2024-04-23T14:14:11.299 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T14:14:11.299 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} --name rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/orig.config.yaml 2024-04-23T14:14:11.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T14:14:11.458 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558 branch: wip-rishabh-testing-20240416.193735-3 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '7669558' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - SLOW_OPS - slow request sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735-3 sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7954 sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d44fddd910b5e94da0f2357af4be37d7bd495ae0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTi99oxamSC7wnm1akxwgPqUTM5Q2eNYXeJtv0CuMGrRdZcTJV4pajIpMOsD/XzF2n2aJwQkJ6Iihh167uGAgk= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOPjTCAgQ2s4Z1JRC83Ht1EysK0I8seOsYfWPx6VggU01TY2UulHB2P6jKoItXmMJKc2favLSyifXwWneaXdnE= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1X5IYqrqjkXgkuxnlHqAeRBnJF0eD7SLpEQzyPGJlq8V2SzxV5Dg3b8Ttk/oGmo7NOLlyeqLCLJvnrfv2VwyQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_14:04:26 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T14:14:11.458 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d44fddd910b5e94da0f2357af4be37d7bd495ae0/qa; will attempt to use it 2024-04-23T14:14:11.459 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d44fddd910b5e94da0f2357af4be37d7bd495ae0/qa/tasks 2024-04-23T14:14:11.459 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T14:14:11.461 INFO:teuthology.task.internal:Checking packages... 2024-04-23T14:14:11.486 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd44fddd910b5e94da0f2357af4be37d7bd495ae0' 2024-04-23T14:14:11.486 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:14:11.486 INFO:teuthology.packaging:ref: None 2024-04-23T14:14:11.486 INFO:teuthology.packaging:tag: None 2024-04-23T14:14:11.487 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735-3 2024-04-23T14:14:11.487 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:14:11.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735-3 2024-04-23T14:14:11.629 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3126.gd44fddd9 2024-04-23T14:14:11.630 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T14:14:11.637 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T14:14:11.638 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T14:14:11.671 INFO:teuthology.task.internal:Saving configuration 2024-04-23T14:14:11.692 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T14:14:11.698 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T14:14:11.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 14:05:31.695635', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTi99oxamSC7wnm1akxwgPqUTM5Q2eNYXeJtv0CuMGrRdZcTJV4pajIpMOsD/XzF2n2aJwQkJ6Iihh167uGAgk='} 2024-04-23T14:14:11.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 14:05:31.693748', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOPjTCAgQ2s4Z1JRC83Ht1EysK0I8seOsYfWPx6VggU01TY2UulHB2P6jKoItXmMJKc2favLSyifXwWneaXdnE='} 2024-04-23T14:14:11.767 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 14:05:31.696742', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1X5IYqrqjkXgkuxnlHqAeRBnJF0eD7SLpEQzyPGJlq8V2SzxV5Dg3b8Ttk/oGmo7NOLlyeqLCLJvnrfv2VwyQ='} 2024-04-23T14:14:11.767 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T14:14:11.774 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-23T14:14:11.774 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-23T14:14:11.774 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-23T14:14:11.774 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T14:14:11.899 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1036927160>, signals=[15]) 2024-04-23T14:14:11.900 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T14:14:11.906 INFO:teuthology.task.internal:Opening connections... 2024-04-23T14:14:11.906 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:14:11.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:14:11.986 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T14:14:11.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:14:12.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-04-23T14:14:12.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:14:12.138 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T14:14:12.145 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-04-23T14:14:12.164 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-04-23T14:14:12.165 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-04-23T14:14:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-04-23T14:14:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-04-23T14:14:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-04-23T14:14:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-04-23T14:14:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-04-23T14:14:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T14:14:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T14:14:12.224 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-04-23T14:14:12.258 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-23T14:14:12.276 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-23T14:14:12.276 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-23T14:14:12.334 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T14:14:12.335 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T14:14:12.335 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T14:14:12.335 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-23T14:14:12.358 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-04-23T14:14:12.376 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-04-23T14:14:12.376 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-04-23T14:14:12.433 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T14:14:12.434 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T14:14:12.435 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-04-23T14:14:12.458 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T14:14:12.472 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T14:14:12.496 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T14:14:12.497 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-04-23T14:14:12.500 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-23T14:14:12.502 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-04-23T14:14:12.518 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T14:14:12.524 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T14:14:12.525 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-04-23T14:14:12.557 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-23T14:14:12.559 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-04-23T14:14:12.648 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T14:14:12.724 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T14:14:12.739 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-23T14:14:12.739 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-23T14:14:12.739 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T14:14:12.740 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T14:14:12.740 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T14:14:12.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:14:12.757 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.757 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-23T14:14:12.757 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-23T14:14:12.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:14:12.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:14:12.759 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.759 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-23T14:14:12.759 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-04-23T14:14:12.759 DEBUG:teuthology.task.kernel:sha1 for mon.c is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.759 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-23T14:14:12.759 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-23T14:14:12.814 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-437.el9.x86_64 2024-04-23T14:14:12.814 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.815 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-23T14:14:12.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-437.el9.x86_64 2024-04-23T14:14:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-437.el9.x86_64 2024-04-23T14:14:12.819 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.820 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-23T14:14:12.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.821 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.821 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-23T14:14:12.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:12.960 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum upgrade -y linux-firmware 2024-04-23T14:14:12.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum upgrade -y linux-firmware 2024-04-23T14:14:12.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum upgrade -y linux-firmware 2024-04-23T14:14:16.539 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:02 2024-04-23T14:14:16.680 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.0 MB 00:02 2024-04-23T14:14:17.062 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.0 MB 00:02 2024-04-23T14:14:18.530 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-23T14:14:20.434 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 19 MB 00:02 2024-04-23T14:14:20.772 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-04-23T14:14:25.285 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.2 MB 00:01 2024-04-23T14:14:25.815 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-04-23T14:14:27.440 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-23T14:14:27.480 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 16 kB 00:00 2024-04-23T14:14:28.479 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-23T14:14:30.427 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 21 MB 00:02 2024-04-23T14:14:30.830 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 730 kB/s | 6.2 MB 00:08 2024-04-23T14:14:32.698 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-23T14:14:33.737 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-23T14:14:34.084 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-23T14:14:35.541 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-23T14:14:35.873 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-04-23T14:14:35.874 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2024-04-23T14:14:35.874 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-04-23T14:14:35.985 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-23T14:14:35.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:36.202 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-23T14:14:36.202 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-23T14:14:36.205 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi007.front.sepia.ceph.com to complete... 2024-04-23T14:14:37.522 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-23T14:14:37.523 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-23T14:14:37.523 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-23T14:14:37.641 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-04-23T14:14:37.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:37.856 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-23T14:14:37.856 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-23T14:14:37.859 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi186.front.sepia.ceph.com to complete... 2024-04-23T14:14:39.165 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-23T14:14:41.077 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-23T14:14:41.078 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-23T14:14:41.078 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-23T14:14:41.176 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-23T14:14:41.176 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:41.316 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-23T14:14:41.316 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-23T14:14:41.319 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-04-23T14:20:18.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23 14:20:18 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-23T14:20:18.967 INFO:teuthology.orchestra.run.smithi007.stderr:FINISHED --2024-04-23 14:20:18-- 2024-04-23T14:20:18.967 INFO:teuthology.orchestra.run.smithi007.stderr:Total wall clock time: 5m 43s 2024-04-23T14:20:18.967 INFO:teuthology.orchestra.run.smithi007.stderr:Downloaded: 1 files, 341M in 5m 42s (1020 KB/s) 2024-04-23T14:20:18.970 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-23T14:20:18.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-23T14:20:21.188 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying... ######################################## 2024-04-23T14:20:21.342 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing... ######################################## 2024-04-23T14:20:21.453 INFO:teuthology.orchestra.run.smithi007.stdout:Updating / installing... 2024-04-23T14:20:29.855 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-23T14:21:08.124 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-23T14:21:08.124 DEBUG:teuthology.orchestra.run.smithi007:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-23T14:21:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-23T14:21:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-23T14:21:08.215 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-23T14:21:08.216 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-23T14:21:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-23T14:21:08.218 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-23T14:21:08.219 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-23T14:21:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-23T14:21:08.221 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-23T14:21:08.222 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-23T14:21:08.223 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-23T14:21:08.225 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-23T14:21:08.225 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-23T14:21:08.225 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-23T14:21:08.225 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-23T14:21:08.226 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-23T14:21:08.227 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-23T14:21:08.228 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-23T14:21:08.229 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-23T14:21:08.230 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-23T14:21:08.231 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-23T14:21:08.232 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-23T14:21:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-23T14:21:08.234 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-23T14:21:08.235 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-23T14:21:08.236 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-23T14:21:08.237 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-23T14:21:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-23T14:21:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-23T14:21:08.240 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-23T14:21:08.241 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-23T14:21:08.242 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-23T14:21:08.243 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-23T14:21:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-23T14:21:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-23T14:21:08.246 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-23T14:21:08.247 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-23T14:21:08.248 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-23T14:21:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-23T14:21:08.250 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-23T14:21:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-23T14:21:08.252 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-23T14:21:08.253 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-23T14:21:08.254 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-23T14:21:08.255 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-23T14:21:08.256 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-23T14:21:08.257 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-23T14:21:08.258 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-23T14:21:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-23T14:21:08.260 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-23T14:21:08.261 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-23T14:21:08.262 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-23T14:21:08.263 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-23T14:21:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-23T14:21:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-23T14:21:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-23T14:21:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-23T14:21:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-23T14:21:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-23T14:21:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-23T14:21:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-23T14:21:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-23T14:21:08.273 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-23T14:21:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-23T14:21:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-23T14:21:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-23T14:21:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-23T14:21:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-23T14:21:08.279 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-23T14:21:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-23T14:21:08.281 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-23T14:21:08.282 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-23T14:21:08.283 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-23T14:21:08.284 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-23T14:21:08.285 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-23T14:21:08.286 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-23T14:21:08.287 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-23T14:21:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-23T14:21:08.289 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-23T14:21:08.290 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-23T14:21:08.291 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-23T14:21:08.292 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-23T14:21:08.293 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-23T14:21:08.294 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-23T14:21:08.295 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-23T14:21:08.296 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-23T14:21:08.297 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-23T14:21:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-23T14:21:08.299 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-23T14:21:08.300 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-23T14:21:08.301 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-23T14:21:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-23T14:21:08.303 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-23T14:21:08.304 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-23T14:21:08.305 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-23T14:21:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-23T14:21:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-23T14:21:08.308 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-23T14:21:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-23T14:21:08.310 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-23T14:21:08.311 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-23T14:21:08.312 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-23T14:21:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-23T14:21:08.314 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-23T14:21:08.315 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-23T14:21:08.316 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-23T14:21:08.317 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-23T14:21:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-23T14:21:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-23T14:21:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-23T14:21:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-23T14:21:08.322 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-23T14:21:08.323 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-23T14:21:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-23T14:21:08.325 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-23T14:21:08.326 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-23T14:21:08.327 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-23T14:21:08.328 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-23T14:21:08.329 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-23T14:21:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-23T14:21:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-23T14:21:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-23T14:21:08.333 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-23T14:21:08.334 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-23T14:21:08.335 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-23T14:21:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-23T14:21:08.337 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-23T14:21:08.338 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-23T14:21:08.339 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-23T14:21:08.340 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-23T14:21:08.341 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-23T14:21:08.342 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-23T14:21:08.343 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-23T14:21:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-23T14:21:08.345 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-23T14:21:08.346 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-23T14:21:08.347 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-23T14:21:08.348 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-23T14:21:08.349 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-23T14:21:08.350 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:21:08.354 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.354 DEBUG:teuthology.orchestra.run.smithi007:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-23T14:21:08.377 INFO:teuthology.orchestra.run.smithi007.stdout:postinstall scriptlet (using /bin/sh): 2024-04-23T14:21:08.377 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:21:08.377 INFO:teuthology.orchestra.run.smithi007.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:21:08.377 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-04-23T14:21:08.377 INFO:teuthology.orchestra.run.smithi007.stdout:for file in vmlinuz System.map config; do 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: fi 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-04-23T14:21:08.378 INFO:teuthology.orchestra.run.smithi007.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-23T14:21:08.379 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:21:08.379 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.379 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-04-23T14:21:08.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 68.el9 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8264254 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-23T14:21:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:21:08.454 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-04-23T14:21:08.455 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-23T14:21:08.455 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:08.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-23T14:21:09.011 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-04-23T14:21:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-23T14:21:10.452 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-04-23T14:21:10.455 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-04-23T14:21:10.473 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.Bzow6woIi8 2024-04-23T14:21:10.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Bzow6woIi8 2024-04-23T14:21:10.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.Bzow6woIi8 2024-04-23T14:21:10.684 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.Bzow6woIi8 is 6KB 2024-04-23T14:21:10.732 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.Bzow6woIi8 2024-04-23T14:21:10.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-04-23T14:21:10.818 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-23T14:21:10.818 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-23T14:21:10.818 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-23T14:21:10.818 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-23T14:21:10.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-23T14:21:10.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-04-23T14:21:40.994 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-23T14:21:40.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-23T14:21:40.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:21:59.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-23T14:22:08.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-23T14:22:08.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:22:10.608 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23 14:22:10 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-23T14:22:10.608 INFO:teuthology.orchestra.run.smithi186.stderr:FINISHED --2024-04-23 14:22:10-- 2024-04-23T14:22:10.609 INFO:teuthology.orchestra.run.smithi186.stderr:Total wall clock time: 7m 33s 2024-04-23T14:22:10.609 INFO:teuthology.orchestra.run.smithi186.stderr:Downloaded: 1 files, 341M in 7m 32s (772 KB/s) 2024-04-23T14:22:10.612 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-04-23T14:22:10.612 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-23T14:22:12.722 INFO:teuthology.orchestra.run.smithi186.stdout:Verifying... ######################################## 2024-04-23T14:22:12.865 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing... ######################################## 2024-04-23T14:22:12.981 INFO:teuthology.orchestra.run.smithi186.stdout:Updating / installing... 2024-04-23T14:22:21.110 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-23T14:22:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23 14:22:30 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-23T14:22:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2024-04-23 14:22:30-- 2024-04-23T14:22:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 7m 50s 2024-04-23T14:22:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 341M in 7m 49s (744 KB/s) 2024-04-23T14:22:30.952 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-23T14:22:30.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-23T14:22:33.068 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying... ######################################## 2024-04-23T14:22:33.192 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing... ######################################## 2024-04-23T14:22:33.301 INFO:teuthology.orchestra.run.smithi137.stdout:Updating / installing... 2024-04-23T14:22:41.234 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-23T14:22:58.089 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-23T14:22:58.089 DEBUG:teuthology.orchestra.run.smithi186:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-23T14:22:58.168 INFO:teuthology.orchestra.run.smithi186.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-23T14:22:58.169 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-23T14:22:58.170 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-23T14:22:58.171 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-23T14:22:58.172 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-23T14:22:58.173 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-23T14:22:58.174 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-23T14:22:58.175 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-23T14:22:58.176 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-23T14:22:58.177 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-23T14:22:58.178 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-23T14:22:58.179 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-23T14:22:58.180 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-23T14:22:58.181 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-23T14:22:58.182 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-23T14:22:58.183 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-23T14:22:58.184 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-23T14:22:58.185 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-23T14:22:58.186 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-23T14:22:58.187 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-23T14:22:58.187 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-23T14:22:58.189 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-23T14:22:58.189 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-23T14:22:58.190 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-23T14:22:58.191 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-23T14:22:58.192 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-23T14:22:58.193 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-23T14:22:58.194 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-23T14:22:58.195 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-23T14:22:58.196 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-23T14:22:58.197 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-23T14:22:58.198 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-23T14:22:58.199 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-23T14:22:58.200 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-23T14:22:58.201 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-23T14:22:58.202 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-23T14:22:58.203 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-23T14:22:58.204 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-23T14:22:58.205 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-23T14:22:58.206 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-23T14:22:58.207 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-23T14:22:58.208 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-23T14:22:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-23T14:22:58.210 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-23T14:22:58.211 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-23T14:22:58.212 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-23T14:22:58.213 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-23T14:22:58.214 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-23T14:22:58.215 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-23T14:22:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-23T14:22:58.217 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-23T14:22:58.218 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-23T14:22:58.219 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-23T14:22:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-23T14:22:58.221 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-23T14:22:58.222 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-23T14:22:58.223 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-23T14:22:58.224 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-23T14:22:58.225 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-23T14:22:58.226 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-23T14:22:58.227 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-23T14:22:58.228 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-23T14:22:58.229 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-23T14:22:58.230 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-23T14:22:58.231 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-23T14:22:58.232 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-23T14:22:58.233 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-23T14:22:58.234 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-23T14:22:58.235 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-23T14:22:58.236 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-23T14:22:58.237 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-23T14:22:58.238 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-23T14:22:58.239 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-23T14:22:58.240 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-23T14:22:58.241 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-23T14:22:58.242 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-23T14:22:58.243 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-23T14:22:58.244 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-23T14:22:58.245 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-23T14:22:58.246 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-23T14:22:58.247 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-23T14:22:58.248 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-23T14:22:58.249 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-23T14:22:58.250 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-23T14:22:58.251 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-23T14:22:58.252 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-23T14:22:58.253 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-23T14:22:58.254 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-23T14:22:58.255 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-23T14:22:58.256 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-23T14:22:58.257 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-23T14:22:58.258 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-23T14:22:58.259 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-23T14:22:58.260 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-23T14:22:58.261 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-23T14:22:58.262 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-23T14:22:58.263 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-23T14:22:58.264 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-23T14:22:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-23T14:22:58.266 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-23T14:22:58.267 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-23T14:22:58.268 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-23T14:22:58.269 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-23T14:22:58.270 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-23T14:22:58.271 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-23T14:22:58.272 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-23T14:22:58.273 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-23T14:22:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-23T14:22:58.275 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-23T14:22:58.276 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-23T14:22:58.277 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-23T14:22:58.278 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-23T14:22:58.279 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-23T14:22:58.280 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-23T14:22:58.281 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-23T14:22:58.282 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-23T14:22:58.283 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-23T14:22:58.284 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-23T14:22:58.285 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-23T14:22:58.286 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-23T14:22:58.287 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-23T14:22:58.288 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-23T14:22:58.289 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-23T14:22:58.290 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-23T14:22:58.291 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-23T14:22:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-23T14:22:58.293 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-23T14:22:58.294 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-23T14:22:58.295 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-23T14:22:58.296 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-23T14:22:58.297 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-23T14:22:58.298 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-23T14:22:58.299 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-23T14:22:58.300 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-23T14:22:58.301 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-23T14:22:58.302 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-23T14:22:58.303 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-23T14:22:58.304 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-23T14:22:58.305 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-23T14:22:58.306 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-23T14:22:58.307 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-23T14:22:58.308 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-23T14:22:58.308 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:22:58.311 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.311 DEBUG:teuthology.orchestra.run.smithi186:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout:postinstall scriptlet (using /bin/sh): 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout:for file in vmlinuz System.map config; do 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:22:58.335 INFO:teuthology.orchestra.run.smithi186.stdout: fi 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:done 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-23T14:22:58.336 INFO:teuthology.orchestra.run.smithi186.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:22:58.337 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.337 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2024-04-23T14:22:58.338 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -qi grub2-tools 2024-04-23T14:22:58.411 INFO:teuthology.orchestra.run.smithi186.stdout:Name : grub2-tools 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Epoch : 1 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Version : 2.06 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Release : 68.el9 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: x86_64 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Group : Unspecified 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Size : 8264254 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:License : GPLv3+ 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-23T14:22:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Packager : builder@centos.org 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:Vendor : CentOS 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:Summary : Support tools for GRUB. 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:Description : 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:hardware devices. 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:22:58.413 INFO:teuthology.orchestra.run.smithi186.stdout:This subpackage provides tools for support of all platforms. 2024-04-23T14:22:58.414 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-23T14:22:58.414 INFO:teuthology.task.kernel:Updating grub on smithi186 to boot 6.9.0-rc3-g806ec36b2112 2024-04-23T14:22:58.414 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-23T14:22:58.957 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2024-04-23T14:23:00.295 INFO:teuthology.orchestra.run.smithi186.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-23T14:23:00.324 INFO:teuthology.orchestra.run.smithi186.stderr:done 2024-04-23T14:23:00.326 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-23T14:23:00.346 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.hxOhI0Jwr1 2024-04-23T14:23:00.347 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hxOhI0Jwr1 2024-04-23T14:23:00.420 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.hxOhI0Jwr1 2024-04-23T14:23:00.560 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.hxOhI0Jwr1 is 6KB 2024-04-23T14:23:00.608 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.hxOhI0Jwr1 2024-04-23T14:23:00.623 DEBUG:teuthology.orchestra.run.smithi186:> sudo /bin/ls /boot/loader/entries || true 2024-04-23T14:23:00.684 INFO:teuthology.orchestra.run.smithi186.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-23T14:23:00.684 INFO:teuthology.orchestra.run.smithi186.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-23T14:23:00.684 INFO:teuthology.orchestra.run.smithi186.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-23T14:23:00.684 INFO:teuthology.orchestra.run.smithi186.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-23T14:23:00.685 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:00.829 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2024-04-23T14:23:08.459 DEBUG:teuthology.orchestra.remote:timed out 2024-04-23T14:23:18.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-23T14:23:18.486 DEBUG:teuthology.orchestra.run.smithi137:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-23T14:23:18.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-23T14:23:18.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-23T14:23:18.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-23T14:23:18.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-23T14:23:18.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-23T14:23:18.571 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-23T14:23:18.572 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-23T14:23:18.573 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-23T14:23:18.574 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-23T14:23:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-23T14:23:18.576 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-23T14:23:18.577 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-23T14:23:18.578 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-23T14:23:18.579 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-23T14:23:18.580 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-23T14:23:18.581 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-23T14:23:18.582 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-23T14:23:18.583 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-23T14:23:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-23T14:23:18.585 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-23T14:23:18.586 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-23T14:23:18.587 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-23T14:23:18.588 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-23T14:23:18.589 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-23T14:23:18.590 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-23T14:23:18.591 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-23T14:23:18.592 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-23T14:23:18.593 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-23T14:23:18.594 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-23T14:23:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-23T14:23:18.596 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-23T14:23:18.597 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-23T14:23:18.598 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-23T14:23:18.599 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-23T14:23:18.600 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-23T14:23:18.601 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-23T14:23:18.602 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-23T14:23:18.603 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-23T14:23:18.604 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-23T14:23:18.605 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-23T14:23:18.606 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-23T14:23:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-23T14:23:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-23T14:23:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-23T14:23:18.610 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-23T14:23:18.611 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-23T14:23:18.612 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-23T14:23:18.613 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-23T14:23:18.614 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-23T14:23:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-23T14:23:18.616 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-23T14:23:18.616 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-23T14:23:18.616 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-23T14:23:18.616 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-23T14:23:18.617 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-23T14:23:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-23T14:23:18.619 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-23T14:23:18.620 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-23T14:23:18.621 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-23T14:23:18.622 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-23T14:23:18.623 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-23T14:23:18.624 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-23T14:23:18.625 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-23T14:23:18.626 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-23T14:23:18.627 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-23T14:23:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-23T14:23:18.629 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-23T14:23:18.630 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-23T14:23:18.631 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-23T14:23:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-23T14:23:18.633 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-23T14:23:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-23T14:23:18.635 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-23T14:23:18.636 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-23T14:23:18.637 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-23T14:23:18.638 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-23T14:23:18.639 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-23T14:23:18.640 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-23T14:23:18.641 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-23T14:23:18.642 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-23T14:23:18.643 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-23T14:23:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-23T14:23:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-23T14:23:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-23T14:23:18.647 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-23T14:23:18.648 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-23T14:23:18.649 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-23T14:23:18.650 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-23T14:23:18.651 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-23T14:23:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-23T14:23:18.653 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-23T14:23:18.654 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-23T14:23:18.655 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-23T14:23:18.656 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-23T14:23:18.657 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-23T14:23:18.658 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-23T14:23:18.659 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-23T14:23:18.660 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-23T14:23:18.661 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-23T14:23:18.662 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-23T14:23:18.663 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-23T14:23:18.664 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-23T14:23:18.665 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-23T14:23:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-23T14:23:18.667 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-23T14:23:18.668 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-23T14:23:18.669 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-23T14:23:18.670 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-23T14:23:18.671 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-23T14:23:18.672 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-23T14:23:18.673 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-23T14:23:18.674 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-23T14:23:18.675 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-23T14:23:18.676 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-23T14:23:18.677 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-23T14:23:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-23T14:23:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-23T14:23:18.681 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-23T14:23:18.681 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-23T14:23:18.681 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-23T14:23:18.681 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-23T14:23:18.681 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-23T14:23:18.681 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-23T14:23:18.682 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-23T14:23:18.683 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-23T14:23:18.684 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-23T14:23:18.685 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-23T14:23:18.686 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-23T14:23:18.687 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-23T14:23:18.688 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-23T14:23:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-23T14:23:18.690 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-23T14:23:18.691 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-23T14:23:18.692 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-23T14:23:18.693 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-23T14:23:18.694 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-23T14:23:18.695 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-23T14:23:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-23T14:23:18.697 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-23T14:23:18.698 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-23T14:23:18.699 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-23T14:23:18.700 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-23T14:23:18.701 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-23T14:23:18.702 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-23T14:23:18.703 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-23T14:23:18.704 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-23T14:23:18.705 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-23T14:23:18.706 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-23T14:23:18.707 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-23T14:23:18.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-23T14:23:18.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-23T14:23:18.708 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-23T14:23:18.709 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-23T14:23:18.710 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-23T14:23:18.711 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-23T14:23:18.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-23T14:23:18.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-23T14:23:18.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-23T14:23:18.712 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:23:18.715 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.716 DEBUG:teuthology.orchestra.run.smithi137:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout:postinstall scriptlet (using /bin/sh): 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout:for file in vmlinuz System.map config; do 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout: fi 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-04-23T14:23:18.739 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.740 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-23T14:23:18.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 68.el9 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8264254 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-23T14:23:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:23:18.824 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-04-23T14:23:18.825 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-23T14:23:18.825 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:18.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-23T14:23:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-04-23T14:23:20.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-23T14:23:20.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:23:20.728 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-23T14:23:20.750 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-04-23T14:23:20.751 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-23T14:23:20.790 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.TzQJ3Dxg4M 2024-04-23T14:23:20.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TzQJ3Dxg4M 2024-04-23T14:23:20.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.TzQJ3Dxg4M 2024-04-23T14:23:20.872 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-04-23T14:23:21.000 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.TzQJ3Dxg4M is 6KB 2024-04-23T14:23:21.049 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.TzQJ3Dxg4M 2024-04-23T14:23:21.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-04-23T14:23:21.133 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-23T14:23:21.134 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-23T14:23:21.134 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-23T14:23:21.134 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-23T14:23:21.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:21.327 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-04-23T14:23:21.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-23T14:23:21.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-23T14:23:21.483 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-04-23T14:23:21.534 INFO:teuthology.orchestra.run.smithi007.stdout:6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:21.535 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:21.535 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T14:23:21.535 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-23T14:23:22.535 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T14:23:22.536 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T14:23:22.662 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2024-04-23T14:23:22.710 DEBUG:teuthology.parallel:result is None 2024-04-23T14:23:30.832 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-04-23T14:23:30.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:23:30.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:23:49.278 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-23T14:23:51.330 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-23T14:23:51.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:23:51.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:23:58.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:23:58.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:01.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-23T14:24:09.760 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-23T14:24:13.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:24:13.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:18.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:24:18.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:21.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-23T14:24:31.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-23T14:24:33.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:24:33.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:46.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:24:46.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:48.538 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-23T14:24:49.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:24:49.193 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-g806ec36b2112"... 2024-04-23T14:24:49.193 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-23T14:24:49.237 INFO:teuthology.orchestra.run.smithi186.stdout:6.9.0-rc3-g806ec36b2112 2024-04-23T14:24:49.237 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-23T14:24:49.237 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T14:24:49.238 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-23T14:24:50.238 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-04-23T14:24:50.238 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T14:24:50.391 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2024-04-23T14:24:50.451 DEBUG:teuthology.parallel:result is None 2024-04-23T14:24:52.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-23T14:25:07.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:25:07.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:25:07.985 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-23T14:25:08.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:25:08.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-23T14:25:08.499 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-23T14:25:08.541 INFO:teuthology.orchestra.run.smithi137.stdout:6.9.0-rc3-g806ec36b2112 2024-04-23T14:25:08.541 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-23T14:25:08.542 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T14:25:08.542 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-23T14:25:09.542 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-23T14:25:09.542 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T14:25:09.678 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-04-23T14:25:09.752 DEBUG:teuthology.parallel:result is None 2024-04-23T14:25:09.752 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T14:25:09.763 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T14:25:09.764 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T14:25:09.772 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T14:25:09.780 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T14:25:09.838 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T14:25:09.847 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T14:25:09.872 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T14:25:09.872 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T14:25:09.880 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T14:25:09.887 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T14:25:09.964 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T14:25:09.974 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T14:25:09.974 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T14:25:09.984 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T14:25:09.990 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T14:25:10.063 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:10.073 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:10.088 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:10.091 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:10.105 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:10.119 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:10.124 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T14:25:10.136 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T14:25:10.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T14:25:10.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T14:25:10.147 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T14:25:10.234 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T14:25:10.245 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T14:25:10.245 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T14:25:10.251 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T14:25:10.256 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T14:25:10.312 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:10.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:10.505 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:10.590 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:10.679 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:25:10.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T14:25:10.764 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:10.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:10.919 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:10.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:11.064 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:25:11.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T14:25:11.128 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:11.219 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:11.316 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:11.397 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:11.480 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:25:11.480 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T14:25:11.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-04-23T14:25:11.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-23T14:25:11.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-04-23T14:25:11.674 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T14:25:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T14:25:11.716 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T14:25:12.166 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T14:25:12.176 INFO:teuthology.task.internal:Starting timer... 2024-04-23T14:25:12.176 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T14:25:12.225 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T14:25:12.258 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-23T14:25:12.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-04-23T14:25:12.436 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-04-23T14:25:12.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-04-23T14:25:12.546 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-04-23T14:25:12.549 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-04-23T14:25:12.703 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-04-23T14:25:12.708 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T14:25:12.708 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-04-23T14:25:12.789 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-04-23T14:25:12.789 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-04-23T14:25:12.837 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-04-23T14:25:12.837 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-04-23T14:25:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-04-23T14:25:12.894 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2024-04-23T14:25:12.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T14:25:12.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:25:12.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T14:25:13.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:25:13.043 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T14:25:13.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:25:13.125 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T14:25:13.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-04-23T14:25:13.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-04-23T14:25:13.265 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-04-23T14:25:13.347 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T14:25:13.359 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T14:25:13.391 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T14:25:13.393 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi137.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T14:30:35.687 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-04-23T14:30:35.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-23T14:30:35.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:30:35.802 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-04-23T14:30:35.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-23T14:30:35.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:30:35.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:30:36.086 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-23T14:30:36.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T14:30:36.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:30:36.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:30:36.341 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-23T14:30:36.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-23T14:30:36.493 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T14:30:36.504 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T14:30:36.505 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T14:30:36.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T14:30:36.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T14:30:36.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T14:30:36.521 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T14:30:36.521 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T14:30:36.605 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T14:30:36.607 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T14:30:36.613 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T14:30:36.649 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T14:30:36.652 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T14:30:36.654 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T14:30:36.721 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-04-23T14:30:36.728 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-04-23T14:30:36.735 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-04-23T14:30:36.751 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-04-23T14:30:36.756 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-04-23T14:30:36.769 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-04-23T14:30:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T14:30:36.792 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T14:30:36.811 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T14:30:36.828 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T14:30:36.833 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T14:30:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T14:30:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-23T14:30:36.972 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-04-23T14:30:36.980 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T14:30:36.980 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-23T14:30:36.980 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.980 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.981 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.982 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:36.994 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-04-23T14:30:37.003 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T14:30:37.003 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-04-23T14:30:37.003 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:37.003 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:37.003 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:37.003 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:37.005 INFO:teuthology.run_tasks:Running task install... 2024-04-23T14:30:37.013 DEBUG:teuthology.task.install:project ceph 2024-04-23T14:30:37.013 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'}} 2024-04-23T14:30:37.013 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'} 2024-04-23T14:30:37.013 INFO:teuthology.task.install:Using flavor: default 2024-04-23T14:30:37.019 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T14:30:37.019 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-23T14:30:37.020 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'tag': None, 'wait_for_package': False} 2024-04-23T14:30:37.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:37.023 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'tag': None, 'wait_for_package': False} 2024-04-23T14:30:37.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:37.024 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'tag': None, 'wait_for_package': False} 2024-04-23T14:30:37.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:37.167 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/ 2024-04-23T14:30:37.167 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3126.gd44fddd9 2024-04-23T14:30:37.180 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/ 2024-04-23T14:30:37.180 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3126.gd44fddd9 2024-04-23T14:30:37.365 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/ 2024-04-23T14:30:37.365 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3126.gd44fddd9 2024-04-23T14:30:37.479 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T14:30:37.479 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:30:37.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T14:30:37.572 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-23T14:30:37.572 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d44fddd910b5e94da0f2357af4be37d7bd495ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T14:30:37.635 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T14:30:37.635 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:30:37.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T14:30:37.661 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T14:30:37.661 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:30:37.661 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T14:30:37.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T14:30:37.724 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-23T14:30:37.725 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d44fddd910b5e94da0f2357af4be37d7bd495ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T14:30:37.750 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-23T14:30:37.750 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d44fddd910b5e94da0f2357af4be37d7bd495ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T14:30:37.826 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T14:30:37.853 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T14:30:37.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T14:30:37.909 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-04-23T14:30:37.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-04-23T14:30:37.967 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T14:30:37.980 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T14:30:38.041 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-04-23T14:30:38.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-04-23T14:30:38.060 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-04-23T14:30:38.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-04-23T14:30:38.248 INFO:teuthology.orchestra.run.smithi007.stdout:48 files removed 2024-04-23T14:30:38.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-23T14:30:38.353 INFO:teuthology.orchestra.run.smithi186.stdout:48 files removed 2024-04-23T14:30:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:48 files removed 2024-04-23T14:30:38.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-23T14:30:38.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-23T14:30:39.506 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 109 kB/s | 83 kB 00:00 2024-04-23T14:30:39.743 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 91 kB/s | 83 kB 00:00 2024-04-23T14:30:39.819 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 86 kB/s | 83 kB 00:00 2024-04-23T14:30:40.474 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 13 kB/s | 12 kB 00:00 2024-04-23T14:30:40.535 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-04-23T14:30:40.944 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 11 kB/s | 12 kB 00:01 2024-04-23T14:30:41.535 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-04-23T14:30:41.566 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 1.9 kB/s | 1.9 kB 00:01 2024-04-23T14:30:41.844 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2024-04-23T14:30:42.876 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.0 MB 00:00 2024-04-23T14:30:42.975 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-04-23T14:30:46.942 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 19 MB 00:02 2024-04-23T14:30:47.518 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-04-23T14:30:51.344 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-23T14:30:51.812 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 811 kB/s | 8.0 MB 00:10 2024-04-23T14:30:53.302 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-23T14:30:53.964 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-23T14:30:55.294 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-23T14:31:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 720 kB/s | 6.2 MB 00:08 2024-04-23T14:31:01.245 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-23T14:31:01.935 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-23T14:31:03.150 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 6.2 MB 00:05 2024-04-23T14:31:03.595 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T14:31:03.597 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T14:31:03.617 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-23T14:31:03.618 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-23T14:31:03.619 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-23T14:31:03.620 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-23T14:31:03.623 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-23T14:31:03.626 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-23T14:31:03.627 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-23T14:31:03.698 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout:======================================================================================= 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout:======================================================================================= 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 6.6 k 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 5.4 M 2024-04-23T14:31:03.725 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 891 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 145 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 1.5 M 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 142 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 3.5 M 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 7.4 M 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 49 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 11 M 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 49 M 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 273 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 762 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 225 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 27 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 18 k 2024-04-23T14:31:03.726 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 32 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 746 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 127 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-23T14:31:03.727 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 161 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 320 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 297 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 100 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 85 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.1 M 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 171 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.4 M 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.1 M 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-23T14:31:03.728 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 21 M 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 34 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 2.4 M 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 249 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 4.7 M 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 17 M 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 16 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 25 k 2024-04-23T14:31:03.729 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 163 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T14:31:03.730 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 500 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 5.4 M 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T14:31:03.731 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 45 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 135 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T14:31:03.732 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T14:31:03.733 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T14:31:03.734 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-23T14:31:03.735 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T14:31:03.736 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout:Installing weak dependencies: 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-23T14:31:03.737 INFO:teuthology.orchestra.run.smithi186.stdout:======================================================================================= 2024-04-23T14:31:03.738 INFO:teuthology.orchestra.run.smithi186.stdout:Install 148 Packages 2024-04-23T14:31:03.738 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 4 Packages 2024-04-23T14:31:03.738 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:31:03.738 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 222 M 2024-04-23T14:31:03.738 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-23T14:31:04.789 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-04-23T14:31:04.963 INFO:teuthology.orchestra.run.smithi186.stdout:(1/152): ceph-19.0.0-3126.gd44fddd9.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-04-23T14:31:05.872 INFO:teuthology.orchestra.run.smithi186.stdout:(2/152): ceph-fuse-19.0.0-3126.gd44fddd9.el9.x8 981 kB/s | 891 kB 00:00 2024-04-23T14:31:06.064 INFO:teuthology.orchestra.run.smithi186.stdout:(3/152): ceph-immutable-object-cache-19.0.0-312 759 kB/s | 145 kB 00:00 2024-04-23T14:31:07.034 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-23T14:31:07.439 INFO:teuthology.orchestra.run.smithi186.stdout:(4/152): ceph-mds-19.0.0-3126.gd44fddd9.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-04-23T14:31:08.347 INFO:teuthology.orchestra.run.smithi186.stdout:(5/152): ceph-mgr-19.0.0-3126.gd44fddd9.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-04-23T14:31:08.598 INFO:teuthology.orchestra.run.smithi186.stdout:(6/152): ceph-base-19.0.0-3126.gd44fddd9.el9.x8 1.4 MB/s | 5.4 MB 00:03 2024-04-23T14:31:09.149 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 21 MB 00:07 2024-04-23T14:31:10.206 INFO:teuthology.orchestra.run.smithi186.stdout:(7/152): ceph-common-19.0.0-3126.gd44fddd9.el9. 3.8 MB/s | 21 MB 00:05 2024-04-23T14:31:10.540 INFO:teuthology.orchestra.run.smithi186.stdout:(8/152): ceph-mon-19.0.0-3126.gd44fddd9.el9.x86 2.1 MB/s | 4.7 MB 00:02 2024-04-23T14:31:10.615 INFO:teuthology.orchestra.run.smithi186.stdout:(9/152): ceph-selinux-19.0.0-3126.gd44fddd9.el9 341 kB/s | 25 kB 00:00 2024-04-23T14:31:11.657 INFO:teuthology.orchestra.run.smithi186.stdout:(10/152): ceph-radosgw-19.0.0-3126.gd44fddd9.el 7.3 MB/s | 11 MB 00:01 2024-04-23T14:31:11.757 INFO:teuthology.orchestra.run.smithi186.stdout:(11/152): cephfs-mirror-19.0.0-3126.gd44fddd9.e 2.2 MB/s | 225 kB 00:00 2024-04-23T14:31:11.832 INFO:teuthology.orchestra.run.smithi186.stdout:(12/152): cephfs-shell-19.0.0-3126.gd44fddd9.el 363 kB/s | 27 kB 00:00 2024-04-23T14:31:11.924 INFO:teuthology.orchestra.run.smithi186.stdout:(13/152): libcephfs-devel-19.0.0-3126.gd44fddd9 347 kB/s | 32 kB 00:00 2024-04-23T14:31:12.102 INFO:teuthology.orchestra.run.smithi186.stdout:(14/152): libcephfs2-19.0.0-3126.gd44fddd9.el9. 4.1 MB/s | 746 kB 00:00 2024-04-23T14:31:12.183 INFO:teuthology.orchestra.run.smithi186.stdout:(15/152): libcephsqlite-19.0.0-3126.gd44fddd9.e 2.0 MB/s | 163 kB 00:00 2024-04-23T14:31:12.266 INFO:teuthology.orchestra.run.smithi186.stdout:(16/152): librados-devel-19.0.0-3126.gd44fddd9. 1.5 MB/s | 127 kB 00:00 2024-04-23T14:31:12.409 INFO:teuthology.orchestra.run.smithi186.stdout:(17/152): libradosstriper1-19.0.0-3126.gd44fddd 3.5 MB/s | 500 kB 00:00 2024-04-23T14:31:13.233 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-23T14:31:13.276 INFO:teuthology.orchestra.run.smithi186.stdout:(18/152): librgw2-19.0.0-3126.gd44fddd9.el9.x86 6.2 MB/s | 5.4 MB 00:00 2024-04-23T14:31:13.351 INFO:teuthology.orchestra.run.smithi186.stdout:(19/152): python3-ceph-argparse-19.0.0-3126.gd4 613 kB/s | 45 kB 00:00 2024-04-23T14:31:13.426 INFO:teuthology.orchestra.run.smithi186.stdout:(20/152): python3-ceph-common-19.0.0-3126.gd44f 1.8 MB/s | 135 kB 00:00 2024-04-23T14:31:13.501 INFO:teuthology.orchestra.run.smithi186.stdout:(21/152): python3-cephfs-19.0.0-3126.gd44fddd9. 2.1 MB/s | 161 kB 00:00 2024-04-23T14:31:13.585 INFO:teuthology.orchestra.run.smithi186.stdout:(22/152): python3-rados-19.0.0-3126.gd44fddd9.e 3.8 MB/s | 320 kB 00:00 2024-04-23T14:31:13.669 INFO:teuthology.orchestra.run.smithi186.stdout:(23/152): python3-rbd-19.0.0-3126.gd44fddd9.el9 3.5 MB/s | 297 kB 00:00 2024-04-23T14:31:13.744 INFO:teuthology.orchestra.run.smithi186.stdout:(24/152): python3-rgw-19.0.0-3126.gd44fddd9.el9 1.3 MB/s | 100 kB 00:00 2024-04-23T14:31:13.811 INFO:teuthology.orchestra.run.smithi186.stdout:(25/152): rbd-fuse-19.0.0-3126.gd44fddd9.el9.x8 1.3 MB/s | 85 kB 00:00 2024-04-23T14:31:14.328 INFO:teuthology.orchestra.run.smithi186.stdout:(26/152): rbd-mirror-19.0.0-3126.gd44fddd9.el9. 6.0 MB/s | 3.1 MB 00:00 2024-04-23T14:31:14.411 INFO:teuthology.orchestra.run.smithi186.stdout:(27/152): rbd-nbd-19.0.0-3126.gd44fddd9.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-23T14:31:14.478 INFO:teuthology.orchestra.run.smithi186.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3126.g 521 kB/s | 34 kB 00:00 2024-04-23T14:31:14.562 INFO:teuthology.orchestra.run.smithi186.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3126.gd44fddd 1.7 MB/s | 142 kB 00:00 2024-04-23T14:31:15.061 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-23T14:31:15.062 INFO:teuthology.orchestra.run.smithi186.stdout:(30/152): ceph-osd-19.0.0-3126.gd44fddd9.el9.x8 2.6 MB/s | 17 MB 00:06 2024-04-23T14:31:15.178 INFO:teuthology.orchestra.run.smithi186.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3126.gd44fd 5.7 MB/s | 3.5 MB 00:00 2024-04-23T14:31:15.262 INFO:teuthology.orchestra.run.smithi186.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3126.gd4 2.9 MB/s | 249 kB 00:00 2024-04-23T14:31:15.338 INFO:teuthology.orchestra.run.smithi186.stdout:(33/152): ceph-mgr-rook-19.0.0-3126.gd44fddd9.e 665 kB/s | 49 kB 00:00 2024-04-23T14:31:15.413 INFO:teuthology.orchestra.run.smithi186.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3126.gd 222 kB/s | 16 kB 00:00 2024-04-23T14:31:15.521 INFO:teuthology.orchestra.run.smithi186.stdout:(35/152): ceph-volume-19.0.0-3126.gd44fddd9.el9 2.5 MB/s | 273 kB 00:00 2024-04-23T14:31:15.689 INFO:teuthology.orchestra.run.smithi186.stdout:(36/152): cephadm-19.0.0-3126.gd44fddd9.el9.noa 4.5 MB/s | 762 kB 00:00 2024-04-23T14:31:15.727 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T14:31:15.728 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T14:31:15.750 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-23T14:31:15.751 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-23T14:31:15.753 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-23T14:31:15.754 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-23T14:31:15.757 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-23T14:31:15.760 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-23T14:31:15.762 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-23T14:31:15.780 INFO:teuthology.orchestra.run.smithi186.stdout:(37/152): cephfs-top-19.0.0-3126.gd44fddd9.el9. 201 kB/s | 18 kB 00:00 2024-04-23T14:31:15.837 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 6.6 k 2024-04-23T14:31:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 5.4 M 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 891 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 145 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 1.5 M 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 142 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 3.5 M 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 7.4 M 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 49 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 11 M 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 49 M 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 273 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 762 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 225 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 27 k 2024-04-23T14:31:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 18 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 32 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 746 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 127 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 161 k 2024-04-23T14:31:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 320 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 297 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 100 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 85 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.1 M 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 171 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.4 M 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.1 M 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-23T14:31:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 21 M 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 34 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 2.4 M 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 249 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 4.7 M 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 17 M 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 16 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 25 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T14:31:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 163 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 500 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 5.4 M 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T14:31:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 45 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 135 k 2024-04-23T14:31:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T14:31:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T14:31:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T14:31:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T14:31:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout:Install 148 Packages 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 4 Packages 2024-04-23T14:31:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:31:15.869 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 222 M 2024-04-23T14:31:15.869 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-04-23T14:31:15.906 INFO:teuthology.orchestra.run.smithi186.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 647 kB/s | 80 kB 00:00 2024-04-23T14:31:16.131 INFO:teuthology.orchestra.run.smithi186.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-04-23T14:31:16.223 INFO:teuthology.orchestra.run.smithi186.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-23T14:31:16.332 INFO:teuthology.orchestra.run.smithi186.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-04-23T14:31:16.524 INFO:teuthology.orchestra.run.smithi186.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-04-23T14:31:16.574 INFO:teuthology.orchestra.run.smithi186.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-23T14:31:16.624 INFO:teuthology.orchestra.run.smithi186.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-04-23T14:31:16.674 INFO:teuthology.orchestra.run.smithi186.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-04-23T14:31:16.733 INFO:teuthology.orchestra.run.smithi186.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-23T14:31:17.192 INFO:teuthology.orchestra.run.smithi186.stdout:(47/152): ceph-mgr-diskprediction-local-19.0.0- 3.5 MB/s | 7.4 MB 00:02 2024-04-23T14:31:17.351 INFO:teuthology.orchestra.run.smithi007.stdout:(1/152): ceph-19.0.0-3126.gd44fddd9.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-23T14:31:17.409 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T14:31:17.411 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T14:31:17.429 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-23T14:31:17.430 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-23T14:31:17.431 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-23T14:31:17.432 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-23T14:31:17.434 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-23T14:31:17.437 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-23T14:31:17.438 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-23T14:31:17.442 INFO:teuthology.orchestra.run.smithi186.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 974 kB/s | 689 kB 00:00 2024-04-23T14:31:17.506 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 6.6 k 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 5.4 M 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 891 k 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 145 k 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 1.5 M 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 142 k 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 3.5 M 2024-04-23T14:31:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 7.4 M 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 49 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 11 M 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 49 M 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 273 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 762 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 225 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 27 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 18 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 32 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 746 k 2024-04-23T14:31:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 127 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 161 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 320 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 297 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 100 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 85 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.1 M 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 171 k 2024-04-23T14:31:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.4 M 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 3.1 M 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 21 M 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 34 k 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 2.4 M 2024-04-23T14:31:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 249 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 4.7 M 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 17 M 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3126.gd44fddd9.el9 ceph-noarch 16 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 25 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 163 k 2024-04-23T14:31:17.531 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 500 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 5.4 M 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T14:31:17.532 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 45 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.0.0-3126.gd44fddd9.el9 ceph 135 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T14:31:17.533 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T14:31:17.534 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T14:31:17.535 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T14:31:17.536 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T14:31:17.537 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-23T14:31:17.538 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-23T14:31:17.539 INFO:teuthology.orchestra.run.smithi137.stdout:Install 148 Packages 2024-04-23T14:31:17.539 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 4 Packages 2024-04-23T14:31:17.539 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:31:17.539 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 222 M 2024-04-23T14:31:17.539 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-23T14:31:17.876 INFO:teuthology.orchestra.run.smithi186.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 247 kB/s | 107 kB 00:00 2024-04-23T14:31:17.943 INFO:teuthology.orchestra.run.smithi186.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-04-23T14:31:18.143 INFO:teuthology.orchestra.run.smithi186.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 81 kB/s | 21 kB 00:00 2024-04-23T14:31:18.259 INFO:teuthology.orchestra.run.smithi007.stdout:(2/152): ceph-fuse-19.0.0-3126.gd44fddd9.el9.x8 982 kB/s | 891 kB 00:00 2024-04-23T14:31:18.410 INFO:teuthology.orchestra.run.smithi186.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 123 kB/s | 33 kB 00:00 2024-04-23T14:31:18.451 INFO:teuthology.orchestra.run.smithi007.stdout:(3/152): ceph-immutable-object-cache-19.0.0-312 759 kB/s | 145 kB 00:00 2024-04-23T14:31:18.935 INFO:teuthology.orchestra.run.smithi186.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 316 kB/s | 313 kB 00:00 2024-04-23T14:31:19.096 INFO:teuthology.orchestra.run.smithi137.stdout:(1/152): ceph-19.0.0-3126.gd44fddd9.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-04-23T14:31:19.235 INFO:teuthology.orchestra.run.smithi186.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 61 kB/s | 18 kB 00:00 2024-04-23T14:31:19.452 INFO:teuthology.orchestra.run.smithi186.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 52 kB/s | 11 kB 00:00 2024-04-23T14:31:19.785 INFO:teuthology.orchestra.run.smithi007.stdout:(4/152): ceph-mds-19.0.0-3126.gd44fddd9.el9.x86 1.8 MB/s | 2.4 MB 00:01 2024-04-23T14:31:19.786 INFO:teuthology.orchestra.run.smithi186.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-04-23T14:31:19.986 INFO:teuthology.orchestra.run.smithi186.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 301 kB/s | 160 kB 00:00 2024-04-23T14:31:20.128 INFO:teuthology.orchestra.run.smithi186.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 133 kB/s | 45 kB 00:00 2024-04-23T14:31:20.671 INFO:teuthology.orchestra.run.smithi137.stdout:(2/152): ceph-fuse-19.0.0-3126.gd44fddd9.el9.x8 566 kB/s | 891 kB 00:01 2024-04-23T14:31:20.728 INFO:teuthology.orchestra.run.smithi186.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 972 kB/s | 582 kB 00:00 2024-04-23T14:31:20.785 INFO:teuthology.orchestra.run.smithi007.stdout:(5/152): ceph-mgr-19.0.0-3126.gd44fddd9.el9.x86 1.5 MB/s | 1.5 MB 00:00 2024-04-23T14:31:20.954 INFO:teuthology.orchestra.run.smithi137.stdout:(3/152): ceph-immutable-object-cache-19.0.0-312 513 kB/s | 145 kB 00:00 2024-04-23T14:31:21.003 INFO:teuthology.orchestra.run.smithi186.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 652 kB/s | 662 kB 00:01 2024-04-23T14:31:21.029 INFO:teuthology.orchestra.run.smithi186.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 85 kB/s | 25 kB 00:00 2024-04-23T14:31:21.354 INFO:teuthology.orchestra.run.smithi186.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 136 kB/s | 47 kB 00:00 2024-04-23T14:31:21.854 INFO:teuthology.orchestra.run.smithi186.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 377 kB/s | 188 kB 00:00 2024-04-23T14:31:21.904 INFO:teuthology.orchestra.run.smithi186.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-04-23T14:31:22.130 INFO:teuthology.orchestra.run.smithi186.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 128 kB/s | 35 kB 00:00 2024-04-23T14:31:23.705 INFO:teuthology.orchestra.run.smithi186.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-04-23T14:31:23.793 INFO:teuthology.orchestra.run.smithi007.stdout:(6/152): ceph-mon-19.0.0-3126.gd44fddd9.el9.x86 1.6 MB/s | 4.7 MB 00:03 2024-04-23T14:31:23.946 INFO:teuthology.orchestra.run.smithi137.stdout:(4/152): ceph-mds-19.0.0-3126.gd44fddd9.el9.x86 808 kB/s | 2.4 MB 00:02 2024-04-23T14:31:24.260 INFO:teuthology.orchestra.run.smithi007.stdout:(7/152): ceph-base-19.0.0-3126.gd44fddd9.el9.x8 753 kB/s | 5.4 MB 00:07 2024-04-23T14:31:24.262 INFO:teuthology.orchestra.run.smithi137.stdout:(5/152): ceph-base-19.0.0-3126.gd44fddd9.el9.x8 994 kB/s | 5.4 MB 00:05 2024-04-23T14:31:24.964 INFO:teuthology.orchestra.run.smithi186.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2024-04-23T14:31:25.330 INFO:teuthology.orchestra.run.smithi137.stdout:(6/152): ceph-mgr-19.0.0-3126.gd44fddd9.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-04-23T14:31:26.005 INFO:teuthology.orchestra.run.smithi186.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 1.2 MB/s | 4.7 MB 00:04 2024-04-23T14:31:26.156 INFO:teuthology.orchestra.run.smithi186.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 765 kB/s | 911 kB 00:01 2024-04-23T14:31:26.431 INFO:teuthology.orchestra.run.smithi186.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 314 kB/s | 133 kB 00:00 2024-04-23T14:31:27.215 INFO:teuthology.orchestra.run.smithi186.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-04-23T14:31:27.504 INFO:teuthology.orchestra.run.smithi137.stdout:(7/152): ceph-mon-19.0.0-3126.gd44fddd9.el9.x86 1.4 MB/s | 4.7 MB 00:03 2024-04-23T14:31:27.650 INFO:teuthology.orchestra.run.smithi186.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 202 kB/s | 87 kB 00:00 2024-04-23T14:31:27.998 INFO:teuthology.orchestra.run.smithi186.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 3.1 MB/s | 5.8 MB 00:01 2024-04-23T14:31:28.515 INFO:teuthology.orchestra.run.smithi186.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 473 kB/s | 244 kB 00:00 2024-04-23T14:31:29.265 INFO:teuthology.orchestra.run.smithi186.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 331 kB/s | 248 kB 00:00 2024-04-23T14:31:29.541 INFO:teuthology.orchestra.run.smithi186.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 93 kB/s | 26 kB 00:00 2024-04-23T14:31:29.808 INFO:teuthology.orchestra.run.smithi186.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 72 kB/s | 19 kB 00:00 2024-04-23T14:31:30.366 INFO:teuthology.orchestra.run.smithi186.stdout:(78/152): ceph-test-19.0.0-3126.gd44fddd9.el9.x 2.5 MB/s | 49 MB 00:19 2024-04-23T14:31:30.500 INFO:teuthology.orchestra.run.smithi186.stdout:(79/152): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2024-04-23T14:31:30.692 INFO:teuthology.orchestra.run.smithi186.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 107 kB/s | 35 kB 00:00 2024-04-23T14:31:30.742 INFO:teuthology.orchestra.run.smithi186.stdout:(81/152): python3-mako-1.1.4-6.el9.noarch.rpm 184 kB/s | 172 kB 00:00 2024-04-23T14:31:31.192 INFO:teuthology.orchestra.run.smithi186.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 502 kB/s | 250 kB 00:00 2024-04-23T14:31:31.242 INFO:teuthology.orchestra.run.smithi186.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 445 kB/s | 222 kB 00:00 2024-04-23T14:31:31.584 INFO:teuthology.orchestra.run.smithi186.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 124 kB/s | 42 kB 00:00 2024-04-23T14:31:31.643 INFO:teuthology.orchestra.run.smithi186.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 172 kB/s | 77 kB 00:00 2024-04-23T14:31:32.076 INFO:teuthology.orchestra.run.smithi007.stdout:(8/152): ceph-radosgw-19.0.0-3126.gd44fddd9.el9 1.4 MB/s | 11 MB 00:07 2024-04-23T14:31:32.135 INFO:teuthology.orchestra.run.smithi186.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-04-23T14:31:32.151 INFO:teuthology.orchestra.run.smithi007.stdout:(9/152): ceph-selinux-19.0.0-3126.gd44fddd9.el9 341 kB/s | 25 kB 00:00 2024-04-23T14:31:32.168 INFO:teuthology.orchestra.run.smithi186.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 303 kB/s | 159 kB 00:00 2024-04-23T14:31:32.235 INFO:teuthology.orchestra.run.smithi186.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 414 kB/s | 269 kB 00:00 2024-04-23T14:31:32.544 INFO:teuthology.orchestra.run.smithi186.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 136 kB/s | 51 kB 00:00 2024-04-23T14:31:32.754 INFO:teuthology.orchestra.run.smithi186.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 103 kB/s | 54 kB 00:00 2024-04-23T14:31:32.919 INFO:teuthology.orchestra.run.smithi186.stdout:(91/152): python3-pyasn1-modules-0.4.8-6.el9.no 356 kB/s | 279 kB 00:00 2024-04-23T14:31:33.128 INFO:teuthology.orchestra.run.smithi186.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 112 kB/s | 42 kB 00:00 2024-04-23T14:31:33.162 INFO:teuthology.orchestra.run.smithi137.stdout:(8/152): ceph-common-19.0.0-3126.gd44fddd9.el9. 1.5 MB/s | 21 MB 00:14 2024-04-23T14:31:33.270 INFO:teuthology.orchestra.run.smithi186.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 126 kB/s | 44 kB 00:00 2024-04-23T14:31:33.271 INFO:teuthology.orchestra.run.smithi137.stdout:(9/152): ceph-selinux-19.0.0-3126.gd44fddd9.el9 235 kB/s | 25 kB 00:00 2024-04-23T14:31:33.545 INFO:teuthology.orchestra.run.smithi186.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 131 kB/s | 36 kB 00:00 2024-04-23T14:31:33.637 INFO:teuthology.orchestra.run.smithi186.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 434 kB/s | 221 kB 00:00 2024-04-23T14:31:33.912 INFO:teuthology.orchestra.run.smithi186.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 129 kB/s | 47 kB 00:00 2024-04-23T14:31:34.154 INFO:teuthology.orchestra.run.smithi186.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 590 kB/s | 305 kB 00:00 2024-04-23T14:31:34.235 INFO:teuthology.orchestra.run.smithi007.stdout:(10/152): ceph-osd-19.0.0-3126.gd44fddd9.el9.x8 1.6 MB/s | 17 MB 00:10 2024-04-23T14:31:34.271 INFO:teuthology.orchestra.run.smithi186.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 161 kB/s | 58 kB 00:00 2024-04-23T14:31:34.496 INFO:teuthology.orchestra.run.smithi186.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 274 kB/s | 94 kB 00:00 2024-04-23T14:31:34.577 INFO:teuthology.orchestra.run.smithi007.stdout:(11/152): cephfs-mirror-19.0.0-3126.gd44fddd9.e 661 kB/s | 225 kB 00:00 2024-04-23T14:31:34.613 INFO:teuthology.orchestra.run.smithi186.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 187 kB/s | 64 kB 00:00 2024-04-23T14:31:34.696 INFO:teuthology.orchestra.run.smithi137.stdout:(10/152): ceph-osd-19.0.0-3126.gd44fddd9.el9.x8 1.8 MB/s | 17 MB 00:09 2024-04-23T14:31:34.702 INFO:teuthology.orchestra.run.smithi007.stdout:(12/152): cephfs-shell-19.0.0-3126.gd44fddd9.el 217 kB/s | 27 kB 00:00 2024-04-23T14:31:34.747 INFO:teuthology.orchestra.run.smithi186.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 168 kB/s | 22 kB 00:00 2024-04-23T14:31:34.836 INFO:teuthology.orchestra.run.smithi007.stdout:(13/152): libcephfs-devel-19.0.0-3126.gd44fddd9 240 kB/s | 32 kB 00:00 2024-04-23T14:31:34.847 INFO:teuthology.orchestra.run.smithi186.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 128 kB/s | 45 kB 00:00 2024-04-23T14:31:34.938 INFO:teuthology.orchestra.run.smithi137.stdout:(11/152): cephfs-mirror-19.0.0-3126.gd44fddd9.e 934 kB/s | 225 kB 00:00 2024-04-23T14:31:35.021 INFO:teuthology.orchestra.run.smithi137.stdout:(12/152): cephfs-shell-19.0.0-3126.gd44fddd9.el 327 kB/s | 27 kB 00:00 2024-04-23T14:31:35.097 INFO:teuthology.orchestra.run.smithi137.stdout:(13/152): libcephfs-devel-19.0.0-3126.gd44fddd9 429 kB/s | 32 kB 00:00 2024-04-23T14:31:35.164 INFO:teuthology.orchestra.run.smithi186.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-04-23T14:31:35.456 INFO:teuthology.orchestra.run.smithi137.stdout:(14/152): libcephfs2-19.0.0-3126.gd44fddd9.el9. 2.0 MB/s | 746 kB 00:00 2024-04-23T14:31:35.605 INFO:teuthology.orchestra.run.smithi137.stdout:(15/152): libcephsqlite-19.0.0-3126.gd44fddd9.e 1.1 MB/s | 163 kB 00:00 2024-04-23T14:31:35.649 INFO:teuthology.orchestra.run.smithi186.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 685 kB/s | 548 kB 00:00 2024-04-23T14:31:35.689 INFO:teuthology.orchestra.run.smithi137.stdout:(16/152): librados-devel-19.0.0-3126.gd44fddd9. 1.5 MB/s | 127 kB 00:00 2024-04-23T14:31:35.728 INFO:teuthology.orchestra.run.smithi007.stdout:(14/152): libcephfs2-19.0.0-3126.gd44fddd9.el9. 838 kB/s | 746 kB 00:00 2024-04-23T14:31:35.765 INFO:teuthology.orchestra.run.smithi186.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 169 kB/s | 19 kB 00:00 2024-04-23T14:31:35.907 INFO:teuthology.orchestra.run.smithi186.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 416 kB/s | 309 kB 00:00 2024-04-23T14:31:35.998 INFO:teuthology.orchestra.run.smithi137.stdout:(17/152): libradosstriper1-19.0.0-3126.gd44fddd 1.6 MB/s | 500 kB 00:00 2024-04-23T14:31:36.007 INFO:teuthology.orchestra.run.smithi186.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 263 kB/s | 26 kB 00:00 2024-04-23T14:31:36.095 INFO:teuthology.orchestra.run.smithi007.stdout:(15/152): libcephsqlite-19.0.0-3126.gd44fddd9.e 446 kB/s | 163 kB 00:00 2024-04-23T14:31:36.124 INFO:teuthology.orchestra.run.smithi186.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 420 kB/s | 49 kB 00:00 2024-04-23T14:31:36.308 INFO:teuthology.orchestra.run.smithi186.stdout:(109/152): libarrow-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-04-23T14:31:36.333 INFO:teuthology.orchestra.run.smithi186.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 324 kB/s | 67 kB 00:00 2024-04-23T14:31:36.575 INFO:teuthology.orchestra.run.smithi186.stdout:(111/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:04 2024-04-23T14:31:36.600 INFO:teuthology.orchestra.run.smithi186.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 519 kB/s | 151 kB 00:00 2024-04-23T14:31:36.650 INFO:teuthology.orchestra.run.smithi186.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2024-04-23T14:31:36.693 INFO:teuthology.orchestra.run.smithi186.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-04-23T14:31:36.810 INFO:teuthology.orchestra.run.smithi186.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2024-04-23T14:31:36.852 INFO:teuthology.orchestra.run.smithi186.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 162 kB/s | 15 kB 00:00 2024-04-23T14:31:36.919 INFO:teuthology.orchestra.run.smithi186.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-23T14:31:36.920 INFO:teuthology.orchestra.run.smithi007.stdout:(16/152): librados-devel-19.0.0-3126.gd44fddd9. 154 kB/s | 127 kB 00:00 2024-04-23T14:31:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.1 MB/s | 358 kB 00:00 2024-04-23T14:31:37.052 INFO:teuthology.orchestra.run.smithi186.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-23T14:31:37.078 INFO:teuthology.orchestra.run.smithi186.stdout:(120/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 91 kB/s | 43 kB 00:00 2024-04-23T14:31:37.103 INFO:teuthology.orchestra.run.smithi186.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 265 kB/s | 35 kB 00:00 2024-04-23T14:31:37.170 INFO:teuthology.orchestra.run.smithi186.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-23T14:31:37.262 INFO:teuthology.orchestra.run.smithi186.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-23T14:31:37.289 INFO:teuthology.orchestra.run.smithi186.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 90 kB/s | 11 kB 00:00 2024-04-23T14:31:37.340 INFO:teuthology.orchestra.run.smithi186.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 231 kB/s | 18 kB 00:00 2024-04-23T14:31:37.381 INFO:teuthology.orchestra.run.smithi186.stdout:(126/152): python3-grpcio-tools-1.46.7-10.el9.x 520 kB/s | 144 kB 00:00 2024-04-23T14:31:37.407 INFO:teuthology.orchestra.run.smithi186.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-04-23T14:31:37.432 INFO:teuthology.orchestra.run.smithi186.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2024-04-23T14:31:37.466 INFO:teuthology.orchestra.run.smithi186.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2024-04-23T14:31:37.516 INFO:teuthology.orchestra.run.smithi186.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 558 kB/s | 46 kB 00:00 2024-04-23T14:31:37.558 INFO:teuthology.orchestra.run.smithi186.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 863 kB/s | 79 kB 00:00 2024-04-23T14:31:37.600 INFO:teuthology.orchestra.run.smithi186.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 696 kB/s | 58 kB 00:00 2024-04-23T14:31:37.667 INFO:teuthology.orchestra.run.smithi186.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-04-23T14:31:37.700 INFO:teuthology.orchestra.run.smithi186.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-04-23T14:31:37.742 INFO:teuthology.orchestra.run.smithi186.stdout:(135/152): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-04-23T14:31:37.767 INFO:teuthology.orchestra.run.smithi186.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 905 kB/s | 90 kB 00:00 2024-04-23T14:31:37.784 INFO:teuthology.orchestra.run.smithi186.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 340 kB/s | 28 kB 00:00 2024-04-23T14:31:37.818 INFO:teuthology.orchestra.run.smithi186.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-04-23T14:31:37.820 INFO:teuthology.orchestra.run.smithi007.stdout:(17/152): libradosstriper1-19.0.0-3126.gd44fddd 556 kB/s | 500 kB 00:00 2024-04-23T14:31:37.831 INFO:teuthology.orchestra.run.smithi137.stdout:(18/152): ceph-radosgw-19.0.0-3126.gd44fddd9.el 1.0 MB/s | 11 MB 00:10 2024-04-23T14:31:37.868 INFO:teuthology.orchestra.run.smithi186.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-23T14:31:37.910 INFO:teuthology.orchestra.run.smithi186.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 473 kB/s | 59 kB 00:00 2024-04-23T14:31:37.935 INFO:teuthology.orchestra.run.smithi186.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-04-23T14:31:37.961 INFO:teuthology.orchestra.run.smithi186.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 558 kB/s | 51 kB 00:00 2024-04-23T14:31:38.019 INFO:teuthology.orchestra.run.smithi186.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-23T14:31:38.044 INFO:teuthology.orchestra.run.smithi186.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 830 kB/s | 90 kB 00:00 2024-04-23T14:31:38.086 INFO:teuthology.orchestra.run.smithi186.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-23T14:31:38.112 INFO:teuthology.orchestra.run.smithi186.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2024-04-23T14:31:38.145 INFO:teuthology.orchestra.run.smithi186.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-23T14:31:38.312 INFO:teuthology.orchestra.run.smithi186.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-04-23T14:31:38.637 INFO:teuthology.orchestra.run.smithi186.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 1.3 MB 00:00 2024-04-23T14:31:38.731 INFO:teuthology.orchestra.run.smithi137.stdout:(19/152): python3-ceph-argparse-19.0.0-3126.gd4 50 kB/s | 45 kB 00:00 2024-04-23T14:31:38.821 INFO:teuthology.orchestra.run.smithi186.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-04-23T14:31:39.132 INFO:teuthology.orchestra.run.smithi137.stdout:(20/152): python3-ceph-common-19.0.0-3126.gd44f 337 kB/s | 135 kB 00:00 2024-04-23T14:31:39.490 INFO:teuthology.orchestra.run.smithi137.stdout:(21/152): python3-cephfs-19.0.0-3126.gd44fddd9. 452 kB/s | 161 kB 00:00 2024-04-23T14:31:39.663 INFO:teuthology.orchestra.run.smithi186.stdout:(151/152): librbd1-19.0.0-3126.gd44fddd9.el9.x8 2.1 MB/s | 3.1 MB 00:01 2024-04-23T14:31:40.224 INFO:teuthology.orchestra.run.smithi137.stdout:(22/152): python3-rados-19.0.0-3126.gd44fddd9.e 437 kB/s | 320 kB 00:00 2024-04-23T14:31:40.841 INFO:teuthology.orchestra.run.smithi137.stdout:(23/152): librgw2-19.0.0-3126.gd44fddd9.el9.x86 1.1 MB/s | 5.4 MB 00:04 2024-04-23T14:31:41.049 INFO:teuthology.orchestra.run.smithi137.stdout:(24/152): python3-rbd-19.0.0-3126.gd44fddd9.el9 360 kB/s | 297 kB 00:00 2024-04-23T14:31:41.355 INFO:teuthology.orchestra.run.smithi137.stdout:(25/152): python3-rgw-19.0.0-3126.gd44fddd9.el9 194 kB/s | 100 kB 00:00 2024-04-23T14:31:41.383 INFO:teuthology.orchestra.run.smithi137.stdout:(26/152): rbd-fuse-19.0.0-3126.gd44fddd9.el9.x8 256 kB/s | 85 kB 00:00 2024-04-23T14:31:41.850 INFO:teuthology.orchestra.run.smithi137.stdout:(27/152): rbd-nbd-19.0.0-3126.gd44fddd9.el9.x86 367 kB/s | 171 kB 00:00 2024-04-23T14:31:42.229 INFO:teuthology.orchestra.run.smithi186.stdout:(152/152): librados2-19.0.0-3126.gd44fddd9.el9. 844 kB/s | 3.4 MB 00:04 2024-04-23T14:31:42.241 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:31:42.242 INFO:teuthology.orchestra.run.smithi186.stdout:Total 5.8 MB/s | 222 MB 00:38 2024-04-23T14:31:42.775 INFO:teuthology.orchestra.run.smithi137.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3126.g 37 kB/s | 34 kB 00:00 2024-04-23T14:31:43.367 INFO:teuthology.orchestra.run.smithi137.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3126.gd44fddd 241 kB/s | 142 kB 00:00 2024-04-23T14:31:45.024 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-23T14:31:45.263 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-23T14:31:45.263 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-23T14:31:45.967 INFO:teuthology.orchestra.run.smithi137.stdout:(30/152): rbd-mirror-19.0.0-3126.gd44fddd9.el9. 686 kB/s | 3.1 MB 00:04 2024-04-23T14:31:47.119 INFO:teuthology.orchestra.run.smithi007.stdout:(18/152): librgw2-19.0.0-3126.gd44fddd9.el9.x86 591 kB/s | 5.4 MB 00:09 2024-04-23T14:31:47.253 INFO:teuthology.orchestra.run.smithi007.stdout:(19/152): python3-ceph-argparse-19.0.0-3126.gd4 341 kB/s | 45 kB 00:00 2024-04-23T14:31:47.934 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-23T14:31:47.934 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-23T14:31:48.028 INFO:teuthology.orchestra.run.smithi007.stdout:(20/152): python3-ceph-common-19.0.0-3126.gd44f 174 kB/s | 135 kB 00:00 2024-04-23T14:31:48.329 INFO:teuthology.orchestra.run.smithi007.stdout:(21/152): python3-cephfs-19.0.0-3126.gd44fddd9. 540 kB/s | 161 kB 00:00 2024-04-23T14:31:48.879 INFO:teuthology.orchestra.run.smithi007.stdout:(22/152): ceph-common-19.0.0-3126.gd44fddd9.el9 678 kB/s | 21 MB 00:31 2024-04-23T14:31:48.912 INFO:teuthology.orchestra.run.smithi007.stdout:(23/152): python3-rados-19.0.0-3126.gd44fddd9.e 550 kB/s | 320 kB 00:00 2024-04-23T14:31:49.138 INFO:teuthology.orchestra.run.smithi007.stdout:(24/152): python3-rgw-19.0.0-3126.gd44fddd9.el9 444 kB/s | 100 kB 00:00 2024-04-23T14:31:49.355 INFO:teuthology.orchestra.run.smithi007.stdout:(25/152): rbd-fuse-19.0.0-3126.gd44fddd9.el9.x8 396 kB/s | 85 kB 00:00 2024-04-23T14:31:49.563 INFO:teuthology.orchestra.run.smithi007.stdout:(26/152): python3-rbd-19.0.0-3126.gd44fddd9.el9 435 kB/s | 297 kB 00:00 2024-04-23T14:31:49.955 INFO:teuthology.orchestra.run.smithi007.stdout:(27/152): rbd-nbd-19.0.0-3126.gd44fddd9.el9.x86 437 kB/s | 171 kB 00:00 2024-04-23T14:31:50.081 INFO:teuthology.orchestra.run.smithi007.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3126.g 275 kB/s | 34 kB 00:00 2024-04-23T14:31:50.359 INFO:teuthology.orchestra.run.smithi137.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3126.gd44fd 518 kB/s | 3.5 MB 00:06 2024-04-23T14:31:50.397 INFO:teuthology.orchestra.run.smithi007.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3126.gd44fddd 450 kB/s | 142 kB 00:00 2024-04-23T14:31:50.650 INFO:teuthology.orchestra.run.smithi137.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3126.gd4 857 kB/s | 249 kB 00:00 2024-04-23T14:31:50.784 INFO:teuthology.orchestra.run.smithi137.stdout:(33/152): ceph-mgr-rook-19.0.0-3126.gd44fddd9.e 372 kB/s | 49 kB 00:00 2024-04-23T14:31:50.926 INFO:teuthology.orchestra.run.smithi137.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3126.gd 117 kB/s | 16 kB 00:00 2024-04-23T14:31:51.276 INFO:teuthology.orchestra.run.smithi137.stdout:(35/152): ceph-volume-19.0.0-3126.gd44fddd9.el9 782 kB/s | 273 kB 00:00 2024-04-23T14:31:52.218 INFO:teuthology.orchestra.run.smithi137.stdout:(36/152): cephadm-19.0.0-3126.gd44fddd9.el9.noa 810 kB/s | 762 kB 00:00 2024-04-23T14:31:52.335 INFO:teuthology.orchestra.run.smithi137.stdout:(37/152): cephfs-top-19.0.0-3126.gd44fddd9.el9. 158 kB/s | 18 kB 00:00 2024-04-23T14:31:52.544 INFO:teuthology.orchestra.run.smithi137.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 388 kB/s | 80 kB 00:00 2024-04-23T14:31:52.861 INFO:teuthology.orchestra.run.smithi137.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 1.1 MB/s | 7.4 MB 00:06 2024-04-23T14:31:52.902 INFO:teuthology.orchestra.run.smithi137.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-23T14:31:52.994 INFO:teuthology.orchestra.run.smithi137.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-23T14:31:53.178 INFO:teuthology.orchestra.run.smithi137.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 617 kB/s | 195 kB 00:00 2024-04-23T14:31:53.270 INFO:teuthology.orchestra.run.smithi137.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-23T14:31:53.320 INFO:teuthology.orchestra.run.smithi137.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-04-23T14:31:53.354 INFO:teuthology.orchestra.run.smithi137.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-04-23T14:31:53.387 INFO:teuthology.orchestra.run.smithi137.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.9 MB/s | 125 kB 00:00 2024-04-23T14:31:53.429 INFO:teuthology.orchestra.run.smithi137.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-04-23T14:31:53.891 INFO:teuthology.orchestra.run.smithi007.stdout:(30/152): rbd-mirror-19.0.0-3126.gd44fddd9.el9. 697 kB/s | 3.1 MB 00:04 2024-04-23T14:31:54.204 INFO:teuthology.orchestra.run.smithi137.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 844 kB/s | 689 kB 00:00 2024-04-23T14:31:54.264 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-23T14:31:54.313 INFO:teuthology.orchestra.run.smithi137.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 991 kB/s | 107 kB 00:00 2024-04-23T14:31:54.355 INFO:teuthology.orchestra.run.smithi137.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-04-23T14:31:54.387 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-23T14:31:54.422 INFO:teuthology.orchestra.run.smithi137.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 199 kB/s | 21 kB 00:00 2024-04-23T14:31:54.474 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-23T14:31:54.480 INFO:teuthology.orchestra.run.smithi137.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-04-23T14:31:54.539 INFO:teuthology.orchestra.run.smithi137.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-04-23T14:31:54.585 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-23T14:31:54.646 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-23T14:31:54.675 INFO:teuthology.orchestra.run.smithi137.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 135 kB/s | 18 kB 00:00 2024-04-23T14:31:54.679 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-23T14:31:54.798 INFO:teuthology.orchestra.run.smithi137.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 91 kB/s | 11 kB 00:00 2024-04-23T14:31:54.806 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-23T14:31:54.932 INFO:teuthology.orchestra.run.smithi137.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.6 MB/s | 3.0 MB 00:00 2024-04-23T14:31:54.966 INFO:teuthology.orchestra.run.smithi137.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 963 kB/s | 160 kB 00:00 2024-04-23T14:31:55.057 INFO:teuthology.orchestra.run.smithi137.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 364 kB/s | 45 kB 00:00 2024-04-23T14:31:55.199 INFO:teuthology.orchestra.run.smithi137.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 582 kB 00:00 2024-04-23T14:31:55.235 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-23T14:31:55.282 INFO:teuthology.orchestra.run.smithi137.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-04-23T14:31:55.308 INFO:teuthology.orchestra.run.smithi137.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 235 kB/s | 25 kB 00:00 2024-04-23T14:31:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:31:55.400 INFO:teuthology.orchestra.run.smithi137.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-04-23T14:31:55.433 INFO:teuthology.orchestra.run.smithi137.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-04-23T14:31:55.517 INFO:teuthology.orchestra.run.smithi137.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-23T14:31:55.518 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:31:55.551 INFO:teuthology.orchestra.run.smithi137.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 301 kB/s | 35 kB 00:00 2024-04-23T14:31:55.561 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:31:55.688 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:31:55.727 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 10/156 2024-04-23T14:31:56.077 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-23T14:31:56.133 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-23T14:31:56.157 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:31:56.307 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:31:56.333 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 14/156 2024-04-23T14:31:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 14/156 2024-04-23T14:31:56.442 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T14:31:56.510 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T14:31:56.849 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T14:31:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T14:31:57.051 INFO:teuthology.orchestra.run.smithi137.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 3.1 MB/s | 4.7 MB 00:01 2024-04-23T14:31:57.119 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-23T14:31:57.246 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-23T14:31:57.293 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-23T14:31:57.301 INFO:teuthology.orchestra.run.smithi137.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 6.4 MB/s | 1.6 MB 00:00 2024-04-23T14:31:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-23T14:31:57.443 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-23T14:31:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-23T14:31:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-23T14:31:57.627 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-23T14:31:57.667 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-23T14:31:57.682 INFO:teuthology.orchestra.run.smithi007.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3126.gd44fd 498 kB/s | 3.5 MB 00:07 2024-04-23T14:31:57.788 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-23T14:31:57.865 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-23T14:31:57.901 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-23T14:31:57.958 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-23T14:31:58.065 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-23T14:31:58.104 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9. 31/156 2024-04-23T14:31:58.124 INFO:teuthology.orchestra.run.smithi007.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3126.gd4 565 kB/s | 249 kB 00:00 2024-04-23T14:31:58.166 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el 32/156 2024-04-23T14:31:58.202 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_6 33/156 2024-04-23T14:31:58.233 INFO:teuthology.orchestra.run.smithi007.stdout:(33/152): ceph-mgr-rook-19.0.0-3126.gd44fddd9.e 458 kB/s | 49 kB 00:00 2024-04-23T14:31:58.321 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-23T14:31:58.341 INFO:teuthology.orchestra.run.smithi007.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3126.gd 153 kB/s | 16 kB 00:00 2024-04-23T14:31:58.405 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-23T14:31:58.505 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-23T14:31:58.551 INFO:teuthology.orchestra.run.smithi137.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 729 kB/s | 911 kB 00:01 2024-04-23T14:31:58.683 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-23T14:31:58.749 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-23T14:31:58.901 INFO:teuthology.orchestra.run.smithi137.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 382 kB/s | 133 kB 00:00 2024-04-23T14:31:58.917 INFO:teuthology.orchestra.run.smithi007.stdout:(35/152): ceph-volume-19.0.0-3126.gd44fddd9.el9 476 kB/s | 273 kB 00:00 2024-04-23T14:31:59.094 INFO:teuthology.orchestra.run.smithi137.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-04-23T14:31:59.253 INFO:teuthology.orchestra.run.smithi137.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-04-23T14:31:59.361 INFO:teuthology.orchestra.run.smithi137.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 814 kB/s | 87 kB 00:00 2024-04-23T14:31:59.438 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-23T14:31:59.539 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-23T14:31:59.583 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-23T14:31:59.629 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-23T14:31:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_6 43/156 2024-04-23T14:31:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-23T14:31:59.971 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-23T14:32:00.019 INFO:teuthology.orchestra.run.smithi137.stdout:(73/152): python3-babel-2.9.1-2.el9.noarch.rpm 9.1 MB/s | 6.0 MB 00:00 2024-04-23T14:32:00.051 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-23T14:32:00.119 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-23T14:32:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.1 MB/s | 244 kB 00:00 2024-04-23T14:32:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-23T14:32:00.252 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-23T14:32:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-23T14:32:00.395 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-23T14:32:00.412 INFO:teuthology.orchestra.run.smithi137.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 193 kB/s | 26 kB 00:00 2024-04-23T14:32:00.441 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-23T14:32:00.475 INFO:teuthology.orchestra.run.smithi007.stdout:(36/152): cephadm-19.0.0-3126.gd44fddd9.el9.noa 489 kB/s | 762 kB 00:01 2024-04-23T14:32:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-23T14:32:00.545 INFO:teuthology.orchestra.run.smithi137.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 144 kB/s | 19 kB 00:00 2024-04-23T14:32:00.577 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-23T14:32:00.634 INFO:teuthology.orchestra.run.smithi007.stdout:(37/152): cephfs-top-19.0.0-3126.gd44fddd9.el9. 116 kB/s | 18 kB 00:00 2024-04-23T14:32:00.687 INFO:teuthology.orchestra.run.smithi137.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-04-23T14:32:00.775 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-23T14:32:00.829 INFO:teuthology.orchestra.run.smithi137.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 246 kB/s | 35 kB 00:00 2024-04-23T14:32:00.830 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-23T14:32:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-23T14:32:00.901 INFO:teuthology.orchestra.run.smithi007.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 302 kB/s | 80 kB 00:00 2024-04-23T14:32:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-23T14:32:01.055 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-23T14:32:01.092 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-23T14:32:01.139 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-23T14:32:01.206 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-23T14:32:01.209 INFO:teuthology.orchestra.run.smithi007.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-04-23T14:32:01.240 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-23T14:32:01.285 INFO:teuthology.orchestra.run.smithi007.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-04-23T14:32:01.360 INFO:teuthology.orchestra.run.smithi007.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-23T14:32:01.425 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-23T14:32:01.569 INFO:teuthology.orchestra.run.smithi007.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-04-23T14:32:01.612 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-23T14:32:01.619 INFO:teuthology.orchestra.run.smithi007.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-23T14:32:01.655 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-23T14:32:01.669 INFO:teuthology.orchestra.run.smithi007.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-04-23T14:32:01.713 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-23T14:32:01.744 INFO:teuthology.orchestra.run.smithi007.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-23T14:32:01.759 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-23T14:32:01.803 INFO:teuthology.orchestra.run.smithi007.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-23T14:32:01.826 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-23T14:32:01.885 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-23T14:32:01.934 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-23T14:32:01.980 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-23T14:32:02.030 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-23T14:32:02.103 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-23T14:32:02.152 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-23T14:32:02.293 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-23T14:32:02.349 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-23T14:32:02.393 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-23T14:32:02.462 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-23T14:32:02.478 INFO:teuthology.orchestra.run.smithi007.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-04-23T14:32:02.609 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-23T14:32:02.681 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-23T14:32:03.649 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-23T14:32:03.721 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-23T14:32:03.755 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-23T14:32:03.881 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-23T14:32:03.950 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-23T14:32:04.054 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-23T14:32:04.098 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-23T14:32:04.120 INFO:teuthology.orchestra.run.smithi007.stdout:(48/152): ceph-mgr-diskprediction-local-19.0.0- 742 kB/s | 7.4 MB 00:10 2024-04-23T14:32:04.237 INFO:teuthology.orchestra.run.smithi007.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 537 kB/s | 943 kB 00:01 2024-04-23T14:32:04.336 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-23T14:32:04.529 INFO:teuthology.orchestra.run.smithi007.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 74 kB/s | 21 kB 00:00 2024-04-23T14:32:04.587 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-23T14:32:04.588 INFO:teuthology.orchestra.run.smithi007.stdout:(51/152): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-04-23T14:32:04.751 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-23T14:32:04.787 INFO:teuthology.orchestra.run.smithi137.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-04-23T14:32:04.896 INFO:teuthology.orchestra.run.smithi007.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 106 kB/s | 33 kB 00:00 2024-04-23T14:32:05.047 INFO:teuthology.orchestra.run.smithi007.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 607 kB/s | 313 kB 00:00 2024-04-23T14:32:05.196 INFO:teuthology.orchestra.run.smithi137.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 615 kB/s | 250 kB 00:00 2024-04-23T14:32:05.339 INFO:teuthology.orchestra.run.smithi007.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 62 kB/s | 18 kB 00:00 2024-04-23T14:32:05.548 INFO:teuthology.orchestra.run.smithi007.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 54 kB/s | 11 kB 00:00 2024-04-23T14:32:05.722 INFO:teuthology.orchestra.run.smithi137.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 423 kB/s | 222 kB 00:00 2024-04-23T14:32:05.726 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-23T14:32:05.877 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-23T14:32:06.073 INFO:teuthology.orchestra.run.smithi007.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 306 kB/s | 160 kB 00:00 2024-04-23T14:32:06.205 INFO:teuthology.orchestra.run.smithi137.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 160 kB/s | 77 kB 00:00 2024-04-23T14:32:06.355 INFO:teuthology.orchestra.run.smithi137.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 283 kB/s | 42 kB 00:00 2024-04-23T14:32:06.415 INFO:teuthology.orchestra.run.smithi007.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 133 kB/s | 45 kB 00:00 2024-04-23T14:32:06.505 INFO:teuthology.orchestra.run.smithi137.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-04-23T14:32:06.631 INFO:teuthology.orchestra.run.smithi137.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-23T14:32:06.781 INFO:teuthology.orchestra.run.smithi137.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-04-23T14:32:06.914 INFO:teuthology.orchestra.run.smithi137.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 384 kB/s | 51 kB 00:00 2024-04-23T14:32:07.065 INFO:teuthology.orchestra.run.smithi137.stdout:(89/152): python3-requests-oauthlib-1.3.0-12.el 358 kB/s | 54 kB 00:00 2024-04-23T14:32:07.248 INFO:teuthology.orchestra.run.smithi007.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 796 kB/s | 662 kB 00:00 2024-04-23T14:32:07.451 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-23T14:32:07.542 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-23T14:32:07.591 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-23T14:32:07.636 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-23T14:32:07.882 INFO:teuthology.orchestra.run.smithi137.stdout:(90/152): ceph-test-19.0.0-3126.gd44fddd9.el9.x 1.4 MB/s | 49 MB 00:34 2024-04-23T14:32:07.907 INFO:teuthology.orchestra.run.smithi007.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.0 MB/s | 3.0 MB 00:03 2024-04-23T14:32:07.990 INFO:teuthology.orchestra.run.smithi007.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 786 kB/s | 582 kB 00:00 2024-04-23T14:32:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-23T14:32:08.063 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 99/156 2024-04-23T14:32:08.199 INFO:teuthology.orchestra.run.smithi007.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 87 kB/s | 25 kB 00:00 2024-04-23T14:32:08.200 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 99/156 2024-04-23T14:32:08.236 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 100/156 2024-04-23T14:32:08.293 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-23T14:32:08.357 INFO:teuthology.orchestra.run.smithi137.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 88 kB/s | 42 kB 00:00 2024-04-23T14:32:08.366 INFO:teuthology.orchestra.run.smithi007.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 126 kB/s | 47 kB 00:00 2024-04-23T14:32:08.624 INFO:teuthology.orchestra.run.smithi137.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 166 kB/s | 44 kB 00:00 2024-04-23T14:32:08.841 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-23T14:32:08.874 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 103/156 2024-04-23T14:32:08.941 INFO:teuthology.orchestra.run.smithi007.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 395 kB/s | 292 kB 00:00 2024-04-23T14:32:08.967 INFO:teuthology.orchestra.run.smithi007.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 314 kB/s | 188 kB 00:00 2024-04-23T14:32:08.974 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 103/156 2024-04-23T14:32:08.974 INFO:teuthology.orchestra.run.smithi137.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 631 kB/s | 221 kB 00:00 2024-04-23T14:32:09.001 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 104/156 2024-04-23T14:32:09.108 INFO:teuthology.orchestra.run.smithi137.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 270 kB/s | 36 kB 00:00 2024-04-23T14:32:09.216 INFO:teuthology.orchestra.run.smithi137.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 440 kB/s | 47 kB 00:00 2024-04-23T14:32:09.255 INFO:teuthology.orchestra.run.smithi007.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 113 kB/s | 35 kB 00:00 2024-04-23T14:32:09.542 INFO:teuthology.orchestra.run.smithi137.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 940 kB/s | 305 kB 00:00 2024-04-23T14:32:09.659 INFO:teuthology.orchestra.run.smithi137.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 497 kB/s | 58 kB 00:00 2024-04-23T14:32:09.776 INFO:teuthology.orchestra.run.smithi137.stdout:(98/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 583 kB/s | 5.1 MB 00:08 2024-04-23T14:32:09.801 INFO:teuthology.orchestra.run.smithi137.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 664 kB/s | 94 kB 00:00 2024-04-23T14:32:09.893 INFO:teuthology.orchestra.run.smithi137.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 549 kB/s | 64 kB 00:00 2024-04-23T14:32:09.926 INFO:teuthology.orchestra.run.smithi137.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 359 kB/s | 45 kB 00:00 2024-04-23T14:32:10.035 INFO:teuthology.orchestra.run.smithi137.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 158 kB/s | 22 kB 00:00 2024-04-23T14:32:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-04-23T14:32:10.492 INFO:teuthology.orchestra.run.smithi007.stdout:(66/152): ceph-test-19.0.0-3126.gd44fddd9.el9.x 1.3 MB/s | 49 MB 00:38 2024-04-23T14:32:10.686 INFO:teuthology.orchestra.run.smithi137.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 843 kB/s | 548 kB 00:00 2024-04-23T14:32:10.786 INFO:teuthology.orchestra.run.smithi137.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 196 kB/s | 19 kB 00:00 2024-04-23T14:32:11.292 INFO:teuthology.orchestra.run.smithi007.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 2.0 MB/s | 4.7 MB 00:02 2024-04-23T14:32:11.561 INFO:teuthology.orchestra.run.smithi137.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 277 kB/s | 309 kB 00:01 2024-04-23T14:32:11.653 INFO:teuthology.orchestra.run.smithi137.stdout:(107/152): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-04-23T14:32:11.659 INFO:teuthology.orchestra.run.smithi007.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-04-23T14:32:11.712 INFO:teuthology.orchestra.run.smithi137.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 836 kB/s | 49 kB 00:00 2024-04-23T14:32:11.770 INFO:teuthology.orchestra.run.smithi137.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-23T14:32:11.820 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:11.828 INFO:teuthology.orchestra.run.smithi137.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-04-23T14:32:11.865 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:11.937 INFO:teuthology.orchestra.run.smithi137.stdout:(111/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2024-04-23T14:32:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:(112/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 59 kB/s | 26 kB 00:00 2024-04-23T14:32:12.130 INFO:teuthology.orchestra.run.smithi007.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 284 kB/s | 133 kB 00:00 2024-04-23T14:32:12.155 INFO:teuthology.orchestra.run.smithi137.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 291 kB/s | 43 kB 00:00 2024-04-23T14:32:12.230 INFO:teuthology.orchestra.run.smithi137.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 434 kB/s | 32 kB 00:00 2024-04-23T14:32:12.276 INFO:teuthology.orchestra.run.smithi007.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 927 kB/s | 911 kB 00:00 2024-04-23T14:32:12.314 INFO:teuthology.orchestra.run.smithi137.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2024-04-23T14:32:12.364 INFO:teuthology.orchestra.run.smithi137.stdout:(116/152): python3-asyncssh-2.13.2-5.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-04-23T14:32:12.535 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:12.548 INFO:teuthology.orchestra.run.smithi137.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 737 kB/s | 172 kB 00:00 2024-04-23T14:32:12.585 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 106/156 2024-04-23T14:32:12.732 INFO:teuthology.orchestra.run.smithi137.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 978 kB/s | 358 kB 00:00 2024-04-23T14:32:12.755 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 106/156 2024-04-23T14:32:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T14:32:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T14:32:12.756 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:12.794 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 107/156 2024-04-23T14:32:12.798 INFO:teuthology.orchestra.run.smithi137.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 534 kB/s | 35 kB 00:00 2024-04-23T14:32:12.852 INFO:teuthology.orchestra.run.smithi007.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-04-23T14:32:12.865 INFO:teuthology.orchestra.run.smithi137.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-04-23T14:32:12.990 INFO:teuthology.orchestra.run.smithi137.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 686 kB/s | 303 kB 00:00 2024-04-23T14:32:13.133 INFO:teuthology.orchestra.run.smithi137.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.7 MB/s | 2.0 MB 00:00 2024-04-23T14:32:13.208 INFO:teuthology.orchestra.run.smithi137.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 144 kB/s | 11 kB 00:00 2024-04-23T14:32:13.233 INFO:teuthology.orchestra.run.smithi137.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 598 kB/s | 144 kB 00:00 2024-04-23T14:32:13.284 INFO:teuthology.orchestra.run.smithi137.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 236 kB/s | 18 kB 00:00 2024-04-23T14:32:13.285 INFO:teuthology.orchestra.run.smithi007.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 202 kB/s | 87 kB 00:00 2024-04-23T14:32:13.367 INFO:teuthology.orchestra.run.smithi137.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2024-04-23T14:32:13.401 INFO:teuthology.orchestra.run.smithi137.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2024-04-23T14:32:13.426 INFO:teuthology.orchestra.run.smithi137.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 339 kB/s | 20 kB 00:00 2024-04-23T14:32:13.501 INFO:teuthology.orchestra.run.smithi137.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 623 kB/s | 46 kB 00:00 2024-04-23T14:32:13.602 INFO:teuthology.orchestra.run.smithi137.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-04-23T14:32:13.644 INFO:teuthology.orchestra.run.smithi007.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 756 kB/s | 1.0 MB 00:01 2024-04-23T14:32:13.685 INFO:teuthology.orchestra.run.smithi137.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 697 kB/s | 58 kB 00:00 2024-04-23T14:32:13.728 INFO:teuthology.orchestra.run.smithi137.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 350 kB/s | 79 kB 00:00 2024-04-23T14:32:13.761 INFO:teuthology.orchestra.run.smithi137.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-04-23T14:32:13.819 INFO:teuthology.orchestra.run.smithi137.stdout:(134/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-04-23T14:32:13.861 INFO:teuthology.orchestra.run.smithi137.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2024-04-23T14:32:13.887 INFO:teuthology.orchestra.run.smithi137.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 426 kB/s | 28 kB 00:00 2024-04-23T14:32:13.929 INFO:teuthology.orchestra.run.smithi137.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 465 kB/s | 31 kB 00:00 2024-04-23T14:32:13.962 INFO:teuthology.orchestra.run.smithi137.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-23T14:32:14.029 INFO:teuthology.orchestra.run.smithi137.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 541 kB/s | 36 kB 00:00 2024-04-23T14:32:14.096 INFO:teuthology.orchestra.run.smithi137.stdout:(140/152): python3-typing-extensions-4.4.0-2.el 772 kB/s | 51 kB 00:00 2024-04-23T14:32:14.161 INFO:teuthology.orchestra.run.smithi007.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 473 kB/s | 244 kB 00:00 2024-04-23T14:32:14.171 INFO:teuthology.orchestra.run.smithi137.stdout:(141/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-23T14:32:14.230 INFO:teuthology.orchestra.run.smithi137.stdout:(142/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-23T14:32:14.255 INFO:teuthology.orchestra.run.smithi137.stdout:(143/152): python3-rsa-4.9-2.el9.noarch.rpm 182 kB/s | 59 kB 00:00 2024-04-23T14:32:14.305 INFO:teuthology.orchestra.run.smithi137.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-23T14:32:14.364 INFO:teuthology.orchestra.run.smithi137.stdout:(145/152): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-23T14:32:14.489 INFO:teuthology.orchestra.run.smithi137.stdout:(146/152): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-23T14:32:14.515 INFO:teuthology.orchestra.run.smithi137.stdout:(147/152): python3-zc-lockfile-2.0-10.el9.noarc 77 kB/s | 20 kB 00:00 2024-04-23T14:32:14.678 INFO:teuthology.orchestra.run.smithi007.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 481 kB/s | 248 kB 00:00 2024-04-23T14:32:14.945 INFO:teuthology.orchestra.run.smithi007.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 96 kB/s | 26 kB 00:00 2024-04-23T14:32:15.245 INFO:teuthology.orchestra.run.smithi007.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 64 kB/s | 19 kB 00:00 2024-04-23T14:32:15.431 INFO:teuthology.orchestra.run.smithi137.stdout:(148/152): librados2-19.0.0-3126.gd44fddd9.el9. 3.6 MB/s | 3.4 MB 00:00 2024-04-23T14:32:15.565 INFO:teuthology.orchestra.run.smithi007.stdout:(78/152): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-04-23T14:32:15.829 INFO:teuthology.orchestra.run.smithi007.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 295 kB/s | 172 kB 00:00 2024-04-23T14:32:15.871 INFO:teuthology.orchestra.run.smithi007.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 114 kB/s | 35 kB 00:00 2024-04-23T14:32:15.881 INFO:teuthology.orchestra.run.smithi137.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 3.0 MB/s | 1.3 MB 00:00 2024-04-23T14:32:16.124 INFO:teuthology.orchestra.run.smithi137.stdout:(150/152): librbd1-19.0.0-3126.gd44fddd9.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-04-23T14:32:16.213 INFO:teuthology.orchestra.run.smithi007.stdout:(81/152): postgresql-server-13.14-1.el9.x86_64. 1.4 MB/s | 5.8 MB 00:04 2024-04-23T14:32:16.340 INFO:teuthology.orchestra.run.smithi137.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 2.4 MB 00:00 2024-04-23T14:32:16.455 INFO:teuthology.orchestra.run.smithi007.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 430 kB/s | 250 kB 00:00 2024-04-23T14:32:16.739 INFO:teuthology.orchestra.run.smithi007.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 424 kB/s | 222 kB 00:00 2024-04-23T14:32:16.897 INFO:teuthology.orchestra.run.smithi007.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 175 kB/s | 77 kB 00:00 2024-04-23T14:32:17.106 INFO:teuthology.orchestra.run.smithi007.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 115 kB/s | 42 kB 00:00 2024-04-23T14:32:17.415 INFO:teuthology.orchestra.run.smithi007.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 522 kB/s | 269 kB 00:00 2024-04-23T14:32:17.615 INFO:teuthology.orchestra.run.smithi007.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 313 kB/s | 159 kB 00:00 2024-04-23T14:32:17.932 INFO:teuthology.orchestra.run.smithi007.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 540 kB/s | 279 kB 00:00 2024-04-23T14:32:17.973 INFO:teuthology.orchestra.run.smithi007.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 142 kB/s | 51 kB 00:00 2024-04-23T14:32:18.082 INFO:teuthology.orchestra.run.smithi007.stdout:(90/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.3 MB/s | 5.1 MB 00:02 2024-04-23T14:32:18.374 INFO:teuthology.orchestra.run.smithi007.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 122 kB/s | 54 kB 00:00 2024-04-23T14:32:18.382 INFO:teuthology.orchestra.run.smithi137.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.4 MB/s | 16 MB 00:11 2024-04-23T14:32:18.388 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:18.389 INFO:teuthology.orchestra.run.smithi137.stdout:Total 3.6 MB/s | 222 MB 01:00 2024-04-23T14:32:18.416 INFO:teuthology.orchestra.run.smithi007.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 125 kB/s | 42 kB 00:00 2024-04-23T14:32:18.733 INFO:teuthology.orchestra.run.smithi007.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 44 kB 00:00 2024-04-23T14:32:18.925 INFO:teuthology.orchestra.run.smithi007.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 435 kB/s | 221 kB 00:00 2024-04-23T14:32:19.042 INFO:teuthology.orchestra.run.smithi007.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 116 kB/s | 36 kB 00:00 2024-04-23T14:32:19.326 INFO:teuthology.orchestra.run.smithi007.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 118 kB/s | 47 kB 00:00 2024-04-23T14:32:19.693 INFO:teuthology.orchestra.run.smithi007.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 158 kB/s | 58 kB 00:00 2024-04-23T14:32:19.735 INFO:teuthology.orchestra.run.smithi007.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 441 kB/s | 305 kB 00:00 2024-04-23T14:32:20.110 INFO:teuthology.orchestra.run.smithi007.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-04-23T14:32:20.135 INFO:teuthology.orchestra.run.smithi007.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 212 kB/s | 94 kB 00:00 2024-04-23T14:32:20.294 INFO:teuthology.orchestra.run.smithi007.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 141 kB/s | 22 kB 00:00 2024-04-23T14:32:20.477 INFO:teuthology.orchestra.run.smithi007.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 122 kB/s | 45 kB 00:00 2024-04-23T14:32:20.819 INFO:teuthology.orchestra.run.smithi007.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-04-23T14:32:20.995 INFO:teuthology.orchestra.run.smithi007.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-04-23T14:32:21.087 INFO:teuthology.orchestra.run.smithi007.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 214 kB/s | 19 kB 00:00 2024-04-23T14:32:21.174 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-23T14:32:21.195 INFO:teuthology.orchestra.run.smithi007.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 824 kB/s | 309 kB 00:00 2024-04-23T14:32:21.296 INFO:teuthology.orchestra.run.smithi007.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 262 kB/s | 26 kB 00:00 2024-04-23T14:32:21.404 INFO:teuthology.orchestra.run.smithi007.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 451 kB/s | 49 kB 00:00 2024-04-23T14:32:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-23T14:32:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-23T14:32:21.530 INFO:teuthology.orchestra.run.smithi007.stdout:(109/152): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-23T14:32:21.555 INFO:teuthology.orchestra.run.smithi007.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 451 kB/s | 67 kB 00:00 2024-04-23T14:32:21.614 INFO:teuthology.orchestra.run.smithi007.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-23T14:32:21.697 INFO:teuthology.orchestra.run.smithi007.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 6.5 MB/s | 548 kB 00:00 2024-04-23T14:32:21.739 INFO:teuthology.orchestra.run.smithi007.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-23T14:32:21.781 INFO:teuthology.orchestra.run.smithi007.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 525 kB/s | 43 kB 00:00 2024-04-23T14:32:21.823 INFO:teuthology.orchestra.run.smithi007.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 389 kB/s | 32 kB 00:00 2024-04-23T14:32:21.865 INFO:teuthology.orchestra.run.smithi007.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 181 kB/s | 15 kB 00:00 2024-04-23T14:32:21.924 INFO:teuthology.orchestra.run.smithi007.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-23T14:32:21.966 INFO:teuthology.orchestra.run.smithi007.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-23T14:32:21.999 INFO:teuthology.orchestra.run.smithi007.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-04-23T14:32:22.058 INFO:teuthology.orchestra.run.smithi007.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 387 kB/s | 35 kB 00:00 2024-04-23T14:32:22.083 INFO:teuthology.orchestra.run.smithi007.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-23T14:32:22.326 INFO:teuthology.orchestra.run.smithi007.stdout:(122/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-04-23T14:32:22.359 INFO:teuthology.orchestra.run.smithi007.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 526 kB/s | 144 kB 00:00 2024-04-23T14:32:22.443 INFO:teuthology.orchestra.run.smithi007.stdout:(124/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-04-23T14:32:22.510 INFO:teuthology.orchestra.run.smithi007.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-23T14:32:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 88 kB/s | 18 kB 00:00 2024-04-23T14:32:22.610 INFO:teuthology.orchestra.run.smithi007.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 139 kB/s | 23 kB 00:00 2024-04-23T14:32:22.660 INFO:teuthology.orchestra.run.smithi007.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 130 kB/s | 19 kB 00:00 2024-04-23T14:32:22.711 INFO:teuthology.orchestra.run.smithi007.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 132 kB/s | 20 kB 00:00 2024-04-23T14:32:22.769 INFO:teuthology.orchestra.run.smithi007.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 6.5 MB/s | 1.0 MB 00:00 2024-04-23T14:32:22.811 INFO:teuthology.orchestra.run.smithi007.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 309 kB/s | 46 kB 00:00 2024-04-23T14:32:22.837 INFO:teuthology.orchestra.run.smithi007.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 631 kB/s | 79 kB 00:00 2024-04-23T14:32:22.879 INFO:teuthology.orchestra.run.smithi007.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 532 kB/s | 58 kB 00:00 2024-04-23T14:32:22.921 INFO:teuthology.orchestra.run.smithi007.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 197 kB/s | 16 kB 00:00 2024-04-23T14:32:22.946 INFO:teuthology.orchestra.run.smithi007.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-23T14:32:22.979 INFO:teuthology.orchestra.run.smithi007.stdout:(136/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-04-23T14:32:23.021 INFO:teuthology.orchestra.run.smithi007.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2024-04-23T14:32:23.089 INFO:teuthology.orchestra.run.smithi007.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 217 kB/s | 31 kB 00:00 2024-04-23T14:32:23.122 INFO:teuthology.orchestra.run.smithi007.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-23T14:32:23.164 INFO:teuthology.orchestra.run.smithi007.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 418 kB/s | 59 kB 00:00 2024-04-23T14:32:23.206 INFO:teuthology.orchestra.run.smithi007.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-04-23T14:32:23.256 INFO:teuthology.orchestra.run.smithi007.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 383 kB/s | 51 kB 00:00 2024-04-23T14:32:23.282 INFO:teuthology.orchestra.run.smithi007.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-23T14:32:23.315 INFO:teuthology.orchestra.run.smithi007.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-23T14:32:23.357 INFO:teuthology.orchestra.run.smithi007.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 268 kB/s | 20 kB 00:00 2024-04-23T14:32:23.399 INFO:teuthology.orchestra.run.smithi007.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-04-23T14:32:23.433 INFO:teuthology.orchestra.run.smithi007.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-23T14:32:23.500 INFO:teuthology.orchestra.run.smithi007.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-23T14:32:23.892 INFO:teuthology.orchestra.run.smithi007.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 3.5 MB/s | 1.3 MB 00:00 2024-04-23T14:32:24.009 INFO:teuthology.orchestra.run.smithi007.stdout:(150/152): librbd1-19.0.0-3126.gd44fddd9.el9.x8 5.5 MB/s | 3.1 MB 00:00 2024-04-23T14:32:24.079 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-23T14:32:24.079 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-23T14:32:24.259 INFO:teuthology.orchestra.run.smithi007.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 2.4 MB 00:00 2024-04-23T14:32:25.059 INFO:teuthology.orchestra.run.smithi007.stdout:(152/152): librados2-19.0.0-3126.gd44fddd9.el9. 2.0 MB/s | 3.4 MB 00:01 2024-04-23T14:32:25.065 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:25.066 INFO:teuthology.orchestra.run.smithi007.stdout:Total 3.2 MB/s | 222 MB 01:09 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 107/156 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /root 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-04-23T14:32:25.872 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:26.122 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 108/156 2024-04-23T14:32:26.170 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 108/156 2024-04-23T14:32:26.170 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:26.170 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T14:32:26.170 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:27.766 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 109/156 2024-04-23T14:32:27.867 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 109/156 2024-04-23T14:32:27.867 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:27.867 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T14:32:27.867 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:32:27.867 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:32:27.867 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:27.990 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-04-23T14:32:28.116 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 110/156 2024-04-23T14:32:28.190 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 110/156 2024-04-23T14:32:28.190 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:28.190 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T14:32:28.190 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:32:28.190 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:32:28.190 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:28.250 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-04-23T14:32:28.250 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-04-23T14:32:28.691 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 111/156 2024-04-23T14:32:28.770 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 111/156 2024-04-23T14:32:28.771 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:28.771 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T14:32:28.771 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:32:28.771 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:32:28.771 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:28.919 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-23T14:32:28.981 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-23T14:32:29.055 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-23T14:32:29.304 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-23T14:32:29.364 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-23T14:32:29.461 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-23T14:32:29.588 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T14:32:29.766 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T14:32:29.811 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-23T14:32:29.851 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-23T14:32:29.893 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-23T14:32:30.328 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-23T14:32:30.413 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-23T14:32:30.507 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-23T14:32:30.587 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 123/156 2024-04-23T14:32:30.622 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 123/156 2024-04-23T14:32:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-23T14:32:30.674 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.e 124/156 2024-04-23T14:32:30.684 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-23T14:32:30.723 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-23T14:32:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9. 125/156 2024-04-23T14:32:30.807 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 126/156 2024-04-23T14:32:30.858 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-23T14:32:31.106 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-04-23T14:32:31.107 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-04-23T14:32:31.287 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-23T14:32:31.387 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:32:31.557 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:32:31.588 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:32:31.724 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:32:31.779 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 10/156 2024-04-23T14:32:32.106 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-23T14:32:32.122 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 126/156 2024-04-23T14:32:32.169 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-23T14:32:32.196 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 127/156 2024-04-23T14:32:32.201 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:32:32.350 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:32:32.385 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 14/156 2024-04-23T14:32:32.472 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 14/156 2024-04-23T14:32:32.503 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T14:32:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T14:32:32.925 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T14:32:32.979 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T14:32:33.173 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-23T14:32:33.297 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 127/156 2024-04-23T14:32:33.300 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-23T14:32:33.333 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 128/156 2024-04-23T14:32:33.347 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-23T14:32:33.395 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-23T14:32:33.480 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 128/156 2024-04-23T14:32:33.497 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-23T14:32:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-23T14:32:33.633 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-23T14:32:33.657 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el 129/156 2024-04-23T14:32:33.677 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-23T14:32:33.685 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 130/156 2024-04-23T14:32:33.711 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-23T14:32:33.754 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 130/156 2024-04-23T14:32:33.755 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:33.755 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T14:32:33.755 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:32:33.755 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:32:33.755 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:33.802 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-23T14:32:33.811 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 131/156 2024-04-23T14:32:33.846 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 131/156 2024-04-23T14:32:33.884 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-23T14:32:33.921 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-23T14:32:33.969 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-23T14:32:33.972 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 132/156 2024-04-23T14:32:34.042 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 133/156 2024-04-23T14:32:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-23T14:32:34.126 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9. 31/156 2024-04-23T14:32:34.177 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el 32/156 2024-04-23T14:32:34.207 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_6 33/156 2024-04-23T14:32:34.317 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-23T14:32:34.387 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-23T14:32:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-23T14:32:34.673 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-23T14:32:34.737 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-23T14:32:35.069 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-23T14:32:35.122 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 135/156 2024-04-23T14:32:35.206 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 135/156 2024-04-23T14:32:35.207 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:35.207 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T14:32:35.207 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:32:35.207 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:32:35.207 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:35.256 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 136/156 2024-04-23T14:32:35.341 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 136/156 2024-04-23T14:32:35.341 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:35.341 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T14:32:35.341 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-23T14:32:35.415 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 137/156 2024-04-23T14:32:35.511 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 137/156 2024-04-23T14:32:35.511 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:35.511 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-23T14:32:35.511 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T14:32:35.511 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T14:32:35.511 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:35.526 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-23T14:32:35.563 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-23T14:32:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-23T14:32:35.650 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_6 43/156 2024-04-23T14:32:35.701 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-23T14:32:35.907 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 138/156 2024-04-23T14:32:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-23T14:32:35.975 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 138/156 2024-04-23T14:32:35.975 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:35.975 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T14:32:35.975 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:32:35.975 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:32:35.975 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-23T14:32:36.083 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-23T14:32:36.178 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-23T14:32:36.225 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-23T14:32:36.262 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-23T14:32:36.331 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-23T14:32:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-23T14:32:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-23T14:32:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-23T14:32:36.688 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-23T14:32:36.746 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-23T14:32:36.782 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-23T14:32:36.838 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-23T14:32:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-23T14:32:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-23T14:32:37.051 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-23T14:32:37.088 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-23T14:32:37.121 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-23T14:32:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-23T14:32:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-23T14:32:37.520 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-23T14:32:37.561 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-23T14:32:37.605 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-23T14:32:37.663 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-23T14:32:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-23T14:32:37.730 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-04-23T14:32:37.770 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-23T14:32:37.819 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-23T14:32:37.833 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-23T14:32:37.869 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-23T14:32:37.909 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-23T14:32:37.944 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-23T14:32:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-23T14:32:38.132 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-23T14:32:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-23T14:32:38.202 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-23T14:32:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-23T14:32:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-23T14:32:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-23T14:32:38.340 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-23T14:32:38.401 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-23T14:32:38.494 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-23T14:32:38.579 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-23T14:32:38.861 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-23T14:32:38.973 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:32:39.153 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:32:39.207 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:32:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:32:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 10/156 2024-04-23T14:32:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-23T14:32:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-23T14:32:39.604 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-23T14:32:39.724 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-23T14:32:39.752 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-23T14:32:39.790 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-23T14:32:39.823 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-23T14:32:39.853 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:32:39.894 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-23T14:32:39.947 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-23T14:32:40.015 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:32:40.046 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 14/156 2024-04-23T14:32:40.128 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 14/156 2024-04-23T14:32:40.155 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T14:32:40.181 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-23T14:32:40.211 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-23T14:32:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T14:32:40.315 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-23T14:32:40.540 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T14:32:40.598 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T14:32:40.806 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-23T14:32:40.933 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-23T14:32:40.981 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-23T14:32:41.018 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 139/156 2024-04-23T14:32:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-23T14:32:41.078 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 140/156 2024-04-23T14:32:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-23T14:32:41.144 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-23T14:32:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-23T14:32:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 141/156 2024-04-23T14:32:41.245 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-23T14:32:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-23T14:32:41.283 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-23T14:32:41.298 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-23T14:32:41.303 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-23T14:32:41.338 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-23T14:32:41.460 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-23T14:32:41.552 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-23T14:32:41.590 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-23T14:32:41.636 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 144/156 2024-04-23T14:32:41.686 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-23T14:32:41.695 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-23T14:32:41.723 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_ 146/156 2024-04-23T14:32:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-23T14:32:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9. 31/156 2024-04-23T14:32:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el 32/156 2024-04-23T14:32:41.935 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_6 33/156 2024-04-23T14:32:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-23T14:32:42.135 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-23T14:32:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-23T14:32:42.426 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-23T14:32:42.491 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-23T14:32:42.544 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:32:42.595 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:32:42.652 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:32:42.901 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-23T14:32:42.993 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-23T14:32:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-23T14:32:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-23T14:32:43.181 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-23T14:32:43.307 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-23T14:32:43.341 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-23T14:32:43.386 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-23T14:32:43.428 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_6 43/156 2024-04-23T14:32:43.454 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-23T14:32:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-23T14:32:43.505 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 99/156 2024-04-23T14:32:43.618 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 99/156 2024-04-23T14:32:43.661 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 100/156 2024-04-23T14:32:43.719 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-23T14:32:43.728 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-23T14:32:43.826 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-23T14:32:43.905 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-23T14:32:43.985 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 148/156 2024-04-23T14:32:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-23T14:32:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-23T14:32:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-23T14:32:44.094 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-23T14:32:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-23T14:32:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-23T14:32:44.187 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-23T14:32:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-23T14:32:44.284 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-23T14:32:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-23T14:32:44.316 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 103/156 2024-04-23T14:32:44.359 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-23T14:32:44.400 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-23T14:32:44.400 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T14:32:44.416 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 103/156 2024-04-23T14:32:44.452 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 104/156 2024-04-23T14:32:44.506 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-23T14:32:44.534 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T14:32:44.564 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-23T14:32:44.574 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T14:32:44.574 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T14:32:44.600 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-23T14:32:44.645 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-23T14:32:44.736 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T14:32:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-23T14:32:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-23T14:32:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-23T14:32:44.864 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:32:44.907 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-23T14:32:44.957 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-23T14:32:45.151 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-23T14:32:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:32:45.152 INFO:teuthology.orchestra.run.smithi186.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-23T14:32:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:45.329 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-23T14:32:45.373 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-23T14:32:45.412 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-23T14:32:45.458 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-23T14:32:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-23T14:32:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-23T14:32:45.619 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-23T14:32:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-23T14:32:45.713 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-23T14:32:45.789 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-23T14:32:45.836 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-23T14:32:45.951 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-23T14:32:46.016 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-23T14:32:46.059 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-23T14:32:46.142 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-23T14:32:46.300 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-23T14:32:46.366 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-23T14:32:47.099 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:47.140 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-23T14:32:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-23T14:32:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-23T14:32:47.581 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-23T14:32:47.645 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-23T14:32:47.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-23T14:32:47.783 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:47.791 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-23T14:32:47.835 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 106/156 2024-04-23T14:32:48.018 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 106/156 2024-04-23T14:32:48.018 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T14:32:48.018 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T14:32:48.018 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:32:48.060 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 107/156 2024-04-23T14:32:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-23T14:32:48.089 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-23T14:32:48.203 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-23T14:32:49.064 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-23T14:32:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-23T14:32:50.802 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 1/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 2/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 3/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 4/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 5/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 6/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 7/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 10/156 2024-04-23T14:32:50.803 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 11/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 12/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 14/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_ 15/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 16/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 17/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_6 18/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 19/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 20/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el 21/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9. 22/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_6 23/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 24/156 2024-04-23T14:32:50.804 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 25/156 2024-04-23T14:32:50.805 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 26/156 2024-04-23T14:32:50.805 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 27/156 2024-04-23T14:32:50.816 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 28/156 2024-04-23T14:32:50.816 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 29/156 2024-04-23T14:32:50.816 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9. 30/156 2024-04-23T14:32:50.816 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 31/156 2024-04-23T14:32:50.816 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 32/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 33/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el 34/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 35/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.e 36/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 37/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 38/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 39/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-23T14:32:50.817 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-23T14:32:50.818 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-23T14:32:50.819 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-23T14:32:50.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-23T14:32:50.821 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-23T14:32:50.822 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-23T14:32:50.823 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-23T14:32:50.824 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 149/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 151/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T14:32:50.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-23T14:32:50.918 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-23T14:32:51.013 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-23T14:32:51.052 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-23T14:32:51.097 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-23T14:32:51.510 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-23T14:32:51.558 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 99/156 2024-04-23T14:32:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 99/156 2024-04-23T14:32:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 100/156 2024-04-23T14:32:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-23T14:32:52.395 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-23T14:32:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 103/156 2024-04-23T14:32:52.574 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 103/156 2024-04-23T14:32:52.605 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 104/156 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.2-8.el9.noarch 2024-04-23T14:32:53.256 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.7.4-5.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.257 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:32:53.258 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.4-9.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.259 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T14:32:53.260 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-13.14-1.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-23T14:32:53.261 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T14:32:53.262 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T14:32:53.263 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T14:32:53.264 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T14:32:53.265 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T14:32:53.266 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-23T14:32:53.267 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:32:53.268 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-23T14:32:53.849 DEBUG:teuthology.parallel:result is None 2024-04-23T14:32:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 105/156 2024-04-23T14:32:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 106/156 2024-04-23T14:32:56.359 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 106/156 2024-04-23T14:32:56.360 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T14:32:56.360 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T14:32:56.360 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:32:56.406 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 107/156 2024-04-23T14:33:01.098 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 107/156 2024-04-23T14:33:01.098 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-04-23T14:33:01.098 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-04-23T14:33:01.099 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-04-23T14:33:01.099 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-04-23T14:33:01.099 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-04-23T14:33:01.099 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-04-23T14:33:01.099 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-04-23T14:33:01.099 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:01.331 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 108/156 2024-04-23T14:33:01.380 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 108/156 2024-04-23T14:33:01.380 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:01.380 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T14:33:01.380 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 109/156 2024-04-23T14:33:03.120 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 109/156 2024-04-23T14:33:03.120 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:03.120 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T14:33:03.120 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:33:03.120 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:33:03.120 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 110/156 2024-04-23T14:33:03.435 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 110/156 2024-04-23T14:33:03.435 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:03.435 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T14:33:03.435 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:33:03.435 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:33:03.435 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:03.927 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 111/156 2024-04-23T14:33:04.001 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 111/156 2024-04-23T14:33:04.001 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:04.001 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T14:33:04.001 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:33:04.001 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:33:04.001 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:04.135 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-23T14:33:04.188 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-23T14:33:04.262 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-23T14:33:04.493 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-23T14:33:04.547 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-23T14:33:04.633 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-23T14:33:04.741 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T14:33:04.908 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T14:33:04.964 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-23T14:33:05.004 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-23T14:33:05.029 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-23T14:33:05.705 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 123/156 2024-04-23T14:33:05.749 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 123/156 2024-04-23T14:33:05.807 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.e 124/156 2024-04-23T14:33:05.908 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9. 125/156 2024-04-23T14:33:05.934 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 126/156 2024-04-23T14:33:07.204 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 126/156 2024-04-23T14:33:07.253 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 127/156 2024-04-23T14:33:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 127/156 2024-04-23T14:33:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 128/156 2024-04-23T14:33:08.531 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 128/156 2024-04-23T14:33:08.710 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el 129/156 2024-04-23T14:33:08.747 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 130/156 2024-04-23T14:33:08.830 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 130/156 2024-04-23T14:33:08.830 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:08.830 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T14:33:08.830 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:33:08.830 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:33:08.830 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 131/156 2024-04-23T14:33:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 131/156 2024-04-23T14:33:09.061 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 132/156 2024-04-23T14:33:09.130 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 133/156 2024-04-23T14:33:09.820 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 107/156 2024-04-23T14:33:09.820 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-04-23T14:33:09.820 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-04-23T14:33:09.820 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-04-23T14:33:09.820 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-04-23T14:33:09.821 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-04-23T14:33:09.821 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-04-23T14:33:09.821 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-04-23T14:33:09.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:10.065 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 108/156 2024-04-23T14:33:10.113 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 108/156 2024-04-23T14:33:10.114 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:10.114 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T14:33:10.114 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:10.165 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-23T14:33:10.200 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 135/156 2024-04-23T14:33:10.277 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 135/156 2024-04-23T14:33:10.277 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:10.277 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T14:33:10.277 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:33:10.277 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:33:10.277 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:10.326 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 136/156 2024-04-23T14:33:10.415 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 136/156 2024-04-23T14:33:10.415 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:10.415 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T14:33:10.415 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 137/156 2024-04-23T14:33:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 137/156 2024-04-23T14:33:10.594 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:10.594 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-23T14:33:10.594 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T14:33:10.594 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T14:33:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:10.977 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 138/156 2024-04-23T14:33:11.073 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 138/156 2024-04-23T14:33:11.073 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:11.073 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T14:33:11.073 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:11.073 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:11.074 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:11.815 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 109/156 2024-04-23T14:33:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 109/156 2024-04-23T14:33:11.915 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:11.915 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T14:33:11.915 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:33:11.915 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:33:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:12.182 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 110/156 2024-04-23T14:33:12.262 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 110/156 2024-04-23T14:33:12.262 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:12.262 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T14:33:12.262 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:33:12.262 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:33:12.262 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:12.791 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 111/156 2024-04-23T14:33:12.863 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 111/156 2024-04-23T14:33:12.863 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:12.863 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T14:33:12.863 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:33:12.863 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:33:12.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:13.010 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-23T14:33:13.072 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-23T14:33:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-23T14:33:13.391 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-23T14:33:13.464 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-23T14:33:13.554 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-23T14:33:13.664 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T14:33:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T14:33:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-23T14:33:13.961 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-23T14:33:13.995 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-23T14:33:14.663 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 123/156 2024-04-23T14:33:14.698 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 123/156 2024-04-23T14:33:14.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.e 124/156 2024-04-23T14:33:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9. 125/156 2024-04-23T14:33:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 126/156 2024-04-23T14:33:16.137 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 139/156 2024-04-23T14:33:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 140/156 2024-04-23T14:33:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 126/156 2024-04-23T14:33:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 141/156 2024-04-23T14:33:16.293 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 127/156 2024-04-23T14:33:16.330 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-23T14:33:16.378 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-23T14:33:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 144/156 2024-04-23T14:33:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-23T14:33:16.800 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_ 146/156 2024-04-23T14:33:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 127/156 2024-04-23T14:33:17.493 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 128/156 2024-04-23T14:33:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 128/156 2024-04-23T14:33:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:33:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:33:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:33:17.834 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el 129/156 2024-04-23T14:33:17.862 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 130/156 2024-04-23T14:33:17.942 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 130/156 2024-04-23T14:33:17.942 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:17.942 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T14:33:17.942 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:33:17.943 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:33:17.943 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:18.005 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 131/156 2024-04-23T14:33:18.046 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 131/156 2024-04-23T14:33:18.201 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 132/156 2024-04-23T14:33:18.286 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 133/156 2024-04-23T14:33:19.156 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 148/156 2024-04-23T14:33:19.271 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-23T14:33:19.350 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-23T14:33:19.385 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-23T14:33:19.416 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 135/156 2024-04-23T14:33:19.487 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 135/156 2024-04-23T14:33:19.487 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:19.487 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T14:33:19.487 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:33:19.487 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:33:19.487 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:19.533 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 136/156 2024-04-23T14:33:19.542 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-23T14:33:19.594 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-23T14:33:19.594 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T14:33:19.620 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 136/156 2024-04-23T14:33:19.621 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:19.621 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T14:33:19.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:19.701 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 137/156 2024-04-23T14:33:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T14:33:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T14:33:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T14:33:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 137/156 2024-04-23T14:33:19.778 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:19.779 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-23T14:33:19.779 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T14:33:19.779 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T14:33:19.779 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:19.917 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T14:33:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:33:20.168 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 138/156 2024-04-23T14:33:20.241 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 138/156 2024-04-23T14:33:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T14:33:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:20.242 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:20.354 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:33:20.354 INFO:teuthology.orchestra.run.smithi137.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-23T14:33:20.354 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:25.583 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 139/156 2024-04-23T14:33:25.640 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 140/156 2024-04-23T14:33:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 141/156 2024-04-23T14:33:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-23T14:33:25.812 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 1/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 2/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 3/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 4/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 5/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 6/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 7/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 10/156 2024-04-23T14:33:25.943 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 11/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 12/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 14/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_ 15/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 16/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 17/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_6 18/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 19/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 20/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el 21/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9. 22/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_6 23/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 24/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 25/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 26/156 2024-04-23T14:33:25.944 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 27/156 2024-04-23T14:33:25.945 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 28/156 2024-04-23T14:33:25.954 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 29/156 2024-04-23T14:33:25.954 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9. 30/156 2024-04-23T14:33:25.954 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 31/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 32/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 33/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el 34/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 35/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.e 36/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 37/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 38/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 39/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-23T14:33:25.955 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-23T14:33:25.956 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-23T14:33:25.957 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-23T14:33:25.958 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-23T14:33:25.959 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-23T14:33:25.960 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-23T14:33:25.961 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 149/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 151/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-23T14:33:25.962 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T14:33:25.963 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-23T14:33:26.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 144/156 2024-04-23T14:33:26.213 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-23T14:33:26.240 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_ 146/156 2024-04-23T14:33:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:33:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:33:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T14:33:28.337 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:33:28.337 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:28.337 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-04-23T14:33:28.337 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.337 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.338 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.339 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T14:33:28.340 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T14:33:28.341 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-23T14:33:28.342 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.14-1.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-23T14:33:28.343 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T14:33:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T14:33:28.345 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T14:33:28.346 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T14:33:28.347 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T14:33:28.348 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.349 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-23T14:33:28.350 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T14:33:28.351 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-23T14:33:28.891 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 148/156 2024-04-23T14:33:28.934 DEBUG:teuthology.parallel:result is None 2024-04-23T14:33:29.013 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-23T14:33:29.102 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-23T14:33:29.286 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-23T14:33:29.328 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-23T14:33:29.328 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T14:33:29.480 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T14:33:29.527 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T14:33:29.527 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T14:33:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T14:33:29.790 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:33:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:33:30.118 INFO:teuthology.orchestra.run.smithi007.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-23T14:33:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:35.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 1/156 2024-04-23T14:33:35.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 2/156 2024-04-23T14:33:35.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 3/156 2024-04-23T14:33:35.869 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 4/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3126.gd44fd 5/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 6/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 7/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 8/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 9/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 10/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 11/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 12/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 13/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 14/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_ 15/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 16/156 2024-04-23T14:33:35.870 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 17/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_6 18/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86 19/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 20/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el 21/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9. 22/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_6 23/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 24/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 25/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 26/156 2024-04-23T14:33:35.871 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 27/156 2024-04-23T14:33:35.883 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 28/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 29/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9. 30/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noa 31/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.n 32/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44 33/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el 34/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 35/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.e 36/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 37/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 38/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 39/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-23T14:33:35.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-23T14:33:35.885 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-23T14:33:35.886 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-23T14:33:35.887 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-23T14:33:35.888 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-23T14:33:35.889 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-23T14:33:35.890 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-23T14:33:35.891 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 149/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 151/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T14:33:35.892 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-23T14:33:38.520 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T14:33:38.520 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-04-23T14:33:38.520 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.520 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.522 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.0.0-3126.gd44fddd9.el9.noarch 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T14:33:38.523 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T14:33:38.524 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T14:33:38.525 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.14-1.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T14:33:38.526 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T14:33:38.527 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T14:33:38.528 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T14:33:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T14:33:38.530 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.0.0-3126.gd44fddd9.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T14:33:38.531 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:33:38.532 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-04-23T14:33:39.296 DEBUG:teuthology.parallel:result is None 2024-04-23T14:33:39.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:39.439 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T14:33:39.501 INFO:teuthology.orchestra.run.smithi007.stdout:19.0.0-3126.gd44fddd9.el9 2024-04-23T14:33:39.501 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3126.gd44fddd9.el9 2024-04-23T14:33:39.502 INFO:teuthology.task.install:The correct ceph version 19.0.0-3126.gd44fddd9 is installed. 2024-04-23T14:33:39.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:39.758 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T14:33:39.822 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-3126.gd44fddd9.el9 2024-04-23T14:33:39.823 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3126.gd44fddd9.el9 2024-04-23T14:33:39.823 INFO:teuthology.task.install:The correct ceph version 19.0.0-3126.gd44fddd9 is installed. 2024-04-23T14:33:39.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:39.962 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T14:33:40.035 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-3126.gd44fddd9.el9 2024-04-23T14:33:40.036 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3126.gd44fddd9.el9 2024-04-23T14:33:40.036 INFO:teuthology.task.install:The correct ceph version 19.0.0-3126.gd44fddd9 is installed. 2024-04-23T14:33:40.038 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T14:33:40.038 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:33:40.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T14:33:40.133 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:33:40.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T14:33:40.216 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:33:40.216 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T14:33:40.306 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T14:33:40.307 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:33:40.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T14:33:40.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T14:33:40.449 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:33:40.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T14:33:40.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T14:33:40.640 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:33:40.640 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T14:33:40.718 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T14:33:40.827 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T14:33:40.827 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:33:40.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T14:33:40.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T14:33:40.994 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:33:40.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T14:33:41.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T14:33:41.203 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:33:41.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T14:33:41.275 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T14:33:41.385 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T14:33:41.385 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:33:41.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T14:33:41.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T14:33:41.556 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:33:41.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T14:33:41.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T14:33:41.729 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:33:41.729 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T14:33:41.805 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T14:33:41.924 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-23T14:33:42.026 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'SLOW_OPS', 'slow request'], 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'subvols': {'create': 2}} 2024-04-23T14:33:42.026 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:42.027 INFO:tasks.cephadm:Cluster fsid is 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:33:42.027 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-23T14:33:42.027 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.137', 'mon.c': '172.21.15.186'} 2024-04-23T14:33:42.027 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-04-23T14:33:42.027 INFO:tasks.cephadm:First mgr is x 2024-04-23T14:33:42.027 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-23T14:33:42.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-04-23T14:33:42.107 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname $(hostname -s) 2024-04-23T14:33:42.197 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname $(hostname -s) 2024-04-23T14:33:42.266 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-23T14:33:42.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:42.406 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78800/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3126-gd44fddd9', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3126.gd44fddd9'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-22 14:41:17.415668', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240416.193735-3', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-23T14:33:42.544 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240416.193735-3, sha1 d44fddd910b5e94da0f2357af4be37d7bd495ae0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:42.545 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/x86_64/flavors/default/cephadm 2024-04-23T14:33:42.545 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:43.042 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 781447 Apr 23 14:33 /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:43.042 DEBUG:teuthology.orchestra.run.smithi137:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:43.574 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r--. 1 ubuntu ubuntu 781447 Apr 23 14:33 /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:43.575 DEBUG:teuthology.orchestra.run.smithi186:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735-3/d44fddd910b5e94da0f2357af4be37d7bd495ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:44.098 INFO:teuthology.orchestra.run.smithi186.stdout:-rw-r--r--. 1 ubuntu ubuntu 781447 Apr 23 14:33 /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:44.099 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:44.144 DEBUG:teuthology.orchestra.run.smithi137:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:44.204 DEBUG:teuthology.orchestra.run.smithi186:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:44.280 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 on all hosts... 2024-04-23T14:33:44.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 pull 2024-04-23T14:33:44.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 pull 2024-04-23T14:33:44.292 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 pull 2024-04-23T14:33:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0... 2024-04-23T14:33:46.328 INFO:teuthology.orchestra.run.smithi137.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0... 2024-04-23T14:33:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0... 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)", 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "image_id": "76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e", 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "repo_digests": [ 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd" 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-23T14:34:41.228 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)", 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: "image_id": "76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e", 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: "repo_digests": [ 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd" 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-23T14:36:30.869 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-23T14:37:08.046 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:37:08.047 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)", 2024-04-23T14:37:08.047 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e", 2024-04-23T14:37:08.047 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-04-23T14:37:08.047 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd" 2024-04-23T14:37:08.047 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T14:37:08.047 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:37:08.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-04-23T14:37:08.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph 2024-04-23T14:37:08.280 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph 2024-04-23T14:37:08.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-04-23T14:37:08.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /etc/ceph 2024-04-23T14:37:08.555 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /etc/ceph 2024-04-23T14:37:08.643 INFO:tasks.cephadm:Writing seed config... 2024-04-23T14:37:08.644 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-23T14:37:08.644 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-23T14:37:08.644 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-23T14:37:08.644 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-23T14:37:08.644 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-23T14:37:08.644 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-23T14:37:08.645 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-23T14:37:08.646 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-23T14:37:08.647 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-04-23T14:37:08.648 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:37:08.648 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-23T14:37:08.709 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7b70c844-017e-11ef-bc93-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-23T14:37:08.710 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service 2024-04-23T14:37:08.758 DEBUG:teuthology.orchestra.run.smithi007:mgr.x> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x.service 2024-04-23T14:37:08.804 INFO:tasks.cephadm:Bootstrapping... 2024-04-23T14:37:08.804 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 -v bootstrap --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-23T14:37:09.077 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:37:09.078 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0', '-v', 'bootstrap', '--fsid', '7b70c844-017e-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-04-23T14:37:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-23T14:37:09.078 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-04-23T14:37:09.139 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T14:37:09.139 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-04-23T14:37:09.139 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-04-23T14:37:09.155 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-23T14:37:09.155 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-23T14:37:09.175 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-23T14:37:09.175 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-04-23T14:37:09.199 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-04-23T14:37:09.220 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-04-23T14:37:09.220 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-04-23T14:37:09.221 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-04-23T14:37:09.282 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T14:37:09.282 INFO:teuthology.orchestra.run.smithi007.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-23T14:37:09.282 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-04-23T14:37:09.282 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-04-23T14:37:09.298 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-23T14:37:09.298 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-23T14:37:09.313 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-23T14:37:09.314 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-04-23T14:37:09.334 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-04-23T14:37:09.356 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-04-23T14:37:09.356 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-04-23T14:37:09.357 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-04-23T14:37:09.357 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:09.358 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 139760364862624 on /run/cephadm/7b70c844-017e-11ef-bc93-c7b262605968.lock 2024-04-23T14:37:09.358 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 139760364862624 acquired on /run/cephadm/7b70c844-017e-11ef-bc93-c7b262605968.lock 2024-04-23T14:37:09.360 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-04-23T14:37:09.361 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-04-23T14:37:09.361 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-04-23T14:37:09.376 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-04-23T14:37:09.377 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-04-23T14:37:09.389 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-23T14:37:09.390 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-23T14:37:09.390 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-23T14:37:09.401 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-23T14:37:09.402 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-23T14:37:09.402 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-23T14:37:09.402 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-23T14:37:09.402 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-23T14:37:09.403 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-23T14:37:09.405 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-04-23T14:37:09.406 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-04-23T14:37:09.406 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-23T14:37:09.409 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-23T14:37:09.412 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0... 2024-04-23T14:37:10.213 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e 2024-04-23T14:37:10.213 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0... 2024-04-23T14:37:10.214 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Getting image source signatures 2024-04-23T14:37:10.214 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:871ee18b3c7f87d5ff3fbc84e47e46994673cad1275c5c818c1e7168af8e5da2 2024-04-23T14:37:10.214 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-23T14:37:10.214 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying config sha256:76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e 2024-04-23T14:37:10.215 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-23T14:37:11.597 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev) 2024-04-23T14:37:11.597 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev) 2024-04-23T14:37:11.598 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-04-23T14:37:13.225 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-04-23T14:37:13.225 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-04-23T14:37:14.391 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQCZxydm5rXKKRAAfr3ZyU/HfakFI73/yfSGIA== 2024-04-23T14:37:15.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQCaxydmsiHzNRAAz37gw25wh1fH1LAuYDKb9A== 2024-04-23T14:37:16.656 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQCcxydmOuVTABAAV6r7Klyk32yJE+R7QYj91w== 2024-04-23T14:37:16.658 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-04-23T14:37:28.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-04-23T14:37:29.935 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-04-23T14:37:30.240 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-23T14:37:30.488 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-23T14:37:30.785 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7b70c844-017e-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-7b70c844-017e-11ef-bc93-c7b262605968.target. 2024-04-23T14:37:30.785 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7b70c844-017e-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-7b70c844-017e-11ef-bc93-c7b262605968.target. 2024-04-23T14:37:31.166 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a 2024-04-23T14:37:31.166 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-23T14:37:31.493 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7b70c844-017e-11ef-bc93-c7b262605968.target.wants/ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-7b70c844-017e-11ef-bc93-c7b262605968@.service. 2024-04-23T14:37:32.172 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:31 smithi007 podman[27523]: 2024-04-23 14:37:31.829861158 +0000 UTC m=+0.037695866 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:37:32.172 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:32 smithi007 podman[27523]: 2024-04-23 14:37:32.17115095 +0000 UTC m=+0.378985690 container init a219fc0b712ee2c18960175efc4b55880da54f75b9520f912f5b3cb2cb880694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-04-23T14:37:32.304 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:37:32.304 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-04-23T14:37:32.321 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:37:32.321 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-04-23T14:37:32.321 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-04-23T14:37:32.322 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-04-23T14:37:32.322 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-04-23T14:37:32.322 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-04-23T14:37:32.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:32 smithi007 podman[27523]: 2024-04-23 14:37:32.182722266 +0000 UTC m=+0.390556985 container start a219fc0b712ee2c18960175efc4b55880da54f75b9520f912f5b3cb2cb880694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-23T14:37:32.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:32 smithi007 bash[27523]: a219fc0b712ee2c18960175efc4b55880da54f75b9520f912f5b3cb2cb880694 2024-04-23T14:37:32.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:32 smithi007 ceph-mon[27541]: mkfs 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:32.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:32 smithi007 ceph-mon[27541]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-23T14:37:32.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:32 smithi007 systemd[1]: Started Ceph mon.a for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:33.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: monmap epoch 1 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: last_changed 2024-04-23T14:37:17.131882+0000 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: min_mon_release 19 (squid) 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: election_strategy: 1 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: fsmap 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: osdmap e1: 0 total, 0 up, 0 in 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: mgrmap e1: no daemons active 2024-04-23T14:37:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:33 smithi007 ceph-mon[27541]: from='client.? 172.21.15.7:0/1243279171' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-23T14:37:34.383 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-04-23T14:37:34.383 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:34.383 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-23T14:37:34.383 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.904518s) 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.069+0000 7f56f3000700 1 Processor -- start 2024-04-23T14:37:34.384 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.069+0000 7f56f3000700 1 -- start start 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.069+0000 7f56f3000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec10f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.069+0000 7f56f3000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec10f920 con 0x7f56ec10efc0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.071+0000 7f56ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec10f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.071+0000 7f56ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec10f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40574/0 (socket says 172.21.15.7:40574) 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.071+0000 7f56ebe00700 1 -- 172.21.15.7:0/1437059690 learned_addr learned my addr 172.21.15.7:0/1437059690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.072+0000 7f56ebe00700 1 -- 172.21.15.7:0/1437059690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec10faa0 con 0x7f56ec10efc0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.072+0000 7f56ebe00700 1 --2- 172.21.15.7:0/1437059690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec10f3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009e80 tx=0x7f56dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34a6f2e0a6c061b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.072+0000 7f56eb400700 1 -- 172.21.15.7:0/1437059690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56dc017070 con 0x7f56ec10efc0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.072+0000 7f56eb400700 1 -- 172.21.15.7:0/1437059690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56dc003a20 con 0x7f56ec10efc0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.072+0000 7f56eb400700 1 -- 172.21.15.7:0/1437059690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56dc003d20 con 0x7f56ec10efc0 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 -- 172.21.15.7:0/1437059690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 msgr2=0x7f56ec10f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 --2- 172.21.15.7:0/1437059690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec10f3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009e80 tx=0x7f56dc00b330 comp rx=0 tx=0).stop 2024-04-23T14:37:34.385 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 -- 172.21.15.7:0/1437059690 shutdown_connections 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 --2- 172.21.15.7:0/1437059690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec10f3e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 -- 172.21.15.7:0/1437059690 >> 172.21.15.7:0/1437059690 conn(0x7f56ec07ddb0 msgr2=0x7f56ec0801d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 -- 172.21.15.7:0/1437059690 shutdown_connections 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.073+0000 7f56f3000700 1 -- 172.21.15.7:0/1437059690 wait complete. 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.074+0000 7f56f3000700 1 Processor -- start 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.075+0000 7f56f3000700 1 -- start start 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.075+0000 7f56f3000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec1a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.075+0000 7f56f3000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec110080 con 0x7f56ec10efc0 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.075+0000 7f56ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec1a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.075+0000 7f56ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec1a2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40584/0 (socket says 172.21.15.7:40584) 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.075+0000 7f56ebe00700 1 -- 172.21.15.7:0/1243279171 learned_addr learned my addr 172.21.15.7:0/1243279171 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.076+0000 7f56ebe00700 1 -- 172.21.15.7:0/1243279171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec1a2770 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.076+0000 7f56ebe00700 1 --2- 172.21.15.7:0/1243279171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec1a2230 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000f80 tx=0x7f56dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.076+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56dc022020 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.076+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56dc018040 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.076+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56dc017070 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.076+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec1a2a00 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.077+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec1a56f0 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.077+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56dc025020 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.077+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f56dc00f050 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.078+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec064150 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.081+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f56dc02c030 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.163+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f56ec02e1a0 con 0x7f56ec10efc0 2024-04-23T14:37:34.387 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.163+0000 7f56e9600700 1 -- 172.21.15.7:0/1243279171 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f56dc01e480 con 0x7f56ec10efc0 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 msgr2=0x7f56ec1a2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 --2- 172.21.15.7:0/1243279171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec1a2230 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000f80 tx=0x7f56dc004ad0 comp rx=0 tx=0).stop 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 shutdown_connections 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 --2- 172.21.15.7:0/1243279171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56ec10efc0 0x7f56ec1a2230 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 >> 172.21.15.7:0/1243279171 conn(0x7f56ec07ddb0 msgr2=0x7f56ec198e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 shutdown_connections 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.165+0000 7f56f3000700 1 -- 172.21.15.7:0/1243279171 wait complete. 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-04-23T14:37:34.388 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-04-23T14:37:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:35 smithi007 ceph-mon[27541]: from='client.? 172.21.15.7:0/287787095' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-23T14:37:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:35 smithi007 ceph-mon[27541]: from='client.? 172.21.15.7:0/287787095' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-23T14:37:35.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:35.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-04-23T14:37:35.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:35.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-04-23T14:37:35.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-23T14:37:35.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.024+0000 7fd6c9200700 1 Processor -- start 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.024+0000 7fd6c9200700 1 -- start start 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.024+0000 7fd6c9200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c410ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.024+0000 7fd6c9200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c410b140 con 0x7fd6c410a7e0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.025+0000 7fd6c1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c410ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.025+0000 7fd6c1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c410ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40596/0 (socket says 172.21.15.7:40596) 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.025+0000 7fd6c1e00700 1 -- 172.21.15.7:0/516908982 learned_addr learned my addr 172.21.15.7:0/516908982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.026+0000 7fd6c1e00700 1 -- 172.21.15.7:0/516908982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c410b2c0 con 0x7fd6c410a7e0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.026+0000 7fd6c1e00700 1 --2- 172.21.15.7:0/516908982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c410ac00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009e80 tx=0x7fd6b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8b97480cc43678 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.026+0000 7fd6c1400700 1 -- 172.21.15.7:0/516908982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6b4017070 con 0x7fd6c410a7e0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.026+0000 7fd6c1400700 1 -- 172.21.15.7:0/516908982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b4003a20 con 0x7fd6c410a7e0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.026+0000 7fd6c1400700 1 -- 172.21.15.7:0/516908982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6b4003d20 con 0x7fd6c410a7e0 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 -- 172.21.15.7:0/516908982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 msgr2=0x7fd6c410ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 --2- 172.21.15.7:0/516908982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c410ac00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009e80 tx=0x7fd6b400b330 comp rx=0 tx=0).stop 2024-04-23T14:37:35.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 -- 172.21.15.7:0/516908982 shutdown_connections 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 --2- 172.21.15.7:0/516908982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c410ac00 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 -- 172.21.15.7:0/516908982 >> 172.21.15.7:0/516908982 conn(0x7fd6c407ddb0 msgr2=0x7fd6c41084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 -- 172.21.15.7:0/516908982 shutdown_connections 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.027+0000 7fd6c9200700 1 -- 172.21.15.7:0/516908982 wait complete. 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.028+0000 7fd6c9200700 1 Processor -- start 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.029+0000 7fd6c9200700 1 -- start start 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.029+0000 7fd6c9200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c419dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.029+0000 7fd6c9200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c410bc90 con 0x7fd6c410a7e0 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.029+0000 7fd6c1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c419dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.029+0000 7fd6c1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c419dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40606/0 (socket says 172.21.15.7:40606) 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.029+0000 7fd6c1e00700 1 -- 172.21.15.7:0/287787095 learned_addr learned my addr 172.21.15.7:0/287787095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.030+0000 7fd6c1e00700 1 -- 172.21.15.7:0/287787095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c419e400 con 0x7fd6c410a7e0 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.030+0000 7fd6c1e00700 1 --2- 172.21.15.7:0/287787095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c419dec0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd6c410b510 tx=0x7fd6b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:35.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.030+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6b4022020 con 0x7fd6c410a7e0 2024-04-23T14:37:35.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.030+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b4018040 con 0x7fd6c410a7e0 2024-04-23T14:37:35.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.030+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c419e690 con 0x7fd6c410a7e0 2024-04-23T14:37:35.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.031+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6b4017070 con 0x7fd6c410a7e0 2024-04-23T14:37:35.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.031+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c41a1380 con 0x7fd6c410a7e0 2024-04-23T14:37:35.787 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.031+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd6b4025020 con 0x7fd6c410a7e0 2024-04-23T14:37:35.787 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.031+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd6b400f050 con 0x7fd6c410a7e0 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.032+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c4064150 con 0x7fd6c410a7e0 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.035+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd6b402c030 con 0x7fd6c410a7e0 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.112+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fd6c402e170 con 0x7fd6c410a7e0 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.122+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+452 (secure 0 0 0) 0x7fd6b401e480 con 0x7fd6c410a7e0 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.123+0000 7fd6bb400700 1 -- 172.21.15.7:0/287787095 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd6b4003a20 con 0x7fd6c410a7e0 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.124+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 msgr2=0x7fd6c419dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.124+0000 7fd6c9200700 1 --2- 172.21.15.7:0/287787095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c419dec0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd6c410b510 tx=0x7fd6b4004ad0 comp rx=0 tx=0).stop 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.125+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 shutdown_connections 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.125+0000 7fd6c9200700 1 --2- 172.21.15.7:0/287787095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6c410a7e0 0x7fd6c419dec0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.125+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 >> 172.21.15.7:0/287787095 conn(0x7fd6c407ddb0 msgr2=0x7fd6c4194a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.125+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 shutdown_connections 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.125+0000 7fd6c9200700 1 -- 172.21.15.7:0/287787095 wait complete. 2024-04-23T14:37:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-04-23T14:37:36.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:36 smithi007 ceph-mon[27541]: from='client.? 172.21.15.7:0/2864439627' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:37:37.174 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.392+0000 7f49cbe00700 1 Processor -- start 2024-04-23T14:37:37.174 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.393+0000 7f49cbe00700 1 -- start start 2024-04-23T14:37:37.174 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.393+0000 7f49cbe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c4106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.393+0000 7f49cbe00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49c4107280 con 0x7f49c4106890 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.394+0000 7f49c9400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c4106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.394+0000 7f49c9400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c4106cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40618/0 (socket says 172.21.15.7:40618) 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.394+0000 7f49c9400700 1 -- 172.21.15.7:0/3973842774 learned_addr learned my addr 172.21.15.7:0/3973842774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.394+0000 7f49c9400700 1 -- 172.21.15.7:0/3973842774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c4109820 con 0x7f49c4106890 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.394+0000 7f49c9400700 1 --2- 172.21.15.7:0/3973842774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c4106cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49b80098a0 tx=0x7f49b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0574e378646bacc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.395+0000 7f49c3e00700 1 -- 172.21.15.7:0/3973842774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b8004160 con 0x7f49c4106890 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.395+0000 7f49c3e00700 1 -- 172.21.15.7:0/3973842774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f49b8004300 con 0x7f49c4106890 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.395+0000 7f49c3e00700 1 -- 172.21.15.7:0/3973842774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b8011a80 con 0x7f49c4106890 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 -- 172.21.15.7:0/3973842774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 msgr2=0x7f49c4106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 --2- 172.21.15.7:0/3973842774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c4106cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49b80098a0 tx=0x7f49b8009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 -- 172.21.15.7:0/3973842774 shutdown_connections 2024-04-23T14:37:37.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 --2- 172.21.15.7:0/3973842774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c4106cb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 -- 172.21.15.7:0/3973842774 >> 172.21.15.7:0/3973842774 conn(0x7f49c4102260 msgr2=0x7f49c4104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 -- 172.21.15.7:0/3973842774 shutdown_connections 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.396+0000 7f49cbe00700 1 -- 172.21.15.7:0/3973842774 wait complete. 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.397+0000 7f49cbe00700 1 Processor -- start 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.397+0000 7f49cbe00700 1 -- start start 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.398+0000 7f49cbe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c41955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.398+0000 7f49cbe00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49c410cbd0 con 0x7f49c4106890 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.398+0000 7f49c9400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c41955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.398+0000 7f49c9400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c41955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40624/0 (socket says 172.21.15.7:40624) 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.398+0000 7f49c9400700 1 -- 172.21.15.7:0/2864439627 learned_addr learned my addr 172.21.15.7:0/2864439627 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.398+0000 7f49c9400700 1 -- 172.21.15.7:0/2864439627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c4195b20 con 0x7f49c4106890 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49c9400700 1 --2- 172.21.15.7:0/2864439627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c41955e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49b8000c00 tx=0x7f49b8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b80039c0 con 0x7f49c4106890 2024-04-23T14:37:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f49b8003b60 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c4195db0 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49b801a6f0 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c4192370 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.399+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f49b801ac20 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.400+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f49b8019700 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.400+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c4195f80 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.403+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f49c4195f80 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.482+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f49c41929a0 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.483+0000 7f49c2000700 1 -- 172.21.15.7:0/2864439627 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f49b8004300 con 0x7f49c4106890 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.484+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 msgr2=0x7f49c41955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.484+0000 7f49cbe00700 1 --2- 172.21.15.7:0/2864439627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c41955e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49b8000c00 tx=0x7f49b8004290 comp rx=0 tx=0).stop 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.484+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 shutdown_connections 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.484+0000 7f49cbe00700 1 --2- 172.21.15.7:0/2864439627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c4106890 0x7f49c41955e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.484+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 >> 172.21.15.7:0/2864439627 conn(0x7f49c4102260 msgr2=0x7f49c4102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.484+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 shutdown_connections 2024-04-23T14:37:37.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:36.485+0000 7f49cbe00700 1 -- 172.21.15.7:0/2864439627 wait complete. 2024-04-23T14:37:37.178 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-04-23T14:37:37.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:37 smithi007 systemd[1]: Stopping Ceph mon.a for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:37:37.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:37 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a[27537]: 2024-04-23T14:37:37.680+0000 7fd2abc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:37:37.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:37 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a[27537]: 2024-04-23T14:37:37.680+0000 7fd2abc00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-23T14:37:38.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:37 smithi007 podman[27783]: 2024-04-23 14:37:37.940035479 +0000 UTC m=+0.399828300 container died a219fc0b712ee2c18960175efc4b55880da54f75b9520f912f5b3cb2cb880694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:37:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:38 smithi007 podman[27783]: 2024-04-23 14:37:38.32302072 +0000 UTC m=+0.782813534 container cleanup a219fc0b712ee2c18960175efc4b55880da54f75b9520f912f5b3cb2cb880694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:37:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:38 smithi007 bash[27783]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a 2024-04-23T14:37:38.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:38 smithi007 podman[27797]: 2024-04-23 14:37:38.540356005 +0000 UTC m=+0.586087460 container remove a219fc0b712ee2c18960175efc4b55880da54f75b9520f912f5b3cb2cb880694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-23T14:37:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 systemd[1]: ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-23T14:37:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 systemd[1]: Stopped Ceph mon.a for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 systemd[1]: ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service: Consumed 2.017s CPU time. 2024-04-23T14:37:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 systemd[1]: Starting Ceph mon.a for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:37:39.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 podman[27887]: 2024-04-23 14:37:39.327992844 +0000 UTC m=+0.034607139 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:37:39.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 podman[27887]: 2024-04-23 14:37:39.441104617 +0000 UTC m=+0.147718951 container create b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-23T14:37:39.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 podman[27887]: 2024-04-23 14:37:39.71166487 +0000 UTC m=+0.418279206 container init b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:37:39.804 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-23T14:37:40.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 podman[27887]: 2024-04-23 14:37:39.722280979 +0000 UTC m=+0.428895282 container start b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:37:40.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T14:37:40.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev), process ceph-mon, pid 2 2024-04-23T14:37:40.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: pidfile_write: ignore empty --pid-file 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: load: jerasure load: lrc 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: RocksDB version: 7.9.2 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Git sha 0 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Compile date 2024-04-22 13:15:13 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: DB SUMMARY 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: DB Session ID: ARRK2N1W6451YNQWK6C2 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: CURRENT file: CURRENT 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105516 ; 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.error_if_exists: 0 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.create_if_missing: 0 2024-04-23T14:37:40.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.paranoid_checks: 1 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.env: 0x55a16a158cc0 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.fs: PosixFileSystem 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.info_log: 0x55a192875c60 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.statistics: (nil) 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.use_fsync: 0 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_log_file_size: 0 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T14:37:40.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.allow_fallocate: 1 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.use_direct_reads: 0 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T14:37:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.db_log_dir: 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.wal_dir: 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.write_buffer_manager: 0x55a1928441e0 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T14:37:40.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.unordered_write: 0 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.row_cache: None 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.wal_filter: None 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T14:37:40.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.two_write_queues: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.wal_compression: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.atomic_flush: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T14:37:40.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.log_readahead_size: 0 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_background_jobs: 2 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_background_compactions: -1 2024-04-23T14:37:40.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_subcompactions: 1 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_open_files: -1 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T14:37:40.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_background_flushes: -1 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Compression algorithms supported: 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kZSTD supported: 0 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kXpressCompression supported: 0 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kZlibCompression supported: 1 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kSnappyCompression supported: 1 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kLZ4Compression supported: 1 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: kBZip2Compression supported: 0 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T14:37:40.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.merge_operator: 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_filter: None 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a192875e20) 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T14:37:40.027 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x55a192877090 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-04-23T14:37:40.028 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-04-23T14:37:40.029 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression: NoCompression 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.num_levels: 7 2024-04-23T14:37:40.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T14:37:40.031 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T14:37:40.031 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T14:37:40.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T14:37:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T14:37:40.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.arena_block_size: 1048576 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T14:37:40.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.inplace_update_support: 0 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.bloom_locality: 0 2024-04-23T14:37:40.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.max_successive_merges: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.ttl: 2592000 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.enable_blob_files: false 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.min_blob_size: 0 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T14:37:40.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.blob_file_starting_level: 0 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6549cf58-326f-4b91-9df8-3db2eda63d76 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883059780768, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883059783048, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100623, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98511, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14290, "raw_average_key_size": 49, "raw_value_size": 90741, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713883059, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6549cf58-326f-4b91-9df8-3db2eda63d76", "db_session_id": "ARRK2N1W6451YNQWK6C2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883059783206, "job": 1, "event": "recovery_finished"} 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a192964000 2024-04-23T14:37:40.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: DB pointer 0x55a19294e000 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-23T14:37:40.040 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 100.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 100.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 60.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 60.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-04-23T14:37:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 12.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 12.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x55a192877090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-04-23T14:37:40.042 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???) e1 preinit fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).mds e1 new map 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).mds e1 print_map 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:37:40.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 bash[27887]: b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 systemd[1]: Started Ceph mon.a for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: monmap epoch 1 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: last_changed 2024-04-23T14:37:17.131882+0000 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: min_mon_release 19 (squid) 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: election_strategy: 1 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: fsmap 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: osdmap e1: 0 total, 0 up, 0 in 2024-04-23T14:37:40.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:39 smithi007 ceph-mon[27906]: mgrmap e1: no daemons active 2024-04-23T14:37:41.175 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.447+0000 7fae70c00700 1 Processor -- start 2024-04-23T14:37:41.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.448+0000 7fae70c00700 1 -- start start 2024-04-23T14:37:41.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.448+0000 7fae70c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c108a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:41.176 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.448+0000 7fae70c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c108fd0 con 0x7fae6c1085e0 2024-04-23T14:37:41.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.449+0000 7fae69e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c108a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:41.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.449+0000 7fae69e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c108a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40626/0 (socket says 172.21.15.7:40626) 2024-04-23T14:37:41.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.449+0000 7fae69e00700 1 -- 172.21.15.7:0/467705504 learned_addr learned my addr 172.21.15.7:0/467705504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:41.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.450+0000 7fae69e00700 1 -- 172.21.15.7:0/467705504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c109790 con 0x7fae6c1085e0 2024-04-23T14:37:41.177 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.450+0000 7fae69e00700 1 --2- 172.21.15.7:0/467705504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c108a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0098a0 tx=0x7fae5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c0602da8d56543 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:41.178 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.450+0000 7fae68a00700 1 -- 172.21.15.7:0/467705504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5c004160 con 0x7fae6c1085e0 2024-04-23T14:37:41.178 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.450+0000 7fae68a00700 1 -- 172.21.15.7:0/467705504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fae5c004300 con 0x7fae6c1085e0 2024-04-23T14:37:41.178 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.450+0000 7fae68a00700 1 -- 172.21.15.7:0/467705504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5c011a80 con 0x7fae6c1085e0 2024-04-23T14:37:41.179 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 -- 172.21.15.7:0/467705504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 msgr2=0x7fae6c108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:41.179 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 --2- 172.21.15.7:0/467705504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c108a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0098a0 tx=0x7fae5c009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:41.179 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 -- 172.21.15.7:0/467705504 shutdown_connections 2024-04-23T14:37:41.179 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 --2- 172.21.15.7:0/467705504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c108a00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:41.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 -- 172.21.15.7:0/467705504 >> 172.21.15.7:0/467705504 conn(0x7fae6c103c60 msgr2=0x7fae6c106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:41.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 -- 172.21.15.7:0/467705504 shutdown_connections 2024-04-23T14:37:41.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.451+0000 7fae70c00700 1 -- 172.21.15.7:0/467705504 wait complete. 2024-04-23T14:37:41.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.452+0000 7fae70c00700 1 Processor -- start 2024-04-23T14:37:41.180 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.453+0000 7fae70c00700 1 -- start start 2024-04-23T14:37:41.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.453+0000 7fae70c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:41.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.453+0000 7fae70c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c10cb40 con 0x7fae6c1085e0 2024-04-23T14:37:41.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.453+0000 7fae69e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:41.181 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.453+0000 7fae69e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c19c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40636/0 (socket says 172.21.15.7:40636) 2024-04-23T14:37:41.182 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.453+0000 7fae69e00700 1 -- 172.21.15.7:0/1140528054 learned_addr learned my addr 172.21.15.7:0/1140528054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:41.182 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.454+0000 7fae69e00700 1 -- 172.21.15.7:0/1140528054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c19ca40 con 0x7fae6c1085e0 2024-04-23T14:37:41.182 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.454+0000 7fae69e00700 1 --2- 172.21.15.7:0/1140528054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c19c500 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fae5c000c00 tx=0x7fae5c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:41.182 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.454+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5c0039c0 con 0x7fae6c1085e0 2024-04-23T14:37:41.183 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.454+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fae5c003b60 con 0x7fae6c1085e0 2024-04-23T14:37:41.183 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.454+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c19ccd0 con 0x7fae6c1085e0 2024-04-23T14:37:41.183 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.454+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5c01a6f0 con 0x7fae6c1085e0 2024-04-23T14:37:41.183 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.455+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c19f9c0 con 0x7fae6c1085e0 2024-04-23T14:37:41.183 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.455+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fae5c02d3f0 con 0x7fae6c1085e0 2024-04-23T14:37:41.184 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.455+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fae5c019700 con 0x7fae6c1085e0 2024-04-23T14:37:41.184 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.456+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c064150 con 0x7fae6c1085e0 2024-04-23T14:37:41.184 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.459+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fae5c024a40 con 0x7fae6c1085e0 2024-04-23T14:37:41.184 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.537+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fae6c19fb90 con 0x7fae6c1085e0 2024-04-23T14:37:41.185 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.542+0000 7fae62a00700 1 -- 172.21.15.7:0/1140528054 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fae5c032030 con 0x7fae6c1085e0 2024-04-23T14:37:41.185 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.543+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 msgr2=0x7fae6c19c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:41.185 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.543+0000 7fae70c00700 1 --2- 172.21.15.7:0/1140528054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c19c500 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fae5c000c00 tx=0x7fae5c004290 comp rx=0 tx=0).stop 2024-04-23T14:37:41.186 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.544+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 shutdown_connections 2024-04-23T14:37:41.186 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.544+0000 7fae70c00700 1 --2- 172.21.15.7:0/1140528054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae6c1085e0 0x7fae6c19c500 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:41.186 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.544+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 >> 172.21.15.7:0/1140528054 conn(0x7fae6c103c60 msgr2=0x7fae6c104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:41.186 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.544+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 shutdown_connections 2024-04-23T14:37:41.186 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.544+0000 7fae70c00700 1 -- 172.21.15.7:0/1140528054 wait complete. 2024-04-23T14:37:41.187 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-23T14:37:41.207 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-23T14:37:41.208 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-04-23T14:37:41.209 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-23T14:37:41.211 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-23T14:37:41.617 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x 2024-04-23T14:37:41.617 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-23T14:37:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:41 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1140528054' entity='client.admin' 2024-04-23T14:37:41.906 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7b70c844-017e-11ef-bc93-c7b262605968.target.wants/ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-7b70c844-017e-11ef-bc93-c7b262605968@.service. 2024-04-23T14:37:42.322 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:41 smithi007 systemd[1]: Starting Ceph mgr.x for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:37:42.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 podman[28119]: 2024-04-23 14:37:42.226869157 +0000 UTC m=+0.036387542 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:37:42.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 podman[28119]: 2024-04-23 14:37:42.335430178 +0000 UTC m=+0.144948597 container create 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-23T14:37:42.818 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:37:42.818 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-04-23T14:37:42.837 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:37:42.837 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-04-23T14:37:42.837 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-04-23T14:37:42.837 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-04-23T14:37:42.863 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:37:42.863 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-04-23T14:37:42.883 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:37:42.883 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-04-23T14:37:42.883 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-04-23T14:37:42.883 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-23T14:37:42.884 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-04-23T14:37:42.884 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-04-23T14:37:42.944 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 podman[28119]: 2024-04-23 14:37:42.672493721 +0000 UTC m=+0.482012147 container init 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-23T14:37:42.944 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 podman[28119]: 2024-04-23 14:37:42.683390411 +0000 UTC m=+0.492908863 container start 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:37:42.944 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 bash[28119]: 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 2024-04-23T14:37:42.944 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 systemd[1]: Started Ceph mgr.x for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:43.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:42 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:42.942+0000 7ff70583e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:37:43.224 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:43.201+0000 7ff70583e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:37:43.482 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:43.341+0000 7ff70583e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:37:43.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:43 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/138794498' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:44.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:43.769+0000 7ff70583e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:37:44.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:43.892+0000 7ff70583e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:44.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:44.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:44.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:44.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:44.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:44.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:44.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:32.262393+0000", 2024-04-23T14:37:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.544+0000 7f51ed200700 1 Processor -- start 2024-04-23T14:37:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.544+0000 7f51ed200700 1 -- start start 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.544+0000 7f51ed200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e807c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.544+0000 7f51ed200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51e807c8d0 con 0x7f51e807de50 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.545+0000 7f51e5e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.545+0000 7f51e5e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e807c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51376/0 (socket says 172.21.15.7:51376) 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.545+0000 7f51e5e00700 1 -- 172.21.15.7:0/3048976411 learned_addr learned my addr 172.21.15.7:0/3048976411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.545+0000 7f51e5e00700 1 -- 172.21.15.7:0/3048976411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e807ca50 con 0x7f51e807de50 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.546+0000 7f51e5e00700 1 --2- 172.21.15.7:0/3048976411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e807c300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f51d80098a0 tx=0x7f51d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad1cf7f9dd5dec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.546+0000 7f51e4a00700 1 -- 172.21.15.7:0/3048976411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8004160 con 0x7f51e807de50 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.546+0000 7f51e4a00700 1 -- 172.21.15.7:0/3048976411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f51d8004300 con 0x7f51e807de50 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.546+0000 7f51e4a00700 1 -- 172.21.15.7:0/3048976411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8011a80 con 0x7f51e807de50 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 -- 172.21.15.7:0/3048976411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 msgr2=0x7f51e807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 --2- 172.21.15.7:0/3048976411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e807c300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f51d80098a0 tx=0x7f51d8009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 -- 172.21.15.7:0/3048976411 shutdown_connections 2024-04-23T14:37:44.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 --2- 172.21.15.7:0/3048976411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e807c300 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:44.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 -- 172.21.15.7:0/3048976411 >> 172.21.15.7:0/3048976411 conn(0x7f51e8103c00 msgr2=0x7f51e8106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:44.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 -- 172.21.15.7:0/3048976411 shutdown_connections 2024-04-23T14:37:44.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.547+0000 7f51ed200700 1 -- 172.21.15.7:0/3048976411 wait complete. 2024-04-23T14:37:44.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.548+0000 7f51ed200700 1 Processor -- start 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.548+0000 7f51ed200700 1 -- start start 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.549+0000 7f51ed200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.549+0000 7f51ed200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51e810eaf0 con 0x7f51e807de50 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.549+0000 7f51e5e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.549+0000 7f51e5e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e819e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51380/0 (socket says 172.21.15.7:51380) 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.549+0000 7f51e5e00700 1 -- 172.21.15.7:0/138794498 learned_addr learned my addr 172.21.15.7:0/138794498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.549+0000 7f51e5e00700 1 -- 172.21.15.7:0/138794498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e819ebf0 con 0x7f51e807de50 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.550+0000 7f51e5e00700 1 --2- 172.21.15.7:0/138794498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e819e6b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f51d8006af0 tx=0x7f51d8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.550+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d8003930 con 0x7f51e807de50 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.550+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f51d8003ad0 con 0x7f51e807de50 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.550+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d80195e0 con 0x7f51e807de50 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.550+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e819ee80 con 0x7f51e807de50 2024-04-23T14:37:44.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.550+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e81a1b70 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.551+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51d8019c20 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.551+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f51d8024730 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.551+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e8064150 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.554+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f51d8043e50 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.634+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f51e81a1d40 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.635+0000 7f51dea00700 1 -- 172.21.15.7:0/138794498 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f51d8032030 con 0x7f51e807de50 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 msgr2=0x7f51e819e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 --2- 172.21.15.7:0/138794498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e819e6b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f51d8006af0 tx=0x7f51d8011b70 comp rx=0 tx=0).stop 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 shutdown_connections 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 --2- 172.21.15.7:0/138794498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e807de50 0x7f51e819e6b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:44.488 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 >> 172.21.15.7:0/138794498 conn(0x7f51e8103c00 msgr2=0x7f51e8104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:44.489 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 shutdown_connections 2024-04-23T14:37:44.489 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.637+0000 7f51ed200700 1 -- 172.21.15.7:0/138794498 wait complete. 2024-04-23T14:37:44.489 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-04-23T14:37:45.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:45 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:45.531+0000 7ff70583e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:37:45.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:45 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:45.763+0000 7ff70583e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:37:46.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:45 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:45.982+0000 7ff70583e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:37:46.650 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:46 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:46.375+0000 7ff70583e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:37:46.650 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:46 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:46.503+0000 7ff70583e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:37:46.914 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:46 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:46.775+0000 7ff70583e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:37:47.166 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:47 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:47.047+0000 7ff70583e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:37:47.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:47 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1580521545' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:47.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:47.847 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.849 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:47.849 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:47.849 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:47.849 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:47.849 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:47.850 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:47.853 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:47.853 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:47.853 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:47.853 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.853 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:47.854 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:32.262393+0000", 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.075+0000 7fbe99600700 1 Processor -- start 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.075+0000 7fbe99600700 1 -- start start 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.075+0000 7fbe99600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe94108830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.075+0000 7fbe99600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94108d70 con 0x7fbe94108410 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.076+0000 7fbe93e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe94108830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:47.858 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.076+0000 7fbe93e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe94108830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51388/0 (socket says 172.21.15.7:51388) 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.076+0000 7fbe93e00700 1 -- 172.21.15.7:0/3427082540 learned_addr learned my addr 172.21.15.7:0/3427082540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.076+0000 7fbe93e00700 1 -- 172.21.15.7:0/3427082540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe94108ef0 con 0x7fbe94108410 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.076+0000 7fbe93e00700 1 --2- 172.21.15.7:0/3427082540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe94108830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe840098a0 tx=0x7fbe84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8965f542e59172 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.077+0000 7fbe93400700 1 -- 172.21.15.7:0/3427082540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe84004160 con 0x7fbe94108410 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.077+0000 7fbe93400700 1 -- 172.21.15.7:0/3427082540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbe84004300 con 0x7fbe94108410 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.077+0000 7fbe93400700 1 -- 172.21.15.7:0/3427082540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe84011a80 con 0x7fbe94108410 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.077+0000 7fbe99600700 1 -- 172.21.15.7:0/3427082540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 msgr2=0x7fbe94108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.077+0000 7fbe99600700 1 --2- 172.21.15.7:0/3427082540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe94108830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe840098a0 tx=0x7fbe84009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.078+0000 7fbe99600700 1 -- 172.21.15.7:0/3427082540 shutdown_connections 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.078+0000 7fbe99600700 1 --2- 172.21.15.7:0/3427082540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe94108830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.078+0000 7fbe99600700 1 -- 172.21.15.7:0/3427082540 >> 172.21.15.7:0/3427082540 conn(0x7fbe94103af0 msgr2=0x7fbe94105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:47.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.078+0000 7fbe99600700 1 -- 172.21.15.7:0/3427082540 shutdown_connections 2024-04-23T14:37:47.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.078+0000 7fbe99600700 1 -- 172.21.15.7:0/3427082540 wait complete. 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.079+0000 7fbe99600700 1 Processor -- start 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.079+0000 7fbe99600700 1 -- start start 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.079+0000 7fbe99600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe9419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.079+0000 7fbe99600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9410a410 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.080+0000 7fbe93e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe9419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.080+0000 7fbe93e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe9419e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51404/0 (socket says 172.21.15.7:51404) 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.080+0000 7fbe93e00700 1 -- 172.21.15.7:0/1580521545 learned_addr learned my addr 172.21.15.7:0/1580521545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.080+0000 7fbe93e00700 1 -- 172.21.15.7:0/1580521545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9419ea70 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.080+0000 7fbe93e00700 1 --2- 172.21.15.7:0/1580521545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe9419e530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe84006af0 tx=0x7fbe84011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe84003930 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbe84003ad0 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9419ed00 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe840195e0 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941a19f0 con 0x7fbe94108410 2024-04-23T14:37:47.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe84019c70 con 0x7fbe94108410 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.081+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbe84024730 con 0x7fbe94108410 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.082+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe94064150 con 0x7fbe94108410 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.085+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbe84043e50 con 0x7fbe94108410 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.164+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbe941a1f40 con 0x7fbe94108410 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.165+0000 7fbe91600700 1 -- 172.21.15.7:0/1580521545 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fbe84032020 con 0x7fbe94108410 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 msgr2=0x7fbe9419e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 --2- 172.21.15.7:0/1580521545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe9419e530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe84006af0 tx=0x7fbe84011b70 comp rx=0 tx=0).stop 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 shutdown_connections 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 --2- 172.21.15.7:0/1580521545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe94108410 0x7fbe9419e530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 >> 172.21.15.7:0/1580521545 conn(0x7fbe94103af0 msgr2=0x7fbe94104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 shutdown_connections 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:47.167+0000 7fbe99600700 1 -- 172.21.15.7:0/1580521545 wait complete. 2024-04-23T14:37:47.864 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-04-23T14:37:48.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:47 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:47.872+0000 7ff70583e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:37:48.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:48 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:48.446+0000 7ff70583e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:37:48.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:48 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:48.588+0000 7ff70583e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:37:49.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:48 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:48.871+0000 7ff70583e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:37:49.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:49 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:49.537+0000 7ff70583e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:37:49.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:49 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:49.667+0000 7ff70583e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:37:50.312 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:50.006+0000 7ff70583e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:37:50.312 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:50.203+0000 7ff70583e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:37:50.562 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:50.335+0000 7ff70583e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:37:50.562 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:50.497+0000 7ff70583e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:37:50.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:50 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/127369158' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:51.244 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:50.877+0000 7ff70583e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:37:51.255 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T14:37:51.256 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:51.257 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:51.265 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:51.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:32.262393+0000", 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.463+0000 7f7278a00700 1 Processor -- start 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.464+0000 7f7278a00700 1 -- start start 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.464+0000 7f7278a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.464+0000 7f7278a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f727407e170 con 0x7f727407dd50 2024-04-23T14:37:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.465+0000 7f7272800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.465+0000 7f7272800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51410/0 (socket says 172.21.15.7:51410) 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.465+0000 7f7272800700 1 -- 172.21.15.7:0/1525665358 learned_addr learned my addr 172.21.15.7:0/1525665358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.465+0000 7f7272800700 1 -- 172.21.15.7:0/1525665358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727407c800 con 0x7f727407dd50 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.465+0000 7f7272800700 1 --2- 172.21.15.7:0/1525665358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727407c2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f72640098a0 tx=0x7f7264009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4deddbab3e53db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.466+0000 7f7271400700 1 -- 172.21.15.7:0/1525665358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7264004160 con 0x7f727407dd50 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.466+0000 7f7271400700 1 -- 172.21.15.7:0/1525665358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7264004300 con 0x7f727407dd50 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.466+0000 7f7271400700 1 -- 172.21.15.7:0/1525665358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7264011a80 con 0x7f727407dd50 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.466+0000 7f7278a00700 1 -- 172.21.15.7:0/1525665358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 msgr2=0x7f727407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.466+0000 7f7278a00700 1 --2- 172.21.15.7:0/1525665358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727407c2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f72640098a0 tx=0x7f7264009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.467+0000 7f7278a00700 1 -- 172.21.15.7:0/1525665358 shutdown_connections 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.467+0000 7f7278a00700 1 --2- 172.21.15.7:0/1525665358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727407c2c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.467+0000 7f7278a00700 1 -- 172.21.15.7:0/1525665358 >> 172.21.15.7:0/1525665358 conn(0x7f7274103af0 msgr2=0x7f7274105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.467+0000 7f7278a00700 1 -- 172.21.15.7:0/1525665358 shutdown_connections 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.467+0000 7f7278a00700 1 -- 172.21.15.7:0/1525665358 wait complete. 2024-04-23T14:37:51.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.468+0000 7f7278a00700 1 Processor -- start 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.468+0000 7f7278a00700 1 -- start start 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.469+0000 7f7278a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.469+0000 7f7278a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f727410e860 con 0x7f727407dd50 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.469+0000 7f7272800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.469+0000 7f7272800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727419e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51418/0 (socket says 172.21.15.7:51418) 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.469+0000 7f7272800700 1 -- 172.21.15.7:0/127369158 learned_addr learned my addr 172.21.15.7:0/127369158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.469+0000 7f7272800700 1 -- 172.21.15.7:0/127369158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727419ea40 con 0x7f727407dd50 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.470+0000 7f7272800700 1 --2- 172.21.15.7:0/127369158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727419e500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7264011a50 tx=0x7f7264004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.470+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72640039f0 con 0x7f727407dd50 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.470+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727419ecd0 con 0x7f727407dd50 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.470+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7264003b90 con 0x7f727407dd50 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.470+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f726401a600 con 0x7f727407dd50 2024-04-23T14:37:51.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.470+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72741a19c0 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.471+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f726401ac60 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.471+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7264019700 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.471+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7274064150 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.476+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7264024a40 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.555+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f72741a1f00 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.556+0000 7f726b400700 1 -- 172.21.15.7:0/127369158 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f7264024440 con 0x7f727407dd50 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.557+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 msgr2=0x7f727419e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.557+0000 7f7278a00700 1 --2- 172.21.15.7:0/127369158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727419e500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7264011a50 tx=0x7f7264004290 comp rx=0 tx=0).stop 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.558+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 shutdown_connections 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.558+0000 7f7278a00700 1 --2- 172.21.15.7:0/127369158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f727407dd50 0x7f727419e500 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.558+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 >> 172.21.15.7:0/127369158 conn(0x7f7274103af0 msgr2=0x7f7274104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.558+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 shutdown_connections 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.558+0000 7f7278a00700 1 -- 172.21.15.7:0/127369158 wait complete. 2024-04-23T14:37:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (3/15)... 2024-04-23T14:37:51.971 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:51 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:51.674+0000 7ff70583e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:37:52.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:51 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:51.968+0000 7ff70583e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:37:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: Activating manager daemon x 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: mgrmap e2: x(active, starting, since 0.00582605s) 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: Manager daemon x is now available 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T14:37:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:52 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' 2024-04-23T14:37:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:53 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' 2024-04-23T14:37:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:53 smithi007 ceph-mon[27906]: from='mgr.14100 172.21.15.7:0/1113253901' entity='mgr.x' 2024-04-23T14:37:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:53 smithi007 ceph-mon[27906]: mgrmap e3: x(active, since 1.02007s) 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:54.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:54.982 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.983 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:54.984 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:32.262393+0000", 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.977+0000 7fd30a200700 1 Processor -- start 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.977+0000 7fd30a200700 1 -- start start 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.978+0000 7fd30a200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd30410f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.978+0000 7fd30a200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd30410f920 con 0x7fd30410efc0 2024-04-23T14:37:54.985 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.978+0000 7fd303400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd30410f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.978+0000 7fd303400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd30410f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58198/0 (socket says 172.21.15.7:58198) 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.978+0000 7fd303400700 1 -- 172.21.15.7:0/3909093346 learned_addr learned my addr 172.21.15.7:0/3909093346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.979+0000 7fd303400700 1 -- 172.21.15.7:0/3909093346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30410faa0 con 0x7fd30410efc0 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.979+0000 7fd303400700 1 --2- 172.21.15.7:0/3909093346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd30410f3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098a0 tx=0x7fd2f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87de653a141847ad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.980+0000 7fd302a00700 1 -- 172.21.15.7:0/3909093346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f4004160 con 0x7fd30410efc0 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.980+0000 7fd302a00700 1 -- 172.21.15.7:0/3909093346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd2f4004300 con 0x7fd30410efc0 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.980+0000 7fd302a00700 1 -- 172.21.15.7:0/3909093346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f4011a80 con 0x7fd30410efc0 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.980+0000 7fd30a200700 1 -- 172.21.15.7:0/3909093346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 msgr2=0x7fd30410f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.980+0000 7fd30a200700 1 --2- 172.21.15.7:0/3909093346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd30410f3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098a0 tx=0x7fd2f4009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.981+0000 7fd30a200700 1 -- 172.21.15.7:0/3909093346 shutdown_connections 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.981+0000 7fd30a200700 1 --2- 172.21.15.7:0/3909093346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd30410f3e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.981+0000 7fd30a200700 1 -- 172.21.15.7:0/3909093346 >> 172.21.15.7:0/3909093346 conn(0x7fd30407ddb0 msgr2=0x7fd3040801d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:54.986 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.981+0000 7fd30a200700 1 -- 172.21.15.7:0/3909093346 shutdown_connections 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.981+0000 7fd30a200700 1 -- 172.21.15.7:0/3909093346 wait complete. 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.982+0000 7fd30a200700 1 Processor -- start 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.983+0000 7fd30a200700 1 -- start start 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.983+0000 7fd30a200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd3041a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.983+0000 7fd30a200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd304110b60 con 0x7fd30410efc0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.983+0000 7fd303400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd3041a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.983+0000 7fd303400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd3041a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58206/0 (socket says 172.21.15.7:58206) 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.983+0000 7fd303400700 1 -- 172.21.15.7:0/2469494367 learned_addr learned my addr 172.21.15.7:0/2469494367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.984+0000 7fd303400700 1 -- 172.21.15.7:0/2469494367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3041a2fc0 con 0x7fd30410efc0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.984+0000 7fd303400700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd3041a2a80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4011a50 tx=0x7fd2f4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.985+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f40039f0 con 0x7fd30410efc0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.985+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd2f4003b90 con 0x7fd30410efc0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.985+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f401a5a0 con 0x7fd30410efc0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.985+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3041a32b0 con 0x7fd30410efc0 2024-04-23T14:37:54.987 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.985+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3041a5f40 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.986+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 3) ==== 46441+0+0 (secure 0 0 0) 0x7fd2f401a8a0 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.986+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd304064150 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.986+0000 7fd300c00700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7fd2e8039440 0x7fd2e803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.986+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd2f404d8c0 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.987+0000 7fd2fbe00700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7fd2e8039440 0x7fd2e803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.987+0000 7fd2fbe00700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7fd2e8039440 0x7fd2e803b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006fd0 tx=0x7fd2ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.993+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd2f4019c70 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.032+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fd2f4024a40 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.310+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd3041a6640 con 0x7fd30410efc0 2024-04-23T14:37:54.988 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.311+0000 7fd300c00700 1 -- 172.21.15.7:0/2469494367 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fd2f4010380 con 0x7fd30410efc0 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7fd2e8039440 msgr2=0x7fd2e803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7fd2e8039440 0x7fd2e803b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec006fd0 tx=0x7fd2ec006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 msgr2=0x7fd3041a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd3041a2a80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4011a50 tx=0x7fd2f4004290 comp rx=0 tx=0).stop 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 shutdown_connections 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7fd2e8039440 0x7fd2e803b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 --2- 172.21.15.7:0/2469494367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd30410efc0 0x7fd3041a2a80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.314+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 >> 172.21.15.7:0/2469494367 conn(0x7fd30407ddb0 msgr2=0x7fd30407e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.315+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 shutdown_connections 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:54.315+0000 7fd30a200700 1 -- 172.21.15.7:0/2469494367 wait complete. 2024-04-23T14:37:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-04-23T14:37:55.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:55 smithi007 ceph-mon[27906]: mgrmap e4: x(active, since 2s) 2024-04-23T14:37:55.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:55 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2469494367' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:56.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:56 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/258650256' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-23T14:37:56.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:56.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-04-23T14:37:56.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:56.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-23T14:37:56.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:56.557 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-04-23T14:37:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-04-23T14:37:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-23T14:37:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-23T14:37:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-23T14:37:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-23T14:37:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-23T14:37:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.600+0000 7f20f1800700 1 Processor -- start 2024-04-23T14:37:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.600+0000 7f20f1800700 1 -- start start 2024-04-23T14:37:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.601+0000 7f20f1800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec10aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.601+0000 7f20f1800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec10b020 con 0x7f20ec10a6c0 2024-04-23T14:37:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.601+0000 7f20ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec10aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.601+0000 7f20ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec10aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58218/0 (socket says 172.21.15.7:58218) 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.601+0000 7f20ebe00700 1 -- 172.21.15.7:0/1624396702 learned_addr learned my addr 172.21.15.7:0/1624396702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.602+0000 7f20ebe00700 1 -- 172.21.15.7:0/1624396702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec10b1a0 con 0x7f20ec10a6c0 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.602+0000 7f20ebe00700 1 --2- 172.21.15.7:0/1624396702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec10aae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0098a0 tx=0x7f20dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e133bf5a9760c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.602+0000 7f20eaa00700 1 -- 172.21.15.7:0/1624396702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20dc004160 con 0x7f20ec10a6c0 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.603+0000 7f20eaa00700 1 -- 172.21.15.7:0/1624396702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f20dc004300 con 0x7f20ec10a6c0 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.603+0000 7f20eaa00700 1 -- 172.21.15.7:0/1624396702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20dc011a80 con 0x7f20ec10a6c0 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.603+0000 7f20f1800700 1 -- 172.21.15.7:0/1624396702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 msgr2=0x7f20ec10aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.603+0000 7f20f1800700 1 --2- 172.21.15.7:0/1624396702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec10aae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0098a0 tx=0x7f20dc009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.604+0000 7f20f1800700 1 -- 172.21.15.7:0/1624396702 shutdown_connections 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.604+0000 7f20f1800700 1 --2- 172.21.15.7:0/1624396702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec10aae0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.604+0000 7f20f1800700 1 -- 172.21.15.7:0/1624396702 >> 172.21.15.7:0/1624396702 conn(0x7f20ec07de10 msgr2=0x7f20ec1084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.604+0000 7f20f1800700 1 -- 172.21.15.7:0/1624396702 shutdown_connections 2024-04-23T14:37:56.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.604+0000 7f20f1800700 1 -- 172.21.15.7:0/1624396702 wait complete. 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.605+0000 7f20f1800700 1 Processor -- start 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.606+0000 7f20f1800700 1 -- start start 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.606+0000 7f20f1800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.606+0000 7f20f1800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec10c630 con 0x7f20ec10a6c0 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.606+0000 7f20ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.606+0000 7f20ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec19e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58234/0 (socket says 172.21.15.7:58234) 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.606+0000 7f20ebe00700 1 -- 172.21.15.7:0/258650256 learned_addr learned my addr 172.21.15.7:0/258650256 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:56.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.607+0000 7f20ebe00700 1 -- 172.21.15.7:0/258650256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec19e9b0 con 0x7f20ec10a6c0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.607+0000 7f20ebe00700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec19e470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f20dc011a50 tx=0x7f20dc011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.607+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20dc003a80 con 0x7f20ec10a6c0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.607+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f20dc003c20 con 0x7f20ec10a6c0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.607+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20dc01a650 con 0x7f20ec10a6c0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.607+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec19ec40 con 0x7f20ec10a6c0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.608+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec1a1930 con 0x7f20ec10a6c0 2024-04-23T14:37:56.566 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.609+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f20dc024440 con 0x7f20ec10a6c0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.609+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ec064150 con 0x7f20ec10a6c0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.609+0000 7f20e8c00700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f20d00395b0 0x7f20d003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.609+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f20dc04db10 con 0x7f20ec10a6c0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.612+0000 7f20eb400700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f20d00395b0 0x7f20d003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.613+0000 7f20eb400700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f20d00395b0 0x7f20d003ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20d8006fd0 tx=0x7f20d8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.615+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f20dc00e260 con 0x7f20ec10a6c0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.846+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f20ec1a1b00 con 0x7f20ec10a6c0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.848+0000 7f20e8c00700 1 -- 172.21.15.7:0/258650256 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+398 (secure 0 0 0) 0x7f20ec1a1b00 con 0x7f20ec10a6c0 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f20d00395b0 msgr2=0x7f20d003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f20d00395b0 0x7f20d003ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20d8006fd0 tx=0x7f20d8006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 msgr2=0x7f20ec19e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec19e470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f20dc011a50 tx=0x7f20dc011b30 comp rx=0 tx=0).stop 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 shutdown_connections 2024-04-23T14:37:56.567 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f20d00395b0 0x7f20d003ba70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.568 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 --2- 172.21.15.7:0/258650256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ec10a6c0 0x7f20ec19e470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.568 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 >> 172.21.15.7:0/258650256 conn(0x7f20ec07de10 msgr2=0x7f20ec107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:56.568 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 shutdown_connections 2024-04-23T14:37:56.568 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.851+0000 7f20f1800700 1 -- 172.21.15.7:0/258650256 wait complete. 2024-04-23T14:37:56.568 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-04-23T14:37:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:57 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/673760749' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-23T14:37:57.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:57 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: ignoring --setuser ceph since I am not root 2024-04-23T14:37:57.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:57 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: ignoring --setgroup ceph since I am not root 2024-04-23T14:37:58.230 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:57 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:57.845+0000 7f3f008f8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:37:58.230 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:58 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:58.093+0000 7f3f008f8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:37:58.230 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:58 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:58.229+0000 7f3f008f8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.185+0000 7f3a45800700 1 Processor -- start 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.186+0000 7f3a45800700 1 -- start start 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.186+0000 7f3a45800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a401078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.186+0000 7f3a45800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40107ec0 con 0x7f3a401074d0 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.187+0000 7f3a3ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a401078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.187+0000 7f3a3ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a401078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58244/0 (socket says 172.21.15.7:58244) 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.187+0000 7f3a3ea00700 1 -- 172.21.15.7:0/2191743164 learned_addr learned my addr 172.21.15.7:0/2191743164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.187+0000 7f3a3ea00700 1 -- 172.21.15.7:0/2191743164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a401086d0 con 0x7f3a401074d0 2024-04-23T14:37:58.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.188+0000 7f3a3ea00700 1 --2- 172.21.15.7:0/2191743164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a401078f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a300098a0 tx=0x7f3a30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d06851c3a0175c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:58.333 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.188+0000 7f3a3e000700 1 -- 172.21.15.7:0/2191743164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30004160 con 0x7f3a401074d0 2024-04-23T14:37:58.333 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.188+0000 7f3a3e000700 1 -- 172.21.15.7:0/2191743164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3a30004300 con 0x7f3a401074d0 2024-04-23T14:37:58.333 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.188+0000 7f3a3e000700 1 -- 172.21.15.7:0/2191743164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a30011a80 con 0x7f3a401074d0 2024-04-23T14:37:58.333 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 -- 172.21.15.7:0/2191743164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 msgr2=0x7f3a401078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 --2- 172.21.15.7:0/2191743164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a401078f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a300098a0 tx=0x7f3a30009bb0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 -- 172.21.15.7:0/2191743164 shutdown_connections 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 --2- 172.21.15.7:0/2191743164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a401078f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 -- 172.21.15.7:0/2191743164 >> 172.21.15.7:0/2191743164 conn(0x7f3a40102af0 msgr2=0x7f3a40104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 -- 172.21.15.7:0/2191743164 shutdown_connections 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.189+0000 7f3a45800700 1 -- 172.21.15.7:0/2191743164 wait complete. 2024-04-23T14:37:58.337 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.190+0000 7f3a45800700 1 Processor -- start 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.190+0000 7f3a45800700 1 -- start start 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.190+0000 7f3a45800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a40192640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.190+0000 7f3a45800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4010ba80 con 0x7f3a401074d0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.191+0000 7f3a3ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a40192640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.191+0000 7f3a3ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a40192640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58252/0 (socket says 172.21.15.7:58252) 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.191+0000 7f3a3ea00700 1 -- 172.21.15.7:0/673760749 learned_addr learned my addr 172.21.15.7:0/673760749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.191+0000 7f3a3ea00700 1 -- 172.21.15.7:0/673760749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a40192b80 con 0x7f3a401074d0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.191+0000 7f3a3ea00700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a40192640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a30000c00 tx=0x7f3a30004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.192+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a300039c0 con 0x7f3a401074d0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.192+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3a30003b60 con 0x7f3a401074d0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.192+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a40190d70 con 0x7f3a401074d0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.192+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a3001a6f0 con 0x7f3a401074d0 2024-04-23T14:37:58.338 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.192+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a401912b0 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.193+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f3a30024440 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.193+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a40064150 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.194+0000 7f3a37e00700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f3a240395b0 0x7f3a2403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.194+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3a3004d950 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.194+0000 7f3a36000700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f3a240395b0 0x7f3a2403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.195+0000 7f3a36000700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f3a240395b0 0x7f3a2403ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800ad30 tx=0x7f3a280093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.199+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3a300247e0 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.490+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f3a401963c0 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.543+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f3a3000e260 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.547+0000 7f3a37e00700 1 -- 172.21.15.7:0/673760749 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f3a3002d3f0 con 0x7f3a401074d0 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.547+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f3a240395b0 msgr2=0x7f3a2403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.547+0000 7f3a45800700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f3a240395b0 0x7f3a2403ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800ad30 tx=0x7f3a280093f0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.547+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 msgr2=0x7f3a40192640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.547+0000 7f3a45800700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a40192640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a30000c00 tx=0x7f3a30004290 comp rx=0 tx=0).stop 2024-04-23T14:37:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.548+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 shutdown_connections 2024-04-23T14:37:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.548+0000 7f3a45800700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f3a240395b0 0x7f3a2403ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.548+0000 7f3a45800700 1 --2- 172.21.15.7:0/673760749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a401074d0 0x7f3a40192640 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.548+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 >> 172.21.15.7:0/673760749 conn(0x7f3a40102af0 msgr2=0x7f3a40103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.549+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 shutdown_connections 2024-04-23T14:37:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.549+0000 7f3a45800700 1 -- 172.21.15.7:0/673760749 wait complete. 2024-04-23T14:37:58.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:58 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/673760749' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-23T14:37:58.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:58 smithi007 ceph-mon[27906]: mgrmap e5: x(active, since 5s) 2024-04-23T14:37:58.770 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:58 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:58.649+0000 7f3f008f8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:37:59.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:37:58 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:37:58.769+0000 7f3f008f8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:37:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:37:59 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4011395688' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-23T14:38:00.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:38:00.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-23T14:38:00.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T14:38:00.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-23T14:38:00.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-23T14:38:00.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.980+0000 7f5005800700 1 Processor -- start 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.980+0000 7f5005800700 1 -- start start 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.981+0000 7f5005800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500010b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.981+0000 7f5005800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f500007be30 con 0x7f50001090b0 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.981+0000 7f4ffea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500010b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.981+0000 7f4ffea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500010b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58282/0 (socket says 172.21.15.7:58282) 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.981+0000 7f4ffea00700 1 -- 172.21.15.7:0/1673531236 learned_addr learned my addr 172.21.15.7:0/1673531236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:00.145 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.982+0000 7f4ffea00700 1 -- 172.21.15.7:0/1673531236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500010b9e0 con 0x7f50001090b0 2024-04-23T14:38:00.148 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.982+0000 7f4ffea00700 1 --2- 172.21.15.7:0/1673531236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500010b4a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00098a0 tx=0x7f4ff0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b069a8bd0ffc4d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.982+0000 7f4ffd600700 1 -- 172.21.15.7:0/1673531236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff0004160 con 0x7f50001090b0 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.982+0000 7f4ffd600700 1 -- 172.21.15.7:0/1673531236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4ff0004300 con 0x7f50001090b0 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.982+0000 7f4ffd600700 1 -- 172.21.15.7:0/1673531236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff0011a80 con 0x7f50001090b0 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 -- 172.21.15.7:0/1673531236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 msgr2=0x7f500010b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 --2- 172.21.15.7:0/1673531236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500010b4a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00098a0 tx=0x7f4ff0009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 -- 172.21.15.7:0/1673531236 shutdown_connections 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 --2- 172.21.15.7:0/1673531236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500010b4a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 -- 172.21.15.7:0/1673531236 >> 172.21.15.7:0/1673531236 conn(0x7f5000102a60 msgr2=0x7f5000104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 -- 172.21.15.7:0/1673531236 shutdown_connections 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.983+0000 7f5005800700 1 -- 172.21.15.7:0/1673531236 wait complete. 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.984+0000 7f5005800700 1 Processor -- start 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.985+0000 7f5005800700 1 -- start start 2024-04-23T14:38:00.149 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.985+0000 7f5005800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.985+0000 7f5005800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f500010c940 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.985+0000 7f4ffea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.985+0000 7f4ffea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500019c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58294/0 (socket says 172.21.15.7:58294) 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.985+0000 7f4ffea00700 1 -- 172.21.15.7:0/4011395688 learned_addr learned my addr 172.21.15.7:0/4011395688 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f4ffea00700 1 -- 172.21.15.7:0/4011395688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500019ca80 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f4ffea00700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500019c540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0011a50 tx=0x7f4ff0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff00039f0 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4ff0003b90 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff001a600 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500019cd10 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.986+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500019fa00 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.988+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5000064150 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.988+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f4ff0024440 con 0x7f50001090b0 2024-04-23T14:38:00.150 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.988+0000 7f4ff7400700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 0x7f4fe403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:00.151 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.988+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ff004dae0 con 0x7f50001090b0 2024-04-23T14:38:00.151 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.988+0000 7f4ffe000700 1 -- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 msgr2=0x7f4fe403bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:00.151 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.988+0000 7f4ffe000700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 0x7f4fe403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:38:00.152 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:58.993+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4ff000f2e0 con 0x7f50001090b0 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.189+0000 7f4ffe000700 1 -- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 msgr2=0x7f4fe403bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.189+0000 7f4ffe000700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 0x7f4fe403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.285+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f500019fbd0 con 0x7f50001090b0 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.286+0000 7f4ff7400700 1 -- 172.21.15.7:0/4011395688 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f500019fbd0 con 0x7f50001090b0 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.288+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 msgr2=0x7f4fe403bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.288+0000 7f5005800700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 0x7f4fe403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.288+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 msgr2=0x7f500019c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.288+0000 7f5005800700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500019c540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0011a50 tx=0x7f4ff0004290 comp rx=0 tx=0).stop 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.289+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 shutdown_connections 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.289+0000 7f5005800700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f4fe4039600 0x7f4fe403bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.289+0000 7f5005800700 1 --2- 172.21.15.7:0/4011395688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50001090b0 0x7f500019c540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.289+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 >> 172.21.15.7:0/4011395688 conn(0x7f5000102a60 msgr2=0x7f50001035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.289+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 shutdown_connections 2024-04-23T14:38:00.153 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.289+0000 7f5005800700 1 -- 172.21.15.7:0/4011395688 wait complete. 2024-04-23T14:38:00.154 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-04-23T14:38:00.154 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-04-23T14:38:00.752 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:00.462+0000 7f3f008f8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:38:00.753 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:00.707+0000 7f3f008f8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:38:01.021 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:00.932+0000 7f3f008f8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:38:01.721 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:01 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:01.334+0000 7f3f008f8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:38:01.721 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:01 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:01.461+0000 7f3f008f8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:38:01.988 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:01 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:01.720+0000 7f3f008f8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:38:01.988 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:01 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:01.987+0000 7f3f008f8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:38:03.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:02 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:02.804+0000 7f3f008f8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:38:03.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:03 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:03.382+0000 7f3f008f8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:38:03.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:03 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:03.514+0000 7f3f008f8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:38:03.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:03 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:03.789+0000 7f3f008f8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:38:04.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:04.460+0000 7f3f008f8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:38:04.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:04.588+0000 7f3f008f8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:38:05.244 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:04.924+0000 7f3f008f8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:38:05.244 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:05 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:05.112+0000 7f3f008f8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:38:05.244 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:05 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:05.243+0000 7f3f008f8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:38:05.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:05 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:05.401+0000 7f3f008f8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:38:06.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:05 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:05.778+0000 7f3f008f8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:38:06.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:06.572+0000 7f3f008f8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:38:07.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:06.866+0000 7f3f008f8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:38:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: Active manager daemon x restarted 2024-04-23T14:38:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: Activating manager daemon x 2024-04-23T14:38:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: osdmap e2: 0 total, 0 up, 0 in 2024-04-23T14:38:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: mgrmap e6: x(active, starting, since 0.00818444s) 2024-04-23T14:38:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:38:07.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T14:38:07.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:38:07.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:38:07.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:38:07.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:06 smithi007 ceph-mon[27906]: Manager daemon x is now available 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: Found migration_current of "None". Setting to last migration. 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:08.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:07 smithi007 ceph-mon[27906]: mgrmap e7: x(active, since 1.01448s) 2024-04-23T14:38:08.876 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.810+0000 7f60f1600700 1 Processor -- start 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.810+0000 7f60f1600700 1 -- start start 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.810+0000 7f60f1600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec1078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.810+0000 7f60f1600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec107eb0 con 0x7f60ec1074c0 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.811+0000 7f60eaa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec1078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.811+0000 7f60eaa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec1078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58298/0 (socket says 172.21.15.7:58298) 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.811+0000 7f60eaa00700 1 -- 172.21.15.7:0/1559896684 learned_addr learned my addr 172.21.15.7:0/1559896684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:08.877 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.811+0000 7f60eaa00700 1 -- 172.21.15.7:0/1559896684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec1086c0 con 0x7f60ec1074c0 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.812+0000 7f60eaa00700 1 --2- 172.21.15.7:0/1559896684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec1078e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0098a0 tx=0x7f60dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60b97264db5d0ad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.812+0000 7f60e9600700 1 -- 172.21.15.7:0/1559896684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60dc004160 con 0x7f60ec1074c0 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.812+0000 7f60e9600700 1 -- 172.21.15.7:0/1559896684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f60dc004300 con 0x7f60ec1074c0 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.812+0000 7f60e9600700 1 -- 172.21.15.7:0/1559896684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60dc011a80 con 0x7f60ec1074c0 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 -- 172.21.15.7:0/1559896684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 msgr2=0x7f60ec1078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 --2- 172.21.15.7:0/1559896684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec1078e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0098a0 tx=0x7f60dc009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 -- 172.21.15.7:0/1559896684 shutdown_connections 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 --2- 172.21.15.7:0/1559896684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec1078e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 -- 172.21.15.7:0/1559896684 >> 172.21.15.7:0/1559896684 conn(0x7f60ec102a60 msgr2=0x7f60ec104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 -- 172.21.15.7:0/1559896684 shutdown_connections 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.813+0000 7f60f1600700 1 -- 172.21.15.7:0/1559896684 wait complete. 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.815+0000 7f60f1600700 1 Processor -- start 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.815+0000 7f60f1600700 1 -- start start 2024-04-23T14:38:08.878 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.815+0000 7f60f1600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.815+0000 7f60f1600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec10ba70 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.816+0000 7f60eaa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.816+0000 7f60eaa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec19e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58312/0 (socket says 172.21.15.7:58312) 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.816+0000 7f60eaa00700 1 -- 172.21.15.7:0/4281166051 learned_addr learned my addr 172.21.15.7:0/4281166051 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.816+0000 7f60eaa00700 1 -- 172.21.15.7:0/4281166051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec19ed00 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.816+0000 7f60eaa00700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec19e7c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f60dc000c00 tx=0x7f60dc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.817+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60dc0039c0 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.817+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f60dc003b60 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.817+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec19ef90 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.817+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60dc01a6f0 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.817+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec1a1c80 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.818+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f60dc024a40 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.819+0000 7f60e3400700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.819+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 --> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f60d003c230 con 0x7f60d0039660 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.819+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f60dc04d9f0 con 0x7f60ec1074c0 2024-04-23T14:38:08.879 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.819+0000 7f60ea000700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 msgr2=0x7f60d003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:00.819+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.020+0000 7f60ea000700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 msgr2=0x7f60d003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.020+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.421+0000 7f60ea000700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 msgr2=0x7f60d003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.421+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:02.222+0000 7f60ea000700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 msgr2=0x7f60d003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:02.222+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.824+0000 7f60ea000700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 msgr2=0x7f60d003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3246781913 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.824+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.875+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f60dc024440 con 0x7f60ec1074c0 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.875+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 msgr2=0x7f60d003bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.875+0000 7f60e3400700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.878+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f60dc04f4a0 con 0x7f60ec1074c0 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.879+0000 7f60e3400700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f60d003cf50 0x7f60d003f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.879+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f60dc01fec0 con 0x7f60d003cf50 2024-04-23T14:38:08.880 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.880+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f60d003cf50 0x7f60d003f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.882+0000 7f60ea000700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f60d003cf50 0x7f60d003f340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f60d8003a10 tx=0x7f60d80092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.883+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f60dc01fec0 con 0x7f60d003cf50 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.896+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f60ec064150 con 0x7f60d003cf50 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.897+0000 7f60e3400700 1 -- 172.21.15.7:0/4281166051 <== mgr.14120 v2:172.21.15.7:6800/2898788410 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f60ec064150 con 0x7f60d003cf50 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f60d003cf50 msgr2=0x7f60d003f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f60d003cf50 0x7f60d003f340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f60d8003a10 tx=0x7f60d80092b0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 msgr2=0x7f60ec19e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec19e7c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f60dc000c00 tx=0x7f60dc004290 comp rx=0 tx=0).stop 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 shutdown_connections 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f60d003cf50 0x7f60d003f340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60ec1074c0 0x7f60ec19e7c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 --2- 172.21.15.7:0/4281166051 >> [v2:172.21.15.7:6800/3246781913,v1:172.21.15.7:6801/3246781913] conn(0x7f60d0039660 0x7f60d003bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 >> 172.21.15.7:0/4281166051 conn(0x7f60ec102a60 msgr2=0x7f60ec103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 shutdown_connections 2024-04-23T14:38:08.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.898+0000 7f60f1600700 1 -- 172.21.15.7:0/4281166051 wait complete. 2024-04-23T14:38:08.882 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-04-23T14:38:08.882 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-04-23T14:38:09.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-23T14:38:09.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-23T14:38:09.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:07] ENGINE Bus STARTING 2024-04-23T14:38:09.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:08] ENGINE Serving on https://172.21.15.7:7150 2024-04-23T14:38:09.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:08] ENGINE Serving on http://172.21.15.7:8765 2024-04-23T14:38:09.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:08] ENGINE Bus STARTED 2024-04-23T14:38:09.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:08 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:09 smithi007 ceph-mon[27906]: mgrmap e8: x(active, since 2s) 2024-04-23T14:38:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:09 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:09 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:10.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.508+0000 7fada1600700 1 Processor -- start 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.509+0000 7fada1600700 1 -- start start 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.509+0000 7fada1600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c107100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.509+0000 7fada1600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c07be50 con 0x7fad9c106ce0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.510+0000 7fad9be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.510+0000 7fad9be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49036/0 (socket says 172.21.15.7:49036) 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.510+0000 7fad9be00700 1 -- 172.21.15.7:0/83168029 learned_addr learned my addr 172.21.15.7:0/83168029 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.510+0000 7fad9be00700 1 -- 172.21.15.7:0/83168029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c107640 con 0x7fad9c106ce0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.511+0000 7fad9be00700 1 --2- 172.21.15.7:0/83168029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c107100 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098a0 tx=0x7fad8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f82394abef9a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.511+0000 7fad9b400700 1 -- 172.21.15.7:0/83168029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c004160 con 0x7fad9c106ce0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.511+0000 7fad9b400700 1 -- 172.21.15.7:0/83168029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fad8c004300 con 0x7fad9c106ce0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.511+0000 7fad9b400700 1 -- 172.21.15.7:0/83168029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c011a80 con 0x7fad9c106ce0 2024-04-23T14:38:10.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 -- 172.21.15.7:0/83168029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 msgr2=0x7fad9c107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 --2- 172.21.15.7:0/83168029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c107100 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098a0 tx=0x7fad8c009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 -- 172.21.15.7:0/83168029 shutdown_connections 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 --2- 172.21.15.7:0/83168029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c107100 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 -- 172.21.15.7:0/83168029 >> 172.21.15.7:0/83168029 conn(0x7fad9c102900 msgr2=0x7fad9c104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 -- 172.21.15.7:0/83168029 shutdown_connections 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.512+0000 7fada1600700 1 -- 172.21.15.7:0/83168029 wait complete. 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.513+0000 7fada1600700 1 Processor -- start 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.513+0000 7fada1600700 1 -- start start 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.514+0000 7fada1600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.514+0000 7fada1600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c108670 con 0x7fad9c106ce0 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.514+0000 7fad9be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.514+0000 7fad9be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c19e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49052/0 (socket says 172.21.15.7:49052) 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.514+0000 7fad9be00700 1 -- 172.21.15.7:0/1702562930 learned_addr learned my addr 172.21.15.7:0/1702562930 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.515+0000 7fad9be00700 1 -- 172.21.15.7:0/1702562930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c19eac0 con 0x7fad9c106ce0 2024-04-23T14:38:10.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.515+0000 7fad9be00700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c19e580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006af0 tx=0x7fad8c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.515+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c003930 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.515+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fad8c003ad0 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.515+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c0195e0 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.515+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c19ed50 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.516+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c1a1a40 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.517+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fad8c019890 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.517+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c064150 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.517+0000 7fad99600700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fad800395b0 0x7fad8003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.517+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fad8c04dc90 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.518+0000 7fad93e00700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fad800395b0 0x7fad8003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.518+0000 7fad93e00700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fad800395b0 0x7fad8003ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad84006fd0 tx=0x7fad84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.523+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fad8c023e00 con 0x7fad9c106ce0 2024-04-23T14:38:10.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.772+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fad9c0008d0 con 0x7fad800395b0 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.785+0000 7fad99600700 1 -- 172.21.15.7:0/1702562930 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad9c0008d0 con 0x7fad800395b0 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.787+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fad800395b0 msgr2=0x7fad8003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.787+0000 7fada1600700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fad800395b0 0x7fad8003ba70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad84006fd0 tx=0x7fad84006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.787+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 msgr2=0x7fad9c19e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.787+0000 7fada1600700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c19e580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006af0 tx=0x7fad8c011b70 comp rx=0 tx=0).stop 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.788+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 shutdown_connections 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.788+0000 7fada1600700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fad800395b0 0x7fad8003ba70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.788+0000 7fada1600700 1 --2- 172.21.15.7:0/1702562930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad9c106ce0 0x7fad9c19e580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.788+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 >> 172.21.15.7:0/1702562930 conn(0x7fad9c102900 msgr2=0x7fad9c1951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.788+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 shutdown_connections 2024-04-23T14:38:10.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.788+0000 7fada1600700 1 -- 172.21.15.7:0/1702562930 wait complete. 2024-04-23T14:38:10.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:10 smithi007 ceph-mon[27906]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:12.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-23T14:38:12.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.032+0000 7f0cc5a00700 1 Processor -- start 2024-04-23T14:38:12.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.032+0000 7f0cc5a00700 1 -- start start 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.032+0000 7f0cc5a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc007c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.032+0000 7f0cc5a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc007c880 con 0x7f0cc007de40 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.033+0000 7f0cbea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.033+0000 7f0cbea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc007c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49068/0 (socket says 172.21.15.7:49068) 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.033+0000 7f0cbea00700 1 -- 172.21.15.7:0/2646770097 learned_addr learned my addr 172.21.15.7:0/2646770097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.034+0000 7f0cbea00700 1 -- 172.21.15.7:0/2646770097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc007ca00 con 0x7f0cc007de40 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.034+0000 7f0cbea00700 1 --2- 172.21.15.7:0/2646770097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc007c340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00098a0 tx=0x7f0cb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2584048ae67cd950 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.034+0000 7f0cbd600700 1 -- 172.21.15.7:0/2646770097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb0004160 con 0x7f0cc007de40 2024-04-23T14:38:12.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.034+0000 7f0cbd600700 1 -- 172.21.15.7:0/2646770097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0cb0004300 con 0x7f0cc007de40 2024-04-23T14:38:12.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.034+0000 7f0cbd600700 1 -- 172.21.15.7:0/2646770097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb0011a80 con 0x7f0cc007de40 2024-04-23T14:38:12.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 -- 172.21.15.7:0/2646770097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 msgr2=0x7f0cc007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:12.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 --2- 172.21.15.7:0/2646770097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc007c340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00098a0 tx=0x7f0cb0009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:12.046 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 -- 172.21.15.7:0/2646770097 shutdown_connections 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 --2- 172.21.15.7:0/2646770097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc007c340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 -- 172.21.15.7:0/2646770097 >> 172.21.15.7:0/2646770097 conn(0x7f0cc0103c60 msgr2=0x7f0cc0106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 -- 172.21.15.7:0/2646770097 shutdown_connections 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.035+0000 7f0cc5a00700 1 -- 172.21.15.7:0/2646770097 wait complete. 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cc5a00700 1 Processor -- start 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cc5a00700 1 -- start start 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cc5a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cc5a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc010eb50 con 0x7f0cc007de40 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cbea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cbea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc019e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49076/0 (socket says 172.21.15.7:49076) 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.037+0000 7f0cbea00700 1 -- 172.21.15.7:0/1354261378 learned_addr learned my addr 172.21.15.7:0/1354261378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.038+0000 7f0cbea00700 1 -- 172.21.15.7:0/1354261378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc019ec20 con 0x7f0cc007de40 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.038+0000 7f0cbea00700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc019e6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0011a50 tx=0x7f0cb0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:12.047 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.038+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb00039f0 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.039+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc019eeb0 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.039+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0cb0003b90 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.039+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb001a600 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.039+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc01a1ba0 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.040+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc0064150 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.040+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f0cb0024a40 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.041+0000 7f0cb7400700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f0ca4039600 0x7f0ca403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.041+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0cb004dbb0 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.041+0000 7f0cbe000700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f0ca4039600 0x7f0ca403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.042+0000 7f0cbe000700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f0ca4039600 0x7f0ca403bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0cac006fd0 tx=0x7f0cac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.047+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0cb000f2e0 con 0x7f0cc007de40 2024-04-23T14:38:12.048 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.279+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0cc0104e80 con 0x7f0ca4039600 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.282+0000 7f0cb7400700 1 -- 172.21.15.7:0/1354261378 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f0cc0104e80 con 0x7f0ca4039600 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f0ca4039600 msgr2=0x7f0ca403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f0ca4039600 0x7f0ca403bac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0cac006fd0 tx=0x7f0cac006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 msgr2=0x7f0cc019e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc019e6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0011a50 tx=0x7f0cb0004290 comp rx=0 tx=0).stop 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 shutdown_connections 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f0ca4039600 0x7f0ca403bac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 --2- 172.21.15.7:0/1354261378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cc007de40 0x7f0cc019e6e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:12.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 >> 172.21.15.7:0/1354261378 conn(0x7f0cc0103c60 msgr2=0x7f0cc0104770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:12.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 shutdown_connections 2024-04-23T14:38:12.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.285+0000 7f0cc5a00700 1 -- 172.21.15.7:0/1354261378 wait complete. 2024-04-23T14:38:12.050 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-04-23T14:38:12.207 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:11 smithi007 ceph-mon[27906]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: Generating public/private rsa key pair. 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: Your identification has been saved in /tmp/tmpgmyx_zzz/key. 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: Your public key has been saved in /tmp/tmpgmyx_zzz/key.pub. 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: The key fingerprint is: 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: SHA256:6tQtsWRZqpC4HGx/ZmDg6Do51qpf0uSdMUvu+kp2mMI ceph-7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: The key's randomart image is: 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: +---[RSA 3072]----+ 2024-04-23T14:38:13.695 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: | | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: | | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: | . . | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: | + o . + | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: |. * * + S | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: |.+ O O @ + | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: | oE X & + . | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: |=. B O . | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: |==o o++ | 2024-04-23T14:38:13.696 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: +----[SHA256]-----+ 2024-04-23T14:38:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.688+0000 7f947b200700 1 Processor -- start 2024-04-23T14:38:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.688+0000 7f947b200700 1 -- start start 2024-04-23T14:38:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.689+0000 7f947b200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c10aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.689+0000 7f947b200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f947c10b020 con 0x7f947c10a6c0 2024-04-23T14:38:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.689+0000 7f9479e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c10aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.689+0000 7f9479e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c10aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49078/0 (socket says 172.21.15.7:49078) 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.689+0000 7f9479e00700 1 -- 172.21.15.7:0/2015412950 learned_addr learned my addr 172.21.15.7:0/2015412950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.690+0000 7f9479e00700 1 -- 172.21.15.7:0/2015412950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947c10b1a0 con 0x7f947c10a6c0 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.690+0000 7f9479e00700 1 --2- 172.21.15.7:0/2015412950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c10aae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f946c0098a0 tx=0x7f946c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d432d6c35a9b892a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f9478a00700 1 -- 172.21.15.7:0/2015412950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c004160 con 0x7f947c10a6c0 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f9478a00700 1 -- 172.21.15.7:0/2015412950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f946c004300 con 0x7f947c10a6c0 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f9478a00700 1 -- 172.21.15.7:0/2015412950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c011a80 con 0x7f947c10a6c0 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f947b200700 1 -- 172.21.15.7:0/2015412950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 msgr2=0x7f947c10aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f947b200700 1 --2- 172.21.15.7:0/2015412950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c10aae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f946c0098a0 tx=0x7f946c009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f947b200700 1 -- 172.21.15.7:0/2015412950 shutdown_connections 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f947b200700 1 --2- 172.21.15.7:0/2015412950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c10aae0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.691+0000 7f947b200700 1 -- 172.21.15.7:0/2015412950 >> 172.21.15.7:0/2015412950 conn(0x7f947c07ddd0 msgr2=0x7f947c1084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.692+0000 7f947b200700 1 -- 172.21.15.7:0/2015412950 shutdown_connections 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.692+0000 7f947b200700 1 -- 172.21.15.7:0/2015412950 wait complete. 2024-04-23T14:38:13.995 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.693+0000 7f947b200700 1 Processor -- start 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.693+0000 7f947b200700 1 -- start start 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.693+0000 7f947b200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c19e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.693+0000 7f947b200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f947c10c630 con 0x7f947c10a6c0 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.694+0000 7f9479e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c19e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.694+0000 7f9479e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c19e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49092/0 (socket says 172.21.15.7:49092) 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.694+0000 7f9479e00700 1 -- 172.21.15.7:0/4047446557 learned_addr learned my addr 172.21.15.7:0/4047446557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.694+0000 7f9479e00700 1 -- 172.21.15.7:0/4047446557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947c19ea40 con 0x7f947c10a6c0 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.694+0000 7f9479e00700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c19e500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f946c011a50 tx=0x7f946c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.695+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c0039f0 con 0x7f947c10a6c0 2024-04-23T14:38:13.999 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.695+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f946c003b90 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.695+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947c19ecd0 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.695+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c01a600 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.695+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947c1a19c0 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.696+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947c064150 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.696+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f946c024a40 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.697+0000 7f9472a00700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9460039600 0x7f946003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.697+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f946c04dbb0 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.697+0000 7f9479400700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9460039600 0x7f946003bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.698+0000 7f9479400700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9460039600 0x7f946003bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9468006fd0 tx=0x7f9468006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.702+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f946c00f2e0 con 0x7f947c10a6c0 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.937+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f947c1082f0 con 0x7f9460039600 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.368+0000 7f9472a00700 1 -- 172.21.15.7:0/4047446557 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f947c1082f0 con 0x7f9460039600 2024-04-23T14:38:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.372+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9460039600 msgr2=0x7f946003bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.372+0000 7f947b200700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9460039600 0x7f946003bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9468006fd0 tx=0x7f9468006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.372+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 msgr2=0x7f947c19e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.372+0000 7f947b200700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c19e500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f946c011a50 tx=0x7f946c004290 comp rx=0 tx=0).stop 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.373+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 shutdown_connections 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.373+0000 7f947b200700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9460039600 0x7f946003bac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.373+0000 7f947b200700 1 --2- 172.21.15.7:0/4047446557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f947c10a6c0 0x7f947c19e500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.373+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 >> 172.21.15.7:0/4047446557 conn(0x7f947c07ddd0 msgr2=0x7f947c107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.373+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 shutdown_connections 2024-04-23T14:38:14.001 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:13.373+0000 7f947b200700 1 -- 172.21.15.7:0/4047446557 wait complete. 2024-04-23T14:38:14.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:14 smithi007 ceph-mon[27906]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:14.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:14 smithi007 ceph-mon[27906]: Generating ssh key... 2024-04-23T14:38:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:14 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:14 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:15.568 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:15.569 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.619+0000 7fe38e800700 1 Processor -- start 2024-04-23T14:38:15.569 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.620+0000 7fe38e800700 1 -- start start 2024-04-23T14:38:15.569 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.620+0000 7fe38e800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe388107740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:15.569 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.620+0000 7fe38e800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe388107d10 con 0x7fe388107320 2024-04-23T14:38:15.569 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.620+0000 7fe38d400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe388107740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:15.570 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.621+0000 7fe38d400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe388107740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37606/0 (socket says 172.21.15.7:37606) 2024-04-23T14:38:15.570 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.621+0000 7fe38d400700 1 -- 172.21.15.7:0/2747734562 learned_addr learned my addr 172.21.15.7:0/2747734562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:15.570 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.621+0000 7fe38d400700 1 -- 172.21.15.7:0/2747734562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe388108520 con 0x7fe388107320 2024-04-23T14:38:15.570 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.622+0000 7fe38d400700 1 --2- 172.21.15.7:0/2747734562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe388107740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0098a0 tx=0x7fe37c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650028c4c6ea0625 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:15.571 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.622+0000 7fe387e00700 1 -- 172.21.15.7:0/2747734562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c004160 con 0x7fe388107320 2024-04-23T14:38:15.571 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.622+0000 7fe387e00700 1 -- 172.21.15.7:0/2747734562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe37c004300 con 0x7fe388107320 2024-04-23T14:38:15.571 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.622+0000 7fe387e00700 1 -- 172.21.15.7:0/2747734562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c011a80 con 0x7fe388107320 2024-04-23T14:38:15.571 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 -- 172.21.15.7:0/2747734562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 msgr2=0x7fe388107740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:15.572 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 --2- 172.21.15.7:0/2747734562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe388107740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0098a0 tx=0x7fe37c009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:15.572 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 -- 172.21.15.7:0/2747734562 shutdown_connections 2024-04-23T14:38:15.572 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 --2- 172.21.15.7:0/2747734562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe388107740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:15.572 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 -- 172.21.15.7:0/2747734562 >> 172.21.15.7:0/2747734562 conn(0x7fe388102900 msgr2=0x7fe388104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:15.572 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 -- 172.21.15.7:0/2747734562 shutdown_connections 2024-04-23T14:38:15.572 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.623+0000 7fe38e800700 1 -- 172.21.15.7:0/2747734562 wait complete. 2024-04-23T14:38:15.573 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.624+0000 7fe38e800700 1 Processor -- start 2024-04-23T14:38:15.573 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.624+0000 7fe38e800700 1 -- start start 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.624+0000 7fe38e800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe38819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.624+0000 7fe38e800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe38807afd0 con 0x7fe388107320 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.625+0000 7fe38d400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe38819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.625+0000 7fe38d400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe38819e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37614/0 (socket says 172.21.15.7:37614) 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.625+0000 7fe38d400700 1 -- 172.21.15.7:0/3016275987 learned_addr learned my addr 172.21.15.7:0/3016275987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.625+0000 7fe38d400700 1 -- 172.21.15.7:0/3016275987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38819eb00 con 0x7fe388107320 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.625+0000 7fe38d400700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe38819e5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe37c006af0 tx=0x7fe37c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.626+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c003930 con 0x7fe388107320 2024-04-23T14:38:15.575 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.626+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe37c003ad0 con 0x7fe388107320 2024-04-23T14:38:15.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.626+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37c0195e0 con 0x7fe388107320 2024-04-23T14:38:15.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.626+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38819ed90 con 0x7fe388107320 2024-04-23T14:38:15.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.626+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3881a1a80 con 0x7fe388107320 2024-04-23T14:38:15.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.627+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fe37c019890 con 0x7fe388107320 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.627+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe388064150 con 0x7fe388107320 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.627+0000 7fe386000700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fe370039610 0x7fe37003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.628+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe37c04dc50 con 0x7fe388107320 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.628+0000 7fe38ca00700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fe370039610 0x7fe37003bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.629+0000 7fe38ca00700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fe370039610 0x7fe37003bad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe374006fd0 tx=0x7fe374006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.633+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe37c00fda0 con 0x7fe388107320 2024-04-23T14:38:15.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.866+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fe3880008d0 con 0x7fe370039610 2024-04-23T14:38:15.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.868+0000 7fe386000700 1 -- 172.21.15.7:0/3016275987 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fe3880008d0 con 0x7fe370039610 2024-04-23T14:38:15.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fe370039610 msgr2=0x7fe37003bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:15.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fe370039610 0x7fe37003bad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe374006fd0 tx=0x7fe374006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 msgr2=0x7fe38819e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe38819e5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe37c006af0 tx=0x7fe37c011b70 comp rx=0 tx=0).stop 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 shutdown_connections 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fe370039610 0x7fe37003bad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 --2- 172.21.15.7:0/3016275987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe388107320 0x7fe38819e5c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 >> 172.21.15.7:0/3016275987 conn(0x7fe388102900 msgr2=0x7fe388104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 shutdown_connections 2024-04-23T14:38:15.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.871+0000 7fe38e800700 1 -- 172.21.15.7:0/3016275987 wait complete. 2024-04-23T14:38:15.580 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-23T14:38:15.580 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-04-23T14:38:15.590 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-04-23T14:38:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:15 smithi007 ceph-mon[27906]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:16.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:16 smithi007 ceph-mon[27906]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:18.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:18 smithi007 ceph-mon[27906]: Deploying cephadm binary to smithi007 2024-04-23T14:38:23.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-04-23T14:38:23.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.232+0000 7f9674e00700 1 Processor -- start 2024-04-23T14:38:23.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.233+0000 7f9674e00700 1 -- start start 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.233+0000 7f9674e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967010b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.233+0000 7f9674e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f967007bdf0 con 0x7f9670108f50 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.234+0000 7f966f400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967010b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.234+0000 7f966f400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967010b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37628/0 (socket says 172.21.15.7:37628) 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.234+0000 7f966f400700 1 -- 172.21.15.7:0/2882924496 learned_addr learned my addr 172.21.15.7:0/2882924496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.234+0000 7f966f400700 1 -- 172.21.15.7:0/2882924496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967010b880 con 0x7f9670108f50 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.235+0000 7f966f400700 1 --2- 172.21.15.7:0/2882924496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967010b340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96600098a0 tx=0x7f9660009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91a0261d0bfa163 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.235+0000 7f966e000700 1 -- 172.21.15.7:0/2882924496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660004160 con 0x7f9670108f50 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.235+0000 7f966e000700 1 -- 172.21.15.7:0/2882924496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9660004300 con 0x7f9670108f50 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.235+0000 7f966e000700 1 -- 172.21.15.7:0/2882924496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660011a80 con 0x7f9670108f50 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.235+0000 7f9674e00700 1 -- 172.21.15.7:0/2882924496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 msgr2=0x7f967010b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.235+0000 7f9674e00700 1 --2- 172.21.15.7:0/2882924496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967010b340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96600098a0 tx=0x7f9660009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.236+0000 7f9674e00700 1 -- 172.21.15.7:0/2882924496 shutdown_connections 2024-04-23T14:38:23.544 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.236+0000 7f9674e00700 1 --2- 172.21.15.7:0/2882924496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967010b340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.236+0000 7f9674e00700 1 -- 172.21.15.7:0/2882924496 >> 172.21.15.7:0/2882924496 conn(0x7f9670102900 msgr2=0x7f9670104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.236+0000 7f9674e00700 1 -- 172.21.15.7:0/2882924496 shutdown_connections 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.236+0000 7f9674e00700 1 -- 172.21.15.7:0/2882924496 wait complete. 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.237+0000 7f9674e00700 1 Processor -- start 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.237+0000 7f9674e00700 1 -- start start 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.238+0000 7f9674e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.238+0000 7f9674e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f967010c790 con 0x7f9670108f50 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.238+0000 7f966f400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.238+0000 7f966f400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37644/0 (socket says 172.21.15.7:37644) 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.238+0000 7f966f400700 1 -- 172.21.15.7:0/1444010179 learned_addr learned my addr 172.21.15.7:0/1444010179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.238+0000 7f966f400700 1 -- 172.21.15.7:0/1444010179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967019c880 con 0x7f9670108f50 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.239+0000 7f966f400700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967019c340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9660011a50 tx=0x7f9660004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.239+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96600039f0 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.239+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9660003b90 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.239+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966001a600 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.239+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967019cb10 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.239+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967019f800 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.240+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f9660024a40 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.241+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9670064150 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.241+0000 7f9667e00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9654039600 0x7f965403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.241+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f966004dc00 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.241+0000 7f966ea00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9654039600 0x7f965403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.242+0000 7f966ea00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9654039600 0x7f965403bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f965c006fd0 tx=0x7f965c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.247+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f966004d550 con 0x7f9670108f50 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.484+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}) -- 0x7f9670103b20 con 0x7f9654039600 2024-04-23T14:38:23.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.765+0000 7f9667e00700 1 -- 172.21.15.7:0/1444010179 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f9670103b20 con 0x7f9654039600 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9654039600 msgr2=0x7f965403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9654039600 0x7f965403bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f965c006fd0 tx=0x7f965c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 msgr2=0x7f967019c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967019c340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9660011a50 tx=0x7f9660004290 comp rx=0 tx=0).stop 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 shutdown_connections 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f9654039600 0x7f965403bac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 --2- 172.21.15.7:0/1444010179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670108f50 0x7f967019c340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 >> 172.21.15.7:0/1444010179 conn(0x7f9670102900 msgr2=0x7f9670103410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 shutdown_connections 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:22.770+0000 7f9674e00700 1 -- 172.21.15.7:0/1444010179 wait complete. 2024-04-23T14:38:23.547 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-04-23T14:38:23.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:23 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:23.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:23 smithi007 ceph-mon[27906]: Added host smithi007 2024-04-23T14:38:23.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:23 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:25.154 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-23T14:38:25.154 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.209+0000 7fbf67c00700 1 Processor -- start 2024-04-23T14:38:25.154 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.210+0000 7fbf67c00700 1 -- start start 2024-04-23T14:38:25.154 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.210+0000 7fbf67c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf6010f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:25.154 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.210+0000 7fbf67c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6010f920 con 0x7fbf6010efc0 2024-04-23T14:38:25.154 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.211+0000 7fbf65200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf6010f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.211+0000 7fbf65200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf6010f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33642/0 (socket says 172.21.15.7:33642) 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.211+0000 7fbf65200700 1 -- 172.21.15.7:0/2229572183 learned_addr learned my addr 172.21.15.7:0/2229572183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.212+0000 7fbf65200700 1 -- 172.21.15.7:0/2229572183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6010faa0 con 0x7fbf6010efc0 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.212+0000 7fbf65200700 1 --2- 172.21.15.7:0/2229572183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf6010f3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf540098a0 tx=0x7fbf54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685c2f7d56f4a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.212+0000 7fbf5f400700 1 -- 172.21.15.7:0/2229572183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf54004160 con 0x7fbf6010efc0 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.212+0000 7fbf5f400700 1 -- 172.21.15.7:0/2229572183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbf54004300 con 0x7fbf6010efc0 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.212+0000 7fbf5f400700 1 -- 172.21.15.7:0/2229572183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf54011a80 con 0x7fbf6010efc0 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 -- 172.21.15.7:0/2229572183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 msgr2=0x7fbf6010f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 --2- 172.21.15.7:0/2229572183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf6010f3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf540098a0 tx=0x7fbf54009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 -- 172.21.15.7:0/2229572183 shutdown_connections 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 --2- 172.21.15.7:0/2229572183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf6010f3e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 -- 172.21.15.7:0/2229572183 >> 172.21.15.7:0/2229572183 conn(0x7fbf6007ddb0 msgr2=0x7fbf600801d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:25.155 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 -- 172.21.15.7:0/2229572183 shutdown_connections 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.213+0000 7fbf67c00700 1 -- 172.21.15.7:0/2229572183 wait complete. 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.214+0000 7fbf67c00700 1 Processor -- start 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.214+0000 7fbf67c00700 1 -- start start 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.215+0000 7fbf67c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf601a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.215+0000 7fbf67c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60110b60 con 0x7fbf6010efc0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.215+0000 7fbf65200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf601a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.215+0000 7fbf65200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf601a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33650/0 (socket says 172.21.15.7:33650) 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.215+0000 7fbf65200700 1 -- 172.21.15.7:0/914790716 learned_addr learned my addr 172.21.15.7:0/914790716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.215+0000 7fbf65200700 1 -- 172.21.15.7:0/914790716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf601a2fc0 con 0x7fbf6010efc0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.216+0000 7fbf65200700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf601a2a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf54011a50 tx=0x7fbf54004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.216+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf540039f0 con 0x7fbf6010efc0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.216+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbf54003b90 con 0x7fbf6010efc0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.216+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf601a32b0 con 0x7fbf6010efc0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.216+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5401a5a0 con 0x7fbf6010efc0 2024-04-23T14:38:25.156 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.216+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf601a5f40 con 0x7fbf6010efc0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.217+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fbf54024a40 con 0x7fbf6010efc0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.218+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf60064150 con 0x7fbf6010efc0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.218+0000 7fbf5d600700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fbf48039600 0x7fbf4803bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.218+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbf5404dbb0 con 0x7fbf6010efc0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.218+0000 7fbf5fe00700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fbf48039600 0x7fbf4803bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.219+0000 7fbf5fe00700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fbf48039600 0x7fbf4803bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c006fd0 tx=0x7fbf4c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.224+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf5400f2e0 con 0x7fbf6010efc0 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.469+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbf6007f000 con 0x7fbf48039600 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.476+0000 7fbf5d600700 1 -- 172.21.15.7:0/914790716 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbf6007f000 con 0x7fbf48039600 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.478+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fbf48039600 msgr2=0x7fbf4803bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.478+0000 7fbf67c00700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fbf48039600 0x7fbf4803bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c006fd0 tx=0x7fbf4c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.478+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 msgr2=0x7fbf601a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.478+0000 7fbf67c00700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf601a2a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf54011a50 tx=0x7fbf54004290 comp rx=0 tx=0).stop 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.479+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 shutdown_connections 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.479+0000 7fbf67c00700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fbf48039600 0x7fbf4803bac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.479+0000 7fbf67c00700 1 --2- 172.21.15.7:0/914790716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf6010efc0 0x7fbf601a2a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.479+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 >> 172.21.15.7:0/914790716 conn(0x7fbf6007ddb0 msgr2=0x7fbf6007e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.479+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 shutdown_connections 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.479+0000 7fbf67c00700 1 -- 172.21.15.7:0/914790716 wait complete. 2024-04-23T14:38:25.158 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-04-23T14:38:25.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:25 smithi007 ceph-mon[27906]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:25.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:25 smithi007 ceph-mon[27906]: Saving service mon spec with placement count:5 2024-04-23T14:38:25.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:25 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:27.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-23T14:38:27.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.149+0000 7f3119c00700 1 Processor -- start 2024-04-23T14:38:27.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.149+0000 7f3119c00700 1 -- start start 2024-04-23T14:38:27.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.149+0000 7f3119c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f31141089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:27.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.149+0000 7f3119c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3114108f90 con 0x7f31141085a0 2024-04-23T14:38:27.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.150+0000 7f3112a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f31141089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:27.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.150+0000 7f3112a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f31141089c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33664/0 (socket says 172.21.15.7:33664) 2024-04-23T14:38:27.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.150+0000 7f3112a00700 1 -- 172.21.15.7:0/1245653339 learned_addr learned my addr 172.21.15.7:0/1245653339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:27.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.150+0000 7f3112a00700 1 -- 172.21.15.7:0/1245653339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3114109750 con 0x7f31141085a0 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.151+0000 7f3112a00700 1 --2- 172.21.15.7:0/1245653339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f31141089c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31040098a0 tx=0x7f3104009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f00044858589b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.151+0000 7f3112000700 1 -- 172.21.15.7:0/1245653339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3104004160 con 0x7f31141085a0 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.151+0000 7f3112000700 1 -- 172.21.15.7:0/1245653339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3104004300 con 0x7f31141085a0 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.151+0000 7f3112000700 1 -- 172.21.15.7:0/1245653339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3104011a80 con 0x7f31141085a0 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 -- 172.21.15.7:0/1245653339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 msgr2=0x7f31141089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 --2- 172.21.15.7:0/1245653339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f31141089c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31040098a0 tx=0x7f3104009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 -- 172.21.15.7:0/1245653339 shutdown_connections 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 --2- 172.21.15.7:0/1245653339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f31141089c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 -- 172.21.15.7:0/1245653339 >> 172.21.15.7:0/1245653339 conn(0x7f3114103c00 msgr2=0x7f3114106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 -- 172.21.15.7:0/1245653339 shutdown_connections 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.152+0000 7f3119c00700 1 -- 172.21.15.7:0/1245653339 wait complete. 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.153+0000 7f3119c00700 1 Processor -- start 2024-04-23T14:38:27.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.154+0000 7f3119c00700 1 -- start start 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.154+0000 7f3119c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f311419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.154+0000 7f3119c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f311410cb00 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.155+0000 7f3112a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f311419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.155+0000 7f3112a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f311419e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33668/0 (socket says 172.21.15.7:33668) 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.155+0000 7f3112a00700 1 -- 172.21.15.7:0/1627719708 learned_addr learned my addr 172.21.15.7:0/1627719708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.155+0000 7f3112a00700 1 -- 172.21.15.7:0/1627719708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311419ec70 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.156+0000 7f3112a00700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f311419e730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f3104004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.156+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31040039c0 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.156+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3104003b60 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.156+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310401a6f0 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.156+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311419ef00 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.156+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31141a1bf0 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.158+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3114064150 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.158+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3104024a40 con 0x7f31141085a0 2024-04-23T14:38:27.329 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.159+0000 7f310be00700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f30f80395b0 0x7f30f803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:27.331 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.159+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f310404daf0 con 0x7f31141085a0 2024-04-23T14:38:27.331 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.159+0000 7f310a000700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f30f80395b0 0x7f30f803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:27.331 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.160+0000 7f310a000700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f30f80395b0 0x7f30f803ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f30fc006fd0 tx=0x7f30fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:27.331 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.165+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f310400f2e0 con 0x7f31141085a0 2024-04-23T14:38:27.331 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.410+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3114104dc0 con 0x7f30f80395b0 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.419+0000 7f310be00700 1 -- 172.21.15.7:0/1627719708 <== mgr.14120 v2:172.21.15.7:6800/2898788410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3114104dc0 con 0x7f30f80395b0 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.422+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f30f80395b0 msgr2=0x7f30f803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.422+0000 7f3119c00700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f30f80395b0 0x7f30f803ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f30fc006fd0 tx=0x7f30fc006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.422+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 msgr2=0x7f311419e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.422+0000 7f3119c00700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f311419e730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3104000c00 tx=0x7f3104004290 comp rx=0 tx=0).stop 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.423+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 shutdown_connections 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.423+0000 7f3119c00700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f30f80395b0 0x7f30f803ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.423+0000 7f3119c00700 1 --2- 172.21.15.7:0/1627719708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31141085a0 0x7f311419e730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.423+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 >> 172.21.15.7:0/1627719708 conn(0x7f3114103c00 msgr2=0x7f31141046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.423+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 shutdown_connections 2024-04-23T14:38:27.332 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.423+0000 7f3119c00700 1 -- 172.21.15.7:0/1627719708 wait complete. 2024-04-23T14:38:27.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:27 smithi007 ceph-mon[27906]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:27.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:27 smithi007 ceph-mon[27906]: Saving service mgr spec with placement count:2 2024-04-23T14:38:27.570 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:27 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:28.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:28 smithi007 ceph-mon[27906]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:28.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:28 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:28.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:28 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1838872448' entity='client.admin' 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.027+0000 7fd4e3200700 1 Processor -- start 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.027+0000 7fd4e3200700 1 -- start start 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.028+0000 7fd4e3200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e410b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.028+0000 7fd4e3200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e407beb0 con 0x7fd4e4108e90 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.028+0000 7fd4e1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e410b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.028+0000 7fd4e1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e410b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33682/0 (socket says 172.21.15.7:33682) 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.028+0000 7fd4e1e00700 1 -- 172.21.15.7:0/1197333789 learned_addr learned my addr 172.21.15.7:0/1197333789 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.029+0000 7fd4e1e00700 1 -- 172.21.15.7:0/1197333789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e410b7c0 con 0x7fd4e4108e90 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.029+0000 7fd4e1e00700 1 --2- 172.21.15.7:0/1197333789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e410b280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40098a0 tx=0x7fd4d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f0d2703d4e7a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.029+0000 7fd4e0a00700 1 -- 172.21.15.7:0/1197333789 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4004160 con 0x7fd4e4108e90 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e0a00700 1 -- 172.21.15.7:0/1197333789 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4d4004300 con 0x7fd4e4108e90 2024-04-23T14:38:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e0a00700 1 -- 172.21.15.7:0/1197333789 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4011a50 con 0x7fd4e4108e90 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e3200700 1 -- 172.21.15.7:0/1197333789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 msgr2=0x7fd4e410b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e3200700 1 --2- 172.21.15.7:0/1197333789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e410b280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40098a0 tx=0x7fd4d4009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e3200700 1 -- 172.21.15.7:0/1197333789 shutdown_connections 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e3200700 1 --2- 172.21.15.7:0/1197333789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e410b280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.030+0000 7fd4e3200700 1 -- 172.21.15.7:0/1197333789 >> 172.21.15.7:0/1197333789 conn(0x7fd4e4102900 msgr2=0x7fd4e4104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.031+0000 7fd4e3200700 1 -- 172.21.15.7:0/1197333789 shutdown_connections 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.031+0000 7fd4e3200700 1 -- 172.21.15.7:0/1197333789 wait complete. 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e3200700 1 Processor -- start 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e3200700 1 -- start start 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e3200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e3200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e410c7d0 con 0x7fd4e4108e90 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e1e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e419c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33696/0 (socket says 172.21.15.7:33696) 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.032+0000 7fd4e1e00700 1 -- 172.21.15.7:0/1838872448 learned_addr learned my addr 172.21.15.7:0/1838872448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.033+0000 7fd4e1e00700 1 -- 172.21.15.7:0/1838872448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e419c860 con 0x7fd4e4108e90 2024-04-23T14:38:29.081 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.033+0000 7fd4e1e00700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e419c320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4011a00 tx=0x7fd4d4011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.033+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4003af0 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.033+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4d401a8e0 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.033+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d4024840 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.033+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e419caf0 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.034+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e419f7e0 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.035+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd4d4022020 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.035+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e4064150 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.035+0000 7fd4daa00700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fd4c80395b0 0x7fd4c803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.035+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd4d404da70 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.036+0000 7fd4e1400700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fd4c80395b0 0x7fd4c803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.037+0000 7fd4e1400700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fd4c80395b0 0x7fd4c803ba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0006fd0 tx=0x7fd4d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.042+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd4d402c350 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.271+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd4e419cfd0 con 0x7fd4e4108e90 2024-04-23T14:38:29.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.276+0000 7fd4daa00700 1 -- 172.21.15.7:0/1838872448 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fd4e419cfd0 con 0x7fd4e4108e90 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.279+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fd4c80395b0 msgr2=0x7fd4c803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.279+0000 7fd4e3200700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fd4c80395b0 0x7fd4c803ba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0006fd0 tx=0x7fd4d0006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.279+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 msgr2=0x7fd4e419c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.279+0000 7fd4e3200700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e419c320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4011a00 tx=0x7fd4d4011ae0 comp rx=0 tx=0).stop 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.280+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 shutdown_connections 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.280+0000 7fd4e3200700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7fd4c80395b0 0x7fd4c803ba70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.280+0000 7fd4e3200700 1 --2- 172.21.15.7:0/1838872448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4e4108e90 0x7fd4e419c320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.280+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 >> 172.21.15.7:0/1838872448 conn(0x7fd4e4102900 msgr2=0x7fd4e41033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.280+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 shutdown_connections 2024-04-23T14:38:29.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:28.280+0000 7fd4e3200700 1 -- 172.21.15.7:0/1838872448 wait complete. 2024-04-23T14:38:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:29 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:30 smithi007 ceph-mon[27906]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:31.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3290983099' entity='client.admin' 2024-04-23T14:38:31.049 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.711+0000 7ff40ee00700 1 Processor -- start 2024-04-23T14:38:31.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.711+0000 7ff40ee00700 1 -- start start 2024-04-23T14:38:31.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.711+0000 7ff40ee00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40810b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:31.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.711+0000 7ff40ee00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff40807beb0 con 0x7ff408109030 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.712+0000 7ff407e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40810b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.712+0000 7ff407e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40810b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33710/0 (socket says 172.21.15.7:33710) 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.712+0000 7ff407e00700 1 -- 172.21.15.7:0/1761022180 learned_addr learned my addr 172.21.15.7:0/1761022180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.712+0000 7ff407e00700 1 -- 172.21.15.7:0/1761022180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40810b960 con 0x7ff408109030 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.713+0000 7ff407e00700 1 --2- 172.21.15.7:0/1761022180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40810b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80098a0 tx=0x7ff3f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd0978eefdd7267 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.713+0000 7ff406a00700 1 -- 172.21.15.7:0/1761022180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f8004160 con 0x7ff408109030 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.713+0000 7ff406a00700 1 -- 172.21.15.7:0/1761022180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3f8004300 con 0x7ff408109030 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.713+0000 7ff406a00700 1 -- 172.21.15.7:0/1761022180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f8011a50 con 0x7ff408109030 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 -- 172.21.15.7:0/1761022180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 msgr2=0x7ff40810b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 --2- 172.21.15.7:0/1761022180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40810b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80098a0 tx=0x7ff3f8009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 -- 172.21.15.7:0/1761022180 shutdown_connections 2024-04-23T14:38:31.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 --2- 172.21.15.7:0/1761022180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40810b420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 -- 172.21.15.7:0/1761022180 >> 172.21.15.7:0/1761022180 conn(0x7ff408102a60 msgr2=0x7ff408104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 -- 172.21.15.7:0/1761022180 shutdown_connections 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.714+0000 7ff40ee00700 1 -- 172.21.15.7:0/1761022180 wait complete. 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.715+0000 7ff40ee00700 1 Processor -- start 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.715+0000 7ff40ee00700 1 -- start start 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.716+0000 7ff40ee00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.716+0000 7ff40ee00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff40810c970 con 0x7ff408109030 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.716+0000 7ff407e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.716+0000 7ff407e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33724/0 (socket says 172.21.15.7:33724) 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.716+0000 7ff407e00700 1 -- 172.21.15.7:0/3290983099 learned_addr learned my addr 172.21.15.7:0/3290983099 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.716+0000 7ff407e00700 1 -- 172.21.15.7:0/3290983099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40819ca10 con 0x7ff408109030 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.717+0000 7ff407e00700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40819c4d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8011a00 tx=0x7ff3f8011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.717+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f8003af0 con 0x7ff408109030 2024-04-23T14:38:31.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.717+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3f801a8e0 con 0x7ff408109030 2024-04-23T14:38:31.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.717+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f8024840 con 0x7ff408109030 2024-04-23T14:38:31.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.717+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40819cca0 con 0x7ff408109030 2024-04-23T14:38:31.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.717+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40819f990 con 0x7ff408109030 2024-04-23T14:38:31.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.718+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff3f8022020 con 0x7ff408109030 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.719+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff408064150 con 0x7ff408109030 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.719+0000 7ff404c00700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7ff3ec0395b0 0x7ff3ec03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.719+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff3f804de40 con 0x7ff408109030 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.720+0000 7ff407400700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7ff3ec0395b0 0x7ff3ec03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.720+0000 7ff407400700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7ff3ec0395b0 0x7ff3ec03ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4006fd0 tx=0x7ff3f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:29.729+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3f801ab40 con 0x7ff408109030 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.006+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7ff40819fb60 con 0x7ff408109030 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.010+0000 7ff404c00700 1 -- 172.21.15.7:0/3290983099 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7ff3f800f2e0 con 0x7ff408109030 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7ff3ec0395b0 msgr2=0x7ff3ec03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7ff3ec0395b0 0x7ff3ec03ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4006fd0 tx=0x7ff3f4006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 msgr2=0x7ff40819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40819c4d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8011a00 tx=0x7ff3f8011ae0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 shutdown_connections 2024-04-23T14:38:31.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7ff3ec0395b0 0x7ff3ec03ba70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 --2- 172.21.15.7:0/3290983099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff408109030 0x7ff40819c4d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 >> 172.21.15.7:0/3290983099 conn(0x7ff408102a60 msgr2=0x7ff408103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:31.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 shutdown_connections 2024-04-23T14:38:31.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:30.013+0000 7ff40ee00700 1 -- 172.21.15.7:0/3290983099 wait complete. 2024-04-23T14:38:31.059 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-04-23T14:38:32.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:32 smithi007 ceph-mon[27906]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:32.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:32 smithi007 ceph-mon[27906]: from='mgr.14120 172.21.15.7:0/2115524244' entity='mgr.x' 2024-04-23T14:38:32.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:32 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1579513894' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-23T14:38:33.257 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:32 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: ignoring --setuser ceph since I am not root 2024-04-23T14:38:33.257 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:32 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: ignoring --setgroup ceph since I am not root 2024-04-23T14:38:33.258 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:33 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:33.142+0000 7f4261bea200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:38:33.538 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:33 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:33.401+0000 7f4261bea200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:38:33.625 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.020+0000 7f96f5200700 1 Processor -- start 2024-04-23T14:38:33.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.020+0000 7f96f5200700 1 -- start start 2024-04-23T14:38:33.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.021+0000 7f96f5200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f010ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:33.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.021+0000 7f96f5200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010b150 con 0x7f96f010a7f0 2024-04-23T14:38:33.626 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.021+0000 7f96ede00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f010ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:33.627 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.021+0000 7f96ede00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f010ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33740/0 (socket says 172.21.15.7:33740) 2024-04-23T14:38:33.627 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.021+0000 7f96ede00700 1 -- 172.21.15.7:0/3924257618 learned_addr learned my addr 172.21.15.7:0/3924257618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.022+0000 7f96ede00700 1 -- 172.21.15.7:0/3924257618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f010b2d0 con 0x7f96f010a7f0 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.022+0000 7f96ede00700 1 --2- 172.21.15.7:0/3924257618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f010ac10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96e00098a0 tx=0x7f96e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b600af9ff6146c21 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.022+0000 7f96eca00700 1 -- 172.21.15.7:0/3924257618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0004160 con 0x7f96f010a7f0 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.022+0000 7f96eca00700 1 -- 172.21.15.7:0/3924257618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96e0004300 con 0x7f96f010a7f0 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.022+0000 7f96eca00700 1 -- 172.21.15.7:0/3924257618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0011a50 con 0x7f96f010a7f0 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.023+0000 7f96f5200700 1 -- 172.21.15.7:0/3924257618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 msgr2=0x7f96f010ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:33.628 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.023+0000 7f96f5200700 1 --2- 172.21.15.7:0/3924257618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f010ac10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96e00098a0 tx=0x7f96e0009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.023+0000 7f96f5200700 1 -- 172.21.15.7:0/3924257618 shutdown_connections 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.023+0000 7f96f5200700 1 --2- 172.21.15.7:0/3924257618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f010ac10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.023+0000 7f96f5200700 1 -- 172.21.15.7:0/3924257618 >> 172.21.15.7:0/3924257618 conn(0x7f96f007de30 msgr2=0x7f96f01084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.023+0000 7f96f5200700 1 -- 172.21.15.7:0/3924257618 shutdown_connections 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.024+0000 7f96f5200700 1 -- 172.21.15.7:0/3924257618 wait complete. 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96f5200700 1 Processor -- start 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96f5200700 1 -- start start 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96f5200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96f5200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010c830 con 0x7f96f010a7f0 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96ede00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96ede00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33742/0 (socket says 172.21.15.7:33742) 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.025+0000 7f96ede00700 1 -- 172.21.15.7:0/1579513894 learned_addr learned my addr 172.21.15.7:0/1579513894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.026+0000 7f96ede00700 1 -- 172.21.15.7:0/1579513894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f019eb90 con 0x7f96f010a7f0 2024-04-23T14:38:33.631 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.026+0000 7f96ede00700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f019e650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96e0011a00 tx=0x7f96e0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.026+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0003af0 con 0x7f96f010a7f0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.027+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96e001a8e0 con 0x7f96f010a7f0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.027+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0024840 con 0x7f96f010a7f0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.027+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f019ee20 con 0x7f96f010a7f0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.027+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f01a1b10 con 0x7f96f010a7f0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.028+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f96e0022020 con 0x7f96f010a7f0 2024-04-23T14:38:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.028+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f0064150 con 0x7f96f010a7f0 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.028+0000 7f96e6a00700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f96d40395b0 0x7f96d403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.029+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f96e004da70 con 0x7f96f010a7f0 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.029+0000 7f96ed400700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f96d40395b0 0x7f96d403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.030+0000 7f96ed400700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f96d40395b0 0x7f96d403ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006fd0 tx=0x7f96dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.034+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96e002c350 con 0x7f96f010a7f0 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.335+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f96f01a20c0 con 0x7f96f010a7f0 2024-04-23T14:38:33.633 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.802+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f96e002dc10 con 0x7f96f010a7f0 2024-04-23T14:38:33.634 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.806+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f96d40395b0 msgr2=0x7f96d403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:33.634 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.806+0000 7f96f5200700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f96d40395b0 0x7f96d403ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006fd0 tx=0x7f96dc006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:33.634 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.806+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 msgr2=0x7f96f019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:33.634 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.806+0000 7f96f5200700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f019e650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96e0011a00 tx=0x7f96e0011ae0 comp rx=0 tx=0).stop 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.806+0000 7f96e6a00700 1 -- 172.21.15.7:0/1579513894 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f96e0017cf0 con 0x7f96f010a7f0 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.808+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 shutdown_connections 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.808+0000 7f96f5200700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f96d40395b0 0x7f96d403ba70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.808+0000 7f96f5200700 1 --2- 172.21.15.7:0/1579513894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f010a7f0 0x7f96f019e650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.808+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 >> 172.21.15.7:0/1579513894 conn(0x7f96f007de30 msgr2=0x7f96f0107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.808+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 shutdown_connections 2024-04-23T14:38:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:32.809+0000 7f96f5200700 1 -- 172.21.15.7:0/1579513894 wait complete. 2024-04-23T14:38:33.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:33 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:33.536+0000 7f4261bea200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:38:34.073 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:33 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:33.951+0000 7f4261bea200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:38:34.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:33 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1579513894' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-23T14:38:34.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:33 smithi007 ceph-mon[27906]: mgrmap e9: x(active, since 25s) 2024-04-23T14:38:34.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:34 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:34.071+0000 7f4261bea200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:38:35.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:34 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2823708964' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.292+0000 7f5645a00700 1 Processor -- start 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.292+0000 7f5645a00700 1 -- start start 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.293+0000 7f5645a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564010b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.293+0000 7f5645a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f564007beb0 con 0x7f5640109030 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.293+0000 7f563ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564010b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.293+0000 7f563ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564010b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40742/0 (socket says 172.21.15.7:40742) 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.293+0000 7f563ea00700 1 -- 172.21.15.7:0/4090167541 learned_addr learned my addr 172.21.15.7:0/4090167541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.294+0000 7f563ea00700 1 -- 172.21.15.7:0/4090167541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564010b960 con 0x7f5640109030 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.294+0000 7f563ea00700 1 --2- 172.21.15.7:0/4090167541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564010b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56300098a0 tx=0x7f5630009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5078ecafa413925f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.294+0000 7f563d600700 1 -- 172.21.15.7:0/4090167541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5630004160 con 0x7f5640109030 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.294+0000 7f563d600700 1 -- 172.21.15.7:0/4090167541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5630004300 con 0x7f5640109030 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.294+0000 7f563d600700 1 -- 172.21.15.7:0/4090167541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5630011a50 con 0x7f5640109030 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 -- 172.21.15.7:0/4090167541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 msgr2=0x7f564010b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 --2- 172.21.15.7:0/4090167541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564010b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56300098a0 tx=0x7f5630009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 -- 172.21.15.7:0/4090167541 shutdown_connections 2024-04-23T14:38:35.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 --2- 172.21.15.7:0/4090167541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564010b420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 -- 172.21.15.7:0/4090167541 >> 172.21.15.7:0/4090167541 conn(0x7f5640102a60 msgr2=0x7f5640104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 -- 172.21.15.7:0/4090167541 shutdown_connections 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.295+0000 7f5645a00700 1 -- 172.21.15.7:0/4090167541 wait complete. 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.296+0000 7f5645a00700 1 Processor -- start 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.297+0000 7f5645a00700 1 -- start start 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.297+0000 7f5645a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564019c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:35.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.297+0000 7f5645a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f564010c970 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.297+0000 7f563ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564019c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.297+0000 7f563ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564019c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40752/0 (socket says 172.21.15.7:40752) 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.297+0000 7f563ea00700 1 -- 172.21.15.7:0/2823708964 learned_addr learned my addr 172.21.15.7:0/2823708964 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.298+0000 7f563ea00700 1 -- 172.21.15.7:0/2823708964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564019ca10 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.298+0000 7f563ea00700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564019c4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5630011a00 tx=0x7f5630011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.298+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5630003af0 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.298+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f563001a8e0 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.298+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564019cca0 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.298+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5630024840 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.299+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564019f990 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.300+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f5630022020 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.300+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5640064150 con 0x7f5640109030 2024-04-23T14:38:35.326 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.300+0000 7f5637400700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 0x7f562403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.300+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f563004da60 con 0x7f5640109030 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.300+0000 7f563e000700 1 -- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 msgr2=0x7f562403bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.300+0000 7f563e000700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 0x7f562403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.306+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f56300172b0 con 0x7f5640109030 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.501+0000 7f563e000700 1 -- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 msgr2=0x7f562403bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.501+0000 7f563e000700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 0x7f562403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.596+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f564019ff40 con 0x7f5640109030 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.596+0000 7f5637400700 1 -- 172.21.15.7:0/2823708964 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f563001adb0 con 0x7f5640109030 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 msgr2=0x7f562403bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 0x7f562403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 msgr2=0x7f564019c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564019c4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5630011a00 tx=0x7f5630011ae0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 shutdown_connections 2024-04-23T14:38:35.327 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f5624039600 0x7f562403bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 --2- 172.21.15.7:0/2823708964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5640109030 0x7f564019c4d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 >> 172.21.15.7:0/2823708964 conn(0x7f5640102a60 msgr2=0x7f5640103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:35.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 shutdown_connections 2024-04-23T14:38:35.328 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:34.599+0000 7f5645a00700 1 -- 172.21.15.7:0/2823708964 wait complete. 2024-04-23T14:38:35.328 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-04-23T14:38:35.328 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 9... 2024-04-23T14:38:35.907 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:35 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:35.711+0000 7f4261bea200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:38:36.177 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:35 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:35.953+0000 7f4261bea200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:38:36.518 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:36 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:36.175+0000 7f4261bea200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:38:36.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:36 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:36.574+0000 7f4261bea200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:38:36.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:36 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:36.701+0000 7f4261bea200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:38:37.228 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:36 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:36.961+0000 7f4261bea200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:38:37.228 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:37 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:37.226+0000 7f4261bea200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:38:38.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:38 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:38.050+0000 7f4261bea200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:38:38.921 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:38 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:38.625+0000 7f4261bea200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:38:38.921 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:38 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:38.757+0000 7f4261bea200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:38:39.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:39 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:39.035+0000 7f4261bea200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:38:40.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:39 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:39.708+0000 7f4261bea200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:38:40.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:39 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:39.837+0000 7f4261bea200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:38:40.498 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:40 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:40.176+0000 7f4261bea200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:38:40.498 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:40 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:40.364+0000 7f4261bea200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:38:40.498 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:40 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:40.496+0000 7f4261bea200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:38:40.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:40 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:40.654+0000 7f4261bea200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:38:41.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:41 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:41.037+0000 7f4261bea200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:38:42.124 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:41 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:41.835+0000 7f4261bea200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:38:42.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:38:42.134+0000 7f4261bea200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:38:42.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: Active manager daemon x restarted 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: Activating manager daemon x 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: osdmap e3: 0 total, 0 up, 0 in 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: mgrmap e10: x(active, starting, since 0.00464384s) 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:38:42.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:42 smithi007 ceph-mon[27906]: Manager daemon x is now available 2024-04-23T14:38:43.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:43.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:38:43.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T14:38:43.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:43 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:42] ENGINE Bus STARTING 2024-04-23T14:38:43.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:43 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:42] ENGINE Serving on https://172.21.15.7:7150 2024-04-23T14:38:43.481 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:43 smithi007 ceph-mon[27906]: mgrmap e11: x(active, since 1.01314s) 2024-04-23T14:38:43.830 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:38:43.831 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-23T14:38:43.831 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-23T14:38:43.831 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:38:43.832 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.905+0000 7f3e4fa00700 1 Processor -- start 2024-04-23T14:38:43.832 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.905+0000 7f3e4fa00700 1 -- start start 2024-04-23T14:38:43.832 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.906+0000 7f3e4fa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e481089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:43.833 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.906+0000 7f3e4fa00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e48108fb0 con 0x7f3e481085c0 2024-04-23T14:38:43.833 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.906+0000 7f3e4d000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e481089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:43.833 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.906+0000 7f3e4d000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e481089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40760/0 (socket says 172.21.15.7:40760) 2024-04-23T14:38:43.833 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.906+0000 7f3e4d000700 1 -- 172.21.15.7:0/1598858279 learned_addr learned my addr 172.21.15.7:0/1598858279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:43.833 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.907+0000 7f3e4d000700 1 -- 172.21.15.7:0/1598858279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e48109770 con 0x7f3e481085c0 2024-04-23T14:38:43.834 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.907+0000 7f3e4d000700 1 --2- 172.21.15.7:0/1598858279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e481089e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0098a0 tx=0x7f3e3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c31f14074e47f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:43.834 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.907+0000 7f3e47400700 1 -- 172.21.15.7:0/1598858279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c004160 con 0x7f3e481085c0 2024-04-23T14:38:43.834 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.907+0000 7f3e47400700 1 -- 172.21.15.7:0/1598858279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e3c004300 con 0x7f3e481085c0 2024-04-23T14:38:43.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.907+0000 7f3e47400700 1 -- 172.21.15.7:0/1598858279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c011a50 con 0x7f3e481085c0 2024-04-23T14:38:43.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 -- 172.21.15.7:0/1598858279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 msgr2=0x7f3e481089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:43.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/1598858279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e481089e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0098a0 tx=0x7f3e3c009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 -- 172.21.15.7:0/1598858279 shutdown_connections 2024-04-23T14:38:43.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/1598858279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e481089e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 -- 172.21.15.7:0/1598858279 >> 172.21.15.7:0/1598858279 conn(0x7f3e48103c00 msgr2=0x7f3e48106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:43.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 -- 172.21.15.7:0/1598858279 shutdown_connections 2024-04-23T14:38:43.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.908+0000 7f3e4fa00700 1 -- 172.21.15.7:0/1598858279 wait complete. 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.909+0000 7f3e4fa00700 1 Processor -- start 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.909+0000 7f3e4fa00700 1 -- start start 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.910+0000 7f3e4fa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e4819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.910+0000 7f3e4fa00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4810cb20 con 0x7f3e481085c0 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.910+0000 7f3e4d000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e4819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.910+0000 7f3e4d000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e4819e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40766/0 (socket says 172.21.15.7:40766) 2024-04-23T14:38:43.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.910+0000 7f3e4d000700 1 -- 172.21.15.7:0/3252062038 learned_addr learned my addr 172.21.15.7:0/3252062038 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:43.841 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.910+0000 7f3e4d000700 1 -- 172.21.15.7:0/3252062038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4819ec00 con 0x7f3e481085c0 2024-04-23T14:38:43.841 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.911+0000 7f3e4d000700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e4819e6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c011a20 tx=0x7f3e3c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:43.841 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.911+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c003af0 con 0x7f3e481085c0 2024-04-23T14:38:43.841 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.911+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e3c01a8e0 con 0x7f3e481085c0 2024-04-23T14:38:43.841 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.911+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c024860 con 0x7f3e481085c0 2024-04-23T14:38:43.841 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.912+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4819ee90 con 0x7f3e481085c0 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.912+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e481a1b80 con 0x7f3e481085c0 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.913+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f3e3c022020 con 0x7f3e481085c0 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.914+0000 7f3e45600700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.914+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 --> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3e3003c230 con 0x7f3e30039660 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.914+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e3c04dcc0 con 0x7f3e481085c0 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.914+0000 7f3e47e00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:35.914+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:36.115+0000 7f3e47e00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:36.115+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:36.516+0000 7f3e47e00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:36.516+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:37.317+0000 7f3e47e00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:37.317+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T14:38:43.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:38.919+0000 7f3e47e00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:38.919+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:42.122+0000 7f3e47e00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/2898788410 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:42.123+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:42.141+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7f3e3c01a5c0 con 0x7f3e481085c0 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:42.141+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 msgr2=0x7f3e3003bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:42.141+0000 7f3e45600700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.147+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f3e3c02cc90 con 0x7f3e481085c0 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.147+0000 7f3e45600700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e3003cff0 0x7f3e3003f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.147+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3e3c047130 con 0x7f3e3003cff0 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.148+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e3003cff0 0x7f3e3003f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:43.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.149+0000 7f3e47e00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e3003cff0 0x7f3e3003f3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e34003a10 tx=0x7f3e34009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.150+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f3e3c047130 con 0x7f3e3003cff0 2024-04-23T14:38:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.158+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3e48064150 con 0x7f3e3003cff0 2024-04-23T14:38:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.159+0000 7f3e45600700 1 -- 172.21.15.7:0/3252062038 <== mgr.14152 v2:172.21.15.7:6800/3440122157 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f3e48064150 con 0x7f3e3003cff0 2024-04-23T14:38:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.159+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e3003cff0 msgr2=0x7f3e3003f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.159+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e3003cff0 0x7f3e3003f3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e34003a10 tx=0x7f3e34009270 comp rx=0 tx=0).stop 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.159+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 msgr2=0x7f3e4819e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.159+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e4819e6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c011a20 tx=0x7f3e3c011b00 comp rx=0 tx=0).stop 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 shutdown_connections 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e3003cff0 0x7f3e3003f3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e481085c0 0x7f3e4819e6c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 --2- 172.21.15.7:0/3252062038 >> [v2:172.21.15.7:6800/2898788410,v1:172.21.15.7:6801/2898788410] conn(0x7f3e30039660 0x7f3e3003bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 >> 172.21.15.7:0/3252062038 conn(0x7f3e48103c00 msgr2=0x7f3e481046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 shutdown_connections 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:43.160+0000 7f3e4fa00700 1 -- 172.21.15.7:0/3252062038 wait complete. 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 9 is available 2024-04-23T14:38:43.846 INFO:teuthology.orchestra.run.smithi007.stdout:Generating a dashboard self-signed certificate... 2024-04-23T14:38:44.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:44 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:43] ENGINE Serving on http://172.21.15.7:8765 2024-04-23T14:38:44.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:44 smithi007 ceph-mon[27906]: [23/Apr/2024:14:38:43] ENGINE Bus STARTED 2024-04-23T14:38:44.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:44 smithi007 ceph-mon[27906]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-23T14:38:44.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:44 smithi007 ceph-mon[27906]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-23T14:38:45.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:45 smithi007 ceph-mon[27906]: mgrmap e12: x(active, since 2s) 2024-04-23T14:38:45.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:46.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-23T14:38:46.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.072+0000 7fac04c00700 1 Processor -- start 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.073+0000 7fac04c00700 1 -- start start 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.073+0000 7fac04c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0010ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.073+0000 7fac04c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fac0010b140 con 0x7fac0010a7e0 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.074+0000 7fabfde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0010ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.074+0000 7fabfde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0010ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50800/0 (socket says 172.21.15.7:50800) 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.074+0000 7fabfde00700 1 -- 172.21.15.7:0/3902726085 learned_addr learned my addr 172.21.15.7:0/3902726085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.074+0000 7fabfde00700 1 -- 172.21.15.7:0/3902726085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0010b2c0 con 0x7fac0010a7e0 2024-04-23T14:38:46.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.075+0000 7fabfde00700 1 --2- 172.21.15.7:0/3902726085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0010ac00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabf00098a0 tx=0x7fabf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9998fafb2ea9a84c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.075+0000 7fabfca00700 1 -- 172.21.15.7:0/3902726085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf0004160 con 0x7fac0010a7e0 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.075+0000 7fabfca00700 1 -- 172.21.15.7:0/3902726085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabf0004300 con 0x7fac0010a7e0 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.075+0000 7fabfca00700 1 -- 172.21.15.7:0/3902726085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf0011a50 con 0x7fac0010a7e0 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.076+0000 7fac04c00700 1 -- 172.21.15.7:0/3902726085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 msgr2=0x7fac0010ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.076+0000 7fac04c00700 1 --2- 172.21.15.7:0/3902726085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0010ac00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabf00098a0 tx=0x7fabf0009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.076+0000 7fac04c00700 1 -- 172.21.15.7:0/3902726085 shutdown_connections 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.076+0000 7fac04c00700 1 --2- 172.21.15.7:0/3902726085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0010ac00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.076+0000 7fac04c00700 1 -- 172.21.15.7:0/3902726085 >> 172.21.15.7:0/3902726085 conn(0x7fac0007dde0 msgr2=0x7fac001084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.076+0000 7fac04c00700 1 -- 172.21.15.7:0/3902726085 shutdown_connections 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.077+0000 7fac04c00700 1 -- 172.21.15.7:0/3902726085 wait complete. 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fac04c00700 1 Processor -- start 2024-04-23T14:38:46.352 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fac04c00700 1 -- start start 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fac04c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fac04c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fac0010c820 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fabfde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fabfde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0019e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50816/0 (socket says 172.21.15.7:50816) 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.078+0000 7fabfde00700 1 -- 172.21.15.7:0/1349843095 learned_addr learned my addr 172.21.15.7:0/1349843095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.079+0000 7fabfde00700 1 -- 172.21.15.7:0/1349843095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0019ebb0 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.079+0000 7fabfde00700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0019e670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fabf0011a00 tx=0x7fabf0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.080+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf0003af0 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.080+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0019ee40 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.080+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac001a1b30 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.080+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabf001a8e0 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.080+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf00247e0 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.081+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fabf0022020 con 0x7fac0010a7e0 2024-04-23T14:38:46.353 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.081+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe0005360 con 0x7fac0010a7e0 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.082+0000 7fabf6a00700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fabe4039660 0x7fabe403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.082+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fabf004ead0 con 0x7fac0010a7e0 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.082+0000 7fabfd400700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fabe4039660 0x7fabe403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.083+0000 7fabfd400700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fabe4039660 0x7fabe403bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabec006fd0 tx=0x7fabec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.089+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fabf000fdd0 con 0x7fac0010a7e0 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.336+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fabe0000bf0 con 0x7fabe4039660 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.613+0000 7fabf6a00700 1 -- 172.21.15.7:0/1349843095 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fabe0000bf0 con 0x7fabe4039660 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fabe4039660 msgr2=0x7fabe403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fabe4039660 0x7fabe403bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabec006fd0 tx=0x7fabec006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 msgr2=0x7fac0019e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0019e670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fabf0011a00 tx=0x7fabf0011ae0 comp rx=0 tx=0).stop 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 shutdown_connections 2024-04-23T14:38:46.354 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fabe4039660 0x7fabe403bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:46.355 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 --2- 172.21.15.7:0/1349843095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac0010a7e0 0x7fac0019e670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:46.355 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.616+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 >> 172.21.15.7:0/1349843095 conn(0x7fac0007dde0 msgr2=0x7fac00107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:46.355 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.617+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 shutdown_connections 2024-04-23T14:38:46.355 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:45.617+0000 7fac04c00700 1 -- 172.21.15.7:0/1349843095 wait complete. 2024-04-23T14:38:46.355 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-04-23T14:38:46.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:46 smithi007 ceph-mon[27906]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:46.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:46 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:46.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:46 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:48.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:48 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:48.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:48 smithi007 ceph-mon[27906]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:48.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:48 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:48.306 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$RGmhP0ygow4AUBCbLk/90OQuYjELgFq9t4hFSwucAGPlhod7pgJDm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713883127, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.041+0000 7fb38ce00700 1 Processor -- start 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.041+0000 7fb38ce00700 1 -- start start 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.042+0000 7fb38ce00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb3881089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.042+0000 7fb38ce00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb388108f90 con 0x7fb3881085a0 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.042+0000 7fb385e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb3881089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.043+0000 7fb385e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb3881089c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50820/0 (socket says 172.21.15.7:50820) 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.043+0000 7fb385e00700 1 -- 172.21.15.7:0/3382590351 learned_addr learned my addr 172.21.15.7:0/3382590351 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:48.309 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.043+0000 7fb385e00700 1 -- 172.21.15.7:0/3382590351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb388109750 con 0x7fb3881085a0 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.043+0000 7fb385e00700 1 --2- 172.21.15.7:0/3382590351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb3881089c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3780098a0 tx=0x7fb378009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbed85c4de24ec3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.044+0000 7fb384a00700 1 -- 172.21.15.7:0/3382590351 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb378004160 con 0x7fb3881085a0 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.044+0000 7fb384a00700 1 -- 172.21.15.7:0/3382590351 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb378004300 con 0x7fb3881085a0 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.044+0000 7fb384a00700 1 -- 172.21.15.7:0/3382590351 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb378011a50 con 0x7fb3881085a0 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 -- 172.21.15.7:0/3382590351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 msgr2=0x7fb3881089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 --2- 172.21.15.7:0/3382590351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb3881089c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3780098a0 tx=0x7fb378009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 -- 172.21.15.7:0/3382590351 shutdown_connections 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 --2- 172.21.15.7:0/3382590351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb3881089c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 -- 172.21.15.7:0/3382590351 >> 172.21.15.7:0/3382590351 conn(0x7fb388103c00 msgr2=0x7fb388106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 -- 172.21.15.7:0/3382590351 shutdown_connections 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.045+0000 7fb38ce00700 1 -- 172.21.15.7:0/3382590351 wait complete. 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.046+0000 7fb38ce00700 1 Processor -- start 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.046+0000 7fb38ce00700 1 -- start start 2024-04-23T14:38:48.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.047+0000 7fb38ce00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb38819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:48.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.047+0000 7fb38ce00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb38810cb00 con 0x7fb3881085a0 2024-04-23T14:38:48.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.047+0000 7fb385e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb38819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:48.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.047+0000 7fb385e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb38819e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50834/0 (socket says 172.21.15.7:50834) 2024-04-23T14:38:48.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.047+0000 7fb385e00700 1 -- 172.21.15.7:0/3719287665 learned_addr learned my addr 172.21.15.7:0/3719287665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:48.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.047+0000 7fb385e00700 1 -- 172.21.15.7:0/3719287665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38819ec10 con 0x7fb3881085a0 2024-04-23T14:38:48.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.048+0000 7fb385e00700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb38819e6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb378011a20 tx=0x7fb378011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.048+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb378003af0 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.048+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb37801a8e0 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.048+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb378024860 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.048+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38819eea0 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.048+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3881a1b90 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.050+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb388064150 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.050+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fb378022020 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.050+0000 7fb37ea00700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb36c039660 0x7fb36c03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.050+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb37804db50 con 0x7fb3881085a0 2024-04-23T14:38:48.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.051+0000 7fb385400700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb36c039660 0x7fb36c03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.051+0000 7fb385400700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb36c039660 0x7fb36c03bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb374006fd0 tx=0x7fb374006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.056+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb3780212c0 con 0x7fb3881085a0 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.343+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fb3881a1e20 con 0x7fb36c039660 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.639+0000 7fb37ea00700 1 -- 172.21.15.7:0/3719287665 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fb3881a1e20 con 0x7fb36c039660 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb36c039660 msgr2=0x7fb36c03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb36c039660 0x7fb36c03bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb374006fd0 tx=0x7fb374006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 msgr2=0x7fb38819e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb38819e6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb378011a20 tx=0x7fb378011b00 comp rx=0 tx=0).stop 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 shutdown_connections 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb36c039660 0x7fb36c03bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 --2- 172.21.15.7:0/3719287665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3881085a0 0x7fb38819e6d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 >> 172.21.15.7:0/3719287665 conn(0x7fb388103c00 msgr2=0x7fb388104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 shutdown_connections 2024-04-23T14:38:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:47.642+0000 7fb38ce00700 1 -- 172.21.15.7:0/3719287665 wait complete. 2024-04-23T14:38:48.316 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-04-23T14:38:49.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:49 smithi007 ceph-mon[27906]: mgrmap e13: x(active, since 6s) 2024-04-23T14:38:49.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:49 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1557276705' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-23T14:38:50.898 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-04-23T14:38:50.899 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.904+0000 7f82e0800700 1 Processor -- start 2024-04-23T14:38:50.899 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.904+0000 7f82e0800700 1 -- start start 2024-04-23T14:38:50.899 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.905+0000 7f82e0800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d81089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:50.900 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.905+0000 7f82e0800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8108f90 con 0x7f82d81085a0 2024-04-23T14:38:50.900 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.905+0000 7f82dde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d81089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:50.900 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.905+0000 7f82dde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d81089c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50844/0 (socket says 172.21.15.7:50844) 2024-04-23T14:38:50.900 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.905+0000 7f82dde00700 1 -- 172.21.15.7:0/3254345005 learned_addr learned my addr 172.21.15.7:0/3254345005 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:50.900 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.906+0000 7f82dde00700 1 -- 172.21.15.7:0/3254345005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d8109750 con 0x7f82d81085a0 2024-04-23T14:38:50.901 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.906+0000 7f82dde00700 1 --2- 172.21.15.7:0/3254345005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d81089c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0098a0 tx=0x7f82cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e958949dc9ed54 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:50.901 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82dca00700 1 -- 172.21.15.7:0/3254345005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc004160 con 0x7f82d81085a0 2024-04-23T14:38:50.901 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82dca00700 1 -- 172.21.15.7:0/3254345005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82cc004300 con 0x7f82d81085a0 2024-04-23T14:38:50.901 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82dca00700 1 -- 172.21.15.7:0/3254345005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc011a50 con 0x7f82d81085a0 2024-04-23T14:38:50.901 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82e0800700 1 -- 172.21.15.7:0/3254345005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 msgr2=0x7f82d81089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:50.901 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82e0800700 1 --2- 172.21.15.7:0/3254345005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d81089c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0098a0 tx=0x7f82cc009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:50.902 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82e0800700 1 -- 172.21.15.7:0/3254345005 shutdown_connections 2024-04-23T14:38:50.903 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82e0800700 1 --2- 172.21.15.7:0/3254345005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d81089c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:50.903 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.907+0000 7f82e0800700 1 -- 172.21.15.7:0/3254345005 >> 172.21.15.7:0/3254345005 conn(0x7f82d8103c00 msgr2=0x7f82d8106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:50.903 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.908+0000 7f82e0800700 1 -- 172.21.15.7:0/3254345005 shutdown_connections 2024-04-23T14:38:50.903 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.908+0000 7f82e0800700 1 -- 172.21.15.7:0/3254345005 wait complete. 2024-04-23T14:38:50.903 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82e0800700 1 Processor -- start 2024-04-23T14:38:50.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82e0800700 1 -- start start 2024-04-23T14:38:50.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82e0800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:50.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82e0800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82d810cb00 con 0x7f82d81085a0 2024-04-23T14:38:50.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82dde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:50.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82dde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50860/0 (socket says 172.21.15.7:50860) 2024-04-23T14:38:50.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.909+0000 7f82dde00700 1 -- 172.21.15.7:0/1557276705 learned_addr learned my addr 172.21.15.7:0/1557276705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:50.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.910+0000 7f82dde00700 1 -- 172.21.15.7:0/1557276705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d819c9c0 con 0x7f82d81085a0 2024-04-23T14:38:50.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.910+0000 7f82dde00700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d819c480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82cc011a20 tx=0x7f82cc011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:50.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.910+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc003af0 con 0x7f82d81085a0 2024-04-23T14:38:50.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.910+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82cc01a8e0 con 0x7f82d81085a0 2024-04-23T14:38:50.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.910+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d819cc50 con 0x7f82d81085a0 2024-04-23T14:38:50.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.911+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc024860 con 0x7f82d81085a0 2024-04-23T14:38:50.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.911+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d819f940 con 0x7f82d81085a0 2024-04-23T14:38:50.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.912+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d8064150 con 0x7f82d81085a0 2024-04-23T14:38:50.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.912+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f82cc022020 con 0x7f82d81085a0 2024-04-23T14:38:50.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.912+0000 7f82d2a00700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82c0039700 0x7f82c003bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:50.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.913+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f82cc04dc60 con 0x7f82d81085a0 2024-04-23T14:38:50.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.913+0000 7f82dd400700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82c0039700 0x7f82c003bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:50.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.914+0000 7f82dd400700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82c0039700 0x7f82c003bbc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f82c8006fd0 tx=0x7f82c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:50.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:48.918+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f82cc0212c0 con 0x7f82d81085a0 2024-04-23T14:38:50.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.170+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f82d819fef0 con 0x7f82d81085a0 2024-04-23T14:38:50.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.171+0000 7f82d2a00700 1 -- 172.21.15.7:0/1557276705 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f82cc01ab40 con 0x7f82d81085a0 2024-04-23T14:38:50.909 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82c0039700 msgr2=0x7f82c003bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:50.909 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82c0039700 0x7f82c003bbc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f82c8006fd0 tx=0x7f82c8006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:50.909 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 msgr2=0x7f82d819c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d819c480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82cc011a20 tx=0x7f82cc011b00 comp rx=0 tx=0).stop 2024-04-23T14:38:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 shutdown_connections 2024-04-23T14:38:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82c0039700 0x7f82c003bbc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 --2- 172.21.15.7:0/1557276705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82d81085a0 0x7f82d819c480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 >> 172.21.15.7:0/1557276705 conn(0x7f82d8103c00 msgr2=0x7f82d81046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.174+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 shutdown_connections 2024-04-23T14:38:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:49.175+0000 7f82e0800700 1 -- 172.21.15.7:0/1557276705 wait complete. 2024-04-23T14:38:50.941 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:38:50.942 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-04-23T14:38:50.969 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:38:50.969 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-04-23T14:38:50.970 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-04-23T14:38:50.970 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-23T14:38:50.977 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-04-23T14:38:50.977 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:50.977 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-04-23T14:38:50.977 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-04-23T14:38:50.978 INFO:teuthology.orchestra.run.smithi007.stdout: Password: 45mprlqcrx 2024-04-23T14:38:50.978 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:50.979 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config directory 2024-04-23T14:38:50.981 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling autotune for osd_memory_target 2024-04-23T14:38:52.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.610+0000 7f9b89a00700 1 Processor -- start 2024-04-23T14:38:52.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.611+0000 7f9b89a00700 1 -- start start 2024-04-23T14:38:52.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.611+0000 7f9b89a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b8410f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:52.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.611+0000 7f9b89a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8410f920 con 0x7f9b8410efc0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.612+0000 7f9b82a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b8410f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.612+0000 7f9b82a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b8410f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50874/0 (socket says 172.21.15.7:50874) 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.612+0000 7f9b82a00700 1 -- 172.21.15.7:0/3304030015 learned_addr learned my addr 172.21.15.7:0/3304030015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.612+0000 7f9b82a00700 1 -- 172.21.15.7:0/3304030015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8410faa0 con 0x7f9b8410efc0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.612+0000 7f9b82a00700 1 --2- 172.21.15.7:0/3304030015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b8410f3e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b740098a0 tx=0x7f9b74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995440416f3e8041 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.613+0000 7f9b82000700 1 -- 172.21.15.7:0/3304030015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b74004160 con 0x7f9b8410efc0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.613+0000 7f9b82000700 1 -- 172.21.15.7:0/3304030015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b74004300 con 0x7f9b8410efc0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.613+0000 7f9b82000700 1 -- 172.21.15.7:0/3304030015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b74011a50 con 0x7f9b8410efc0 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.613+0000 7f9b89a00700 1 -- 172.21.15.7:0/3304030015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 msgr2=0x7f9b8410f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.613+0000 7f9b89a00700 1 --2- 172.21.15.7:0/3304030015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b8410f3e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b740098a0 tx=0x7f9b74009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:52.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.614+0000 7f9b89a00700 1 -- 172.21.15.7:0/3304030015 shutdown_connections 2024-04-23T14:38:52.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.614+0000 7f9b89a00700 1 --2- 172.21.15.7:0/3304030015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b8410f3e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:52.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.614+0000 7f9b89a00700 1 -- 172.21.15.7:0/3304030015 >> 172.21.15.7:0/3304030015 conn(0x7f9b8407ddb0 msgr2=0x7f9b840801d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:52.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.614+0000 7f9b89a00700 1 -- 172.21.15.7:0/3304030015 shutdown_connections 2024-04-23T14:38:52.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.614+0000 7f9b89a00700 1 -- 172.21.15.7:0/3304030015 wait complete. 2024-04-23T14:38:52.545 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.615+0000 7f9b89a00700 1 Processor -- start 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.615+0000 7f9b89a00700 1 -- start start 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.616+0000 7f9b89a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b841a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.616+0000 7f9b89a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84110c10 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.616+0000 7f9b82a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b841a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.616+0000 7f9b82a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b841a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50876/0 (socket says 172.21.15.7:50876) 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.616+0000 7f9b82a00700 1 -- 172.21.15.7:0/1582476868 learned_addr learned my addr 172.21.15.7:0/1582476868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.617+0000 7f9b82a00700 1 -- 172.21.15.7:0/1582476868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b841a2f70 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.617+0000 7f9b82a00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b841a2a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b74011a20 tx=0x7f9b74011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.617+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b74003aa0 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.617+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b7401a8e0 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.617+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b74024890 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.617+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841a3260 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.618+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841a5ef0 con 0x7f9b8410efc0 2024-04-23T14:38:52.546 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.619+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f9b74022020 con 0x7f9b8410efc0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.619+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b84064150 con 0x7f9b8410efc0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.619+0000 7f9b7b400700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9b68039750 0x7f9b6803bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.620+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9b7404dc00 con 0x7f9b8410efc0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.620+0000 7f9b7be00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9b68039750 0x7f9b6803bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.620+0000 7f9b7be00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9b68039750 0x7f9b6803bc10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c006fd0 tx=0x7f9b6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.625+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9b7400f2e0 con 0x7f9b8410efc0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.856+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f9b841a61e0 con 0x7f9b8410efc0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.856+0000 7f9b7b400700 1 -- 172.21.15.7:0/1582476868 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f9b7402c3a0 con 0x7f9b8410efc0 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.859+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9b68039750 msgr2=0x7f9b6803bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.859+0000 7f9b89a00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9b68039750 0x7f9b6803bc10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c006fd0 tx=0x7f9b6c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.859+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 msgr2=0x7f9b841a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.859+0000 7f9b89a00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b841a2a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b74011a20 tx=0x7f9b74011b00 comp rx=0 tx=0).stop 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.859+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 shutdown_connections 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.860+0000 7f9b89a00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9b68039750 0x7f9b6803bc10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.860+0000 7f9b89a00700 1 --2- 172.21.15.7:0/1582476868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b8410efc0 0x7f9b841a2a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:52.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.860+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 >> 172.21.15.7:0/1582476868 conn(0x7f9b8407ddb0 msgr2=0x7f9b8407e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:52.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.860+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 shutdown_connections 2024-04-23T14:38:52.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:51.860+0000 7f9b89a00700 1 -- 172.21.15.7:0/1582476868 wait complete. 2024-04-23T14:38:54.113 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.141+0000 7f771be00700 1 Processor -- start 2024-04-23T14:38:54.113 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.141+0000 7f771be00700 1 -- start start 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.141+0000 7f771be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f771410f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.141+0000 7f771be00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f771410f9b0 con 0x7f771410efc0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.142+0000 7f7719400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f771410f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.142+0000 7f7719400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f771410f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45052/0 (socket says 172.21.15.7:45052) 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.142+0000 7f7719400700 1 -- 172.21.15.7:0/173251663 learned_addr learned my addr 172.21.15.7:0/173251663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.142+0000 7f7719400700 1 -- 172.21.15.7:0/173251663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771410fde0 con 0x7f771410efc0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.143+0000 7f7719400700 1 --2- 172.21.15.7:0/173251663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f771410f3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77080098a0 tx=0x7f7708009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc5bf3ccc05ded3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.143+0000 7f7713e00700 1 -- 172.21.15.7:0/173251663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7708004160 con 0x7f771410efc0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.143+0000 7f7713e00700 1 -- 172.21.15.7:0/173251663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7708004300 con 0x7f771410efc0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.143+0000 7f7713e00700 1 -- 172.21.15.7:0/173251663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7708011a50 con 0x7f771410efc0 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 -- 172.21.15.7:0/173251663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 msgr2=0x7f771410f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:54.114 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 --2- 172.21.15.7:0/173251663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f771410f3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77080098a0 tx=0x7f7708009bb0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 -- 172.21.15.7:0/173251663 shutdown_connections 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 --2- 172.21.15.7:0/173251663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f771410f3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 -- 172.21.15.7:0/173251663 >> 172.21.15.7:0/173251663 conn(0x7f771407de30 msgr2=0x7f7714080250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 -- 172.21.15.7:0/173251663 shutdown_connections 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.144+0000 7f771be00700 1 -- 172.21.15.7:0/173251663 wait complete. 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.145+0000 7f771be00700 1 Processor -- start 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.145+0000 7f771be00700 1 -- start start 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.145+0000 7f771be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f77141a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.145+0000 7f771be00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77141130a0 con 0x7f771410efc0 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.146+0000 7f7719400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f77141a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.146+0000 7f7719400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f77141a2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45056/0 (socket says 172.21.15.7:45056) 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.146+0000 7f7719400700 1 -- 172.21.15.7:0/4050873565 learned_addr learned my addr 172.21.15.7:0/4050873565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.146+0000 7f7719400700 1 -- 172.21.15.7:0/4050873565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77141a2f90 con 0x7f771410efc0 2024-04-23T14:38:54.115 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.147+0000 7f7719400700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f77141a2a50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7708011a00 tx=0x7f7708011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:54.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.147+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7708003af0 con 0x7f771410efc0 2024-04-23T14:38:54.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.147+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f770801a8e0 con 0x7f771410efc0 2024-04-23T14:38:54.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.147+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77141a3220 con 0x7f771410efc0 2024-04-23T14:38:54.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.147+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7708024840 con 0x7f771410efc0 2024-04-23T14:38:54.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.147+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141a5f10 con 0x7f771410efc0 2024-04-23T14:38:54.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.148+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f7708022020 con 0x7f771410efc0 2024-04-23T14:38:54.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.148+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7714064150 con 0x7f771410efc0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.149+0000 7f7712000700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76fc039700 0x7f76fc03bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.149+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f770804db90 con 0x7f771410efc0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.149+0000 7f7718a00700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76fc039700 0x7f76fc03bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.150+0000 7f7718a00700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76fc039700 0x7f76fc03bbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7700006fd0 tx=0x7f7700006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.154+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7708016260 con 0x7f771410efc0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.503+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f77141a64c0 con 0x7f771410efc0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.506+0000 7f7712000700 1 -- 172.21.15.7:0/4050873565 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f770802ddb0 con 0x7f771410efc0 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76fc039700 msgr2=0x7f76fc03bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76fc039700 0x7f76fc03bbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7700006fd0 tx=0x7f7700006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 msgr2=0x7f77141a2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f77141a2a50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7708011a00 tx=0x7f7708011ae0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 shutdown_connections 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76fc039700 0x7f76fc03bbc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 --2- 172.21.15.7:0/4050873565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f771410efc0 0x7f77141a2a50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 >> 172.21.15.7:0/4050873565 conn(0x7f771407de30 msgr2=0x7f771407e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.509+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 shutdown_connections 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:53.510+0000 7f771be00700 1 -- 172.21.15.7:0/4050873565 wait complete. 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-04-23T14:38:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.121 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-04-23T14:38:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-23T14:38:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:38:54.121 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-04-23T14:38:54.223 INFO:tasks.cephadm:Fetching config... 2024-04-23T14:38:54.223 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:38:54.224 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-23T14:38:54.277 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-23T14:38:54.277 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:38:54.277 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-23T14:38:54.327 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-23T14:38:54.327 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:38:54.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-23T14:38:54.397 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-23T14:38:54.397 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:38:54.397 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-23T14:38:54.496 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-23T14:38:54.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T14:38:54.627 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:54.651 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:54 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4050873565' entity='client.admin' 2024-04-23T14:38:54.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T14:38:54.796 INFO:teuthology.orchestra.run.smithi137.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:54.832 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T14:38:54.955 INFO:teuthology.orchestra.run.smithi186.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBB+F7x7AqfqMA1jNieEzl05Nb4Qma8//O4DOeH1cOPP0MIATL3AHtqeOL+vstaMM6JP4rqBm05izBq6n811nvKf/ESuets/LhiSvA13psQFXZhyT/ZJYfAJWmJHGSjww65+SalB7XT7tpQVotzPuuyUWyrCRiOirFrM8km/Y62hC8YPPdLHL4Fcj8woCjZLjznPsJI+gU7ZA2k+vNcuNgFsBDnd8UlSRmNkmb3HnTy3mF/23TrnKF2QdMuXgNlMcbYLT9u/vlNT5r4m/kerVbLyqUn3nrgMZIdfDLgNDVVz0KsvWPh5tDEJhLHeY+FaAZRBey+0RDaPyQx89grrBwMvhDtW7M6sLvr/62WeJrun/sd8iFpqyZL5WvpwAHTAP+a8fRvD3rsoGKZlqMo5UkseYTYmisj1iSi8H9o/sexgSSuiDDQ1NmRAJo61AbsI4qEvSaax1pas1WDkuwf64ChuJFC7iNt1Q3FIrBxvIyfZ882nKpHPOCLC3kEgpfPs= ceph-7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:55.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-23T14:38:55.441 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.047+0000 7f01d4000700 1 -- 172.21.15.7:0/4060233762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 msgr2=0x7f01cc104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.047+0000 7f01d4000700 1 --2- 172.21.15.7:0/4060233762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc104bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009910 tx=0x7f01c0009c20 comp rx=0 tx=0).stop 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.048+0000 7f01d4000700 1 -- 172.21.15.7:0/4060233762 shutdown_connections 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.048+0000 7f01d4000700 1 --2- 172.21.15.7:0/4060233762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc104bc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.048+0000 7f01d4000700 1 -- 172.21.15.7:0/4060233762 >> 172.21.15.7:0/4060233762 conn(0x7f01cc0ffd20 msgr2=0x7f01cc102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.048+0000 7f01d4000700 1 -- 172.21.15.7:0/4060233762 shutdown_connections 2024-04-23T14:38:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.048+0000 7f01d4000700 1 -- 172.21.15.7:0/4060233762 wait complete. 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.049+0000 7f01d4000700 1 Processor -- start 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.049+0000 7f01d4000700 1 -- start start 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.050+0000 7f01d4000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.050+0000 7f01d4000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc10a6e0 con 0x7f01cc1047a0 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.050+0000 7f01d1600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.050+0000 7f01d1600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45076/0 (socket says 172.21.15.7:45076) 2024-04-23T14:38:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.050+0000 7f01d1600700 1 -- 172.21.15.7:0/1649094291 learned_addr learned my addr 172.21.15.7:0/1649094291 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:38:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.050+0000 7f01d1600700 1 -- 172.21.15.7:0/1649094291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc19a2f0 con 0x7f01cc1047a0 2024-04-23T14:38:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.051+0000 7f01d1600700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc199db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01c0005950 tx=0x7f01c0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.051+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c0026070 con 0x7f01cc1047a0 2024-04-23T14:38:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.051+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01c000bc00 con 0x7f01cc1047a0 2024-04-23T14:38:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.051+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc19a580 con 0x7f01cc1047a0 2024-04-23T14:38:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.051+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c00039a0 con 0x7f01cc1047a0 2024-04-23T14:38:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.051+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc19d270 con 0x7f01cc1047a0 2024-04-23T14:38:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.052+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f01c0029070 con 0x7f01cc1047a0 2024-04-23T14:38:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.052+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc10ae60 con 0x7f01cc1047a0 2024-04-23T14:38:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.053+0000 7f01ca000700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01b40396b0 0x7f01b403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.053+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f01c001e070 con 0x7f01cc1047a0 2024-04-23T14:38:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.053+0000 7f01d0c00700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01b40396b0 0x7f01b403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.054+0000 7f01d0c00700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01b40396b0 0x7f01b403bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f01b8006fd0 tx=0x7f01b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.059+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f01c0013070 con 0x7f01cc1047a0 2024-04-23T14:38:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.290+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f01cc02e0f0 con 0x7f01cc1047a0 2024-04-23T14:38:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.295+0000 7f01ca000700 1 -- 172.21.15.7:0/1649094291 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f01c00300c0 con 0x7f01cc1047a0 2024-04-23T14:38:58.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.298+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01b40396b0 msgr2=0x7f01b403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:58.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.298+0000 7f01d4000700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01b40396b0 0x7f01b403bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f01b8006fd0 tx=0x7f01b8006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:58.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.298+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 msgr2=0x7f01cc199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:58.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.298+0000 7f01d4000700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc199db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01c0005950 tx=0x7f01c0004fa0 comp rx=0 tx=0).stop 2024-04-23T14:38:58.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.299+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 shutdown_connections 2024-04-23T14:38:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.299+0000 7f01d4000700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01b40396b0 0x7f01b403bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.299+0000 7f01d4000700 1 --2- 172.21.15.7:0/1649094291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01cc1047a0 0x7f01cc199db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.299+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 >> 172.21.15.7:0/1649094291 conn(0x7f01cc0ffd20 msgr2=0x7f01cc1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.299+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 shutdown_connections 2024-04-23T14:38:58.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:38:58.299+0000 7f01d4000700 1 -- 172.21.15.7:0/1649094291 wait complete. 2024-04-23T14:38:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1649094291' entity='client.admin' 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:38:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:38:59.115 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-23T14:38:59.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-23T14:38:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 -- 172.21.15.7:0/2449656942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 msgr2=0x7f35481011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 --2- 172.21.15.7:0/2449656942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f35481011f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3538009910 tx=0x7f3538009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 -- 172.21.15.7:0/2449656942 shutdown_connections 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 --2- 172.21.15.7:0/2449656942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f35481011f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 -- 172.21.15.7:0/2449656942 >> 172.21.15.7:0/2449656942 conn(0x7f35480fc9f0 msgr2=0x7f35480fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 -- 172.21.15.7:0/2449656942 shutdown_connections 2024-04-23T14:39:01.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.557+0000 7f354e600700 1 -- 172.21.15.7:0/2449656942 wait complete. 2024-04-23T14:39:01.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.558+0000 7f354e600700 1 Processor -- start 2024-04-23T14:39:01.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.558+0000 7f354e600700 1 -- start start 2024-04-23T14:39:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.559+0000 7f354e600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f3548199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.559+0000 7f354e600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f354810a680 con 0x7f3548100dd0 2024-04-23T14:39:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.559+0000 7f3547400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f3548199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.559+0000 7f3547400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f3548199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45100/0 (socket says 172.21.15.7:45100) 2024-04-23T14:39:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.559+0000 7f3547400700 1 -- 172.21.15.7:0/748903386 learned_addr learned my addr 172.21.15.7:0/748903386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:39:01.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.559+0000 7f3547400700 1 -- 172.21.15.7:0/748903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354819a2e0 con 0x7f3548100dd0 2024-04-23T14:39:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.560+0000 7f3547400700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f3548199da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3538005190 tx=0x7f3538004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.560+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3538027070 con 0x7f3548100dd0 2024-04-23T14:39:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.560+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3538022470 con 0x7f3548100dd0 2024-04-23T14:39:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.560+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354819a570 con 0x7f3548100dd0 2024-04-23T14:39:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.560+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353800f5f0 con 0x7f3548100dd0 2024-04-23T14:39:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.560+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354819d220 con 0x7f3548100dd0 2024-04-23T14:39:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.561+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f353802a070 con 0x7f3548100dd0 2024-04-23T14:39:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.561+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354810ae00 con 0x7f3548100dd0 2024-04-23T14:39:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.562+0000 7f353fe00700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f352c0396b0 0x7f352c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.562+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f353801e030 con 0x7f3548100dd0 2024-04-23T14:39:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.562+0000 7f3546a00700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f352c0396b0 0x7f352c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.563+0000 7f3546a00700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f352c0396b0 0x7f352c03bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3534006fd0 tx=0x7f3534006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.568+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3538013070 con 0x7f3548100dd0 2024-04-23T14:39:01.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.800+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f354802e180 con 0x7f352c0396b0 2024-04-23T14:39:01.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.808+0000 7f353fe00700 1 -- 172.21.15.7:0/748903386 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f354802e180 con 0x7f352c0396b0 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f352c0396b0 msgr2=0x7f352c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f352c0396b0 0x7f352c03bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3534006fd0 tx=0x7f3534006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 msgr2=0x7f3548199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f3548199da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3538005190 tx=0x7f3538004f80 comp rx=0 tx=0).stop 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 shutdown_connections 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f352c0396b0 0x7f352c03bb70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 --2- 172.21.15.7:0/748903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3548100dd0 0x7f3548199da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 >> 172.21.15.7:0/748903386 conn(0x7f35480fc9f0 msgr2=0x7f35480fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 shutdown_connections 2024-04-23T14:39:01.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:01.811+0000 7f354e600700 1 -- 172.21.15.7:0/748903386 wait complete. 2024-04-23T14:39:02.614 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi137 2024-04-23T14:39:02.614 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:39:02.615 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.conf 2024-04-23T14:39:02.673 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:39:02.673 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:02.768 INFO:tasks.cephadm:Adding host smithi137 to orchestrator... 2024-04-23T14:39:02.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch host add smithi137 2024-04-23T14:39:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:02 smithi007 ceph-mon[27906]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:39:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:02 smithi007 ceph-mon[27906]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:39:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:39:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:03 smithi007 ceph-mon[27906]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:03 smithi007 ceph-mon[27906]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:04 smithi007 ceph-mon[27906]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:04 smithi007 ceph-mon[27906]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 -- 172.21.15.7:0/3707940113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 msgr2=0x7f2ae4103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 --2- 172.21.15.7:0/3707940113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4103900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009910 tx=0x7f2ad4009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 -- 172.21.15.7:0/3707940113 shutdown_connections 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 --2- 172.21.15.7:0/3707940113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4103900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 -- 172.21.15.7:0/3707940113 >> 172.21.15.7:0/3707940113 conn(0x7f2ae40fcd50 msgr2=0x7f2ae40ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 -- 172.21.15.7:0/3707940113 shutdown_connections 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.534+0000 7f2aea000700 1 -- 172.21.15.7:0/3707940113 wait complete. 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.535+0000 7f2aea000700 1 Processor -- start 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.535+0000 7f2aea000700 1 -- start start 2024-04-23T14:39:05.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.536+0000 7f2aea000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.536+0000 7f2aea000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae410c890 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.536+0000 7f2ae8c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.536+0000 7f2ae8c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4101180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53984/0 (socket says 172.21.15.7:53984) 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.536+0000 7f2ae8c00700 1 -- 172.21.15.7:0/1920870139 learned_addr learned my addr 172.21.15.7:0/1920870139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.536+0000 7f2ae8c00700 1 -- 172.21.15.7:0/1920870139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae4103070 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.537+0000 7f2ae8c00700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4101180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4006010 tx=0x7f2ad4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.537+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad4026070 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.537+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ad400bc00 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.537+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad4003910 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.537+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae41016c0 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.537+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae4101b80 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.538+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae406b060 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.538+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f2ad4029070 con 0x7f2ae4103520 2024-04-23T14:39:05.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.539+0000 7f2ae2000700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2ac80396b0 0x7f2ac803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.539+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ad401e070 con 0x7f2ae4103520 2024-04-23T14:39:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.539+0000 7f2adbe00700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2ac80396b0 0x7f2ac803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.540+0000 7f2adbe00700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2ac80396b0 0x7f2ac803bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2acc006fd0 tx=0x7f2acc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:05.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.545+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2ad4013070 con 0x7f2ae4103520 2024-04-23T14:39:05.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:05.779+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi137", "target": ["mon-mgr", ""]}) -- 0x7f2ae41026b0 con 0x7f2ac80396b0 2024-04-23T14:39:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:05 smithi007 ceph-mon[27906]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:06 smithi007 ceph-mon[27906]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi137", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:07 smithi007 ceph-mon[27906]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:07 smithi007 ceph-mon[27906]: Deploying cephadm binary to smithi137 2024-04-23T14:39:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:09 smithi007 ceph-mon[27906]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:11.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.803+0000 7f2ae2000700 1 -- 172.21.15.7:0/1920870139 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2ae41026b0 con 0x7f2ac80396b0 2024-04-23T14:39:11.804 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi137' with addr '172.21.15.137' 2024-04-23T14:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2ac80396b0 msgr2=0x7f2ac803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2ac80396b0 0x7f2ac803bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2acc006fd0 tx=0x7f2acc006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 msgr2=0x7f2ae4101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4101180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4006010 tx=0x7f2ad4005780 comp rx=0 tx=0).stop 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 shutdown_connections 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2ac80396b0 0x7f2ac803bb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 --2- 172.21.15.7:0/1920870139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ae4103520 0x7f2ae4101180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 >> 172.21.15.7:0/1920870139 conn(0x7f2ae40fcd50 msgr2=0x7f2ae41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 shutdown_connections 2024-04-23T14:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:11.808+0000 7f2aea000700 1 -- 172.21.15.7:0/1920870139 wait complete. 2024-04-23T14:39:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:11 smithi007 ceph-mon[27906]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:12.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-23T14:39:13.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:12 smithi007 ceph-mon[27906]: Added host smithi137 2024-04-23T14:39:13.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:12 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:39:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:13 smithi007 ceph-mon[27906]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.117+0000 7f158f000700 1 -- 172.21.15.7:0/3016707944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 msgr2=0x7f1588107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.117+0000 7f158f000700 1 --2- 172.21.15.7:0/3016707944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f1588107860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1578009910 tx=0x7f1578009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.118+0000 7f158f000700 1 -- 172.21.15.7:0/3016707944 shutdown_connections 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.118+0000 7f158f000700 1 --2- 172.21.15.7:0/3016707944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f1588107860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.118+0000 7f158f000700 1 -- 172.21.15.7:0/3016707944 >> 172.21.15.7:0/3016707944 conn(0x7f1588076f50 msgr2=0x7f1588077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.118+0000 7f158f000700 1 -- 172.21.15.7:0/3016707944 shutdown_connections 2024-04-23T14:39:15.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.118+0000 7f158f000700 1 -- 172.21.15.7:0/3016707944 wait complete. 2024-04-23T14:39:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.119+0000 7f158f000700 1 Processor -- start 2024-04-23T14:39:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.119+0000 7f158f000700 1 -- start start 2024-04-23T14:39:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.120+0000 7f158f000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f15880fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.120+0000 7f158f000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f158810b8e0 con 0x7f1588107480 2024-04-23T14:39:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.120+0000 7f1587e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f15880fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:15.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.120+0000 7f1587e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f15880fe4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60550/0 (socket says 172.21.15.7:60550) 2024-04-23T14:39:15.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.120+0000 7f1587e00700 1 -- 172.21.15.7:0/3613737615 learned_addr learned my addr 172.21.15.7:0/3613737615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:39:15.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.120+0000 7f1587e00700 1 -- 172.21.15.7:0/3613737615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15881003e0 con 0x7f1588107480 2024-04-23T14:39:15.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.121+0000 7f1587e00700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f15880fe4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f15780056d0 tx=0x7f15780057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.121+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1578026070 con 0x7f1588107480 2024-04-23T14:39:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.121+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f157800bc00 con 0x7f1588107480 2024-04-23T14:39:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.121+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15880fea90 con 0x7f1588107480 2024-04-23T14:39:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.121+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15780039b0 con 0x7f1588107480 2024-04-23T14:39:15.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.121+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15880fef50 con 0x7f1588107480 2024-04-23T14:39:15.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.122+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f1578029070 con 0x7f1588107480 2024-04-23T14:39:15.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.122+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1588102b30 con 0x7f1588107480 2024-04-23T14:39:15.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.123+0000 7f1584c00700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f156c0396b0 0x7f156c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:15.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.123+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f157801e070 con 0x7f1588107480 2024-04-23T14:39:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.123+0000 7f1587400700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f156c0396b0 0x7f156c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:15.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.124+0000 7f1587400700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f156c0396b0 0x7f156c03bb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1574006fd0 tx=0x7f1574006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:15.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.129+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1578013070 con 0x7f1588107480 2024-04-23T14:39:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.368+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15880ffa20 con 0x7f156c0396b0 2024-04-23T14:39:15.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.370+0000 7f1584c00700 1 -- 172.21.15.7:0/3613737615 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f15880ffa20 con 0x7f156c0396b0 2024-04-23T14:39:15.370 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:39:15.370 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}] 2024-04-23T14:39:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.373+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f156c0396b0 msgr2=0x7f156c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.373+0000 7f158f000700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f156c0396b0 0x7f156c03bb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1574006fd0 tx=0x7f1574006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.373+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 msgr2=0x7f15880fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.373+0000 7f158f000700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f15880fe4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f15780056d0 tx=0x7f15780057b0 comp rx=0 tx=0).stop 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.374+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 shutdown_connections 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.374+0000 7f158f000700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f156c0396b0 0x7f156c03bb70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.374+0000 7f158f000700 1 --2- 172.21.15.7:0/3613737615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1588107480 0x7f15880fe4f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.374+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 >> 172.21.15.7:0/3613737615 conn(0x7f1588076f50 msgr2=0x7f1588069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.374+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 shutdown_connections 2024-04-23T14:39:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:15.374+0000 7f158f000700 1 -- 172.21.15.7:0/3613737615 wait complete. 2024-04-23T14:39:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:15 smithi007 ceph-mon[27906]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:16.172 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi186 2024-04-23T14:39:16.172 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:39:16.172 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.conf 2024-04-23T14:39:16.226 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:39:16.227 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:16.323 INFO:tasks.cephadm:Adding host smithi186 to orchestrator... 2024-04-23T14:39:16.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch host add smithi186 2024-04-23T14:39:16.776 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:39:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:16 smithi007 ceph-mon[27906]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:39:17.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:17 smithi007 ceph-mon[27906]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:18.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1643135819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 msgr2=0x7fb6f410dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:18.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 --2- 172.21.15.7:0/1643135819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f410dc30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009910 tx=0x7fb6e8009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:18.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1643135819 shutdown_connections 2024-04-23T14:39:18.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 --2- 172.21.15.7:0/1643135819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f410dc30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:18.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1643135819 >> 172.21.15.7:0/1643135819 conn(0x7fb6f4078100 msgr2=0x7fb6f407a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:18.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1643135819 shutdown_connections 2024-04-23T14:39:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.845+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1643135819 wait complete. 2024-04-23T14:39:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.847+0000 7fb6f9e00700 1 Processor -- start 2024-04-23T14:39:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.847+0000 7fb6f9e00700 1 -- start start 2024-04-23T14:39:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.848+0000 7fb6f9e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f419e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.848+0000 7fb6f9e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f4112e50 con 0x7fb6f410d850 2024-04-23T14:39:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.848+0000 7fb6f8a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f419e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.848+0000 7fb6f8a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f419e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60566/0 (socket says 172.21.15.7:60566) 2024-04-23T14:39:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.848+0000 7fb6f8a00700 1 -- 172.21.15.7:0/1366782170 learned_addr learned my addr 172.21.15.7:0/1366782170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:39:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.849+0000 7fb6f8a00700 1 -- 172.21.15.7:0/1366782170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f419e870 con 0x7fb6f410d850 2024-04-23T14:39:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.849+0000 7fb6f8a00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f419e330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006010 tx=0x7fb6e8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.850+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e8026070 con 0x7fb6f410d850 2024-04-23T14:39:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.850+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6e800bba0 con 0x7fb6f410d850 2024-04-23T14:39:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.850+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f419eb60 con 0x7fb6f410d850 2024-04-23T14:39:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.850+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e8003910 con 0x7fb6f410d850 2024-04-23T14:39:18.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.850+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f41a2c00 con 0x7fb6f410d850 2024-04-23T14:39:18.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.852+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f410a070 con 0x7fb6f410d850 2024-04-23T14:39:18.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.852+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7fb6e8029070 con 0x7fb6f410d850 2024-04-23T14:39:18.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.852+0000 7fb6f1600700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb6dc0396b0 0x7fb6dc03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.852+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb6e801e070 con 0x7fb6f410d850 2024-04-23T14:39:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.853+0000 7fb6f3e00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb6dc0396b0 0x7fb6dc03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.853+0000 7fb6f3e00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb6dc0396b0 0x7fb6dc03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0006fd0 tx=0x7fb6e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:18.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:18.858+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6e8013070 con 0x7fb6f410d850 2024-04-23T14:39:19.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:19.095+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}) -- 0x7fb6f419f690 con 0x7fb6dc0396b0 2024-04-23T14:39:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:19 smithi007 ceph-mon[27906]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:20 smithi007 ceph-mon[27906]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:22.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:22.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: Deploying cephadm binary to smithi186 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:39:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:21 smithi007 ceph-mon[27906]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:39:24.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:23 smithi007 ceph-mon[27906]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.402+0000 7fb6f1600700 1 -- 172.21.15.7:0/1366782170 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb6f419f690 con 0x7fb6dc0396b0 2024-04-23T14:39:25.403 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi186' with addr '172.21.15.186' 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb6dc0396b0 msgr2=0x7fb6dc03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb6dc0396b0 0x7fb6dc03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0006fd0 tx=0x7fb6e0006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 msgr2=0x7fb6f419e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f419e330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006010 tx=0x7fb6e8005780 comp rx=0 tx=0).stop 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 shutdown_connections 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb6dc0396b0 0x7fb6dc03bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 --2- 172.21.15.7:0/1366782170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6f410d850 0x7fb6f419e330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:25.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.406+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 >> 172.21.15.7:0/1366782170 conn(0x7fb6f4078100 msgr2=0x7fb6f4078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.407+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 shutdown_connections 2024-04-23T14:39:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:25.407+0000 7fb6f9e00700 1 -- 172.21.15.7:0/1366782170 wait complete. 2024-04-23T14:39:26.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:25 smithi007 ceph-mon[27906]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:26.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:25 smithi007 ceph-mon[27906]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:26.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:26.160 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-23T14:39:26.613 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:39:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:26 smithi007 ceph-mon[27906]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:26 smithi007 ceph-mon[27906]: Added host smithi186 2024-04-23T14:39:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:26 smithi007 ceph-mon[27906]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:27.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:27 smithi007 ceph-mon[27906]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:27.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.786+0000 7fc1cba00700 1 -- 172.21.15.7:0/749315904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 msgr2=0x7fc1c4077400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.787+0000 7fc1cba00700 1 --2- 172.21.15.7:0/749315904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c4077400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009910 tx=0x7fc1b8009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.787+0000 7fc1cba00700 1 -- 172.21.15.7:0/749315904 shutdown_connections 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.787+0000 7fc1cba00700 1 --2- 172.21.15.7:0/749315904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c4077400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.787+0000 7fc1cba00700 1 -- 172.21.15.7:0/749315904 >> 172.21.15.7:0/749315904 conn(0x7fc1c4100200 msgr2=0x7fc1c4102620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.787+0000 7fc1cba00700 1 -- 172.21.15.7:0/749315904 shutdown_connections 2024-04-23T14:39:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.787+0000 7fc1cba00700 1 -- 172.21.15.7:0/749315904 wait complete. 2024-04-23T14:39:28.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.788+0000 7fc1cba00700 1 Processor -- start 2024-04-23T14:39:28.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.788+0000 7fc1cba00700 1 -- start start 2024-04-23T14:39:28.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.789+0000 7fc1cba00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c419e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:28.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.789+0000 7fc1cba00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4113030 con 0x7fc1c4077020 2024-04-23T14:39:28.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.789+0000 7fc1c9000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c419e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:28.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.789+0000 7fc1c9000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c419e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52574/0 (socket says 172.21.15.7:52574) 2024-04-23T14:39:28.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.789+0000 7fc1c9000700 1 -- 172.21.15.7:0/1195229147 learned_addr learned my addr 172.21.15.7:0/1195229147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:39:28.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.789+0000 7fc1c9000700 1 -- 172.21.15.7:0/1195229147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c419eaa0 con 0x7fc1c4077020 2024-04-23T14:39:28.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.790+0000 7fc1c9000700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c419e560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8006010 tx=0x7fc1b8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:28.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.790+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1b8026070 con 0x7fc1c4077020 2024-04-23T14:39:28.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.790+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1b800bc00 con 0x7fc1c4077020 2024-04-23T14:39:28.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.790+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c419ed30 con 0x7fc1c4077020 2024-04-23T14:39:28.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.790+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1b8003930 con 0x7fc1c4077020 2024-04-23T14:39:28.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.790+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c419f190 con 0x7fc1c4077020 2024-04-23T14:39:28.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.791+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c4078760 con 0x7fc1c4077020 2024-04-23T14:39:28.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.792+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7fc1b8029070 con 0x7fc1c4077020 2024-04-23T14:39:28.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.792+0000 7fc1c1600700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc1ac039650 0x7fc1ac03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:28.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.792+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc1b801e070 con 0x7fc1c4077020 2024-04-23T14:39:28.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.792+0000 7fc1c3e00700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc1ac039650 0x7fc1ac03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:28.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.793+0000 7fc1c3e00700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc1ac039650 0x7fc1ac03bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0006fd0 tx=0x7fc1b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:28.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:28.798+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc1b8013070 con 0x7fc1c4077020 2024-04-23T14:39:29.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.038+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1c419f8c0 con 0x7fc1ac039650 2024-04-23T14:39:29.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.040+0000 7fc1c1600700 1 -- 172.21.15.7:0/1195229147 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fc1c419f8c0 con 0x7fc1ac039650 2024-04-23T14:39:29.041 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:39:29.041 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}] 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.043+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc1ac039650 msgr2=0x7fc1ac03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.043+0000 7fc1cba00700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc1ac039650 0x7fc1ac03bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0006fd0 tx=0x7fc1b0006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.043+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 msgr2=0x7fc1c419e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.043+0000 7fc1cba00700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c419e560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8006010 tx=0x7fc1b8005780 comp rx=0 tx=0).stop 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.044+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 shutdown_connections 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.044+0000 7fc1cba00700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc1ac039650 0x7fc1ac03bb10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.044+0000 7fc1cba00700 1 --2- 172.21.15.7:0/1195229147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1c4077020 0x7fc1c419e560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.044+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 >> 172.21.15.7:0/1195229147 conn(0x7fc1c4100200 msgr2=0x7fc1c41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.044+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 shutdown_connections 2024-04-23T14:39:29.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:29.044+0000 7fc1cba00700 1 -- 172.21.15.7:0/1195229147 wait complete. 2024-04-23T14:39:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:29.801 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-23T14:39:29.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-23T14:39:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:29 smithi007 ceph-mon[27906]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:39:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:30 smithi007 ceph-mon[27906]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:39:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 -- 172.21.15.7:0/1418075587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 msgr2=0x7f73b8108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 --2- 172.21.15.7:0/1418075587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b8108960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009910 tx=0x7f73a8009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 -- 172.21.15.7:0/1418075587 shutdown_connections 2024-04-23T14:39:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 --2- 172.21.15.7:0/1418075587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b8108960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 -- 172.21.15.7:0/1418075587 >> 172.21.15.7:0/1418075587 conn(0x7f73b8076f50 msgr2=0x7f73b8077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 -- 172.21.15.7:0/1418075587 shutdown_connections 2024-04-23T14:39:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.168+0000 7f73bde00700 1 -- 172.21.15.7:0/1418075587 wait complete. 2024-04-23T14:39:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.170+0000 7f73bde00700 1 Processor -- start 2024-04-23T14:39:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.170+0000 7f73bde00700 1 -- start start 2024-04-23T14:39:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.170+0000 7f73bde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.170+0000 7f73bde00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73b810c970 con 0x7f73b8108580 2024-04-23T14:39:32.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.171+0000 7f73b6a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:32.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.171+0000 7f73b6a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52588/0 (socket says 172.21.15.7:52588) 2024-04-23T14:39:32.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.171+0000 7f73b6a00700 1 -- 172.21.15.7:0/2220539457 learned_addr learned my addr 172.21.15.7:0/2220539457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:39:32.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.171+0000 7f73b6a00700 1 -- 172.21.15.7:0/2220539457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b819a5e0 con 0x7f73b8108580 2024-04-23T14:39:32.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.172+0000 7f73b6a00700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b819a0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73a8006010 tx=0x7f73a8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:32.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.172+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a8026070 con 0x7f73b8108580 2024-04-23T14:39:32.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.172+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73a800bc00 con 0x7f73b8108580 2024-04-23T14:39:32.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.172+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a8003930 con 0x7f73b8108580 2024-04-23T14:39:32.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.172+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b819a8d0 con 0x7f73b8108580 2024-04-23T14:39:32.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.172+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b819e970 con 0x7f73b8108580 2024-04-23T14:39:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.174+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b8103c40 con 0x7f73b8108580 2024-04-23T14:39:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.174+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f73a8029070 con 0x7f73b8108580 2024-04-23T14:39:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.174+0000 7f73bca00700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f739c0396b0 0x7f739c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.174+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f73a801e070 con 0x7f73b8108580 2024-04-23T14:39:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.175+0000 7f73b6000700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f739c0396b0 0x7f739c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.175+0000 7f73b6000700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f739c0396b0 0x7f739c03bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f73a4006fd0 tx=0x7f73a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:32.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.180+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f73a8013070 con 0x7f73b8108580 2024-04-23T14:39:32.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:31 smithi007 ceph-mon[27906]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:32.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.425+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f73b8064150 con 0x7f73b8108580 2024-04-23T14:39:32.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.953+0000 7f73bca00700 1 -- 172.21.15.7:0/2220539457 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f73a800fe20 con 0x7f73b8108580 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f739c0396b0 msgr2=0x7f739c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f739c0396b0 0x7f739c03bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f73a4006fd0 tx=0x7f73a4006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 msgr2=0x7f73b819a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b819a0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73a8006010 tx=0x7f73a8005780 comp rx=0 tx=0).stop 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 shutdown_connections 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f739c0396b0 0x7f739c03bb70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 --2- 172.21.15.7:0/2220539457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73b8108580 0x7f73b819a0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.958+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 >> 172.21.15.7:0/2220539457 conn(0x7f73b8076f50 msgr2=0x7f73b8104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.959+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 shutdown_connections 2024-04-23T14:39:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:39:32.959+0000 7f73bde00700 1 -- 172.21.15.7:0/2220539457 wait complete. 2024-04-23T14:39:32.962 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-04-23T14:39:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:32 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2220539457' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-23T14:39:33.730 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-04-23T14:39:33.731 INFO:tasks.cephadm:Adding mon.b on smithi137 2024-04-23T14:39:33.731 INFO:tasks.cephadm:Adding mon.c on smithi186 2024-04-23T14:39:33.731 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c' 2024-04-23T14:39:34.153 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:34.265 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:34.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:33 smithi007 ceph-mon[27906]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:34.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:33 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2220539457' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-23T14:39:34.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:33 smithi007 ceph-mon[27906]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:39:36.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:39:36.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 -- 172.21.15.186:0/3554923029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 msgr2=0x7f53e8103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:36.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 --2- 172.21.15.186:0/3554923029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e8103200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009910 tx=0x7f53dc009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:36.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 -- 172.21.15.186:0/3554923029 shutdown_connections 2024-04-23T14:39:36.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 --2- 172.21.15.186:0/3554923029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e8103200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:36.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 -- 172.21.15.186:0/3554923029 >> 172.21.15.186:0/3554923029 conn(0x7f53e80fc9f0 msgr2=0x7f53e80fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 -- 172.21.15.186:0/3554923029 shutdown_connections 2024-04-23T14:39:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.971+0000 7f53efc00700 1 -- 172.21.15.186:0/3554923029 wait complete. 2024-04-23T14:39:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.973+0000 7f53efc00700 1 Processor -- start 2024-04-23T14:39:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.973+0000 7f53efc00700 1 -- start start 2024-04-23T14:39:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.973+0000 7f53efc00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.974+0000 7f53efc00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53e8106340 con 0x7f53e8100dd0 2024-04-23T14:39:36.974 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.974+0000 7f53ed200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:36.974 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.974+0000 7f53ed200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e819e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.186:54878/0 (socket says 172.21.15.186:54878) 2024-04-23T14:39:36.974 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.974+0000 7f53ed200700 1 -- 172.21.15.186:0/798882421 learned_addr learned my addr 172.21.15.186:0/798882421 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:39:36.975 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.975+0000 7f53ed200700 1 -- 172.21.15.186:0/798882421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e819e660 con 0x7f53e8100dd0 2024-04-23T14:39:36.975 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.975+0000 7f53ed200700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e819e120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005190 tx=0x7f53dc004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:36.976 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.976+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc027070 con 0x7f53e8100dd0 2024-04-23T14:39:36.976 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.976+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e819e8f0 con 0x7f53e8100dd0 2024-04-23T14:39:36.976 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.976+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53dc022470 con 0x7f53e8100dd0 2024-04-23T14:39:36.977 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.976+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc00f5f0 con 0x7f53e8100dd0 2024-04-23T14:39:36.977 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.976+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e81a15e0 con 0x7f53e8100dd0 2024-04-23T14:39:36.977 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.977+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e8106ac0 con 0x7f53e8100dd0 2024-04-23T14:39:36.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.978+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f53dc02a070 con 0x7f53e8100dd0 2024-04-23T14:39:36.979 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.979+0000 7f53e5600700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f53d0039700 0x7f53d003bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:36.979 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.979+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f53dc01e030 con 0x7f53e8100dd0 2024-04-23T14:39:36.979 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.979+0000 7f53e7e00700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f53d0039700 0x7f53d003bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:36.981 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.981+0000 7f53e7e00700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f53d0039700 0x7f53d003bbc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:36.996 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:36.996+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53dc013070 con 0x7f53e8100dd0 2024-04-23T14:39:37.238 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.238+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}) -- 0x7f53e802e270 con 0x7f53d0039700 2024-04-23T14:39:37.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.256+0000 7f53e5600700 1 -- 172.21.15.186:0/798882421 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f53e802e270 con 0x7f53d0039700 2024-04-23T14:39:37.257 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mon update... 2024-04-23T14:39:37.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f53d0039700 msgr2=0x7f53d003bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:37.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f53d0039700 0x7f53d003bbc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d4006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:37.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 msgr2=0x7f53e819e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:37.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e819e120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005190 tx=0x7f53dc004f80 comp rx=0 tx=0).stop 2024-04-23T14:39:37.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 shutdown_connections 2024-04-23T14:39:37.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f53d0039700 0x7f53d003bbc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:37.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 --2- 172.21.15.186:0/798882421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53e8100dd0 0x7f53e819e120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:37.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 >> 172.21.15.186:0/798882421 conn(0x7f53e80fc9f0 msgr2=0x7f53e80fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:37.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 shutdown_connections 2024-04-23T14:39:37.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:37.259+0000 7f53efc00700 1 -- 172.21.15.186:0/798882421 wait complete. 2024-04-23T14:39:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:36 smithi007 ceph-mon[27906]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:39:37.985 DEBUG:teuthology.orchestra.run.smithi137:mon.b> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.b.service 2024-04-23T14:39:37.993 DEBUG:teuthology.orchestra.run.smithi186:mon.c> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.c.service 2024-04-23T14:39:37.998 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T14:39:37.998 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:38.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:37 smithi007 ceph-mon[27906]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:38.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:37 smithi007 ceph-mon[27906]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:38.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:38.422 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c;count:3 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:39:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:40.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:39 smithi007 ceph-mon[27906]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:40.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:39 smithi007 ceph-mon[27906]: Deploying daemon mon.c on smithi186 2024-04-23T14:39:40.877 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.876+0000 7ffb80000700 1 -- 172.21.15.186:0/744702945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 msgr2=0x7ffb78075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:40.877 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.876+0000 7ffb80000700 1 --2- 172.21.15.186:0/744702945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb78075270 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009910 tx=0x7ffb6c009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:40.877 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.876+0000 7ffb80000700 1 -- 172.21.15.186:0/744702945 shutdown_connections 2024-04-23T14:39:40.877 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.876+0000 7ffb80000700 1 --2- 172.21.15.186:0/744702945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb78075270 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:40.878 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.876+0000 7ffb80000700 1 -- 172.21.15.186:0/744702945 >> 172.21.15.186:0/744702945 conn(0x7ffb780fe030 msgr2=0x7ffb78100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:40.878 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.877+0000 7ffb80000700 1 -- 172.21.15.186:0/744702945 shutdown_connections 2024-04-23T14:39:40.878 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.877+0000 7ffb80000700 1 -- 172.21.15.186:0/744702945 wait complete. 2024-04-23T14:39:40.878 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.878+0000 7ffb80000700 1 Processor -- start 2024-04-23T14:39:40.878 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.878+0000 7ffb80000700 1 -- start start 2024-04-23T14:39:40.878 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.879+0000 7ffb80000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb7819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:40.879 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.879+0000 7ffb80000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78113050 con 0x7ffb78074e90 2024-04-23T14:39:40.879 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.879+0000 7ffb7d600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb7819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:40.879 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.879+0000 7ffb7d600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb7819e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.186:32782/0 (socket says 172.21.15.186:32782) 2024-04-23T14:39:40.879 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.879+0000 7ffb7d600700 1 -- 172.21.15.186:0/4119493195 learned_addr learned my addr 172.21.15.186:0/4119493195 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:39:40.880 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.880+0000 7ffb7d600700 1 -- 172.21.15.186:0/4119493195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7819ead0 con 0x7ffb78074e90 2024-04-23T14:39:40.880 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.880+0000 7ffb7d600700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb7819e590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c006010 tx=0x7ffb6c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:40.881 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.881+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6c026070 con 0x7ffb78074e90 2024-04-23T14:39:40.881 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.881+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7819ed60 con 0x7ffb78074e90 2024-04-23T14:39:40.881 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.881+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7819f1c0 con 0x7ffb78074e90 2024-04-23T14:39:40.881 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.881+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb6c00bc00 con 0x7ffb78074e90 2024-04-23T14:39:40.881 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.881+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6c0047d0 con 0x7ffb78074e90 2024-04-23T14:39:40.882 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.882+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb58005330 con 0x7ffb78074e90 2024-04-23T14:39:40.883 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.883+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7ffb6c029070 con 0x7ffb78074e90 2024-04-23T14:39:40.884 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.884+0000 7ffb76000700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ffb600396b0 0x7ffb6003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:40.884 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.884+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffb6c01e070 con 0x7ffb78074e90 2024-04-23T14:39:40.884 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.885+0000 7ffb7cc00700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ffb600396b0 0x7ffb6003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:40.886 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.886+0000 7ffb7cc00700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ffb600396b0 0x7ffb6003bb70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006fd0 tx=0x7ffb64006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:40.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:40.899+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffb6c013070 con 0x7ffb78074e90 2024-04-23T14:39:41.223 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.222+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ffb580058f0 con 0x7ffb78074e90 2024-04-23T14:39:41.224 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.223+0000 7ffb76000700 1 -- 172.21.15.186:0/4119493195 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7ffb6c02ac70 con 0x7ffb78074e90 2024-04-23T14:39:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:39:41.224 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":1,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:17.131882Z","created":"2024-04-23T14:37:17.131882Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:41.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ffb600396b0 msgr2=0x7ffb6003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:41.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ffb600396b0 0x7ffb6003bb70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006fd0 tx=0x7ffb64006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:41.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 msgr2=0x7ffb7819e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:41.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb7819e590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c006010 tx=0x7ffb6c005780 comp rx=0 tx=0).stop 2024-04-23T14:39:41.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 shutdown_connections 2024-04-23T14:39:41.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ffb600396b0 0x7ffb6003bb70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:41.228 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 --2- 172.21.15.186:0/4119493195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78074e90 0x7ffb7819e590 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:41.228 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 >> 172.21.15.186:0/4119493195 conn(0x7ffb780fe030 msgr2=0x7ffb78104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:41.228 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 shutdown_connections 2024-04-23T14:39:41.228 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:41.226+0000 7ffb80000700 1 -- 172.21.15.186:0/4119493195 wait complete. 2024-04-23T14:39:41.229 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 1 2024-04-23T14:39:42.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:41 smithi007 ceph-mon[27906]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:42.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:41 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/4119493195' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:43.937 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T14:39:43.938 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:44.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:43 smithi007 ceph-mon[27906]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:44.994 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.071+0000 7fa5cb800700 1 -- 172.21.15.186:0/2235891740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c41086a0 msgr2=0x7fa5a4005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.071+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2235891740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c41086a0 0x7fa5a4005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400fc90 tx=0x7fa5b400ffa0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.071+0000 7fa5cb800700 1 -- 172.21.15.186:0/2235891740 shutdown_connections 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.071+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2235891740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c41086a0 0x7fa5a4005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.071+0000 7fa5cb800700 1 -- 172.21.15.186:0/2235891740 >> 172.21.15.186:0/2235891740 conn(0x7fa5c40fe100 msgr2=0x7fa5c4100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.071+0000 7fa5cb800700 1 -- 172.21.15.186:0/2235891740 shutdown_connections 2024-04-23T14:39:50.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.072+0000 7fa5cb800700 1 -- 172.21.15.186:0/2235891740 wait complete. 2024-04-23T14:39:50.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.074+0000 7fa5cb800700 1 Processor -- start 2024-04-23T14:39:50.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.074+0000 7fa5cb800700 1 -- start start 2024-04-23T14:39:50.077 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.075+0000 7fa5cb800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 0x7fa5c419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:50.077 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.075+0000 7fa5cb800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 0x7fa5c419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:50.077 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.075+0000 7fa5cb800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c410a580 con 0x7fa5c419a740 2024-04-23T14:39:50.077 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.075+0000 7fa5cb800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c410a400 con 0x7fa5c41086a0 2024-04-23T14:39:50.078 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.076+0000 7fa5bbe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 0x7fa5c419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:50.078 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.076+0000 7fa5bbe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 0x7fa5c419ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.186:51840/0 (socket says 172.21.15.186:51840) 2024-04-23T14:39:50.078 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.076+0000 7fa5bbe00700 1 -- 172.21.15.186:0/2329381565 learned_addr learned my addr 172.21.15.186:0/2329381565 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:39:50.078 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.076+0000 7fa5c8e00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 0x7fa5c419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5c8e00700 1 -- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 msgr2=0x7fa5c419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5c8e00700 1 -- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 msgr2=0x7fa5c419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5c8e00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 0x7fa5c419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5c8e00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 0x7fa5c419a200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5bbe00700 1 -- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 msgr2=0x7fa5c419a200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5bbe00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 0x7fa5c419a200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.077+0000 7fa5bbe00700 1 -- 172.21.15.186:0/2329381565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c419ad80 con 0x7fa5c419a740 2024-04-23T14:39:50.079 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.078+0000 7fa5bbe00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 0x7fa5c419ead0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00b700 tx=0x7fa5ac00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:50.080 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.078+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa5ac011630 con 0x7fa5c419a740 2024-04-23T14:39:50.080 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.078+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c419f010 con 0x7fa5c419a740 2024-04-23T14:39:50.080 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.078+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5ac011c80 con 0x7fa5c419a740 2024-04-23T14:39:50.080 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.078+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa5ac010da0 con 0x7fa5c419a740 2024-04-23T14:39:50.080 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.079+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c419f5f0 con 0x7fa5c419a740 2024-04-23T14:39:50.081 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.080+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7fa5ac018020 con 0x7fa5c419a740 2024-04-23T14:39:50.081 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.080+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c419f900 con 0x7fa5c419a740 2024-04-23T14:39:50.082 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.081+0000 7fa5c2000700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa5a0039410 0x7fa5a003b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:50.082 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.081+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5ac04c3d0 con 0x7fa5c419a740 2024-04-23T14:39:50.083 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.082+0000 7fa5c8e00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa5a0039410 0x7fa5a003b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:50.084 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.083+0000 7fa5c8e00700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa5a0039410 0x7fa5a003b8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40059d0 tx=0x7fa5b4005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:50.098 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.097+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa5c419f900 con 0x7fa5c419a740 2024-04-23T14:39:50.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:50 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:50.423 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.422+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa5c419b560 con 0x7fa5c419a740 2024-04-23T14:39:50.425 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.424+0000 7fa5c2000700 1 -- 172.21.15.186:0/2329381565 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fa5ac01f020 con 0x7fa5c419a740 2024-04-23T14:39:50.425 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:39:50.425 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:39:45.031985Z","created":"2024-04-23T14:37:17.131882Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa5a0039410 msgr2=0x7fa5a003b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa5a0039410 0x7fa5a003b8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40059d0 tx=0x7fa5b4005940 comp rx=0 tx=0).stop 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 msgr2=0x7fa5c419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 0x7fa5c419ead0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00b700 tx=0x7fa5ac00bac0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 shutdown_connections 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa5a0039410 0x7fa5a003b8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5c41086a0 0x7fa5c419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 --2- 172.21.15.186:0/2329381565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa5c419a740 0x7fa5c419ead0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:50.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.426+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 >> 172.21.15.186:0/2329381565 conn(0x7fa5c40fe100 msgr2=0x7fa5c40ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:50.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.427+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 shutdown_connections 2024-04-23T14:39:50.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:50.427+0000 7fa5cb800700 1 -- 172.21.15.186:0/2329381565 wait complete. 2024-04-23T14:39:50.429 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2024-04-23T14:39:50.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:39:50.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: mon.a calling monitor election 2024-04-23T14:39:50.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:50.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: mon.c calling monitor election 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:50.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: monmap epoch 2 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: last_changed 2024-04-23T14:39:45.031985+0000 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: min_mon_release 19 (squid) 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: election_strategy: 1 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: 1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.c 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: fsmap 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: mgrmap e13: x(active, since 67s) 2024-04-23T14:39:50.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T14:39:50.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:50.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:39:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: Deploying daemon mon.b on smithi137 2024-04-23T14:39:51.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:51.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/2329381565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:51.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:39:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: Deploying daemon mon.b on smithi137 2024-04-23T14:39:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/2329381565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:52.049 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T14:39:52.050 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:52.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:39:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:39:52.039+0000 7f421e200700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-23T14:39:52.487 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:39:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:53 smithi007 ceph-mon[27906]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:53 smithi186 ceph-mon[31814]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 -- 172.21.15.186:0/2898355878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 msgr2=0x7f8134109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 --2- 172.21.15.186:0/2898355878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f8134109300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8128009910 tx=0x7f8128009c20 comp rx=0 tx=0).stop 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 -- 172.21.15.186:0/2898355878 shutdown_connections 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 --2- 172.21.15.186:0/2898355878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f8134109300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 -- 172.21.15.186:0/2898355878 >> 172.21.15.186:0/2898355878 conn(0x7f8134078470 msgr2=0x7f813407a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 -- 172.21.15.186:0/2898355878 shutdown_connections 2024-04-23T14:39:54.530 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.528+0000 7f813c200700 1 -- 172.21.15.186:0/2898355878 wait complete. 2024-04-23T14:39:54.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.529+0000 7f813c200700 1 Processor -- start 2024-04-23T14:39:54.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f813c200700 1 -- start start 2024-04-23T14:39:54.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f813c200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f81341a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:54.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f813c200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:54.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f813c200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8134113120 con 0x7f8134108f20 2024-04-23T14:39:54.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f813c200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8134112fa0 con 0x7f81341a4980 2024-04-23T14:39:54.532 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f8138e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:54.532 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.530+0000 7f8138e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:48360/0 (socket says 172.21.15.186:48360) 2024-04-23T14:39:54.532 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8138e00700 1 -- 172.21.15.186:0/1595196309 learned_addr learned my addr 172.21.15.186:0/1595196309 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8139800700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f81341a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8138e00700 1 -- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 msgr2=0x7f813419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8138e00700 1 -- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 msgr2=0x7f813419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8138e00700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8138e00700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8139800700 1 -- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 msgr2=0x7f813419e600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8139800700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:54.533 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.531+0000 7f8139800700 1 -- 172.21.15.186:0/1595196309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81341a4fc0 con 0x7f8134108f20 2024-04-23T14:39:54.534 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.532+0000 7f8139800700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f81341a4440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8128014000 tx=0x7f8128005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:54.534 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.532+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8128005dc0 con 0x7f8134108f20 2024-04-23T14:39:54.534 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.532+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813419eb40 con 0x7f8134108f20 2024-04-23T14:39:54.534 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.533+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813419f0d0 con 0x7f8134108f20 2024-04-23T14:39:54.534 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.533+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f812800b6f0 con 0x7f8134108f20 2024-04-23T14:39:54.534 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.533+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8128003860 con 0x7f8134108f20 2024-04-23T14:39:54.535 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.534+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813410a380 con 0x7f8134108f20 2024-04-23T14:39:54.535 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.534+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f8128029070 con 0x7f8134108f20 2024-04-23T14:39:54.536 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.535+0000 7f8132000700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f811c039440 0x7f811c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:54.536 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.535+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f812801e070 con 0x7f8134108f20 2024-04-23T14:39:54.536 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.535+0000 7f8138e00700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f811c039440 0x7f811c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:54.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.537+0000 7f8138e00700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f811c039440 0x7f811c03b900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8120009180 tx=0x7f8120008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:54.550 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.550+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8128013070 con 0x7f8134108f20 2024-04-23T14:39:54.860 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.859+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f813419f3b0 con 0x7f8134108f20 2024-04-23T14:39:54.861 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.860+0000 7f8132000700 1 -- 172.21.15.186:0/1595196309 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f812802b440 con 0x7f8134108f20 2024-04-23T14:39:54.862 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:39:54.862 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:39:45.031985Z","created":"2024-04-23T14:37:17.131882Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.863+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f811c039440 msgr2=0x7f811c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.863+0000 7f813c200700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f811c039440 0x7f811c03b900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8120009180 tx=0x7f8120008040 comp rx=0 tx=0).stop 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.863+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 msgr2=0x7f81341a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.863+0000 7f813c200700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f81341a4440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8128014000 tx=0x7f8128005030 comp rx=0 tx=0).stop 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.863+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 shutdown_connections 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.864+0000 7f813c200700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f811c039440 0x7f811c03b900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.864+0000 7f813c200700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8134108f20 0x7f81341a4440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.864+0000 7f813c200700 1 --2- 172.21.15.186:0/1595196309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81341a4980 0x7f813419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.864+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 >> 172.21.15.186:0/1595196309 conn(0x7f8134078470 msgr2=0x7f813410a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.864+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 shutdown_connections 2024-04-23T14:39:54.865 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:39:54.864+0000 7f813c200700 1 -- 172.21.15.186:0/1595196309 wait complete. 2024-04-23T14:39:54.866 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2024-04-23T14:39:55.532 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:55 smithi186 ceph-mon[31814]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:55.533 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:39:55 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/1595196309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:55 smithi007 ceph-mon[27906]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:39:55 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/1595196309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:55.774 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 podman[31674]: 2024-04-23 14:39:55.771562652 +0000 UTC m=+0.426116088 container init cd17eb6ef5c7359210f36d5ece1a763504a42c1edffcaf50d645054ddd6d4f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:39:56.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 podman[31674]: 2024-04-23 14:39:55.781731946 +0000 UTC m=+0.436285330 container start cd17eb6ef5c7359210f36d5ece1a763504a42c1edffcaf50d645054ddd6d4f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:39:56.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T14:39:56.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev), process ceph-mon, pid 2 2024-04-23T14:39:56.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pidfile_write: ignore empty --pid-file 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: load: jerasure load: lrc 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: RocksDB version: 7.9.2 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Git sha 0 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Compile date 2024-04-22 13:15:13 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: DB SUMMARY 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: DB Session ID: XYTO0FU1LWHHO750Y64G 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: CURRENT file: CURRENT 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.error_if_exists: 0 2024-04-23T14:39:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.create_if_missing: 0 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.paranoid_checks: 1 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.env: 0x56010077fcc0 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.fs: PosixFileSystem 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.info_log: 0x56012afabc60 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.statistics: (nil) 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.use_fsync: 0 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_log_file_size: 0 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T14:39:56.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T14:39:56.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T14:39:56.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.allow_fallocate: 1 2024-04-23T14:39:56.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T14:39:56.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T14:39:56.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.use_direct_reads: 0 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.db_log_dir: 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.wal_dir: 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T14:39:56.173 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.write_buffer_manager: 0x56012af7a1e0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.unordered_write: 0 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T14:39:56.174 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.row_cache: None 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.wal_filter: None 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.two_write_queues: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.wal_compression: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.atomic_flush: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T14:39:56.175 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.log_readahead_size: 0 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_background_jobs: 2 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_background_compactions: -1 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_subcompactions: 1 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T14:39:56.176 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_open_files: -1 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_background_flushes: -1 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Compression algorithms supported: 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T14:39:56.177 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kZSTD supported: 0 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kXpressCompression supported: 0 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kZlibCompression supported: 1 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kSnappyCompression supported: 1 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kLZ4Compression supported: 1 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: kBZip2Compression supported: 0 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.merge_operator: 2024-04-23T14:39:56.178 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_filter: None 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56012afabe20) 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: index_type: 0 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: data_block_index_type: 0 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: index_shortening: 1 2024-04-23T14:39:56.179 INFO:journalctl@ceph.mon.b.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: checksum: 4 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: no_block_cache: 0 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache: 0x56012afad090 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache_options: 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: capacity : 536870912 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: num_shard_bits : 4 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: strict_capacity_limit : 0 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache_compressed: (nil) 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: persistent_cache: (nil) 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_size: 4096 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_size_deviation: 10 2024-04-23T14:39:56.180 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_restart_interval: 16 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: index_block_restart_interval: 1 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: metadata_block_size: 4096 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: partition_filters: 0 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: use_delta_encoding: 1 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: filter_policy: bloomfilter 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: whole_key_filtering: 1 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: verify_compression: 0 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: format_version: 5 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: enable_index_compression: 1 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_align: 0 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: max_auto_readahead_size: 262144 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: prepopulate_block_cache: 0 2024-04-23T14:39:56.181 INFO:journalctl@ceph.mon.b.smithi137.stdout: initial_auto_readahead_size: 8192 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression: NoCompression 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.num_levels: 7 2024-04-23T14:39:56.182 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T14:39:56.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T14:39:56.185 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T14:39:56.186 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.arena_block_size: 1048576 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T14:39:56.187 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.inplace_update_support: 0 2024-04-23T14:39:56.188 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.bloom_locality: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.max_successive_merges: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.ttl: 2592000 2024-04-23T14:39:56.189 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.enable_blob_files: false 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.min_blob_size: 0 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.blob_file_starting_level: 0 2024-04-23T14:39:56.190 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 884368e3-e5f9-4cef-8c1c-ea4a9b54b705 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883195839670, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883195840564, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713883195, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "884368e3-e5f9-4cef-8c1c-ea4a9b54b705", "db_session_id": "XYTO0FU1LWHHO750Y64G", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883195840836, "job": 1, "event": "recovery_finished"} 2024-04-23T14:39:56.191 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56012b09a000 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: DB pointer 0x56012b084000 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** DB Stats ** 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:39:56.192 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** Compaction Stats [default] ** 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T14:39:56.193 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** Compaction Stats [default] ** 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T14:39:56.194 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: Block cache BinnedLRUCache@0x56012afad090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:39:56.195 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: using public_addr v2:172.21.15.137:0/0 -> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: starting mon.b rank -1 at public addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] at bind addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(???) e0 preinit fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 bash[31674]: cd17eb6ef5c7359210f36d5ece1a763504a42c1edffcaf50d645054ddd6d4f17 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 systemd[1]: Started Ceph mon.b for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).mds e1 new map 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout: e1 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T14:39:56.196 INFO:journalctl@ceph.mon.b.smithi137.stdout: legacy client fscid: -1 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout: No filesystems configured 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-23T14:39:56.197 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Added host smithi137 2024-04-23T14:39:56.198 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.199 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Deploying cephadm binary to smithi186 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:56.200 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Added host smithi186 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2220539457' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-23T14:39:56.201 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2220539457' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.202 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c;count:3 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Deploying daemon mon.c on smithi186 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.203 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/4119493195' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.a calling monitor election 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.c calling monitor election 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T14:39:56.204 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: monmap epoch 2 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: last_changed 2024-04-23T14:39:45.031985+0000 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: min_mon_release 19 (squid) 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: election_strategy: 1 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: 1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.c 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: fsmap 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mgrmap e13: x(active, since 67s) 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.205 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: Deploying daemon mon.b on smithi137 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/2329381565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/1595196309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:56.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:39:55 smithi137 ceph-mon[31694]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-04-23T14:39:56.592 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T14:39:56.592 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:57.030 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:40:01.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:40:01.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: mon.a calling monitor election 2024-04-23T14:40:01.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: mon.c calling monitor election 2024-04-23T14:40:01.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: mon.b calling monitor election 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: monmap epoch 3 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: last_changed 2024-04-23T14:39:55.895883+0000 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: min_mon_release 19 (squid) 2024-04-23T14:40:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: election_strategy: 1 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: 1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.c 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: fsmap 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: mgrmap e13: x(active, since 78s) 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:01.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: mon.a calling monitor election 2024-04-23T14:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: mon.c calling monitor election 2024-04-23T14:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: mon.b calling monitor election 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: monmap epoch 3 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: last_changed 2024-04-23T14:39:55.895883+0000 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: min_mon_release 19 (squid) 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: election_strategy: 1 2024-04-23T14:40:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: 1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.c 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: fsmap 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: mgrmap e13: x(active, since 78s) 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:01.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: mon.a calling monitor election 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: mon.c calling monitor election 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: mon.b calling monitor election 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: monmap epoch 3 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: last_changed 2024-04-23T14:39:55.895883+0000 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: created 2024-04-23T14:37:17.131882+0000 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: min_mon_release 19 (squid) 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: election_strategy: 1 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: 1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.c 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: fsmap 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: mgrmap e13: x(active, since 78s) 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.896+0000 7ff15e000700 1 -- 172.21.15.186:0/1974727091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff158108f20 msgr2=0x7ff13c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.896+0000 7ff15e000700 1 --2- 172.21.15.186:0/1974727091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff158108f20 0x7ff13c005610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff148005fa0 tx=0x7ff14800ffc0 comp rx=0 tx=0).stop 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.896+0000 7ff15e000700 1 -- 172.21.15.186:0/1974727091 shutdown_connections 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.897+0000 7ff15e000700 1 --2- 172.21.15.186:0/1974727091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff158108f20 0x7ff13c005610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.897+0000 7ff15e000700 1 -- 172.21.15.186:0/1974727091 >> 172.21.15.186:0/1974727091 conn(0x7ff158078470 msgr2=0x7ff15807a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.897+0000 7ff15e000700 1 -- 172.21.15.186:0/1974727091 shutdown_connections 2024-04-23T14:40:01.899 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.897+0000 7ff15e000700 1 -- 172.21.15.186:0/1974727091 wait complete. 2024-04-23T14:40:01.900 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.899+0000 7ff15e000700 1 Processor -- start 2024-04-23T14:40:01.901 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 -- start start 2024-04-23T14:40:01.901 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff158108f20 0x7ff15819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:01.901 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 0x7ff1581a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:01.902 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1581a3510 0x7ff1581a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:01.902 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110b30 con 0x7ff15819ec40 2024-04-23T14:40:01.902 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581109b0 con 0x7ff1581a3510 2024-04-23T14:40:01.902 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.900+0000 7ff15e000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110cb0 con 0x7ff158108f20 2024-04-23T14:40:01.902 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.901+0000 7ff156a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 0x7ff1581a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:01.902 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.901+0000 7ff156a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 0x7ff1581a2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.186:35064/0 (socket says 172.21.15.186:35064) 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.901+0000 7ff156a00700 1 -- 172.21.15.186:0/662893350 learned_addr learned my addr 172.21.15.186:0/662893350 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.901+0000 7ff157400700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff158108f20 0x7ff15819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157e00700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1581a3510 0x7ff1581a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157400700 1 -- 172.21.15.186:0/662893350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1581a3510 msgr2=0x7ff1581a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157400700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1581a3510 0x7ff1581a39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157400700 1 -- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 msgr2=0x7ff1581a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:01.903 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157400700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 0x7ff1581a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157400700 1 -- 172.21.15.186:0/662893350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1581ab280 con 0x7ff158108f20 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff156a00700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 0x7ff1581a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.902+0000 7ff157400700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff158108f20 0x7ff15819e700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff148000c00 tx=0x7ff148005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.903+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14801b430 con 0x7ff158108f20 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.903+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14801ba80 con 0x7ff158108f20 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.903+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1581ab450 con 0x7ff158108f20 2024-04-23T14:40:01.904 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.903+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480116d0 con 0x7ff158108f20 2024-04-23T14:40:01.905 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.903+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581ab9e0 con 0x7ff158108f20 2024-04-23T14:40:01.905 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.904+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7ff148011930 con 0x7ff158108f20 2024-04-23T14:40:01.906 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.904+0000 7ff14fe00700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff134039ae0 0x7ff13403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:01.906 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.905+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff14804efb0 con 0x7ff158108f20 2024-04-23T14:40:01.906 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.904+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158064150 con 0x7ff158108f20 2024-04-23T14:40:01.906 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.905+0000 7ff156a00700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff134039ae0 0x7ff13403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:01.907 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.906+0000 7ff156a00700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff134039ae0 0x7ff13403bfa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff140009f70 tx=0x7ff1400092c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:01.914 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:01.913+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff14807dff0 con 0x7ff158108f20 2024-04-23T14:40:02.244 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.242+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff15802dfe0 con 0x7ff158108f20 2024-04-23T14:40:02.244 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:01 smithi186 ceph-mon[31814]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:02.244 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:02.244 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:02.244 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:02.244 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:02.245 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.243+0000 7ff14fe00700 1 -- 172.21.15.186:0/662893350 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7ff148022070 con 0x7ff158108f20 2024-04-23T14:40:02.245 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-23T14:40:02.245 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":3,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:39:55.895883Z","created":"2024-04-23T14:37:17.131882Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-23T14:40:02.247 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff134039ae0 msgr2=0x7ff13403bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:02.247 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff134039ae0 0x7ff13403bfa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff140009f70 tx=0x7ff1400092c0 comp rx=0 tx=0).stop 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff158108f20 msgr2=0x7ff15819e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff158108f20 0x7ff15819e700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff148000c00 tx=0x7ff148005250 comp rx=0 tx=0).stop 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 shutdown_connections 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff134039ae0 0x7ff13403bfa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1581a3510 0x7ff1581a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff158108f20 0x7ff15819e700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 --2- 172.21.15.186:0/662893350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff15819ec40 0x7ff1581a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 >> 172.21.15.186:0/662893350 conn(0x7ff158078470 msgr2=0x7ff158079650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.246+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 shutdown_connections 2024-04-23T14:40:02.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:02.247+0000 7ff15e000700 1 -- 172.21.15.186:0/662893350 wait complete. 2024-04-23T14:40:02.249 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 3 2024-04-23T14:40:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:01 smithi007 ceph-mon[27906]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:02.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:02.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:02.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:02.410 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:01 smithi137 ceph-mon[31694]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:02.410 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:02.410 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:02.411 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:02.411 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:40:02.841 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-23T14:40:02.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-23T14:40:03.225 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:40:02 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:40:02.897+0000 7f421e200700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-23T14:40:03.305 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:40:03.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:03 smithi007 ceph-mon[27906]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:03.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:03.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:03 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/662893350' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:03 smithi186 ceph-mon[31814]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:03 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/662893350' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:03 smithi137 ceph-mon[31694]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:03 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/662893350' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:04.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:04.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:40:04.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:40:04.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:04 smithi007 ceph-mon[27906]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:40:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:40:04.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:04 smithi186 ceph-mon[31814]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:40:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:40:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:04 smithi137 ceph-mon[31694]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:40:05.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.455+0000 7fa77b000700 1 -- 172.21.15.7:0/3613172520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7741085e0 msgr2=0x7fa7741089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.455+0000 7fa77b000700 1 --2- 172.21.15.7:0/3613172520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7741085e0 0x7fa7741089c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa764009910 tx=0x7fa764009c20 comp rx=0 tx=0).stop 2024-04-23T14:40:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.456+0000 7fa77b000700 1 -- 172.21.15.7:0/3613172520 shutdown_connections 2024-04-23T14:40:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.456+0000 7fa77b000700 1 --2- 172.21.15.7:0/3613172520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7741085e0 0x7fa7741089c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.456+0000 7fa77b000700 1 -- 172.21.15.7:0/3613172520 >> 172.21.15.7:0/3613172520 conn(0x7fa7740fe020 msgr2=0x7fa774100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.456+0000 7fa77b000700 1 -- 172.21.15.7:0/3613172520 shutdown_connections 2024-04-23T14:40:05.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.456+0000 7fa77b000700 1 -- 172.21.15.7:0/3613172520 wait complete. 2024-04-23T14:40:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.457+0000 7fa77b000700 1 Processor -- start 2024-04-23T14:40:05.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.457+0000 7fa77b000700 1 -- start start 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.457+0000 7fa77b000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7741085e0 0x7fa77419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.457+0000 7fa77b000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 0x7fa77419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.457+0000 7fa77b000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa77419f190 0x7fa77419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa77b000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa77410ca50 con 0x7fa77419a8c0 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa77b000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa77410c8d0 con 0x7fa7741085e0 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa77b000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa77410cbd0 con 0x7fa77419f190 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 0x7fa77419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 0x7fa77419ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43228/0 (socket says 172.21.15.7:43228) 2024-04-23T14:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 -- 172.21.15.7:0/1309169380 learned_addr learned my addr 172.21.15.7:0/1309169380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa779000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa77419f190 0x7fa77419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 -- 172.21.15.7:0/1309169380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa77419f190 msgr2=0x7fa77419f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa77419f190 0x7fa77419f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 -- 172.21.15.7:0/1309169380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7741085e0 msgr2=0x7fa77419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7741085e0 0x7fa77419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.458+0000 7fa773400700 1 -- 172.21.15.7:0/1309169380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7741a6f00 con 0x7fa77419a8c0 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa779000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa77419f190 0x7fa77419f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa773400700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 0x7fa77419ec50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b780 tx=0x7fa76000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760004230 con 0x7fa77419a8c0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7600043d0 con 0x7fa77419a8c0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760011b80 con 0x7fa77419a8c0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741a7130 con 0x7fa77419a8c0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.459+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7741a7740 con 0x7fa77419a8c0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.460+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa774064150 con 0x7fa77419a8c0 2024-04-23T14:40:05.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.461+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7fa7600036a0 con 0x7fa77419a8c0 2024-04-23T14:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.461+0000 7fa770c00700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa758039ae0 0x7fa75803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.461+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa76004c580 con 0x7fa77419a8c0 2024-04-23T14:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.462+0000 7fa773e00700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa758039ae0 0x7fa75803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.462+0000 7fa773e00700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa758039ae0 0x7fa75803bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b5c0 tx=0x7fa764005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.467+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa760020740 con 0x7fa77419a8c0 2024-04-23T14:40:05.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.712+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa7741a7a60 con 0x7fa77419a8c0 2024-04-23T14:40:05.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.713+0000 7fa770c00700 1 -- 172.21.15.7:0/1309169380 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fa760017d50 con 0x7fa77419a8c0 2024-04-23T14:40:05.713 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:05.713 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-23T14:40:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] 2024-04-23T14:40:05.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa758039ae0 msgr2=0x7fa75803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa758039ae0 0x7fa75803bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b5c0 tx=0x7fa764005da0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 msgr2=0x7fa77419ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 0x7fa77419ec50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa76000b780 tx=0x7fa76000bb40 comp rx=0 tx=0).stop 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 shutdown_connections 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa758039ae0 0x7fa75803bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa77419f190 0x7fa77419f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7741085e0 0x7fa77419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 --2- 172.21.15.7:0/1309169380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa77419a8c0 0x7fa77419ec50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 >> 172.21.15.7:0/1309169380 conn(0x7fa7740fe020 msgr2=0x7fa774074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 shutdown_connections 2024-04-23T14:40:05.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:05.716+0000 7fa77b000700 1 -- 172.21.15.7:0/1309169380 wait complete. 2024-04-23T14:40:06.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:06.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1309169380' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:06.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1309169380' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:06.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:06.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:06.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1309169380' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:06.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:06.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.534 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-23T14:40:06.534 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:40:06.534 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T14:40:06.604 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:40:06.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:40:06.712 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:40:06.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T14:40:06.804 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:40:06.804 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:40:06.931 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:40:06.932 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T14:40:07.025 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:40:07.025 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:40:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:06 smithi007 ceph-mon[27906]: Reconfiguring mon.a (unknown last config time)... 2024-04-23T14:40:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:06 smithi007 ceph-mon[27906]: Reconfiguring daemon mon.a on smithi007 2024-04-23T14:40:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:06 smithi186 ceph-mon[31814]: Reconfiguring mon.a (unknown last config time)... 2024-04-23T14:40:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:06 smithi186 ceph-mon[31814]: Reconfiguring daemon mon.a on smithi007 2024-04-23T14:40:07.155 INFO:tasks.cephadm:Adding mgr.x on smithi007 2024-04-23T14:40:07.155 INFO:tasks.cephadm:Adding mgr.y on smithi137 2024-04-23T14:40:07.155 INFO:tasks.cephadm:Adding mgr.z on smithi186 2024-04-23T14:40:07.155 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi007=x;smithi137=y;smithi186=z' 2024-04-23T14:40:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:06 smithi137 ceph-mon[31694]: Reconfiguring mon.a (unknown last config time)... 2024-04-23T14:40:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:06 smithi137 ceph-mon[31694]: Reconfiguring daemon mon.a on smithi007 2024-04-23T14:40:07.625 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:40:08.053 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:07 smithi186 ceph-mon[31814]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:07 smithi137 ceph-mon[31694]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:08.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:07 smithi007 ceph-mon[27906]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: Reconfiguring mon.b (monmap changed)... 2024-04-23T14:40:09.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:09.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:09.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:09.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: Reconfiguring daemon mon.b on smithi137 2024-04-23T14:40:09.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:09 smithi007 ceph-mon[27906]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: Reconfiguring mon.b (monmap changed)... 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: Reconfiguring daemon mon.b on smithi137 2024-04-23T14:40:09.354 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:09 smithi137 ceph-mon[31694]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: Reconfiguring mon.b (monmap changed)... 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:09.360 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: Reconfiguring daemon mon.b on smithi137 2024-04-23T14:40:09.361 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:09 smithi186 ceph-mon[31814]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:09.829 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.827+0000 7fdcfc800700 1 -- 172.21.15.186:0/965172234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf40774a0 msgr2=0x7fdcf40778c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:09.829 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.827+0000 7fdcfc800700 1 --2- 172.21.15.186:0/965172234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf40774a0 0x7fdcf40778c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009910 tx=0x7fdce8009c20 comp rx=0 tx=0).stop 2024-04-23T14:40:09.829 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.828+0000 7fdcfc800700 1 -- 172.21.15.186:0/965172234 shutdown_connections 2024-04-23T14:40:09.829 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.828+0000 7fdcfc800700 1 --2- 172.21.15.186:0/965172234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf40774a0 0x7fdcf40778c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:09.829 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.828+0000 7fdcfc800700 1 -- 172.21.15.186:0/965172234 >> 172.21.15.186:0/965172234 conn(0x7fdcf40ffe50 msgr2=0x7fdcf4102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:09.830 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.828+0000 7fdcfc800700 1 -- 172.21.15.186:0/965172234 shutdown_connections 2024-04-23T14:40:09.830 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.828+0000 7fdcfc800700 1 -- 172.21.15.186:0/965172234 wait complete. 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.829+0000 7fdcfc800700 1 Processor -- start 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.829+0000 7fdcfc800700 1 -- start start 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.829+0000 7fdcfc800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 0x7fdcf419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.829+0000 7fdcfc800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf419e8e0 0x7fdcf41a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.829+0000 7fdcfc800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf419ed60 0x7fdcf41a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcfc800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf410ec70 con 0x7fdcf419e8e0 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcfc800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf410eaf0 con 0x7fdcf419ed60 2024-04-23T14:40:09.831 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcfc800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf410edf0 con 0x7fdcf40774a0 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcf9e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 0x7fdcf419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcf9400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf419e8e0 0x7fdcf41a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcf9e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 0x7fdcf419e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:55262/0 (socket says 172.21.15.186:55262) 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.830+0000 7fdcf9e00700 1 -- 172.21.15.186:0/2291887736 learned_addr learned my addr 172.21.15.186:0/2291887736 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcf9e00700 1 -- 172.21.15.186:0/2291887736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf419ed60 msgr2=0x7fdcf41a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcf9e00700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf419ed60 0x7fdcf41a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcf9e00700 1 -- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf419e8e0 msgr2=0x7fdcf41a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcf9e00700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf419e8e0 0x7fdcf41a3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:09.832 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcf9e00700 1 -- 172.21.15.186:0/2291887736 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf41a67b0 con 0x7fdcf40774a0 2024-04-23T14:40:09.833 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcf9e00700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 0x7fdcf419e3a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdce80052c0 tx=0x7fdce8004fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:09.833 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8027070 con 0x7fdcf40774a0 2024-04-23T14:40:09.833 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdce800be10 con 0x7fdcf40774a0 2024-04-23T14:40:09.833 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf41a6a40 con 0x7fdcf40774a0 2024-04-23T14:40:09.833 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.831+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce800f460 con 0x7fdcf40774a0 2024-04-23T14:40:09.834 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.832+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf41a6ff0 con 0x7fdcf40774a0 2024-04-23T14:40:09.834 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.833+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7fdce802a070 con 0x7fdcf40774a0 2024-04-23T14:40:09.834 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.833+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf4064150 con 0x7fdcf40774a0 2024-04-23T14:40:09.834 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.833+0000 7fdceea00700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdcdc039ae0 0x7fdcdc03bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:09.834 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.833+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdce804db30 con 0x7fdcf40774a0 2024-04-23T14:40:09.835 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.834+0000 7fdcf9400700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdcdc039ae0 0x7fdcdc03bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:09.836 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.835+0000 7fdcf9400700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdcdc039ae0 0x7fdcdc03bfa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009ad0 tx=0x7fdce4009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:09.841 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:09.840+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdce8013070 con 0x7fdcf40774a0 2024-04-23T14:40:10.081 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.080+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi137=y;smithi186=z", "target": ["mon-mgr", ""]}) -- 0x7fdcf4062fc0 con 0x7fdcdc039ae0 2024-04-23T14:40:10.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.095+0000 7fdceea00700 1 -- 172.21.15.186:0/2291887736 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fdcf4062fc0 con 0x7fdcdc039ae0 2024-04-23T14:40:10.096 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mgr update... 2024-04-23T14:40:10.099 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdcdc039ae0 msgr2=0x7fdcdc03bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdcdc039ae0 0x7fdcdc03bfa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009ad0 tx=0x7fdce4009210 comp rx=0 tx=0).stop 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 msgr2=0x7fdcf419e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 0x7fdcf419e3a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdce80052c0 tx=0x7fdce8004fa0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 shutdown_connections 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdcdc039ae0 0x7fdcdc03bfa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf419ed60 0x7fdcf41a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf40774a0 0x7fdcf419e3a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 --2- 172.21.15.186:0/2291887736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcf419e8e0 0x7fdcf41a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 >> 172.21.15.186:0/2291887736 conn(0x7fdcf40ffe50 msgr2=0x7fdcf4100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 shutdown_connections 2024-04-23T14:40:10.100 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:40:10.098+0000 7fdcfc800700 1 -- 172.21.15.186:0/2291887736 wait complete. 2024-04-23T14:40:10.782 DEBUG:teuthology.orchestra.run.smithi137:mgr.y> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.y.service 2024-04-23T14:40:10.790 DEBUG:teuthology.orchestra.run.smithi186:mgr.z> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.z.service 2024-04-23T14:40:10.795 INFO:tasks.cephadm:Deploying OSDs... 2024-04-23T14:40:10.796 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:40:10.796 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T14:40:10.858 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T14:40:10.859 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-04-23T14:40:10.918 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-23 14:38:55.765553072 +0000 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-23 14:30:07.304692506 +0000 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-23 14:30:07.305692491 +0000 2024-04-23T14:40:10.919 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-23 14:30:07.304692506 +0000 2024-04-23T14:40:10.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T14:40:11.005 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-23T14:40:11.005 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-23T14:40:11.005 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000293433 s, 1.7 MB/s 2024-04-23T14:40:11.009 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T14:40:11.067 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-04-23T14:40:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T14:40:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:11.120 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-04-23T14:40:11.121 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:11.121 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:11.121 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-23 14:38:55.837551935 +0000 2024-04-23T14:40:11.121 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-23 14:30:07.921683161 +0000 2024-04-23T14:40:11.121 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-23 14:30:07.921683161 +0000 2024-04-23T14:40:11.121 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-23 14:30:07.921683161 +0000 2024-04-23T14:40:11.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi137=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: Saving service mgr spec with placement smithi007=x;smithi137=y;smithi186=z;count:3 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: Reconfiguring mon.c (monmap changed)... 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:11 smithi137 ceph-mon[31694]: Reconfiguring daemon mon.c on smithi186 2024-04-23T14:40:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-23T14:40:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-23T14:40:11.203 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000268996 s, 1.9 MB/s 2024-04-23T14:40:11.207 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T14:40:11.270 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-23 14:38:55.917550672 +0000 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-23 14:30:08.522674059 +0000 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-23 14:30:08.522674059 +0000 2024-04-23T14:40:11.324 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-23 14:30:08.522674059 +0000 2024-04-23T14:40:11.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi137=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: Saving service mgr spec with placement smithi007=x;smithi137=y;smithi186=z;count:3 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: Reconfiguring mon.c (monmap changed)... 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:11.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:11 smithi007 ceph-mon[27906]: Reconfiguring daemon mon.c on smithi186 2024-04-23T14:40:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi137=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: Saving service mgr spec with placement smithi007=x;smithi137=y;smithi186=z;count:3 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: Reconfiguring mon.c (monmap changed)... 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:11 smithi186 ceph-mon[31814]: Reconfiguring daemon mon.c on smithi186 2024-04-23T14:40:11.411 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-23T14:40:11.411 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-23T14:40:11.411 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000289086 s, 1.8 MB/s 2024-04-23T14:40:11.415 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T14:40:11.518 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-04-23T14:40:11.573 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-23 14:38:55.973549788 +0000 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-23 14:30:09.120665002 +0000 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-23 14:30:09.120665002 +0000 2024-04-23T14:40:11.574 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-23 14:30:09.120665002 +0000 2024-04-23T14:40:11.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T14:40:11.658 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-23T14:40:11.658 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-23T14:40:11.658 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000312977 s, 1.6 MB/s 2024-04-23T14:40:11.662 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T14:40:11.722 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T14:40:11.722 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T14:40:11.780 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T14:40:11.780 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 14:39:54.961585890 +0000 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 14:30:01.702403317 +0000 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 14:30:01.702403317 +0000 2024-04-23T14:40:11.833 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-23 14:30:01.702403317 +0000 2024-04-23T14:40:11.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T14:40:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T14:40:11.911 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T14:40:11.911 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000402606 s, 1.3 MB/s 2024-04-23T14:40:11.914 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T14:40:11.961 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 14:39:54.961585890 +0000 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 14:30:02.307392599 +0000 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 14:30:02.307392599 +0000 2024-04-23T14:40:12.004 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-23 14:30:02.307392599 +0000 2024-04-23T14:40:12.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T14:40:12.128 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T14:40:12.128 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T14:40:12.128 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000388162 s, 1.3 MB/s 2024-04-23T14:40:12.132 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T14:40:12.185 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-04-23T14:40:12.233 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T14:40:12.233 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:12.233 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-23T14:40:12.233 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:12.234 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:12.234 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 14:39:54.962585872 +0000 2024-04-23T14:40:12.234 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 14:30:02.929381579 +0000 2024-04-23T14:40:12.234 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 14:30:02.929381579 +0000 2024-04-23T14:40:12.234 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-23 14:30:02.929381579 +0000 2024-04-23T14:40:12.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T14:40:12.309 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T14:40:12.309 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T14:40:12.309 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000355673 s, 1.4 MB/s 2024-04-23T14:40:12.313 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T14:40:12.368 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 14:39:54.962585872 +0000 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 14:30:03.540370754 +0000 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 14:30:03.540370754 +0000 2024-04-23T14:40:12.418 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-23 14:30:03.540370754 +0000 2024-04-23T14:40:12.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T14:40:12.495 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T14:40:12.495 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T14:40:12.495 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000391315 s, 1.3 MB/s 2024-04-23T14:40:12.499 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T14:40:12.555 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-23T14:40:12.555 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T14:40:12.600 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T14:40:12.600 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-04-23T14:40:12.683 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T14:40:12.683 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:12.683 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-23T14:40:12.683 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:12.684 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:12.684 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-23 14:39:44.095072401 +0000 2024-04-23T14:40:12.684 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-23 14:30:01.711058786 +0000 2024-04-23T14:40:12.684 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-23 14:30:01.711058786 +0000 2024-04-23T14:40:12.684 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-23 14:30:01.711058786 +0000 2024-04-23T14:40:12.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T14:40:12.796 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-23T14:40:12.796 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-23T14:40:12.796 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000351865 s, 1.5 MB/s 2024-04-23T14:40:12.799 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T14:40:12.848 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-04-23T14:40:12.894 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T14:40:12.894 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-23T14:40:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-23 14:39:44.096072383 +0000 2024-04-23T14:40:12.895 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-23 14:30:02.323047479 +0000 2024-04-23T14:40:12.895 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-23 14:30:02.323047479 +0000 2024-04-23T14:40:12.895 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-23 14:30:02.323047479 +0000 2024-04-23T14:40:12.895 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T14:40:13.006 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-23T14:40:13.006 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-23T14:40:13.006 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000362969 s, 1.4 MB/s 2024-04-23T14:40:13.009 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T14:40:13.059 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-23 14:39:44.096072383 +0000 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-23 14:30:02.904036745 +0000 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-23 14:30:02.904036745 +0000 2024-04-23T14:40:13.103 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-23 14:30:02.904036745 +0000 2024-04-23T14:40:13.104 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T14:40:13.203 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-23T14:40:13.204 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-23T14:40:13.204 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000372681 s, 1.4 MB/s 2024-04-23T14:40:13.206 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T14:40:13.247 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-04-23T14:40:13.328 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T14:40:13.328 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:13.328 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-23T14:40:13.328 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:13.328 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:13.328 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-23 14:39:44.097072364 +0000 2024-04-23T14:40:13.329 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-23 14:30:03.509025567 +0000 2024-04-23T14:40:13.329 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-23 14:30:03.509025567 +0000 2024-04-23T14:40:13.329 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-23 14:30:03.509025567 +0000 2024-04-23T14:40:13.329 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T14:40:13.435 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-23T14:40:13.435 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-23T14:40:13.435 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000357585 s, 1.4 MB/s 2024-04-23T14:40:13.438 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T14:40:13.461 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:13.461 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.461 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.461 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:13.462 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:13 smithi186 ceph-mon[31814]: Deploying daemon mgr.z on smithi186 2024-04-23T14:40:13.488 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-04-23T14:40:13.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:13.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:13.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:13.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:13.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:13 smithi137 ceph-mon[31694]: Deploying daemon mgr.z on smithi186 2024-04-23T14:40:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:13 smithi007 ceph-mon[27906]: Deploying daemon mgr.z on smithi186 2024-04-23T14:40:13.937 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:40:15.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:15 smithi186 ceph-mon[31814]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:15.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:15 smithi137 ceph-mon[31694]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:15.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:15 smithi007 ceph-mon[27906]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:15.864 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:15 smithi186 podman[33749]: 2024-04-23 14:40:15.616240161 +0000 UTC m=+0.144372266 container create b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-23T14:40:16.166 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:15 smithi186 podman[33749]: 2024-04-23 14:40:15.886657525 +0000 UTC m=+0.414789637 container init b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-23T14:40:16.166 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:15 smithi186 podman[33749]: 2024-04-23 14:40:15.897613325 +0000 UTC m=+0.425745422 container start b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-23T14:40:16.166 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:15 smithi186 ceph-mgr[33768]: -- 172.21.15.186:0/2364099067 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff363165a0 con 0x55ff362eb000 2024-04-23T14:40:16.167 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:16 smithi186 bash[33749]: b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b 2024-04-23T14:40:16.167 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:16 smithi186 systemd[1]: Started Ceph mgr.z for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:40:16.167 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:16.164+0000 7f08f6dd7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:40:16.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:16.414+0000 7f08f6dd7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:40:16.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:16.543+0000 7f08f6dd7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:40:17.005 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T14:40:17.005 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T14:40:17.005 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-04-23T14:40:17.005 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-04-23T14:40:17.005 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0370502 s, 283 MB/s 2024-04-23T14:40:17.005 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-04-23T14:40:17.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:16.947+0000 7f08f6dd7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:40:17.364 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:17.059+0000 7f08f6dd7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:40:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:17.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:17.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:17.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:17.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:17 smithi186 ceph-mon[31814]: Deploying daemon mgr.y on smithi137 2024-04-23T14:40:17.462 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.462 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:17.462 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.462 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.463 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:17.463 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:17.463 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:17.463 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:17.463 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:17 smithi137 ceph-mon[31694]: Deploying daemon mgr.y on smithi137 2024-04-23T14:40:17.530 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:17.531 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:17 smithi007 ceph-mon[27906]: Deploying daemon mgr.y on smithi137 2024-04-23T14:40:17.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-04-23T14:40:18.397 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:40:19.093 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:18.656+0000 7f08f6dd7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:40:19.093 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:18.879+0000 7f08f6dd7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:40:19.094 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:19.092+0000 7f08f6dd7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:40:19.362 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:19 smithi137 ceph-mon[31694]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:19 smithi186 ceph-mon[31814]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:19.569 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:19 smithi007 ceph-mon[27906]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:19.657 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:19 smithi137 podman[33070]: 2024-04-23 14:40:19.607247619 +0000 UTC m=+0.359535680 container start c5bf3339a27d33dcc5b84aa80a386fc2670205ff6f6f466110bf4f6b9bdbc789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y, org.label-schema.build-date=20240416, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:40:19.658 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:19 smithi137 ceph-mgr[33088]: -- 172.21.15.137:0/2435081799 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641116385a0 con 0x56411160c800 2024-04-23T14:40:19.839 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:19.467+0000 7f08f6dd7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:40:19.840 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:19.586+0000 7f08f6dd7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:40:19.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:19 smithi137 bash[33070]: c5bf3339a27d33dcc5b84aa80a386fc2670205ff6f6f466110bf4f6b9bdbc789 2024-04-23T14:40:19.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:19 smithi137 systemd[1]: Started Ceph mgr.y for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:40:19.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:19 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:19.851+0000 7fdf80814200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:40:20.095 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:19.837+0000 7f08f6dd7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:40:20.095 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:20.093+0000 7f08f6dd7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:40:20.417 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:20.107+0000 7fdf80814200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:40:20.418 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:20.238+0000 7fdf80814200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 -- 172.21.15.7:0/208518461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 msgr2=0x7f4fc00759d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 --2- 172.21.15.7:0/208518461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc00759d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009990 tx=0x7f4fac009ca0 comp rx=0 tx=0).stop 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 -- 172.21.15.7:0/208518461 shutdown_connections 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 --2- 172.21.15.7:0/208518461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc010aa30 0x7f4fc010cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 --2- 172.21.15.7:0/208518461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc0076b20 0x7f4fc0074f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 --2- 172.21.15.7:0/208518461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc00759d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:20.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 -- 172.21.15.7:0/208518461 >> 172.21.15.7:0/208518461 conn(0x7f4fc00fe0c0 msgr2=0x7f4fc0100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:20.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 -- 172.21.15.7:0/208518461 shutdown_connections 2024-04-23T14:40:20.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.634+0000 7f4fc8400700 1 -- 172.21.15.7:0/208518461 wait complete. 2024-04-23T14:40:20.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.636+0000 7f4fc8400700 1 Processor -- start 2024-04-23T14:40:20.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.636+0000 7f4fc8400700 1 -- start start 2024-04-23T14:40:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.636+0000 7f4fc8400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.636+0000 7f4fc8400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc0076b20 0x7f4fc019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc8400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc010aa30 0x7f4fc01a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc8400700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc0110860 con 0x7f4fc0075550 2024-04-23T14:40:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc8400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01106e0 con 0x7f4fc010aa30 2024-04-23T14:40:20.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc8400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01109e0 con 0x7f4fc0076b20 2024-04-23T14:40:20.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:20.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc019af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58404/0 (socket says 172.21.15.7:58404) 2024-04-23T14:40:20.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 -- 172.21.15.7:0/2998546087 learned_addr learned my addr 172.21.15.7:0/2998546087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:40:20.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5000700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc0076b20 0x7f4fc019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc6400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc010aa30 0x7f4fc01a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 -- 172.21.15.7:0/2998546087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc0076b20 msgr2=0x7f4fc019b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc0076b20 0x7f4fc019b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 -- 172.21.15.7:0/2998546087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc010aa30 msgr2=0x7f4fc01a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc010aa30 0x7f4fc01a24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.637+0000 7f4fc5a00700 1 -- 172.21.15.7:0/2998546087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc01a2b60 con 0x7f4fc0075550 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.638+0000 7f4fc5000700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc0076b20 0x7f4fc019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.638+0000 7f4fc5a00700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc019af50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400e9a0 tx=0x7f4fb400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.638+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400cbd0 con 0x7f4fc0075550 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.638+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4fb400cd70 con 0x7f4fc0075550 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.638+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc01a2e50 con 0x7f4fc0075550 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.638+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4010430 con 0x7f4fc0075550 2024-04-23T14:40:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.639+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc01a32b0 con 0x7f4fc0075550 2024-04-23T14:40:20.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.639+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46613+0+0 (secure 0 0 0) 0x7f4fb40105d0 con 0x7f4fc0075550 2024-04-23T14:40:20.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.640+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc00697e0 con 0x7f4fc0075550 2024-04-23T14:40:20.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.640+0000 7f4fbe000700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4fa8039890 0x7f4fa803bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:20.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.640+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fb404cc60 con 0x7f4fc0075550 2024-04-23T14:40:20.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.640+0000 7f4fc5000700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4fa8039890 0x7f4fa803bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:20.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.641+0000 7f4fc5000700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4fa8039890 0x7f4fa803bd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00b840 tx=0x7f4fac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.646+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4fb4016330 con 0x7f4fc0075550 2024-04-23T14:40:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:20.887+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4fc0062f30 con 0x7f4fa8039890 2024-04-23T14:40:20.917 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:20.656+0000 7fdf80814200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:40:20.917 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:20.772+0000 7fdf80814200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:40:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:21.113 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:20.915+0000 7f08f6dd7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:40:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:21.856 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:21.496+0000 7f08f6dd7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:40:21.856 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:21.628+0000 7f08f6dd7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:40:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:21 smithi007 ceph-mon[27906]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:21 smithi007 ceph-mon[27906]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:22.113 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:21.904+0000 7f08f6dd7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:40:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-mon[31814]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-mon[31814]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:22.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:21 smithi137 ceph-mon[31694]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:21 smithi137 ceph-mon[31694]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:22.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:22 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:22.568+0000 7f08f6dd7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:40:22.995 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:22 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:22.692+0000 7f08f6dd7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:40:22.996 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:22 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:22.450+0000 7fdf80814200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:40:22.996 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:22 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:22.680+0000 7fdf80814200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:40:22.996 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:22 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:22.904+0000 7fdf80814200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:40:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-mon[31694]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-mon[31814]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:23.016+0000 7f08f6dd7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:23.199+0000 7f08f6dd7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:40:23.327 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:23.325+0000 7f08f6dd7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:23 smithi007 ceph-mon[27906]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:23.613 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:23.478+0000 7f08f6dd7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:40:23.667 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:23.290+0000 7fdf80814200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:40:23.668 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:23.412+0000 7fdf80814200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:40:23.917 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:23.666+0000 7fdf80814200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:40:23.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:23.916+0000 7fdf80814200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:40:24.113 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:23.851+0000 7f08f6dd7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:40:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: Reconfiguring mgr.x (unknown last config time)... 2024-04-23T14:40:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:24.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:24.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:24.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-mon[31814]: Reconfiguring daemon mgr.x on smithi007 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: Reconfiguring mgr.x (unknown last config time)... 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-mon[31694]: Reconfiguring daemon mgr.x on smithi007 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: Reconfiguring mgr.x (unknown last config time)... 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:24 smithi007 ceph-mon[27906]: Reconfiguring daemon mgr.x on smithi007 2024-04-23T14:40:24.897 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:24.612+0000 7f08f6dd7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:40:25.100 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:24.716+0000 7fdf80814200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:40:25.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:25.116+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 14) ==== 92601+0+0 (secure 0 0 0) 0x7f4fb401dce0 con 0x7f4fc0075550 2024-04-23T14:40:25.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:40:24 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:40:24.895+0000 7f08f6dd7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:40:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: Standby manager daemon z started 2024-04-23T14:40:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T14:40:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:25.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T14:40:25.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:25.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1779162103' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bada9023-7750-40ab-88f9-04e037cac5af"}]: dispatch 2024-04-23T14:40:25.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1779162103' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bada9023-7750-40ab-88f9-04e037cac5af"}]': finished 2024-04-23T14:40:25.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: osdmap e5: 1 total, 0 up, 1 in 2024-04-23T14:40:25.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:25.389 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:25.264+0000 7fdf80814200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:40:25.390 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:25.390 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: Standby manager daemon z started 2024-04-23T14:40:25.390 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T14:40:25.390 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:25.390 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T14:40:25.390 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:25.391 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1779162103' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bada9023-7750-40ab-88f9-04e037cac5af"}]: dispatch 2024-04-23T14:40:25.391 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1779162103' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bada9023-7750-40ab-88f9-04e037cac5af"}]': finished 2024-04-23T14:40:25.391 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: osdmap e5: 1 total, 0 up, 1 in 2024-04-23T14:40:25.391 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: Standby manager daemon z started 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/1905747036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1779162103' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bada9023-7750-40ab-88f9-04e037cac5af"}]: dispatch 2024-04-23T14:40:25.489 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1779162103' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bada9023-7750-40ab-88f9-04e037cac5af"}]': finished 2024-04-23T14:40:25.490 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: osdmap e5: 1 total, 0 up, 1 in 2024-04-23T14:40:25.490 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:25.654 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:25.388+0000 7fdf80814200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:40:25.654 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:25.652+0000 7fdf80814200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:40:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:26 smithi186 ceph-mon[31814]: mgrmap e14: x(active, since 102s), standbys: z 2024-04-23T14:40:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T14:40:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:26 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2402947141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:40:26.418 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:26.315+0000 7fdf80814200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:40:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-mon[31694]: mgrmap e14: x(active, since 102s), standbys: z 2024-04-23T14:40:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T14:40:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2402947141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:40:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:26 smithi007 ceph-mon[27906]: mgrmap e14: x(active, since 102s), standbys: z 2024-04-23T14:40:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T14:40:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:26 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2402947141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:40:26.759 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:26.437+0000 7fdf80814200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:40:26.759 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:26.757+0000 7fdf80814200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:40:27.061 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:26.933+0000 7fdf80814200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:40:27.062 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:27.059+0000 7fdf80814200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:40:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:27 smithi186 ceph-mon[31814]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:27 smithi137 ceph-mon[31694]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:27.418 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:27.213+0000 7fdf80814200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:40:27.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:27 smithi007 ceph-mon[27906]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:27.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:27.591+0000 7fdf80814200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:40:28.627 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:28 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:28.343+0000 7fdf80814200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:40:28.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:40:28 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:40:28.625+0000 7fdf80814200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:40:29.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:29.255+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 15) ==== 138589+0+0 (secure 0 0 0) 0x7f4fb4004750 con 0x7f4fc0075550 2024-04-23T14:40:29.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:29 smithi007 ceph-mon[27906]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:29.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:29 smithi007 ceph-mon[27906]: Standby manager daemon y started 2024-04-23T14:40:29.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:29 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T14:40:29.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:29 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:29.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:29 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T14:40:29.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:29 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:29 smithi186 ceph-mon[31814]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:29 smithi186 ceph-mon[31814]: Standby manager daemon y started 2024-04-23T14:40:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:29 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T14:40:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:29 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:29 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T14:40:29.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:29 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:29 smithi137 ceph-mon[31694]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:29 smithi137 ceph-mon[31694]: Standby manager daemon y started 2024-04-23T14:40:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:29 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T14:40:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:29 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:29 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T14:40:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:29 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1655761881' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:30.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:30 smithi007 ceph-mon[27906]: mgrmap e15: x(active, since 107s), standbys: z, y 2024-04-23T14:40:30.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T14:40:30.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:30 smithi186 ceph-mon[31814]: mgrmap e15: x(active, since 107s), standbys: z, y 2024-04-23T14:40:30.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T14:40:30.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:30 smithi137 ceph-mon[31694]: mgrmap e15: x(active, since 107s), standbys: z, y 2024-04-23T14:40:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T14:40:31.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:31 smithi007 ceph-mon[27906]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:31.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:31 smithi186 ceph-mon[31814]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:31.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:31 smithi137 ceph-mon[31694]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:33.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:32 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:33.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:32 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:33.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:32 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:32 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:32 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:32 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:32 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:33.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:32 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:33.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:32 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:33 smithi007 ceph-mon[27906]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:33 smithi186 ceph-mon[31814]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:34.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:33 smithi137 ceph-mon[31694]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:34.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:34.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:34.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:36.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:35 smithi007 ceph-mon[27906]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:36.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:40:36.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:35 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:35 smithi186 ceph-mon[31814]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:35 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:40:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:35 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:36.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:35 smithi137 ceph-mon[31694]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:36.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:35 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:40:36.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:35 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:37.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:36 smithi007 ceph-mon[27906]: Deploying daemon osd.0 on smithi007 2024-04-23T14:40:37.036 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:36 smithi186 ceph-mon[31814]: Deploying daemon osd.0 on smithi007 2024-04-23T14:40:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:36 smithi137 ceph-mon[31694]: Deploying daemon osd.0 on smithi007 2024-04-23T14:40:38.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:37 smithi007 ceph-mon[27906]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:38.070 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:37 smithi137 ceph-mon[31694]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:37 smithi186 ceph-mon[31814]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:40.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:39 smithi007 ceph-mon[27906]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:39 smithi186 ceph-mon[31814]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:40.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:39 smithi137 ceph-mon[31694]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:42.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:41 smithi007 ceph-mon[27906]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:42.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:41 smithi186 ceph-mon[31814]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:42.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:41 smithi137 ceph-mon[31694]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:44.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:43 smithi007 ceph-mon[27906]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:44.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:44.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:44.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:43 smithi186 ceph-mon[31814]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:44.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:43 smithi137 ceph-mon[31694]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:44.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:44.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:44.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:45.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:45 smithi007 ceph-mon[27906]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:45 smithi186 ceph-mon[31814]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:45 smithi137 ceph-mon[31694]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:48.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:47 smithi007 ceph-mon[27906]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:40:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:48.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:48.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:47 smithi186 ceph-mon[31814]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:40:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:48.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:48.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:48.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:48.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:47 smithi137 ceph-mon[31694]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:40:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.048+0000 7f4fbe000700 1 -- 172.21.15.7:0/2998546087 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4fc0062f30 con 0x7f4fa8039890 2024-04-23T14:40:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-04-23T14:40:49.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4fa8039890 msgr2=0x7f4fa803bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:49.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4fa8039890 0x7f4fa803bd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00b840 tx=0x7f4fac01a040 comp rx=0 tx=0).stop 2024-04-23T14:40:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 msgr2=0x7f4fc019af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc019af50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400e9a0 tx=0x7f4fb400ed60 comp rx=0 tx=0).stop 2024-04-23T14:40:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 shutdown_connections 2024-04-23T14:40:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4fa8039890 0x7f4fa803bd50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc010aa30 0x7f4fc01a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:49.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fc0075550 0x7f4fc019af50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 --2- 172.21.15.7:0/2998546087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc0076b20 0x7f4fc019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.053+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 >> 172.21.15.7:0/2998546087 conn(0x7f4fc00fe0c0 msgr2=0x7f4fc0106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.054+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 shutdown_connections 2024-04-23T14:40:49.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:40:49.054+0000 7f4fc8400700 1 -- 172.21.15.7:0/2998546087 wait complete. 2024-04-23T14:40:49.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:48 smithi007 ceph-mon[27906]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:40:49.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:48 smithi007 ceph-mon[27906]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T14:40:49.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:48 smithi007 ceph-mon[27906]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:40:49.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:48 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:48 smithi186 ceph-mon[31814]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:40:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:48 smithi186 ceph-mon[31814]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T14:40:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:48 smithi186 ceph-mon[31814]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:40:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:48 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:48 smithi137 ceph-mon[31694]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:40:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:48 smithi137 ceph-mon[31694]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T14:40:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:48 smithi137 ceph-mon[31694]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:40:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:48 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:49.855 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.0.service 2024-04-23T14:40:49.859 INFO:tasks.cephadm:Deploying osd.1 on smithi137 with /dev/vg_nvme/lv_4... 2024-04-23T14:40:49.859 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T14:40:50.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:50.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:50.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:49 smithi007 ceph-mon[27906]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' 2024-04-23T14:40:50.298 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:40:50.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:50.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:49 smithi186 ceph-mon[31814]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:49 smithi137 ceph-mon[31694]: from='osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541]' entity='osd.0' 2024-04-23T14:40:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:50 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:40:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:50 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:40:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:50 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:50 smithi137 ceph-mon[31694]: osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] boot 2024-04-23T14:40:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:50 smithi137 ceph-mon[31694]: osdmap e8: 1 total, 1 up, 1 in 2024-04-23T14:40:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:50 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:51.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:50 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:40:51.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:50 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:40:51.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:51.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:50 smithi007 ceph-mon[27906]: osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] boot 2024-04-23T14:40:51.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:50 smithi007 ceph-mon[27906]: osdmap e8: 1 total, 1 up, 1 in 2024-04-23T14:40:51.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:50 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:40:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:50 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:40:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:50 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:50 smithi186 ceph-mon[31814]: osd.0 [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] boot 2024-04-23T14:40:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:50 smithi186 ceph-mon[31814]: osdmap e8: 1 total, 1 up, 1 in 2024-04-23T14:40:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:50 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:51 smithi007 ceph-mon[27906]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:52.086 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:51 smithi137 ceph-mon[31694]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:52.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:51 smithi186 ceph-mon[31814]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:52.971 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T14:40:52.971 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T14:40:52.971 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-23T14:40:52.971 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-23T14:40:52.971 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0341351 s, 307 MB/s 2024-04-23T14:40:52.972 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-23T14:40:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:53 smithi007 ceph-mon[27906]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T14:40:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:53 smithi007 ceph-mon[27906]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:53.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:53 smithi137 ceph-mon[31694]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T14:40:53.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:53 smithi137 ceph-mon[31694]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:53 smithi186 ceph-mon[31814]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T14:40:53.520 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:53 smithi186 ceph-mon[31814]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:53.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_4 2024-04-23T14:40:54.263 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi007 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 17094M 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:56.141 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:56.142 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.308+0000 7f9c32600700 1 -- 172.21.15.137:0/171904461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c10f140 msgr2=0x7f9c2c111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.308+0000 7f9c32600700 1 --2- 172.21.15.137:0/171904461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c10f140 0x7f9c2c111530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009990 tx=0x7f9c24009ca0 comp rx=0 tx=0).stop 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.308+0000 7f9c32600700 1 -- 172.21.15.137:0/171904461 shutdown_connections 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.308+0000 7f9c32600700 1 --2- 172.21.15.137:0/171904461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c10f140 0x7f9c2c111530 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.309+0000 7f9c32600700 1 --2- 172.21.15.137:0/171904461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c076b20 0x7f9c2c074f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.309+0000 7f9c32600700 1 --2- 172.21.15.137:0/171904461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c075550 0x7f9c2c0759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.309+0000 7f9c32600700 1 -- 172.21.15.137:0/171904461 >> 172.21.15.137:0/171904461 conn(0x7f9c2c0fe0c0 msgr2=0x7f9c2c100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.309+0000 7f9c32600700 1 -- 172.21.15.137:0/171904461 shutdown_connections 2024-04-23T14:40:56.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.309+0000 7f9c32600700 1 -- 172.21.15.137:0/171904461 wait complete. 2024-04-23T14:40:56.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.310+0000 7f9c32600700 1 Processor -- start 2024-04-23T14:40:56.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.310+0000 7f9c32600700 1 -- start start 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c32600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c075550 0x7f9c2c19f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c32600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 0x7f9c2c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c32600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c10f140 0x7f9c2c1a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c32600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c114c00 con 0x7f9c2c10f140 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c32600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c114a80 con 0x7f9c2c076b20 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c32600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c114d80 con 0x7f9c2c075550 2024-04-23T14:40:56.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c22a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 0x7f9c2c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:56.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c22a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 0x7f9c2c19f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42196/0 (socket says 172.21.15.137:42196) 2024-04-23T14:40:56.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c22a00700 1 -- 172.21.15.137:0/3999993063 learned_addr learned my addr 172.21.15.137:0/3999993063 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T14:40:56.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c2b400700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c075550 0x7f9c2c19f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:56.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.311+0000 7f9c2be00700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c10f140 0x7f9c2c1a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c22a00700 1 -- 172.21.15.137:0/3999993063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c075550 msgr2=0x7f9c2c19f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c22a00700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c075550 0x7f9c2c19f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c22a00700 1 -- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c10f140 msgr2=0x7f9c2c1a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c22a00700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c10f140 0x7f9c2c1a67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c22a00700 1 -- 172.21.15.137:0/3999993063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c1a6e60 con 0x7f9c2c076b20 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c2b400700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c075550 0x7f9c2c19f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c2be00700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c10f140 0x7f9c2c1a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c22a00700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 0x7f9c2c19f740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400d980 tx=0x7f9c1400dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14017030 con 0x7f9c2c076b20 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c140044d0 con 0x7f9c2c076b20 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c1a7150 con 0x7f9c2c076b20 2024-04-23T14:40:56.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.312+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14003aa0 con 0x7f9c2c076b20 2024-04-23T14:40:56.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.313+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c1a76e0 con 0x7f9c2c076b20 2024-04-23T14:40:56.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.314+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2c0697e0 con 0x7f9c2c076b20 2024-04-23T14:40:56.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.316+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 15) ==== 138589+0+0 (secure 0 0 0) 0x7f9c1401a070 con 0x7f9c2c076b20 2024-04-23T14:40:56.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.318+0000 7f9c28c00700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9c100a3c30 0x7f9c100a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:56.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.318+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f9c140ce2c0 con 0x7f9c2c076b20 2024-04-23T14:40:56.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.319+0000 7f9c2b400700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9c100a3c30 0x7f9c100a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:56.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.320+0000 7f9c2b400700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9c100a3c30 0x7f9c100a60f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c076f00 tx=0x7f9c1c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.324+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9c1409c710 con 0x7f9c2c076b20 2024-04-23T14:40:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi007 2024-04-23T14:40:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:40:56.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 17094M 2024-04-23T14:40:56.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:56.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:56.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi007 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 17094M 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:56.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:56.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:40:56.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:40:56.559+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9c2c062f30 con 0x7f9c100a3c30 2024-04-23T14:40:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:58.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:57 smithi186 ceph-mon[31814]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:58.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:57 smithi186 ceph-mon[31814]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:58.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:57 smithi137 ceph-mon[31694]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:58.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:57 smithi137 ceph-mon[31694]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:57 smithi007 ceph-mon[27906]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:40:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:57 smithi007 ceph-mon[27906]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:41:00.141 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:40:59 smithi007 ceph-mon[27906]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:00.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:40:59 smithi137 ceph-mon[31694]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:00.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:40:59 smithi186 ceph-mon[31814]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:00 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/857420478' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]: dispatch 2024-04-23T14:41:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:00 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]: dispatch 2024-04-23T14:41:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:00 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]': finished 2024-04-23T14:41:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:00 smithi137 ceph-mon[31694]: osdmap e10: 2 total, 1 up, 2 in 2024-04-23T14:41:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:01.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:00 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/857420478' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]: dispatch 2024-04-23T14:41:01.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:00 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]: dispatch 2024-04-23T14:41:01.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:00 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]': finished 2024-04-23T14:41:01.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:00 smithi007 ceph-mon[27906]: osdmap e10: 2 total, 1 up, 2 in 2024-04-23T14:41:01.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:00 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/857420478' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]: dispatch 2024-04-23T14:41:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:00 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]: dispatch 2024-04-23T14:41:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:00 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb0cc325-66cb-4ed4-866d-ce8820287b97"}]': finished 2024-04-23T14:41:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:00 smithi186 ceph-mon[31814]: osdmap e10: 2 total, 1 up, 2 in 2024-04-23T14:41:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:02.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:01 smithi137 ceph-mon[31694]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:02.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:01 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/1176062431' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:01 smithi007 ceph-mon[27906]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:01 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/1176062431' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:01 smithi186 ceph-mon[31814]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:01 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/1176062431' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:04.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:03 smithi137 ceph-mon[31694]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:03 smithi007 ceph-mon[27906]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:03 smithi186 ceph-mon[31814]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:06.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:05 smithi137 ceph-mon[31694]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:05 smithi007 ceph-mon[27906]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:06.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:05 smithi186 ceph-mon[31814]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:08.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:07 smithi137 ceph-mon[31694]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:08.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:07 smithi007 ceph-mon[27906]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:08.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:07 smithi186 ceph-mon[31814]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:10.103 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:09 smithi137 ceph-mon[31694]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:10.103 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:41:10.103 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:10.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:09 smithi007 ceph-mon[27906]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:10.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:41:10.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:09 smithi186 ceph-mon[31814]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:41:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:11.092 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:10 smithi137 ceph-mon[31694]: Deploying daemon osd.1 on smithi137 2024-04-23T14:41:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:10 smithi007 ceph-mon[27906]: Deploying daemon osd.1 on smithi137 2024-04-23T14:41:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:10 smithi186 ceph-mon[31814]: Deploying daemon osd.1 on smithi137 2024-04-23T14:41:12.162 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:11 smithi137 ceph-mon[31694]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:12.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:11 smithi007 ceph-mon[27906]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:11 smithi186 ceph-mon[31814]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:14.133 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:13 smithi137 ceph-mon[31694]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:14.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:13 smithi007 ceph-mon[27906]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:13 smithi186 ceph-mon[31814]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:15.979 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:15 smithi137 ceph-mon[31694]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:16.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:15 smithi007 ceph-mon[27906]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:16.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:15 smithi186 ceph-mon[31814]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:18.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:17 smithi137 ceph-mon[31694]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:18.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:18.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:18.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:17 smithi007 ceph-mon[27906]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:18.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:18.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:17 smithi186 ceph-mon[31814]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:18.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:18.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:18.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:20.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:19 smithi007 ceph-mon[27906]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:20.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:19 smithi186 ceph-mon[31814]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:19 smithi137 ceph-mon[31694]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:21.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:20 smithi137 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:21.322 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 1 on host 'smithi137' 2024-04-23T14:41:21.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.320+0000 7f9c28c00700 1 -- 172.21.15.137:0/3999993063 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c2c062f30 con 0x7f9c100a3c30 2024-04-23T14:41:21.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9c100a3c30 msgr2=0x7f9c100a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:21.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9c100a3c30 0x7f9c100a60f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c076f00 tx=0x7f9c1c009040 comp rx=0 tx=0).stop 2024-04-23T14:41:21.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 msgr2=0x7f9c2c19f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:21.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 0x7f9c2c19f740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400d980 tx=0x7f9c1400dd40 comp rx=0 tx=0).stop 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 shutdown_connections 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f9c100a3c30 0x7f9c100a60f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c2c10f140 0x7f9c2c1a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2c075550 0x7f9c2c19f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 --2- 172.21.15.137:0/3999993063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c2c076b20 0x7f9c2c19f740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 >> 172.21.15.137:0/3999993063 conn(0x7f9c2c0fe0c0 msgr2=0x7f9c2c1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.324+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 shutdown_connections 2024-04-23T14:41:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:41:21.325+0000 7f9c32600700 1 -- 172.21.15.137:0/3999993063 wait complete. 2024-04-23T14:41:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:20 smithi007 ceph-mon[27906]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:20 smithi186 ceph-mon[31814]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:22.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:22.030 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:22 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:22.084 DEBUG:teuthology.orchestra.run.smithi137:osd.1> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.1.service 2024-04-23T14:41:22.088 INFO:tasks.cephadm:Deploying osd.2 on smithi186 with /dev/vg_nvme/lv_4... 2024-04-23T14:41:22.088 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: from='osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:41:22.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:22.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:22 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:22.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:22 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:22 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:22.522 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:41:23.329 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:23 smithi137 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:41:23.329 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:23 smithi137 ceph-mon[31694]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T14:41:23.329 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:23.329 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:23.330 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:23 smithi137 ceph-mon[31694]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:23 smithi007 ceph-mon[27906]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:41:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:23 smithi007 ceph-mon[27906]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T14:41:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:23 smithi007 ceph-mon[27906]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:23 smithi186 ceph-mon[31814]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:41:23.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:23 smithi186 ceph-mon[31814]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T14:41:23.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:23.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:23.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:23 smithi186 ceph-mon[31814]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:24.329 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:24 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:41:24.339 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:24 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:41:24.339 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:24 smithi186 ceph-mon[31814]: osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] boot 2024-04-23T14:41:24.340 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:24 smithi186 ceph-mon[31814]: osdmap e13: 2 total, 2 up, 2 in 2024-04-23T14:41:24.340 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:24.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:24 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:41:24.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:24 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:41:24.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:24 smithi007 ceph-mon[27906]: osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] boot 2024-04-23T14:41:24.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:24 smithi007 ceph-mon[27906]: osdmap e13: 2 total, 2 up, 2 in 2024-04-23T14:41:24.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:24 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:41:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:24 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:41:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:24 smithi137 ceph-mon[31694]: osd.1 [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] boot 2024-04-23T14:41:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:24 smithi137 ceph-mon[31694]: osdmap e13: 2 total, 2 up, 2 in 2024-04-23T14:41:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:25.198 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T14:41:25.198 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T14:41:25.198 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-04-23T14:41:25.198 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-04-23T14:41:25.198 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0337253 s, 311 MB/s 2024-04-23T14:41:25.199 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-04-23T14:41:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:25 smithi007 ceph-mon[27906]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T14:41:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:25 smithi007 ceph-mon[27906]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:25 smithi186 ceph-mon[31814]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T14:41:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:25 smithi186 ceph-mon[31814]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:25 smithi137 ceph-mon[31694]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T14:41:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:25 smithi137 ceph-mon[31694]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:26.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_4 2024-04-23T14:41:26.416 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi137 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 17089M 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:27.720 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi137 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 17089M 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:27.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi137 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 17089M 2024-04-23T14:41:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:27.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:27.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:27.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:28.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2134684258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34076b20 msgr2=0x7f6a34074f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:28.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2134684258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34076b20 0x7f6a34074f80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009990 tx=0x7f6a24009ca0 comp rx=0 tx=0).stop 2024-04-23T14:41:28.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2134684258 shutdown_connections 2024-04-23T14:41:28.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2134684258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a3410f140 0x7f6a34111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:28.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2134684258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34076b20 0x7f6a34074f80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:28.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2134684258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a34075550 0x7f6a340759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:28.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2134684258 >> 172.21.15.186:0/2134684258 conn(0x7f6a340fe0c0 msgr2=0x7f6a34100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:41:28.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2134684258 shutdown_connections 2024-04-23T14:41:28.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.495+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2134684258 wait complete. 2024-04-23T14:41:28.499 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.496+0000 7f6a3ac00700 1 Processor -- start 2024-04-23T14:41:28.499 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.496+0000 7f6a3ac00700 1 -- start start 2024-04-23T14:41:28.499 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a3ac00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 0x7f6a3419f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:28.499 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a3ac00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a34076b20 0x7f6a3419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:28.499 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a3ac00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a3410f140 0x7f6a341a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a3ac00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a34114be0 con 0x7f6a34076b20 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a3ac00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a34114a60 con 0x7f6a3410f140 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a3ac00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a34114d60 con 0x7f6a34075550 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a33e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 0x7f6a3419f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a33e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 0x7f6a3419f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:55428/0 (socket says 172.21.15.186:55428) 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a33e00700 1 -- 172.21.15.186:0/2757239022 learned_addr learned my addr 172.21.15.186:0/2757239022 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a33400700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a34076b20 0x7f6a3419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.497+0000 7f6a38c00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a3410f140 0x7f6a341a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a33e00700 1 -- 172.21.15.186:0/2757239022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a3410f140 msgr2=0x7f6a341a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a33e00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a3410f140 0x7f6a341a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:28.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a33e00700 1 -- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a34076b20 msgr2=0x7f6a3419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a33e00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a34076b20 0x7f6a3419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a33e00700 1 -- 172.21.15.186:0/2757239022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a341a6f10 con 0x7f6a34075550 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a33e00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 0x7f6a3419f2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000c00 tx=0x7f6a24009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.498+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24027070 con 0x7f6a34075550 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.499+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a24004190 con 0x7f6a34075550 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.499+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24022e60 con 0x7f6a34075550 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.499+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a341a71a0 con 0x7f6a34075550 2024-04-23T14:41:28.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.499+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a341a76d0 con 0x7f6a34075550 2024-04-23T14:41:28.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.500+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a340697e0 con 0x7f6a34075550 2024-04-23T14:41:28.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.502+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 15) ==== 138589+0+0 (secure 0 0 0) 0x7f6a2402a070 con 0x7f6a34075550 2024-04-23T14:41:28.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.504+0000 7f6a30c00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a180a3c30 0x7f6a180a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:28.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.504+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f6a240cf8e0 con 0x7f6a34075550 2024-04-23T14:41:28.505 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.505+0000 7f6a33400700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a180a3c30 0x7f6a180a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:28.506 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.506+0000 7f6a33400700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a180a3c30 0x7f6a180a60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a34076850 tx=0x7f6a2000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:41:28.510 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.510+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6a24013070 con 0x7f6a34075550 2024-04-23T14:41:28.746 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:28.746+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6a34062ff0 con 0x7f6a180a3c30 2024-04-23T14:41:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:29 smithi007 ceph-mon[27906]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:29 smithi007 ceph-mon[27906]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:41:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:41:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:41:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:29 smithi186 ceph-mon[31814]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:29 smithi186 ceph-mon[31814]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:41:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:41:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:41:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:29 smithi137 ceph-mon[31694]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:29 smithi137 ceph-mon[31694]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:41:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:41:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:41:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:31.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:31 smithi186 ceph-mon[31814]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:31 smithi007 ceph-mon[27906]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:31 smithi137 ceph-mon[31694]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/171593914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]: dispatch 2024-04-23T14:41:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]: dispatch 2024-04-23T14:41:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]': finished 2024-04-23T14:41:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: osdmap e15: 3 total, 2 up, 3 in 2024-04-23T14:41:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:33 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/2284917617' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/171593914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]: dispatch 2024-04-23T14:41:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]: dispatch 2024-04-23T14:41:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]': finished 2024-04-23T14:41:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: osdmap e15: 3 total, 2 up, 3 in 2024-04-23T14:41:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:33 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/2284917617' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:33.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:33.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/171593914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]: dispatch 2024-04-23T14:41:33.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]: dispatch 2024-04-23T14:41:33.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc"}]': finished 2024-04-23T14:41:33.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: osdmap e15: 3 total, 2 up, 3 in 2024-04-23T14:41:33.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:33.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:33 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/2284917617' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:35 smithi007 ceph-mon[27906]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:35 smithi186 ceph-mon[31814]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:35 smithi137 ceph-mon[31694]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:37.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:37 smithi007 ceph-mon[27906]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:37 smithi186 ceph-mon[31814]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:37 smithi137 ceph-mon[31694]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:39.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:39 smithi186 ceph-mon[31814]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:39 smithi007 ceph-mon[27906]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:39.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:39 smithi137 ceph-mon[31694]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:41 smithi007 ceph-mon[27906]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:41:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:41 smithi186 ceph-mon[31814]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:41:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:41 smithi137 ceph-mon[31694]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:41:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:42.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:42 smithi186 ceph-mon[31814]: Deploying daemon osd.2 on smithi186 2024-04-23T14:41:42.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:42 smithi137 ceph-mon[31694]: Deploying daemon osd.2 on smithi186 2024-04-23T14:41:43.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:42 smithi007 ceph-mon[27906]: Deploying daemon osd.2 on smithi186 2024-04-23T14:41:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:43 smithi186 ceph-mon[31814]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:43 smithi137 ceph-mon[31694]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:43 smithi007 ceph-mon[27906]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:45 smithi186 ceph-mon[31814]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:45 smithi137 ceph-mon[31694]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:45 smithi007 ceph-mon[27906]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:47 smithi186 ceph-mon[31814]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:47 smithi137 ceph-mon[31694]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:47 smithi007 ceph-mon[27906]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:49 smithi137 ceph-mon[31694]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:49.942 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:49.943 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:49.943 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:49 smithi007 ceph-mon[27906]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:49 smithi186 ceph-mon[31814]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:51 smithi137 ceph-mon[31694]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:51 smithi007 ceph-mon[27906]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:52.106 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:51 smithi186 ceph-mon[31814]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:53.322 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:53.322 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:53.323 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:53 smithi186 ceph-mon[31814]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:53 smithi007 ceph-mon[27906]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:53 smithi137 ceph-mon[31694]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:53.967 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.966+0000 7f6a30c00700 1 -- 172.21.15.186:0/2757239022 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6a34062ff0 con 0x7f6a180a3c30 2024-04-23T14:41:53.968 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 2 on host 'smithi186' 2024-04-23T14:41:53.970 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.969+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a180a3c30 msgr2=0x7f6a180a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:53.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.969+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a180a3c30 0x7f6a180a60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a34076850 tx=0x7f6a2000b5b0 comp rx=0 tx=0).stop 2024-04-23T14:41:53.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.969+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 msgr2=0x7f6a3419f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:53.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.969+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 0x7f6a3419f2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000c00 tx=0x7f6a24009580 comp rx=0 tx=0).stop 2024-04-23T14:41:53.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 shutdown_connections 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a180a3c30 0x7f6a180a60f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a3410f140 0x7f6a341a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a34075550 0x7f6a3419f2b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 --2- 172.21.15.186:0/2757239022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a34076b20 0x7f6a3419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 >> 172.21.15.186:0/2757239022 conn(0x7f6a340fe0c0 msgr2=0x7f6a341024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 shutdown_connections 2024-04-23T14:41:53.972 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:41:53.970+0000 7f6a3ac00700 1 -- 172.21.15.186:0/2757239022 wait complete. 2024-04-23T14:41:54.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:54.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:54.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:41:54.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:41:54.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:54 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:54 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:54 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:54.812 DEBUG:teuthology.orchestra.run.smithi186:osd.2> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.2.service 2024-04-23T14:41:54.817 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_3... 2024-04-23T14:41:54.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T14:41:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:41:55.303 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-mon[31814]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:55.304 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-mon[31814]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:41:55.304 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-mon[31814]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T14:41:55.304 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:55.304 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-mon[31814]: from='osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:41:55.304 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-mon[31814]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:41:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:55 smithi007 ceph-mon[27906]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:55 smithi007 ceph-mon[27906]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:41:55.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:55 smithi007 ceph-mon[27906]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T14:41:55.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:55 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:55.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:55 smithi007 ceph-mon[27906]: from='osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:41:55.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:55 smithi007 ceph-mon[27906]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:41:55.610 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2[37035]: 2024-04-23T14:41:55.301+0000 7f73f7a00700 -1 osd.2 0 waiting for initial osdmap 2024-04-23T14:41:55.610 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:55 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2[37035]: 2024-04-23T14:41:55.310+0000 7f73f2800700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:41:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:55 smithi137 ceph-mon[31694]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:55 smithi137 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:41:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:55 smithi137 ceph-mon[31694]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T14:41:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:55 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:55 smithi137 ceph-mon[31694]: from='osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:41:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:55 smithi137 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:41:56.499 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:56 smithi186 ceph-mon[31814]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:41:56.499 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:56 smithi186 ceph-mon[31814]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T14:41:56.499 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:56.499 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:56.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:56 smithi007 ceph-mon[27906]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:41:56.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:56 smithi007 ceph-mon[27906]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T14:41:56.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:56.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:56.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:56 smithi137 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:41:56.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:56 smithi137 ceph-mon[31694]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T14:41:56.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:56.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:57.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:41:57.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:41:57.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:57.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] boot 2024-04-23T14:41:57.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: osdmap e18: 3 total, 3 up, 3 in 2024-04-23T14:41:57.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:57.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:41:57.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:41:57.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:41:57.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:57.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] boot 2024-04-23T14:41:57.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: osdmap e18: 3 total, 3 up, 3 in 2024-04-23T14:41:57.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:57.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: osd.2 [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] boot 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: osdmap e18: 3 total, 3 up, 3 in 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:41:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:41:58.361 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T14:41:58.362 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T14:41:58.362 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-04-23T14:41:58.362 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-04-23T14:41:58.362 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.060489 s, 173 MB/s 2024-04-23T14:41:58.362 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-04-23T14:41:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-23T14:41:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:58 smithi007 ceph-mon[27906]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T14:41:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:41:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-23T14:41:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:58 smithi186 ceph-mon[31814]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T14:41:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:41:58.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-23T14:41:58.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:58 smithi137 ceph-mon[31694]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T14:41:58.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:41:59.086 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44072]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44072]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44075]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44075]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44075]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.087 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 14:41:58 smithi007 sudo[44075]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40053]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40053]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40053]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40053]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40056]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40056]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40056]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.169 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 14:41:58 smithi137 sudo[40056]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-04-23T14:41:59.293 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40863]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40863]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40863]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40863]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40866]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40866]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40866]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.294 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40866]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44079]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44079]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44079]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44079]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44082]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 sudo[44082]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40869]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:41:59.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40869]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40869]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40869]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40872]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40872]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40872]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 sudo[40872]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: pgmap v107: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:41:59.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:41:59.616 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:41:59.616 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:41:59.616 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:41:59.616 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:41:59.616 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:41:59 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:41:59.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40059]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40059]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40059]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40059]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40062]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40062]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40062]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 sudo[40062]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: pgmap v107: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T14:41:59.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:41:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:41:59 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:41:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:41:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: pgmap v107: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:41:59.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:41:59.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T14:41:59.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T14:41:59.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:41:59.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:41:59.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:41:59.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:41:59.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:41:59.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:41:59.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:41:59.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:41:59.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:41:59 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi186 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:00.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 17089M 2024-04-23T14:42:00.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:00.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:00.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi186 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:00.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 17089M 2024-04-23T14:42:00.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:00.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:00.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi186 2024-04-23T14:42:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 17089M 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:00.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:01.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:01 smithi007 ceph-mon[27906]: pgmap v110: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:01.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:01 smithi007 ceph-mon[27906]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:42:01.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:01 smithi007 ceph-mon[27906]: Cluster is now healthy 2024-04-23T14:42:01.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:01 smithi007 ceph-mon[27906]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-04-23T14:42:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:01 smithi186 ceph-mon[31814]: pgmap v110: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:01 smithi186 ceph-mon[31814]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:42:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:01 smithi186 ceph-mon[31814]: Cluster is now healthy 2024-04-23T14:42:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:01 smithi186 ceph-mon[31814]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-04-23T14:42:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:01 smithi137 ceph-mon[31694]: pgmap v110: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:01 smithi137 ceph-mon[31694]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:42:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:01 smithi137 ceph-mon[31694]: Cluster is now healthy 2024-04-23T14:42:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:01 smithi137 ceph-mon[31694]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-04-23T14:42:01.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 -- 172.21.15.7:0/127569038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3244101d30 msgr2=0x7f32441021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 --2- 172.21.15.7:0/127569038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3244101d30 0x7f32441021b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f322c009990 tx=0x7f322c009ca0 comp rx=0 tx=0).stop 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 -- 172.21.15.7:0/127569038 shutdown_connections 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 --2- 172.21.15.7:0/127569038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32441026f0 0x7f3244102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 --2- 172.21.15.7:0/127569038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32441013d0 0x7f32441017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 --2- 172.21.15.7:0/127569038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3244101d30 0x7f32441021b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 -- 172.21.15.7:0/127569038 >> 172.21.15.7:0/127569038 conn(0x7f32440fcff0 msgr2=0x7f32440ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 -- 172.21.15.7:0/127569038 shutdown_connections 2024-04-23T14:42:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.949+0000 7f3249800700 1 -- 172.21.15.7:0/127569038 wait complete. 2024-04-23T14:42:01.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.950+0000 7f3249800700 1 Processor -- start 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.950+0000 7f3249800700 1 -- start start 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.950+0000 7f3249800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32441013d0 0x7f324419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3249800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3244101d30 0x7f324419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3249800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 0x7f32441a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3249800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3244110800 con 0x7f32441026f0 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3249800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3244110680 con 0x7f3244101d30 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3249800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3244110980 con 0x7f32441013d0 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3243400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 0x7f32441a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3242a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32441013d0 0x7f324419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3243400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 0x7f32441a24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56806/0 (socket says 172.21.15.7:56806) 2024-04-23T14:42:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f3243400700 1 -- 172.21.15.7:0/1178731868 learned_addr learned my addr 172.21.15.7:0/1178731868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:42:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.951+0000 7f323be00700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3244101d30 0x7f324419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3243400700 1 -- 172.21.15.7:0/1178731868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32441013d0 msgr2=0x7f324419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3243400700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32441013d0 0x7f324419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3243400700 1 -- 172.21.15.7:0/1178731868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3244101d30 msgr2=0x7f324419b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3243400700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3244101d30 0x7f324419b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3243400700 1 -- 172.21.15.7:0/1178731868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32441a2b40 con 0x7f32441026f0 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3243400700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 0x7f32441a24a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f323c007f10 tx=0x7f323c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c004bb0 con 0x7f32441026f0 2024-04-23T14:42:01.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f323c004d50 con 0x7f32441026f0 2024-04-23T14:42:01.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32441a2e30 con 0x7f32441026f0 2024-04-23T14:42:01.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.952+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0058e0 con 0x7f32441026f0 2024-04-23T14:42:01.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.953+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32441a3330 con 0x7f32441026f0 2024-04-23T14:42:01.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.954+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32440697e0 con 0x7f32441026f0 2024-04-23T14:42:01.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.956+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f323c01a020 con 0x7f32441026f0 2024-04-23T14:42:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.957+0000 7f323b400700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f32280a3cc0 0x7f32280a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.957+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f323c0ce770 con 0x7f32441026f0 2024-04-23T14:42:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.958+0000 7f3242a00700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f32280a3cc0 0x7f32280a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.958+0000 7f3242a00700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f32280a3cc0 0x7f32280a6180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3234005950 tx=0x7f323400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:01.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:01.961+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f323c010070 con 0x7f32441026f0 2024-04-23T14:42:02.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:02.206+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3244062f30 con 0x7f32280a3cc0 2024-04-23T14:42:02.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:02.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:02.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:02.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:02.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:02.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:03 smithi007 ceph-mon[27906]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:03 smithi007 ceph-mon[27906]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:03 smithi186 ceph-mon[31814]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:03 smithi186 ceph-mon[31814]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:03 smithi137 ceph-mon[31694]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:03 smithi137 ceph-mon[31694]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:05.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:05 smithi007 ceph-mon[27906]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:05 smithi186 ceph-mon[31814]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:05 smithi137 ceph-mon[31694]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:06 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1852035931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "546655c4-16cd-4be5-a422-aa644ef9c0e3"}]: dispatch 2024-04-23T14:42:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:06 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1852035931' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "546655c4-16cd-4be5-a422-aa644ef9c0e3"}]': finished 2024-04-23T14:42:06.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:06 smithi186 ceph-mon[31814]: osdmap e22: 4 total, 3 up, 4 in 2024-04-23T14:42:06.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:06 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:06 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1852035931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "546655c4-16cd-4be5-a422-aa644ef9c0e3"}]: dispatch 2024-04-23T14:42:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:06 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1852035931' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "546655c4-16cd-4be5-a422-aa644ef9c0e3"}]': finished 2024-04-23T14:42:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:06 smithi007 ceph-mon[27906]: osdmap e22: 4 total, 3 up, 4 in 2024-04-23T14:42:06.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:06 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:06 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1852035931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "546655c4-16cd-4be5-a422-aa644ef9c0e3"}]: dispatch 2024-04-23T14:42:06.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:06 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1852035931' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "546655c4-16cd-4be5-a422-aa644ef9c0e3"}]': finished 2024-04-23T14:42:06.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:06 smithi137 ceph-mon[31694]: osdmap e22: 4 total, 3 up, 4 in 2024-04-23T14:42:06.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:06 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:07 smithi007 ceph-mon[27906]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1193629198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:07 smithi186 ceph-mon[31814]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1193629198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:07 smithi137 ceph-mon[31694]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1193629198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:09 smithi007 ceph-mon[27906]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:09 smithi186 ceph-mon[31814]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:09 smithi137 ceph-mon[31694]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:11 smithi007 ceph-mon[27906]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:11 smithi186 ceph-mon[31814]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:11 smithi137 ceph-mon[31694]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:13.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:13 smithi007 ceph-mon[27906]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:13 smithi186 ceph-mon[31814]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:13 smithi137 ceph-mon[31694]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:15.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:15 smithi007 ceph-mon[27906]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:15.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:15 smithi186 ceph-mon[31814]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:15 smithi137 ceph-mon[31694]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:16.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:42:16.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:16.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:42:16.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:16.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:42:16.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:17.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:17 smithi007 ceph-mon[27906]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:17.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:17 smithi007 ceph-mon[27906]: Deploying daemon osd.3 on smithi007 2024-04-23T14:42:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:17 smithi186 ceph-mon[31814]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:17 smithi186 ceph-mon[31814]: Deploying daemon osd.3 on smithi007 2024-04-23T14:42:17.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:17 smithi137 ceph-mon[31694]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:17.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:17 smithi137 ceph-mon[31694]: Deploying daemon osd.3 on smithi007 2024-04-23T14:42:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:19 smithi007 ceph-mon[27906]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:19 smithi186 ceph-mon[31814]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:19 smithi137 ceph-mon[31694]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:21 smithi137 ceph-mon[31694]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:21.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:21 smithi007 ceph-mon[27906]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:21 smithi186 ceph-mon[31814]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:23.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:23 smithi007 ceph-mon[27906]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:23 smithi186 ceph-mon[31814]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:23 smithi137 ceph-mon[31694]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:25.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:25 smithi007 ceph-mon[27906]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:25.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:25.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:25.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:25 smithi186 ceph-mon[31814]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:25.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:25 smithi137 ceph-mon[31694]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:25.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:25.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:25.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:27 smithi007 ceph-mon[27906]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:27 smithi186 ceph-mon[31814]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:27 smithi137 ceph-mon[31694]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:29 smithi007 ceph-mon[27906]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:29 smithi007 ceph-mon[27906]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:42:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:29 smithi186 ceph-mon[31814]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:29 smithi186 ceph-mon[31814]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:42:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:29 smithi137 ceph-mon[31694]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:29 smithi137 ceph-mon[31694]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:42:30.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.663+0000 7f323b400700 1 -- 172.21.15.7:0/1178731868 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3244062f30 con 0x7f32280a3cc0 2024-04-23T14:42:30.665 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-04-23T14:42:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.668+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f32280a3cc0 msgr2=0x7f32280a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.668+0000 7f3249800700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f32280a3cc0 0x7f32280a6180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3234005950 tx=0x7f323400a300 comp rx=0 tx=0).stop 2024-04-23T14:42:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.668+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 msgr2=0x7f32441a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.668+0000 7f3249800700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 0x7f32441a24a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f323c007f10 tx=0x7f323c00d3b0 comp rx=0 tx=0).stop 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 shutdown_connections 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f32280a3cc0 0x7f32280a6180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32441026f0 0x7f32441a24a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32441013d0 0x7f324419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 --2- 172.21.15.7:0/1178731868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3244101d30 0x7f324419b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 >> 172.21.15.7:0/1178731868 conn(0x7f32440fcff0 msgr2=0x7f32440feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 shutdown_connections 2024-04-23T14:42:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:42:30.669+0000 7f3249800700 1 -- 172.21.15.7:0/1178731868 wait complete. 2024-04-23T14:42:30.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:42:30.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: osdmap e23: 4 total, 3 up, 4 in 2024-04-23T14:42:30.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:42:30.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:30.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:30.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:30.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: osdmap e23: 4 total, 3 up, 4 in 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: osdmap e23: 4 total, 3 up, 4 in 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:31.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:31 smithi186 ceph-mon[31814]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:31.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:31.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:31 smithi007 ceph-mon[27906]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' 2024-04-23T14:42:31.871 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.3.service 2024-04-23T14:42:31.879 INFO:tasks.cephadm:Deploying osd.4 on smithi137 with /dev/vg_nvme/lv_3... 2024-04-23T14:42:31.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T14:42:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:31 smithi137 ceph-mon[31694]: from='osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578]' entity='osd.3' 2024-04-23T14:42:32.316 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:42:32.716 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:32 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:42:32.717 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:32 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:42:32.717 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:32 smithi137 ceph-mon[31694]: osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] boot 2024-04-23T14:42:32.717 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:32 smithi137 ceph-mon[31694]: osdmap e25: 4 total, 4 up, 4 in 2024-04-23T14:42:32.717 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:32 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:32.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:32 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:42:32.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:32 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:42:32.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:32 smithi007 ceph-mon[27906]: osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] boot 2024-04-23T14:42:32.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:32 smithi007 ceph-mon[27906]: osdmap e25: 4 total, 4 up, 4 in 2024-04-23T14:42:32.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:32 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:32 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:42:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:32 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:42:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:32 smithi186 ceph-mon[31814]: osd.3 [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] boot 2024-04-23T14:42:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:32 smithi186 ceph-mon[31814]: osdmap e25: 4 total, 4 up, 4 in 2024-04-23T14:42:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:32 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:33 smithi007 ceph-mon[27906]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:33 smithi007 ceph-mon[27906]: osdmap e26: 4 total, 4 up, 4 in 2024-04-23T14:42:33.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:33 smithi137 ceph-mon[31694]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:33.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:33 smithi137 ceph-mon[31694]: osdmap e26: 4 total, 4 up, 4 in 2024-04-23T14:42:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:33 smithi186 ceph-mon[31814]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:33 smithi186 ceph-mon[31814]: osdmap e26: 4 total, 4 up, 4 in 2024-04-23T14:42:34.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:34 smithi007 ceph-mon[27906]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T14:42:34.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:34 smithi137 ceph-mon[31694]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T14:42:35.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:34 smithi186 ceph-mon[31814]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.033839 s, 310 MB/s 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 2024-04-23T14:42:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-23T14:42:35.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:35 smithi137 ceph-mon[31694]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:35.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:35 smithi137 ceph-mon[31694]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T14:42:36.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_3 2024-04-23T14:42:36.154 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:35 smithi186 ceph-mon[31814]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:36.154 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:35 smithi186 ceph-mon[31814]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T14:42:36.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:35 smithi007 ceph-mon[27906]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:36.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:35 smithi007 ceph-mon[27906]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T14:42:36.579 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:42:36.934 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:36 smithi137 ceph-mon[31694]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T14:42:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:36 smithi007 ceph-mon[27906]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T14:42:37.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:36 smithi186 ceph-mon[31814]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:37.898 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:37.899 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:37.899 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:38.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:38.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:42:38.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 -- 172.21.15.137:0/161328671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818103630 msgr2=0x7ff818105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 --2- 172.21.15.137:0/161328671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818103630 0x7ff818105a20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff80800b0a0 tx=0x7ff80800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 -- 172.21.15.137:0/161328671 shutdown_connections 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 --2- 172.21.15.137:0/161328671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff818108890 0x7ff81810aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 --2- 172.21.15.137:0/161328671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818103630 0x7ff818105a20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 --2- 172.21.15.137:0/161328671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 0x7ff818108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 -- 172.21.15.137:0/161328671 >> 172.21.15.137:0/161328671 conn(0x7ff8180fcfe0 msgr2=0x7ff8180ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 -- 172.21.15.137:0/161328671 shutdown_connections 2024-04-23T14:42:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.711+0000 7ff81dc00700 1 -- 172.21.15.137:0/161328671 wait complete. 2024-04-23T14:42:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.712+0000 7ff81dc00700 1 Processor -- start 2024-04-23T14:42:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.712+0000 7ff81dc00700 1 -- start start 2024-04-23T14:42:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff81dc00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff818103630 0x7ff81819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff81dc00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 0x7ff81819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff81dc00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 0x7ff8181a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff81dc00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff81810e630 con 0x7ff818105f60 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff81dc00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff81810e4b0 con 0x7ff818108890 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff81dc00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff81810e7b0 con 0x7ff818103630 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff817400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 0x7ff8181a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff817400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 0x7ff8181a24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49986/0 (socket says 172.21.15.137:49986) 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff817400700 1 -- 172.21.15.137:0/3451827264 learned_addr learned my addr 172.21.15.137:0/3451827264 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff816a00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff818103630 0x7ff81819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.713+0000 7ff80e000700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 0x7ff81819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff817400700 1 -- 172.21.15.137:0/3451827264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff818103630 msgr2=0x7ff81819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff817400700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff818103630 0x7ff81819af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff817400700 1 -- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 msgr2=0x7ff81819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff817400700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 0x7ff81819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff817400700 1 -- 172.21.15.137:0/3451827264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8181a2b60 con 0x7ff818108890 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff80e000700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 0x7ff81819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff817400700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 0x7ff8181a24c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff81000d950 tx=0x7ff81000dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810017070 con 0x7ff818108890 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff810009df0 con 0x7ff818108890 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8100053a0 con 0x7ff818108890 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8181a2e50 con 0x7ff818108890 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.714+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8181a32b0 con 0x7ff818108890 2024-04-23T14:42:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.715+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8180697e0 con 0x7ff818108890 2024-04-23T14:42:38.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.718+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7ff810005540 con 0x7ff818108890 2024-04-23T14:42:38.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.719+0000 7ff80fe00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7fc0a3c40 0x7ff7fc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:38.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.719+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7ff8100cef20 con 0x7ff818108890 2024-04-23T14:42:38.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.720+0000 7ff816a00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7fc0a3c40 0x7ff7fc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:38.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.721+0000 7ff816a00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7fc0a3c40 0x7ff7fc0a6100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff808009fd0 tx=0x7ff80800b7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:38.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.723+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff81009ca80 con 0x7ff818108890 2024-04-23T14:42:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:38 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi007 2024-04-23T14:42:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:38 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 8547M 2024-04-23T14:42:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:42:38.958+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff818062f30 con 0x7ff7fc0a3c40 2024-04-23T14:42:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:38 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi007 2024-04-23T14:42:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:38 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 8547M 2024-04-23T14:42:39.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:38 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi007 2024-04-23T14:42:39.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:38 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 8547M 2024-04-23T14:42:39.950 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:39 smithi137 ceph-mon[31694]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-23T14:42:39.951 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:39 smithi137 ceph-mon[31694]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:39.951 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:39.951 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:39.951 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:39 smithi007 ceph-mon[27906]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-23T14:42:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:39 smithi007 ceph-mon[27906]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:40.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:40.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:39 smithi186 ceph-mon[31814]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-23T14:42:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:39 smithi186 ceph-mon[31814]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:41.801 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:41 smithi137 ceph-mon[31694]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-04-23T14:42:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:41 smithi007 ceph-mon[27906]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-04-23T14:42:42.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:41 smithi186 ceph-mon[31814]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-04-23T14:42:43.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:43 smithi137 ceph-mon[31694]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:42:43.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:43 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/2016931344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]: dispatch 2024-04-23T14:42:43.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:43 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]: dispatch 2024-04-23T14:42:43.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:43 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]': finished 2024-04-23T14:42:43.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:43 smithi137 ceph-mon[31694]: osdmap e30: 5 total, 4 up, 5 in 2024-04-23T14:42:43.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:42:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:43 smithi007 ceph-mon[27906]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:42:44.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:43 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/2016931344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]: dispatch 2024-04-23T14:42:44.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:43 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]: dispatch 2024-04-23T14:42:44.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:43 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]': finished 2024-04-23T14:42:44.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:43 smithi007 ceph-mon[27906]: osdmap e30: 5 total, 4 up, 5 in 2024-04-23T14:42:44.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:42:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:43 smithi186 ceph-mon[31814]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:42:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:43 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/2016931344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]: dispatch 2024-04-23T14:42:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:43 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]: dispatch 2024-04-23T14:42:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:43 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06dad351-e05a-4c7b-83bc-e1e8757bc711"}]': finished 2024-04-23T14:42:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:43 smithi186 ceph-mon[31814]: osdmap e30: 5 total, 4 up, 5 in 2024-04-23T14:42:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:42:45.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:44 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/4083070929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:44 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/4083070929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:45.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:44 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/4083070929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:45 smithi007 ceph-mon[27906]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-23T14:42:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:45 smithi186 ceph-mon[31814]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-23T14:42:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:45 smithi137 ceph-mon[31694]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-23T14:42:47.816 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:47 smithi137 ceph-mon[31694]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:42:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:47 smithi007 ceph-mon[27906]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:42:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:47 smithi186 ceph-mon[31814]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:42:49.829 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:49 smithi137 ceph-mon[31694]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:49 smithi007 ceph-mon[27906]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:49 smithi186 ceph-mon[31814]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:51 smithi007 ceph-mon[27906]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:52.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:51 smithi186 ceph-mon[31814]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:51 smithi137 ceph-mon[31694]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:53.011 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:52 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:42:53.011 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:52 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:53.012 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:52 smithi137 ceph-mon[31694]: Deploying daemon osd.4 on smithi137 2024-04-23T14:42:53.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:52 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:42:53.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:52 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:53.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:52 smithi007 ceph-mon[27906]: Deploying daemon osd.4 on smithi137 2024-04-23T14:42:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:52 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:42:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:52 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:52 smithi186 ceph-mon[31814]: Deploying daemon osd.4 on smithi137 2024-04-23T14:42:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:53 smithi007 ceph-mon[27906]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:54.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:53 smithi186 ceph-mon[31814]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:53 smithi137 ceph-mon[31694]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:55.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:55 smithi137 ceph-mon[31694]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:55 smithi007 ceph-mon[27906]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:55 smithi186 ceph-mon[31814]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:57 smithi007 ceph-mon[27906]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:58.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:57 smithi186 ceph-mon[31814]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:58.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:57 smithi137 ceph-mon[31694]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:42:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:42:59 smithi137 ceph-mon[31694]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:42:59 smithi007 ceph-mon[27906]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:00.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:42:59 smithi186 ceph-mon[31814]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:01.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:01.113 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:01.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:01.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:02.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:01 smithi186 ceph-mon[31814]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:02.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:01 smithi137 ceph-mon[31694]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:01 smithi007 ceph-mon[27906]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:03 smithi007 ceph-mon[27906]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:04.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:04.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:03 smithi007 ceph-mon[27906]: from='osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:04.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:03 smithi007 ceph-mon[27906]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:03 smithi186 ceph-mon[31814]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:03 smithi186 ceph-mon[31814]: from='osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:03 smithi186 ceph-mon[31814]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:04.126 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:03 smithi137 ceph-mon[31694]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:04.126 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:04.126 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:04.126 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:03 smithi137 ceph-mon[31694]: from='osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:04.126 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:03 smithi137 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:04.224 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 4 on host 'smithi137' 2024-04-23T14:43:04.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.222+0000 7ff80fe00700 1 -- 172.21.15.137:0/3451827264 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff818062f30 con 0x7ff7fc0a3c40 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7fc0a3c40 msgr2=0x7ff7fc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7fc0a3c40 0x7ff7fc0a6100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff808009fd0 tx=0x7ff80800b7f0 comp rx=0 tx=0).stop 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 msgr2=0x7ff8181a24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 0x7ff8181a24c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff81000d950 tx=0x7ff81000dd10 comp rx=0 tx=0).stop 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 shutdown_connections 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7fc0a3c40 0x7ff7fc0a6100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:04.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff818108890 0x7ff8181a24c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:04.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff818103630 0x7ff81819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:04.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 --2- 172.21.15.137:0/3451827264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff818105f60 0x7ff81819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:04.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 >> 172.21.15.137:0/3451827264 conn(0x7ff8180fcfe0 msgr2=0x7ff818102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:04.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 shutdown_connections 2024-04-23T14:43:04.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:43:04.225+0000 7ff81dc00700 1 -- 172.21.15.137:0/3451827264 wait complete. 2024-04-23T14:43:05.047 DEBUG:teuthology.orchestra.run.smithi137:osd.4> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.4.service 2024-04-23T14:43:05.053 INFO:tasks.cephadm:Deploying osd.5 on smithi186 with /dev/vg_nvme/lv_3... 2024-04-23T14:43:05.053 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T14:43:05.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:05.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:05.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:05.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:43:05.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: osdmap e31: 5 total, 4 up, 5 in 2024-04-23T14:43:05.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:05.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: from='osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:43:05.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:43:05.494 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:43:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:05.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:43:05.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: osdmap e31: 5 total, 4 up, 5 in 2024-04-23T14:43:05.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:05.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: from='osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:43:05.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:05 smithi007 ceph-mon[27906]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:43:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:05.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:43:05.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: osdmap e31: 5 total, 4 up, 5 in 2024-04-23T14:43:05.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:05.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: from='osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:43:05.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:05 smithi186 ceph-mon[31814]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:43:05.664 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4[42789]: 2024-04-23T14:43:05.529+0000 7fd8ba800700 -1 osd.4 0 waiting for initial osdmap 2024-04-23T14:43:05.664 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 14:43:05 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4[42789]: 2024-04-23T14:43:05.538+0000 7fd8b5600700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:43:06.814 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:06 smithi137 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:43:06.814 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:06 smithi137 ceph-mon[31694]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T14:43:06.814 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:06 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:06.814 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:06 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:06.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:06 smithi186 ceph-mon[31814]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:43:06.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:06 smithi186 ceph-mon[31814]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T14:43:06.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:06 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:06.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:06 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:06 smithi007 ceph-mon[27906]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:43:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:06 smithi007 ceph-mon[27906]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T14:43:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:06 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:06 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:07 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:43:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:07 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:43:07.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:07 smithi007 ceph-mon[27906]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:07.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:07 smithi007 ceph-mon[27906]: osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] boot 2024-04-23T14:43:07.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:07 smithi007 ceph-mon[27906]: osdmap e33: 5 total, 5 up, 5 in 2024-04-23T14:43:07.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:07 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:07 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:43:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:07 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:43:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:07 smithi186 ceph-mon[31814]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:07 smithi186 ceph-mon[31814]: osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] boot 2024-04-23T14:43:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:07 smithi186 ceph-mon[31814]: osdmap e33: 5 total, 5 up, 5 in 2024-04-23T14:43:07.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:07 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:07 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:43:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:07 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:43:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:07 smithi137 ceph-mon[31694]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-23T14:43:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:07 smithi137 ceph-mon[31694]: osd.4 [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] boot 2024-04-23T14:43:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:07 smithi137 ceph-mon[31694]: osdmap e33: 5 total, 5 up, 5 in 2024-04-23T14:43:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:07 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:08.342 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T14:43:08.342 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T14:43:08.342 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-04-23T14:43:08.342 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-04-23T14:43:08.342 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0386375 s, 271 MB/s 2024-04-23T14:43:08.342 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-04-23T14:43:08.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:08 smithi186 ceph-mon[31814]: osdmap e34: 5 total, 5 up, 5 in 2024-04-23T14:43:08.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:08 smithi007 ceph-mon[27906]: osdmap e34: 5 total, 5 up, 5 in 2024-04-23T14:43:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:08 smithi137 ceph-mon[31694]: osdmap e34: 5 total, 5 up, 5 in 2024-04-23T14:43:09.118 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_3 2024-04-23T14:43:09.548 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:43:09.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:09 smithi137 ceph-mon[31694]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:09 smithi007 ceph-mon[27906]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:09.850 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:09 smithi186 ceph-mon[31814]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi137 2024-04-23T14:43:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 8544M 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:11.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:11.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi137 2024-04-23T14:43:11.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 8544M 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:11.432 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi137 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 8544M 2024-04-23T14:43:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:11.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:11.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 -- 172.21.15.186:0/630670618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08106930 msgr2=0x7f6f0810d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:11.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 --2- 172.21.15.186:0/630670618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08106930 0x7f6f0810d1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b0a0 tx=0x7f6f0000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 -- 172.21.15.186:0/630670618 shutdown_connections 2024-04-23T14:43:11.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 --2- 172.21.15.186:0/630670618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08106930 0x7f6f0810d1e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 --2- 172.21.15.186:0/630670618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f08104d90 0x7f6f081051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 --2- 172.21.15.186:0/630670618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f08105f90 0x7f6f081063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 -- 172.21.15.186:0/630670618 >> 172.21.15.186:0/630670618 conn(0x7f6f08100350 msgr2=0x7f6f08102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:11.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.695+0000 7f6f10000700 1 -- 172.21.15.186:0/630670618 shutdown_connections 2024-04-23T14:43:11.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.696+0000 7f6f10000700 1 -- 172.21.15.186:0/630670618 wait complete. 2024-04-23T14:43:11.698 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 Processor -- start 2024-04-23T14:43:11.698 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 -- start start 2024-04-23T14:43:11.698 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 0x7f6f0819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.698 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f08105f90 0x7f6f0819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f08106930 0x7f6f081a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f08110860 con 0x7f6f08105f90 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f081106e0 con 0x7f6f08106930 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f10000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6f081109e0 con 0x7f6f08104d90 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f0d600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 0x7f6f0819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f0d600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 0x7f6f0819ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56018/0 (socket says 172.21.15.186:56018) 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.697+0000 7f6f0d600700 1 -- 172.21.15.186:0/1626129174 learned_addr learned my addr 172.21.15.186:0/1626129174 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0cc00700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f08105f90 0x7f6f0819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0e000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f08106930 0x7f6f081a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0d600700 1 -- 172.21.15.186:0/1626129174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f08106930 msgr2=0x7f6f081a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0d600700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f08106930 0x7f6f081a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0d600700 1 -- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f08105f90 msgr2=0x7f6f0819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0d600700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f08105f90 0x7f6f0819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0d600700 1 -- 172.21.15.186:0/1626129174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f081a2aa0 con 0x7f6f08104d90 2024-04-23T14:43:11.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.698+0000 7f6f0d600700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 0x7f6f0819ae40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00d9b0 tx=0x7f6efc00dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:11.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.699+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc017030 con 0x7f6f08104d90 2024-04-23T14:43:11.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.699+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6efc0044d0 con 0x7f6f08104d90 2024-04-23T14:43:11.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.699+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0039e0 con 0x7f6f08104d90 2024-04-23T14:43:11.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.699+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f081a2d90 con 0x7f6f08104d90 2024-04-23T14:43:11.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.699+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f081a31c0 con 0x7f6f08104d90 2024-04-23T14:43:11.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.700+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f08069820 con 0x7f6f08104d90 2024-04-23T14:43:11.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.703+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f6efc01a070 con 0x7f6f08104d90 2024-04-23T14:43:11.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.705+0000 7f6f06000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ef00a3cc0 0x7f6ef00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.705+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f6efc0cf100 con 0x7f6f08104d90 2024-04-23T14:43:11.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.705+0000 7f6f0cc00700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ef00a3cc0 0x7f6ef00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.706+0000 7f6f0cc00700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ef00a3cc0 0x7f6ef00a6180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009bf0 tx=0x7f6ef8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:11.709 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.709+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6efc09cb30 con 0x7f6f08104d90 2024-04-23T14:43:11.945 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:11.945+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6f08062f30 con 0x7f6ef00a3cc0 2024-04-23T14:43:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:12 smithi007 ceph-mon[27906]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:12 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:12.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:12 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:12.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:12 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:12 smithi186 ceph-mon[31814]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:12 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:12 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:12 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:12.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:12 smithi137 ceph-mon[31694]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:12.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:12 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:12.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:12 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:12.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:12 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:13.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:13 smithi007 ceph-mon[27906]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:13.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:13 smithi186 ceph-mon[31814]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:13.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:13 smithi137 ceph-mon[31694]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:15 smithi186 ceph-mon[31814]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:15.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:15 smithi137 ceph-mon[31694]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:15 smithi007 ceph-mon[27906]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:16 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/3092263188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]: dispatch 2024-04-23T14:43:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:16 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]: dispatch 2024-04-23T14:43:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:16 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]': finished 2024-04-23T14:43:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:16 smithi186 ceph-mon[31814]: osdmap e35: 6 total, 5 up, 6 in 2024-04-23T14:43:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:16 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/3092263188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]: dispatch 2024-04-23T14:43:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:16 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]: dispatch 2024-04-23T14:43:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:16 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]': finished 2024-04-23T14:43:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:16 smithi137 ceph-mon[31694]: osdmap e35: 6 total, 5 up, 6 in 2024-04-23T14:43:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:16.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:16 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/3092263188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]: dispatch 2024-04-23T14:43:16.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:16 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]: dispatch 2024-04-23T14:43:16.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:16 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "097180ed-48e5-4b8a-a06b-3190abf3df8f"}]': finished 2024-04-23T14:43:16.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:16 smithi007 ceph-mon[27906]: osdmap e35: 6 total, 5 up, 6 in 2024-04-23T14:43:16.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:17 smithi186 ceph-mon[31814]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:17 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/418114975' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:17.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:17 smithi137 ceph-mon[31694]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:17.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:17 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/418114975' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:17 smithi007 ceph-mon[27906]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:17.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:17 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/418114975' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:19.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:19 smithi186 ceph-mon[31814]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:19.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:19 smithi137 ceph-mon[31694]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:19 smithi007 ceph-mon[27906]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:21 smithi137 ceph-mon[31694]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:21.813 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:21 smithi186 ceph-mon[31814]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:21 smithi007 ceph-mon[27906]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:23.529 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:23 smithi186 ceph-mon[31814]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:23.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:23 smithi137 ceph-mon[31694]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:23 smithi007 ceph-mon[27906]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:25 smithi137 ceph-mon[31694]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:43:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:25 smithi137 ceph-mon[31694]: Deploying daemon osd.5 on smithi186 2024-04-23T14:43:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:25 smithi007 ceph-mon[27906]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:43:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:25.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:25 smithi007 ceph-mon[27906]: Deploying daemon osd.5 on smithi186 2024-04-23T14:43:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:25 smithi186 ceph-mon[31814]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:43:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:25.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:25 smithi186 ceph-mon[31814]: Deploying daemon osd.5 on smithi186 2024-04-23T14:43:27.665 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:27 smithi186 ceph-mon[31814]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:27.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:27 smithi137 ceph-mon[31694]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:27 smithi007 ceph-mon[27906]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:29 smithi137 ceph-mon[31694]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:29.729 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:29 smithi186 ceph-mon[31814]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:29 smithi007 ceph-mon[27906]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:31.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:31 smithi137 ceph-mon[31694]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:31.668 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:31 smithi186 ceph-mon[31814]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:31 smithi007 ceph-mon[27906]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:33.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:33 smithi137 ceph-mon[31694]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:33.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:33.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:33.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:33 smithi007 ceph-mon[27906]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:33 smithi186 ceph-mon[31814]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:35.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:35 smithi137 ceph-mon[31694]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:35 smithi007 ceph-mon[27906]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:35.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:35 smithi186 ceph-mon[31814]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:37.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:37.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:43:37.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:37 smithi137 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:43:37.734 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:43:37.735 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:37 smithi186 ceph-mon[31814]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:43:37.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:43:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:37 smithi007 ceph-mon[27906]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:43:38.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.202+0000 7f6f06000700 1 -- 172.21.15.186:0/1626129174 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6f08062f30 con 0x7f6ef00a3cc0 2024-04-23T14:43:38.205 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 5 on host 'smithi186' 2024-04-23T14:43:38.207 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ef00a3cc0 msgr2=0x7f6ef00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:38.207 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ef00a3cc0 0x7f6ef00a6180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009bf0 tx=0x7f6ef8009260 comp rx=0 tx=0).stop 2024-04-23T14:43:38.207 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 msgr2=0x7f6f0819ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:38.207 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 0x7f6f0819ae40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00d9b0 tx=0x7f6efc00dd70 comp rx=0 tx=0).stop 2024-04-23T14:43:38.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 shutdown_connections 2024-04-23T14:43:38.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ef00a3cc0 0x7f6ef00a6180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:38.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f08106930 0x7f6f081a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:38.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f08104d90 0x7f6f0819ae40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:38.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 --2- 172.21.15.186:0/1626129174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f08105f90 0x7f6f0819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:38.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 >> 172.21.15.186:0/1626129174 conn(0x7f6f08100350 msgr2=0x7f6f08109290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:38.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.206+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 shutdown_connections 2024-04-23T14:43:38.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:43:38.207+0000 7f6f10000700 1 -- 172.21.15.186:0/1626129174 wait complete. 2024-04-23T14:43:38.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: osdmap e36: 6 total, 5 up, 6 in 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:43:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:43:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: osdmap e36: 6 total, 5 up, 6 in 2024-04-23T14:43:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:43:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:43:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:43:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: osdmap e36: 6 total, 5 up, 6 in 2024-04-23T14:43:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:43:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:38.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:38.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:39.001 DEBUG:teuthology.orchestra.run.smithi186:osd.5> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.5.service 2024-04-23T14:43:39.006 INFO:tasks.cephadm:Deploying osd.6 on smithi007 with /dev/vg_nvme/lv_2... 2024-04-23T14:43:39.007 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T14:43:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:43:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:39 smithi186 ceph-mon[31814]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:39 smithi186 ceph-mon[31814]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:43:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:39 smithi186 ceph-mon[31814]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T14:43:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:39.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:39 smithi007 ceph-mon[27906]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:39.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:39 smithi007 ceph-mon[27906]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:43:39.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:39 smithi007 ceph-mon[27906]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T14:43:39.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:39.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:39.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:39 smithi137 ceph-mon[31694]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:39.820 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:39 smithi137 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:43:39.820 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:39 smithi137 ceph-mon[31694]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T14:43:39.820 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:39.820 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] boot 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: osdmap e38: 6 total, 6 up, 6 in 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:40 smithi186 ceph-mon[31814]: osdmap e39: 6 total, 6 up, 6 in 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] boot 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: osdmap e38: 6 total, 6 up, 6 in 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:40 smithi007 ceph-mon[27906]: osdmap e39: 6 total, 6 up, 6 in 2024-04-23T14:43:40.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:43:40.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:43:40.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: osd.5 [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] boot 2024-04-23T14:43:40.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: osdmap e38: 6 total, 6 up, 6 in 2024-04-23T14:43:40.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:40.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:40 smithi137 ceph-mon[31694]: osdmap e39: 6 total, 6 up, 6 in 2024-04-23T14:43:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:41 smithi007 ceph-mon[27906]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:41 smithi007 ceph-mon[27906]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T14:43:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:41 smithi186 ceph-mon[31814]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:41 smithi186 ceph-mon[31814]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T14:43:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:41 smithi137 ceph-mon[31694]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-23T14:43:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:41 smithi137 ceph-mon[31694]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T14:43:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T14:43:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T14:43:42.783 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-04-23T14:43:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-04-23T14:43:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0622887 s, 168 MB/s 2024-04-23T14:43:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-04-23T14:43:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:42 smithi007 ceph-mon[27906]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T14:43:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:42 smithi186 ceph-mon[31814]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T14:43:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:42 smithi137 ceph-mon[31694]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T14:43:43.920 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-04-23T14:43:44.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:43 smithi007 ceph-mon[27906]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:44.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:43 smithi007 ceph-mon[27906]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T14:43:44.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:43 smithi186 ceph-mon[31814]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:44.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:43 smithi186 ceph-mon[31814]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T14:43:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:43:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:43 smithi137 ceph-mon[31694]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:43 smithi137 ceph-mon[31694]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T14:43:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi186 2024-04-23T14:43:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi186 2024-04-23T14:43:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:45.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:45.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:45.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:45.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi186 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:45.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:43:46.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:46 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 8544M 2024-04-23T14:43:46.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:46 smithi007 ceph-mon[27906]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-04-23T14:43:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:46 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 8544M 2024-04-23T14:43:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:46 smithi186 ceph-mon[31814]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-04-23T14:43:46.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:46 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 8544M 2024-04-23T14:43:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:46 smithi137 ceph-mon[31694]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-04-23T14:43:46.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 -- 172.21.15.7:0/3187879888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc109190 msgr2=0x7f70dc1095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 --2- 172.21.15.7:0/3187879888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc109190 0x7f70dc1095b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0099c0 tx=0x7f70cc009cd0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 -- 172.21.15.7:0/3187879888 shutdown_connections 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 --2- 172.21.15.7:0/3187879888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70dc10ad30 0x7f70dc1115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 --2- 172.21.15.7:0/3187879888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc109190 0x7f70dc1095b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 --2- 172.21.15.7:0/3187879888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70dc10a390 0x7f70dc10a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.788+0000 7f70e0c00700 1 -- 172.21.15.7:0/3187879888 >> 172.21.15.7:0/3187879888 conn(0x7f70dc078160 msgr2=0x7f70dc07a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.789+0000 7f70e0c00700 1 -- 172.21.15.7:0/3187879888 shutdown_connections 2024-04-23T14:43:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.789+0000 7f70e0c00700 1 -- 172.21.15.7:0/3187879888 wait complete. 2024-04-23T14:43:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 Processor -- start 2024-04-23T14:43:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 -- start start 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70dc109190 0x7f70dc19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70dc10a390 0x7f70dc19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 0x7f70dc1a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc114c80 con 0x7f70dc10ad30 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc114b00 con 0x7f70dc109190 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.790+0000 7f70e0c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc114e00 con 0x7f70dc10a390 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 0x7f70dc1a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 0x7f70dc1a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34824/0 (socket says 172.21.15.7:34824) 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 -- 172.21.15.7:0/1769617954 learned_addr learned my addr 172.21.15.7:0/1769617954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70d3e00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70dc10a390 0x7f70dc19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70d9e00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70dc109190 0x7f70dc19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 -- 172.21.15.7:0/1769617954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70dc10a390 msgr2=0x7f70dc19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70dc10a390 0x7f70dc19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 -- 172.21.15.7:0/1769617954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70dc109190 msgr2=0x7f70dc19f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70dc109190 0x7f70dc19f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 -- 172.21.15.7:0/1769617954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc1a6f20 con 0x7f70dc10ad30 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.791+0000 7f70da800700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 0x7f70dc1a6880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70d4007f10 tx=0x7f70d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.792+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4004bb0 con 0x7f70dc10ad30 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.792+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70d4004d50 con 0x7f70dc10ad30 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.792+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70dc1a7210 con 0x7f70dc10ad30 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.792+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4005990 con 0x7f70dc10ad30 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.792+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70dc1a7750 con 0x7f70dc10ad30 2024-04-23T14:43:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.793+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70dc0697e0 con 0x7f70dc10ad30 2024-04-23T14:43:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.796+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f70d401a020 con 0x7f70dc10ad30 2024-04-23T14:43:46.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.797+0000 7f70d2a00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f70c00a3cc0 0x7f70c00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.797+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f70d40cf440 con 0x7f70dc10ad30 2024-04-23T14:43:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.797+0000 7f70d9e00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f70c00a3cc0 0x7f70c00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.798+0000 7f70d9e00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f70c00a3cc0 0x7f70c00a6180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70cc000c00 tx=0x7f70cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:46.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:46.800+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70d4010070 con 0x7f70dc10ad30 2024-04-23T14:43:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:43:47.040+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f70dc062f30 con 0x7f70c00a3cc0 2024-04-23T14:43:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:47 smithi007 ceph-mon[27906]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:43:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:47 smithi186 ceph-mon[31814]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:43:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:47 smithi137 ceph-mon[31694]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:43:48.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:48 smithi007 ceph-mon[27906]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:48 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:48 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:48.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:48 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:48 smithi186 ceph-mon[31814]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:48 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:48 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:48 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:48 smithi137 ceph-mon[31694]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:48 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:48 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:48 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:49 smithi007 ceph-mon[27906]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-23T14:43:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:49 smithi186 ceph-mon[31814]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-23T14:43:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:49 smithi137 ceph-mon[31694]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-23T14:43:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:51 smithi007 ceph-mon[27906]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-23T14:43:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:51 smithi186 ceph-mon[31814]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-23T14:43:51.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:51 smithi137 ceph-mon[31694]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-23T14:43:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:52 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/546247814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b57c273-5d0c-40e5-ba14-8704b6844d03"}]: dispatch 2024-04-23T14:43:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:52 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/546247814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b57c273-5d0c-40e5-ba14-8704b6844d03"}]': finished 2024-04-23T14:43:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:52 smithi007 ceph-mon[27906]: osdmap e43: 7 total, 6 up, 7 in 2024-04-23T14:43:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:52 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:43:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:52 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/546247814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b57c273-5d0c-40e5-ba14-8704b6844d03"}]: dispatch 2024-04-23T14:43:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:52 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/546247814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b57c273-5d0c-40e5-ba14-8704b6844d03"}]': finished 2024-04-23T14:43:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:52 smithi186 ceph-mon[31814]: osdmap e43: 7 total, 6 up, 7 in 2024-04-23T14:43:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:52 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:43:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:52 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/546247814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b57c273-5d0c-40e5-ba14-8704b6844d03"}]: dispatch 2024-04-23T14:43:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:52 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/546247814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b57c273-5d0c-40e5-ba14-8704b6844d03"}]': finished 2024-04-23T14:43:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:52 smithi137 ceph-mon[31694]: osdmap e43: 7 total, 6 up, 7 in 2024-04-23T14:43:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:52 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:43:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:53 smithi007 ceph-mon[27906]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:43:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:53 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/907109695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:53 smithi186 ceph-mon[31814]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:43:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:53 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/907109695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:53 smithi137 ceph-mon[31694]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:43:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:53 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/907109695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:55 smithi007 ceph-mon[27906]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:55.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:55 smithi186 ceph-mon[31814]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:55 smithi137 ceph-mon[31694]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:57.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:57 smithi007 ceph-mon[27906]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:57.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:57 smithi186 ceph-mon[31814]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:57.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:57 smithi137 ceph-mon[31694]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:43:59 smithi186 ceph-mon[31814]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:59.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:43:59 smithi007 ceph-mon[27906]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:43:59.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:43:59 smithi137 ceph-mon[31694]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:01.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:01 smithi007 ceph-mon[27906]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:01.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:01 smithi186 ceph-mon[31814]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:01.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:01 smithi137 ceph-mon[31694]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-23T14:44:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:02 smithi186 ceph-mon[31814]: Deploying daemon osd.6 on smithi007 2024-04-23T14:44:02.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-23T14:44:02.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:02.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:02 smithi137 ceph-mon[31694]: Deploying daemon osd.6 on smithi007 2024-04-23T14:44:02.817 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-23T14:44:02.817 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:02.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:02 smithi007 ceph-mon[27906]: Deploying daemon osd.6 on smithi007 2024-04-23T14:44:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:03 smithi007 ceph-mon[27906]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:03 smithi186 ceph-mon[31814]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:03 smithi137 ceph-mon[31694]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:05.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:05 smithi007 ceph-mon[27906]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:05 smithi186 ceph-mon[31814]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:05.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:05 smithi137 ceph-mon[31694]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:07.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:07 smithi007 ceph-mon[27906]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:07 smithi186 ceph-mon[31814]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:07.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:07 smithi137 ceph-mon[31694]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:09.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:09 smithi007 ceph-mon[27906]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:09.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:09 smithi137 ceph-mon[31694]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:09 smithi186 ceph-mon[31814]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:12.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:11 smithi007 ceph-mon[27906]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:12.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:12.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:12.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:11 smithi186 ceph-mon[31814]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:11 smithi137 ceph-mon[31694]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:14.063 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:13 smithi007 ceph-mon[27906]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:14.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:13 smithi186 ceph-mon[31814]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:13 smithi137 ceph-mon[31694]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:16.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:16.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:16.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:15 smithi007 ceph-mon[27906]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-23T14:44:16.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:16.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:16.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:16.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:15 smithi186 ceph-mon[31814]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:15 smithi137 ceph-mon[31694]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-23T14:44:16.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.317+0000 7f70d2a00700 1 -- 172.21.15.7:0/1769617954 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f70dc062f30 con 0x7f70c00a3cc0 2024-04-23T14:44:16.318 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 6 on host 'smithi007' 2024-04-23T14:44:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f70c00a3cc0 msgr2=0x7f70c00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f70c00a3cc0 0x7f70c00a6180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70cc000c00 tx=0x7f70cc005fb0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 msgr2=0x7f70dc1a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 0x7f70dc1a6880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70d4007f10 tx=0x7f70d400d3b0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 shutdown_connections 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f70c00a3cc0 0x7f70c00a6180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc10ad30 0x7f70dc1a6880 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70dc109190 0x7f70dc19f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 --2- 172.21.15.7:0/1769617954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70dc10a390 0x7f70dc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.321+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 >> 172.21.15.7:0/1769617954 conn(0x7f70dc078160 msgr2=0x7f70dc10d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.322+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 shutdown_connections 2024-04-23T14:44:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:44:16.322+0000 7f70e0c00700 1 -- 172.21.15.7:0/1769617954 wait complete. 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: osdmap e44: 7 total, 6 up, 7 in 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:16 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:17.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-23T14:44:17.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: osdmap e44: 7 total, 6 up, 7 in 2024-04-23T14:44:17.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:44:17.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:17.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:17.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:17.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:16 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:17.331 DEBUG:teuthology.orchestra.run.smithi007:osd.6> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.6.service 2024-04-23T14:44:17.336 INFO:tasks.cephadm:Deploying osd.7 on smithi137 with /dev/vg_nvme/lv_2... 2024-04-23T14:44:17.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T14:44:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-23T14:44:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: osdmap e44: 7 total, 6 up, 7 in 2024-04-23T14:44:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:44:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:16 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:17.770 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:44:18.164 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:17 smithi137 ceph-mon[31694]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:18.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:17 smithi137 ceph-mon[31694]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:44:18.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:17 smithi137 ceph-mon[31694]: osdmap e45: 7 total, 6 up, 7 in 2024-04-23T14:44:18.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:18.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:17 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:17 smithi007 ceph-mon[27906]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:17 smithi007 ceph-mon[27906]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:44:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:17 smithi007 ceph-mon[27906]: osdmap e45: 7 total, 6 up, 7 in 2024-04-23T14:44:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:17 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:17 smithi186 ceph-mon[31814]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:17 smithi186 ceph-mon[31814]: from='osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:44:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:17 smithi186 ceph-mon[31814]: osdmap e45: 7 total, 6 up, 7 in 2024-04-23T14:44:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:17 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:19.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:18 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:44:19.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:18 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:44:19.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:18 smithi137 ceph-mon[31694]: osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] boot 2024-04-23T14:44:19.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:18 smithi137 ceph-mon[31694]: osdmap e46: 7 total, 7 up, 7 in 2024-04-23T14:44:19.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:18 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:44:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:18 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:44:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:18 smithi007 ceph-mon[27906]: osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] boot 2024-04-23T14:44:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:18 smithi007 ceph-mon[27906]: osdmap e46: 7 total, 7 up, 7 in 2024-04-23T14:44:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:18 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:44:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:18 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:44:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:18 smithi186 ceph-mon[31814]: osd.6 [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] boot 2024-04-23T14:44:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:18 smithi186 ceph-mon[31814]: osdmap e46: 7 total, 7 up, 7 in 2024-04-23T14:44:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:44:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:19 smithi137 ceph-mon[31694]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:19 smithi137 ceph-mon[31694]: osdmap e47: 7 total, 7 up, 7 in 2024-04-23T14:44:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:19 smithi007 ceph-mon[27906]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:20.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:19 smithi007 ceph-mon[27906]: osdmap e47: 7 total, 7 up, 7 in 2024-04-23T14:44:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:19 smithi186 ceph-mon[31814]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:44:20.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:19 smithi186 ceph-mon[31814]: osdmap e47: 7 total, 7 up, 7 in 2024-04-23T14:44:20.723 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T14:44:20.723 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T14:44:20.723 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-23T14:44:20.724 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-23T14:44:20.724 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0338259 s, 310 MB/s 2024-04-23T14:44:20.724 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-23T14:44:21.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_2 2024-04-23T14:44:22.096 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:44:22.240 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:21 smithi137 ceph-mon[31694]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:22.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:21 smithi007 ceph-mon[27906]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:21 smithi186 ceph-mon[31814]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:23.847 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:23.847 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi007 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 5698M 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:23.848 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi007 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 5698M 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:23.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi007 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 5698M 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:24.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 -- 172.21.15.137:0/2296363821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103810a950 msgr2=0x7f103810cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 --2- 172.21.15.137:0/2296363821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103810a950 0x7f103810cde0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f103000b0a0 tx=0x7f103000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 -- 172.21.15.137:0/2296363821 shutdown_connections 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 --2- 172.21.15.137:0/2296363821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f103810a950 0x7f103810cde0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 --2- 172.21.15.137:0/2296363821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1038076ac0 0x7f1038074f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 --2- 172.21.15.137:0/2296363821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10380754f0 0x7f1038075970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.123+0000 7f103e800700 1 -- 172.21.15.137:0/2296363821 >> 172.21.15.137:0/2296363821 conn(0x7f10380fe030 msgr2=0x7f1038100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.124+0000 7f103e800700 1 -- 172.21.15.137:0/2296363821 shutdown_connections 2024-04-23T14:44:24.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.124+0000 7f103e800700 1 -- 172.21.15.137:0/2296363821 wait complete. 2024-04-23T14:44:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.125+0000 7f103e800700 1 Processor -- start 2024-04-23T14:44:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.125+0000 7f103e800700 1 -- start start 2024-04-23T14:44:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.125+0000 7f103e800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10380754f0 0x7f103819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.125+0000 7f103e800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 0x7f103819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.125+0000 7f103e800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f103810a950 0x7f10381a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103e800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10381106c0 con 0x7f103810a950 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103e800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1038110540 con 0x7f1038076ac0 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103e800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1038110840 con 0x7f10380754f0 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 0x7f103819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 0x7f103819b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60866/0 (socket says 172.21.15.137:60866) 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 -- 172.21.15.137:0/3338231890 learned_addr learned my addr 172.21.15.137:0/3338231890 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103d400700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10380754f0 0x7f103819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103de00700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f103810a950 0x7f10381a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 -- 172.21.15.137:0/3338231890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10380754f0 msgr2=0x7f103819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10380754f0 0x7f103819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 -- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f103810a950 msgr2=0x7f10381a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f103810a950 0x7f10381a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103ca00700 1 -- 172.21.15.137:0/3338231890 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10381a28e0 con 0x7f1038076ac0 2024-04-23T14:44:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.126+0000 7f103de00700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f103810a950 0x7f10381a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:44:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.127+0000 7f103ca00700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 0x7f103819b1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f102400d950 tx=0x7f102400dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.127+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024016070 con 0x7f1038076ac0 2024-04-23T14:44:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.127+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1024010460 con 0x7f1038076ac0 2024-04-23T14:44:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.127+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10381a2bd0 con 0x7f1038076ac0 2024-04-23T14:44:24.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.127+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102400f620 con 0x7f1038076ac0 2024-04-23T14:44:24.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.127+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381a3160 con 0x7f1038076ac0 2024-04-23T14:44:24.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.128+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10380697e0 con 0x7f1038076ac0 2024-04-23T14:44:24.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.130+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f1024019070 con 0x7f1038076ac0 2024-04-23T14:44:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.132+0000 7f1036000700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f10200a3cc0 0x7f10200a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.132+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f10240cf3e0 con 0x7f1038076ac0 2024-04-23T14:44:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.132+0000 7f103d400700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f10200a3cc0 0x7f10200a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:24.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.134+0000 7f103d400700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f10200a3cc0 0x7f10200a6180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f102c005ea0 tx=0x7f102c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:24.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.135+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f102409ca30 con 0x7f1038076ac0 2024-04-23T14:44:24.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:24.369+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1038062f30 con 0x7f10200a3cc0 2024-04-23T14:44:24.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:44:24.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:44:24.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:24 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:24.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:44:24.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:44:24.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:24 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:44:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:44:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:24 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:25.607 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:25 smithi137 ceph-mon[31694]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:25.607 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:25 smithi137 ceph-mon[31694]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:44:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:25 smithi186 ceph-mon[31814]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:25 smithi186 ceph-mon[31814]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:44:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:25 smithi007 ceph-mon[27906]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:25 smithi007 ceph-mon[27906]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:44:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:27 smithi186 ceph-mon[31814]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:27 smithi137 ceph-mon[31694]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:27 smithi007 ceph-mon[27906]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:28 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/2407716232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]: dispatch 2024-04-23T14:44:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:28 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]: dispatch 2024-04-23T14:44:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:28 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]': finished 2024-04-23T14:44:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:28 smithi137 ceph-mon[31694]: osdmap e48: 8 total, 7 up, 8 in 2024-04-23T14:44:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:28 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/2407716232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]: dispatch 2024-04-23T14:44:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:28 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]: dispatch 2024-04-23T14:44:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:28 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]': finished 2024-04-23T14:44:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:28 smithi007 ceph-mon[27906]: osdmap e48: 8 total, 7 up, 8 in 2024-04-23T14:44:29.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:28 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/2407716232' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]: dispatch 2024-04-23T14:44:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:28 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]: dispatch 2024-04-23T14:44:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:28 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c59e05c5-705e-49d3-92c8-d32881241f96"}]': finished 2024-04-23T14:44:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:28 smithi186 ceph-mon[31814]: osdmap e48: 8 total, 7 up, 8 in 2024-04-23T14:44:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:29 smithi137 ceph-mon[31694]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:29 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/383009174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:44:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:29 smithi007 ceph-mon[27906]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:29 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/383009174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:44:30.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:29 smithi186 ceph-mon[31814]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:30.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:29 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/383009174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:44:31.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:31 smithi007 ceph-mon[27906]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:31 smithi137 ceph-mon[31694]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:32.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:31 smithi186 ceph-mon[31814]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:33 smithi007 ceph-mon[27906]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:33.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:33 smithi137 ceph-mon[31694]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:33 smithi186 ceph-mon[31814]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:35.767 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:35 smithi137 ceph-mon[31694]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:35 smithi007 ceph-mon[27906]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:35 smithi186 ceph-mon[31814]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:37 smithi137 ceph-mon[31694]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-23T14:44:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:37 smithi007 ceph-mon[27906]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-23T14:44:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:37 smithi186 ceph-mon[31814]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-23T14:44:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:38.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:38 smithi137 ceph-mon[31694]: Deploying daemon osd.7 on smithi137 2024-04-23T14:44:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:38 smithi007 ceph-mon[27906]: Deploying daemon osd.7 on smithi137 2024-04-23T14:44:39.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:38 smithi186 ceph-mon[31814]: Deploying daemon osd.7 on smithi137 2024-04-23T14:44:39.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:39 smithi137 ceph-mon[31694]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:39 smithi007 ceph-mon[27906]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:39 smithi186 ceph-mon[31814]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:41 smithi137 ceph-mon[31694]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:41 smithi007 ceph-mon[27906]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:42.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:41 smithi186 ceph-mon[31814]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:43.931 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:43 smithi137 ceph-mon[31694]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:43 smithi007 ceph-mon[27906]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:43 smithi186 ceph-mon[31814]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:45 smithi007 ceph-mon[27906]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:45 smithi186 ceph-mon[31814]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:45 smithi137 ceph-mon[31694]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:47.825 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:47 smithi137 ceph-mon[31694]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:47 smithi007 ceph-mon[27906]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:47 smithi186 ceph-mon[31814]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:49.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:49.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:49.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:49.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:49.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:49.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:49.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T14:44:49.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:49 smithi137 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T14:44:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T14:44:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:49 smithi007 ceph-mon[27906]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T14:44:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T14:44:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:49 smithi186 ceph-mon[31814]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T14:44:50.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.331+0000 7f1036000700 1 -- 172.21.15.137:0/3338231890 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1038062f30 con 0x7f10200a3cc0 2024-04-23T14:44:50.334 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 7 on host 'smithi137' 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.334+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f10200a3cc0 msgr2=0x7f10200a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.334+0000 7f103e800700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f10200a3cc0 0x7f10200a6180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f102c005ea0 tx=0x7f102c005e30 comp rx=0 tx=0).stop 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.334+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 msgr2=0x7f103819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.334+0000 7f103e800700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 0x7f103819b1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f102400d950 tx=0x7f102400dd10 comp rx=0 tx=0).stop 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 shutdown_connections 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f10200a3cc0 0x7f10200a6180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f103810a950 0x7f10381a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10380754f0 0x7f103819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 --2- 172.21.15.137:0/3338231890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1038076ac0 0x7f103819b1a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 >> 172.21.15.137:0/3338231890 conn(0x7f10380fe030 msgr2=0x7f10381068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 shutdown_connections 2024-04-23T14:44:50.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:44:50.335+0000 7f103e800700 1 -- 172.21.15.137:0/3338231890 wait complete. 2024-04-23T14:44:51.091 DEBUG:teuthology.orchestra.run.smithi137:osd.7> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.7.service 2024-04-23T14:44:51.096 INFO:tasks.cephadm:Deploying osd.8 on smithi186 with /dev/vg_nvme/lv_2... 2024-04-23T14:44:51.096 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: osdmap e49: 8 total, 7 up, 8 in 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:51.294 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:51.295 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7[49599]: 2024-04-23T14:44:51.274+0000 7ff12fa00700 -1 osd.7 0 waiting for initial osdmap 2024-04-23T14:44:51.295 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 14:44:51 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7[49599]: 2024-04-23T14:44:51.292+0000 7ff12a800700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:44:51.542 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:44:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: osdmap e49: 8 total, 7 up, 8 in 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:51 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: osdmap e49: 8 total, 7 up, 8 in 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:51 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:52.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:52 smithi186 ceph-mon[31814]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:44:52.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:52 smithi186 ceph-mon[31814]: osdmap e50: 8 total, 7 up, 8 in 2024-04-23T14:44:52.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:52 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:52.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:52 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:52.400 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:52 smithi137 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:44:52.400 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:52 smithi137 ceph-mon[31694]: osdmap e50: 8 total, 7 up, 8 in 2024-04-23T14:44:52.400 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:52 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:52.400 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:52 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:52 smithi007 ceph-mon[27906]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:44:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:52 smithi007 ceph-mon[27906]: osdmap e50: 8 total, 7 up, 8 in 2024-04-23T14:44:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:52 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:52.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:52 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:53.538 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:44:53.539 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:44:53.539 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:53.539 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:53.539 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] boot 2024-04-23T14:44:53.539 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: osdmap e51: 8 total, 8 up, 8 in 2024-04-23T14:44:53.539 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:44:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:44:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] boot 2024-04-23T14:44:53.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: osdmap e51: 8 total, 8 up, 8 in 2024-04-23T14:44:53.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: osd.7 [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] boot 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: osdmap e51: 8 total, 8 up, 8 in 2024-04-23T14:44:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:44:54.449 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T14:44:54.449 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T14:44:54.449 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-04-23T14:44:54.449 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-04-23T14:44:54.449 INFO:teuthology.orchestra.run.smithi186.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0354619 s, 296 MB/s 2024-04-23T14:44:54.449 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-04-23T14:44:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:54 smithi007 ceph-mon[27906]: osdmap e52: 8 total, 8 up, 8 in 2024-04-23T14:44:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:54 smithi186 ceph-mon[31814]: osdmap e52: 8 total, 8 up, 8 in 2024-04-23T14:44:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:54 smithi137 ceph-mon[31694]: osdmap e52: 8 total, 8 up, 8 in 2024-04-23T14:44:55.397 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_2 2024-04-23T14:44:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:55 smithi007 ceph-mon[27906]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:44:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:55 smithi007 ceph-mon[27906]: osdmap e53: 8 total, 8 up, 8 in 2024-04-23T14:44:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:55 smithi007 ceph-mon[27906]: osdmap e54: 8 total, 8 up, 8 in 2024-04-23T14:44:55.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:55 smithi186 ceph-mon[31814]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:44:55.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:55 smithi186 ceph-mon[31814]: osdmap e53: 8 total, 8 up, 8 in 2024-04-23T14:44:55.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:55 smithi186 ceph-mon[31814]: osdmap e54: 8 total, 8 up, 8 in 2024-04-23T14:44:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:55 smithi137 ceph-mon[31694]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:44:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:55 smithi137 ceph-mon[31694]: osdmap e53: 8 total, 8 up, 8 in 2024-04-23T14:44:55.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:55 smithi137 ceph-mon[31694]: osdmap e54: 8 total, 8 up, 8 in 2024-04-23T14:44:55.838 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi137 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 5696M 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:56 smithi186 ceph-mon[31814]: osdmap e55: 8 total, 8 up, 8 in 2024-04-23T14:44:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi137 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 5696M 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:56 smithi007 ceph-mon[27906]: osdmap e55: 8 total, 8 up, 8 in 2024-04-23T14:44:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi137 2024-04-23T14:44:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:57.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 5696M 2024-04-23T14:44:57.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:44:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:56 smithi137 ceph-mon[31694]: osdmap e55: 8 total, 8 up, 8 in 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 -- 172.21.15.186:0/3546299474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260104610 msgr2=0x7f126010aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 --2- 172.21.15.186:0/3546299474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260104610 0x7f126010aec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f125800b0a0 tx=0x7f125800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 -- 172.21.15.186:0/3546299474 shutdown_connections 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 --2- 172.21.15.186:0/3546299474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260104610 0x7f126010aec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 --2- 172.21.15.186:0/3546299474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1260102a70 0x7f1260102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 --2- 172.21.15.186:0/3546299474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1260103c70 0x7f12601040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 -- 172.21.15.186:0/3546299474 >> 172.21.15.186:0/3546299474 conn(0x7f12600fe030 msgr2=0x7f1260100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 -- 172.21.15.186:0/3546299474 shutdown_connections 2024-04-23T14:44:58.174 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.173+0000 7f1267000700 1 -- 172.21.15.186:0/3546299474 wait complete. 2024-04-23T14:44:58.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 Processor -- start 2024-04-23T14:44:58.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 -- start start 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 0x7f12601989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1260103c70 0x7f1260198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1260104610 0x7f126019ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f126010e4f0 con 0x7f1260104610 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f126010e370 con 0x7f1260103c70 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.175+0000 7f1267000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f126010e670 con 0x7f1260102a70 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 0x7f12601989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 0x7f12601989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:47672/0 (socket says 172.21.15.186:47672) 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 -- 172.21.15.186:0/157565919 learned_addr learned my addr 172.21.15.186:0/157565919 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265200700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1260103c70 0x7f1260198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 -- 172.21.15.186:0/157565919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1260103c70 msgr2=0x7f1260198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1260103c70 0x7f1260198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:58.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 -- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1260104610 msgr2=0x7f126019ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:58.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1266600700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1260104610 0x7f126019ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:58.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1260104610 0x7f126019ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:58.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.176+0000 7f1265c00700 1 -- 172.21.15.186:0/157565919 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12601a0650 con 0x7f1260102a70 2024-04-23T14:44:58.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.177+0000 7f1265c00700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 0x7f12601989f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f125400c9c0 tx=0x7f125400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:58.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.177+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254007ac0 con 0x7f1260102a70 2024-04-23T14:44:58.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.177+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1254007c60 con 0x7f1260102a70 2024-04-23T14:44:58.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.177+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254018660 con 0x7f1260102a70 2024-04-23T14:44:58.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.177+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12601a0940 con 0x7f1260102a70 2024-04-23T14:44:58.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.177+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12601a0e30 con 0x7f1260102a70 2024-04-23T14:44:58.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.178+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12600697e0 con 0x7f1260102a70 2024-04-23T14:44:58.181 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.180+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f125400f450 con 0x7f1260102a70 2024-04-23T14:44:58.182 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.182+0000 7f125e000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f12480a3c40 0x7f12480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:58.183 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:57 smithi186 ceph-mon[31814]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:44:58.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.182+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7f12540cfa70 con 0x7f1260102a70 2024-04-23T14:44:58.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.182+0000 7f1265200700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f12480a3c40 0x7f12480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:58.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.184+0000 7f1265200700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f12480a3c40 0x7f12480a6100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f124c005ea0 tx=0x7f124c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:58.186 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.186+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1254014030 con 0x7f1260102a70 2024-04-23T14:44:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:57 smithi007 ceph-mon[27906]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:44:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:57 smithi137 ceph-mon[31694]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:44:58.422 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:44:58.422+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1260062f30 con 0x7f12480a3c40 2024-04-23T14:44:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:44:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:44:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:44:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:44:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:44:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:44:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:00.082 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:59 smithi186 ceph-mon[31814]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:00.083 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:44:59 smithi186 ceph-mon[31814]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:00.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:59 smithi007 ceph-mon[27906]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:00.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:44:59 smithi007 ceph-mon[27906]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:59 smithi137 ceph-mon[31694]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:44:59 smithi137 ceph-mon[31694]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:01 smithi007 ceph-mon[27906]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:01 smithi186 ceph-mon[31814]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:01 smithi137 ceph-mon[31694]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:02 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/3166233646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]: dispatch 2024-04-23T14:45:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:02 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]: dispatch 2024-04-23T14:45:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:02 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]': finished 2024-04-23T14:45:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:02 smithi007 ceph-mon[27906]: osdmap e56: 9 total, 8 up, 9 in 2024-04-23T14:45:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:02 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/3166233646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]: dispatch 2024-04-23T14:45:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:02 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]: dispatch 2024-04-23T14:45:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:02 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]': finished 2024-04-23T14:45:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:02 smithi186 ceph-mon[31814]: osdmap e56: 9 total, 8 up, 9 in 2024-04-23T14:45:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:02 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/3166233646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]: dispatch 2024-04-23T14:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:02 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]: dispatch 2024-04-23T14:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:02 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dc3fbc8-a0e3-4031-a338-30881b7db934"}]': finished 2024-04-23T14:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:02 smithi137 ceph-mon[31694]: osdmap e56: 9 total, 8 up, 9 in 2024-04-23T14:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:03 smithi007 ceph-mon[27906]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:03 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/1640194801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:45:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:03 smithi186 ceph-mon[31814]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:03 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/1640194801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:45:04.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:03 smithi137 ceph-mon[31694]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:04.522 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:03 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/1640194801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:45:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:05 smithi007 ceph-mon[27906]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:06.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:05 smithi186 ceph-mon[31814]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:06.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:05 smithi137 ceph-mon[31694]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:08.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:07 smithi007 ceph-mon[27906]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:08.359 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:07 smithi186 ceph-mon[31814]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:08.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:07 smithi137 ceph-mon[31694]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:10.248 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:09 smithi137 ceph-mon[31694]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:10.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:09 smithi007 ceph-mon[27906]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:10.348 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:09 smithi186 ceph-mon[31814]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:11 smithi137 ceph-mon[31694]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-23T14:45:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:11 smithi007 ceph-mon[27906]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-23T14:45:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:11 smithi186 ceph-mon[31814]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-23T14:45:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:13.081 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:13 smithi186 ceph-mon[31814]: Deploying daemon osd.8 on smithi186 2024-04-23T14:45:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:13 smithi007 ceph-mon[27906]: Deploying daemon osd.8 on smithi186 2024-04-23T14:45:13.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:13 smithi137 ceph-mon[31694]: Deploying daemon osd.8 on smithi186 2024-04-23T14:45:14.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:14 smithi007 ceph-mon[27906]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:14 smithi186 ceph-mon[31814]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:14.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:14 smithi137 ceph-mon[31694]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:16.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:16 smithi007 ceph-mon[27906]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:16.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:16 smithi186 ceph-mon[31814]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:16 smithi137 ceph-mon[31694]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:18 smithi007 ceph-mon[27906]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:18 smithi186 ceph-mon[31814]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:18.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:18 smithi137 ceph-mon[31694]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:20.084 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:20 smithi186 ceph-mon[31814]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:20 smithi007 ceph-mon[27906]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:20.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:20 smithi137 ceph-mon[31694]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:21.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:21 smithi186 ceph-mon[31814]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:21.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:21.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:21.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:21 smithi137 ceph-mon[31694]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:21 smithi007 ceph-mon[27906]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:21.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:23.611 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:23 smithi186 ceph-mon[31814]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:23.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:23 smithi137 ceph-mon[31694]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:23 smithi007 ceph-mon[27906]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:25.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:25.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:25 smithi007 ceph-mon[27906]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:25.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:25 smithi007 ceph-mon[27906]: from='osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T14:45:25.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:25 smithi007 ceph-mon[27906]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T14:45:25.344 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:25.344 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:25.344 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:25 smithi186 ceph-mon[31814]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:25.344 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:25 smithi186 ceph-mon[31814]: from='osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T14:45:25.344 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:25 smithi186 ceph-mon[31814]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T14:45:25.344 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.342+0000 7f125e000700 1 -- 172.21.15.186:0/157565919 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1260062f30 con 0x7f12480a3c40 2024-04-23T14:45:25.344 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 8 on host 'smithi186' 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f12480a3c40 msgr2=0x7f12480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f12480a3c40 0x7f12480a6100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f124c005ea0 tx=0x7f124c005e30 comp rx=0 tx=0).stop 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 msgr2=0x7f12601989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 0x7f12601989f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f125400c9c0 tx=0x7f125400cd80 comp rx=0 tx=0).stop 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 shutdown_connections 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f12480a3c40 0x7f12480a6100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1260104610 0x7f126019ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1260102a70 0x7f12601989f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 --2- 172.21.15.186:0/157565919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1260103c70 0x7f1260198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 >> 172.21.15.186:0/157565919 conn(0x7f12600fe030 msgr2=0x7f1260106ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 shutdown_connections 2024-04-23T14:45:25.347 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:45:25.345+0000 7f1267000700 1 -- 172.21.15.186:0/157565919 wait complete. 2024-04-23T14:45:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:25 smithi137 ceph-mon[31694]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:25 smithi137 ceph-mon[31694]: from='osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T14:45:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:25 smithi137 ceph-mon[31694]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T14:45:26.159 DEBUG:teuthology.orchestra.run.smithi186:osd.8> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.8.service 2024-04-23T14:45:26.164 INFO:tasks.cephadm:Deploying osd.9 on smithi007 with /dev/vg_nvme/lv_1... 2024-04-23T14:45:26.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: from='osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: osdmap e57: 9 total, 8 up, 9 in 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: from='osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: osdmap e57: 9 total, 8 up, 9 in 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:26.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-23T14:45:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: from='osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:45:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: osdmap e57: 9 total, 8 up, 9 in 2024-04-23T14:45:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:45:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:45:27.105 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 14:45:26 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T14:45:26.955+0000 7f4a01400700 -1 osd.8 0 waiting for initial osdmap 2024-04-23T14:45:27.105 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T14:45:26.998+0000 7f49f6800700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:45:27.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:27 smithi007 ceph-mon[27906]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:45:27.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:27 smithi007 ceph-mon[27906]: osdmap e58: 9 total, 8 up, 9 in 2024-04-23T14:45:27.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:27.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:27.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:27 smithi007 ceph-mon[27906]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:27.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:27 smithi007 ceph-mon[27906]: from='osd.8 ' entity='osd.8' 2024-04-23T14:45:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-mon[31814]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:45:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-mon[31814]: osdmap e58: 9 total, 8 up, 9 in 2024-04-23T14:45:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-mon[31814]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:27.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:27 smithi186 ceph-mon[31814]: from='osd.8 ' entity='osd.8' 2024-04-23T14:45:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:27 smithi137 ceph-mon[31694]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:45:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:27 smithi137 ceph-mon[31694]: osdmap e58: 9 total, 8 up, 9 in 2024-04-23T14:45:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:27 smithi137 ceph-mon[31694]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-23T14:45:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:27 smithi137 ceph-mon[31694]: from='osd.8 ' entity='osd.8' 2024-04-23T14:45:28.234 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:28 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:45:28.235 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:28 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:45:28.235 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:28.235 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:28 smithi186 ceph-mon[31814]: osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] boot 2024-04-23T14:45:28.235 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:28 smithi186 ceph-mon[31814]: osdmap e59: 9 total, 9 up, 9 in 2024-04-23T14:45:28.235 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:28 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:45:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:28 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:45:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:28 smithi137 ceph-mon[31694]: osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] boot 2024-04-23T14:45:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:28 smithi137 ceph-mon[31694]: osdmap e59: 9 total, 9 up, 9 in 2024-04-23T14:45:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:28.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:28 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:45:28.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:28 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:45:28.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:28.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:28 smithi007 ceph-mon[27906]: osd.8 [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] boot 2024-04-23T14:45:28.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:28 smithi007 ceph-mon[27906]: osdmap e59: 9 total, 9 up, 9 in 2024-04-23T14:45:28.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:45:29.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:29 smithi137 ceph-mon[31694]: osdmap e60: 9 total, 9 up, 9 in 2024-04-23T14:45:29.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:29 smithi137 ceph-mon[31694]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:29.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:29 smithi007 ceph-mon[27906]: osdmap e60: 9 total, 9 up, 9 in 2024-04-23T14:45:29.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:29 smithi007 ceph-mon[27906]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:29 smithi186 ceph-mon[31814]: osdmap e60: 9 total, 9 up, 9 in 2024-04-23T14:45:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:29 smithi186 ceph-mon[31814]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:29.777 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-23T14:45:29.777 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-23T14:45:29.777 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-04-23T14:45:29.777 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-04-23T14:45:29.777 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0351146 s, 299 MB/s 2024-04-23T14:45:29.777 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-04-23T14:45:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:30 smithi137 ceph-mon[31694]: osdmap e61: 9 total, 9 up, 9 in 2024-04-23T14:45:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:30 smithi137 ceph-mon[31694]: osdmap e62: 9 total, 9 up, 9 in 2024-04-23T14:45:30.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:30 smithi007 ceph-mon[27906]: osdmap e61: 9 total, 9 up, 9 in 2024-04-23T14:45:30.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:30 smithi007 ceph-mon[27906]: osdmap e62: 9 total, 9 up, 9 in 2024-04-23T14:45:30.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:30 smithi186 ceph-mon[31814]: osdmap e61: 9 total, 9 up, 9 in 2024-04-23T14:45:30.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:30 smithi186 ceph-mon[31814]: osdmap e62: 9 total, 9 up, 9 in 2024-04-23T14:45:30.782 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-04-23T14:45:31.235 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: pgmap v256: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: osdmap e63: 9 total, 9 up, 9 in 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:32.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:31 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: pgmap v256: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: osdmap e63: 9 total, 9 up, 9 in 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:32.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:32.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:31 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: pgmap v256: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: osdmap e63: 9 total, 9 up, 9 in 2024-04-23T14:45:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:32.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:31 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:33.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:32 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi186 2024-04-23T14:45:33.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:32 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 5696M 2024-04-23T14:45:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:32 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi186 2024-04-23T14:45:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:32 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 5696M 2024-04-23T14:45:33.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:32 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi186 2024-04-23T14:45:33.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:32 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 5696M 2024-04-23T14:45:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 -- 172.21.15.7:0/2460910099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010ac20 msgr2=0x7f72c01114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2460910099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010ac20 0x7f72c01114d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72b800b0d0 tx=0x7f72b800b3e0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 -- 172.21.15.7:0/2460910099 shutdown_connections 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2460910099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010ac20 0x7f72c01114d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2460910099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72c0109080 0x7f72c01094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2460910099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72c010a280 0x7f72c010a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 -- 172.21.15.7:0/2460910099 >> 172.21.15.7:0/2460910099 conn(0x7f72c0078050 msgr2=0x7f72c007a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 -- 172.21.15.7:0/2460910099 shutdown_connections 2024-04-23T14:45:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.789+0000 7f72c4c00700 1 -- 172.21.15.7:0/2460910099 wait complete. 2024-04-23T14:45:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.790+0000 7f72c4c00700 1 Processor -- start 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 -- start start 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72c0109080 0x7f72c019f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 0x7f72c019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72c010ac20 0x7f72c01a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0114af0 con 0x7f72c010a280 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0114970 con 0x7f72c010ac20 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72c4c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0114c70 con 0x7f72c0109080 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72bea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 0x7f72c019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72bea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 0x7f72c019f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59210/0 (socket says 172.21.15.7:59210) 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.791+0000 7f72bea00700 1 -- 172.21.15.7:0/2369744455 learned_addr learned my addr 172.21.15.7:0/2369744455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:45:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bfe00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72c010ac20 0x7f72c01a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bf400700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72c0109080 0x7f72c019f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bea00700 1 -- 172.21.15.7:0/2369744455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72c0109080 msgr2=0x7f72c019f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bea00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72c0109080 0x7f72c019f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bea00700 1 -- 172.21.15.7:0/2369744455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72c010ac20 msgr2=0x7f72c01a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bea00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72c010ac20 0x7f72c01a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bea00700 1 -- 172.21.15.7:0/2369744455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c01a6d30 con 0x7f72c010a280 2024-04-23T14:45:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.792+0000 7f72bea00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 0x7f72c019f610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00d980 tx=0x7f72ac00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.793+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac016070 con 0x7f72c010a280 2024-04-23T14:45:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.793+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72ac010460 con 0x7f72c010a280 2024-04-23T14:45:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.793+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00f620 con 0x7f72c010a280 2024-04-23T14:45:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.793+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c01a6fc0 con 0x7f72c010a280 2024-04-23T14:45:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.793+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a7480 con 0x7f72c010a280 2024-04-23T14:45:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.795+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c00697e0 con 0x7f72c010a280 2024-04-23T14:45:33.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.796+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f72ac019070 con 0x7f72c010a280 2024-04-23T14:45:33.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.798+0000 7f72b7e00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f72a40a3c40 0x7f72a40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.798+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7f72ac0cf6a0 con 0x7f72c010a280 2024-04-23T14:45:33.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.798+0000 7f72bf400700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f72a40a3c40 0x7f72a40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.799+0000 7f72bf400700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f72a40a3c40 0x7f72a40a6100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72b0005950 tx=0x7f72b00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:33.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:33.803+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f72ac09c990 con 0x7f72c010a280 2024-04-23T14:45:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:45:34.043+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f72c0062f30 con 0x7f72a40a3c40 2024-04-23T14:45:34.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:33 smithi007 ceph-mon[27906]: pgmap v258: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:34.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:33 smithi186 ceph-mon[31814]: pgmap v258: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:34.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:33 smithi137 ceph-mon[31694]: pgmap v258: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:35.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:34 smithi007 ceph-mon[27906]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:35.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:34 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:45:35.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:34 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:45:35.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:34 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:34 smithi186 ceph-mon[31814]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:34 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:45:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:34 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:45:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:34 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:35.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:34 smithi137 ceph-mon[31694]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:35.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:34 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:45:35.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:34 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:45:35.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:34 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:36.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:35 smithi007 ceph-mon[27906]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:45:36.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:35 smithi186 ceph-mon[31814]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:45:36.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:35 smithi137 ceph-mon[31694]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:45:38.230 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:37 smithi186 ceph-mon[31814]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-23T14:45:38.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:37 smithi007 ceph-mon[27906]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-23T14:45:38.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:37 smithi137 ceph-mon[31694]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-23T14:45:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:38 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2934173361' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bc566f6-4686-46dc-b8a2-fffbeadd9025"}]: dispatch 2024-04-23T14:45:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:38 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2934173361' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bc566f6-4686-46dc-b8a2-fffbeadd9025"}]': finished 2024-04-23T14:45:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:38 smithi007 ceph-mon[27906]: osdmap e64: 10 total, 9 up, 10 in 2024-04-23T14:45:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:45:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:38 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2934173361' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bc566f6-4686-46dc-b8a2-fffbeadd9025"}]: dispatch 2024-04-23T14:45:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:38 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2934173361' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bc566f6-4686-46dc-b8a2-fffbeadd9025"}]': finished 2024-04-23T14:45:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:38 smithi186 ceph-mon[31814]: osdmap e64: 10 total, 9 up, 10 in 2024-04-23T14:45:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:45:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:38 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2934173361' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bc566f6-4686-46dc-b8a2-fffbeadd9025"}]: dispatch 2024-04-23T14:45:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:38 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2934173361' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bc566f6-4686-46dc-b8a2-fffbeadd9025"}]': finished 2024-04-23T14:45:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:38 smithi137 ceph-mon[31694]: osdmap e64: 10 total, 9 up, 10 in 2024-04-23T14:45:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:45:40.320 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:39 smithi137 ceph-mon[31694]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-23T14:45:40.320 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:39 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2401182790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:45:40.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:39 smithi007 ceph-mon[27906]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-23T14:45:40.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:39 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2401182790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:45:40.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:39 smithi186 ceph-mon[31814]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-04-23T14:45:40.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:39 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2401182790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:45:42.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:41 smithi007 ceph-mon[27906]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:45:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:41 smithi186 ceph-mon[31814]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:45:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:41 smithi137 ceph-mon[31694]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:45:44.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:44 smithi007 ceph-mon[27906]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:45:44.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:44 smithi186 ceph-mon[31814]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:45:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:44 smithi137 ceph-mon[31694]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:45:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:46 smithi007 ceph-mon[27906]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:46 smithi186 ceph-mon[31814]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:46 smithi137 ceph-mon[31694]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:48.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:48 smithi007 ceph-mon[27906]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:48 smithi186 ceph-mon[31814]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:48.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:48 smithi137 ceph-mon[31694]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:49.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-23T14:45:49.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-23T14:45:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-23T14:45:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:50.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:50 smithi007 ceph-mon[27906]: Deploying daemon osd.9 on smithi007 2024-04-23T14:45:50.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:50 smithi007 ceph-mon[27906]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:50.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:50 smithi186 ceph-mon[31814]: Deploying daemon osd.9 on smithi007 2024-04-23T14:45:50.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:50 smithi186 ceph-mon[31814]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:50 smithi137 ceph-mon[31694]: Deploying daemon osd.9 on smithi007 2024-04-23T14:45:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:50 smithi137 ceph-mon[31694]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:52 smithi007 ceph-mon[27906]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:52.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:52 smithi186 ceph-mon[31814]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:52.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:52 smithi137 ceph-mon[31694]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:54.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:54 smithi007 ceph-mon[27906]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:54.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:54 smithi186 ceph-mon[31814]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:54.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:54 smithi137 ceph-mon[31694]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:56 smithi007 ceph-mon[27906]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:56 smithi186 ceph-mon[31814]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:56.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:56 smithi137 ceph-mon[31694]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:58 smithi007 ceph-mon[27906]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:45:58 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:58 smithi186 ceph-mon[31814]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:45:58 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:58 smithi137 ceph-mon[31694]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:45:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:45:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:45:58 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:00.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:00 smithi007 ceph-mon[27906]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:00.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:00 smithi186 ceph-mon[31814]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:00.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:00 smithi137 ceph-mon[31694]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:02.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:02 smithi007 ceph-mon[27906]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:02.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:02.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:02 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:02.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:02 smithi007 ceph-mon[27906]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-23T14:46:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:02 smithi186 ceph-mon[31814]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:02 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:02 smithi186 ceph-mon[31814]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-23T14:46:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:02 smithi137 ceph-mon[31694]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:02 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:02 smithi137 ceph-mon[31694]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-23T14:46:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.754+0000 7f72b7e00700 1 -- 172.21.15.7:0/2369744455 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f72c0062f30 con 0x7f72a40a3c40 2024-04-23T14:46:02.757 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 9 on host 'smithi007' 2024-04-23T14:46:02.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f72a40a3c40 msgr2=0x7f72a40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:02.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f72a40a3c40 0x7f72a40a6100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72b0005950 tx=0x7f72b00058e0 comp rx=0 tx=0).stop 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 msgr2=0x7f72c019f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 0x7f72c019f610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00d980 tx=0x7f72ac00dd40 comp rx=0 tx=0).stop 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 shutdown_connections 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f72a40a3c40 0x7f72a40a6100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72c010ac20 0x7f72c01a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72c0109080 0x7f72c019f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 --2- 172.21.15.7:0/2369744455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c010a280 0x7f72c019f610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 >> 172.21.15.7:0/2369744455 conn(0x7f72c0078050 msgr2=0x7f72c010d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:02.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 shutdown_connections 2024-04-23T14:46:02.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:46:02.759+0000 7f72c4c00700 1 -- 172.21.15.7:0/2369744455 wait complete. 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: osdmap e65: 10 total, 9 up, 10 in 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:03 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:03.613 DEBUG:teuthology.orchestra.run.smithi007:osd.9> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.9.service 2024-04-23T14:46:03.621 INFO:tasks.cephadm:Deploying osd.10 on smithi137 with /dev/vg_nvme/lv_1... 2024-04-23T14:46:03.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-23T14:46:03.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:03.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-23T14:46:03.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: osdmap e65: 10 total, 9 up, 10 in 2024-04-23T14:46:03.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:46:03.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:03.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:03.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:03.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:03 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: osdmap e65: 10 total, 9 up, 10 in 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:03 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:04.060 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:46:04.504 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T14:46:04.283+0000 7f8c76400700 -1 osd.9 0 waiting for initial osdmap 2024-04-23T14:46:04.504 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T14:46:04.318+0000 7f8c6b800700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:46:04.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-mon[27906]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:46:04.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-mon[27906]: osdmap e66: 10 total, 9 up, 10 in 2024-04-23T14:46:04.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:04.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:04.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:04 smithi007 ceph-mon[27906]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' 2024-04-23T14:46:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:04 smithi186 ceph-mon[31814]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:46:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:04 smithi186 ceph-mon[31814]: osdmap e66: 10 total, 9 up, 10 in 2024-04-23T14:46:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:04.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:04 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:04.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:04 smithi186 ceph-mon[31814]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' 2024-04-23T14:46:04.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:04 smithi137 ceph-mon[31694]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-04-23T14:46:04.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:04 smithi137 ceph-mon[31694]: osdmap e66: 10 total, 9 up, 10 in 2024-04-23T14:46:04.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:04.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:04 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:04.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:04 smithi137 ceph-mon[31694]: from='osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792]' entity='osd.9' 2024-04-23T14:46:05.776 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:46:05.776 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:46:05.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:05.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:05.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] boot 2024-04-23T14:46:05.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: osdmap e67: 10 total, 10 up, 10 in 2024-04-23T14:46:05.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] boot 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: osdmap e67: 10 total, 10 up, 10 in 2024-04-23T14:46:05.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:46:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:46:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-04-23T14:46:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: osd.9 [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] boot 2024-04-23T14:46:05.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: osdmap e67: 10 total, 10 up, 10 in 2024-04-23T14:46:05.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:46:07.050 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-23T14:46:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-23T14:46:07.051 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-23T14:46:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-23T14:46:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0346174 s, 303 MB/s 2024-04-23T14:46:07.051 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-23T14:46:07.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:07 smithi007 ceph-mon[27906]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:07.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:07 smithi007 ceph-mon[27906]: osdmap e68: 10 total, 10 up, 10 in 2024-04-23T14:46:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:07 smithi186 ceph-mon[31814]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:07 smithi186 ceph-mon[31814]: osdmap e68: 10 total, 10 up, 10 in 2024-04-23T14:46:07.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:07 smithi137 ceph-mon[31694]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:07.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:07 smithi137 ceph-mon[31694]: osdmap e68: 10 total, 10 up, 10 in 2024-04-23T14:46:07.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_1 2024-04-23T14:46:08.383 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T14:46:09.563 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:09.563 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.563 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.563 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.563 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.563 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.564 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.564 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.564 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:09.564 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:09.564 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:10.333 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:10 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi007 2024-04-23T14:46:10.333 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:10 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 4273M 2024-04-23T14:46:10.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:10 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi007 2024-04-23T14:46:10.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:10 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 4273M 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 -- 172.21.15.137:0/3794943058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc104da0 msgr2=0x7f24bc1051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 --2- 172.21.15.137:0/3794943058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc104da0 0x7f24bc1051c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0099c0 tx=0x7f24ac009cd0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 -- 172.21.15.137:0/3794943058 shutdown_connections 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 --2- 172.21.15.137:0/3794943058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24bc106940 0x7f24bc10d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 --2- 172.21.15.137:0/3794943058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc104da0 0x7f24bc1051c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 --2- 172.21.15.137:0/3794943058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24bc105fa0 0x7f24bc106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 -- 172.21.15.137:0/3794943058 >> 172.21.15.137:0/3794943058 conn(0x7f24bc100340 msgr2=0x7f24bc102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 -- 172.21.15.137:0/3794943058 shutdown_connections 2024-04-23T14:46:10.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.600+0000 7f24c1400700 1 -- 172.21.15.137:0/3794943058 wait complete. 2024-04-23T14:46:10.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.602+0000 7f24c1400700 1 Processor -- start 2024-04-23T14:46:10.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.602+0000 7f24c1400700 1 -- start start 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.602+0000 7f24c1400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24bc104da0 0x7f24bc19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24c1400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 0x7f24bc19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24c1400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24bc106940 0x7f24bc1a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24c1400700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc110880 con 0x7f24bc106940 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24c1400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc110700 con 0x7f24bc105fa0 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24c1400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc110a00 con 0x7f24bc104da0 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 0x7f24bc19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 0x7f24bc19b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60310/0 (socket says 172.21.15.137:60310) 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 -- 172.21.15.137:0/2210777256 learned_addr learned my addr 172.21.15.137:0/2210777256 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T14:46:10.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24ba800700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24bc104da0 0x7f24bc19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24bb200700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24bc106940 0x7f24bc1a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 -- 172.21.15.137:0/2210777256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24bc104da0 msgr2=0x7f24bc19aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24bc104da0 0x7f24bc19aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 -- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24bc106940 msgr2=0x7f24bc1a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24bc106940 0x7f24bc1a2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.603+0000 7f24b9e00700 1 -- 172.21.15.137:0/2210777256 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc1a2b20 con 0x7f24bc105fa0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.604+0000 7f24b9e00700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 0x7f24bc19b400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24a800d950 tx=0x7f24a800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.604+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8016070 con 0x7f24bc105fa0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.604+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24a8010460 con 0x7f24bc105fa0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.604+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc1a2e10 con 0x7f24bc105fa0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.604+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a800f600 con 0x7f24bc105fa0 2024-04-23T14:46:10.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.604+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc1a32c0 con 0x7f24bc105fa0 2024-04-23T14:46:10.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.606+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc0697e0 con 0x7f24bc105fa0 2024-04-23T14:46:10.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.608+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f24a8019070 con 0x7f24bc105fa0 2024-04-23T14:46:10.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.609+0000 7f24b3400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f24a00a3c40 0x7f24a00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:10.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.609+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f24a80cfc60 con 0x7f24bc105fa0 2024-04-23T14:46:10.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.610+0000 7f24ba800700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f24a00a3c40 0x7f24a00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:10.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.611+0000 7f24ba800700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f24a00a3c40 0x7f24a00a6100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f24ac000c00 tx=0x7f24ac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:10.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:10 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi007 2024-04-23T14:46:10.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:10 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 4273M 2024-04-23T14:46:10.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.614+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f24a809cda0 con 0x7f24bc105fa0 2024-04-23T14:46:10.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:10.849+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f24bc062f30 con 0x7f24a00a3c40 2024-04-23T14:46:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:11 smithi007 ceph-mon[27906]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:11 smithi007 ceph-mon[27906]: from='client.34343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:46:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:46:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:46:11.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:11 smithi186 ceph-mon[31814]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:11 smithi186 ceph-mon[31814]: from='client.34343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:46:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:46:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:46:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:11 smithi137 ceph-mon[31694]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:11 smithi137 ceph-mon[31694]: from='client.34343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:46:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:46:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:46:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:13.495 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:13 smithi137 ceph-mon[31694]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:13.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:13 smithi007 ceph-mon[27906]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:13.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:13 smithi186 ceph-mon[31814]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:15 smithi007 ceph-mon[27906]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:15 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/1934436192' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]: dispatch 2024-04-23T14:46:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:15 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]: dispatch 2024-04-23T14:46:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:15 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]': finished 2024-04-23T14:46:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:15 smithi007 ceph-mon[27906]: osdmap e69: 11 total, 10 up, 11 in 2024-04-23T14:46:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:15 smithi186 ceph-mon[31814]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:15 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/1934436192' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]: dispatch 2024-04-23T14:46:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:15 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]: dispatch 2024-04-23T14:46:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:15 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]': finished 2024-04-23T14:46:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:15 smithi186 ceph-mon[31814]: osdmap e69: 11 total, 10 up, 11 in 2024-04-23T14:46:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:15.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:15 smithi137 ceph-mon[31694]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:15.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:15 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/1934436192' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]: dispatch 2024-04-23T14:46:15.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:15 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]: dispatch 2024-04-23T14:46:15.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:15 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4c5d502-eef1-42eb-88fe-2b9c343deb6e"}]': finished 2024-04-23T14:46:15.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:15 smithi137 ceph-mon[31694]: osdmap e69: 11 total, 10 up, 11 in 2024-04-23T14:46:15.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:16 smithi186 ceph-mon[31814]: from='client.? 172.21.15.137:0/1049352107' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:46:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:16 smithi137 ceph-mon[31694]: from='client.? 172.21.15.137:0/1049352107' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:46:16.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:16 smithi007 ceph-mon[27906]: from='client.? 172.21.15.137:0/1049352107' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:46:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:17 smithi186 ceph-mon[31814]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:17.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:17 smithi137 ceph-mon[31694]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:17 smithi007 ceph-mon[27906]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:19.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:19 smithi186 ceph-mon[31814]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:19.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:19 smithi137 ceph-mon[31694]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:19 smithi007 ceph-mon[27906]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:21.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:21 smithi186 ceph-mon[31814]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:21.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:21 smithi137 ceph-mon[31694]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:21 smithi007 ceph-mon[27906]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:23 smithi137 ceph-mon[31694]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:23 smithi007 ceph-mon[27906]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:23 smithi186 ceph-mon[31814]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:25 smithi137 ceph-mon[31694]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-23T14:46:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:25 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:25 smithi137 ceph-mon[31694]: Deploying daemon osd.10 on smithi137 2024-04-23T14:46:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:25 smithi007 ceph-mon[27906]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-23T14:46:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:25 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:25.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:25 smithi007 ceph-mon[27906]: Deploying daemon osd.10 on smithi137 2024-04-23T14:46:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:25 smithi186 ceph-mon[31814]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-23T14:46:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:25 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:25 smithi186 ceph-mon[31814]: Deploying daemon osd.10 on smithi137 2024-04-23T14:46:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:27 smithi137 ceph-mon[31694]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:27 smithi007 ceph-mon[27906]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:27 smithi186 ceph-mon[31814]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:29.596 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:29 smithi137 ceph-mon[31694]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:29.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:29 smithi186 ceph-mon[31814]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:29 smithi007 ceph-mon[27906]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:31.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:31 smithi137 ceph-mon[31694]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:31 smithi007 ceph-mon[27906]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:31 smithi186 ceph-mon[31814]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:33.977 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:33 smithi137 ceph-mon[31694]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:33.977 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:33.977 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:33.977 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:33 smithi007 ceph-mon[27906]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:34.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:34.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:33 smithi186 ceph-mon[31814]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:34.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:34.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:34.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:35.847 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:35 smithi137 ceph-mon[31694]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:35 smithi007 ceph-mon[27906]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:35 smithi186 ceph-mon[31814]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:37.466 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 10 on host 'smithi137' 2024-04-23T14:46:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.464+0000 7f24b3400700 1 -- 172.21.15.137:0/2210777256 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f24bc062f30 con 0x7f24a00a3c40 2024-04-23T14:46:37.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f24a00a3c40 msgr2=0x7f24a00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:37.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f24a00a3c40 0x7f24a00a6100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f24ac000c00 tx=0x7f24ac005fb0 comp rx=0 tx=0).stop 2024-04-23T14:46:37.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 msgr2=0x7f24bc19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:37.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 0x7f24bc19b400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24a800d950 tx=0x7f24a800dd10 comp rx=0 tx=0).stop 2024-04-23T14:46:37.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 shutdown_connections 2024-04-23T14:46:37.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f24a00a3c40 0x7f24a00a6100 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:37.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24bc106940 0x7f24bc1a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:37.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24bc104da0 0x7f24bc19aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:37.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 --2- 172.21.15.137:0/2210777256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24bc105fa0 0x7f24bc19b400 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24a800d950 tx=0x7f24a800dd10 comp rx=0 tx=0).stop 2024-04-23T14:46:37.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.468+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 >> 172.21.15.137:0/2210777256 conn(0x7f24bc100340 msgr2=0x7f24bc109320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:37.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.469+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 shutdown_connections 2024-04-23T14:46:37.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T14:46:37.469+0000 7f24c1400700 1 -- 172.21.15.137:0/2210777256 wait complete. 2024-04-23T14:46:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:37 smithi137 ceph-mon[31694]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:37 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:37 smithi137 ceph-mon[31694]: from='osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T14:46:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:37 smithi137 ceph-mon[31694]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T14:46:37.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:37 smithi007 ceph-mon[27906]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:37 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:37 smithi007 ceph-mon[27906]: from='osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T14:46:37.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:37 smithi007 ceph-mon[27906]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T14:46:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:37 smithi186 ceph-mon[31814]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:37 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:37 smithi186 ceph-mon[31814]: from='osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T14:46:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:37 smithi186 ceph-mon[31814]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T14:46:38.282 DEBUG:teuthology.orchestra.run.smithi137:osd.10> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.10.service 2024-04-23T14:46:38.287 INFO:tasks.cephadm:Deploying osd.11 on smithi186 with /dev/vg_nvme/lv_1... 2024-04-23T14:46:38.287 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: from='osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: osdmap e70: 11 total, 10 up, 11 in 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:38.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:38 smithi137 ceph-mon[31694]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:46:38.737 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: from='osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: osdmap e70: 11 total, 10 up, 11 in 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:38 smithi007 ceph-mon[27906]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:46:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-23T14:46:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: from='osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:46:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: osdmap e70: 11 total, 10 up, 11 in 2024-04-23T14:46:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:38.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:38 smithi186 ceph-mon[31814]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-23T14:46:39.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:39 smithi186 ceph-mon[31814]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:39.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:39 smithi186 ceph-mon[31814]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:46:39.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:39 smithi186 ceph-mon[31814]: osdmap e71: 11 total, 10 up, 11 in 2024-04-23T14:46:39.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:39.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:39 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:39.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:39 smithi186 ceph-mon[31814]: from='osd.10 ' entity='osd.10' 2024-04-23T14:46:39.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-mon[31694]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:39.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-mon[31694]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:46:39.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-mon[31694]: osdmap e71: 11 total, 10 up, 11 in 2024-04-23T14:46:39.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:39.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:39.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-mon[31694]: from='osd.10 ' entity='osd.10' 2024-04-23T14:46:39.669 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T14:46:39.277+0000 7f277fc00700 -1 osd.10 0 waiting for initial osdmap 2024-04-23T14:46:39.669 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 14:46:39 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T14:46:39.317+0000 7f2775000700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:46:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:39 smithi007 ceph-mon[27906]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:39.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:39 smithi007 ceph-mon[27906]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-23T14:46:39.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:39 smithi007 ceph-mon[27906]: osdmap e71: 11 total, 10 up, 11 in 2024-04-23T14:46:39.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:39.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:39 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:39.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:39 smithi007 ceph-mon[27906]: from='osd.10 ' entity='osd.10' 2024-04-23T14:46:40.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:40 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:46:40.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:40 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:46:40.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:40 smithi137 ceph-mon[31694]: osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] boot 2024-04-23T14:46:40.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:40 smithi137 ceph-mon[31694]: osdmap e72: 11 total, 11 up, 11 in 2024-04-23T14:46:40.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:40 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:40.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:40 smithi137 ceph-mon[31694]: osdmap e73: 11 total, 11 up, 11 in 2024-04-23T14:46:40.801 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:40 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:46:40.801 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:40 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:46:40.802 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:40 smithi186 ceph-mon[31814]: osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] boot 2024-04-23T14:46:40.802 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:40 smithi186 ceph-mon[31814]: osdmap e72: 11 total, 11 up, 11 in 2024-04-23T14:46:40.802 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:40 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:40.802 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:40 smithi186 ceph-mon[31814]: osdmap e73: 11 total, 11 up, 11 in 2024-04-23T14:46:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:40 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:46:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:40 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:46:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:40 smithi007 ceph-mon[27906]: osd.10 [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] boot 2024-04-23T14:46:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:40 smithi007 ceph-mon[27906]: osdmap e72: 11 total, 11 up, 11 in 2024-04-23T14:46:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:40 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:46:40.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:40 smithi007 ceph-mon[27906]: osdmap e73: 11 total, 11 up, 11 in 2024-04-23T14:46:41.696 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-23T14:46:41.697 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-23T14:46:41.697 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-04-23T14:46:41.697 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-04-23T14:46:41.697 INFO:teuthology.orchestra.run.smithi186.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0322174 s, 325 MB/s 2024-04-23T14:46:41.697 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-04-23T14:46:42.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:41 smithi007 ceph-mon[27906]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:42.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:41 smithi007 ceph-mon[27906]: osdmap e74: 11 total, 11 up, 11 in 2024-04-23T14:46:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:41 smithi186 ceph-mon[31814]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:41 smithi186 ceph-mon[31814]: osdmap e74: 11 total, 11 up, 11 in 2024-04-23T14:46:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:41 smithi137 ceph-mon[31694]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-04-23T14:46:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:41 smithi137 ceph-mon[31694]: osdmap e74: 11 total, 11 up, 11 in 2024-04-23T14:46:42.621 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_1 2024-04-23T14:46:43.038 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:46:43.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:43 smithi137 ceph-mon[31694]: osdmap e75: 11 total, 11 up, 11 in 2024-04-23T14:46:43.320 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:42 smithi186 ceph-mon[31814]: osdmap e75: 11 total, 11 up, 11 in 2024-04-23T14:46:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:42 smithi007 ceph-mon[27906]: osdmap e75: 11 total, 11 up, 11 in 2024-04-23T14:46:44.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: osdmap e76: 11 total, 11 up, 11 in 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:44.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: osdmap e76: 11 total, 11 up, 11 in 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:44.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: osdmap e76: 11 total, 11 up, 11 in 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:44.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:44.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:45.077 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:45 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi137 2024-04-23T14:46:45.077 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:45 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 4272M 2024-04-23T14:46:45.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:45.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:45.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:45.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:45 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi137 2024-04-23T14:46:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:45 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 4272M 2024-04-23T14:46:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:45.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:45.357 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 -- 172.21.15.186:0/3852902950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63801046f0 msgr2=0x7f638010afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 --2- 172.21.15.186:0/3852902950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63801046f0 0x7f638010afa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f637800b0a0 tx=0x7f637800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 -- 172.21.15.186:0/3852902950 shutdown_connections 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 --2- 172.21.15.186:0/3852902950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63801046f0 0x7f638010afa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 --2- 172.21.15.186:0/3852902950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 0x7f6380102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 --2- 172.21.15.186:0/3852902950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6380103d50 0x7f63801041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 -- 172.21.15.186:0/3852902950 >> 172.21.15.186:0/3852902950 conn(0x7f63800fe0f0 msgr2=0x7f6380100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 -- 172.21.15.186:0/3852902950 shutdown_connections 2024-04-23T14:46:45.358 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.357+0000 7f6387c00700 1 -- 172.21.15.186:0/3852902950 wait complete. 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.358+0000 7f6387c00700 1 Processor -- start 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.358+0000 7f6387c00700 1 -- start start 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6387c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 0x7f6380076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6387c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 0x7f6380074ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6387c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63801046f0 0x7f6380075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6387c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f638010e690 con 0x7f6380102b50 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6387c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f638010e510 con 0x7f63801046f0 2024-04-23T14:46:45.359 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6387c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f638010e810 con 0x7f6380103d50 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f637fe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 0x7f6380074ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f637fe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 0x7f6380074ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:51990/0 (socket says 172.21.15.186:51990) 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f637fe00700 1 -- 172.21.15.186:0/3932598423 learned_addr learned my addr 172.21.15.186:0/3932598423 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.359+0000 7f6385200700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 0x7f6380076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f6385c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63801046f0 0x7f6380075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637fe00700 1 -- 172.21.15.186:0/3932598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63801046f0 msgr2=0x7f6380075420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637fe00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63801046f0 0x7f6380075420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637fe00700 1 -- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 msgr2=0x7f6380076890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637fe00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 0x7f6380076890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637fe00700 1 -- 172.21.15.186:0/3932598423 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6380075cd0 con 0x7f6380103d50 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f6385200700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 0x7f6380076890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:46:45.361 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637fe00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 0x7f6380074ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f636c00b530 tx=0x7f636c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:45.362 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c015020 con 0x7f6380103d50 2024-04-23T14:46:45.362 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f636c011ce0 con 0x7f6380103d50 2024-04-23T14:46:45.362 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c010d60 con 0x7f6380103d50 2024-04-23T14:46:45.362 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63801a2e60 con 0x7f6380103d50 2024-04-23T14:46:45.362 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.360+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801a3330 con 0x7f6380103d50 2024-04-23T14:46:45.362 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.362+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638002dfe0 con 0x7f6380103d50 2024-04-23T14:46:45.364 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.364+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f636c018020 con 0x7f6380103d50 2024-04-23T14:46:45.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.366+0000 7f637d600700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63680a3c40 0x7f63680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:45.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.366+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6694+0+0 (secure 0 0 0) 0x7f636c0cfbe0 con 0x7f6380103d50 2024-04-23T14:46:45.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.366+0000 7f6385200700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63680a3c40 0x7f63680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:45.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.367+0000 7f6385200700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63680a3c40 0x7f63680a6100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6374005fd0 tx=0x7f6374005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:45.370 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.370+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f636c01f020 con 0x7f6380103d50 2024-04-23T14:46:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:45 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi137 2024-04-23T14:46:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:45 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 4272M 2024-04-23T14:46:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:46:45.610 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:46:45.609+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6380062f30 con 0x7f63680a3c40 2024-04-23T14:46:46.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:46 smithi007 ceph-mon[27906]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-04-23T14:46:46.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:46 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:46:46.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:46 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:46:46.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:46 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:46 smithi186 ceph-mon[31814]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-04-23T14:46:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:46 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:46:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:46 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:46:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:46 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:46 smithi137 ceph-mon[31694]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-04-23T14:46:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:46 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:46:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:46 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:46:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:46 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:47 smithi007 ceph-mon[27906]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:46:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:47 smithi186 ceph-mon[31814]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:46:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:47 smithi137 ceph-mon[31694]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:46:48.298 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:48 smithi186 ceph-mon[31814]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:46:48.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:48 smithi007 ceph-mon[27906]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:46:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:48 smithi137 ceph-mon[31694]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:46:50.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:50 smithi007 ceph-mon[27906]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-23T14:46:50.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:50 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/2542336312' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]: dispatch 2024-04-23T14:46:50.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:50 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]: dispatch 2024-04-23T14:46:50.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:50 smithi007 ceph-mon[27906]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]': finished 2024-04-23T14:46:50.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:50 smithi007 ceph-mon[27906]: osdmap e77: 12 total, 11 up, 12 in 2024-04-23T14:46:50.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:50 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:46:50.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:50 smithi186 ceph-mon[31814]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-23T14:46:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:50 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/2542336312' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]: dispatch 2024-04-23T14:46:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:50 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]: dispatch 2024-04-23T14:46:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:50 smithi186 ceph-mon[31814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]': finished 2024-04-23T14:46:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:50 smithi186 ceph-mon[31814]: osdmap e77: 12 total, 11 up, 12 in 2024-04-23T14:46:50.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:50 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:46:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:50 smithi137 ceph-mon[31694]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-04-23T14:46:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:50 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/2542336312' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]: dispatch 2024-04-23T14:46:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:50 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]: dispatch 2024-04-23T14:46:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:50 smithi137 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "793ab73a-d36f-4b60-9cb3-9a2a14b92148"}]': finished 2024-04-23T14:46:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:50 smithi137 ceph-mon[31694]: osdmap e77: 12 total, 11 up, 12 in 2024-04-23T14:46:50.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:50 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:46:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:51 smithi007 ceph-mon[27906]: from='client.? 172.21.15.186:0/3469804094' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:46:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:51 smithi186 ceph-mon[31814]: from='client.? 172.21.15.186:0/3469804094' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:46:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:51 smithi137 ceph-mon[31694]: from='client.? 172.21.15.186:0/3469804094' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:46:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:52 smithi007 ceph-mon[27906]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:46:52.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:52 smithi186 ceph-mon[31814]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:46:52.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:52 smithi137 ceph-mon[31694]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:46:54.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:54 smithi007 ceph-mon[27906]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:46:54.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:54 smithi186 ceph-mon[31814]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:46:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:54 smithi137 ceph-mon[31694]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-23T14:46:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:56 smithi007 ceph-mon[27906]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:56 smithi186 ceph-mon[31814]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:56.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:56 smithi137 ceph-mon[31694]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:58.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:58 smithi007 ceph-mon[27906]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:58 smithi186 ceph-mon[31814]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:58 smithi137 ceph-mon[31694]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:59.321 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:46:59 smithi186 ceph-mon[31814]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:46:59 smithi137 ceph-mon[31694]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:46:59.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:46:59 smithi007 ceph-mon[27906]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:00.388 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-23T14:47:00.389 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:00 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:00.389 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:00 smithi186 ceph-mon[31814]: Deploying daemon osd.11 on smithi186 2024-04-23T14:47:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-23T14:47:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:00 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:00 smithi137 ceph-mon[31694]: Deploying daemon osd.11 on smithi186 2024-04-23T14:47:00.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-23T14:47:00.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:00 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:00.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:00 smithi007 ceph-mon[27906]: Deploying daemon osd.11 on smithi186 2024-04-23T14:47:01.207 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:01 smithi186 ceph-mon[31814]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:01.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:01 smithi137 ceph-mon[31694]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:01.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:01 smithi007 ceph-mon[27906]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:03.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:03 smithi186 ceph-mon[31814]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:03 smithi137 ceph-mon[31694]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:03 smithi007 ceph-mon[27906]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:05 smithi186 ceph-mon[31814]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:05.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:05 smithi007 ceph-mon[27906]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:05.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:05 smithi137 ceph-mon[31694]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:07.584 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:07 smithi186 ceph-mon[31814]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:07.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:07 smithi137 ceph-mon[31694]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:07 smithi007 ceph-mon[27906]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:09.071 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:08 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:09.071 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:08 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:09.071 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:08 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:08 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:08 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:08 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:08 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:08 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:08 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:09 smithi007 ceph-mon[27906]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:10.092 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:09 smithi137 ceph-mon[31694]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:09 smithi186 ceph-mon[31814]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:11.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:11.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:11.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:11.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:11.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T14:47:11.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:11 smithi137 ceph-mon[31694]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T14:47:12.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:11 smithi186 ceph-mon[31814]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T14:47:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T14:47:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:11 smithi007 ceph-mon[27906]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T14:47:12.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.938+0000 7f637d600700 1 -- 172.21.15.186:0/3932598423 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6380062f30 con 0x7f63680a3c40 2024-04-23T14:47:12.940 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 11 on host 'smithi186' 2024-04-23T14:47:12.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63680a3c40 msgr2=0x7f63680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:12.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63680a3c40 0x7f63680a6100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6374005fd0 tx=0x7f6374005dc0 comp rx=0 tx=0).stop 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 msgr2=0x7f6380074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 0x7f6380074ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f636c00b530 tx=0x7f636c00b8f0 comp rx=0 tx=0).stop 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 shutdown_connections 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63680a3c40 0x7f63680a6100 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63801046f0 0x7f6380075420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6380102b50 0x7f6380076890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 --2- 172.21.15.186:0/3932598423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6380103d50 0x7f6380074ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:12.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.942+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 >> 172.21.15.186:0/3932598423 conn(0x7f63800fe0f0 msgr2=0x7f6380107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:12.945 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.943+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 shutdown_connections 2024-04-23T14:47:12.945 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:12.943+0000 7f6387c00700 1 -- 172.21.15.186:0/3932598423 wait complete. 2024-04-23T14:47:13.716 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: osdmap e78: 12 total, 11 up, 12 in 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:13.717 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:13 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:13.784 DEBUG:teuthology.orchestra.run.smithi186:osd.11> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.11.service 2024-04-23T14:47:13.788 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-23T14:47:13.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-23T14:47:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-23T14:47:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: osdmap e78: 12 total, 11 up, 12 in 2024-04-23T14:47:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:47:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:47:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:13.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:13 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-23T14:47:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: osdmap e78: 12 total, 11 up, 12 in 2024-04-23T14:47:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:47:13.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-04-23T14:47:13.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:13.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:13.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:13 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:47:14.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:14 smithi007 ceph-mon[27906]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:47:14.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:14 smithi007 ceph-mon[27906]: osdmap e79: 12 total, 11 up, 12 in 2024-04-23T14:47:14.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:14.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:14.745 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:14 smithi186 ceph-mon[31814]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:47:14.746 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:14 smithi186 ceph-mon[31814]: osdmap e79: 12 total, 11 up, 12 in 2024-04-23T14:47:14.746 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:14.746 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:14.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:14 smithi137 ceph-mon[31694]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-04-23T14:47:14.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:14 smithi137 ceph-mon[31694]: osdmap e79: 12 total, 11 up, 12 in 2024-04-23T14:47:14.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:14.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:15.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: purged_snaps scrub starts 2024-04-23T14:47:15.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: purged_snaps scrub ok 2024-04-23T14:47:15.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:15.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:15.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] boot 2024-04-23T14:47:15.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: osdmap e80: 12 total, 12 up, 12 in 2024-04-23T14:47:15.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: purged_snaps scrub starts 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: purged_snaps scrub ok 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] boot 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: osdmap e80: 12 total, 12 up, 12 in 2024-04-23T14:47:15.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:15.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: purged_snaps scrub starts 2024-04-23T14:47:15.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: purged_snaps scrub ok 2024-04-23T14:47:15.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-23T14:47:15.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:15.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: osd.11 [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] boot 2024-04-23T14:47:15.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: osdmap e80: 12 total, 12 up, 12 in 2024-04-23T14:47:15.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.604+0000 7f1d39400700 1 -- 172.21.15.7:0/2649345667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34103da0 msgr2=0x7f1d34104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.604+0000 7f1d39400700 1 --2- 172.21.15.7:0/2649345667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34103da0 0x7f1d34104200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d200099c0 tx=0x7f1d20009cd0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 -- 172.21.15.7:0/2649345667 shutdown_connections 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 --2- 172.21.15.7:0/2649345667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d34104740 0x7f1d3410aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 --2- 172.21.15.7:0/2649345667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d34102ba0 0x7f1d34102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 --2- 172.21.15.7:0/2649345667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34103da0 0x7f1d34104200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 -- 172.21.15.7:0/2649345667 >> 172.21.15.7:0/2649345667 conn(0x7f1d340fe140 msgr2=0x7f1d34100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:16.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 -- 172.21.15.7:0/2649345667 shutdown_connections 2024-04-23T14:47:16.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.605+0000 7f1d39400700 1 -- 172.21.15.7:0/2649345667 wait complete. 2024-04-23T14:47:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.606+0000 7f1d39400700 1 Processor -- start 2024-04-23T14:47:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.606+0000 7f1d39400700 1 -- start start 2024-04-23T14:47:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d39400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d34102ba0 0x7f1d3419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d39400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d34103da0 0x7f1d3419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d39400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 0x7f1d341a2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d39400700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3410e660 con 0x7f1d34104740 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d39400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3410e4e0 con 0x7f1d34103da0 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d39400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3410e7e0 con 0x7f1d34102ba0 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d33200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 0x7f1d341a2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d32800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d34102ba0 0x7f1d3419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d33200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 0x7f1d341a2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41648/0 (socket says 172.21.15.7:41648) 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d33200700 1 -- 172.21.15.7:0/1301452375 learned_addr learned my addr 172.21.15.7:0/1301452375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.607+0000 7f1d31e00700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d34103da0 0x7f1d3419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d33200700 1 -- 172.21.15.7:0/1301452375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d34102ba0 msgr2=0x7f1d3419ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d33200700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d34102ba0 0x7f1d3419ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d33200700 1 -- 172.21.15.7:0/1301452375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d34103da0 msgr2=0x7f1d3419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:16.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d33200700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d34103da0 0x7f1d3419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d33200700 1 -- 172.21.15.7:0/1301452375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d341a2ac0 con 0x7f1d34104740 2024-04-23T14:47:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d33200700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 0x7f1d341a2420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c007da0 tx=0x7f1d2c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c016020 con 0x7f1d34104740 2024-04-23T14:47:16.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d341a2db0 con 0x7f1d34104740 2024-04-23T14:47:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d2c00ac50 con 0x7f1d34104740 2024-04-23T14:47:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.608+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0115e0 con 0x7f1d34104740 2024-04-23T14:47:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.609+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d341a3270 con 0x7f1d34104740 2024-04-23T14:47:16.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.610+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d340697e0 con 0x7f1d34104740 2024-04-23T14:47:16.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.614+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f1d2c019020 con 0x7f1d34104740 2024-04-23T14:47:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.615+0000 7f1d2b400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1d180a3c40 0x7f1d180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.615+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f1d2c0d0260 con 0x7f1d34104740 2024-04-23T14:47:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.615+0000 7f1d32800700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1d180a3c40 0x7f1d180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.616+0000 7f1d32800700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1d180a3c40 0x7f1d180a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d34103c00 tx=0x7f1d2400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:16.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.618+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1d2c020020 con 0x7f1d34104740 2024-04-23T14:47:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:16 smithi007 ceph-mon[27906]: osdmap e81: 12 total, 12 up, 12 in 2024-04-23T14:47:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.853+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1d341a3790 con 0x7f1d34104740 2024-04-23T14:47:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.854+0000 7f1d2b400700 1 -- 172.21.15.7:0/1301452375 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f1d2c00ae00 con 0x7f1d34104740 2024-04-23T14:47:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1d180a3c40 msgr2=0x7f1d180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1d180a3c40 0x7f1d180a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d34103c00 tx=0x7f1d2400a380 comp rx=0 tx=0).stop 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 msgr2=0x7f1d341a2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 0x7f1d341a2420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c007da0 tx=0x7f1d2c00a340 comp rx=0 tx=0).stop 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 shutdown_connections 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1d180a3c40 0x7f1d180a6100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d34104740 0x7f1d341a2420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d34102ba0 0x7f1d3419ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 --2- 172.21.15.7:0/1301452375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d34103da0 0x7f1d3419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 >> 172.21.15.7:0/1301452375 conn(0x7f1d340fe140 msgr2=0x7f1d34074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 shutdown_connections 2024-04-23T14:47:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:16.857+0000 7f1d39400700 1 -- 172.21.15.7:0/1301452375 wait complete. 2024-04-23T14:47:16.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:16 smithi186 ceph-mon[31814]: osdmap e81: 12 total, 12 up, 12 in 2024-04-23T14:47:16.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:16 smithi137 ceph-mon[31694]: osdmap e81: 12 total, 12 up, 12 in 2024-04-23T14:47:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:17 smithi007 ceph-mon[27906]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:17 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1301452375' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T14:47:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:17 smithi186 ceph-mon[31814]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:17 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1301452375' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T14:47:17.902 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1713883634,"num_in_osds":12,"osd_in_since":1713883609,"num_remapped_pgs":0} 2024-04-23T14:47:17.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T14:47:17.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:17 smithi137 ceph-mon[31694]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:17.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:17 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1301452375' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T14:47:18.338 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:47:20.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:20.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: Detected new or changed devices on smithi186 2024-04-23T14:47:20.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 4272M 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: Detected new or changed devices on smithi186 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 4272M 2024-04-23T14:47:20.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:20.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:20.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: Detected new or changed devices on smithi186 2024-04-23T14:47:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 4272M 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:20.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 -- 172.21.15.7:0/2600775021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 msgr2=0x7f3218108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 --2- 172.21.15.7:0/2600775021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f3218108f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3208009990 tx=0x7f3208009ca0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 -- 172.21.15.7:0/2600775021 shutdown_connections 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 --2- 172.21.15.7:0/2600775021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3218103530 0x7f321810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 --2- 172.21.15.7:0/2600775021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f3218108f60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 --2- 172.21.15.7:0/2600775021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3218102b70 0x7f3218102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 -- 172.21.15.7:0/2600775021 >> 172.21.15.7:0/2600775021 conn(0x7f3218079bc0 msgr2=0x7f3218079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 -- 172.21.15.7:0/2600775021 shutdown_connections 2024-04-23T14:47:20.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.582+0000 7f321f200700 1 -- 172.21.15.7:0/2600775021 wait complete. 2024-04-23T14:47:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.583+0000 7f321f200700 1 Processor -- start 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 -- start start 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3218102b70 0x7f3218199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3218103530 0x7f3218199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f321819da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3218112d00 con 0x7f3218108b80 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3218112b80 con 0x7f3218103530 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.584+0000 7f321f200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3218112e80 con 0x7f3218102b70 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f321819da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f321819da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41670/0 (socket says 172.21.15.7:41670) 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 -- 172.21.15.7:0/308048137 learned_addr learned my addr 172.21.15.7:0/308048137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:20.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f3217e00700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3218102b70 0x7f3218199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f320f400700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3218103530 0x7f3218199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 -- 172.21.15.7:0/308048137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3218102b70 msgr2=0x7f3218199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3218102b70 0x7f3218199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 -- 172.21.15.7:0/308048137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3218103530 msgr2=0x7f3218199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3218103530 0x7f3218199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 -- 172.21.15.7:0/308048137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321819e140 con 0x7f3218108b80 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.585+0000 7f321d200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f321819da00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3210007ee0 tx=0x7f321000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.586+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321000dbd0 con 0x7f3218108b80 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.586+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f321000dd70 con 0x7f3218108b80 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.586+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210005a20 con 0x7f3218108b80 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.586+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321819e430 con 0x7f3218108b80 2024-04-23T14:47:20.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.586+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32181a5cb0 con 0x7f3218108b80 2024-04-23T14:47:20.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.587+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32180697e0 con 0x7f3218108b80 2024-04-23T14:47:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.589+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f321001a020 con 0x7f3218108b80 2024-04-23T14:47:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.591+0000 7f3215600700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f31f80a3cc0 0x7f31f80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.591+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f32100cf1f0 con 0x7f3218108b80 2024-04-23T14:47:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.591+0000 7f3217e00700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f31f80a3cc0 0x7f31f80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.592+0000 7f3217e00700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f31f80a3cc0 0x7f31f80a6180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f320800b5c0 tx=0x7f320801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.596+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3210010070 con 0x7f3218108b80 2024-04-23T14:47:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.830+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f321802e1a0 con 0x7f3218108b80 2024-04-23T14:47:20.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.831+0000 7f3215600700 1 -- 172.21.15.7:0/308048137 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18386 (secure 0 0 0) 0x7f3210010250 con 0x7f3218108b80 2024-04-23T14:47:20.833 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:20.834 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:47:15.452468+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:47:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.835+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f31f80a3cc0 msgr2=0x7f31f80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.835+0000 7f321f200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f31f80a3cc0 0x7f31f80a6180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f320800b5c0 tx=0x7f320801a040 comp rx=0 tx=0).stop 2024-04-23T14:47:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.835+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 msgr2=0x7f321819da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.835+0000 7f321f200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f321819da00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3210007ee0 tx=0x7f321000d3b0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 shutdown_connections 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f31f80a3cc0 0x7f31f80a6180 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3218108b80 0x7f321819da00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3218102b70 0x7f3218199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 --2- 172.21.15.7:0/308048137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3218103530 0x7f3218199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 >> 172.21.15.7:0/308048137 conn(0x7f3218079bc0 msgr2=0x7f3218101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 shutdown_connections 2024-04-23T14:47:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:20.836+0000 7f321f200700 1 -- 172.21.15.7:0/308048137 wait complete. 2024-04-23T14:47:21.808 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T14:47:21.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-23T14:47:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:21 smithi007 ceph-mon[27906]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:21 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/308048137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:47:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:21 smithi186 ceph-mon[31814]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:21 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/308048137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:47:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:21 smithi137 ceph-mon[31694]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:21 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/308048137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:47:22.274 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:47:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:23 smithi007 ceph-mon[27906]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:23 smithi186 ceph-mon[31814]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:24.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:23 smithi137 ceph-mon[31694]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:24.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 -- 172.21.15.7:0/1695653567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0113980 msgr2=0x7fd7f0115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:24.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 --2- 172.21.15.7:0/1695653567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0113980 0x7fd7f0115d70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800b0a0 tx=0x7fd7e800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 -- 172.21.15.7:0/1695653567 shutdown_connections 2024-04-23T14:47:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 --2- 172.21.15.7:0/1695653567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0113980 0x7fd7f0115d70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 --2- 172.21.15.7:0/1695653567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0077020 0x7fd7f0077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 --2- 172.21.15.7:0/1695653567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077940 0x7fd7f0113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 -- 172.21.15.7:0/1695653567 >> 172.21.15.7:0/1695653567 conn(0x7fd7f01007d0 msgr2=0x7fd7f0102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 -- 172.21.15.7:0/1695653567 shutdown_connections 2024-04-23T14:47:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.698+0000 7fd7f5000700 1 -- 172.21.15.7:0/1695653567 wait complete. 2024-04-23T14:47:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.699+0000 7fd7f5000700 1 Processor -- start 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 -- start start 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077020 0x7fd7f01a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 0x7fd7f01a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0113980 0x7fd7f019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0119300 con 0x7fd7f0077940 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0119180 con 0x7fd7f0077020 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7f5000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0119480 con 0x7fd7f0113980 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7ed400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 0x7fd7f01a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7ed400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 0x7fd7f01a5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52564/0 (socket says 172.21.15.7:52564) 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.700+0000 7fd7ed400700 1 -- 172.21.15.7:0/2771457417 learned_addr learned my addr 172.21.15.7:0/2771457417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ee800700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0113980 0x7fd7f019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ede00700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077020 0x7fd7f01a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ed400700 1 -- 172.21.15.7:0/2771457417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0113980 msgr2=0x7fd7f019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ed400700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0113980 0x7fd7f019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ed400700 1 -- 172.21.15.7:0/2771457417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077020 msgr2=0x7fd7f01a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ed400700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077020 0x7fd7f01a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ed400700 1 -- 172.21.15.7:0/2771457417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f019ffc0 con 0x7fd7f0077940 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ede00700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077020 0x7fd7f01a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ee800700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0113980 0x7fd7f019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:47:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.701+0000 7fd7ed400700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 0x7fd7f01a5b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00e9a0 tx=0x7fd7dc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.702+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00cbd0 con 0x7fd7f0077940 2024-04-23T14:47:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.702+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f01a02b0 con 0x7fd7f0077940 2024-04-23T14:47:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.702+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7dc00cd70 con 0x7fd7f0077940 2024-04-23T14:47:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.702+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc018750 con 0x7fd7f0077940 2024-04-23T14:47:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.702+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f01ac590 con 0x7fd7f0077940 2024-04-23T14:47:24.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.703+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f0078760 con 0x7fd7f0077940 2024-04-23T14:47:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.705+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fd7dc010430 con 0x7fd7f0077940 2024-04-23T14:47:24.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.707+0000 7fd7e6a00700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7d40a3c40 0x7fd7d40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:24.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.707+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd7dc0d0270 con 0x7fd7f0077940 2024-04-23T14:47:24.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.707+0000 7fd7ede00700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7d40a3c40 0x7fd7d40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:24.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.708+0000 7fd7ede00700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7d40a3c40 0x7fd7d40a6100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005950 tx=0x7fd7e00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:24.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.711+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd7dc09d050 con 0x7fd7f0077940 2024-04-23T14:47:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.941+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7f01a0c10 con 0x7fd7f0077940 2024-04-23T14:47:24.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.942+0000 7fd7e6a00700 1 -- 172.21.15.7:0/2771457417 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fd7dc09c950 con 0x7fd7f0077940 2024-04-23T14:47:24.944 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:47:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7d40a3c40 msgr2=0x7fd7d40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7d40a3c40 0x7fd7d40a6100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005950 tx=0x7fd7e00058e0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 msgr2=0x7fd7f01a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 0x7fd7f01a5b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00e9a0 tx=0x7fd7dc00ed60 comp rx=0 tx=0).stop 2024-04-23T14:47:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 shutdown_connections 2024-04-23T14:47:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7d40a3c40 0x7fd7d40a6100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7f0113980 0x7fd7f019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7f0077020 0x7fd7f01a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 --2- 172.21.15.7:0/2771457417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7f0077940 0x7fd7f01a5b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.946+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 >> 172.21.15.7:0/2771457417 conn(0x7fd7f01007d0 msgr2=0x7fd7f01145f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.947+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 shutdown_connections 2024-04-23T14:47:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:24.947+0000 7fd7f5000700 1 -- 172.21.15.7:0/2771457417 wait complete. 2024-04-23T14:47:25.804 INFO:tasks.cephadm:Adding mds.a on smithi007 2024-04-23T14:47:25.804 INFO:tasks.cephadm:Adding mds.d on smithi007 2024-04-23T14:47:25.804 INFO:tasks.cephadm:Adding mds.g on smithi007 2024-04-23T14:47:25.804 INFO:tasks.cephadm:Adding mds.j on smithi007 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.b on smithi137 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.e on smithi137 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.h on smithi137 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.k on smithi137 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.c on smithi186 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.f on smithi186 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.i on smithi186 2024-04-23T14:47:25.805 INFO:tasks.cephadm:Adding mds.l on smithi186 2024-04-23T14:47:25.805 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l' 2024-04-23T14:47:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:25 smithi007 ceph-mon[27906]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:25 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2771457417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:47:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:25 smithi186 ceph-mon[31814]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:25 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2771457417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:47:26.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:25 smithi137 ceph-mon[31694]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:26.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:25 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2771457417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:47:26.253 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T14:47:27.845 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:27 smithi186 ceph-mon[31814]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:28.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:27 smithi007 ceph-mon[27906]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:27 smithi137 ceph-mon[31694]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:28.364 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 -- 172.21.15.186:0/922473255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 msgr2=0x7f8ca01115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:28.364 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/922473255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01115e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800b0a0 tx=0x7f8c9800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 -- 172.21.15.186:0/922473255 shutdown_connections 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/922473255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01115e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/922473255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca0109190 0x7f8ca01095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/922473255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 0x7f8ca010a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.363+0000 7f8ca4e00700 1 -- 172.21.15.186:0/922473255 >> 172.21.15.186:0/922473255 conn(0x7f8ca0078160 msgr2=0x7f8ca007a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.364+0000 7f8ca4e00700 1 -- 172.21.15.186:0/922473255 shutdown_connections 2024-04-23T14:47:28.365 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.364+0000 7f8ca4e00700 1 -- 172.21.15.186:0/922473255 wait complete. 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.365+0000 7f8ca4e00700 1 Processor -- start 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.365+0000 7f8ca4e00700 1 -- start start 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8ca4e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca0109190 0x7f8ca019f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8ca4e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 0x7f8ca019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8ca4e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8ca4e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0114c00 con 0x7f8ca010a390 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8ca4e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0114a80 con 0x7f8ca0109190 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8ca4e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca0114d80 con 0x7f8ca010ad30 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:28.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:36394/0 (socket says 172.21.15.186:36394) 2024-04-23T14:47:28.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 -- 172.21.15.186:0/3803921097 learned_addr learned my addr 172.21.15.186:0/3803921097 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9de00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca0109190 0x7f8ca019f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c97e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 0x7f8ca019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 -- 172.21.15.186:0/3803921097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca0109190 msgr2=0x7f8ca019f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca0109190 0x7f8ca019f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 -- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 msgr2=0x7f8ca019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 0x7f8ca019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c9e800700 1 -- 172.21.15.186:0/3803921097 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca01a6d80 con 0x7f8ca010ad30 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.366+0000 7f8c97e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 0x7f8ca019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.367+0000 7f8c9e800700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01a66e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c98004e40 tx=0x7f8c98004f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.367+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98021070 con 0x7f8ca010ad30 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.367+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c98004020 con 0x7f8ca010ad30 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.367+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca01a7010 con 0x7f8ca010ad30 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.367+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9801d6b0 con 0x7f8ca010ad30 2024-04-23T14:47:28.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.367+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca01a74c0 con 0x7f8ca010ad30 2024-04-23T14:47:28.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.368+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca00697e0 con 0x7f8ca010ad30 2024-04-23T14:47:28.370 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.370+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f8c980044d0 con 0x7f8ca010ad30 2024-04-23T14:47:28.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.372+0000 7f8c96a00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8c840a3c40 0x7f8c840a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:28.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.372+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8c9800f020 con 0x7f8ca010ad30 2024-04-23T14:47:28.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.372+0000 7f8c9de00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8c840a3c40 0x7f8c840a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:28.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.373+0000 7f8c9de00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8c840a3c40 0x7f8c840a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c90005950 tx=0x7f8c900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:28.376 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.375+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8c9802a020 con 0x7f8ca010ad30 2024-04-23T14:47:28.611 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.611+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}) -- 0x7f8ca00630f0 con 0x7f8c840a3c40 2024-04-23T14:47:28.629 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.629+0000 7f8c96a00700 1 -- 172.21.15.186:0/3803921097 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8ca00630f0 con 0x7f8c840a3c40 2024-04-23T14:47:28.629 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mds.all update... 2024-04-23T14:47:28.632 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8c840a3c40 msgr2=0x7f8c840a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:28.632 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8c840a3c40 0x7f8c840a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c90005950 tx=0x7f8c900058e0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.632 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 msgr2=0x7f8ca01a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:28.632 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01a66e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c98004e40 tx=0x7f8c98004f20 comp rx=0 tx=0).stop 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 shutdown_connections 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8c840a3c40 0x7f8c840a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ca010ad30 0x7f8ca01a66e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ca0109190 0x7f8ca019f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 --2- 172.21.15.186:0/3803921097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ca010a390 0x7f8ca019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 >> 172.21.15.186:0/3803921097 conn(0x7f8ca0078160 msgr2=0x7f8ca010d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 shutdown_connections 2024-04-23T14:47:28.633 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-23T14:47:28.632+0000 7f8ca4e00700 1 -- 172.21.15.186:0/3803921097 wait complete. 2024-04-23T14:47:29.496 DEBUG:teuthology.orchestra.run.smithi007:mds.a> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.a.service 2024-04-23T14:47:29.504 DEBUG:teuthology.orchestra.run.smithi007:mds.d> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.d.service 2024-04-23T14:47:29.549 DEBUG:teuthology.orchestra.run.smithi007:mds.g> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.g.service 2024-04-23T14:47:29.594 DEBUG:teuthology.orchestra.run.smithi007:mds.j> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.j.service 2024-04-23T14:47:29.639 DEBUG:teuthology.orchestra.run.smithi137:mds.b> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.b.service 2024-04-23T14:47:29.647 DEBUG:teuthology.orchestra.run.smithi137:mds.e> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.e.service 2024-04-23T14:47:29.694 DEBUG:teuthology.orchestra.run.smithi137:mds.h> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.h.service 2024-04-23T14:47:29.741 DEBUG:teuthology.orchestra.run.smithi137:mds.k> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.k.service 2024-04-23T14:47:29.787 DEBUG:teuthology.orchestra.run.smithi186:mds.c> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.c.service 2024-04-23T14:47:29.794 DEBUG:teuthology.orchestra.run.smithi186:mds.f> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.f.service 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:29.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:29.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:29.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:29.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:29.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:29 smithi007 ceph-mon[27906]: Deploying daemon mds.l on smithi186 2024-04-23T14:47:29.839 DEBUG:teuthology.orchestra.run.smithi186:mds.i> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.i.service 2024-04-23T14:47:29.885 DEBUG:teuthology.orchestra.run.smithi186:mds.l> sudo journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.l.service 2024-04-23T14:47:29.891 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:29.891 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:29.891 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:29.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:29 smithi186 ceph-mon[31814]: Deploying daemon mds.l on smithi186 2024-04-23T14:47:29.895 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-23T14:47:29.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:47:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-04-23T14:47:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:29.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:29.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:29.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:29.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:29.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:29.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:29 smithi137 ceph-mon[31694]: Deploying daemon mds.l on smithi186 2024-04-23T14:47:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.126+0000 7f3e8ee00640 1 -- 172.21.15.7:0/600796737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88107b60 msgr2=0x7f3e88109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.126+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/600796737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88107b60 0x7f3e88109fb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009900 tx=0x7f3e8002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 -- 172.21.15.7:0/600796737 shutdown_connections 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/600796737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 0x7f3e88107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/600796737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88107b60 0x7f3e88109fb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/600796737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e88102900 0x7f3e88104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 -- 172.21.15.7:0/600796737 >> 172.21.15.7:0/600796737 conn(0x7f3e880fc2d0 msgr2=0x7f3e880fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 -- 172.21.15.7:0/600796737 shutdown_connections 2024-04-23T14:47:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.127+0000 7f3e8ee00640 1 -- 172.21.15.7:0/600796737 wait complete. 2024-04-23T14:47:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 Processor -- start 2024-04-23T14:47:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 -- start start 2024-04-23T14:47:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 0x7f3e88198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 0x7f3e88198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e88107b60 0x7f3e8819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8810d9d0 con 0x7f3e88102900 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8810d850 con 0x7f3e88105230 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8ee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8810db50 con 0x7f3e88107b60 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 0x7f3e88198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 0x7f3e88198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52588/0 (socket says 172.21.15.7:52588) 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.128+0000 7f3e8da00640 1 -- 172.21.15.7:0/3223325089 learned_addr learned my addr 172.21.15.7:0/3223325089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8e400640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e88107b60 0x7f3e8819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8d000640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 0x7f3e88198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8da00640 1 -- 172.21.15.7:0/3223325089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e88107b60 msgr2=0x7f3e8819f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8da00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e88107b60 0x7f3e8819f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8da00640 1 -- 172.21.15.7:0/3223325089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 msgr2=0x7f3e88198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8da00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 0x7f3e88198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8da00640 1 -- 172.21.15.7:0/3223325089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8819fc70 con 0x7f3e88102900 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8d000640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 0x7f3e88198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e8da00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 0x7f3e88198050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00ea80 tx=0x7f3e7c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.129+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00ce40 con 0x7f3e88102900 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.130+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e7c005020 con 0x7f3e88102900 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.130+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8819ff60 con 0x7f3e88102900 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.130+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0116d0 con 0x7f3e88102900 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.130+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e881a03c0 con 0x7f3e88102900 2024-04-23T14:47:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.131+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e880fddc0 con 0x7f3e88102900 2024-04-23T14:47:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.133+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f3e7c0051d0 con 0x7f3e88102900 2024-04-23T14:47:30.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.134+0000 7f3e86000640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e700a3bb0 0x7f3e700a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.134+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3e7c0d0390 con 0x7f3e88102900 2024-04-23T14:47:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.135+0000 7f3e8d000640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e700a3bb0 0x7f3e700a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.135+0000 7f3e8d000640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e700a3bb0 0x7f3e700a6070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3e740058c0 tx=0x7f3e74005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:30.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.149+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3e7c016030 con 0x7f3e88102900 2024-04-23T14:47:30.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.357+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e88062d00 con 0x7f3e88102900 2024-04-23T14:47:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.360+0000 7f3e86000640 1 -- 172.21.15.7:0/3223325089 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18386 (secure 0 0 0) 0x7f3e7c09d170 con 0x7f3e88102900 2024-04-23T14:47:30.361 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:30.362 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:47:15.452468+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e700a3bb0 msgr2=0x7f3e700a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e700a3bb0 0x7f3e700a6070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3e740058c0 tx=0x7f3e74005850 comp rx=0 tx=0).stop 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 msgr2=0x7f3e88198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 0x7f3e88198050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00ea80 tx=0x7f3e7c00ef40 comp rx=0 tx=0).stop 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 shutdown_connections 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3e700a3bb0 0x7f3e700a6070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e88105230 0x7f3e88198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e88107b60 0x7f3e8819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 --2- 172.21.15.7:0/3223325089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e88102900 0x7f3e88198050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.363+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 >> 172.21.15.7:0/3223325089 conn(0x7f3e880fc2d0 msgr2=0x7f3e881031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:30.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.364+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 shutdown_connections 2024-04-23T14:47:30.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.364+0000 7f3e8ee00640 1 -- 172.21.15.7:0/3223325089 wait complete. 2024-04-23T14:47:30.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T14:47:30.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 -- 172.21.15.7:0/2227023518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4104140 msgr2=0x7f50d4104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 --2- 172.21.15.7:0/2227023518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4104140 0x7f50d4104560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009900 tx=0x7f50c402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 -- 172.21.15.7:0/2227023518 shutdown_connections 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 --2- 172.21.15.7:0/2227023518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4105cf0 0x7f50d410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 --2- 172.21.15.7:0/2227023518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50d4105330 0x7f50d41057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 --2- 172.21.15.7:0/2227023518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4104140 0x7f50d4104560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 -- 172.21.15.7:0/2227023518 >> 172.21.15.7:0/2227023518 conn(0x7f50d40ff6b0 msgr2=0x7f50d4101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 -- 172.21.15.7:0/2227023518 shutdown_connections 2024-04-23T14:47:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.610+0000 7f50d3200640 1 -- 172.21.15.7:0/2227023518 wait complete. 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 Processor -- start 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 -- start start 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4104140 0x7f50d419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50d4105330 0x7f50d419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 0x7f50d41a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f50d410fcc0 con 0x7f50d4105cf0 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50d410fb40 con 0x7f50d4104140 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.611+0000 7f50d3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f50d410fe40 con 0x7f50d4105330 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 0x7f50d41a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 0x7f50d41a19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52602/0 (socket says 172.21.15.7:52602) 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 -- 172.21.15.7:0/592344437 learned_addr learned my addr 172.21.15.7:0/592344437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d1400640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50d4105330 0x7f50d419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d1e00640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4104140 0x7f50d419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 -- 172.21.15.7:0/592344437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50d4105330 msgr2=0x7f50d419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50d4105330 0x7f50d419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 -- 172.21.15.7:0/592344437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4104140 msgr2=0x7f50d419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4104140 0x7f50d419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d2800640 1 -- 172.21.15.7:0/592344437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d41a2010 con 0x7f50d4105cf0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.612+0000 7f50d1e00640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4104140 0x7f50d419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.613+0000 7f50d2800640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 0x7f50d41a19a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b970 tx=0x7f50cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.613+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc019070 con 0x7f50d4105cf0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.613+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d41a2300 con 0x7f50d4105cf0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.613+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50cc014440 con 0x7f50d4105cf0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.613+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0075d0 con 0x7f50d4105cf0 2024-04-23T14:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.613+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d41a2800 con 0x7f50d4105cf0 2024-04-23T14:47:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.614+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d410b4e0 con 0x7f50d4105cf0 2024-04-23T14:47:30.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.616+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f50cc01c070 con 0x7f50d4105cf0 2024-04-23T14:47:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.617+0000 7f50caa00640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f50b80a3bb0 0x7f50b80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.618+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f50cc0cf660 con 0x7f50d4105cf0 2024-04-23T14:47:30.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.618+0000 7f50d1e00640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f50b80a3bb0 0x7f50b80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:30.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.618+0000 7f50d1e00640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f50b80a3bb0 0x7f50b80a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006010 tx=0x7f50c4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:30.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.622+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f50cc09c440 con 0x7f50d4105cf0 2024-04-23T14:47:30.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:30 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3223325089' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:47:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.830+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f50d4062c00 con 0x7f50d4105cf0 2024-04-23T14:47:30.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.831+0000 7f50caa00640 1 -- 172.21.15.7:0/592344437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f50cc09bd40 con 0x7f50d4105cf0 2024-04-23T14:47:30.832 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:47:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f50b80a3bb0 msgr2=0x7f50b80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f50b80a3bb0 0x7f50b80a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006010 tx=0x7f50c4000bc0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 msgr2=0x7f50d41a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 0x7f50d41a19a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b970 tx=0x7f50cc00be30 comp rx=0 tx=0).stop 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 shutdown_connections 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f50b80a3bb0 0x7f50b80a6070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4105cf0 0x7f50d41a19a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50d4105330 0x7f50d419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 --2- 172.21.15.7:0/592344437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50d4104140 0x7f50d419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 >> 172.21.15.7:0/592344437 conn(0x7f50d40ff6b0 msgr2=0x7f50d41086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 shutdown_connections 2024-04-23T14:47:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:30.834+0000 7f50d3200640 1 -- 172.21.15.7:0/592344437 wait complete. 2024-04-23T14:47:30.855 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:30 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3223325089' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:47:30.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3223325089' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:47:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 -- 172.21.15.7:0/2169691321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 msgr2=0x7f0968074e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 --2- 172.21.15.7:0/2169691321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f0968074e60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0954009900 tx=0x7f095402a480 comp rx=0 tx=0).stop 2024-04-23T14:47:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 -- 172.21.15.7:0/2169691321 shutdown_connections 2024-04-23T14:47:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 --2- 172.21.15.7:0/2169691321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 0x7f096810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 --2- 172.21.15.7:0/2169691321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f0968074e60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 --2- 172.21.15.7:0/2169691321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 0x7f0968074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 -- 172.21.15.7:0/2169691321 >> 172.21.15.7:0/2169691321 conn(0x7f09680fd410 msgr2=0x7f09680ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:31.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 -- 172.21.15.7:0/2169691321 shutdown_connections 2024-04-23T14:47:31.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.051+0000 7f0967200640 1 -- 172.21.15.7:0/2169691321 wait complete. 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 Processor -- start 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 -- start start 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f096819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 0x7f096819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 0x7f09681a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f096810fc30 con 0x7f0968074a00 2024-04-23T14:47:31.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f096810fab0 con 0x7f0968075fe0 2024-04-23T14:47:31.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0967200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f096810fdb0 con 0x7f0968109d30 2024-04-23T14:47:31.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.053+0000 7f0965e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f096819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:31.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f096819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52622/0 (socket says 172.21.15.7:52622) 2024-04-23T14:47:31.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 -- 172.21.15.7:0/3862587974 learned_addr learned my addr 172.21.15.7:0/3862587974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:31.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965400640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 0x7f096819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0966800640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 0x7f09681a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 -- 172.21.15.7:0/3862587974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 msgr2=0x7f09681a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 0x7f09681a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 -- 172.21.15.7:0/3862587974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 msgr2=0x7f096819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 0x7f096819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965e00640 1 -- 172.21.15.7:0/3862587974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09681a1f00 con 0x7f0968074a00 2024-04-23T14:47:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0965400640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 0x7f096819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.054+0000 7f0966800640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 0x7f09681a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.055+0000 7f0965e00640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f096819a2e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f095800eab0 tx=0x7f095800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.055+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095800ce40 con 0x7f0968074a00 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.055+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0958011920 con 0x7f0968074a00 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.055+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958010a00 con 0x7f0968074a00 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.055+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09681a21f0 con 0x7f0968074a00 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.055+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09681a2760 con 0x7f0968074a00 2024-04-23T14:47:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.056+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0968108af0 con 0x7f0968074a00 2024-04-23T14:47:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.059+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f0958011ad0 con 0x7f0968074a00 2024-04-23T14:47:31.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.060+0000 7f095ea00640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f094c0a3c30 0x7f094c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:31.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.060+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f09580d0630 con 0x7f0968074a00 2024-04-23T14:47:31.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.060+0000 7f0965400640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f094c0a3c30 0x7f094c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:31.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.061+0000 7f0965400640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f094c0a3c30 0x7f094c0a60f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0954000c00 tx=0x7f09540314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:31.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.062+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0958016030 con 0x7f0968074a00 2024-04-23T14:47:31.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.307+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f096802d620 con 0x7f0968074a00 2024-04-23T14:47:31.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.308+0000 7f095ea00640 1 -- 172.21.15.7:0/3862587974 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f095809d490 con 0x7f0968074a00 2024-04-23T14:47:31.309 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:31.309 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-23T14:47:31.309 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 1 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f094c0a3c30 msgr2=0x7f094c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f094c0a3c30 0x7f094c0a60f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0954000c00 tx=0x7f09540314a0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 msgr2=0x7f096819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f096819a2e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f095800eab0 tx=0x7f095800ef70 comp rx=0 tx=0).stop 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 shutdown_connections 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f094c0a3c30 0x7f094c0a60f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0968075fe0 0x7f096819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0968109d30 0x7f09681a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 --2- 172.21.15.7:0/3862587974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0968074a00 0x7f096819a2e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 >> 172.21.15.7:0/3862587974 conn(0x7f09680fd410 msgr2=0x7f0968105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 shutdown_connections 2024-04-23T14:47:31.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:31.311+0000 7f0967200640 1 -- 172.21.15.7:0/3862587974 wait complete. 2024-04-23T14:47:31.902 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:31 smithi186 ceph-mon[31814]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:31.902 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:31 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/592344437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:47:31.902 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:31 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3862587974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:31 smithi137 ceph-mon[31694]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:31 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/592344437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:47:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:31 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3862587974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:31 smithi007 ceph-mon[27906]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:32.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:31 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/592344437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:47:32.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:31 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3862587974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:32.190 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 podman[62216]: 2024-04-23 14:47:32.024877299 +0000 UTC m=+0.182701635 container create e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T14:47:32.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 podman[62216]: 2024-04-23 14:47:32.295094557 +0000 UTC m=+0.452918900 container init e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-23T14:47:32.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 podman[62216]: 2024-04-23 14:47:32.304550683 +0000 UTC m=+0.462374988 container start e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l, ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-23T14:47:32.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 ceph-mds[62242]: -- 172.21.15.186:0/2918921569 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c72acba40 con 0x562c72a9f000 2024-04-23T14:47:32.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l[62236]: starting mds.l at 2024-04-23T14:47:32.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 bash[62216]: e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 2024-04-23T14:47:32.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 14:47:32 smithi186 systemd[1]: Started Ceph mds.l for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:33.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 -- 172.21.15.7:0/3471242011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105470 msgr2=0x7fc4e41058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 --2- 172.21.15.7:0/3471242011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105470 0x7fc4e41058f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009900 tx=0x7fc4d002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 -- 172.21.15.7:0/3471242011 shutdown_connections 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 --2- 172.21.15.7:0/3471242011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105e30 0x7fc4e410c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 --2- 172.21.15.7:0/3471242011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105470 0x7fc4e41058f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 --2- 172.21.15.7:0/3471242011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e4104280 0x7fc4e41046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 -- 172.21.15.7:0/3471242011 >> 172.21.15.7:0/3471242011 conn(0x7fc4e40ff7f0 msgr2=0x7fc4e4101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 -- 172.21.15.7:0/3471242011 shutdown_connections 2024-04-23T14:47:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.556+0000 7fc4ec200640 1 -- 172.21.15.7:0/3471242011 wait complete. 2024-04-23T14:47:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.557+0000 7fc4ec200640 1 Processor -- start 2024-04-23T14:47:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 -- start start 2024-04-23T14:47:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e4104280 0x7fc4e419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 0x7fc4e419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105e30 0x7fc4e41a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e410fdc0 con 0x7fc4e4105e30 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e410fc40 con 0x7fc4e4104280 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.558+0000 7fc4ec200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e410ff40 con 0x7fc4e4105470 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4ea200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105e30 0x7fc4e41a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 0x7fc4e419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 0x7fc4e419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:36932/0 (socket says 172.21.15.7:36932) 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 -- 172.21.15.7:0/1872120642 learned_addr learned my addr 172.21.15.7:0/1872120642 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e9800640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e4104280 0x7fc4e419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 -- 172.21.15.7:0/1872120642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e4104280 msgr2=0x7fc4e419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e4104280 0x7fc4e419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 -- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105e30 msgr2=0x7fc4e41a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105e30 0x7fc4e41a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.559+0000 7fc4e8e00640 1 -- 172.21.15.7:0/1872120642 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e41a1f80 con 0x7fc4e4105470 2024-04-23T14:47:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.560+0000 7fc4e8e00640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 0x7fc4e419a8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005940 tx=0x7fc4d0004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.560+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d003f030 con 0x7fc4e4105470 2024-04-23T14:47:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.560+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e41a2210 con 0x7fc4e4105470 2024-04-23T14:47:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.560+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4d0003cb0 con 0x7fc4e4105470 2024-04-23T14:47:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.560+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0035070 con 0x7fc4e4105470 2024-04-23T14:47:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.560+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41a2750 con 0x7fc4e4105470 2024-04-23T14:47:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.561+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e410b5a0 con 0x7fc4e4105470 2024-04-23T14:47:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.564+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fc4d0042030 con 0x7fc4e4105470 2024-04-23T14:47:33.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.565+0000 7fc4e2000640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc4cc0a3bb0 0x7fc4cc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:33.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.566+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc4d00f0cc0 con 0x7fc4e4105470 2024-04-23T14:47:33.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.566+0000 7fc4e9800640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc4cc0a3bb0 0x7fc4cc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:33.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.566+0000 7fc4e9800640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc4cc0a3bb0 0x7fc4cc0a6070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80058c0 tx=0x7fc4d8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.577+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc4d00bdaa0 con 0x7fc4e4105470 2024-04-23T14:47:33.663 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:33.663 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6832/156003904,v1:172.21.15.186:6833/156003904] up:boot 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: fsmap 1 up:standby 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:33.664 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:33 smithi137 ceph-mon[31694]: Deploying daemon mds.k on smithi137 2024-04-23T14:47:33.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.824+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e402d620 con 0x7fc4e4105470 2024-04-23T14:47:33.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.825+0000 7fc4e2000640 1 -- 172.21.15.7:0/1872120642 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7fc4d00bd3a0 con 0x7fc4e4105470 2024-04-23T14:47:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:33.826 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T14:47:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc4cc0a3bb0 msgr2=0x7fc4cc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc4cc0a3bb0 0x7fc4cc0a6070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80058c0 tx=0x7fc4d8005850 comp rx=0 tx=0).stop 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 msgr2=0x7fc4e419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 0x7fc4e419a8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005940 tx=0x7fc4d0004430 comp rx=0 tx=0).stop 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 shutdown_connections 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc4cc0a3bb0 0x7fc4cc0a6070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4e4105e30 0x7fc4e41a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4e4105470 0x7fc4e419a8a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 --2- 172.21.15.7:0/1872120642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e4104280 0x7fc4e419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.828+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 >> 172.21.15.7:0/1872120642 conn(0x7fc4e40ff7f0 msgr2=0x7fc4e4108770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.829+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 shutdown_connections 2024-04-23T14:47:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:33.829+0000 7fc4ec200640 1 -- 172.21.15.7:0/1872120642 wait complete. 2024-04-23T14:47:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6832/156003904,v1:172.21.15.186:6833/156003904] up:boot 2024-04-23T14:47:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: fsmap 1 up:standby 2024-04-23T14:47:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:33.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:33 smithi007 ceph-mon[27906]: Deploying daemon mds.k on smithi137 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6832/156003904,v1:172.21.15.186:6833/156003904] up:boot 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: fsmap 1 up:standby 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:33.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:33 smithi186 ceph-mon[31814]: Deploying daemon mds.k on smithi137 2024-04-23T14:47:34.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:34 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1872120642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:34 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1872120642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:34 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1872120642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:35.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.075+0000 7ff84d800640 1 -- 172.21.15.7:0/1643320002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105450 msgr2=0x7ff8481058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 --2- 172.21.15.7:0/1643320002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105450 0x7ff8481058d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff834009900 tx=0x7ff83402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 -- 172.21.15.7:0/1643320002 shutdown_connections 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 --2- 172.21.15.7:0/1643320002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff848105e10 0x7ff84810c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 --2- 172.21.15.7:0/1643320002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105450 0x7ff8481058d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 --2- 172.21.15.7:0/1643320002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff848104260 0x7ff848104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 -- 172.21.15.7:0/1643320002 >> 172.21.15.7:0/1643320002 conn(0x7ff8480ff7f0 msgr2=0x7ff848101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 -- 172.21.15.7:0/1643320002 shutdown_connections 2024-04-23T14:47:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.076+0000 7ff84d800640 1 -- 172.21.15.7:0/1643320002 wait complete. 2024-04-23T14:47:36.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 Processor -- start 2024-04-23T14:47:36.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 -- start start 2024-04-23T14:47:36.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff848104260 0x7ff84819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff848105450 0x7ff84819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 0x7ff8481a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810fdf0 con 0x7ff848105e10 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810fc70 con 0x7ff848104260 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.077+0000 7ff84d800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810ff70 con 0x7ff848105450 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 0x7ff8481a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 0x7ff8481a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59096/0 (socket says 172.21.15.7:59096) 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 -- 172.21.15.7:0/3919474037 learned_addr learned my addr 172.21.15.7:0/3919474037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff846a00640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff848104260 0x7ff84819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff846000640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff848105450 0x7ff84819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 -- 172.21.15.7:0/3919474037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff848105450 msgr2=0x7ff84819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff848105450 0x7ff84819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 -- 172.21.15.7:0/3919474037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff848104260 msgr2=0x7ff84819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff848104260 0x7ff84819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 -- 172.21.15.7:0/3919474037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8481a2090 con 0x7ff848105e10 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.078+0000 7ff847400640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 0x7ff8481a1a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff84000eaa0 tx=0x7ff84000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.079+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84000cdb0 con 0x7ff848105e10 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.079+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8481a2380 con 0x7ff848105e10 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.079+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff840005020 con 0x7ff848105e10 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.079+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8481a28f0 con 0x7ff848105e10 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.079+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84001f060 con 0x7ff848105e10 2024-04-23T14:47:36.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.080+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84810b600 con 0x7ff848105e10 2024-04-23T14:47:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.082+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7ff8400051d0 con 0x7ff848105e10 2024-04-23T14:47:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.083+0000 7ff83f400640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff82c0a3bb0 0x7ff82c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.084+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff8400d0160 con 0x7ff848105e10 2024-04-23T14:47:36.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.084+0000 7ff846a00640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff82c0a3bb0 0x7ff82c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:36.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.085+0000 7ff846a00640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff82c0a3bb0 0x7ff82c0a6070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8380095f0 tx=0x7ff838005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.088+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff840016030 con 0x7ff848105e10 2024-04-23T14:47:36.103 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:35 smithi137 ceph-mon[31694]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:36.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:35 smithi007 ceph-mon[27906]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:36.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.342+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff84802d620 con 0x7ff848105e10 2024-04-23T14:47:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.342+0000 7ff83f400640 1 -- 172.21.15.7:0/3919474037 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7ff84009cf40 con 0x7ff848105e10 2024-04-23T14:47:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:36.343 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T14:47:36.343 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff82c0a3bb0 msgr2=0x7ff82c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff82c0a3bb0 0x7ff82c0a6070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8380095f0 tx=0x7ff838005f90 comp rx=0 tx=0).stop 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 msgr2=0x7ff8481a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 0x7ff8481a1a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff84000eaa0 tx=0x7ff84000ef60 comp rx=0 tx=0).stop 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 shutdown_connections 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff82c0a3bb0 0x7ff82c0a6070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff848105e10 0x7ff8481a1a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff848105450 0x7ff84819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 --2- 172.21.15.7:0/3919474037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff848104260 0x7ff84819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:36.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.345+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 >> 172.21.15.7:0/3919474037 conn(0x7ff8480ff7f0 msgr2=0x7ff8481087d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.346+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 shutdown_connections 2024-04-23T14:47:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:36.346+0000 7ff84d800640 1 -- 172.21.15.7:0/3919474037 wait complete. 2024-04-23T14:47:36.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:35 smithi186 ceph-mon[31814]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:36.668 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 14:47:36 smithi137 systemd[1]: Started Ceph mds.k for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3919474037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:36.995 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:36 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3919474037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:36 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3919474037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:37.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:36 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:38.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:38 smithi007 ceph-mon[27906]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:38.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:38 smithi007 ceph-mon[27906]: Deploying daemon mds.j on smithi007 2024-04-23T14:47:38.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:38 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] up:boot 2024-04-23T14:47:38.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:38 smithi007 ceph-mon[27906]: fsmap 2 up:standby 2024-04-23T14:47:38.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:38 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T14:47:38.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:38 smithi186 ceph-mon[31814]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:38.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:38 smithi186 ceph-mon[31814]: Deploying daemon mds.j on smithi007 2024-04-23T14:47:38.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:38 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] up:boot 2024-04-23T14:47:38.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:38 smithi186 ceph-mon[31814]: fsmap 2 up:standby 2024-04-23T14:47:38.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:38 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T14:47:38.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:38.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:38 smithi137 ceph-mon[31694]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:38.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:38 smithi137 ceph-mon[31694]: Deploying daemon mds.j on smithi007 2024-04-23T14:47:38.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:38 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] up:boot 2024-04-23T14:47:38.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:38 smithi137 ceph-mon[31694]: fsmap 2 up:standby 2024-04-23T14:47:38.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:38 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T14:47:38.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 -- 172.21.15.7:0/817998704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0074a60 msgr2=0x7f3db0074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:38.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 --2- 172.21.15.7:0/817998704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0074a60 0x7f3db0074ee0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009900 tx=0x7f3d9802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 -- 172.21.15.7:0/817998704 shutdown_connections 2024-04-23T14:47:38.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 --2- 172.21.15.7:0/817998704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3db0109f10 0x7f3db010c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 --2- 172.21.15.7:0/817998704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0074a60 0x7f3db0074ee0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 --2- 172.21.15.7:0/817998704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3db0076040 0x7f3db0074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 -- 172.21.15.7:0/817998704 >> 172.21.15.7:0/817998704 conn(0x7f3db00fd5e0 msgr2=0x7f3db00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.580+0000 7f3db7a00640 1 -- 172.21.15.7:0/817998704 shutdown_connections 2024-04-23T14:47:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.581+0000 7f3db7a00640 1 -- 172.21.15.7:0/817998704 wait complete. 2024-04-23T14:47:38.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.581+0000 7f3db7a00640 1 Processor -- start 2024-04-23T14:47:38.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 -- start start 2024-04-23T14:47:38.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3db0074a60 0x7f3db019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:38.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3db0076040 0x7f3db019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:38.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 0x7f3db01a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:38.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010fe30 con 0x7f3db0109f10 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010fcb0 con 0x7f3db0074a60 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db7a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010ffb0 con 0x7f3db0076040 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 0x7f3db01a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 0x7f3db01a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59102/0 (socket says 172.21.15.7:59102) 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db5a00640 1 -- 172.21.15.7:0/2103204837 learned_addr learned my addr 172.21.15.7:0/2103204837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.582+0000 7f3db5000640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3db0074a60 0x7f3db019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3dafe00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3db0076040 0x7f3db019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db5a00640 1 -- 172.21.15.7:0/2103204837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3db0076040 msgr2=0x7f3db019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db5a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3db0076040 0x7f3db019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db5a00640 1 -- 172.21.15.7:0/2103204837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3db0074a60 msgr2=0x7f3db019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db5a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3db0074a60 0x7f3db019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db5a00640 1 -- 172.21.15.7:0/2103204837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db01a2150 con 0x7f3db0109f10 2024-04-23T14:47:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db5a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 0x7f3db01a1ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009fd0 tx=0x7f3da800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8011830 con 0x7f3db0109f10 2024-04-23T14:47:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3da8016070 con 0x7f3db0109f10 2024-04-23T14:47:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8010de0 con 0x7f3db0109f10 2024-04-23T14:47:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.583+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db01a2440 con 0x7f3db0109f10 2024-04-23T14:47:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.584+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01a29c0 con 0x7f3db0109f10 2024-04-23T14:47:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.585+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db0108c40 con 0x7f3db0109f10 2024-04-23T14:47:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.587+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f3da80119d0 con 0x7f3db0109f10 2024-04-23T14:47:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.588+0000 7f3dad600640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3d940a3c30 0x7f3d940a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.588+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3da80cf720 con 0x7f3db0109f10 2024-04-23T14:47:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.589+0000 7f3db5000640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3d940a3c30 0x7f3d940a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.589+0000 7f3db5000640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3d940a3c30 0x7f3d940a60f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005c40 tx=0x7f3da000a390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:38.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.593+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3da809c500 con 0x7f3db0109f10 2024-04-23T14:47:38.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.837+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3db002d620 con 0x7f3db0109f10 2024-04-23T14:47:38.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.837+0000 7f3dad600640 1 -- 172.21.15.7:0/2103204837 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f3da809be00 con 0x7f3db0109f10 2024-04-23T14:47:38.838 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:38.838 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T14:47:38.839 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3d940a3c30 msgr2=0x7f3d940a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3d940a3c30 0x7f3d940a60f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005c40 tx=0x7f3da000a390 comp rx=0 tx=0).stop 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 msgr2=0x7f3db01a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 0x7f3db01a1ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009fd0 tx=0x7f3da800b8e0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 shutdown_connections 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3d940a3c30 0x7f3d940a60f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3db0109f10 0x7f3db01a1ae0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3db0076040 0x7f3db019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 --2- 172.21.15.7:0/2103204837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3db0074a60 0x7f3db019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 >> 172.21.15.7:0/2103204837 conn(0x7f3db00fd5e0 msgr2=0x7f3db0105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 shutdown_connections 2024-04-23T14:47:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:38.840+0000 7f3db7a00640 1 -- 172.21.15.7:0/2103204837 wait complete. 2024-04-23T14:47:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:39 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2103204837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:39 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2103204837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:39 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2103204837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:40.019 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:39 smithi007 systemd[1]: Starting Ceph mds.j for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:47:40.320 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:40 smithi137 ceph-mon[31694]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:40.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:40 smithi007 ceph-mon[27906]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:40.336 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 podman[65470]: 2024-04-23 14:47:39.943525241 +0000 UTC m=+0.042070100 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:47:40.336 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 podman[65470]: 2024-04-23 14:47:40.070588126 +0000 UTC m=+0.169132993 container create fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-23T14:47:40.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:40 smithi186 ceph-mon[31814]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:40.835 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 podman[65470]: 2024-04-23 14:47:40.368464573 +0000 UTC m=+0.467009473 container init fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-23T14:47:40.836 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 podman[65470]: 2024-04-23 14:47:40.379876581 +0000 UTC m=+0.478421429 container start fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:47:40.836 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 ceph-mds[65489]: -- 172.21.15.7:0/3791373351 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e60d6ba40 con 0x557e60d3f000 2024-04-23T14:47:40.836 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j[65485]: starting mds.j at 2024-04-23T14:47:40.836 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 bash[65470]: fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa 2024-04-23T14:47:40.836 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 14:47:40 smithi007 systemd[1]: Started Ceph mds.j for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:40.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:41.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.069+0000 7f37e8a00640 1 -- 172.21.15.7:0/3516623462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 msgr2=0x7f37e4105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.069+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3516623462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e4105710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009900 tx=0x7f37d002a410 comp rx=0 tx=0).stop 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 -- 172.21.15.7:0/3516623462 shutdown_connections 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3516623462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e4105c50 0x7f37e410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3516623462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e4105710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3516623462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37e41040a0 0x7f37e41044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 -- 172.21.15.7:0/3516623462 >> 172.21.15.7:0/3516623462 conn(0x7f37e40ff610 msgr2=0x7f37e4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 -- 172.21.15.7:0/3516623462 shutdown_connections 2024-04-23T14:47:41.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.070+0000 7f37e8a00640 1 -- 172.21.15.7:0/3516623462 wait complete. 2024-04-23T14:47:41.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 Processor -- start 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 -- start start 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e41040a0 0x7f37e419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37e4105c50 0x7f37e41a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37e410fbe0 con 0x7f37e4105290 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37e410fa60 con 0x7f37e4105c50 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.071+0000 7f37e8a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f37e410fd60 con 0x7f37e41040a0 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e419a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59132/0 (socket says 172.21.15.7:59132) 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 -- 172.21.15.7:0/3168293437 learned_addr learned my addr 172.21.15.7:0/3168293437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e3400640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e41040a0 0x7f37e419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 -- 172.21.15.7:0/3168293437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e41040a0 msgr2=0x7f37e419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e41040a0 0x7f37e419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 -- 172.21.15.7:0/3168293437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37e4105c50 msgr2=0x7f37e41a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37e4105c50 0x7f37e41a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.072+0000 7f37e2a00640 1 -- 172.21.15.7:0/3168293437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e41a1e40 con 0x7f37e4105290 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.073+0000 7f37e2a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e419a760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f37d0004770 tx=0x7f37d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.073+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d003f030 con 0x7f37e4105290 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.073+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e41a20d0 con 0x7f37e4105290 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.073+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d0003cb0 con 0x7f37e4105290 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.073+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0035070 con 0x7f37e4105290 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.073+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e41a2610 con 0x7f37e4105290 2024-04-23T14:47:41.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.074+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e410b490 con 0x7f37e4105290 2024-04-23T14:47:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.078+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f37d0042030 con 0x7f37e4105290 2024-04-23T14:47:41.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.079+0000 7f37dbe00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37c80a3bb0 0x7f37c80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.079+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f37d00f0cd0 con 0x7f37e4105290 2024-04-23T14:47:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.079+0000 7f37e3400640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37c80a3bb0 0x7f37c80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.080+0000 7f37e3400640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37c80a3bb0 0x7f37c80a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f37d40058c0 tx=0x7f37d4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:41.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.081+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f37d00bdab0 con 0x7f37e4105290 2024-04-23T14:47:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.331+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e402d620 con 0x7f37e4105290 2024-04-23T14:47:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.332+0000 7f37dbe00640 1 -- 172.21.15.7:0/3168293437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f37d00bd3b0 con 0x7f37e4105290 2024-04-23T14:47:41.333 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:41.333 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T14:47:41.333 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 4 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37c80a3bb0 msgr2=0x7f37c80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37c80a3bb0 0x7f37c80a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f37d40058c0 tx=0x7f37d4005850 comp rx=0 tx=0).stop 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 msgr2=0x7f37e419a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e419a760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f37d0004770 tx=0x7f37d00042f0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 shutdown_connections 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37c80a3bb0 0x7f37c80a6070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37e4105c50 0x7f37e41a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37e4105290 0x7f37e419a760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 --2- 172.21.15.7:0/3168293437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e41040a0 0x7f37e419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 >> 172.21.15.7:0/3168293437 conn(0x7f37e40ff610 msgr2=0x7f37e4108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:41.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 shutdown_connections 2024-04-23T14:47:41.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:41.335+0000 7f37e8a00640 1 -- 172.21.15.7:0/3168293437 wait complete. 2024-04-23T14:47:41.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: Deploying daemon mds.d on smithi007 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.7:6834/1858740077,v1:172.21.15.7:6835/1858740077] up:boot 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: fsmap 3 up:standby 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T14:47:41.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:41 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3168293437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: Deploying daemon mds.d on smithi007 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.7:6834/1858740077,v1:172.21.15.7:6835/1858740077] up:boot 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: fsmap 3 up:standby 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T14:47:41.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:41 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3168293437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: Deploying daemon mds.d on smithi007 2024-04-23T14:47:42.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.7:6834/1858740077,v1:172.21.15.7:6835/1858740077] up:boot 2024-04-23T14:47:42.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: fsmap 3 up:standby 2024-04-23T14:47:42.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T14:47:42.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:41 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3168293437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:43.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:43.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 -- 172.21.15.7:0/3347020331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 msgr2=0x7f82f0076de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 --2- 172.21.15.7:0/3347020331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f0076de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009900 tx=0x7f82e002a410 comp rx=0 tx=0).stop 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 -- 172.21.15.7:0/3347020331 shutdown_connections 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 --2- 172.21.15.7:0/3347020331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f0077c00 0x7f82f0078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 --2- 172.21.15.7:0/3347020331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82f00785a0 0x7f82f0078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 --2- 172.21.15.7:0/3347020331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f0076de0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 -- 172.21.15.7:0/3347020331 >> 172.21.15.7:0/3347020331 conn(0x7f82f00ff7f0 msgr2=0x7f82f0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 -- 172.21.15.7:0/3347020331 shutdown_connections 2024-04-23T14:47:43.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.579+0000 7f82f5200640 1 -- 172.21.15.7:0/3347020331 wait complete. 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.580+0000 7f82f5200640 1 Processor -- start 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.580+0000 7f82f5200640 1 -- start start 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82f5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82f5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f0077c00 0x7f82f019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82f5200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82f00785a0 0x7f82f01a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82f5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82f01141e0 con 0x7f82f00769c0 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82f5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0114060 con 0x7f82f0077c00 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82f5200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0114360 con 0x7f82f00785a0 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55094/0 (socket says 172.21.15.7:55094) 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 -- 172.21.15.7:0/2859945267 learned_addr learned my addr 172.21.15.7:0/2859945267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:43.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ee800640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82f00785a0 0x7f82f01a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 -- 172.21.15.7:0/2859945267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82f00785a0 msgr2=0x7f82f01a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82f00785a0 0x7f82f01a5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 -- 172.21.15.7:0/2859945267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f0077c00 msgr2=0x7f82f019ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82e7e00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f0077c00 0x7f82f019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f0077c00 0x7f82f019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.581+0000 7f82ede00640 1 -- 172.21.15.7:0/2859945267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01a64e0 con 0x7f82f00769c0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.582+0000 7f82ede00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f019e8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82e00314e0 tx=0x7f82e0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.582+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e003f070 con 0x7f82f00769c0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.582+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f01a6770 con 0x7f82f00769c0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.582+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82e0031e40 con 0x7f82f00769c0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.582+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0035030 con 0x7f82f00769c0 2024-04-23T14:47:43.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.582+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a6c60 con 0x7f82f00769c0 2024-04-23T14:47:43.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.584+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0110da0 con 0x7f82f00769c0 2024-04-23T14:47:43.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.586+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f82e0042070 con 0x7f82f00769c0 2024-04-23T14:47:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.587+0000 7f82e6a00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82d40a3bb0 0x7f82d40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.588+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f82e00f0f40 con 0x7f82f00769c0 2024-04-23T14:47:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.588+0000 7f82e7e00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82d40a3bb0 0x7f82d40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.588+0000 7f82e7e00640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82d40a3bb0 0x7f82d40a6070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f82d8005fd0 tx=0x7f82d8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.590+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f82e00bdd20 con 0x7f82f00769c0 2024-04-23T14:47:43.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:43 smithi007 ceph-mon[27906]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:43.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.843+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82f002d620 con 0x7f82f00769c0 2024-04-23T14:47:43.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.844+0000 7f82e6a00640 1 -- 172.21.15.7:0/2859945267 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f82e00bd620 con 0x7f82f00769c0 2024-04-23T14:47:43.844 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T14:47:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 4 2024-04-23T14:47:43.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82d40a3bb0 msgr2=0x7f82d40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82d40a3bb0 0x7f82d40a6070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f82d8005fd0 tx=0x7f82d8005850 comp rx=0 tx=0).stop 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 msgr2=0x7f82f019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f019e8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82e00314e0 tx=0x7f82e0003c80 comp rx=0 tx=0).stop 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 shutdown_connections 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82d40a3bb0 0x7f82d40a6070 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82f0077c00 0x7f82f019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82f00785a0 0x7f82f01a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 --2- 172.21.15.7:0/2859945267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82f00769c0 0x7f82f019e8c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 >> 172.21.15.7:0/2859945267 conn(0x7f82f00ff7f0 msgr2=0x7f82f0100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 shutdown_connections 2024-04-23T14:47:43.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:43.847+0000 7f82f5200640 1 -- 172.21.15.7:0/2859945267 wait complete. 2024-04-23T14:47:43.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:43 smithi137 ceph-mon[31694]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:43 smithi186 ceph-mon[31814]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:44.466 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 podman[65852]: 2024-04-23 14:47:44.185287249 +0000 UTC m=+0.166389670 container create 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-23T14:47:44.467 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 podman[65852]: 2024-04-23 14:47:44.464489909 +0000 UTC m=+0.445592332 container init 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-23T14:47:44.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:44 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2859945267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:44.836 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 podman[65852]: 2024-04-23 14:47:44.476209266 +0000 UTC m=+0.457311720 container start 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-23T14:47:44.836 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 ceph-mds[65871]: -- 172.21.15.7:0/3750831843 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56146eb19a40 con 0x56146eaed000 2024-04-23T14:47:44.836 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d[65867]: starting mds.d at 2024-04-23T14:47:44.836 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 bash[65852]: 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 2024-04-23T14:47:44.837 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 14:47:44 smithi007 systemd[1]: Started Ceph mds.d for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:44 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2859945267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:44 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2859945267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:45.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:45.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:45.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.7:6836/4118329772,v1:172.21.15.7:6837/4118329772] up:boot 2024-04-23T14:47:45.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: fsmap 4 up:standby 2024-04-23T14:47:45.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:45.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:45 smithi137 ceph-mon[31694]: Deploying daemon mds.e on smithi137 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.7:6836/4118329772,v1:172.21.15.7:6837/4118329772] up:boot 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: fsmap 4 up:standby 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:45.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:45 smithi007 ceph-mon[27906]: Deploying daemon mds.e on smithi137 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 -- 172.21.15.7:0/1163289208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 msgr2=0x7f7008074430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 --2- 172.21.15.7:0/1163289208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f7008074430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009900 tx=0x7f6ff802a480 comp rx=0 tx=0).stop 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 -- 172.21.15.7:0/1163289208 shutdown_connections 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 --2- 172.21.15.7:0/1163289208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7008074a00 0x7f7008074e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 --2- 172.21.15.7:0/1163289208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7008109d30 0x7f700810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 --2- 172.21.15.7:0/1163289208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f7008074430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 -- 172.21.15.7:0/1163289208 >> 172.21.15.7:0/1163289208 conn(0x7f70080fd410 msgr2=0x7f70080ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.100+0000 7f700e200640 1 -- 172.21.15.7:0/1163289208 shutdown_connections 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.101+0000 7f700e200640 1 -- 172.21.15.7:0/1163289208 wait complete. 2024-04-23T14:47:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.101+0000 7f700e200640 1 Processor -- start 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 -- start start 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7008074a00 0x7f700819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f700819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7008109d30 0x7f70081a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f700810fc30 con 0x7f7008075fe0 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f700810fab0 con 0x7f7008074a00 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f700810fdb0 con 0x7f7008109d30 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f7007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f700819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:46.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f7007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f700819a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55132/0 (socket says 172.21.15.7:55132) 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f7007e00640 1 -- 172.21.15.7:0/83361921 learned_addr learned my addr 172.21.15.7:0/83361921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.102+0000 7f700ce00640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7008074a00 0x7f700819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f700d800640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7008109d30 0x7f70081a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7007e00640 1 -- 172.21.15.7:0/83361921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7008109d30 msgr2=0x7f70081a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7007e00640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7008109d30 0x7f70081a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7007e00640 1 -- 172.21.15.7:0/83361921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7008074a00 msgr2=0x7f700819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7007e00640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7008074a00 0x7f700819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7007e00640 1 -- 172.21.15.7:0/83361921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70081a1ef0 con 0x7f7008075fe0 2024-04-23T14:47:46.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7007e00640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f700819a810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400d950 tx=0x7f6ff400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4017030 con 0x7f7008075fe0 2024-04-23T14:47:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ff4004020 con 0x7f7008075fe0 2024-04-23T14:47:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70081a21e0 con 0x7f7008075fe0 2024-04-23T14:47:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.103+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40047a0 con 0x7f7008075fe0 2024-04-23T14:47:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.104+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081a2730 con 0x7f7008075fe0 2024-04-23T14:47:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.105+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7008108af0 con 0x7f7008075fe0 2024-04-23T14:47:46.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.107+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f6ff40041d0 con 0x7f7008075fe0 2024-04-23T14:47:46.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.109+0000 7f7005600640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6fec0a3bb0 0x7f6fec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.109+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6ff40cfb30 con 0x7f7008075fe0 2024-04-23T14:47:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.109+0000 7f700ce00640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6fec0a3bb0 0x7f6fec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.110+0000 7f700ce00640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6fec0a3bb0 0x7f6fec0a6070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80314e0 tx=0x7f6ff8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.7:6836/4118329772,v1:172.21.15.7:6837/4118329772] up:boot 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: fsmap 4 up:standby 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:46.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:45 smithi186 ceph-mon[31814]: Deploying daemon mds.e on smithi137 2024-04-23T14:47:46.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.114+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ff409c910 con 0x7f7008075fe0 2024-04-23T14:47:46.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.365+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f700802d620 con 0x7f7008075fe0 2024-04-23T14:47:46.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.366+0000 7f7005600640 1 -- 172.21.15.7:0/83361921 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3865 (secure 0 0 0) 0x7f6ff409c210 con 0x7f7008075fe0 2024-04-23T14:47:46.367 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:46.367 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T14:47:46.367 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-04-23T14:47:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6fec0a3bb0 msgr2=0x7f6fec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6fec0a3bb0 0x7f6fec0a6070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80314e0 tx=0x7f6ff8005a20 comp rx=0 tx=0).stop 2024-04-23T14:47:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 msgr2=0x7f700819a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f700819a810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400d950 tx=0x7f6ff400de10 comp rx=0 tx=0).stop 2024-04-23T14:47:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 shutdown_connections 2024-04-23T14:47:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6fec0a3bb0 0x7f6fec0a6070 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7008109d30 0x7f70081a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7008075fe0 0x7f700819a810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 --2- 172.21.15.7:0/83361921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7008074a00 0x7f700819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 >> 172.21.15.7:0/83361921 conn(0x7f70080fd410 msgr2=0x7f7008105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 shutdown_connections 2024-04-23T14:47:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:46.369+0000 7f700e200640 1 -- 172.21.15.7:0/83361921 wait complete. 2024-04-23T14:47:46.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:46 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/83361921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:47.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:46 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/83361921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:46 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/83361921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:47.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:47 smithi007 ceph-mon[27906]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:47.863 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:47 smithi137 ceph-mon[31694]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:47 smithi186 ceph-mon[31814]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:48.168 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:47 smithi137 systemd[1]: Starting Ceph mds.e for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:47:48.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:48.522 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 podman[61169]: 2024-04-23 14:47:48.116916756 +0000 UTC m=+0.031766049 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:47:48.522 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 podman[61169]: 2024-04-23 14:47:48.225386941 +0000 UTC m=+0.140236266 container create 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:47:48.523 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 podman[61169]: 2024-04-23 14:47:48.521011061 +0000 UTC m=+0.435860392 container init 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:47:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.614+0000 7efdc1200640 1 -- 172.21.15.7:0/4282657366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 msgr2=0x7efdbc10c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.614+0000 7efdc1200640 1 --2- 172.21.15.7:0/4282657366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc10c4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009ca0 tx=0x7efdb402a8c0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 -- 172.21.15.7:0/4282657366 shutdown_connections 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 --2- 172.21.15.7:0/4282657366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc105270 0x7efdbc1056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 --2- 172.21.15.7:0/4282657366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc10c4c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 --2- 172.21.15.7:0/4282657366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc104080 0x7efdbc1044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 -- 172.21.15.7:0/4282657366 >> 172.21.15.7:0/4282657366 conn(0x7efdbc0ff610 msgr2=0x7efdbc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 -- 172.21.15.7:0/4282657366 shutdown_connections 2024-04-23T14:47:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.615+0000 7efdc1200640 1 -- 172.21.15.7:0/4282657366 wait complete. 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 Processor -- start 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 -- start start 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc104080 0x7efdbc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc105270 0x7efdbc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc10fc10 con 0x7efdbc105c30 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc10fa90 con 0x7efdbc105270 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdc1200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc10fd90 con 0x7efdbc104080 2024-04-23T14:47:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.616+0000 7efdbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc1a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55148/0 (socket says 172.21.15.7:55148) 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 -- 172.21.15.7:0/587316253 learned_addr learned my addr 172.21.15.7:0/587316253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdb3e00640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc105270 0x7efdbc19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbb400640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc104080 0x7efdbc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 -- 172.21.15.7:0/587316253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc104080 msgr2=0x7efdbc19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc104080 0x7efdbc19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 -- 172.21.15.7:0/587316253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc105270 msgr2=0x7efdbc19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc105270 0x7efdbc19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 -- 172.21.15.7:0/587316253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc1a1e60 con 0x7efdbc105c30 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.617+0000 7efdbbe00640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc1a17f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdb4031040 tx=0x7efdb4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.618+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4032ec0 con 0x7efdbc105c30 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.618+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc1a20f0 con 0x7efdbc105c30 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.618+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdb40044f0 con 0x7efdbc105c30 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.618+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4030d10 con 0x7efdbc105c30 2024-04-23T14:47:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.618+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc1a2690 con 0x7efdbc105c30 2024-04-23T14:47:48.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.619+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc10b420 con 0x7efdbc105c30 2024-04-23T14:47:48.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.621+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7efdb4004040 con 0x7efdbc105c30 2024-04-23T14:47:48.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.622+0000 7efdb8c00640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efda00a3dd0 0x7efda00a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:48.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.622+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7efdb40f1600 con 0x7efdbc105c30 2024-04-23T14:47:48.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.623+0000 7efdbb400640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efda00a3dd0 0x7efda00a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.624+0000 7efdbb400640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efda00a3dd0 0x7efda00a6290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efda4005fd0 tx=0x7efda4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:48.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.629+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efdb40be3e0 con 0x7efdbc105c30 2024-04-23T14:47:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.898+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdbc062c00 con 0x7efdbc105c30 2024-04-23T14:47:48.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.899+0000 7efdb8c00640 1 -- 172.21.15.7:0/587316253 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4693 (secure 0 0 0) 0x7efdb40bdce0 con 0x7efdbc105c30 2024-04-23T14:47:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:48.900 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-23T14:47:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efda00a3dd0 msgr2=0x7efda00a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efda00a3dd0 0x7efda00a6290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efda4005fd0 tx=0x7efda4005850 comp rx=0 tx=0).stop 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 msgr2=0x7efdbc1a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc1a17f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdb4031040 tx=0x7efdb4003ba0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 shutdown_connections 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efda00a3dd0 0x7efda00a6290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc105270 0x7efdbc19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdbc105c30 0x7efdbc1a17f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 --2- 172.21.15.7:0/587316253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc104080 0x7efdbc19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:48.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.902+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 >> 172.21.15.7:0/587316253 conn(0x7efdbc0ff610 msgr2=0x7efdbc1085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:48.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.903+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 shutdown_connections 2024-04-23T14:47:48.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:48.903+0000 7efdc1200640 1 -- 172.21.15.7:0/587316253 wait complete. 2024-04-23T14:47:48.918 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 podman[61169]: 2024-04-23 14:47:48.531172203 +0000 UTC m=+0.446021506 container start 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-23T14:47:48.919 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 ceph-mds[61188]: -- 172.21.15.137:0/2553712254 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56286ad3ba40 con 0x56286ad0ec00 2024-04-23T14:47:48.919 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e[61184]: starting mds.e at 2024-04-23T14:47:48.919 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 bash[61169]: 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c 2024-04-23T14:47:48.919 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 14:47:48 smithi137 systemd[1]: Started Ceph mds.e for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:50.077 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:50.077 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] up:boot 2024-04-23T14:47:50.077 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: fsmap 5 up:standby 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: Deploying daemon mds.f on smithi186 2024-04-23T14:47:50.078 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:49 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/587316253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] up:boot 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: fsmap 5 up:standby 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:50.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:50.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: Deploying daemon mds.f on smithi186 2024-04-23T14:47:50.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:49 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/587316253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] up:boot 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: fsmap 5 up:standby 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:50.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:50.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:50.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: Deploying daemon mds.f on smithi186 2024-04-23T14:47:50.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:49 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/587316253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:50.924 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:51.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 -- 172.21.15.7:0/1460567415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160074a60 msgr2=0x7fe160074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:51.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 --2- 172.21.15.7:0/1460567415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160074a60 0x7fe160074ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009900 tx=0x7fe14c02a400 comp rx=0 tx=0).stop 2024-04-23T14:47:51.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 -- 172.21.15.7:0/1460567415 shutdown_connections 2024-04-23T14:47:51.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 --2- 172.21.15.7:0/1460567415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe160109d30 0x7fe16010c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 --2- 172.21.15.7:0/1460567415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160074a60 0x7fe160074ee0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 --2- 172.21.15.7:0/1460567415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe160076040 0x7fe160074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 -- 172.21.15.7:0/1460567415 >> 172.21.15.7:0/1460567415 conn(0x7fe1600fd3e0 msgr2=0x7fe1600ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 -- 172.21.15.7:0/1460567415 shutdown_connections 2024-04-23T14:47:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.146+0000 7fe164a00640 1 -- 172.21.15.7:0/1460567415 wait complete. 2024-04-23T14:47:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.147+0000 7fe164a00640 1 Processor -- start 2024-04-23T14:47:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.147+0000 7fe164a00640 1 -- start start 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe164a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe160074a60 0x7fe16019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe164a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe160076040 0x7fe16019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe164a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 0x7fe1601a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe164a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe16010fc30 con 0x7fe160109d30 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe164a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe16010fab0 con 0x7fe160076040 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe164a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe16010fdb0 con 0x7fe160074a60 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe15f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 0x7fe1601a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe15f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 0x7fe1601a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55168/0 (socket says 172.21.15.7:55168) 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe15f200640 1 -- 172.21.15.7:0/4148564403 learned_addr learned my addr 172.21.15.7:0/4148564403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe15e800640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe160074a60 0x7fe16019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.148+0000 7fe15de00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe160076040 0x7fe16019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe15f200640 1 -- 172.21.15.7:0/4148564403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe160074a60 msgr2=0x7fe16019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe15f200640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe160074a60 0x7fe16019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe15f200640 1 -- 172.21.15.7:0/4148564403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe160076040 msgr2=0x7fe16019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe15f200640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe160076040 0x7fe16019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe15f200640 1 -- 172.21.15.7:0/4148564403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1601a1f10 con 0x7fe160109d30 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe15f200640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 0x7fe1601a18a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe15800cce0 tx=0x7fe15800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15800f450 con 0x7fe160109d30 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe15800faa0 con 0x7fe160109d30 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1601a2200 con 0x7fe160109d30 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158018b70 con 0x7fe160109d30 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.149+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1601a2750 con 0x7fe160109d30 2024-04-23T14:47:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.151+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe160108a60 con 0x7fe160109d30 2024-04-23T14:47:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.153+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fe158018d10 con 0x7fe160109d30 2024-04-23T14:47:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.154+0000 7fe157400640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe1440a3c00 0x7fe1440a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.154+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe1580d0450 con 0x7fe160109d30 2024-04-23T14:47:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.154+0000 7fe15e800640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe1440a3c00 0x7fe1440a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.155+0000 7fe15e800640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe1440a3c00 0x7fe1440a60c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe150009890 tx=0x7fe150008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.158+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe158014030 con 0x7fe160109d30 2024-04-23T14:47:51.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.403+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe16002d620 con 0x7fe160109d30 2024-04-23T14:47:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.404+0000 7fe157400640 1 -- 172.21.15.7:0/4148564403 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4693 (secure 0 0 0) 0x7fe15809d2d0 con 0x7fe160109d30 2024-04-23T14:47:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:51.405 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-23T14:47:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe1440a3c00 msgr2=0x7fe1440a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe1440a3c00 0x7fe1440a60c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe150009890 tx=0x7fe150008040 comp rx=0 tx=0).stop 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 msgr2=0x7fe1601a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 0x7fe1601a18a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe15800cce0 tx=0x7fe15800a620 comp rx=0 tx=0).stop 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 shutdown_connections 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe1440a3c00 0x7fe1440a60c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe160076040 0x7fe16019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe160109d30 0x7fe1601a18a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 --2- 172.21.15.7:0/4148564403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe160074a60 0x7fe16019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 >> 172.21.15.7:0/4148564403 conn(0x7fe1600fd3e0 msgr2=0x7fe160105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 shutdown_connections 2024-04-23T14:47:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:51.407+0000 7fe164a00640 1 -- 172.21.15.7:0/4148564403 wait complete. 2024-04-23T14:47:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:51 smithi186 ceph-mon[31814]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:51 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4148564403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:51 smithi007 ceph-mon[27906]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:51 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4148564403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:52.114 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:51 smithi186 systemd[1]: Starting Ceph mds.f for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:47:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:51 smithi137 ceph-mon[31694]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:51 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4148564403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:52.576 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 podman[62529]: 2024-04-23 14:47:52.159075145 +0000 UTC m=+0.041583002 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:47:52.576 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 podman[62529]: 2024-04-23 14:47:52.278501039 +0000 UTC m=+0.161008927 container create ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-23T14:47:52.576 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 podman[62529]: 2024-04-23 14:47:52.574318015 +0000 UTC m=+0.456825947 container init ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:47:52.864 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 podman[62529]: 2024-04-23 14:47:52.584811744 +0000 UTC m=+0.467319610 container start ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-04-23T14:47:52.864 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 ceph-mds[62550]: -- 172.21.15.186:0/1006153107 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b5b5d1a40 con 0x559b5b5a4c00 2024-04-23T14:47:52.864 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f[62545]: starting mds.f at 2024-04-23T14:47:52.865 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 bash[62529]: ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 2024-04-23T14:47:52.865 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 14:47:52 smithi186 systemd[1]: Started Ceph mds.f for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:53.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:53.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 -- 172.21.15.7:0/3676907631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080785a0 msgr2=0x7fde08078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 --2- 172.21.15.7:0/3676907631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080785a0 0x7fde08078e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde00009900 tx=0x7fde0002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 -- 172.21.15.7:0/3676907631 shutdown_connections 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 --2- 172.21.15.7:0/3676907631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080785a0 0x7fde08078e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 --2- 172.21.15.7:0/3676907631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde08077c00 0x7fde08078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 --2- 172.21.15.7:0/3676907631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde080769c0 0x7fde08076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 -- 172.21.15.7:0/3676907631 >> 172.21.15.7:0/3676907631 conn(0x7fde080ff610 msgr2=0x7fde08101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 -- 172.21.15.7:0/3676907631 shutdown_connections 2024-04-23T14:47:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.938+0000 7fde07200640 1 -- 172.21.15.7:0/3676907631 wait complete. 2024-04-23T14:47:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.939+0000 7fde07200640 1 Processor -- start 2024-04-23T14:47:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 -- start start 2024-04-23T14:47:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 0x7fde0819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:53.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde08077c00 0x7fde0819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde080785a0 0x7fde081a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fde08114000 con 0x7fde080769c0 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde08113e80 con 0x7fde080785a0 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde07200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fde08114180 con 0x7fde08077c00 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde05e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 0x7fde0819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde05e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 0x7fde0819e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33418/0 (socket says 172.21.15.7:33418) 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fde05e00640 1 -- 172.21.15.7:0/1866273914 learned_addr learned my addr 172.21.15.7:0/1866273914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.940+0000 7fddfd400640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde08077c00 0x7fde0819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde06800640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde080785a0 0x7fde081a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde05e00640 1 -- 172.21.15.7:0/1866273914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde08077c00 msgr2=0x7fde0819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde05e00640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde08077c00 0x7fde0819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde05e00640 1 -- 172.21.15.7:0/1866273914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde080785a0 msgr2=0x7fde081a5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde05e00640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde080785a0 0x7fde081a5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde05e00640 1 -- 172.21.15.7:0/1866273914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde081a6270 con 0x7fde080769c0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fde05e00640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 0x7fde0819e650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddf800eab0 tx=0x7fddf800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.941+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf800ce40 con 0x7fde080769c0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.942+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddf8011920 con 0x7fde080769c0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.942+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8010a00 con 0x7fde080769c0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.942+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde081a6560 con 0x7fde080769c0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.942+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde081a6b00 con 0x7fde080769c0 2024-04-23T14:47:53.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.943+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde08110b90 con 0x7fde080769c0 2024-04-23T14:47:53.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.945+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fddf8011ad0 con 0x7fde080769c0 2024-04-23T14:47:53.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.947+0000 7fddff400640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fddec0a3c30 0x7fddec0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:53.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.948+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fddf80d05c0 con 0x7fde080769c0 2024-04-23T14:47:53.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.948+0000 7fddfd400640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fddec0a3c30 0x7fddec0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:53.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.948+0000 7fddfd400640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fddec0a3c30 0x7fddec0a60f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fde0819fb60 tx=0x7fddf0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:53.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:53.952+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fddf8016030 con 0x7fde080769c0 2024-04-23T14:47:53.984 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:53.984 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6834/77772242,v1:172.21.15.186:6835/77772242] up:boot 2024-04-23T14:47:53.984 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: fsmap 6 up:standby 2024-04-23T14:47:53.984 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T14:47:53.984 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:53.984 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:53.985 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:53.985 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:53.985 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:53.985 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:53.985 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:53 smithi186 ceph-mon[31814]: Deploying daemon mds.c on smithi186 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6834/77772242,v1:172.21.15.186:6835/77772242] up:boot 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: fsmap 6 up:standby 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:54.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:54.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:53 smithi007 ceph-mon[27906]: Deploying daemon mds.c on smithi186 2024-04-23T14:47:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6834/77772242,v1:172.21.15.186:6835/77772242] up:boot 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: fsmap 6 up:standby 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:54.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:53 smithi137 ceph-mon[31694]: Deploying daemon mds.c on smithi186 2024-04-23T14:47:54.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.199+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde08062c30 con 0x7fde080769c0 2024-04-23T14:47:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.201+0000 7fddff400640 1 -- 172.21.15.7:0/1866273914 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7fddf809d3a0 con 0x7fde080769c0 2024-04-23T14:47:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:54.202 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-23T14:47:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-04-23T14:47:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fddec0a3c30 msgr2=0x7fddec0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fddec0a3c30 0x7fddec0a60f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fde0819fb60 tx=0x7fddf0005f90 comp rx=0 tx=0).stop 2024-04-23T14:47:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 msgr2=0x7fde0819e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 0x7fde0819e650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddf800eab0 tx=0x7fddf800ef70 comp rx=0 tx=0).stop 2024-04-23T14:47:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 shutdown_connections 2024-04-23T14:47:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fddec0a3c30 0x7fddec0a60f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde080785a0 0x7fde081a5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde08077c00 0x7fde0819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 --2- 172.21.15.7:0/1866273914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde080769c0 0x7fde0819e650 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 >> 172.21.15.7:0/1866273914 conn(0x7fde080ff610 msgr2=0x7fde08100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 shutdown_connections 2024-04-23T14:47:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:54.204+0000 7fde07200640 1 -- 172.21.15.7:0/1866273914 wait complete. 2024-04-23T14:47:54.829 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:54 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1866273914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:54 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1866273914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:54 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1866273914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:55 smithi186 ceph-mon[31814]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:55 smithi007 ceph-mon[27906]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:56.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:55 smithi137 ceph-mon[31694]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:56.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:56.239 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:55 smithi186 systemd[1]: Starting Ceph mds.c for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:47:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 -- 172.21.15.7:0/1364820436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 msgr2=0x7f84e41054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 --2- 172.21.15.7:0/1364820436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e41054d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009900 tx=0x7f84d002a410 comp rx=0 tx=0).stop 2024-04-23T14:47:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 -- 172.21.15.7:0/1364820436 shutdown_connections 2024-04-23T14:47:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 --2- 172.21.15.7:0/1364820436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e4105a10 0x7f84e4105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 --2- 172.21.15.7:0/1364820436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e41054d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 --2- 172.21.15.7:0/1364820436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e41006f0 0x7f84e4102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 -- 172.21.15.7:0/1364820436 >> 172.21.15.7:0/1364820436 conn(0x7f84e40fc2d0 msgr2=0x7f84e40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 -- 172.21.15.7:0/1364820436 shutdown_connections 2024-04-23T14:47:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.451+0000 7f84eac00640 1 -- 172.21.15.7:0/1364820436 wait complete. 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.452+0000 7f84eac00640 1 Processor -- start 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.452+0000 7f84eac00640 1 -- start start 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84eac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e41006f0 0x7f84e419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84eac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84eac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e4105a10 0x7f84e41a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84eac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4114020 con 0x7f84e4103060 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84eac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4113ea0 con 0x7f84e41006f0 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84eac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41141a0 con 0x7f84e4105a10 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33432/0 (socket says 172.21.15.7:33432) 2024-04-23T14:47:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 -- 172.21.15.7:0/1402501383 learned_addr learned my addr 172.21.15.7:0/1402501383 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 -- 172.21.15.7:0/1402501383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e4105a10 msgr2=0x7f84e41a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e4105a10 0x7f84e41a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 -- 172.21.15.7:0/1402501383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e41006f0 msgr2=0x7f84e419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e9800640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e41006f0 0x7f84e419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e41006f0 0x7f84e419e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.453+0000 7f84e8e00640 1 -- 172.21.15.7:0/1402501383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41a62d0 con 0x7f84e4103060 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.454+0000 7f84e8e00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e419ebf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84d00314e0 tx=0x7f84d0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.454+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d003f070 con 0x7f84e4103060 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.454+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84d0031e40 con 0x7f84e4103060 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.454+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0035030 con 0x7f84e4103060 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.454+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e41a6560 con 0x7f84e4103060 2024-04-23T14:47:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.454+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a6a00 con 0x7f84e4103060 2024-04-23T14:47:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.455+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e40fddc0 con 0x7f84e4103060 2024-04-23T14:47:56.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.457+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f84d0042070 con 0x7f84e4103060 2024-04-23T14:47:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.459+0000 7f84e2000640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84cc0a3c30 0x7f84cc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.459+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f84d00f0ee0 con 0x7f84e4103060 2024-04-23T14:47:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.459+0000 7f84e9800640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84cc0a3c30 0x7f84cc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.460+0000 7f84e9800640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84cc0a3c30 0x7f84cc0a60f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84d8005c40 tx=0x7f84d8005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.462+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f84d00bdcc0 con 0x7f84e4103060 2024-04-23T14:47:56.547 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 podman[62851]: 2024-04-23 14:47:56.145651812 +0000 UTC m=+0.041109525 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:47:56.547 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 podman[62851]: 2024-04-23 14:47:56.267030276 +0000 UTC m=+0.162488016 container create 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:47:56.547 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 podman[62851]: 2024-04-23 14:47:56.545965415 +0000 UTC m=+0.441423162 container init 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-23T14:47:56.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.709+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84e402d620 con 0x7f84e4103060 2024-04-23T14:47:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.716+0000 7f84e2000640 1 -- 172.21.15.7:0/1402501383 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7f84d00bd5c0 con 0x7f84e4103060 2024-04-23T14:47:56.717 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:56.717 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-23T14:47:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-04-23T14:47:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.718+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84cc0a3c30 msgr2=0x7f84cc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.718+0000 7f84eac00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84cc0a3c30 0x7f84cc0a60f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84d8005c40 tx=0x7f84d8005bd0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 msgr2=0x7f84e419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e419ebf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84d00314e0 tx=0x7f84d0003c80 comp rx=0 tx=0).stop 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 shutdown_connections 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84cc0a3c30 0x7f84cc0a60f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e4105a10 0x7f84e41a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e4103060 0x7f84e419ebf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 --2- 172.21.15.7:0/1402501383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e41006f0 0x7f84e419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 >> 172.21.15.7:0/1402501383 conn(0x7f84e40fc2d0 msgr2=0x7f84e4101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 shutdown_connections 2024-04-23T14:47:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:56.719+0000 7f84eac00640 1 -- 172.21.15.7:0/1402501383 wait complete. 2024-04-23T14:47:56.864 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 podman[62851]: 2024-04-23 14:47:56.556225838 +0000 UTC m=+0.451683548 container start 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-23T14:47:56.864 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 ceph-mds[62870]: -- 172.21.15.186:0/214811340 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5591352d04e0 con 0x5591352a6800 2024-04-23T14:47:56.864 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 ceph-mds[62870]: -- 172.21.15.186:0/214811340 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591352d3a40 con 0x5591352a6800 2024-04-23T14:47:56.864 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c[62866]: starting mds.c at 2024-04-23T14:47:56.864 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 bash[62851]: 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f 2024-04-23T14:47:56.864 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 14:47:56 smithi186 systemd[1]: Started Ceph mds.c for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:47:57.987 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:57.987 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1402501383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6836/2659046243,v1:172.21.15.186:6837/2659046243] up:boot 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: fsmap 7 up:standby 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:57.988 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:57 smithi137 ceph-mon[31694]: Deploying daemon mds.h on smithi137 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1402501383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6836/2659046243,v1:172.21.15.186:6837/2659046243] up:boot 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: fsmap 7 up:standby 2024-04-23T14:47:58.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T14:47:58.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:58.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:58.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:58.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:58.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:57 smithi007 ceph-mon[27906]: Deploying daemon mds.h on smithi137 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1402501383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6836/2659046243,v1:172.21.15.186:6837/2659046243] up:boot 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: fsmap 7 up:standby 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T14:47:58.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:47:58.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:47:58.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:47:58.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:58.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:57 smithi186 ceph-mon[31814]: Deploying daemon mds.h on smithi137 2024-04-23T14:47:58.740 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:47:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 -- 172.21.15.7:0/700607510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe324108660 msgr2=0x7fe324108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 --2- 172.21.15.7:0/700607510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe324108660 0x7fe324108a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe314009900 tx=0x7fe31402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:47:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 -- 172.21.15.7:0/700607510 shutdown_connections 2024-04-23T14:47:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 --2- 172.21.15.7:0/700607510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe324109850 0x7fe324109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 --2- 172.21.15.7:0/700607510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32410a210 0x7fe324110aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 --2- 172.21.15.7:0/700607510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe324108660 0x7fe324108a80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 -- 172.21.15.7:0/700607510 >> 172.21.15.7:0/700607510 conn(0x7fe324077620 msgr2=0x7fe324079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 -- 172.21.15.7:0/700607510 shutdown_connections 2024-04-23T14:47:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.964+0000 7fe32ac00640 1 -- 172.21.15.7:0/700607510 wait complete. 2024-04-23T14:47:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.965+0000 7fe32ac00640 1 Processor -- start 2024-04-23T14:47:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.965+0000 7fe32ac00640 1 -- start start 2024-04-23T14:47:58.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.965+0000 7fe32ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe324108660 0x7fe32419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe32ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe324109850 0x7fe32419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe32ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 0x7fe3241a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe32ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241141b0 con 0x7fe32410a210 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe32ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe324114030 con 0x7fe324109850 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe32ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe324114330 con 0x7fe324108660 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 0x7fe3241a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 0x7fe3241a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33450/0 (socket says 172.21.15.7:33450) 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 -- 172.21.15.7:0/1653040016 learned_addr learned my addr 172.21.15.7:0/1653040016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:47:58.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe31b400640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe324109850 0x7fe32419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe323e00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe324108660 0x7fe32419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 -- 172.21.15.7:0/1653040016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe324108660 msgr2=0x7fe32419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe324108660 0x7fe32419e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 -- 172.21.15.7:0/1653040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe324109850 msgr2=0x7fe32419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe324109850 0x7fe32419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.966+0000 7fe328c00640 1 -- 172.21.15.7:0/1653040016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3241a6490 con 0x7fe32410a210 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.967+0000 7fe328c00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 0x7fe3241a5e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c970 tx=0x7fe31c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.967+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c007bb0 con 0x7fe32410a210 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.967+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe31c007d50 con 0x7fe32410a210 2024-04-23T14:47:58.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.967+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3241a6780 con 0x7fe32410a210 2024-04-23T14:47:58.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.967+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c018700 con 0x7fe32410a210 2024-04-23T14:47:58.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.967+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3241a6c80 con 0x7fe32410a210 2024-04-23T14:47:58.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.968+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32410f980 con 0x7fe32410a210 2024-04-23T14:47:58.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.970+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fe31c00fa20 con 0x7fe32410a210 2024-04-23T14:47:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.972+0000 7fe321600640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe3080a3bb0 0x7fe3080a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.972+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe31c0d01a0 con 0x7fe32410a210 2024-04-23T14:47:58.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.972+0000 7fe323e00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe3080a3bb0 0x7fe3080a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:58.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.973+0000 7fe323e00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe3080a3bb0 0x7fe3080a6070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe31402a910 tx=0x7fe314005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:58.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:58.976+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe31c014030 con 0x7fe32410a210 2024-04-23T14:47:59.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.223+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe324062c00 con 0x7fe32410a210 2024-04-23T14:47:59.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.225+0000 7fe321600640 1 -- 172.21.15.7:0/1653040016 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6343 (secure 0 0 0) 0x7fe31c09cf80 con 0x7fe32410a210 2024-04-23T14:47:59.225 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:47:59.226 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-23T14:47:59.226 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-23T14:47:59.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe3080a3bb0 msgr2=0x7fe3080a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe3080a3bb0 0x7fe3080a6070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe31402a910 tx=0x7fe314005fd0 comp rx=0 tx=0).stop 2024-04-23T14:47:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 msgr2=0x7fe3241a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 0x7fe3241a5e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c970 tx=0x7fe31c00ce30 comp rx=0 tx=0).stop 2024-04-23T14:47:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 shutdown_connections 2024-04-23T14:47:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe3080a3bb0 0x7fe3080a6070 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe324109850 0x7fe32419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe32410a210 0x7fe3241a5e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 --2- 172.21.15.7:0/1653040016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe324108660 0x7fe32419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.227+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 >> 172.21.15.7:0/1653040016 conn(0x7fe324077620 msgr2=0x7fe32410cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.228+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 shutdown_connections 2024-04-23T14:47:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:47:59.228+0000 7fe32ac00640 1 -- 172.21.15.7:0/1653040016 wait complete. 2024-04-23T14:47:59.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:59 smithi137 ceph-mon[31694]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:47:59.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:47:59 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1653040016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:59 smithi007 ceph-mon[27906]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:00.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:47:59 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1653040016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:00.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:59 smithi186 ceph-mon[31814]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:00.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:47:59 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1653040016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:00.312 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:47:59 smithi137 systemd[1]: Starting Ceph mds.h for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:48:00.612 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 podman[61474]: 2024-04-23 14:48:00.216806507 +0000 UTC m=+0.036057847 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:48:00.612 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 podman[61474]: 2024-04-23 14:48:00.347534444 +0000 UTC m=+0.166785816 container create 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-23T14:48:00.612 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 podman[61474]: 2024-04-23 14:48:00.610549471 +0000 UTC m=+0.429800832 container init 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-23T14:48:00.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 podman[61474]: 2024-04-23 14:48:00.621472748 +0000 UTC m=+0.440724071 container start 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-23T14:48:00.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 ceph-mds[61493]: -- 172.21.15.137:0/3108244685 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a04cdada40 con 0x55a04cd80c00 2024-04-23T14:48:00.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h[61489]: starting mds.h at 2024-04-23T14:48:00.919 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 bash[61474]: 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 2024-04-23T14:48:00.919 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 14:48:00 smithi137 systemd[1]: Started Ceph mds.h for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:48:01.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:01.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 -- 172.21.15.7:0/1984819767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4103240 msgr2=0x7fd5b41036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:01.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 --2- 172.21.15.7:0/1984819767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4103240 0x7fd5b41036c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009900 tx=0x7fd5a002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 -- 172.21.15.7:0/1984819767 shutdown_connections 2024-04-23T14:48:01.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 --2- 172.21.15.7:0/1984819767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 0x7fd5b410a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 --2- 172.21.15.7:0/1984819767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4103240 0x7fd5b41036c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 --2- 172.21.15.7:0/1984819767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4102050 0x7fd5b4102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 -- 172.21.15.7:0/1984819767 >> 172.21.15.7:0/1984819767 conn(0x7fd5b40fd600 msgr2=0x7fd5b40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 -- 172.21.15.7:0/1984819767 shutdown_connections 2024-04-23T14:48:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.469+0000 7fd5bae00640 1 -- 172.21.15.7:0/1984819767 wait complete. 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.470+0000 7fd5bae00640 1 Processor -- start 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.470+0000 7fd5bae00640 1 -- start start 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5bae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 0x7fd5b4075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5bae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4103240 0x7fd5b40743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5bae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 0x7fd5b4074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5bae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b410dbe0 con 0x7fd5b4102050 2024-04-23T14:48:01.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5bae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b410da60 con 0x7fd5b4103240 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5bae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b410dd60 con 0x7fd5b4103c00 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 0x7fd5b4075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 0x7fd5b4075db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33462/0 (socket says 172.21.15.7:33462) 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.471+0000 7fd5b3e00640 1 -- 172.21.15.7:0/2061843983 learned_addr learned my addr 172.21.15.7:0/2061843983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3400640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4103240 0x7fd5b40743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b8e00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 0x7fd5b4074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3e00640 1 -- 172.21.15.7:0/2061843983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 msgr2=0x7fd5b4074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3e00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 0x7fd5b4074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3e00640 1 -- 172.21.15.7:0/2061843983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4103240 msgr2=0x7fd5b40743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3e00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4103240 0x7fd5b40743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3e00640 1 -- 172.21.15.7:0/2061843983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40751c0 con 0x7fd5b4102050 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3400640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4103240 0x7fd5b40743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b8e00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 0x7fd5b4074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:01.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b3e00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 0x7fd5b4075db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400c970 tx=0x7fd5a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4007c10 con 0x7fd5b4102050 2024-04-23T14:48:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5a4007db0 con 0x7fd5b4102050 2024-04-23T14:48:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a400f870 con 0x7fd5b4102050 2024-04-23T14:48:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b41a2270 con 0x7fd5b4102050 2024-04-23T14:48:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.472+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b41a2770 con 0x7fd5b4102050 2024-04-23T14:48:01.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.474+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b4109310 con 0x7fd5b4102050 2024-04-23T14:48:01.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.476+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fd5a400fa10 con 0x7fd5b4102050 2024-04-23T14:48:01.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.477+0000 7fd5b0c00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5980a3c30 0x7fd5980a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.477+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd5a40d03f0 con 0x7fd5b4102050 2024-04-23T14:48:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.477+0000 7fd5b3400640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5980a3c30 0x7fd5980a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:01.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.478+0000 7fd5b3400640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5980a3c30 0x7fd5980a60f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd5a002a910 tx=0x7fd5a0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:01.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.482+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5a409d260 con 0x7fd5b4102050 2024-04-23T14:48:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.731+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5b402d620 con 0x7fd5b4102050 2024-04-23T14:48:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.733+0000 7fd5b0c00640 1 -- 172.21.15.7:0/2061843983 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7171 (secure 0 0 0) 0x7fd5a409cb60 con 0x7fd5b4102050 2024-04-23T14:48:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:01.735 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-04-23T14:48:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5980a3c30 msgr2=0x7fd5980a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5980a3c30 0x7fd5980a60f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd5a002a910 tx=0x7fd5a0005fd0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 msgr2=0x7fd5b4075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:01.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 0x7fd5b4075db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400c970 tx=0x7fd5a400ce30 comp rx=0 tx=0).stop 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 shutdown_connections 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5980a3c30 0x7fd5980a60f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5b4103240 0x7fd5b40743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5b4103c00 0x7fd5b4074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 --2- 172.21.15.7:0/2061843983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5b4102050 0x7fd5b4075db0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 >> 172.21.15.7:0/2061843983 conn(0x7fd5b40fd600 msgr2=0x7fd5b41064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 shutdown_connections 2024-04-23T14:48:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:01.736+0000 7fd5bae00640 1 -- 172.21.15.7:0/2061843983 wait complete. 2024-04-23T14:48:01.996 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] up:boot 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: fsmap 8 up:standby 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:01.997 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:01 smithi186 ceph-mon[31814]: Deploying daemon mds.i on smithi186 2024-04-23T14:48:02.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:02.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] up:boot 2024-04-23T14:48:02.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: fsmap 8 up:standby 2024-04-23T14:48:02.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T14:48:02.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:02.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:01 smithi007 ceph-mon[27906]: Deploying daemon mds.i on smithi186 2024-04-23T14:48:02.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] up:boot 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: fsmap 8 up:standby 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:02.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:01 smithi137 ceph-mon[31694]: Deploying daemon mds.i on smithi186 2024-04-23T14:48:03.058 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:02 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2061843983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:02 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2061843983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:03.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:02 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2061843983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:03.759 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:03.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 -- 172.21.15.7:0/1971295580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780101e70 msgr2=0x7f2780102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:03.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 --2- 172.21.15.7:0/1971295580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780101e70 0x7f2780102290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2770009900 tx=0x7f277002a410 comp rx=0 tx=0).stop 2024-04-23T14:48:03.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 -- 172.21.15.7:0/1971295580 shutdown_connections 2024-04-23T14:48:03.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 --2- 172.21.15.7:0/1971295580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2780103980 0x7f278010a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:03.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 --2- 172.21.15.7:0/1971295580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2780102fc0 0x7f2780103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 --2- 172.21.15.7:0/1971295580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780101e70 0x7f2780102290 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 -- 172.21.15.7:0/1971295580 >> 172.21.15.7:0/1971295580 conn(0x7f27800fd3e0 msgr2=0x7f27800ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 -- 172.21.15.7:0/1971295580 shutdown_connections 2024-04-23T14:48:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.988+0000 7f277f200640 1 -- 172.21.15.7:0/1971295580 wait complete. 2024-04-23T14:48:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.989+0000 7f277f200640 1 Processor -- start 2024-04-23T14:48:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.989+0000 7f277f200640 1 -- start start 2024-04-23T14:48:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2780101e70 0x7f278019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2780102fc0 0x7f278019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 0x7f27801a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f278010d9a0 con 0x7f2780103980 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f278010d820 con 0x7f2780101e70 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f278010db20 con 0x7f2780102fc0 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 0x7f27801a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 0x7f27801a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41996/0 (socket says 172.21.15.7:41996) 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 -- 172.21.15.7:0/2912705633 learned_addr learned my addr 172.21.15.7:0/2912705633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277d400640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2780102fc0 0x7f278019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277de00640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2780101e70 0x7f278019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 -- 172.21.15.7:0/2912705633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2780102fc0 msgr2=0x7f278019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:03.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2780102fc0 0x7f278019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 -- 172.21.15.7:0/2912705633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2780101e70 msgr2=0x7f278019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2780101e70 0x7f278019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.990+0000 7f277e800640 1 -- 172.21.15.7:0/2912705633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27801a1f10 con 0x7f2780103980 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.991+0000 7f277e800640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 0x7f27801a18a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f277800eaa0 tx=0x7f277800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.991+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277800cdb0 con 0x7f2780103980 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.991+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2778005020 con 0x7f2780103980 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.991+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27780116d0 con 0x7f2780103980 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.991+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27801a2200 con 0x7f2780103980 2024-04-23T14:48:03.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.991+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27801a2700 con 0x7f2780103980 2024-04-23T14:48:03.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.992+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27801a29c0 con 0x7f2780103980 2024-04-23T14:48:03.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.994+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f27780051d0 con 0x7f2780103980 2024-04-23T14:48:03.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.996+0000 7f2776a00640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f27640a3c30 0x7f27640a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:03.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.996+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f27780d01d0 con 0x7f2780103980 2024-04-23T14:48:03.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.996+0000 7f277de00640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f27640a3c30 0x7f27640a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:03.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:03.997+0000 7f277de00640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f27640a3c30 0x7f27640a60f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2770000c00 tx=0x7f27700314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:04.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.000+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2778016030 con 0x7f2780103980 2024-04-23T14:48:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:03 smithi007 ceph-mon[27906]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:04.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:03 smithi186 ceph-mon[31814]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:04.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:03 smithi137 ceph-mon[31694]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.252+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27801a2b90 con 0x7f2780103980 2024-04-23T14:48:04.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.254+0000 7f2776a00640 1 -- 172.21.15.7:0/2912705633 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7171 (secure 0 0 0) 0x7f277809cfb0 con 0x7f2780103980 2024-04-23T14:48:04.255 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:04.256 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:04.256 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.256+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f27640a3c30 msgr2=0x7f27640a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.256+0000 7f277f200640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f27640a3c30 0x7f27640a60f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2770000c00 tx=0x7f27700314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.256+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 msgr2=0x7f27801a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.256+0000 7f277f200640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 0x7f27801a18a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f277800eaa0 tx=0x7f277800ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 shutdown_connections 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f27640a3c30 0x7f27640a60f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2780103980 0x7f27801a18a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2780102fc0 0x7f278019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 --2- 172.21.15.7:0/2912705633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2780101e70 0x7f278019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 >> 172.21.15.7:0/2912705633 conn(0x7f27800fd3e0 msgr2=0x7f2780108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 shutdown_connections 2024-04-23T14:48:04.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:04.257+0000 7f277f200640 1 -- 172.21.15.7:0/2912705633 wait complete. 2024-04-23T14:48:04.363 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 systemd[1]: Starting Ceph mds.i for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:48:04.751 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 podman[63159]: 2024-04-23 14:48:04.35752514 +0000 UTC m=+0.031847735 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:48:04.752 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 podman[63159]: 2024-04-23 14:48:04.479765361 +0000 UTC m=+0.154087987 container create a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.schema-version=1.0) 2024-04-23T14:48:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:04 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2912705633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:04 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2912705633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:05.114 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 podman[63159]: 2024-04-23 14:48:04.758466521 +0000 UTC m=+0.432789153 container init a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-23T14:48:05.114 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 podman[63159]: 2024-04-23 14:48:04.768713645 +0000 UTC m=+0.443036281 container start a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-23T14:48:05.114 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 ceph-mds[63178]: -- 172.21.15.186:0/3499400181 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564250dcda40 con 0x564250da0c00 2024-04-23T14:48:05.115 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i[63174]: starting mds.i at 2024-04-23T14:48:05.115 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 bash[63159]: a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 2024-04-23T14:48:05.115 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 14:48:04 smithi186 systemd[1]: Started Ceph mds.i for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:48:05.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:04 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2912705633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:06.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:06.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:06.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:06.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: Deploying daemon mds.g on smithi007 2024-04-23T14:48:06.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] up:boot 2024-04-23T14:48:06.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: fsmap 9 up:standby 2024-04-23T14:48:06.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:05 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: Deploying daemon mds.g on smithi007 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] up:boot 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: fsmap 9 up:standby 2024-04-23T14:48:06.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:05 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T14:48:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: Deploying daemon mds.g on smithi007 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] up:boot 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: fsmap 9 up:standby 2024-04-23T14:48:06.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:05 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 -- 172.21.15.7:0/824083365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 msgr2=0x7fbe5c107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 --2- 172.21.15.7:0/824083365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c107620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009900 tx=0x7fbe4802a410 comp rx=0 tx=0).stop 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 -- 172.21.15.7:0/824083365 shutdown_connections 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 --2- 172.21.15.7:0/824083365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5c107b60 0x7fbe5c109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 --2- 172.21.15.7:0/824083365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c107620 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 --2- 172.21.15.7:0/824083365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe5c102900 0x7fbe5c104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 -- 172.21.15.7:0/824083365 >> 172.21.15.7:0/824083365 conn(0x7fbe5c0fc2d0 msgr2=0x7fbe5c0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 -- 172.21.15.7:0/824083365 shutdown_connections 2024-04-23T14:48:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.487+0000 7fbe5be00640 1 -- 172.21.15.7:0/824083365 wait complete. 2024-04-23T14:48:06.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.488+0000 7fbe5be00640 1 Processor -- start 2024-04-23T14:48:06.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 -- start start 2024-04-23T14:48:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5c102900 0x7fbe5c102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe5c107b60 0x7fbe5c100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c10da60 con 0x7fbe5c105230 2024-04-23T14:48:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c10d8e0 con 0x7fbe5c102900 2024-04-23T14:48:06.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c10dbe0 con 0x7fbe5c107b60 2024-04-23T14:48:06.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.489+0000 7fbe5a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:06.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c1008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42014/0 (socket says 172.21.15.7:42014) 2024-04-23T14:48:06.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 -- 172.21.15.7:0/1509337052 learned_addr learned my addr 172.21.15.7:0/1509337052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:06.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5aa00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5c102900 0x7fbe5c102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:06.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5b400640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe5c107b60 0x7fbe5c100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:06.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 -- 172.21.15.7:0/1509337052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe5c107b60 msgr2=0x7fbe5c100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:06.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe5c107b60 0x7fbe5c100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 -- 172.21.15.7:0/1509337052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5c102900 msgr2=0x7fbe5c102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:06.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5c102900 0x7fbe5c102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.490+0000 7fbe5a000640 1 -- 172.21.15.7:0/1509337052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c101680 con 0x7fbe5c105230 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.491+0000 7fbe5a000640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c1008b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe480314e0 tx=0x7fbe48003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.491+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4803f070 con 0x7fbe5c105230 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.491+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe48031e40 con 0x7fbe5c105230 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.491+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c1a2260 con 0x7fbe5c105230 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.491+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48035030 con 0x7fbe5c105230 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.491+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5c1a2880 con 0x7fbe5c105230 2024-04-23T14:48:06.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.492+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5c0fddc0 con 0x7fbe5c105230 2024-04-23T14:48:06.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.495+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fbe48042070 con 0x7fbe5c105230 2024-04-23T14:48:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.496+0000 7fbe53400640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbe400a3c30 0x7fbe400a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.496+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbe480f0db0 con 0x7fbe5c105230 2024-04-23T14:48:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.496+0000 7fbe5aa00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbe400a3c30 0x7fbe400a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.497+0000 7fbe5aa00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbe400a3c30 0x7fbe400a60f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009990 tx=0x7fbe4c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:06.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.500+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbe480bdc30 con 0x7fbe5c105230 2024-04-23T14:48:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.755+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe5c02d870 con 0x7fbe5c105230 2024-04-23T14:48:06.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.756+0000 7fbe53400640 1 -- 172.21.15.7:0/1509337052 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8001 (secure 0 0 0) 0x7fbe480bd530 con 0x7fbe5c105230 2024-04-23T14:48:06.758 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:06.758 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:06.758 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 10 2024-04-23T14:48:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.758+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbe400a3c30 msgr2=0x7fbe400a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.758+0000 7fbe5be00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbe400a3c30 0x7fbe400a60f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009990 tx=0x7fbe4c009110 comp rx=0 tx=0).stop 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.758+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 msgr2=0x7fbe5c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.758+0000 7fbe5be00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c1008b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe480314e0 tx=0x7fbe48003d50 comp rx=0 tx=0).stop 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 shutdown_connections 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbe400a3c30 0x7fbe400a60f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe5c107b60 0x7fbe5c100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe5c105230 0x7fbe5c1008b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 --2- 172.21.15.7:0/1509337052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5c102900 0x7fbe5c102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 >> 172.21.15.7:0/1509337052 conn(0x7fbe5c0fc2d0 msgr2=0x7fbe5c103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 shutdown_connections 2024-04-23T14:48:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:06.759+0000 7fbe5be00640 1 -- 172.21.15.7:0/1509337052 wait complete. 2024-04-23T14:48:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1509337052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1509337052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1509337052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:08.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:08 smithi007 ceph-mon[27906]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:08.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:08 smithi186 ceph-mon[31814]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:08.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:08 smithi137 ceph-mon[31694]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:08.708 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:08 smithi007 systemd[1]: Starting Ceph mds.g for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:48:08.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:09.003 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:08 smithi007 podman[66535]: 2024-04-23 14:48:08.612736752 +0000 UTC m=+0.034999070 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:48:09.003 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:08 smithi007 podman[66535]: 2024-04-23 14:48:08.740987228 +0000 UTC m=+0.163249571 container create 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-23T14:48:09.003 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:09 smithi007 podman[66535]: 2024-04-23 14:48:09.002686021 +0000 UTC m=+0.424948355 container init 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:48:09.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 -- 172.21.15.7:0/3762551970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788105470 msgr2=0x7f77881058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:09.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 --2- 172.21.15.7:0/3762551970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788105470 0x7f77881058f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7774009900 tx=0x7f777402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 -- 172.21.15.7:0/3762551970 shutdown_connections 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 --2- 172.21.15.7:0/3762551970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7788105e30 0x7f778810c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 --2- 172.21.15.7:0/3762551970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788105470 0x7f77881058f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 --2- 172.21.15.7:0/3762551970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7788104280 0x7f77881046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 -- 172.21.15.7:0/3762551970 >> 172.21.15.7:0/3762551970 conn(0x7f77880ff7f0 msgr2=0x7f7788101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 -- 172.21.15.7:0/3762551970 shutdown_connections 2024-04-23T14:48:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.006+0000 7f778f000640 1 -- 172.21.15.7:0/3762551970 wait complete. 2024-04-23T14:48:09.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 Processor -- start 2024-04-23T14:48:09.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 -- start start 2024-04-23T14:48:09.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 0x7f778819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:09.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7788105470 0x7f778819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:09.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7788105e30 0x7f77881a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:09.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f778810fe10 con 0x7f7788104280 2024-04-23T14:48:09.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f778810fc90 con 0x7f7788105470 2024-04-23T14:48:09.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.008+0000 7f778f000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f778810ff90 con 0x7f7788105e30 2024-04-23T14:48:09.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 0x7f778819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:09.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 0x7f778819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42022/0 (socket says 172.21.15.7:42022) 2024-04-23T14:48:09.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 -- 172.21.15.7:0/2792997965 learned_addr learned my addr 172.21.15.7:0/2792997965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787400640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7788105470 0x7f778819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f778d000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7788105e30 0x7f77881a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 -- 172.21.15.7:0/2792997965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7788105e30 msgr2=0x7f77881a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7788105e30 0x7f77881a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 -- 172.21.15.7:0/2792997965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7788105470 msgr2=0x7f778819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7788105470 0x7f778819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.009+0000 7f7787e00640 1 -- 172.21.15.7:0/2792997965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77881a2060 con 0x7f7788104280 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.010+0000 7f7787e00640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 0x7f778819a440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f777800d770 tx=0x7f777800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.010+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778017070 con 0x7f7788104280 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.010+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7778009c30 con 0x7f7788104280 2024-04-23T14:48:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.010+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77881a2350 con 0x7f7788104280 2024-04-23T14:48:09.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.010+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778003d00 con 0x7f7788104280 2024-04-23T14:48:09.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.011+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77881a2870 con 0x7f7788104280 2024-04-23T14:48:09.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.012+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778810b5a0 con 0x7f7788104280 2024-04-23T14:48:09.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.014+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f7778003ea0 con 0x7f7788104280 2024-04-23T14:48:09.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.016+0000 7f7784c00640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f776c0a3bb0 0x7f776c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:09.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.016+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f77780cfdc0 con 0x7f7788104280 2024-04-23T14:48:09.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.016+0000 7f7787400640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f776c0a3bb0 0x7f776c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:09.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.017+0000 7f7787400640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f776c0a3bb0 0x7f776c0a6070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7774000c00 tx=0x7f77740314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:09.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.020+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f777809cba0 con 0x7f7788104280 2024-04-23T14:48:09.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.309+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f778802d620 con 0x7f7788104280 2024-04-23T14:48:09.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.311+0000 7f7784c00640 1 -- 172.21.15.7:0/2792997965 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8001 (secure 0 0 0) 0x7f7778009de0 con 0x7f7788104280 2024-04-23T14:48:09.313 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 10 2024-04-23T14:48:09.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:09.313 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f776c0a3bb0 msgr2=0x7f776c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f776c0a3bb0 0x7f776c0a6070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7774000c00 tx=0x7f77740314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 msgr2=0x7f778819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 0x7f778819a440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f777800d770 tx=0x7f777800dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 shutdown_connections 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f776c0a3bb0 0x7f776c0a6070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7788105470 0x7f778819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7788105e30 0x7f77881a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 --2- 172.21.15.7:0/2792997965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7788104280 0x7f778819a440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 >> 172.21.15.7:0/2792997965 conn(0x7f77880ff7f0 msgr2=0x7f7788108770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:09.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 shutdown_connections 2024-04-23T14:48:09.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:09.314+0000 7f778f000640 1 -- 172.21.15.7:0/2792997965 wait complete. 2024-04-23T14:48:09.332 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:09 smithi007 podman[66535]: 2024-04-23 14:48:09.012549367 +0000 UTC m=+0.434811676 container start 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:48:09.332 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:09 smithi007 ceph-mds[66592]: -- 172.21.15.7:0/2215941366 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aebed8da40 con 0x55aebed60c00 2024-04-23T14:48:09.332 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:09 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g[66568]: starting mds.g at 2024-04-23T14:48:09.332 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:09 smithi007 bash[66535]: 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 2024-04-23T14:48:09.333 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 14:48:09 smithi007 systemd[1]: Started Ceph mds.g for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:48:10.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:10.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:10.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:10.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:10.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:10 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2792997965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:10.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:10 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2792997965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:10.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:10.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:10 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2792997965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:11.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:11 smithi007 ceph-mon[27906]: Deploying daemon mds.a on smithi007 2024-04-23T14:48:11.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:11 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.7:6838/2766173942,v1:172.21.15.7:6839/2766173942] up:boot 2024-04-23T14:48:11.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:11 smithi007 ceph-mon[27906]: fsmap 10 up:standby 2024-04-23T14:48:11.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:11 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T14:48:11.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:11 smithi186 ceph-mon[31814]: Deploying daemon mds.a on smithi007 2024-04-23T14:48:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:11 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.7:6838/2766173942,v1:172.21.15.7:6839/2766173942] up:boot 2024-04-23T14:48:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:11 smithi186 ceph-mon[31814]: fsmap 10 up:standby 2024-04-23T14:48:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:11 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T14:48:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:11 smithi137 ceph-mon[31694]: Deploying daemon mds.a on smithi007 2024-04-23T14:48:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:11 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.7:6838/2766173942,v1:172.21.15.7:6839/2766173942] up:boot 2024-04-23T14:48:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:11 smithi137 ceph-mon[31694]: fsmap 10 up:standby 2024-04-23T14:48:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:11 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.564+0000 7f7dbb200640 1 -- 172.21.15.7:0/448085732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc1017d0 msgr2=0x7f7dbc101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.564+0000 7f7dbb200640 1 --2- 172.21.15.7:0/448085732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc101c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009900 tx=0x7f7da802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 -- 172.21.15.7:0/448085732 shutdown_connections 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 --2- 172.21.15.7:0/448085732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 0x7f7dbc1088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 --2- 172.21.15.7:0/448085732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc101c50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 --2- 172.21.15.7:0/448085732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 -- 172.21.15.7:0/448085732 >> 172.21.15.7:0/448085732 conn(0x7f7dbc0fb630 msgr2=0x7f7dbc0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 -- 172.21.15.7:0/448085732 shutdown_connections 2024-04-23T14:48:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.565+0000 7f7dbb200640 1 -- 172.21.15.7:0/448085732 wait complete. 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 Processor -- start 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 -- start start 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 0x7f7dbc1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc10d9e0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc10d860 con 0x7f7dbc1017d0 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.566+0000 7f7dbb200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc10db60 con 0x7f7dbc1064d0 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc19a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42066/0 (socket says 172.21.15.7:42066) 2024-04-23T14:48:11.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 -- 172.21.15.7:0/1766693842 learned_addr learned my addr 172.21.15.7:0/1766693842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9400640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7dba800640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 0x7f7dbc1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 -- 172.21.15.7:0/1766693842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 msgr2=0x7f7dbc1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 0x7f7dbc1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 -- 172.21.15.7:0/1766693842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc1017d0 msgr2=0x7f7dbc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 -- 172.21.15.7:0/1766693842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc1a1ec0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9400640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7dba800640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 0x7f7dbc1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.567+0000 7f7db9e00640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc19a2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00d770 tx=0x7f7dac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.568+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac017070 con 0x7f7dbc0684b0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.568+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7dac009c30 con 0x7f7dbc0684b0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.568+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac003d00 con 0x7f7dbc0684b0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.568+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc1a21b0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.568+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc1a26b0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.569+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc1a2910 con 0x7f7dbc0684b0 2024-04-23T14:48:11.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.571+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f7dac003ea0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.572+0000 7f7db2a00640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7da00a3c30 0x7f7da00a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.573+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7dac0cfd60 con 0x7f7dbc0684b0 2024-04-23T14:48:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.573+0000 7f7db9400640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7da00a3c30 0x7f7da00a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:11.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.574+0000 7f7db9400640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7da00a3c30 0x7f7da00a60f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7da8006010 tx=0x7f7da8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:11.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.578+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7dac09cb40 con 0x7f7dbc0684b0 2024-04-23T14:48:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.878+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dbc1a2ca0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.879+0000 7f7db2a00640 1 -- 172.21.15.7:0/1766693842 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8824 (secure 0 0 0) 0x7f7dac009de0 con 0x7f7dbc0684b0 2024-04-23T14:48:11.881 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:11.881 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 11 2024-04-23T14:48:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7da00a3c30 msgr2=0x7f7da00a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7da00a3c30 0x7f7da00a60f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7da8006010 tx=0x7f7da8000bc0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 msgr2=0x7f7dbc19a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc19a2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00d770 tx=0x7f7dac00dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 shutdown_connections 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7da00a3c30 0x7f7da00a60f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dbc1017d0 0x7f7dbc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dbc1064d0 0x7f7dbc1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 --2- 172.21.15.7:0/1766693842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7dbc0684b0 0x7f7dbc19a2a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 >> 172.21.15.7:0/1766693842 conn(0x7f7dbc0fb630 msgr2=0x7f7dbc0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 shutdown_connections 2024-04-23T14:48:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:11.883+0000 7f7dbb200640 1 -- 172.21.15.7:0/1766693842 wait complete. 2024-04-23T14:48:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:12 smithi137 ceph-mon[31694]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:12 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1766693842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:12 smithi007 ceph-mon[27906]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:12.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:12 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1766693842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:12 smithi186 ceph-mon[31814]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:12 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1766693842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:12.837 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:12 smithi007 systemd[1]: Starting Ceph mds.a for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:48:13.186 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:12 smithi007 podman[66920]: 2024-04-23 14:48:12.753486068 +0000 UTC m=+0.040685674 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:48:13.186 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:12 smithi007 podman[66920]: 2024-04-23 14:48:12.872745114 +0000 UTC m=+0.159944745 container create 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-23T14:48:13.186 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:13 smithi007 podman[66920]: 2024-04-23 14:48:13.184655794 +0000 UTC m=+0.471855448 container init 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-23T14:48:13.586 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:13 smithi007 podman[66920]: 2024-04-23 14:48:13.19581221 +0000 UTC m=+0.483011815 container start 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-23T14:48:13.586 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:13 smithi007 ceph-mds[66938]: -- 172.21.15.7:0/2877767342 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f15635a40 con 0x561f15608c00 2024-04-23T14:48:13.586 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a[66934]: starting mds.a at 2024-04-23T14:48:13.587 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:13 smithi007 bash[66920]: 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 2024-04-23T14:48:13.587 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 14:48:13 smithi007 systemd[1]: Started Ceph mds.a for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:48:13.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.134+0000 7f9159c00640 1 -- 172.21.15.7:0/2276648955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154104080 msgr2=0x7f91541044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.134+0000 7f9159c00640 1 --2- 172.21.15.7:0/2276648955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154104080 0x7f91541044a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9144009900 tx=0x7f914402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 -- 172.21.15.7:0/2276648955 shutdown_connections 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 --2- 172.21.15.7:0/2276648955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 0x7f915410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 --2- 172.21.15.7:0/2276648955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154105270 0x7f91541056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 --2- 172.21.15.7:0/2276648955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154104080 0x7f91541044a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 -- 172.21.15.7:0/2276648955 >> 172.21.15.7:0/2276648955 conn(0x7f91540ff610 msgr2=0x7f9154101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:14.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 -- 172.21.15.7:0/2276648955 shutdown_connections 2024-04-23T14:48:14.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.135+0000 7f9159c00640 1 -- 172.21.15.7:0/2276648955 wait complete. 2024-04-23T14:48:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.136+0000 7f9159c00640 1 Processor -- start 2024-04-23T14:48:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.136+0000 7f9159c00640 1 -- start start 2024-04-23T14:48:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.136+0000 7f9159c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154104080 0x7f915419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.136+0000 7f9159c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 0x7f915419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.136+0000 7f9159c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 0x7f91541a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.136+0000 7f9159c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f915410fbc0 con 0x7f9154105c30 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f9159c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f915410fa40 con 0x7f9154105270 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f9159c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f915410fd40 con 0x7f9154104080 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 0x7f915419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f9159200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 0x7f91541a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 0x7f915419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:51706/0 (socket says 172.21.15.7:51706) 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 -- 172.21.15.7:0/3509264818 learned_addr learned my addr 172.21.15.7:0/3509264818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f9153e00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154104080 0x7f915419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 -- 172.21.15.7:0/3509264818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154104080 msgr2=0x7f915419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154104080 0x7f915419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 -- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 msgr2=0x7f91541a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 0x7f91541a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f914b400640 1 -- 172.21.15.7:0/3509264818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91541a1ec0 con 0x7f9154105270 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f9153e00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154104080 0x7f915419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.137+0000 7f9159200640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 0x7f91541a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.138+0000 7f914b400640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 0x7f915419a7e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f913c00d770 tx=0x7f913c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.138+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c017070 con 0x7f9154105270 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.138+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f913c0054d0 con 0x7f9154105270 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.138+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91541a21b0 con 0x7f9154105270 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.138+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c004cf0 con 0x7f9154105270 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.138+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91541a26b0 con 0x7f9154105270 2024-04-23T14:48:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.139+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915410b420 con 0x7f9154105270 2024-04-23T14:48:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.142+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f913c004e90 con 0x7f9154105270 2024-04-23T14:48:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.143+0000 7f9151600640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f91380a3bb0 0x7f91380a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.143+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f913c0cfc30 con 0x7f9154105270 2024-04-23T14:48:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.143+0000 7f9153e00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f91380a3bb0 0x7f91380a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.144+0000 7f9153e00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f91380a3bb0 0x7f91380a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9144000c00 tx=0x7f9144032c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:14.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.148+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f913c09ca10 con 0x7f9154105270 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:14.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:14 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:14.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:14.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:14.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:14 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.396+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f915402d620 con 0x7f9154105270 2024-04-23T14:48:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.397+0000 7f9151600640 1 -- 172.21.15.7:0/3509264818 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9647 (secure 0 0 0) 0x7f913c09c310 con 0x7f9154105270 2024-04-23T14:48:14.399 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:14.399 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 12 2024-04-23T14:48:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.399+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f91380a3bb0 msgr2=0x7f91380a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.399+0000 7f9159c00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f91380a3bb0 0x7f91380a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9144000c00 tx=0x7f9144032c40 comp rx=0 tx=0).stop 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.399+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 msgr2=0x7f915419a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.399+0000 7f9159c00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 0x7f915419a7e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f913c00d770 tx=0x7f913c00dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 shutdown_connections 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f91380a3bb0 0x7f91380a6070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9154105270 0x7f915419a7e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9154105c30 0x7f91541a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 --2- 172.21.15.7:0/3509264818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9154104080 0x7f915419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 >> 172.21.15.7:0/3509264818 conn(0x7f91540ff610 msgr2=0x7f91541085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 shutdown_connections 2024-04-23T14:48:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:14.400+0000 7f9159c00640 1 -- 172.21.15.7:0/3509264818 wait complete. 2024-04-23T14:48:14.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:14.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:14.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:48:14.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:48:14.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:14 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:15.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:15 smithi007 ceph-mon[27906]: Deploying daemon mds.b on smithi137 2024-04-23T14:48:15.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:15 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.7:6840/1212403180,v1:172.21.15.7:6841/1212403180] up:boot 2024-04-23T14:48:15.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:15 smithi007 ceph-mon[27906]: fsmap 11 up:standby 2024-04-23T14:48:15.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:15 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T14:48:15.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:15 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3509264818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:15.340 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:15 smithi137 ceph-mon[31694]: Deploying daemon mds.b on smithi137 2024-04-23T14:48:15.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:15 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.7:6840/1212403180,v1:172.21.15.7:6841/1212403180] up:boot 2024-04-23T14:48:15.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:15 smithi137 ceph-mon[31694]: fsmap 11 up:standby 2024-04-23T14:48:15.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:15 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T14:48:15.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:15 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3509264818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:15 smithi186 ceph-mon[31814]: Deploying daemon mds.b on smithi137 2024-04-23T14:48:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:15 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.7:6840/1212403180,v1:172.21.15.7:6841/1212403180] up:boot 2024-04-23T14:48:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:15 smithi186 ceph-mon[31814]: fsmap 11 up:standby 2024-04-23T14:48:15.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:15 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T14:48:15.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:15 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3509264818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:16.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:16 smithi007 ceph-mon[27906]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:16.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:16 smithi186 ceph-mon[31814]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:16 smithi137 ceph-mon[31694]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:16.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 -- 172.21.15.7:0/374400664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80109670 msgr2=0x7eff80109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 --2- 172.21.15.7:0/374400664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80109670 0x7eff80109af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff68009900 tx=0x7eff6802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 -- 172.21.15.7:0/374400664 shutdown_connections 2024-04-23T14:48:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 --2- 172.21.15.7:0/374400664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff8010a030 0x7eff801108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 --2- 172.21.15.7:0/374400664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80109670 0x7eff80109af0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 --2- 172.21.15.7:0/374400664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff80108480 0x7eff801088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.643+0000 7eff7fe00640 1 -- 172.21.15.7:0/374400664 >> 172.21.15.7:0/374400664 conn(0x7eff80077440 msgr2=0x7eff80079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.644+0000 7eff7fe00640 1 -- 172.21.15.7:0/374400664 shutdown_connections 2024-04-23T14:48:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.644+0000 7eff7fe00640 1 -- 172.21.15.7:0/374400664 wait complete. 2024-04-23T14:48:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 Processor -- start 2024-04-23T14:48:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 -- start start 2024-04-23T14:48:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 0x7eff8019e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff80109670 0x7eff8019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff8010a030 0x7eff801a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff80114010 con 0x7eff80108480 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff80113e90 con 0x7eff80109670 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7eff80114190 con 0x7eff8010a030 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 0x7eff8019e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.645+0000 7eff7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 0x7eff8019e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40658/0 (socket says 172.21.15.7:40658) 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 -- 172.21.15.7:0/1958063911 learned_addr learned my addr 172.21.15.7:0/1958063911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7e000640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff80109670 0x7eff8019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7f400640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff8010a030 0x7eff801a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 -- 172.21.15.7:0/1958063911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff8010a030 msgr2=0x7eff801a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff8010a030 0x7eff801a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 -- 172.21.15.7:0/1958063911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff80109670 msgr2=0x7eff8019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff80109670 0x7eff8019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 -- 172.21.15.7:0/1958063911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff801a6220 con 0x7eff80108480 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.646+0000 7eff7ea00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 0x7eff8019e6a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff7000ccb0 tx=0x7eff7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.647+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70003b70 con 0x7eff80108480 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.647+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff7000ae50 con 0x7eff80108480 2024-04-23T14:48:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.647+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff801a6510 con 0x7eff80108480 2024-04-23T14:48:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.647+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7000f6f0 con 0x7eff80108480 2024-04-23T14:48:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.647+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff801a6a30 con 0x7eff80108480 2024-04-23T14:48:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.648+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8010f7a0 con 0x7eff80108480 2024-04-23T14:48:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.650+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7eff70004000 con 0x7eff80108480 2024-04-23T14:48:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.651+0000 7eff84a00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7eff640a3bb0 0x7eff640a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.652+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7eff700d01d0 con 0x7eff80108480 2024-04-23T14:48:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.652+0000 7eff7e000640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7eff640a3bb0 0x7eff640a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.653+0000 7eff7e000640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7eff640a3bb0 0x7eff640a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff680314e0 tx=0x7eff68005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.656+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7eff70014070 con 0x7eff80108480 2024-04-23T14:48:16.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.905+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff8002d620 con 0x7eff80108480 2024-04-23T14:48:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.906+0000 7eff84a00640 1 -- 172.21.15.7:0/1958063911 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9647 (secure 0 0 0) 0x7eff7009cfb0 con 0x7eff80108480 2024-04-23T14:48:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:16.908 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-23T14:48:16.908 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 12 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7eff640a3bb0 msgr2=0x7eff640a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7eff640a3bb0 0x7eff640a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff680314e0 tx=0x7eff68005a20 comp rx=0 tx=0).stop 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 msgr2=0x7eff8019e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 0x7eff8019e6a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff7000ccb0 tx=0x7eff7000a620 comp rx=0 tx=0).stop 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 shutdown_connections 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7eff640a3bb0 0x7eff640a6070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff80109670 0x7eff8019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff8010a030 0x7eff801a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 --2- 172.21.15.7:0/1958063911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff80108480 0x7eff8019e6a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 >> 172.21.15.7:0/1958063911 conn(0x7eff80077440 msgr2=0x7eff8010c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 shutdown_connections 2024-04-23T14:48:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:16.909+0000 7eff7fe00640 1 -- 172.21.15.7:0/1958063911 wait complete. 2024-04-23T14:48:16.918 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:16 smithi137 systemd[1]: Starting Ceph mds.b for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T14:48:17.282 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:17 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1958063911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:17.283 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:16 smithi137 podman[61786]: 2024-04-23 14:48:16.877708057 +0000 UTC m=+0.035749022 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:48:17.283 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:16 smithi137 podman[61786]: 2024-04-23 14:48:16.994830839 +0000 UTC m=+0.152871834 container create 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS) 2024-04-23T14:48:17.283 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:17 smithi137 podman[61786]: 2024-04-23 14:48:17.282121797 +0000 UTC m=+0.440162799 container init 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:48:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:17 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1958063911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:17 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1958063911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:17.668 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:17 smithi137 podman[61786]: 2024-04-23 14:48:17.29291561 +0000 UTC m=+0.450956612 container start 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-23T14:48:17.668 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:17 smithi137 ceph-mds[61805]: -- 172.21.15.137:0/1004360748 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569af64fa40 con 0x5569af623000 2024-04-23T14:48:17.668 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: starting mds.b at 2024-04-23T14:48:17.669 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:17 smithi137 bash[61786]: 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 2024-04-23T14:48:17.669 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:17 smithi137 systemd[1]: Started Ceph mds.b for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:18 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:18 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:18 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:18.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:19.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.170+0000 7f642a800640 1 -- 172.21.15.7:0/1068572941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6424105c50 msgr2=0x7f642410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.170+0000 7f642a800640 1 --2- 172.21.15.7:0/1068572941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6424105c50 0x7f642410c4e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f641c009ca0 tx=0x7f641c02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 -- 172.21.15.7:0/1068572941 shutdown_connections 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 --2- 172.21.15.7:0/1068572941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6424105290 0x7f6424105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 --2- 172.21.15.7:0/1068572941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6424105c50 0x7f642410c4e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 --2- 172.21.15.7:0/1068572941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64241040a0 0x7f64241044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 -- 172.21.15.7:0/1068572941 >> 172.21.15.7:0/1068572941 conn(0x7f64240ff610 msgr2=0x7f6424101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 -- 172.21.15.7:0/1068572941 shutdown_connections 2024-04-23T14:48:19.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.171+0000 7f642a800640 1 -- 172.21.15.7:0/1068572941 wait complete. 2024-04-23T14:48:19.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 Processor -- start 2024-04-23T14:48:19.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 -- start start 2024-04-23T14:48:19.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 0x7f642419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6424105290 0x7f642419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6424105c50 0x7f64241a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f642410fba0 con 0x7f64241040a0 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f642410fa20 con 0x7f6424105c50 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f642a800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f642410fd20 con 0x7f6424105290 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f6429400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 0x7f642419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f6429400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 0x7f642419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40672/0 (socket says 172.21.15.7:40672) 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.172+0000 7f6429400640 1 -- 172.21.15.7:0/1802957053 learned_addr learned my addr 172.21.15.7:0/1802957053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429e00640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6424105c50 0x7f64241a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6428a00640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6424105290 0x7f642419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429400640 1 -- 172.21.15.7:0/1802957053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6424105290 msgr2=0x7f642419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429400640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6424105290 0x7f642419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429400640 1 -- 172.21.15.7:0/1802957053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6424105c50 msgr2=0x7f64241a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429400640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6424105c50 0x7f64241a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429400640 1 -- 172.21.15.7:0/1802957053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64241a1e00 con 0x7f64241040a0 2024-04-23T14:48:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.173+0000 7f6429400640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 0x7f642419a1e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f641400d770 tx=0x7f641400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:19.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.174+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414017070 con 0x7f64241040a0 2024-04-23T14:48:19.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.174+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6414009c30 con 0x7f64241040a0 2024-04-23T14:48:19.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.174+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64241a20f0 con 0x7f64241040a0 2024-04-23T14:48:19.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.174+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414003d00 con 0x7f64241040a0 2024-04-23T14:48:19.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.174+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64241a2640 con 0x7f64241040a0 2024-04-23T14:48:19.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.175+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642410b3c0 con 0x7f64241040a0 2024-04-23T14:48:19.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.177+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f6414003ea0 con 0x7f64241040a0 2024-04-23T14:48:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.178+0000 7f6422000640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f64080a3bb0 0x7f64080a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.178+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f64140cfdc0 con 0x7f64241040a0 2024-04-23T14:48:19.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.178+0000 7f6428a00640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f64080a3bb0 0x7f64080a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.179+0000 7f6428a00640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f64080a3bb0 0x7f64080a6070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6410005e10 tx=0x7f6410005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:19.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.183+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f641409cba0 con 0x7f64241040a0 2024-04-23T14:48:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] up:boot 2024-04-23T14:48:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:19 smithi007 ceph-mon[27906]: fsmap 12 up:standby 2024-04-23T14:48:19.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:19 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T14:48:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] up:boot 2024-04-23T14:48:19.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:19 smithi186 ceph-mon[31814]: fsmap 12 up:standby 2024-04-23T14:48:19.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:19 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T14:48:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] up:boot 2024-04-23T14:48:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:19 smithi137 ceph-mon[31694]: fsmap 12 up:standby 2024-04-23T14:48:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:19 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T14:48:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.436+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f642402d620 con 0x7f64241040a0 2024-04-23T14:48:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.438+0000 7f6422000640 1 -- 172.21.15.7:0/1802957053 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10473 (secure 0 0 0) 0x7f6414009de0 con 0x7f64241040a0 2024-04-23T14:48:19.440 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:19.440 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34526,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-23T14:48:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 13 2024-04-23T14:48:19.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f64080a3bb0 msgr2=0x7f64080a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f64080a3bb0 0x7f64080a6070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6410005e10 tx=0x7f6410005da0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 msgr2=0x7f642419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 0x7f642419a1e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f641400d770 tx=0x7f641400dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 shutdown_connections 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f64080a3bb0 0x7f64080a6070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6424105c50 0x7f64241a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6424105290 0x7f642419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 --2- 172.21.15.7:0/1802957053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64241040a0 0x7f642419a1e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 >> 172.21.15.7:0/1802957053 conn(0x7f64240ff610 msgr2=0x7f6424108590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 shutdown_connections 2024-04-23T14:48:19.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.441+0000 7f642a800640 1 -- 172.21.15.7:0/1802957053 wait complete. 2024-04-23T14:48:19.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:19.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 -- 172.21.15.7:0/4101143978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148105470 msgr2=0x7f01481058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 --2- 172.21.15.7:0/4101143978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148105470 0x7f01481058f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0134009900 tx=0x7f013402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:19.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 -- 172.21.15.7:0/4101143978 shutdown_connections 2024-04-23T14:48:19.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 --2- 172.21.15.7:0/4101143978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0148105e30 0x7f014810c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 --2- 172.21.15.7:0/4101143978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148105470 0x7f01481058f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 --2- 172.21.15.7:0/4101143978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0148104280 0x7f01481046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 -- 172.21.15.7:0/4101143978 >> 172.21.15.7:0/4101143978 conn(0x7f01480ff7f0 msgr2=0x7f0148101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:19.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 -- 172.21.15.7:0/4101143978 shutdown_connections 2024-04-23T14:48:19.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.664+0000 7f014d000640 1 -- 172.21.15.7:0/4101143978 wait complete. 2024-04-23T14:48:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.665+0000 7f014d000640 1 Processor -- start 2024-04-23T14:48:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.665+0000 7f014d000640 1 -- start start 2024-04-23T14:48:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f014d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 0x7f014819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f014d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0148105470 0x7f014819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f014d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0148105e30 0x7f01481a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f014d000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f014810fdc0 con 0x7f0148104280 2024-04-23T14:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f014d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f014810fc40 con 0x7f0148105e30 2024-04-23T14:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f014d000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f014810ff40 con 0x7f0148105470 2024-04-23T14:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 0x7f014819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 0x7f014819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40702/0 (socket says 172.21.15.7:40702) 2024-04-23T14:48:19.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 -- 172.21.15.7:0/1139949679 learned_addr learned my addr 172.21.15.7:0/1139949679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0146800640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0148105e30 0x7f01481a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 -- 172.21.15.7:0/1139949679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0148105470 msgr2=0x7f014819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0148105470 0x7f014819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 -- 172.21.15.7:0/1139949679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0148105e30 msgr2=0x7f01481a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0148105e30 0x7f01481a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.666+0000 7f0145e00640 1 -- 172.21.15.7:0/1139949679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01481a2090 con 0x7f0148104280 2024-04-23T14:48:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.667+0000 7f0145e00640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 0x7f014819a470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f013800e9c0 tx=0x7f013800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.667+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013800cd80 con 0x7f0148104280 2024-04-23T14:48:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.667+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01380035f0 con 0x7f0148104280 2024-04-23T14:48:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.667+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01481a2380 con 0x7f0148104280 2024-04-23T14:48:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.667+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138010690 con 0x7f0148104280 2024-04-23T14:48:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.667+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01481a28d0 con 0x7f0148104280 2024-04-23T14:48:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.668+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014810b620 con 0x7f0148104280 2024-04-23T14:48:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.670+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f01380037a0 con 0x7f0148104280 2024-04-23T14:48:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.672+0000 7f013ea00640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f012c0a3bb0 0x7f012c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.672+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f01380d04f0 con 0x7f0148104280 2024-04-23T14:48:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.672+0000 7f0145400640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f012c0a3bb0 0x7f012c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:19.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.673+0000 7f0145400640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f012c0a3bb0 0x7f012c0a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f013402a930 tx=0x7f01340314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:19.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.676+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f013809d2d0 con 0x7f0148104280 2024-04-23T14:48:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.892+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f014802d620 con 0x7f0148104280 2024-04-23T14:48:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.895+0000 7f013ea00640 1 -- 172.21.15.7:0/1139949679 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18386 (secure 0 0 0) 0x7f013809cbd0 con 0x7f0148104280 2024-04-23T14:48:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:19.898 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:47:15.452468+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f012c0a3bb0 msgr2=0x7f012c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f012c0a3bb0 0x7f012c0a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f013402a930 tx=0x7f01340314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 msgr2=0x7f014819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 0x7f014819a470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f013800e9c0 tx=0x7f013800ee80 comp rx=0 tx=0).stop 2024-04-23T14:48:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 shutdown_connections 2024-04-23T14:48:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f012c0a3bb0 0x7f012c0a6070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0148105e30 0x7f01481a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0148105470 0x7f014819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 --2- 172.21.15.7:0/1139949679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0148104280 0x7f014819a470 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 >> 172.21.15.7:0/1139949679 conn(0x7f01480ff7f0 msgr2=0x7f01481087f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 shutdown_connections 2024-04-23T14:48:19.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:19.898+0000 7f014d000640 1 -- 172.21.15.7:0/1139949679 wait complete. 2024-04-23T14:48:19.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T14:48:19.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 -- 172.21.15.7:0/3021056480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac1052c0 msgr2=0x7fd5ac1076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3021056480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac1076b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd598009900 tx=0x7fd59802a410 comp rx=0 tx=0).stop 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 -- 172.21.15.7:0/3021056480 shutdown_connections 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3021056480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac107bf0 0x7fd5ac10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3021056480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac1076b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3021056480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac102990 0x7fd5ac104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 -- 172.21.15.7:0/3021056480 >> 172.21.15.7:0/3021056480 conn(0x7fd5ac0fc3a0 msgr2=0x7fd5ac0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 -- 172.21.15.7:0/3021056480 shutdown_connections 2024-04-23T14:48:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.117+0000 7fd5ab200640 1 -- 172.21.15.7:0/3021056480 wait complete. 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.118+0000 7fd5ab200640 1 Processor -- start 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.118+0000 7fd5ab200640 1 -- start start 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.118+0000 7fd5ab200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac102990 0x7fd5ac19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5ab200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5ab200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac107bf0 0x7fd5ac1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5ab200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac10da80 con 0x7fd5ac107bf0 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5ab200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac10d900 con 0x7fd5ac1052c0 2024-04-23T14:48:20.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5ab200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac10dc00 con 0x7fd5ac102990 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac107bf0 0x7fd5ac1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5a9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac102990 0x7fd5ac19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5a9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5a9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac102990 0x7fd5ac19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:52072/0 (socket says 172.21.15.7:52072) 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.119+0000 7fd5a9e00640 1 -- 172.21.15.7:0/3410332638 learned_addr learned my addr 172.21.15.7:0/3410332638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a9400640 1 -- 172.21.15.7:0/3410332638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac102990 msgr2=0x7fd5ac19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a9400640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac102990 0x7fd5ac19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a9400640 1 -- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac107bf0 msgr2=0x7fd5ac1a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a9400640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac107bf0 0x7fd5ac1a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a9400640 1 -- 172.21.15.7:0/3410332638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ac1a1f90 con 0x7fd5ac1052c0 2024-04-23T14:48:20.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a9400640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac19a8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd598009230 tx=0x7fd598003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:20.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59803f070 con 0x7fd5ac1052c0 2024-04-23T14:48:20.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.120+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ac1a2220 con 0x7fd5ac1052c0 2024-04-23T14:48:20.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.121+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd598031c40 con 0x7fd5ac1052c0 2024-04-23T14:48:20.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.121+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598035030 con 0x7fd5ac1052c0 2024-04-23T14:48:20.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.121+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ac1a2730 con 0x7fd5ac1052c0 2024-04-23T14:48:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.122+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ac109740 con 0x7fd5ac1052c0 2024-04-23T14:48:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.124+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fd598042070 con 0x7fd5ac1052c0 2024-04-23T14:48:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.125+0000 7fd5a2a00640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5900a3bb0 0x7fd5900a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.126+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd5980f0d40 con 0x7fd5ac1052c0 2024-04-23T14:48:20.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.126+0000 7fd5a9e00640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5900a3bb0 0x7fd5900a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.126+0000 7fd5a9e00640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5900a3bb0 0x7fd5900a6070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009c90 tx=0x7fd59c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.133+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd598031df0 con 0x7fd5ac1052c0 2024-04-23T14:48:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:20 smithi007 ceph-mon[27906]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:20 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1802957053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:20 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1139949679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.349+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5ac02d820 con 0x7fd5ac1052c0 2024-04-23T14:48:20.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.350+0000 7fd5a2a00640 1 -- 172.21.15.7:0/3410332638 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fd5980bd4d0 con 0x7fd5ac1052c0 2024-04-23T14:48:20.351 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5900a3bb0 msgr2=0x7fd5900a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5900a3bb0 0x7fd5900a6070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009c90 tx=0x7fd59c005f90 comp rx=0 tx=0).stop 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac1052c0 msgr2=0x7fd5ac19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac19a8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd598009230 tx=0x7fd598003c10 comp rx=0 tx=0).stop 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 shutdown_connections 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd5900a3bb0 0x7fd5900a6070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5ac1052c0 0x7fd5ac19a8b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5ac107bf0 0x7fd5ac1a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 --2- 172.21.15.7:0/3410332638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ac102990 0x7fd5ac19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 >> 172.21.15.7:0/3410332638 conn(0x7fd5ac0fc3a0 msgr2=0x7fd5ac102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:20.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 shutdown_connections 2024-04-23T14:48:20.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.352+0000 7fd5ab200640 1 -- 172.21.15.7:0/3410332638 wait complete. 2024-04-23T14:48:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:20 smithi186 ceph-mon[31814]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:20 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1802957053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:20 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1139949679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:20.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-23T14:48:20.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:20 smithi137 ceph-mon[31694]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:20.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:20 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1802957053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:20.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:20 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1139949679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 -- 172.21.15.7:0/3687931268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed8077c00 msgr2=0x7f6ed8078060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 --2- 172.21.15.7:0/3687931268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed8077c00 0x7f6ed8078060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009900 tx=0x7f6ec402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 -- 172.21.15.7:0/3687931268 shutdown_connections 2024-04-23T14:48:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 --2- 172.21.15.7:0/3687931268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ed80785a0 0x7f6ed8078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 --2- 172.21.15.7:0/3687931268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed8077c00 0x7f6ed8078060 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 --2- 172.21.15.7:0/3687931268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ed80769c0 0x7f6ed8076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 -- 172.21.15.7:0/3687931268 >> 172.21.15.7:0/3687931268 conn(0x7f6ed80ff7f0 msgr2=0x7f6ed8101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:20.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 -- 172.21.15.7:0/3687931268 shutdown_connections 2024-04-23T14:48:20.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.558+0000 7f6ee0600640 1 -- 172.21.15.7:0/3687931268 wait complete. 2024-04-23T14:48:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.559+0000 7f6ee0600640 1 Processor -- start 2024-04-23T14:48:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 -- start start 2024-04-23T14:48:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 0x7f6ed819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ed8077c00 0x7f6ed819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ed80785a0 0x7f6ed81a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed81141e0 con 0x7f6ed80769c0 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed8114060 con 0x7f6ed8077c00 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6ee0600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed8114360 con 0x7f6ed80785a0 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6eddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 0x7f6ed819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6eddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 0x7f6ed819e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40738/0 (socket says 172.21.15.7:40738) 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6eddc00640 1 -- 172.21.15.7:0/4129640195 learned_addr learned my addr 172.21.15.7:0/4129640195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.560+0000 7f6edd200640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ed8077c00 0x7f6ed819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6ede600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ed80785a0 0x7f6ed81a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6eddc00640 1 -- 172.21.15.7:0/4129640195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ed80785a0 msgr2=0x7f6ed81a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6eddc00640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ed80785a0 0x7f6ed81a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6eddc00640 1 -- 172.21.15.7:0/4129640195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ed8077c00 msgr2=0x7f6ed819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6eddc00640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ed8077c00 0x7f6ed819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6eddc00640 1 -- 172.21.15.7:0/4129640195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed81a6490 con 0x7f6ed80769c0 2024-04-23T14:48:20.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6eddc00640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 0x7f6ed819e870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00ea60 tx=0x7f6ecc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:20.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.561+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00cde0 con 0x7f6ed80769c0 2024-04-23T14:48:20.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.562+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed81a6780 con 0x7f6ed80769c0 2024-04-23T14:48:20.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.562+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ecc0035f0 con 0x7f6ed80769c0 2024-04-23T14:48:20.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.562+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc010690 con 0x7f6ed80769c0 2024-04-23T14:48:20.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.562+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed81a6ca0 con 0x7f6ed80769c0 2024-04-23T14:48:20.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.563+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed8110db0 con 0x7f6ed80769c0 2024-04-23T14:48:20.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.565+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f6ecc0037a0 con 0x7f6ed80769c0 2024-04-23T14:48:20.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.567+0000 7f6ed6000640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ec00a3bb0 0x7f6ec00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:20.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.567+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6ecc0d0550 con 0x7f6ed80769c0 2024-04-23T14:48:20.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.567+0000 7f6edd200640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ec00a3bb0 0x7f6ec00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:20.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.568+0000 7f6edd200640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ec00a3bb0 0x7f6ec00a6070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40314e0 tx=0x7f6ec4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:20.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.573+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ecc053ff0 con 0x7f6ed80769c0 2024-04-23T14:48:20.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.838+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6ed802d620 con 0x7f6ed80769c0 2024-04-23T14:48:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.839+0000 7f6ed6000640 1 -- 172.21.15.7:0/4129640195 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f6ecc09d330 con 0x7f6ed80769c0 2024-04-23T14:48:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:20.841 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-23T14:48:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T14:48:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-23T14:48:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-23T14:48:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T14:48:20.842 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ec00a3bb0 msgr2=0x7f6ec00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ec00a3bb0 0x7f6ec00a6070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40314e0 tx=0x7f6ec4005a20 comp rx=0 tx=0).stop 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 msgr2=0x7f6ed819e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 0x7f6ed819e870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00ea60 tx=0x7f6ecc00ef20 comp rx=0 tx=0).stop 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 shutdown_connections 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6ec00a3bb0 0x7f6ec00a6070 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ed8077c00 0x7f6ed819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.842+0000 7f6ee0600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ed80785a0 0x7f6ed81a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.843+0000 7f6ee0600640 1 --2- 172.21.15.7:0/4129640195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ed80769c0 0x7f6ed819e870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.843+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 >> 172.21.15.7:0/4129640195 conn(0x7f6ed80ff7f0 msgr2=0x7f6ed8100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.843+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 shutdown_connections 2024-04-23T14:48:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:20.843+0000 7f6ee0600640 1 -- 172.21.15.7:0/4129640195 wait complete. 2024-04-23T14:48:20.865 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-23T14:48:20.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 -- 172.21.15.7:0/3959002121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc077c00 msgr2=0x7fd6bc078060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 --2- 172.21.15.7:0/3959002121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc077c00 0x7fd6bc078060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009900 tx=0x7fd6a402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 -- 172.21.15.7:0/3959002121 shutdown_connections 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 --2- 172.21.15.7:0/3959002121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 --2- 172.21.15.7:0/3959002121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc077c00 0x7fd6bc078060 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 --2- 172.21.15.7:0/3959002121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6bc0769c0 0x7fd6bc076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 -- 172.21.15.7:0/3959002121 >> 172.21.15.7:0/3959002121 conn(0x7fd6bc0ff7b0 msgr2=0x7fd6bc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 -- 172.21.15.7:0/3959002121 shutdown_connections 2024-04-23T14:48:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.060+0000 7fd6c3000640 1 -- 172.21.15.7:0/3959002121 wait complete. 2024-04-23T14:48:21.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 Processor -- start 2024-04-23T14:48:21.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 -- start start 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0769c0 0x7fd6bc19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6bc077c00 0x7fd6bc19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1141e0 con 0x7fd6bc0785a0 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc114060 con 0x7fd6bc077c00 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.061+0000 7fd6c3000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc114360 con 0x7fd6bc0769c0 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0769c0 0x7fd6bc19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6c1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc1a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40754/0 (socket says 172.21.15.7:40754) 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6c1000640 1 -- 172.21.15.7:0/2548211912 learned_addr learned my addr 172.21.15.7:0/2548211912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6b3400640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6bc077c00 0x7fd6bc19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 -- 172.21.15.7:0/2548211912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6bc077c00 msgr2=0x7fd6bc19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6bc077c00 0x7fd6bc19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 -- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 msgr2=0x7fd6bc1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc1a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 -- 172.21.15.7:0/2548211912 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc1a6490 con 0x7fd6bc0769c0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6c1000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.062+0000 7fd6bbe00640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0769c0 0x7fd6bc19e870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00e9f0 tx=0x7fd6ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.063+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00ccc0 con 0x7fd6bc0769c0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.063+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc1a6780 con 0x7fd6bc0769c0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.063+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6ac0108e0 con 0x7fd6bc0769c0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.063+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac018880 con 0x7fd6bc0769c0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.063+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc1a6cf0 con 0x7fd6bc0769c0 2024-04-23T14:48:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.064+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6bc110de0 con 0x7fd6bc0769c0 2024-04-23T14:48:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.066+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fd6ac010a90 con 0x7fd6bc0769c0 2024-04-23T14:48:21.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.068+0000 7fd6b9600640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd6a00a3bb0 0x7fd6a00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:21.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.068+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd6ac0d0320 con 0x7fd6bc0769c0 2024-04-23T14:48:21.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.068+0000 7fd6b3400640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd6a00a3bb0 0x7fd6a00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.069+0000 7fd6b3400640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd6a00a3bb0 0x7fd6a00a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40314e0 tx=0x7fd6a4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:21.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.075+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6ac09cab0 con 0x7fd6bc0769c0 2024-04-23T14:48:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:21.275+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd6bc062c00 con 0x7fd6bc0769c0 2024-04-23T14:48:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3410332638' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4129640195' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-23T14:48:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:21 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3410332638' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4129640195' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:21 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3410332638' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4129640195' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-23T14:48:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:21.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:21 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:22.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.126+0000 7fd6b9600640 1 -- 172.21.15.7:0/2548211912 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7fd6ac0a0db0 con 0x7fd6bc0769c0 2024-04-23T14:48:22.130 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-23T14:48:22.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd6a00a3bb0 msgr2=0x7fd6a00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:22.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd6a00a3bb0 0x7fd6a00a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40314e0 tx=0x7fd6a4005a20 comp rx=0 tx=0).stop 2024-04-23T14:48:22.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0769c0 msgr2=0x7fd6bc19e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0769c0 0x7fd6bc19e870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00e9f0 tx=0x7fd6ac00eeb0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 shutdown_connections 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd6a00a3bb0 0x7fd6a00a6070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6bc077c00 0x7fd6bc19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6bc0785a0 0x7fd6bc1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 --2- 172.21.15.7:0/2548211912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6bc0769c0 0x7fd6bc19e870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.133+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 >> 172.21.15.7:0/2548211912 conn(0x7fd6bc0ff7b0 msgr2=0x7fd6bc100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.134+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 shutdown_connections 2024-04-23T14:48:22.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.134+0000 7fd6c3000640 1 -- 172.21.15.7:0/2548211912 wait complete. 2024-04-23T14:48:22.160 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.360+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1027386030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41029a0 msgr2=0x7fbfd4104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.360+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1027386030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41029a0 0x7fbfd4104d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009900 tx=0x7fbfc402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1027386030 shutdown_connections 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1027386030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd41052d0 0x7fbfd41076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1027386030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd4107c00 0x7fbfd410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1027386030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41029a0 0x7fbfd4104d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1027386030 >> 172.21.15.7:0/1027386030 conn(0x7fbfd40fc3b0 msgr2=0x7fbfd40fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1027386030 shutdown_connections 2024-04-23T14:48:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.361+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1027386030 wait complete. 2024-04-23T14:48:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:22 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2548211912' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T14:48:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:22 smithi186 ceph-mon[31814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T14:48:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 Processor -- start 2024-04-23T14:48:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 -- start start 2024-04-23T14:48:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd41029a0 0x7fbfd419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 0x7fbfd419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4107c00 0x7fbfd41a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd410da60 con 0x7fbfd41052d0 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd410d8e0 con 0x7fbfd4107c00 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.362+0000 7fbfd9c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd410dbe0 con 0x7fbfd41029a0 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 0x7fbfd419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 0x7fbfd419a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40770/0 (socket says 172.21.15.7:40770) 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 -- 172.21.15.7:0/1991981832 learned_addr learned my addr 172.21.15.7:0/1991981832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfd3e00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd41029a0 0x7fbfd419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfd9200640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4107c00 0x7fbfd41a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 -- 172.21.15.7:0/1991981832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd41029a0 msgr2=0x7fbfd419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd41029a0 0x7fbfd419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 -- 172.21.15.7:0/1991981832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4107c00 msgr2=0x7fbfd41a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4107c00 0x7fbfd41a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfcbe00640 1 -- 172.21.15.7:0/1991981832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd41a1f70 con 0x7fbfd41052d0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfd3e00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd41029a0 0x7fbfd419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.363+0000 7fbfd9200640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4107c00 0x7fbfd41a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.364+0000 7fbfcbe00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 0x7fbfd419a890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00d770 tx=0x7fbfbc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.364+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc017070 con 0x7fbfd41052d0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.364+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfbc009c30 con 0x7fbfd41052d0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.364+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd41a2260 con 0x7fbfd41052d0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.364+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00f620 con 0x7fbfd41052d0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.364+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd41a27b0 con 0x7fbfd41052d0 2024-04-23T14:48:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.365+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd4109750 con 0x7fbfd41052d0 2024-04-23T14:48:22.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.368+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fbfbc01a070 con 0x7fbfd41052d0 2024-04-23T14:48:22.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.369+0000 7fbfd1600640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbfb80a3bb0 0x7fbfb80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:22.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.370+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7fbfbc0cfcf0 con 0x7fbfd41052d0 2024-04-23T14:48:22.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.370+0000 7fbfd3e00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbfb80a3bb0 0x7fbfb80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:22.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.371+0000 7fbfd3e00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbfb80a3bb0 0x7fbfb80a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40314e0 tx=0x7fbfc4032c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:22.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.373+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbfbc009de0 con 0x7fbfd41052d0 2024-04-23T14:48:22.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:22 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2548211912' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T14:48:22.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:22 smithi137 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T14:48:22.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:22 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2548211912' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T14:48:22.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:22 smithi007 ceph-mon[27906]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T14:48:22.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:22.584+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fbfd402d620 con 0x7fbfd41052d0 2024-04-23T14:48:23.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.125+0000 7fbfd1600640 1 -- 172.21.15.7:0/1991981832 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7fbfbc09c960 con 0x7fbfd41052d0 2024-04-23T14:48:23.128 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-23T14:48:23.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.130+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbfb80a3bb0 msgr2=0x7fbfb80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:23.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.130+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbfb80a3bb0 0x7fbfb80a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40314e0 tx=0x7fbfc4032c60 comp rx=0 tx=0).stop 2024-04-23T14:48:23.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.130+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 msgr2=0x7fbfd419a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:23.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.130+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 0x7fbfd419a890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00d770 tx=0x7fbfbc00dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:23.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 shutdown_connections 2024-04-23T14:48:23.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbfb80a3bb0 0x7fbfb80a6070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4107c00 0x7fbfd41a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfd41052d0 0x7fbfd419a890 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 --2- 172.21.15.7:0/1991981832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfd41029a0 0x7fbfd419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 >> 172.21.15.7:0/1991981832 conn(0x7fbfd40fc3b0 msgr2=0x7fbfd41021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 shutdown_connections 2024-04-23T14:48:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.131+0000 7fbfd9c00640 1 -- 172.21.15.7:0/1991981832 wait complete. 2024-04-23T14:48:23.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-23T14:48:23.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.355+0000 7fa67ac00640 1 -- 172.21.15.7:0/4029334012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6740769c0 msgr2=0x7fa674076de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.355+0000 7fa67ac00640 1 --2- 172.21.15.7:0/4029334012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6740769c0 0x7fa674076de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa664009900 tx=0x7fa66402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 -- 172.21.15.7:0/4029334012 shutdown_connections 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 --2- 172.21.15.7:0/4029334012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa674077c00 0x7fa674078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 --2- 172.21.15.7:0/4029334012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6740785a0 0x7fa674078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 --2- 172.21.15.7:0/4029334012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6740769c0 0x7fa674076de0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 -- 172.21.15.7:0/4029334012 >> 172.21.15.7:0/4029334012 conn(0x7fa6740ff7f0 msgr2=0x7fa674101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 -- 172.21.15.7:0/4029334012 shutdown_connections 2024-04-23T14:48:23.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.356+0000 7fa67ac00640 1 -- 172.21.15.7:0/4029334012 wait complete. 2024-04-23T14:48:23.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 Processor -- start 2024-04-23T14:48:23.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 -- start start 2024-04-23T14:48:23.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 0x7fa67419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:23.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6740785a0 0x7fa67419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:23.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6741a4060 0x7fa6741a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:23.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741141c0 con 0x7fa674077c00 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa674114040 con 0x7fa6740785a0 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa67ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa674114340 con 0x7fa6741a4060 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.357+0000 7fa673e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 0x7fa67419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 0x7fa67419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36514/0 (socket says 172.21.15.7:36514) 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 -- 172.21.15.7:0/599106554 learned_addr learned my addr 172.21.15.7:0/599106554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673400640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6740785a0 0x7fa67419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa678c00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6741a4060 0x7fa6741a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 -- 172.21.15.7:0/599106554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6741a4060 msgr2=0x7fa6741a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6741a4060 0x7fa6741a6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 -- 172.21.15.7:0/599106554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6740785a0 msgr2=0x7fa67419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6740785a0 0x7fa67419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 -- 172.21.15.7:0/599106554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6741a6ac0 con 0x7fa674077c00 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.358+0000 7fa673e00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 0x7fa67419eac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa664009230 tx=0x7fa664004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.359+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66403f030 con 0x7fa674077c00 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.359+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6741a6d50 con 0x7fa674077c00 2024-04-23T14:48:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.359+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa664003cb0 con 0x7fa674077c00 2024-04-23T14:48:23.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.359+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6741a7190 con 0x7fa674077c00 2024-04-23T14:48:23.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.359+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664049060 con 0x7fa674077c00 2024-04-23T14:48:23.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.361+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa674110bf0 con 0x7fa674077c00 2024-04-23T14:48:23.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.363+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fa664042030 con 0x7fa674077c00 2024-04-23T14:48:23.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.364+0000 7fa670c00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa6580a3bb0 0x7fa6580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:23.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.364+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7fa6640f0c30 con 0x7fa674077c00 2024-04-23T14:48:23.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.364+0000 7fa673400640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa6580a3bb0 0x7fa6580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:23.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.365+0000 7fa673400640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa6580a3bb0 0x7fa6580a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa660005fd0 tx=0x7fa660005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:23.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.369+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa6640bd720 con 0x7fa674077c00 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: osdmap e82: 12 total, 12 up, 12 in 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: pgmap v362: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1991981832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-23T14:48:23.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:23 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:23.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-23T14:48:23.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: osdmap e82: 12 total, 12 up, 12 in 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: pgmap v362: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1991981832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-23T14:48:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:23 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-23T14:48:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: osdmap e82: 12 total, 12 up, 12 in 2024-04-23T14:48:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:23.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: pgmap v362: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:23.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1991981832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-23T14:48:23.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:23 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:23.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:23.626+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa674062c70 con 0x7fa674077c00 2024-04-23T14:48:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.283+0000 7fa670c00640 1 -- 172.21.15.7:0/599106554 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa6640bd020 con 0x7fa674077c00 2024-04-23T14:48:24.285 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa6580a3bb0 msgr2=0x7fa6580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa6580a3bb0 0x7fa6580a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa660005fd0 tx=0x7fa660005850 comp rx=0 tx=0).stop 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 msgr2=0x7fa67419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 0x7fa67419eac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa664009230 tx=0x7fa664004360 comp rx=0 tx=0).stop 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 shutdown_connections 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa6580a3bb0 0x7fa6580a6070 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6740785a0 0x7fa67419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6741a4060 0x7fa6741a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 --2- 172.21.15.7:0/599106554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa674077c00 0x7fa67419eac0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 >> 172.21.15.7:0/599106554 conn(0x7fa6740ff7f0 msgr2=0x7fa674102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 shutdown_connections 2024-04-23T14:48:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.286+0000 7fa67ac00640 1 -- 172.21.15.7:0/599106554 wait complete. 2024-04-23T14:48:24.310 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-23T14:48:24.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-23T14:48:24.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:24 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1991981832' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-23T14:48:24.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:24 smithi186 ceph-mon[31814]: osdmap e83: 12 total, 12 up, 12 in 2024-04-23T14:48:24.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:24 smithi186 ceph-mon[31814]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:48:24.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:24 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/599106554' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-23T14:48:24.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:24 smithi186 ceph-mon[31814]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-23T14:48:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:24 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1991981832' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-23T14:48:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:24 smithi137 ceph-mon[31694]: osdmap e83: 12 total, 12 up, 12 in 2024-04-23T14:48:24.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:24 smithi137 ceph-mon[31694]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:48:24.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:24 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/599106554' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-23T14:48:24.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:24 smithi137 ceph-mon[31694]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-23T14:48:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 -- 172.21.15.7:0/672819423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54101f30 msgr2=0x7f3f54102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/672819423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54101f30 0x7f3f54102350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009900 tx=0x7f3f4802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 -- 172.21.15.7:0/672819423 shutdown_connections 2024-04-23T14:48:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/672819423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103080 0x7f3f54103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/672819423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f54103a40 0x7f3f5410a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/672819423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54101f30 0x7f3f54102350 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 -- 172.21.15.7:0/672819423 >> 172.21.15.7:0/672819423 conn(0x7f3f540fd4a0 msgr2=0x7f3f540ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:24.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 -- 172.21.15.7:0/672819423 shutdown_connections 2024-04-23T14:48:24.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.499+0000 7f3f5ae00640 1 -- 172.21.15.7:0/672819423 wait complete. 2024-04-23T14:48:24.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 Processor -- start 2024-04-23T14:48:24.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 -- start start 2024-04-23T14:48:24.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f54101f30 0x7f3f5419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:24.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 0x7f3f5419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103a40 0x7f3f541a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5410dae0 con 0x7f3f54103080 2024-04-23T14:48:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5410d960 con 0x7f3f54103a40 2024-04-23T14:48:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.500+0000 7f3f5ae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5410dc60 con 0x7f3f54101f30 2024-04-23T14:48:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 0x7f3f5419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 0x7f3f5419a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36526/0 (socket says 172.21.15.7:36526) 2024-04-23T14:48:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 -- 172.21.15.7:0/2289734772 learned_addr learned my addr 172.21.15.7:0/2289734772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59a00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f54101f30 0x7f3f5419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f5a400640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103a40 0x7f3f541a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 -- 172.21.15.7:0/2289734772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f54101f30 msgr2=0x7f3f5419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f54101f30 0x7f3f5419a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 -- 172.21.15.7:0/2289734772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103a40 msgr2=0x7f3f541a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103a40 0x7f3f541a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 -- 172.21.15.7:0/2289734772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f541a1fe0 con 0x7f3f54103080 2024-04-23T14:48:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f5a400640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103a40 0x7f3f541a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.501+0000 7f3f59000640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 0x7f3f5419a900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400d770 tx=0x7f3f4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.502+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44017070 con 0x7f3f54103080 2024-04-23T14:48:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.502+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f44009c30 con 0x7f3f54103080 2024-04-23T14:48:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.502+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f541a22d0 con 0x7f3f54103080 2024-04-23T14:48:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.502+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44003d00 con 0x7f3f54103080 2024-04-23T14:48:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.502+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f541a2870 con 0x7f3f54103080 2024-04-23T14:48:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.503+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f541a2ad0 con 0x7f3f54103080 2024-04-23T14:48:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.505+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f3f44003ea0 con 0x7f3f54103080 2024-04-23T14:48:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.507+0000 7f3f52000640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3f3c0a3c30 0x7f3f3c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.507+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f3f440d00b0 con 0x7f3f54103080 2024-04-23T14:48:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.507+0000 7f3f59a00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3f3c0a3c30 0x7f3f3c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.508+0000 7f3f59a00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3f3c0a3c30 0x7f3f3c0a60f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f48000c00 tx=0x7f3f480314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.510+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3f4409cbc0 con 0x7f3f54103080 2024-04-23T14:48:24.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:24 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1991981832' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-23T14:48:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:24 smithi007 ceph-mon[27906]: osdmap e83: 12 total, 12 up, 12 in 2024-04-23T14:48:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:24 smithi007 ceph-mon[27906]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:48:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:24 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/599106554' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-23T14:48:24.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:24 smithi007 ceph-mon[27906]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-23T14:48:24.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:24.731+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f3f541a2ca0 con 0x7f3f54103080 2024-04-23T14:48:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.161+0000 7f3f52000640 1 -- 172.21.15.7:0/2289734772 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f3f44009de0 con 0x7f3f54103080 2024-04-23T14:48:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3f3c0a3c30 msgr2=0x7f3f3c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:25.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3f3c0a3c30 0x7f3f3c0a60f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3f48000c00 tx=0x7f3f480314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 msgr2=0x7f3f5419a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 0x7f3f5419a900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400d770 tx=0x7f3f4400dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 shutdown_connections 2024-04-23T14:48:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3f3c0a3c30 0x7f3f3c0a60f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f54103a40 0x7f3f541a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f54103080 0x7f3f5419a900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 --2- 172.21.15.7:0/2289734772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f54101f30 0x7f3f5419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.165+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 >> 172.21.15.7:0/2289734772 conn(0x7f3f540fd4a0 msgr2=0x7f3f54074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.166+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 shutdown_connections 2024-04-23T14:48:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.166+0000 7f3f5ae00640 1 -- 172.21.15.7:0/2289734772 wait complete. 2024-04-23T14:48:25.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-23T14:48:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 -- 172.21.15.7:0/3219315684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4105e10 msgr2=0x7f49b410c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 --2- 172.21.15.7:0/3219315684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4105e10 0x7f49b410c6a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009ca0 tx=0x7f49ac02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 -- 172.21.15.7:0/3219315684 shutdown_connections 2024-04-23T14:48:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 --2- 172.21.15.7:0/3219315684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4105450 0x7f49b41058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 --2- 172.21.15.7:0/3219315684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4105e10 0x7f49b410c6a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 --2- 172.21.15.7:0/3219315684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b4104260 0x7f49b4104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 -- 172.21.15.7:0/3219315684 >> 172.21.15.7:0/3219315684 conn(0x7f49b40ff7f0 msgr2=0x7f49b4101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:25.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 -- 172.21.15.7:0/3219315684 shutdown_connections 2024-04-23T14:48:25.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.388+0000 7f49b9c00640 1 -- 172.21.15.7:0/3219315684 wait complete. 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.389+0000 7f49b9c00640 1 Processor -- start 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.389+0000 7f49b9c00640 1 -- start start 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 0x7f49b419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4105450 0x7f49b419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b9c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b4105e10 0x7f49b41a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b9c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49b410fdf0 con 0x7f49b4104260 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49b410fc70 con 0x7f49b4105450 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b9c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f49b410ff70 con 0x7f49b4105e10 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 0x7f49b419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 0x7f49b419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36552/0 (socket says 172.21.15.7:36552) 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b2a00640 1 -- 172.21.15.7:0/1273409019 learned_addr learned my addr 172.21.15.7:0/1273409019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b2000640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4105450 0x7f49b419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.390+0000 7f49b3400640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b4105e10 0x7f49b41a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b2a00640 1 -- 172.21.15.7:0/1273409019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b4105e10 msgr2=0x7f49b41a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b2a00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b4105e10 0x7f49b41a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b2a00640 1 -- 172.21.15.7:0/1273409019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4105450 msgr2=0x7f49b419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b2a00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4105450 0x7f49b419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b2a00640 1 -- 172.21.15.7:0/1273409019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b41a2060 con 0x7f49b4104260 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b2a00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 0x7f49b419a440 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f49a400e9c0 tx=0x7f49a400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a400cd80 con 0x7f49b4104260 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49a40035f0 con 0x7f49b4104260 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b41a2350 con 0x7f49b4104260 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4010690 con 0x7f49b4104260 2024-04-23T14:48:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.391+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b41a28a0 con 0x7f49b4104260 2024-04-23T14:48:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.393+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b410b580 con 0x7f49b4104260 2024-04-23T14:48:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.395+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f49a40037a0 con 0x7f49b4104260 2024-04-23T14:48:25.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.397+0000 7f49ab400640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f49980a3c30 0x7f49980a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.397+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f49a40d0900 con 0x7f49b4104260 2024-04-23T14:48:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.397+0000 7f49b2000640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f49980a3c30 0x7f49980a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.398+0000 7f49b2000640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f49980a3c30 0x7f49980a60f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49b419b950 tx=0x7f49a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.402+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f49a409d250 con 0x7f49b4104260 2024-04-23T14:48:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: osdmap e84: 12 total, 12 up, 12 in 2024-04-23T14:48:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/599106554' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-23T14:48:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-23T14:48:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-23T14:48:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: pgmap v365: 97 pgs: 7 active+clean, 27 creating+peering, 63 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2289734772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-23T14:48:25.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] up:active 2024-04-23T14:48:25.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:25 smithi007 ceph-mon[27906]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: osdmap e84: 12 total, 12 up, 12 in 2024-04-23T14:48:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/599106554' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-23T14:48:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-23T14:48:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-23T14:48:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: pgmap v365: 97 pgs: 7 active+clean, 27 creating+peering, 63 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2289734772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-23T14:48:25.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] up:active 2024-04-23T14:48:25.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:25 smithi186 ceph-mon[31814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:25.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:25.619+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f49b402d620 con 0x7f49b4104260 2024-04-23T14:48:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: osdmap e84: 12 total, 12 up, 12 in 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/599106554' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: pgmap v365: 97 pgs: 7 active+clean, 27 creating+peering, 63 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2289734772' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] up:active 2024-04-23T14:48:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:25 smithi137 ceph-mon[31694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2289734772' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: osdmap e85: 12 total, 12 up, 12 in 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: Cluster is now healthy 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1273409019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:26.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:26.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:26 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2289734772' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-23T14:48:26.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: osdmap e85: 12 total, 12 up, 12 in 2024-04-23T14:48:26.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:48:26.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: Cluster is now healthy 2024-04-23T14:48:26.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1273409019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:26.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:26 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2289734772' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: osdmap e85: 12 total, 12 up, 12 in 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: Cluster is now healthy 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1273409019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:26.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:26 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:48:27.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.638+0000 7f49ab400640 1 -- 172.21.15.7:0/1273409019 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7f49a409cb50 con 0x7f49b4104260 2024-04-23T14:48:27.640 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' created 2024-04-23T14:48:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.642+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f49980a3c30 msgr2=0x7f49980a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.642+0000 7f49b9c00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f49980a3c30 0x7f49980a60f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49b419b950 tx=0x7f49a0005f90 comp rx=0 tx=0).stop 2024-04-23T14:48:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.642+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 msgr2=0x7f49b419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.642+0000 7f49b9c00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 0x7f49b419a440 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f49a400e9c0 tx=0x7f49a400ee80 comp rx=0 tx=0).stop 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 shutdown_connections 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f49980a3c30 0x7f49980a60f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b4105450 0x7f49b419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b4105e10 0x7f49b41a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 --2- 172.21.15.7:0/1273409019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b4104260 0x7f49b419a440 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 >> 172.21.15.7:0/1273409019 conn(0x7f49b40ff7f0 msgr2=0x7f49b4108750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 shutdown_connections 2024-04-23T14:48:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.643+0000 7f49b9c00640 1 -- 172.21.15.7:0/1273409019 wait complete. 2024-04-23T14:48:27.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-23T14:48:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 -- 172.21.15.7:0/144942588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494100f40 msgr2=0x7f94941013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 --2- 172.21.15.7:0/144942588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494100f40 0x7f94941013c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9480009900 tx=0x7f948002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 -- 172.21.15.7:0/144942588 shutdown_connections 2024-04-23T14:48:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 --2- 172.21.15.7:0/144942588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9494101900 0x7f94941061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 --2- 172.21.15.7:0/144942588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494100f40 0x7f94941013c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 --2- 172.21.15.7:0/144942588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94941001e0 0x7f9494100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 -- 172.21.15.7:0/144942588 >> 172.21.15.7:0/144942588 conn(0x7f94940fbb30 msgr2=0x7f94940fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 -- 172.21.15.7:0/144942588 shutdown_connections 2024-04-23T14:48:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.865+0000 7f949a000640 1 -- 172.21.15.7:0/144942588 wait complete. 2024-04-23T14:48:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.866+0000 7f949a000640 1 Processor -- start 2024-04-23T14:48:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.866+0000 7f949a000640 1 -- start start 2024-04-23T14:48:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f949a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94941001e0 0x7f949419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f949a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9494100f40 0x7f949419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f949a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 0x7f94941a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:27.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f949a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f94941140c0 con 0x7f9494101900 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f949a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9494113f40 con 0x7f94941001e0 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f949a000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9494114240 con 0x7f9494100f40 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f9499600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 0x7f94941a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f9499600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 0x7f94941a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36574/0 (socket says 172.21.15.7:36574) 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f9499600640 1 -- 172.21.15.7:0/2469427176 learned_addr learned my addr 172.21.15.7:0/2469427176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f9493e00640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9494100f40 0x7f949419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.867+0000 7f9498c00640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94941001e0 0x7f949419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9499600640 1 -- 172.21.15.7:0/2469427176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9494100f40 msgr2=0x7f949419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9499600640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9494100f40 0x7f949419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9499600640 1 -- 172.21.15.7:0/2469427176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94941001e0 msgr2=0x7f949419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9499600640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94941001e0 0x7f949419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9499600640 1 -- 172.21.15.7:0/2469427176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94941a63b0 con 0x7f9494101900 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9498c00640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94941001e0 0x7f949419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9499600640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 0x7f94941a5d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f948c00eaa0 tx=0x7f948c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:27.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c00cdb0 con 0x7f9494101900 2024-04-23T14:48:27.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f948c005020 con 0x7f9494101900 2024-04-23T14:48:27.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c0116d0 con 0x7f9494101900 2024-04-23T14:48:27.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94941a66a0 con 0x7f9494101900 2024-04-23T14:48:27.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.868+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941a6b70 con 0x7f9494101900 2024-04-23T14:48:27.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.870+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94941058a0 con 0x7f9494101900 2024-04-23T14:48:27.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.872+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f948c0051d0 con 0x7f9494101900 2024-04-23T14:48:27.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.873+0000 7f9491600640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f947c0a3bb0 0x7f947c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:27.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.873+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7f948c0d0d20 con 0x7f9494101900 2024-04-23T14:48:27.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.874+0000 7f9498c00640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f947c0a3bb0 0x7f947c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:27.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.875+0000 7f9498c00640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f947c0a3bb0 0x7f947c0a6070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9488009b40 tx=0x7f9488005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:27.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:27.877+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f948c016030 con 0x7f9494101900 2024-04-23T14:48:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:27 smithi137 ceph-mon[31694]: pgmap v367: 97 pgs: 44 active+clean, 27 creating+peering, 26 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2024-04-23T14:48:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:27 smithi137 ceph-mon[31694]: osdmap e86: 12 total, 12 up, 12 in 2024-04-23T14:48:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:27 smithi007 ceph-mon[27906]: pgmap v367: 97 pgs: 44 active+clean, 27 creating+peering, 26 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2024-04-23T14:48:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:27 smithi007 ceph-mon[27906]: osdmap e86: 12 total, 12 up, 12 in 2024-04-23T14:48:28.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.085+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f949402d620 con 0x7f9494101900 2024-04-23T14:48:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:27 smithi186 ceph-mon[31814]: pgmap v367: 97 pgs: 44 active+clean, 27 creating+peering, 26 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2024-04-23T14:48:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:27 smithi186 ceph-mon[31814]: osdmap e86: 12 total, 12 up, 12 in 2024-04-23T14:48:28.418 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:28 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: 2024-04-23T14:48:28.095+0000 7f19c8000700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-23T14:48:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.653+0000 7f9491600640 1 -- 172.21.15.7:0/2469427176 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7f948c09d480 con 0x7f9494101900 2024-04-23T14:48:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:set pool 4 allow_ec_overwrites to true 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.656+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f947c0a3bb0 msgr2=0x7f947c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.656+0000 7f949a000640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f947c0a3bb0 0x7f947c0a6070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9488009b40 tx=0x7f9488005e50 comp rx=0 tx=0).stop 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.656+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 msgr2=0x7f94941a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.656+0000 7f949a000640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 0x7f94941a5d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f948c00eaa0 tx=0x7f948c00ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 shutdown_connections 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f947c0a3bb0 0x7f947c0a6070 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9488009b40 tx=0x7f9488005e50 comp rx=0 tx=0).stop 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9494101900 0x7f94941a5d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9494100f40 0x7f949419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 --2- 172.21.15.7:0/2469427176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94941001e0 0x7f949419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 >> 172.21.15.7:0/2469427176 conn(0x7f94940fbb30 msgr2=0x7f94940fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.657+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 shutdown_connections 2024-04-23T14:48:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.658+0000 7f949a000640 1 -- 172.21.15.7:0/2469427176 wait complete. 2024-04-23T14:48:28.696 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 -- 172.21.15.7:0/523448350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c074a60 msgr2=0x7fe65c074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 --2- 172.21.15.7:0/523448350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c074a60 0x7fe65c074ee0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe648009900 tx=0x7fe64802a410 comp rx=0 tx=0).stop 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 -- 172.21.15.7:0/523448350 shutdown_connections 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 --2- 172.21.15.7:0/523448350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c109df0 0x7fe65c10c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 --2- 172.21.15.7:0/523448350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c074a60 0x7fe65c074ee0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 --2- 172.21.15.7:0/523448350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe65c076040 0x7fe65c074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 -- 172.21.15.7:0/523448350 >> 172.21.15.7:0/523448350 conn(0x7fe65c0fd4a0 msgr2=0x7fe65c0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 -- 172.21.15.7:0/523448350 shutdown_connections 2024-04-23T14:48:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.878+0000 7fe661200640 1 -- 172.21.15.7:0/523448350 wait complete. 2024-04-23T14:48:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 Processor -- start 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 -- start start 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe65c074a60 0x7fe65c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c076040 0x7fe65c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 0x7fe65c1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c10fcb0 con 0x7fe65c109df0 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c10fb30 con 0x7fe65c076040 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.879+0000 7fe661200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c10fe30 con 0x7fe65c074a60 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 0x7fe65c1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 0x7fe65c1a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36588/0 (socket says 172.21.15.7:36588) 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 -- 172.21.15.7:0/3777759910 learned_addr learned my addr 172.21.15.7:0/3777759910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65aa00640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c076040 0x7fe65c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65b400640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe65c074a60 0x7fe65c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 -- 172.21.15.7:0/3777759910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe65c074a60 msgr2=0x7fe65c19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe65c074a60 0x7fe65c19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 -- 172.21.15.7:0/3777759910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c076040 msgr2=0x7fe65c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c076040 0x7fe65c19a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.880+0000 7fe65be00640 1 -- 172.21.15.7:0/3777759910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c1a1f40 con 0x7fe65c109df0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.881+0000 7fe65be00640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 0x7fe65c1a18d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe65400eaa0 tx=0x7fe65400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.881+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65400cdb0 con 0x7fe65c109df0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.881+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c1a2230 con 0x7fe65c109df0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.881+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe654005020 con 0x7fe65c109df0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.881+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540116d0 con 0x7fe65c109df0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.881+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c1a2700 con 0x7fe65c109df0 2024-04-23T14:48:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.882+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c108b20 con 0x7fe65c109df0 2024-04-23T14:48:28.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.884+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fe6540051d0 con 0x7fe65c109df0 2024-04-23T14:48:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.885+0000 7fe653e00640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe6400a3bb0 0x7fe6400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.887+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7fe6540d0920 con 0x7fe65c109df0 2024-04-23T14:48:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.887+0000 7fe65b400640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe6400a3bb0 0x7fe6400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.887+0000 7fe65b400640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe6400a3bb0 0x7fe6400a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe64c005fd0 tx=0x7fe64c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:28.890+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe654016030 con 0x7fe65c109df0 2024-04-23T14:48:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:28 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1273409019' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-23T14:48:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:28 smithi137 ceph-mon[31694]: osdmap e87: 12 total, 12 up, 12 in 2024-04-23T14:48:28.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:28 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2469427176' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-23T14:48:29.016 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:28 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1273409019' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-23T14:48:29.016 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:28 smithi186 ceph-mon[31814]: osdmap e87: 12 total, 12 up, 12 in 2024-04-23T14:48:29.016 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:28 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2469427176' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-23T14:48:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:28 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1273409019' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-23T14:48:29.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:28 smithi007 ceph-mon[27906]: osdmap e87: 12 total, 12 up, 12 in 2024-04-23T14:48:29.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:28 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2469427176' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-23T14:48:29.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.148+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe65c062c00 con 0x7fe65c109df0 2024-04-23T14:48:29.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.662+0000 7fe653e00640 1 -- 172.21.15.7:0/3777759910 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7fe65409d080 con 0x7fe65c109df0 2024-04-23T14:48:29.663 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 4 to fsmap 2024-04-23T14:48:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe6400a3bb0 msgr2=0x7fe6400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe6400a3bb0 0x7fe6400a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe64c005fd0 tx=0x7fe64c005850 comp rx=0 tx=0).stop 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 msgr2=0x7fe65c1a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 0x7fe65c1a18d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe65400eaa0 tx=0x7fe65400ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 shutdown_connections 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe6400a3bb0 0x7fe6400a6070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65c076040 0x7fe65c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe65c109df0 0x7fe65c1a18d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.665+0000 7fe661200640 1 --2- 172.21.15.7:0/3777759910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe65c074a60 0x7fe65c19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.666+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 >> 172.21.15.7:0/3777759910 conn(0x7fe65c0fd4a0 msgr2=0x7fe65c105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.666+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 shutdown_connections 2024-04-23T14:48:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.666+0000 7fe661200640 1 -- 172.21.15.7:0/3777759910 wait complete. 2024-04-23T14:48:29.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 -- 172.21.15.7:0/3359954716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34107b60 msgr2=0x7fbd34109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 --2- 172.21.15.7:0/3359954716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34107b60 0x7fbd34109fb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009900 tx=0x7fbd2c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 -- 172.21.15.7:0/3359954716 shutdown_connections 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 --2- 172.21.15.7:0/3359954716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34107b60 0x7fbd34109fb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 --2- 172.21.15.7:0/3359954716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34105230 0x7fbd34107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 --2- 172.21.15.7:0/3359954716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 0x7fbd34104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 -- 172.21.15.7:0/3359954716 >> 172.21.15.7:0/3359954716 conn(0x7fbd340fc2d0 msgr2=0x7fbd340fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:29.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 -- 172.21.15.7:0/3359954716 shutdown_connections 2024-04-23T14:48:29.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.901+0000 7fbd33200640 1 -- 172.21.15.7:0/3359954716 wait complete. 2024-04-23T14:48:29.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.902+0000 7fbd33200640 1 Processor -- start 2024-04-23T14:48:29.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.902+0000 7fbd33200640 1 -- start start 2024-04-23T14:48:29.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.902+0000 7fbd33200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 0x7fbd34198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd33200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 0x7fbd34198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd33200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34107b60 0x7fbd3419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd33200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3410d9d0 con 0x7fbd34105230 2024-04-23T14:48:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd33200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3410d850 con 0x7fbd34102900 2024-04-23T14:48:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd33200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3410db50 con 0x7fbd34107b60 2024-04-23T14:48:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 0x7fbd34198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 0x7fbd34198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36612/0 (socket says 172.21.15.7:36612) 2024-04-23T14:48:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 -- 172.21.15.7:0/2647183164 learned_addr learned my addr 172.21.15.7:0/2647183164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31e00640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 0x7fbd34198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd32800640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34107b60 0x7fbd3419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:29.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 -- 172.21.15.7:0/2647183164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34107b60 msgr2=0x7fbd3419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34107b60 0x7fbd3419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 -- 172.21.15.7:0/2647183164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 msgr2=0x7fbd34198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 0x7fbd34198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31400640 1 -- 172.21.15.7:0/2647183164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3419fc70 con 0x7fbd34105230 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd32800640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34107b60 0x7fbd3419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.903+0000 7fbd31e00640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 0x7fbd34198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.904+0000 7fbd31400640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 0x7fbd34198590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c970 tx=0x7fbd1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.904+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c007bb0 con 0x7fbd34105230 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.904+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd1c007d50 con 0x7fbd34105230 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.904+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c018730 con 0x7fbd34105230 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.904+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3419ff60 con 0x7fbd34105230 2024-04-23T14:48:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.904+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd341a03d0 con 0x7fbd34105230 2024-04-23T14:48:29.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.906+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd340fddc0 con 0x7fbd34105230 2024-04-23T14:48:29.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.908+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fbd1c00f450 con 0x7fbd34105230 2024-04-23T14:48:29.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.909+0000 7fbd2aa00640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbd180a3c30 0x7fbd180a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:29.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.909+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fbd1c0d0710 con 0x7fbd34105230 2024-04-23T14:48:29.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.909+0000 7fbd31e00640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbd180a3c30 0x7fbd180a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:29.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.910+0000 7fbd31e00640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbd180a3c30 0x7fbd180a60f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005fd0 tx=0x7fbd24009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:29.917+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd1c014030 con 0x7fbd34105230 2024-04-23T14:48:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:29 smithi137 ceph-mon[31694]: pgmap v370: 129 pgs: 91 active+clean, 9 creating+peering, 29 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 10 op/s 2024-04-23T14:48:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:29 smithi137 ceph-mon[31694]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:48:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:29 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2469427176' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-23T14:48:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:29 smithi137 ceph-mon[31694]: osdmap e88: 12 total, 12 up, 12 in 2024-04-23T14:48:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:29 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3777759910' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-23T14:48:30.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:29 smithi186 ceph-mon[31814]: pgmap v370: 129 pgs: 91 active+clean, 9 creating+peering, 29 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 10 op/s 2024-04-23T14:48:30.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:29 smithi186 ceph-mon[31814]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:48:30.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:29 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2469427176' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-23T14:48:30.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:29 smithi186 ceph-mon[31814]: osdmap e88: 12 total, 12 up, 12 in 2024-04-23T14:48:30.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:29 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3777759910' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-23T14:48:30.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:29 smithi007 ceph-mon[27906]: pgmap v370: 129 pgs: 91 active+clean, 9 creating+peering, 29 unknown; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 10 op/s 2024-04-23T14:48:30.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:29 smithi007 ceph-mon[27906]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:48:30.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:29 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2469427176' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-23T14:48:30.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:29 smithi007 ceph-mon[27906]: osdmap e88: 12 total, 12 up, 12 in 2024-04-23T14:48:30.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:29 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3777759910' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-23T14:48:30.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.177+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd3402d620 con 0x7fbd34105230 2024-04-23T14:48:30.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.179+0000 7fbd2aa00640 1 -- 172.21.15.7:0/2647183164 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11791 (secure 0 0 0) 0x7fbd1c09ce50 con 0x7fbd34105230 2024-04-23T14:48:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:30.180 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:29.150739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34526,"qdb_cluster":[34526]},"id":1}]} 2024-04-23T14:48:30.180 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbd180a3c30 msgr2=0x7fbd180a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbd180a3c30 0x7fbd180a60f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005fd0 tx=0x7fbd24009520 comp rx=0 tx=0).stop 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 msgr2=0x7fbd34198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 0x7fbd34198590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c970 tx=0x7fbd1c00ce30 comp rx=0 tx=0).stop 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 shutdown_connections 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbd180a3c30 0x7fbd180a60f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd34107b60 0x7fbd3419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd34105230 0x7fbd34198590 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 --2- 172.21.15.7:0/2647183164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd34102900 0x7fbd34198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 >> 172.21.15.7:0/2647183164 conn(0x7fbd340fc2d0 msgr2=0x7fbd34103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:30.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 shutdown_connections 2024-04-23T14:48:30.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.183+0000 7fbd33200640 1 -- 172.21.15.7:0/2647183164 wait complete. 2024-04-23T14:48:30.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:30.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.419+0000 7fde47200640 1 -- 172.21.15.7:0/2325275155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 msgr2=0x7fde481088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.419+0000 7fde47200640 1 --2- 172.21.15.7:0/2325275155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde481088a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde38009900 tx=0x7fde3802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 -- 172.21.15.7:0/2325275155 shutdown_connections 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 --2- 172.21.15.7:0/2325275155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48109670 0x7fde48109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 --2- 172.21.15.7:0/2325275155 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 0x7fde481108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 --2- 172.21.15.7:0/2325275155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde481088a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 -- 172.21.15.7:0/2325275155 >> 172.21.15.7:0/2325275155 conn(0x7fde48077440 msgr2=0x7fde48079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 -- 172.21.15.7:0/2325275155 shutdown_connections 2024-04-23T14:48:30.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.420+0000 7fde47200640 1 -- 172.21.15.7:0/2325275155 wait complete. 2024-04-23T14:48:30.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 Processor -- start 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 -- start start 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde4819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48109670 0x7fde4819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 0x7fde481a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fde48114080 con 0x7fde48108480 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde48113f00 con 0x7fde48109670 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.421+0000 7fde47200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fde48114200 con 0x7fde4810a030 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde4819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde4819e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36632/0 (socket says 172.21.15.7:36632) 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 -- 172.21.15.7:0/375101369 learned_addr learned my addr 172.21.15.7:0/375101369 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde46800640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 0x7fde481a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 -- 172.21.15.7:0/375101369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 msgr2=0x7fde481a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45400640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48109670 0x7fde4819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 0x7fde481a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 -- 172.21.15.7:0/375101369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48109670 msgr2=0x7fde4819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48109670 0x7fde4819ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 -- 172.21.15.7:0/375101369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde481a6460 con 0x7fde48108480 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde46800640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 0x7fde481a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.422+0000 7fde45e00640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde4819e840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fde38009230 tx=0x7fde38004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.423+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3803f030 con 0x7fde48108480 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.423+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde38003cb0 con 0x7fde48108480 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.423+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde481a66f0 con 0x7fde48108480 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.423+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38035070 con 0x7fde48108480 2024-04-23T14:48:30.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.423+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde481a6cb0 con 0x7fde48108480 2024-04-23T14:48:30.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.424+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4810f8e0 con 0x7fde48108480 2024-04-23T14:48:30.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.426+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fde38042030 con 0x7fde48108480 2024-04-23T14:48:30.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.428+0000 7fde3ea00640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fde2c0a3c30 0x7fde2c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.428+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fde380f1170 con 0x7fde48108480 2024-04-23T14:48:30.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.428+0000 7fde45400640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fde2c0a3c30 0x7fde2c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.429+0000 7fde45400640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fde2c0a3c30 0x7fde2c0a60f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde4819fd50 tx=0x7fde34008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:30.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.430+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde380bd8b0 con 0x7fde48108480 2024-04-23T14:48:30.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.639+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde48062c00 con 0x7fde48108480 2024-04-23T14:48:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.644+0000 7fde3ea00640 1 -- 172.21.15.7:0/375101369 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24058 (secure 0 0 0) 0x7fde380bd1b0 con 0x7fde48108480 2024-04-23T14:48:30.645 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:30.645 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":89,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:29.150465+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:30.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fde2c0a3c30 msgr2=0x7fde2c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fde2c0a3c30 0x7fde2c0a60f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde4819fd50 tx=0x7fde34008040 comp rx=0 tx=0).stop 2024-04-23T14:48:30.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 msgr2=0x7fde4819e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde4819e840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fde38009230 tx=0x7fde38004340 comp rx=0 tx=0).stop 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 shutdown_connections 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fde2c0a3c30 0x7fde2c0a60f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48109670 0x7fde4819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde4810a030 0x7fde481a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 --2- 172.21.15.7:0/375101369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde48108480 0x7fde4819e840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.646+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 >> 172.21.15.7:0/375101369 conn(0x7fde48077440 msgr2=0x7fde4810cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.647+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 shutdown_connections 2024-04-23T14:48:30.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.647+0000 7fde47200640 1 -- 172.21.15.7:0/375101369 wait complete. 2024-04-23T14:48:30.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:30.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 -- 172.21.15.7:0/2873700096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938103ae0 msgr2=0x7f993810a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 --2- 172.21.15.7:0/2873700096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938103ae0 0x7f993810a370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9930009930 tx=0x7f993002a440 comp rx=0 tx=0).stop 2024-04-23T14:48:30.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 -- 172.21.15.7:0/2873700096 shutdown_connections 2024-04-23T14:48:30.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 --2- 172.21.15.7:0/2873700096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 0x7f99381035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 --2- 172.21.15.7:0/2873700096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938103ae0 0x7f993810a370 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 --2- 172.21.15.7:0/2873700096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9938100150 0x7f9938100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 -- 172.21.15.7:0/2873700096 >> 172.21.15.7:0/2873700096 conn(0x7f99380fba80 msgr2=0x7f99380fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:30.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 -- 172.21.15.7:0/2873700096 shutdown_connections 2024-04-23T14:48:30.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.872+0000 7f993cc00640 1 -- 172.21.15.7:0/2873700096 wait complete. 2024-04-23T14:48:30.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.873+0000 7f993cc00640 1 Processor -- start 2024-04-23T14:48:30.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.873+0000 7f993cc00640 1 -- start start 2024-04-23T14:48:30.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.873+0000 7f993cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 0x7f99381980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f993cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 0x7f99381985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f993cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9938103ae0 0x7f993819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f993cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f993810da00 con 0x7f9938100150 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f993cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f993810d880 con 0x7f9938103120 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f993cc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f993810db80 con 0x7f9938103ae0 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 0x7f99381980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 0x7f99381980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36654/0 (socket says 172.21.15.7:36654) 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 -- 172.21.15.7:0/1948963021 learned_addr learned my addr 172.21.15.7:0/1948963021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937e00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9938103ae0 0x7f993819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9936a00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 0x7f99381985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 -- 172.21.15.7:0/1948963021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9938103ae0 msgr2=0x7f993819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9938103ae0 0x7f993819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 -- 172.21.15.7:0/1948963021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 msgr2=0x7f99381985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 0x7f99381985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9937400640 1 -- 172.21.15.7:0/1948963021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993819fc80 con 0x7f9938100150 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.874+0000 7f9936a00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 0x7f99381985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.875+0000 7f9937400640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 0x7f99381980b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f992800d770 tx=0x7f992800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.875+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928017070 con 0x7f9938100150 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.875+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9928009c30 con 0x7f9938100150 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.875+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993819ff70 con 0x7f9938100150 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.875+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928003d00 con 0x7f9938100150 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.875+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99381a03d0 con 0x7f9938100150 2024-04-23T14:48:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.876+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99381092d0 con 0x7f9938100150 2024-04-23T14:48:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.878+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f9928003ea0 con 0x7f9938100150 2024-04-23T14:48:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.880+0000 7f992fe00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f991c0a3bb0 0x7f991c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.880+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f99280d0400 con 0x7f9938100150 2024-04-23T14:48:30.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.880+0000 7f9936a00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f991c0a3bb0 0x7f991c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:30.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.881+0000 7f9936a00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f991c0a3bb0 0x7f991c0a6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9938199570 tx=0x7f99240094d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:30.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:30.884+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f992809cba0 con 0x7f9938100150 2024-04-23T14:48:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:30 smithi137 ceph-mon[31694]: osdmap e89: 12 total, 12 up, 12 in 2024-04-23T14:48:30.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:30 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3777759910' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-23T14:48:30.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:30 smithi137 ceph-mon[31694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:30.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:30 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2647183164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:30.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:30 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/375101369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:30 smithi007 ceph-mon[27906]: osdmap e89: 12 total, 12 up, 12 in 2024-04-23T14:48:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3777759910' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-23T14:48:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:30 smithi007 ceph-mon[27906]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2647183164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/375101369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:31.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.096+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f993802d8d0 con 0x7f9938100150 2024-04-23T14:48:31.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.099+0000 7f992fe00640 1 -- 172.21.15.7:0/1948963021 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24058 (secure 0 0 0) 0x7f9928009de0 con 0x7f9938100150 2024-04-23T14:48:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:31.101 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":89,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:29.150465+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f991c0a3bb0 msgr2=0x7f991c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f991c0a3bb0 0x7f991c0a6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9938199570 tx=0x7f99240094d0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 msgr2=0x7f99381980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 0x7f99381980b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f992800d770 tx=0x7f992800dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 shutdown_connections 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f991c0a3bb0 0x7f991c0a6070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9938103120 0x7f99381985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9938103ae0 0x7f993819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 --2- 172.21.15.7:0/1948963021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9938100150 0x7f99381980b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 >> 172.21.15.7:0/1948963021 conn(0x7f99380fba80 msgr2=0x7f99381064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:31.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.102+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 shutdown_connections 2024-04-23T14:48:31.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.103+0000 7f993cc00640 1 -- 172.21.15.7:0/1948963021 wait complete. 2024-04-23T14:48:31.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:30 smithi186 ceph-mon[31814]: osdmap e89: 12 total, 12 up, 12 in 2024-04-23T14:48:31.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:30 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3777759910' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-23T14:48:31.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:30 smithi186 ceph-mon[31814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:31.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:30 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2647183164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:31.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:30 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/375101369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:31.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 -- 172.21.15.7:0/3234055610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4410a210 msgr2=0x7f7a44110aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 --2- 172.21.15.7:0/3234055610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4410a210 0x7f7a44110aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009ca0 tx=0x7f7a3c02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 -- 172.21.15.7:0/3234055610 shutdown_connections 2024-04-23T14:48:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 --2- 172.21.15.7:0/3234055610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4410a210 0x7f7a44110aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 --2- 172.21.15.7:0/3234055610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a44109850 0x7f7a44109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 --2- 172.21.15.7:0/3234055610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a44108660 0x7f7a44108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 -- 172.21.15.7:0/3234055610 >> 172.21.15.7:0/3234055610 conn(0x7f7a44077620 msgr2=0x7f7a44079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 -- 172.21.15.7:0/3234055610 shutdown_connections 2024-04-23T14:48:31.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.355+0000 7f7a4c000640 1 -- 172.21.15.7:0/3234055610 wait complete. 2024-04-23T14:48:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.356+0000 7f7a4c000640 1 Processor -- start 2024-04-23T14:48:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.356+0000 7f7a4c000640 1 -- start start 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4c000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a44108660 0x7f7a4419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 0x7f7a4419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4c000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4410a210 0x7f7a441a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a441141c0 con 0x7f7a44109850 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4c000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a44114040 con 0x7f7a44108660 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4c000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a44114340 con 0x7f7a4410a210 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 0x7f7a4419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 0x7f7a4419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36664/0 (socket says 172.21.15.7:36664) 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a48c00640 1 -- 172.21.15.7:0/4083370306 learned_addr learned my addr 172.21.15.7:0/4083370306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a49600640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a44108660 0x7f7a4419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a4a000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4410a210 0x7f7a441a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a48c00640 1 -- 172.21.15.7:0/4083370306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4410a210 msgr2=0x7f7a441a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a48c00640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4410a210 0x7f7a441a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.357+0000 7f7a48c00640 1 -- 172.21.15.7:0/4083370306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a44108660 msgr2=0x7f7a4419e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a48c00640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a44108660 0x7f7a4419e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a48c00640 1 -- 172.21.15.7:0/4083370306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a441a6450 con 0x7f7a44109850 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a48c00640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 0x7f7a4419ed70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d950 tx=0x7f7a3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30017070 con 0x7f7a44109850 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a30009c30 con 0x7f7a44109850 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a441a6740 con 0x7f7a44109850 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000f620 con 0x7f7a44109850 2024-04-23T14:48:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.358+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a441a6ce0 con 0x7f7a44109850 2024-04-23T14:48:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.360+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4410f980 con 0x7f7a44109850 2024-04-23T14:48:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.362+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f7a300109a0 con 0x7f7a44109850 2024-04-23T14:48:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.363+0000 7f7a42000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7a2c0a3c30 0x7f7a2c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.363+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f7a300d02a0 con 0x7f7a44109850 2024-04-23T14:48:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.363+0000 7f7a49600640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7a2c0a3c30 0x7f7a2c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.364+0000 7f7a49600640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7a2c0a3c30 0x7f7a2c0a60f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7a38005fd0 tx=0x7f7a38005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.368+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7a30009de0 con 0x7f7a44109850 2024-04-23T14:48:31.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.614+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a4402d620 con 0x7f7a44109850 2024-04-23T14:48:31.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.616+0000 7f7a42000640 1 -- 172.21.15.7:0/4083370306 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11791 (secure 0 0 0) 0x7f7a3009ca40 con 0x7f7a44109850 2024-04-23T14:48:31.617 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:31.617 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24478,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34424,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34448,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34484,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:29.150739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34526,"qdb_cluster":[34526]},"id":1}]} 2024-04-23T14:48:31.618 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 16 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7a2c0a3c30 msgr2=0x7f7a2c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7a2c0a3c30 0x7f7a2c0a60f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7a38005fd0 tx=0x7f7a38005850 comp rx=0 tx=0).stop 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 msgr2=0x7f7a4419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 0x7f7a4419ed70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d950 tx=0x7f7a3000de10 comp rx=0 tx=0).stop 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 shutdown_connections 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7a2c0a3c30 0x7f7a2c0a60f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4410a210 0x7f7a441a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a44109850 0x7f7a4419ed70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 --2- 172.21.15.7:0/4083370306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a44108660 0x7f7a4419e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 >> 172.21.15.7:0/4083370306 conn(0x7f7a44077620 msgr2=0x7f7a4410cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:31.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 shutdown_connections 2024-04-23T14:48:31.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.619+0000 7f7a4c000640 1 -- 172.21.15.7:0/4083370306 wait complete. 2024-04-23T14:48:31.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.846+0000 7f6a7ce00640 1 -- 172.21.15.7:0/3326783318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a78109670 msgr2=0x7f6a78109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.846+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/3326783318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a78109670 0x7f6a78109af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009900 tx=0x7f6a6402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 -- 172.21.15.7:0/3326783318 shutdown_connections 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/3326783318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a7810a030 0x7f6a781108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/3326783318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a78109670 0x7f6a78109af0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/3326783318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a78108480 0x7f6a781088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 -- 172.21.15.7:0/3326783318 >> 172.21.15.7:0/3326783318 conn(0x7f6a78077440 msgr2=0x7f6a78079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 -- 172.21.15.7:0/3326783318 shutdown_connections 2024-04-23T14:48:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.847+0000 7f6a7ce00640 1 -- 172.21.15.7:0/3326783318 wait complete. 2024-04-23T14:48:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 Processor -- start 2024-04-23T14:48:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 -- start start 2024-04-23T14:48:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a78108480 0x7f6a7819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a78109670 0x7f6a7819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 0x7f6a781a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78113fc0 con 0x7f6a7810a030 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78113e40 con 0x7f6a78109670 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a7ce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78114140 con 0x7f6a78108480 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 0x7f6a781a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 0x7f6a781a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36678/0 (socket says 172.21.15.7:36678) 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.848+0000 7f6a77e00640 1 -- 172.21.15.7:0/151138598 learned_addr learned my addr 172.21.15.7:0/151138598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77400640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a78108480 0x7f6a7819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77e00640 1 -- 172.21.15.7:0/151138598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a78108480 msgr2=0x7f6a7819e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77e00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a78108480 0x7f6a7819e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a76a00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a78109670 0x7f6a7819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77e00640 1 -- 172.21.15.7:0/151138598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a78109670 msgr2=0x7f6a7819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77e00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a78109670 0x7f6a7819ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77e00640 1 -- 172.21.15.7:0/151138598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a781a6270 con 0x7f6a7810a030 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a77e00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 0x7f6a781a5c00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000eaa0 tx=0x7f6a7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000cdb0 con 0x7f6a7810a030 2024-04-23T14:48:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a70005020 con 0x7f6a7810a030 2024-04-23T14:48:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a781a6560 con 0x7f6a7810a030 2024-04-23T14:48:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.849+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a700116d0 con 0x7f6a7810a030 2024-04-23T14:48:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.850+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a781a6b00 con 0x7f6a7810a030 2024-04-23T14:48:31.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.851+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7810f820 con 0x7f6a7810a030 2024-04-23T14:48:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.853+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f6a700051d0 con 0x7f6a7810a030 2024-04-23T14:48:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.854+0000 7f6a6fe00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a5c0a3c30 0x7f6a5c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.854+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f6a700d0890 con 0x7f6a7810a030 2024-04-23T14:48:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.854+0000 7f6a77400640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a5c0a3c30 0x7f6a5c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.855+0000 7f6a77400640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a5c0a3c30 0x7f6a5c0a60f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6a781094d0 tx=0x7f6a68005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:31.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:31.859+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6a70016030 con 0x7f6a7810a030 2024-04-23T14:48:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:31 smithi137 ceph-mon[31694]: pgmap v373: 129 pgs: 100 active+clean, 3 creating+peering, 26 unknown; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-23T14:48:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:31 smithi137 ceph-mon[31694]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:48:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:31 smithi137 ceph-mon[31694]: Cluster is now healthy 2024-04-23T14:48:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:31 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1948963021' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:31 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4083370306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.067+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a78062c00 con 0x7f6a7810a030 2024-04-23T14:48:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.071+0000 7f6a6fe00640 1 -- 172.21.15.7:0/151138598 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24058 (secure 0 0 0) 0x7f6a7009cfd0 con 0x7f6a7810a030 2024-04-23T14:48:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:32.072 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":89,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:29.150465+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:32.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a5c0a3c30 msgr2=0x7f6a5c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a5c0a3c30 0x7f6a5c0a60f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6a781094d0 tx=0x7f6a68005f90 comp rx=0 tx=0).stop 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 msgr2=0x7f6a781a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 0x7f6a781a5c00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000eaa0 tx=0x7f6a7000ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 shutdown_connections 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6a5c0a3c30 0x7f6a5c0a60f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a78109670 0x7f6a7819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a7810a030 0x7f6a781a5c00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 --2- 172.21.15.7:0/151138598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a78108480 0x7f6a7819e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.074+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 >> 172.21.15.7:0/151138598 conn(0x7f6a78077440 msgr2=0x7f6a7810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.075+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 shutdown_connections 2024-04-23T14:48:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.075+0000 7f6a7ce00640 1 -- 172.21.15.7:0/151138598 wait complete. 2024-04-23T14:48:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:31 smithi007 ceph-mon[27906]: pgmap v373: 129 pgs: 100 active+clean, 3 creating+peering, 26 unknown; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-23T14:48:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:31 smithi007 ceph-mon[27906]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:48:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:31 smithi007 ceph-mon[27906]: Cluster is now healthy 2024-04-23T14:48:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:31 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1948963021' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:31 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4083370306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:32.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T14:48:23.629029+0000', 'modified': '2024-04-23T14:48:29.150739+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34526': {'gid': 34526, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6839/174749197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 174749197}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 174749197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34526, 'qdb_cluster': [34526]} 2024-04-23T14:48:32.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-23T14:48:32.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T14:48:32.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:31 smithi186 ceph-mon[31814]: pgmap v373: 129 pgs: 100 active+clean, 3 creating+peering, 26 unknown; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-23T14:48:32.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:31 smithi186 ceph-mon[31814]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:48:32.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:31 smithi186 ceph-mon[31814]: Cluster is now healthy 2024-04-23T14:48:32.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:31 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1948963021' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:32.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:31 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4083370306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 -- 172.21.15.7:0/3518281337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105e10 msgr2=0x7f980010c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 --2- 172.21.15.7:0/3518281337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105e10 0x7f980010c6a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009900 tx=0x7f97f802a410 comp rx=0 tx=0).stop 2024-04-23T14:48:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 -- 172.21.15.7:0/3518281337 shutdown_connections 2024-04-23T14:48:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 --2- 172.21.15.7:0/3518281337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105e10 0x7f980010c6a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 --2- 172.21.15.7:0/3518281337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9800105450 0x7f98001058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 --2- 172.21.15.7:0/3518281337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 0x7f9800104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 -- 172.21.15.7:0/3518281337 >> 172.21.15.7:0/3518281337 conn(0x7f98000ff7b0 msgr2=0x7f9800101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 -- 172.21.15.7:0/3518281337 shutdown_connections 2024-04-23T14:48:32.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.305+0000 7f9804a00640 1 -- 172.21.15.7:0/3518281337 wait complete. 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.306+0000 7f9804a00640 1 Processor -- start 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.306+0000 7f9804a00640 1 -- start start 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f9804a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 0x7f980019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f9804a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 0x7f980019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f9804a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9800105e10 0x7f98001a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f9804a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f980010fe50 con 0x7f9800105450 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f9804a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f980010fcd0 con 0x7f9800104260 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f9804a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f980010ffd0 con 0x7f9800105e10 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 0x7f980019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 0x7f980019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36700/0 (socket says 172.21.15.7:36700) 2024-04-23T14:48:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 -- 172.21.15.7:0/774757522 learned_addr learned my addr 172.21.15.7:0/774757522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97fde00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 0x7f980019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 -- 172.21.15.7:0/774757522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9800105e10 msgr2=0x7f98001a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9800105e10 0x7f98001a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 -- 172.21.15.7:0/774757522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 msgr2=0x7f980019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 0x7f980019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97f5400640 1 -- 172.21.15.7:0/774757522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98001a20e0 con 0x7f9800105450 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.307+0000 7f97fde00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 0x7f980019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.308+0000 7f97f5400640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 0x7f980019aa00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f97e800d950 tx=0x7f97e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.308+0000 7f97f7400640 1 -- 172.21.15.7:0/774757522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8017030 con 0x7f9800105450 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.308+0000 7f97f7400640 1 -- 172.21.15.7:0/774757522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97e8004020 con 0x7f9800105450 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.308+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98001a23d0 con 0x7f9800105450 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.308+0000 7f97f7400640 1 -- 172.21.15.7:0/774757522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80047a0 con 0x7f9800105450 2024-04-23T14:48:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.308+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98001a2970 con 0x7f9800105450 2024-04-23T14:48:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.311+0000 7f980782c740 1 Processor -- start 2024-04-23T14:48:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.311+0000 7f97f7400640 1 -- 172.21.15.7:0/774757522 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f97e80041d0 con 0x7f9800105450 2024-04-23T14:48:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 -- start start 2024-04-23T14:48:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768faa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768faf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e768f0fb10 con 0x55e768fafbf0 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e768eb62b0 con 0x55e768faa090 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f980782c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e768f0bad0 con 0x55e768faaa80 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f97f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f97f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36704/0 (socket says 172.21.15.7:36704) 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.312+0000 7f97f5400640 1 -- 172.21.15.7:0/113527019 learned_addr learned my addr 172.21.15.7:0/113527019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97fe800640 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768faa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97fde00640 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768faf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97f5400640 1 -- 172.21.15.7:0/113527019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 msgr2=0x55e768faf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97f5400640 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768faf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97f5400640 1 -- 172.21.15.7:0/113527019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 msgr2=0x55e768faa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97f5400640 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768faa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97f5400640 1 -- 172.21.15.7:0/113527019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e768c222d0 con 0x55e768fafbf0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.313+0000 7f97f5400640 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb2080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d8290 tx=0x7f97e80d8750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca8e3b4f559396f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.314+0000 7f97f7400640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f97e40a3c30 0x7f97e40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.314+0000 7f97ef000640 1 -- 172.21.15.7:0/113527019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80e3070 con 0x55e768fafbf0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.314+0000 7f97fe800640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f97e40a3c30 0x7f97e40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.314+0000 7f97f7400640 1 -- 172.21.15.7:0/774757522 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f97e80d0210 con 0x7f9800105450 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.314+0000 7f97ef000640 1 -- 172.21.15.7:0/113527019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97e8017bb0 con 0x55e768fafbf0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.314+0000 7f97ef000640 1 -- 172.21.15.7:0/113527019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e809c020 con 0x55e768fafbf0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 -- 172.21.15.7:0/113527019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 msgr2=0x55e768fb2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f97fe800640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f97e40a3c30 0x7f97e40a60f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97f8005730 tx=0x7f97f80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb2080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d8290 tx=0x7f97e80d8750 comp rx=0 tx=0).stop 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 -- 172.21.15.7:0/113527019 shutdown_connections 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb2080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768faf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 --2- 172.21.15.7:0/113527019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768faa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 -- 172.21.15.7:0/113527019 >> 172.21.15.7:0/113527019 conn(0x55e768fa5700 msgr2=0x55e768fa5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 -- 172.21.15.7:0/113527019 shutdown_connections 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 -- 172.21.15.7:0/113527019 wait complete. 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.315+0000 7f980782c740 1 -- start start 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 Processor -- start 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 0x55e768fb4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768fafbf0 0x55e768fbbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e768fb2ba0 con 0x55e768faaa80 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e768ec9590 con 0x55e768faa090 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e768fb2d20 con 0x55e768fafbf0 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f980782c740 10 client.0 _ll_register_callbacks cb 0x55e768eac3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f97f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 0x55e768fb4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f97f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 0x55e768fb4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36706/0 (socket says 172.21.15.7:36706) 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.316+0000 7f97f5400640 1 -- 172.21.15.7:0/2605506347 learned_addr learned my addr 172.21.15.7:0/2605506347 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97fe800640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768fafbf0 0x55e768fbbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97fde00640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97f5400640 1 -- 172.21.15.7:0/2605506347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768fafbf0 msgr2=0x55e768fbbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97f5400640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768fafbf0 0x55e768fbbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97f5400640 1 -- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 msgr2=0x55e768fb4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97f5400640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97f5400640 1 -- 172.21.15.7:0/2605506347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e768cec6b0 con 0x55e768faaa80 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97fe800640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768fafbf0 0x55e768fbbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97fde00640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97f5400640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 0x55e768fb4a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d8260 tx=0x7f97e8009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b974c923deb25bd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97e3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97e3400640 1 -- 172.21.15.7:0/2605506347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80d3d40 con 0x55e768faaa80 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f97e3400640 1 -- 172.21.15.7:0/2605506347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f97e80cdb80 con 0x55e768faaa80 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.317+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e8017bb0 con 0x55e768faaa80 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f97e3400640 1 -- 172.21.15.7:0/2605506347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f97e809bbb0 con 0x55e768faaa80 2024-04-23T14:48:32.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 10 client.14763 fetch_fsmap learned FSMap version 16 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55e768fb2ba0 con 0x55e768faaa80 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f97e3400640 1 -- 172.21.15.7:0/2605506347 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97e8017bb0 con 0x55e768faaa80 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f97e3400640 1 -- 172.21.15.7:0/2605506347 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 16) ==== 8342+0+0 (secure 0 0 0) 0x7f97e80988c0 con 0x55e768faaa80 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 10 client.14763 fetch_fsmap finished waiting for FSMap version 16 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 10 client.14763 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 20 client.14763 populate_metadata read hostname 'smithi007' 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e768fc0f90 0x55e768fc2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 4 client.14763 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.318+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e768f1d530 con 0x55e768fc0f90 2024-04-23T14:48:32.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.319+0000 7f97fde00640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e768fc0f90 0x55e768fc2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.320+0000 7f97fde00640 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e768fc0f90 0x55e768fc2400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=461b206e2570f84e server_cookie=8f9d12cf6409fd56 in_seq=0 out_seq=0 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.320+0000 7f97e3400640 10 client.14763 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f97e3400640 1 -- 172.21.15.7:0/2605506347 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e768f1d530 con 0x55e768fc0f90 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f97e3400640 10 client.14763 handle_command_reply: tid=0 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 client.14763 shutdown 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 msgr2=0x55e768fb4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 0x55e768fb4a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d8260 tx=0x7f97e8009740 comp rx=0 tx=0).stop 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 shutdown_connections 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e768fc0f90 0x55e768fc2400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768fafbf0 0x55e768fbbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faaa80 0x55e768fb4a90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 --2- 172.21.15.7:0/2605506347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f97e3400640 0 client.14763 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:48:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.322+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 >> 172.21.15.7:0/2605506347 conn(0x55e768fa5700 msgr2=0x55e768fa48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.323+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 shutdown_connections 2024-04-23T14:48:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.323+0000 7f980782c740 1 -- 172.21.15.7:0/2605506347 wait complete. 2024-04-23T14:48:32.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.323+0000 7f980782c740 20 client.14763 trim_cache size 0 max 16384 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.342+0000 7f980782c740 1 Processor -- start 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 -- start start 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fbba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e768fc0740 con 0x55e768fafbf0 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e768fc0e10 con 0x55e768faa090 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f980782c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e768fc14e0 con 0x55e768faaa80 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f97fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f97fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36710/0 (socket says 172.21.15.7:36710) 2024-04-23T14:48:32.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f97fe800640 1 -- 172.21.15.7:0/1110038155 learned_addr learned my addr 172.21.15.7:0/1110038155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:32.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f97f5400640 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fbba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.343+0000 7f97fde00640 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fe800640 1 -- 172.21.15.7:0/1110038155 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 msgr2=0x55e768fbba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fe800640 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fbba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fe800640 1 -- 172.21.15.7:0/1110038155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 msgr2=0x55e768fb4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fe800640 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fe800640 1 -- 172.21.15.7:0/1110038155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e768f96e20 con 0x55e768fafbf0 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fde00640 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.344+0000 7f97fe800640 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb4a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009900 tx=0x7f97f803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5007daee274e6b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f97ee600640 1 -- 172.21.15.7:0/1110038155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f804d070 con 0x55e768fafbf0 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f97ee600640 1 -- 172.21.15.7:0/1110038155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97f8005540 con 0x55e768fafbf0 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f97ee600640 1 -- 172.21.15.7:0/1110038155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8035040 con 0x55e768fafbf0 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 -- 172.21.15.7:0/1110038155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 msgr2=0x55e768fb4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb4a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009900 tx=0x7f97f803d000 comp rx=0 tx=0).stop 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 -- 172.21.15.7:0/1110038155 shutdown_connections 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768fafbf0 0x55e768fb4a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fbba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 --2- 172.21.15.7:0/1110038155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768faa090 0x55e768fb4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 -- 172.21.15.7:0/1110038155 >> 172.21.15.7:0/1110038155 conn(0x55e768fa5700 msgr2=0x55e768fabf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 -- 172.21.15.7:0/1110038155 shutdown_connections 2024-04-23T14:48:32.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.345+0000 7f980782c740 1 -- 172.21.15.7:0/1110038155 wait complete. 2024-04-23T14:48:32.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 -- start start 2024-04-23T14:48:32.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 Processor -- start 2024-04-23T14:48:32.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 0x55e768fb7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fb8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768fafbf0 0x55e768fbad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e768fc2280 con 0x55e768faa090 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e768fc1bb0 con 0x55e768fafbf0 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.346+0000 7f980782c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e768fc2950 con 0x55e768faaa80 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f980782c740 10 client.0 _ll_register_callbacks cb 0x7f97f0007660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 0x55e768fb7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 0x55e768fb7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36720/0 (socket says 172.21.15.7:36720) 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 -- 172.21.15.7:0/384572929 learned_addr learned my addr 172.21.15.7:0/384572929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 -- 172.21.15.7:0/384572929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 msgr2=0x55e768fb8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97f5400640 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fb8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fb8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 -- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768fafbf0 msgr2=0x55e768fbad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768fafbf0 0x55e768fbad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 -- 172.21.15.7:0/384572929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e768fbb360 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97fde00640 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 0x55e768fb7cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55e768faae80 tx=0x7f97f00108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ca67aead91ffe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.347+0000 7f97e3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f97e3400640 1 -- 172.21.15.7:0/384572929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f001a8c0 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f97e3400640 1 -- 172.21.15.7:0/384572929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f97f0011430 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f8005540 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f97e3400640 1 -- 172.21.15.7:0/384572929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f97f002a050 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f980782c740 10 client.14769 fetch_fsmap learned FSMap version 16 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55e76902fe60 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f97e3400640 1 -- 172.21.15.7:0/384572929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97f8005540 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f97e3400640 1 -- 172.21.15.7:0/384572929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 16) ==== 8342+0+0 (secure 0 0 0) 0x7f97f0022790 con 0x55e768faa090 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.348+0000 7f980782c740 10 client.14769 fetch_fsmap finished waiting for FSMap version 16 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.349+0000 7f980782c740 10 client.14769 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.349+0000 7f980782c740 20 client.14769 populate_metadata read hostname 'smithi007' 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.349+0000 7f980782c740 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e769034a90 0x55e7690337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.349+0000 7f980782c740 4 client.14769 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:48:32.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.349+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "status"}) -- 0x55e768f173a0 con 0x55e769034a90 2024-04-23T14:48:32.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.349+0000 7f97f5400640 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e769034a90 0x55e7690337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:32.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.350+0000 7f97f5400640 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e769034a90 0x55e7690337a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d614b1b078ec1a9a server_cookie=6239b78feda23ed in_seq=0 out_seq=0 2024-04-23T14:48:32.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.350+0000 7f97e3400640 10 client.14769 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f97e3400640 1 -- 172.21.15.7:0/384572929 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55e768f173a0 con 0x55e769034a90 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f97e3400640 10 client.14769 handle_command_reply: tid=0 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 client.14769 shutdown 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 msgr2=0x55e768fb7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 0x55e768fb7cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55e768faae80 tx=0x7f97f00108b0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 shutdown_connections 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e769034a90 0x55e7690337a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e768fafbf0 0x55e768fbad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e768faaa80 0x55e768fb8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 --2- 172.21.15.7:0/384572929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e768faa090 0x55e768fb7cc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f97e3400640 0 client.14769 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 >> 172.21.15.7:0/384572929 conn(0x55e768fa5700 msgr2=0x55e768fb4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 shutdown_connections 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 1 -- 172.21.15.7:0/384572929 wait complete. 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.351+0000 7f980782c740 20 client.14769 trim_cache size 0 max 16384 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:48:32.355 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34526, 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 8.064782246, 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 16, 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 89, 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 89, 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 15.005127673 2024-04-23T14:48:32.356 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f97e40a3c30 msgr2=0x7f97e40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f97e40a3c30 0x7f97e40a60f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f97f8005730 tx=0x7f97f80314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 msgr2=0x7f980019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 0x7f980019aa00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f97e800d950 tx=0x7f97e800de10 comp rx=0 tx=0).stop 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 shutdown_connections 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f97e40a3c30 0x7f97e40a60f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9800105e10 0x7f98001a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9800105450 0x7f980019aa00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 --2- 172.21.15.7:0/774757522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9800104260 0x7f980019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:32.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 >> 172.21.15.7:0/774757522 conn(0x7f98000ff7b0 msgr2=0x7f9800108750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:32.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 shutdown_connections 2024-04-23T14:48:32.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:32.352+0000 7f9804a00640 1 -- 172.21.15.7:0/774757522 wait complete. 2024-04-23T14:48:32.368 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T14:48:32.368 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:32.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-23T14:48:32.821 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:48:32.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:32 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/151138598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:32.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:32 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/151138598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:32 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/151138598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:33.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:33 smithi137 ceph-mon[31694]: pgmap v374: 129 pgs: 115 active+clean, 3 creating+peering, 11 unknown; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 5 op/s 2024-04-23T14:48:34.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:33 smithi007 ceph-mon[27906]: pgmap v374: 129 pgs: 115 active+clean, 3 creating+peering, 11 unknown; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 5 op/s 2024-04-23T14:48:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:33 smithi186 ceph-mon[31814]: pgmap v374: 129 pgs: 115 active+clean, 3 creating+peering, 11 unknown; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 5 op/s 2024-04-23T14:48:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 -- 172.21.15.7:0/641232298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c104e60 msgr2=0x7f738c105240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 --2- 172.21.15.7:0/641232298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c104e60 0x7f738c105240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73800099c0 tx=0x7f7380009cd0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 -- 172.21.15.7:0/641232298 shutdown_connections 2024-04-23T14:48:35.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 --2- 172.21.15.7:0/641232298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c109f40 0x7f738c111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 --2- 172.21.15.7:0/641232298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c104e60 0x7f738c105240 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 --2- 172.21.15.7:0/641232298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f738c105810 0x7f738c109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 -- 172.21.15.7:0/641232298 >> 172.21.15.7:0/641232298 conn(0x7f738c100730 msgr2=0x7f738c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 -- 172.21.15.7:0/641232298 shutdown_connections 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.016+0000 7f7391e00700 1 -- 172.21.15.7:0/641232298 wait complete. 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.018+0000 7f7391e00700 1 Processor -- start 2024-04-23T14:48:35.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.018+0000 7f7391e00700 1 -- start start 2024-04-23T14:48:35.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f738c104e60 0x7f738c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 0x7f738c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c109f40 0x7f738c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f738c114e40 con 0x7f738c105810 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f738c114cc0 con 0x7f738c109f40 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f738c114fc0 con 0x7f738c104e60 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f738be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 0x7f738c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f738be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 0x7f738c19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36932/0 (socket says 172.21.15.7:36932) 2024-04-23T14:48:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f738be00700 1 -- 172.21.15.7:0/760477540 learned_addr learned my addr 172.21.15.7:0/760477540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7391400700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c109f40 0x7f738c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.019+0000 7f7390a00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f738c104e60 0x7f738c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f738be00700 1 -- 172.21.15.7:0/760477540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f738c104e60 msgr2=0x7f738c19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f738be00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f738c104e60 0x7f738c19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f738be00700 1 -- 172.21.15.7:0/760477540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c109f40 msgr2=0x7f738c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f738be00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c109f40 0x7f738c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f738be00700 1 -- 172.21.15.7:0/760477540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c1a02b0 con 0x7f738c105810 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f738be00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 0x7f738c19b830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f737800d950 tx=0x7f737800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378017070 con 0x7f738c105810 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f737800de30 con 0x7f738c105810 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.020+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c1a05a0 con 0x7f738c105810 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.021+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378005440 con 0x7f738c105810 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.021+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1a7e20 con 0x7f738c105810 2024-04-23T14:48:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.022+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c0697e0 con 0x7f738c105810 2024-04-23T14:48:35.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.024+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f7378004750 con 0x7f738c105810 2024-04-23T14:48:35.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.025+0000 7f7389600700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73740a3cc0 0x7f73740a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.025+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f73780cfef0 con 0x7f738c105810 2024-04-23T14:48:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.025+0000 7f7390a00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73740a3cc0 0x7f73740a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.026+0000 7f7390a00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73740a3cc0 0x7f73740a6180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7380000c00 tx=0x7f7380005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.030+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f737809c630 con 0x7f738c105810 2024-04-23T14:48:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.311+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f738c02dfe0 con 0x7f738c105810 2024-04-23T14:48:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.312+0000 7f7389600700 1 -- 172.21.15.7:0/760477540 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f737809bf30 con 0x7f738c105810 2024-04-23T14:48:35.313 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.315+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73740a3cc0 msgr2=0x7f73740a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.315+0000 7f7391e00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73740a3cc0 0x7f73740a6180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7380000c00 tx=0x7f7380005fb0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.315+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 msgr2=0x7f738c19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.315+0000 7f7391e00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 0x7f738c19b830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f737800d950 tx=0x7f737800dd10 comp rx=0 tx=0).stop 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 shutdown_connections 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73740a3cc0 0x7f73740a6180 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c109f40 0x7f738c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f738c104e60 0x7f738c19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 --2- 172.21.15.7:0/760477540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f738c105810 0x7f738c19b830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 >> 172.21.15.7:0/760477540 conn(0x7f738c100730 msgr2=0x7f738c102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 shutdown_connections 2024-04-23T14:48:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:35.316+0000 7f7391e00700 1 -- 172.21.15.7:0/760477540 wait complete. 2024-04-23T14:48:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:35 smithi007 ceph-mon[27906]: pgmap v375: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 153 B/s wr, 3 op/s 2024-04-23T14:48:36.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:35 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/760477540' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:48:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:35 smithi186 ceph-mon[31814]: pgmap v375: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 153 B/s wr, 3 op/s 2024-04-23T14:48:36.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:35 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/760477540' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:48:36.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:35 smithi137 ceph-mon[31694]: pgmap v375: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 153 B/s wr, 3 op/s 2024-04-23T14:48:36.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:35 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/760477540' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T14:48:36.198 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T14:48:36.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:36.198 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-23T14:48:36.258 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T14:48:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T14:48:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T14:48:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:48:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-23T14:48:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 41655sec preferred_lft 41655sec 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:48:36.259 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:48:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-23T14:48:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-23T14:48:36.261 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T14:48:36.261 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:48:36.261 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:48:36.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-04-23T14:48:36.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-04-23T14:48:36.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-04-23T14:48:36.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T14:48:36.262 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:48:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:48:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:36.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:36.773 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T14:48:36.844 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-23T14:48:36.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:36.848 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-23T14:48:36.907 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-23T14:48:36.907 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T14:48:36.907 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-23T14:48:36.907 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-23T14:48:36.907 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T14:48:36.908 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:48:36.908 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:48:36.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T14:48:36.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T14:48:36.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T14:48:36.908 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:48:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:48:37.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:37.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:37.684 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-23T14:48:37.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:37.733 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-04-23T14:48:37.826 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:48:37.826 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:48:37.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:37.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-23T14:48:37.827 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:48:37.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:48:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:37 smithi007 ceph-mon[27906]: pgmap v376: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-04-23T14:48:38.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:38.011 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-23T14:48:38.011 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:48:38.011 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:48:38.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-23T14:48:38.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T14:48:38.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-23T14:48:38.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-23T14:48:38.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-23T14:48:38.012 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:48:38.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:48:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:37 smithi186 ceph-mon[31814]: pgmap v376: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-04-23T14:48:38.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:37 smithi137 ceph-mon[31694]: pgmap v376: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-04-23T14:48:38.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:38.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:48:38.305 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:48:38.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-23T14:48:38.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T14:48:38.305 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:48:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:48:38.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:38.511 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-23T14:48:38.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:48:38.511 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:38.552 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T14:48:38.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:48:38.552 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:38.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-23T14:48:38.755 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-23T14:48:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-23T14:48:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/edb1041492cc53ed40e205e76e13b49e4b6afd508520ebaaf3ccb4b439a8a3b1/merged 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/390f1753f42e888b02b990766a1e735ddc718fdef64cec82baeda872f3c3c79e/merged 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/a76d24e5828a340883f18f62e785b9ee880c8bf67a11f2932b770341a8955189/merged 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/ef156b56425315bc4ee396146c1b52d6f57ea2f523a669fcc757fa70c31e30b8/merged 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/3301f49788caa715f06ea8eda2a2e337aa80433db5f176af05f01591d2175596/merged 2024-04-23T14:48:38.803 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/e54c40d66c16d2ba7921c007a4d665262c9d8817c0df21172678d58f56a9d4c5/merged 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/f834b1d95f107cf8759c85cfec0b81b0ccec1ae71ca0dbb3619a12d90e7d1568/merged 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/115d204ce59696846e575fba0f441fc5a9094f3bfece0364ba698afff8a72eea/merged 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5267c3c3b73e3a40cf4bc47558bf1b51e4a7254851ffb1cd9c3592fe97e68f14/merged 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5f3fb352d11c1389bf1c07f00817a01f17fac1618e579dc39c5b154fbddbd981/merged 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:38.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:38.805 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-23T14:48:38.896 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T14:48:38.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-23T14:48:38.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-23T14:48:38.973 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-23T14:48:39.024 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-23T14:48:39.025 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/edb1041492cc53ed40e205e76e13b49e4b6afd508520ebaaf3ccb4b439a8a3b1/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/390f1753f42e888b02b990766a1e735ddc718fdef64cec82baeda872f3c3c79e/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/a76d24e5828a340883f18f62e785b9ee880c8bf67a11f2932b770341a8955189/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/ef156b56425315bc4ee396146c1b52d6f57ea2f523a669fcc757fa70c31e30b8/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/3301f49788caa715f06ea8eda2a2e337aa80433db5f176af05f01591d2175596/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/e54c40d66c16d2ba7921c007a4d665262c9d8817c0df21172678d58f56a9d4c5/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/f834b1d95f107cf8759c85cfec0b81b0ccec1ae71ca0dbb3619a12d90e7d1568/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/115d204ce59696846e575fba0f441fc5a9094f3bfece0364ba698afff8a72eea/merged 2024-04-23T14:48:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5267c3c3b73e3a40cf4bc47558bf1b51e4a7254851ffb1cd9c3592fe97e68f14/merged 2024-04-23T14:48:39.027 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5f3fb352d11c1389bf1c07f00817a01f17fac1618e579dc39c5b154fbddbd981/merged 2024-04-23T14:48:39.027 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-23T14:48:39.027 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:39.027 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:39.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:39.028 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-23T14:48:39.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:2024-04-23T14:48:39.142+0000 7f8075f22480 -1 init, newargv = 0x5621be2ab480 newargc=15 2024-04-23T14:48:39.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[69212]: starting ceph client 2024-04-23T14:48:39.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[69212]: starting fuse 2024-04-23T14:48:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:39 smithi007 ceph-mon[27906]: pgmap v377: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-04-23T14:48:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:39 smithi186 ceph-mon[31814]: pgmap v377: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-04-23T14:48:40.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:39 smithi137 ceph-mon[31694]: pgmap v377: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-04-23T14:48:40.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-23T14:48:40.270 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T14:48:40.329 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-23T14:48:40.330 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/edb1041492cc53ed40e205e76e13b49e4b6afd508520ebaaf3ccb4b439a8a3b1/merged 2024-04-23T14:48:40.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/390f1753f42e888b02b990766a1e735ddc718fdef64cec82baeda872f3c3c79e/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/a76d24e5828a340883f18f62e785b9ee880c8bf67a11f2932b770341a8955189/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/ef156b56425315bc4ee396146c1b52d6f57ea2f523a669fcc757fa70c31e30b8/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/3301f49788caa715f06ea8eda2a2e337aa80433db5f176af05f01591d2175596/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/e54c40d66c16d2ba7921c007a4d665262c9d8817c0df21172678d58f56a9d4c5/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/f834b1d95f107cf8759c85cfec0b81b0ccec1ae71ca0dbb3619a12d90e7d1568/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/115d204ce59696846e575fba0f441fc5a9094f3bfece0364ba698afff8a72eea/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5267c3c3b73e3a40cf4bc47558bf1b51e4a7254851ffb1cd9c3592fe97e68f14/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5f3fb352d11c1389bf1c07f00817a01f17fac1618e579dc39c5b154fbddbd981/merged 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:48:40.332 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:40.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:40.333 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-23T14:48:40.386 INFO:teuthology.orchestra.run.smithi007.stdout:114 2024-04-23T14:48:40.386 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo stdin-killer -- python3 -c ' 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> import re 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2024-04-23T14:48:40.387 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> return f 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.admin")) 2024-04-23T14:48:40.388 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-23T14:48:40.559 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.admin.69212.asok 2024-04-23T14:48:40.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:40.577 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.69212.asok 2024-04-23T14:48:40.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:40.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.69212.asok status 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "d44fddd910b5e94da0f2357af4be37d7bd495ae0", 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)", 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "admin", 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "69212", 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2024-04-23T14:48:40.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 14781, 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 14781 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1279724114 2024-04-23T14:48:40.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1279724114 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.14781 192.168.0.1:0/1279724114", 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/1279724114", 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 16, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 89, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2024-04-23T14:48:40.817 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:48:40.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:40.830 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2024-04-23T14:48:40.830 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:40.881 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2024-04-23T14:48:40.882 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:40.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:40.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:40.969 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-23T14:48:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:48:41.132 INFO:teuthology.orchestra.run.smithi007.stdout:# file: . 2024-04-23T14:48:41.132 INFO:teuthology.orchestra.run.smithi007.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-23T14:48:41.132 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:41.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:48:41.143 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:48:41.143 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T14:48:41.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 -- 172.21.15.7:0/1841785665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac108480 msgr2=0x7f90ac1088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 --2- 172.21.15.7:0/1841785665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac108480 0x7f90ac1088a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f909c009900 tx=0x7f909c02a410 comp rx=0 tx=0).stop 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 -- 172.21.15.7:0/1841785665 shutdown_connections 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 --2- 172.21.15.7:0/1841785665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ac10a030 0x7f90ac1108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 --2- 172.21.15.7:0/1841785665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90ac109670 0x7f90ac109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 --2- 172.21.15.7:0/1841785665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac108480 0x7f90ac1088a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 -- 172.21.15.7:0/1841785665 >> 172.21.15.7:0/1841785665 conn(0x7f90ac077440 msgr2=0x7f90ac079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 -- 172.21.15.7:0/1841785665 shutdown_connections 2024-04-23T14:48:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.405+0000 7f90abe00640 1 -- 172.21.15.7:0/1841785665 wait complete. 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.406+0000 7f90abe00640 1 Processor -- start 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.406+0000 7f90abe00640 1 -- start start 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90abe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90ac108480 0x7f90ac19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90abe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ac109670 0x7f90ac19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 0x7f90ac1a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90abe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac113fe0 con 0x7f90ac10a030 2024-04-23T14:48:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90abe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac113e60 con 0x7f90ac109670 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90abe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac114160 con 0x7f90ac108480 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90ab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 0x7f90ac1a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90ab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 0x7f90ac1a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36954/0 (socket says 172.21.15.7:36954) 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90ab400640 1 -- 172.21.15.7:0/2252889141 learned_addr learned my addr 172.21.15.7:0/2252889141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90aa000640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ac109670 0x7f90ac19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.407+0000 7f90aaa00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90ac108480 0x7f90ac19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90ab400640 1 -- 172.21.15.7:0/2252889141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90ac108480 msgr2=0x7f90ac19e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90ab400640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90ac108480 0x7f90ac19e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90ab400640 1 -- 172.21.15.7:0/2252889141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ac109670 msgr2=0x7f90ac19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90ab400640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ac109670 0x7f90ac19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90ab400640 1 -- 172.21.15.7:0/2252889141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac1a6320 con 0x7f90ac10a030 2024-04-23T14:48:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90ab400640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 0x7f90ac1a5cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f90a400d950 tx=0x7f90a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4017030 con 0x7f90ac10a030 2024-04-23T14:48:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90a4004020 con 0x7f90ac10a030 2024-04-23T14:48:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac1a6610 con 0x7f90ac10a030 2024-04-23T14:48:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4003b20 con 0x7f90ac10a030 2024-04-23T14:48:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.408+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac1a6b10 con 0x7f90ac10a030 2024-04-23T14:48:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.410+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac10f840 con 0x7f90ac10a030 2024-04-23T14:48:41.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.412+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f90a401a070 con 0x7f90ac10a030 2024-04-23T14:48:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.413+0000 7f90a3400640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f90900a3bb0 0x7f90900a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.414+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f90a40d02a0 con 0x7f90ac10a030 2024-04-23T14:48:41.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.414+0000 7f90aaa00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f90900a3bb0 0x7f90900a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.415+0000 7f90aaa00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f90900a3bb0 0x7f90900a6070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f909c006010 tx=0x7f909c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.417+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f90a4021070 con 0x7f90ac10a030 2024-04-23T14:48:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.623+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90ac02d7f0 con 0x7f90ac10a030 2024-04-23T14:48:41.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.625+0000 7f90a3400640 1 -- 172.21.15.7:0/2252889141 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24058 (secure 0 0 0) 0x7f90a409c9e0 con 0x7f90ac10a030 2024-04-23T14:48:41.626 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:41.627 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":89,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:29.150465+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f90900a3bb0 msgr2=0x7f90900a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f90900a3bb0 0x7f90900a6070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f909c006010 tx=0x7f909c0314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 msgr2=0x7f90ac1a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 0x7f90ac1a5cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f90a400d950 tx=0x7f90a400de10 comp rx=0 tx=0).stop 2024-04-23T14:48:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 shutdown_connections 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f90900a3bb0 0x7f90900a6070 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ac109670 0x7f90ac19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90ac10a030 0x7f90ac1a5cb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 --2- 172.21.15.7:0/2252889141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90ac108480 0x7f90ac19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.628+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 >> 172.21.15.7:0/2252889141 conn(0x7f90ac077440 msgr2=0x7f90ac10ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.629+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 shutdown_connections 2024-04-23T14:48:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.629+0000 7f90abe00640 1 -- 172.21.15.7:0/2252889141 wait complete. 2024-04-23T14:48:41.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:48:41.650 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:48:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 -- 172.21.15.7:0/2912082595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 msgr2=0x7f6b78074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 --2- 172.21.15.7:0/2912082595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b78074ee0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009900 tx=0x7f6b6402a400 comp rx=0 tx=0).stop 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 -- 172.21.15.7:0/2912082595 shutdown_connections 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 --2- 172.21.15.7:0/2912082595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 0x7f6b7810c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 --2- 172.21.15.7:0/2912082595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b78074ee0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 --2- 172.21.15.7:0/2912082595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b78076040 0x7f6b78074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 -- 172.21.15.7:0/2912082595 >> 172.21.15.7:0/2912082595 conn(0x7f6b780fd4a0 msgr2=0x7f6b780ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 -- 172.21.15.7:0/2912082595 shutdown_connections 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.870+0000 7f6b7d400640 1 -- 172.21.15.7:0/2912082595 wait complete. 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 Processor -- start 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 -- start start 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b7819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b78076040 0x7f6b7819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 0x7f6b781a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7810fc10 con 0x7f6b78074a60 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7810fa90 con 0x7f6b78076040 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.871+0000 7f6b7d400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7810fd90 con 0x7f6b78109dd0 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b7819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b7819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36964/0 (socket says 172.21.15.7:36964) 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 -- 172.21.15.7:0/877635511 learned_addr learned my addr 172.21.15.7:0/877635511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b7ca00640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 0x7f6b781a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b78076040 0x7f6b7819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 -- 172.21.15.7:0/877635511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 msgr2=0x7f6b781a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 0x7f6b781a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 -- 172.21.15.7:0/877635511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b78076040 msgr2=0x7f6b7819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b78076040 0x7f6b7819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b77e00640 1 -- 172.21.15.7:0/877635511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b781a1e80 con 0x7f6b78074a60 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.872+0000 7f6b7ca00640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 0x7f6b781a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.873+0000 7f6b77e00640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b7819a260 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c920 tx=0x7f6b6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.873+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68007c70 con 0x7f6b78074a60 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.873+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b781a2170 con 0x7f6b78074a60 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.873+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b68007e10 con 0x7f6b78074a60 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.873+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68018820 con 0x7f6b78074a60 2024-04-23T14:48:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.873+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b781a2710 con 0x7f6b78074a60 2024-04-23T14:48:41.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.874+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b78108b00 con 0x7f6b78074a60 2024-04-23T14:48:41.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.877+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f6b680189c0 con 0x7f6b78074a60 2024-04-23T14:48:41.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.878+0000 7f6b74c00640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6b5c0a3c30 0x7f6b5c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:41.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.878+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f6b680d0840 con 0x7f6b78074a60 2024-04-23T14:48:41.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.878+0000 7f6b77400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6b5c0a3c30 0x7f6b5c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:41.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.879+0000 7f6b77400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6b5c0a3c30 0x7f6b5c0a60f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b7819b770 tx=0x7f6b640314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:41.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:41.882+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6b68014030 con 0x7f6b78074a60 2024-04-23T14:48:41.971 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:41 smithi137 ceph-mon[31694]: pgmap v378: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:41.972 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:41 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2252889141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:41 smithi007 ceph-mon[27906]: pgmap v378: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:42.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:41 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2252889141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.092+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6b78062c00 con 0x7f6b78074a60 2024-04-23T14:48:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.093+0000 7f6b74c00640 1 -- 172.21.15.7:0/877635511 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f6b6809cf80 con 0x7f6b78074a60 2024-04-23T14:48:42.094 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:48:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6b5c0a3c30 msgr2=0x7f6b5c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6b5c0a3c30 0x7f6b5c0a60f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b7819b770 tx=0x7f6b640314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 msgr2=0x7f6b7819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b7819a260 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c920 tx=0x7f6b6800cde0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 shutdown_connections 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6b5c0a3c30 0x7f6b5c0a60f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b78076040 0x7f6b7819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b78109dd0 0x7f6b781a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.096+0000 7f6b7d400640 1 --2- 172.21.15.7:0/877635511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b78074a60 0x7f6b7819a260 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.097+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 >> 172.21.15.7:0/877635511 conn(0x7f6b780fd4a0 msgr2=0x7f6b78105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.097+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 shutdown_connections 2024-04-23T14:48:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.097+0000 7f6b7d400640 1 -- 172.21.15.7:0/877635511 wait complete. 2024-04-23T14:48:42.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:41 smithi186 ceph-mon[31814]: pgmap v378: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:48:42.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:41 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2252889141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:42.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 -- 172.21.15.7:0/4072379904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c101f30 msgr2=0x7f796c102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 --2- 172.21.15.7:0/4072379904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c101f30 0x7f796c102350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7960009900 tx=0x7f796002a410 comp rx=0 tx=0).stop 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 -- 172.21.15.7:0/4072379904 shutdown_connections 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 --2- 172.21.15.7:0/4072379904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f796c103080 0x7f796c103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 --2- 172.21.15.7:0/4072379904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c103a40 0x7f796c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 --2- 172.21.15.7:0/4072379904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c101f30 0x7f796c102350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 -- 172.21.15.7:0/4072379904 >> 172.21.15.7:0/4072379904 conn(0x7f796c0fd4a0 msgr2=0x7f796c0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 -- 172.21.15.7:0/4072379904 shutdown_connections 2024-04-23T14:48:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.336+0000 7f7972a00640 1 -- 172.21.15.7:0/4072379904 wait complete. 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.337+0000 7f7972a00640 1 Processor -- start 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.337+0000 7f7972a00640 1 -- start start 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.337+0000 7f7972a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f796c101f30 0x7f796c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.337+0000 7f7972a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c103080 0x7f796c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.337+0000 7f7972a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 0x7f796c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7972a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f796c10dae0 con 0x7f796c103a40 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7972a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f796c10d960 con 0x7f796c101f30 2024-04-23T14:48:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7972a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f796c10dc60 con 0x7f796c103080 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7972000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 0x7f796c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7971600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f796c101f30 0x7f796c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7972000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 0x7f796c1a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36982/0 (socket says 172.21.15.7:36982) 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7972000640 1 -- 172.21.15.7:0/4094060037 learned_addr learned my addr 172.21.15.7:0/4094060037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.338+0000 7f7970c00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c103080 0x7f796c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972000640 1 -- 172.21.15.7:0/4094060037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c103080 msgr2=0x7f796c19a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972000640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c103080 0x7f796c19a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972000640 1 -- 172.21.15.7:0/4094060037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f796c101f30 msgr2=0x7f796c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972000640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f796c101f30 0x7f796c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972000640 1 -- 172.21.15.7:0/4094060037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c1a1f60 con 0x7f796c103a40 2024-04-23T14:48:42.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972000640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 0x7f796c1a18f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f796400eaa0 tx=0x7f796400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:42.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796400cdb0 con 0x7f796c103a40 2024-04-23T14:48:42.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c1a2250 con 0x7f796c103a40 2024-04-23T14:48:42.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7964005020 con 0x7f796c103a40 2024-04-23T14:48:42.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.339+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640116d0 con 0x7f796c103a40 2024-04-23T14:48:42.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.340+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c1a27f0 con 0x7f796c103a40 2024-04-23T14:48:42.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.341+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796c1a2ab0 con 0x7f796c103a40 2024-04-23T14:48:42.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.343+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f79640051d0 con 0x7f796c103a40 2024-04-23T14:48:42.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.345+0000 7f796a000640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f79540a3bb0 0x7f79540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.345+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f79640d0bc0 con 0x7f796c103a40 2024-04-23T14:48:42.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.345+0000 7f7971600640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f79540a3bb0 0x7f79540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.346+0000 7f7971600640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f79540a3bb0 0x7f79540a6070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79600314e0 tx=0x7f7960005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:42.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.349+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7964016030 con 0x7f796c103a40 2024-04-23T14:48:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.555+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f796c1a2c80 con 0x7f796c103a40 2024-04-23T14:48:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.556+0000 7f796a000640 1 -- 172.21.15.7:0/4094060037 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f79640bbe20 con 0x7f796c103a40 2024-04-23T14:48:42.556 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:48:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.558+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f79540a3bb0 msgr2=0x7f79540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.558+0000 7f7972a00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f79540a3bb0 0x7f79540a6070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79600314e0 tx=0x7f7960005a20 comp rx=0 tx=0).stop 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.558+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 msgr2=0x7f796c1a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.558+0000 7f7972a00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 0x7f796c1a18f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f796400eaa0 tx=0x7f796400ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 shutdown_connections 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f79540a3bb0 0x7f79540a6070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f796c103a40 0x7f796c1a18f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c103080 0x7f796c19a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 --2- 172.21.15.7:0/4094060037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f796c101f30 0x7f796c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 >> 172.21.15.7:0/4094060037 conn(0x7f796c0fd4a0 msgr2=0x7f796c074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 shutdown_connections 2024-04-23T14:48:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.559+0000 7f7972a00640 1 -- 172.21.15.7:0/4094060037 wait complete. 2024-04-23T14:48:42.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T14:48:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.797+0000 7f177ce00640 1 -- 172.21.15.7:0/9928506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778103c00 msgr2=0x7f177810a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.797+0000 7f177ce00640 1 --2- 172.21.15.7:0/9928506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778103c00 0x7f177810a490 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1770009900 tx=0x7f177002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 -- 172.21.15.7:0/9928506 shutdown_connections 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 --2- 172.21.15.7:0/9928506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1778103240 0x7f17781036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 --2- 172.21.15.7:0/9928506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778103c00 0x7f177810a490 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 --2- 172.21.15.7:0/9928506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778102050 0x7f1778102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 -- 172.21.15.7:0/9928506 >> 172.21.15.7:0/9928506 conn(0x7f17780fd5e0 msgr2=0x7f17780ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 -- 172.21.15.7:0/9928506 shutdown_connections 2024-04-23T14:48:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.798+0000 7f177ce00640 1 -- 172.21.15.7:0/9928506 wait complete. 2024-04-23T14:48:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 Processor -- start 2024-04-23T14:48:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 -- start start 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 0x7f1778198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1778103240 0x7f17781988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778103c00 0x7f177819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f177810dcc0 con 0x7f1778102050 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f177810db40 con 0x7f1778103240 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.799+0000 7f177ce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f177810de40 con 0x7f1778103c00 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 0x7f1778198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 0x7f1778198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37010/0 (socket says 172.21.15.7:37010) 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 -- 172.21.15.7:0/828021963 learned_addr learned my addr 172.21.15.7:0/828021963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1776800640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778103c00 0x7f177819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 -- 172.21.15.7:0/828021963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778103c00 msgr2=0x7f177819f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778103c00 0x7f177819f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 -- 172.21.15.7:0/828021963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1778103240 msgr2=0x7f17781988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775400640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1778103240 0x7f17781988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1778103240 0x7f17781988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1775e00640 1 -- 172.21.15.7:0/828021963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177819ffb0 con 0x7f1778102050 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.800+0000 7f1776800640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778103c00 0x7f177819f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.801+0000 7f1775e00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 0x7f1778198390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f176000b450 tx=0x7f176000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.801+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760015020 con 0x7f1778102050 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.801+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1760011d40 con 0x7f1778102050 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.801+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176000f340 con 0x7f1778102050 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.801+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17781a02a0 con 0x7f1778102050 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.801+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17781a0820 con 0x7f1778102050 2024-04-23T14:48:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.802+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17781093f0 con 0x7f1778102050 2024-04-23T14:48:42.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.805+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f1760018020 con 0x7f1778102050 2024-04-23T14:48:42.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.807+0000 7f176ea00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f175c0a3c30 0x7f175c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.807+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f17600d0280 con 0x7f1778102050 2024-04-23T14:48:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.807+0000 7f1775400640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f175c0a3c30 0x7f175c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.808+0000 7f1775400640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f175c0a3c30 0x7f175c0a60f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17781998a0 tx=0x7f17680072f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:42.812+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f176001f020 con 0x7f1778102050 2024-04-23T14:48:42.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/877635511' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:42.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-23T14:48:42.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-04-23T14:48:42.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:42 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4094060037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.007 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/877635511' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.007 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-23T14:48:43.007 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-04-23T14:48:43.007 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-04-23T14:48:43.007 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-04-23T14:48:43.007 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-04-23T14:48:43.008 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-23T14:48:43.008 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-04-23T14:48:43.008 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-04-23T14:48:43.008 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-04-23T14:48:43.008 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-04-23T14:48:43.008 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:42 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4094060037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.016+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1778062c00 con 0x7f1778102050 2024-04-23T14:48:43.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.017+0000 7f176ea00640 1 -- 172.21.15.7:0/828021963 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f176000d040 con 0x7f1778102050 2024-04-23T14:48:43.018 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f175c0a3c30 msgr2=0x7f175c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f175c0a3c30 0x7f175c0a60f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17781998a0 tx=0x7f17680072f0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 msgr2=0x7f1778198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 0x7f1778198390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f176000b450 tx=0x7f176000b910 comp rx=0 tx=0).stop 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 shutdown_connections 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f175c0a3c30 0x7f175c0a60f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1778103240 0x7f17781988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1778103c00 0x7f177819f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 --2- 172.21.15.7:0/828021963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1778102050 0x7f1778198390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 >> 172.21.15.7:0/828021963 conn(0x7f17780fd5e0 msgr2=0x7f17781065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:43.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 shutdown_connections 2024-04-23T14:48:43.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.020+0000 7f177ce00640 1 -- 172.21.15.7:0/828021963 wait complete. 2024-04-23T14:48:43.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/877635511' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-04-23T14:48:43.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-23T14:48:43.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-04-23T14:48:43.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-04-23T14:48:43.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-04-23T14:48:43.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-04-23T14:48:43.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:42 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4094060037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 -- 172.21.15.7:0/355389210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948074a60 msgr2=0x7ff948074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 --2- 172.21.15.7:0/355389210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948074a60 0x7ff948074ee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff934009900 tx=0x7ff93402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 -- 172.21.15.7:0/355389210 shutdown_connections 2024-04-23T14:48:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 --2- 172.21.15.7:0/355389210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff948109df0 0x7ff94810c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 --2- 172.21.15.7:0/355389210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948074a60 0x7ff948074ee0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 --2- 172.21.15.7:0/355389210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff948076040 0x7ff948074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.259+0000 7ff947200640 1 -- 172.21.15.7:0/355389210 >> 172.21.15.7:0/355389210 conn(0x7ff9480fd4a0 msgr2=0x7ff9480ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.260+0000 7ff947200640 1 -- 172.21.15.7:0/355389210 shutdown_connections 2024-04-23T14:48:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.260+0000 7ff947200640 1 -- 172.21.15.7:0/355389210 wait complete. 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.261+0000 7ff947200640 1 Processor -- start 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.261+0000 7ff947200640 1 -- start start 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.261+0000 7ff947200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff948074a60 0x7ff94819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.261+0000 7ff947200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 0x7ff94819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.261+0000 7ff947200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff948109df0 0x7ff9481a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.261+0000 7ff947200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff94810fc60 con 0x7ff948076040 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff947200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff94810fae0 con 0x7ff948074a60 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff947200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff94810fde0 con 0x7ff948109df0 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 0x7ff94819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 0x7ff94819a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33380/0 (socket says 172.21.15.7:33380) 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 -- 172.21.15.7:0/1559589438 learned_addr learned my addr 172.21.15.7:0/1559589438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945e00640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff948074a60 0x7ff94819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff946800640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff948109df0 0x7ff9481a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 -- 172.21.15.7:0/1559589438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff948109df0 msgr2=0x7ff9481a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff948109df0 0x7ff9481a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 -- 172.21.15.7:0/1559589438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff948074a60 msgr2=0x7ff94819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff948074a60 0x7ff94819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.262+0000 7ff945400640 1 -- 172.21.15.7:0/1559589438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9481a1f30 con 0x7ff948076040 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.263+0000 7ff945400640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 0x7ff94819a850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff934004770 tx=0x7ff9340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.263+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93403f030 con 0x7ff948076040 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.263+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff934003cb0 con 0x7ff948076040 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.263+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9481a21c0 con 0x7ff948076040 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.263+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934035070 con 0x7ff948076040 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.263+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9481a2700 con 0x7ff948076040 2024-04-23T14:48:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.264+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff948108b20 con 0x7ff948076040 2024-04-23T14:48:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.266+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7ff934042030 con 0x7ff948076040 2024-04-23T14:48:43.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.268+0000 7ff93ea00640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff92c0a3c30 0x7ff92c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.268+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7ff9340f11b0 con 0x7ff948076040 2024-04-23T14:48:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.268+0000 7ff945e00640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff92c0a3c30 0x7ff92c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.269+0000 7ff945e00640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff92c0a3c30 0x7ff92c0a60f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff938005fd0 tx=0x7ff938005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:43.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.272+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff9340bd7d0 con 0x7ff948076040 2024-04-23T14:48:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.478+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff948062c00 con 0x7ff948076040 2024-04-23T14:48:43.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.479+0000 7ff93ea00640 1 -- 172.21.15.7:0/1559589438 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7ff9340bd0d0 con 0x7ff948076040 2024-04-23T14:48:43.480 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff92c0a3c30 msgr2=0x7ff92c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff92c0a3c30 0x7ff92c0a60f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff938005fd0 tx=0x7ff938005850 comp rx=0 tx=0).stop 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 msgr2=0x7ff94819a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 0x7ff94819a850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff934004770 tx=0x7ff9340042f0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 shutdown_connections 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff92c0a3c30 0x7ff92c0a60f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff948109df0 0x7ff9481a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff948076040 0x7ff94819a850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 --2- 172.21.15.7:0/1559589438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff948074a60 0x7ff94819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 >> 172.21.15.7:0/1559589438 conn(0x7ff9480fd4a0 msgr2=0x7ff948105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:43.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.482+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 shutdown_connections 2024-04-23T14:48:43.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.483+0000 7ff947200640 1 -- 172.21.15.7:0/1559589438 wait complete. 2024-04-23T14:48:43.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 -- 172.21.15.7:0/4071013345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220109de0 msgr2=0x7f822010c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 --2- 172.21.15.7:0/4071013345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220109de0 0x7f822010c270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8218009ca0 tx=0x7f821802a950 comp rx=0 tx=0).stop 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 -- 172.21.15.7:0/4071013345 shutdown_connections 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 --2- 172.21.15.7:0/4071013345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220109de0 0x7f822010c270 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 --2- 172.21.15.7:0/4071013345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82200749e0 0x7f8220074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 --2- 172.21.15.7:0/4071013345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220075fc0 0x7f8220074410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 -- 172.21.15.7:0/4071013345 >> 172.21.15.7:0/4071013345 conn(0x7f82200fd4a0 msgr2=0x7f82200ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 -- 172.21.15.7:0/4071013345 shutdown_connections 2024-04-23T14:48:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.711+0000 7f8226c00640 1 -- 172.21.15.7:0/4071013345 wait complete. 2024-04-23T14:48:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.712+0000 7f8226c00640 1 Processor -- start 2024-04-23T14:48:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 -- start start 2024-04-23T14:48:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82200749e0 0x7f822019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 0x7f822019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8220109de0 0x7f82201a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f822010fcd0 con 0x7f8220075fc0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f822010fb50 con 0x7f82200749e0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8226c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f822010fe50 con 0x7f8220109de0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.713+0000 7f8224e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 0x7f822019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 0x7f822019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33392/0 (socket says 172.21.15.7:33392) 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 -- 172.21.15.7:0/4170819108 learned_addr learned my addr 172.21.15.7:0/4170819108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8225800640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82200749e0 0x7f822019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8226200640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8220109de0 0x7f82201a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 -- 172.21.15.7:0/4170819108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8220109de0 msgr2=0x7f82201a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8220109de0 0x7f82201a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 -- 172.21.15.7:0/4170819108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82200749e0 msgr2=0x7f822019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82200749e0 0x7f822019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 -- 172.21.15.7:0/4170819108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82201a1ef0 con 0x7f8220075fc0 2024-04-23T14:48:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8226200640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8220109de0 0x7f82201a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:43.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.714+0000 7f8224e00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 0x7f822019a810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f821400e9f0 tx=0x7f821400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:43.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.715+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821400cd80 con 0x7f8220075fc0 2024-04-23T14:48:43.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.715+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82140054d0 con 0x7f8220075fc0 2024-04-23T14:48:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.715+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82201a21e0 con 0x7f8220075fc0 2024-04-23T14:48:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.715+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214010490 con 0x7f8220075fc0 2024-04-23T14:48:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.715+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82201a26e0 con 0x7f8220075fc0 2024-04-23T14:48:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.716+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8220108ba0 con 0x7f8220075fc0 2024-04-23T14:48:43.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.719+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f8214005020 con 0x7f8220075fc0 2024-04-23T14:48:43.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.721+0000 7f821e000640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82080a3bb0 0x7f82080a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:43.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.722+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f82140d0c90 con 0x7f8220075fc0 2024-04-23T14:48:43.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.724+0000 7f8225800640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82080a3bb0 0x7f82080a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:43.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.725+0000 7f8225800640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82080a3bb0 0x7f82080a6070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f820c005fd0 tx=0x7f820c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:43.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.728+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f821409d2b0 con 0x7f8220075fc0 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: pgmap v379: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-04-23T14:48:43.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: osdmap e90: 12 total, 12 up, 12 in 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/828021963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:43 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1559589438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:48:43.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.952+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f822002d620 con 0x7f8220075fc0 2024-04-23T14:48:43.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.953+0000 7f821e000640 1 -- 172.21.15.7:0/4170819108 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+580 (secure 0 0 0) 0x7f821409cbb0 con 0x7f8220075fc0 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/890429947 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2805710934 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/147420039 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4250737482 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3290686917 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1124398484 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:43.954 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:43.955 INFO:teuthology.orchestra.run.smithi007.stderr:listed 10 entries 2024-04-23T14:48:43.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82080a3bb0 msgr2=0x7f82080a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82080a3bb0 0x7f82080a6070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f820c005fd0 tx=0x7f820c005850 comp rx=0 tx=0).stop 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 msgr2=0x7f822019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 0x7f822019a810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f821400e9f0 tx=0x7f821400edf0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 shutdown_connections 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82080a3bb0 0x7f82080a6070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8220109de0 0x7f82201a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8220075fc0 0x7f822019a810 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 --2- 172.21.15.7:0/4170819108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82200749e0 0x7f822019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 >> 172.21.15.7:0/4170819108 conn(0x7f82200fd4a0 msgr2=0x7f8220105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 shutdown_connections 2024-04-23T14:48:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:43.956+0000 7f8226c00640 1 -- 172.21.15.7:0/4170819108 wait complete. 2024-04-23T14:48:43.974 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:48:43.974 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T14:48:44.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: pgmap v379: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-23T14:48:44.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-04-23T14:48:44.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-04-23T14:48:44.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-04-23T14:48:44.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-04-23T14:48:44.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: osdmap e90: 12 total, 12 up, 12 in 2024-04-23T14:48:44.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/828021963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:48:44.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:43 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1559589438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:48:44.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: pgmap v379: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-04-23T14:48:44.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-23T14:48:44.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-04-23T14:48:44.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-04-23T14:48:44.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-04-23T14:48:44.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: osdmap e90: 12 total, 12 up, 12 in 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/828021963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:48:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:43 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1559589438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1276915067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e68077c00 msgr2=0x7f4e68078060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1276915067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e68077c00 0x7f4e68078060 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009900 tx=0x7f4e5402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1276915067 shutdown_connections 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1276915067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e680785a0 0x7f4e68078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1276915067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e68077c00 0x7f4e68078060 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1276915067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680769c0 0x7f4e68076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1276915067 >> 172.21.15.7:0/1276915067 conn(0x7f4e680ff610 msgr2=0x7f4e68101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1276915067 shutdown_connections 2024-04-23T14:48:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.223+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1276915067 wait complete. 2024-04-23T14:48:44.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 Processor -- start 2024-04-23T14:48:44.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 -- start start 2024-04-23T14:48:44.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 0x7f4e6819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e68077c00 0x7f4e6819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e680785a0 0x7f4e681a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68114060 con 0x7f4e680769c0 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68113ee0 con 0x7f4e68077c00 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.224+0000 7f4e6dc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e681141e0 con 0x7f4e680785a0 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 0x7f4e6819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 0x7f4e6819e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33410/0 (socket says 172.21.15.7:33410) 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 -- 172.21.15.7:0/1751873225 learned_addr learned my addr 172.21.15.7:0/1751873225 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 -- 172.21.15.7:0/1751873225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e680785a0 msgr2=0x7f4e681a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e680785a0 0x7f4e681a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 -- 172.21.15.7:0/1751873225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e68077c00 msgr2=0x7f4e6819ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e68077c00 0x7f4e6819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 -- 172.21.15.7:0/1751873225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e681a6310 con 0x7f4e680769c0 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.225+0000 7f4e67e00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 0x7f4e6819e6f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800d950 tx=0x7f4e5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.226+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58017070 con 0x7f4e680769c0 2024-04-23T14:48:44.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.226+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e58009c30 con 0x7f4e680769c0 2024-04-23T14:48:44.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.226+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800f620 con 0x7f4e680769c0 2024-04-23T14:48:44.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.226+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e681a6600 con 0x7f4e680769c0 2024-04-23T14:48:44.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.226+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e681a6c20 con 0x7f4e680769c0 2024-04-23T14:48:44.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.227+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68110a10 con 0x7f4e680769c0 2024-04-23T14:48:44.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.229+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f4e580109a0 con 0x7f4e680769c0 2024-04-23T14:48:44.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.230+0000 7f4e64c00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4e4c0a3c30 0x7f4e4c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.231+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f4e580d0420 con 0x7f4e680769c0 2024-04-23T14:48:44.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.231+0000 7f4e67400640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4e4c0a3c30 0x7f4e4c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:44.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.232+0000 7f4e67400640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4e4c0a3c30 0x7f4e4c0a60f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009230 tx=0x7f4e540314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:44.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.235+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e58009de0 con 0x7f4e680769c0 2024-04-23T14:48:44.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.443+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e68062ca0 con 0x7f4e680769c0 2024-04-23T14:48:44.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.446+0000 7f4e64c00640 1 -- 172.21.15.7:0/1751873225 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24527 (secure 0 0 0) 0x7f4e58081fe0 con 0x7f4e680769c0 2024-04-23T14:48:44.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:44.447 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:43.702260+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4e4c0a3c30 msgr2=0x7f4e4c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4e4c0a3c30 0x7f4e4c0a60f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009230 tx=0x7f4e540314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 msgr2=0x7f4e6819e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 0x7f4e6819e6f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800d950 tx=0x7f4e5800de10 comp rx=0 tx=0).stop 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 shutdown_connections 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4e4c0a3c30 0x7f4e4c0a60f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e68077c00 0x7f4e6819ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e680785a0 0x7f4e681a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 --2- 172.21.15.7:0/1751873225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e680769c0 0x7f4e6819e6f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.449+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 >> 172.21.15.7:0/1751873225 conn(0x7f4e680ff610 msgr2=0x7f4e68101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.450+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 shutdown_connections 2024-04-23T14:48:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.450+0000 7f4e6dc00640 1 -- 172.21.15.7:0/1751873225 wait complete. 2024-04-23T14:48:44.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:48:44.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:48:44.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 -- 172.21.15.7:0/541767438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 msgr2=0x7fc9dc074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 --2- 172.21.15.7:0/541767438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc074490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009ca0 tx=0x7fc9cc02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 -- 172.21.15.7:0/541767438 shutdown_connections 2024-04-23T14:48:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 --2- 172.21.15.7:0/541767438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc074a60 0x7fc9dc074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 --2- 172.21.15.7:0/541767438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc109e50 0x7fc9dc10c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 --2- 172.21.15.7:0/541767438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc074490 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 -- 172.21.15.7:0/541767438 >> 172.21.15.7:0/541767438 conn(0x7fc9dc0fd500 msgr2=0x7fc9dc0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 -- 172.21.15.7:0/541767438 shutdown_connections 2024-04-23T14:48:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.685+0000 7fc9e3000640 1 -- 172.21.15.7:0/541767438 wait complete. 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 Processor -- start 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 -- start start 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc074a60 0x7fc9dc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc109e50 0x7fc9dc1a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc10fce0 con 0x7fc9dc076040 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc10fb60 con 0x7fc9dc109e50 2024-04-23T14:48:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.687+0000 7fc9e3000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc10fe60 con 0x7fc9dc074a60 2024-04-23T14:48:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc19a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33442/0 (socket says 172.21.15.7:33442) 2024-04-23T14:48:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 -- 172.21.15.7:0/1727408671 learned_addr learned my addr 172.21.15.7:0/1727408671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1c00640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc074a60 0x7fc9dc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 -- 172.21.15.7:0/1727408671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc074a60 msgr2=0x7fc9dc19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc074a60 0x7fc9dc19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 -- 172.21.15.7:0/1727408671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc109e50 msgr2=0x7fc9dc1a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc109e50 0x7fc9dc1a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1200640 1 -- 172.21.15.7:0/1727408671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc1a1ff0 con 0x7fc9dc076040 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.688+0000 7fc9e1c00640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc074a60 0x7fc9dc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.689+0000 7fc9e1200640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc19a910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800d950 tx=0x7fc9c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.689+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8017070 con 0x7fc9dc076040 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.689+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9c8009c30 con 0x7fc9dc076040 2024-04-23T14:48:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.689+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc1a22e0 con 0x7fc9dc076040 2024-04-23T14:48:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.689+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800f620 con 0x7fc9dc076040 2024-04-23T14:48:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.689+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc1a2830 con 0x7fc9dc076040 2024-04-23T14:48:44.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.690+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc108b80 con 0x7fc9dc076040 2024-04-23T14:48:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.693+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fc9c80109a0 con 0x7fc9dc076040 2024-04-23T14:48:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.695+0000 7fc9da000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc9c00a3bb0 0x7fc9c00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.695+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc9c80d04a0 con 0x7fc9dc076040 2024-04-23T14:48:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.695+0000 7fc9e1c00640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc9c00a3bb0 0x7fc9c00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.696+0000 7fc9e1c00640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc9c00a3bb0 0x7fc9c00a6070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc031040 tx=0x7fc9cc000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:44.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.699+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc9c8009de0 con 0x7fc9dc076040 2024-04-23T14:48:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.911+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc9dc062c00 con 0x7fc9dc076040 2024-04-23T14:48:44.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.913+0000 7fc9da000640 1 -- 172.21.15.7:0/1727408671 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fc9c809cac0 con 0x7fc9dc076040 2024-04-23T14:48:44.914 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:48:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.915+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc9c00a3bb0 msgr2=0x7fc9c00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.915+0000 7fc9e3000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc9c00a3bb0 0x7fc9c00a6070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc031040 tx=0x7fc9cc000f40 comp rx=0 tx=0).stop 2024-04-23T14:48:44.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 msgr2=0x7fc9dc19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc19a910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800d950 tx=0x7fc9c800de10 comp rx=0 tx=0).stop 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 shutdown_connections 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc9c00a3bb0 0x7fc9c00a6070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc109e50 0x7fc9dc1a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc076040 0x7fc9dc19a910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 --2- 172.21.15.7:0/1727408671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9dc074a60 0x7fc9dc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 >> 172.21.15.7:0/1727408671 conn(0x7fc9dc0fd500 msgr2=0x7fc9dc105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 shutdown_connections 2024-04-23T14:48:44.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:44.916+0000 7fc9e3000640 1 -- 172.21.15.7:0/1727408671 wait complete. 2024-04-23T14:48:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:44 smithi137 ceph-mon[31694]: osdmap e91: 12 total, 12 up, 12 in 2024-04-23T14:48:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:44 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4170819108' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T14:48:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:44 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1751873225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:44.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T14:48:45.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:44 smithi007 ceph-mon[27906]: osdmap e91: 12 total, 12 up, 12 in 2024-04-23T14:48:45.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:44 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4170819108' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T14:48:45.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:44 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1751873225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:44 smithi186 ceph-mon[31814]: osdmap e91: 12 total, 12 up, 12 in 2024-04-23T14:48:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:44 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4170819108' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T14:48:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:44 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1751873225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 -- 172.21.15.7:0/2405693379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc10a0f0 msgr2=0x7f06fc110980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 --2- 172.21.15.7:0/2405693379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc10a0f0 0x7f06fc110980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009ca0 tx=0x7f06f402a8b0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 -- 172.21.15.7:0/2405693379 shutdown_connections 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 --2- 172.21.15.7:0/2405693379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06fc109730 0x7f06fc109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 --2- 172.21.15.7:0/2405693379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc10a0f0 0x7f06fc110980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 --2- 172.21.15.7:0/2405693379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc108540 0x7f06fc108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 -- 172.21.15.7:0/2405693379 >> 172.21.15.7:0/2405693379 conn(0x7f06fc0774d0 msgr2=0x7f06fc079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:45.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 -- 172.21.15.7:0/2405693379 shutdown_connections 2024-04-23T14:48:45.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.152+0000 7f06fb200640 1 -- 172.21.15.7:0/2405693379 wait complete. 2024-04-23T14:48:45.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.153+0000 7f06fb200640 1 Processor -- start 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.153+0000 7f06fb200640 1 -- start start 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.153+0000 7f06fb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06fc108540 0x7f06fc19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 0x7f06fc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fb200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc10a0f0 0x7f06fc1a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc1140d0 con 0x7f06fc109730 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc113f50 con 0x7f06fc108540 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fb200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc114250 con 0x7f06fc10a0f0 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 0x7f06fc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 0x7f06fc19eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33460/0 (socket says 172.21.15.7:33460) 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 -- 172.21.15.7:0/3119254208 learned_addr learned my addr 172.21.15.7:0/3119254208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f9e00640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06fc108540 0x7f06fc19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fa800640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc10a0f0 0x7f06fc1a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 -- 172.21.15.7:0/3119254208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc10a0f0 msgr2=0x7f06fc1a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc10a0f0 0x7f06fc1a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 -- 172.21.15.7:0/3119254208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06fc108540 msgr2=0x7f06fc19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06fc108540 0x7f06fc19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06f1400640 1 -- 172.21.15.7:0/3119254208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc1a61d0 con 0x7f06fc109730 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.154+0000 7f06fa800640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc10a0f0 0x7f06fc1a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.155+0000 7f06f1400640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 0x7f06fc19eaf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c920 tx=0x7f06e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.155+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4007c70 con 0x7f06fc109730 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.155+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06e4007e10 con 0x7f06fc109730 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.155+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc1a64c0 con 0x7f06fc109730 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.155+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4018820 con 0x7f06fc109730 2024-04-23T14:48:45.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.155+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc1a6a10 con 0x7f06fc109730 2024-04-23T14:48:45.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.156+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06fc10f790 con 0x7f06fc109730 2024-04-23T14:48:45.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.159+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f06e40189c0 con 0x7f06fc109730 2024-04-23T14:48:45.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.160+0000 7f06f3400640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f06e00a3bb0 0x7f06e00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.160+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f06e40d0c60 con 0x7f06fc109730 2024-04-23T14:48:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.160+0000 7f06f9e00640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f06e00a3bb0 0x7f06e00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.161+0000 7f06f9e00640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f06e00a3bb0 0x7f06e00a6070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0058c0 tx=0x7f06ec005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:45.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.163+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f06e4014030 con 0x7f06fc109730 2024-04-23T14:48:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.371+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06fc02d8b0 con 0x7f06fc109730 2024-04-23T14:48:45.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.372+0000 7f06f3400640 1 -- 172.21.15.7:0/3119254208 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f06e409d310 con 0x7f06fc109730 2024-04-23T14:48:45.372 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:48:45.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.374+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f06e00a3bb0 msgr2=0x7f06e00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.374+0000 7f06fb200640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f06e00a3bb0 0x7f06e00a6070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0058c0 tx=0x7f06ec005850 comp rx=0 tx=0).stop 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.374+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 msgr2=0x7f06fc19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.374+0000 7f06fb200640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 0x7f06fc19eaf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c920 tx=0x7f06e400cde0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 shutdown_connections 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f06e00a3bb0 0x7f06e00a6070 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc10a0f0 0x7f06fc1a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc109730 0x7f06fc19eaf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 --2- 172.21.15.7:0/3119254208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06fc108540 0x7f06fc19e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 >> 172.21.15.7:0/3119254208 conn(0x7f06fc0774d0 msgr2=0x7f06fc10c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 shutdown_connections 2024-04-23T14:48:45.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.375+0000 7f06fb200640 1 -- 172.21.15.7:0/3119254208 wait complete. 2024-04-23T14:48:45.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T14:48:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 -- 172.21.15.7:0/2655158543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105cf0 msgr2=0x7f480410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 --2- 172.21.15.7:0/2655158543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105cf0 0x7f480410c580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009ca0 tx=0x7f47fc02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 -- 172.21.15.7:0/2655158543 shutdown_connections 2024-04-23T14:48:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 --2- 172.21.15.7:0/2655158543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105cf0 0x7f480410c580 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 --2- 172.21.15.7:0/2655158543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105330 0x7f48041057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 --2- 172.21.15.7:0/2655158543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 0x7f4804104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 -- 172.21.15.7:0/2655158543 >> 172.21.15.7:0/2655158543 conn(0x7f48040ff6b0 msgr2=0x7f4804101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 -- 172.21.15.7:0/2655158543 shutdown_connections 2024-04-23T14:48:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.594+0000 7f4803e00640 1 -- 172.21.15.7:0/2655158543 wait complete. 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.595+0000 7f4803e00640 1 Processor -- start 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 -- start start 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 0x7f480419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 0x7f480419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105cf0 0x7f48041a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f480410fc80 con 0x7f4804105330 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f480410fb00 con 0x7f4804104140 2024-04-23T14:48:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4803e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f480410fe00 con 0x7f4804105cf0 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 0x7f480419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 0x7f480419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33484/0 (socket says 172.21.15.7:33484) 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f47fbe00640 1 -- 172.21.15.7:0/108987892 learned_addr learned my addr 172.21.15.7:0/108987892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.596+0000 7f4802a00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 0x7f480419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f4803400640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105cf0 0x7f48041a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fbe00640 1 -- 172.21.15.7:0/108987892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105cf0 msgr2=0x7f48041a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fbe00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105cf0 0x7f48041a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fbe00640 1 -- 172.21.15.7:0/108987892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 msgr2=0x7f480419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fbe00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 0x7f480419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fbe00640 1 -- 172.21.15.7:0/108987892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48041a1f00 con 0x7f4804105330 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f4803400640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105cf0 0x7f48041a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f4802a00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 0x7f480419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fbe00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 0x7f480419a820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00d770 tx=0x7f47ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec017070 con 0x7f4804105330 2024-04-23T14:48:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47ec0054d0 con 0x7f4804105330 2024-04-23T14:48:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.597+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48041a21f0 con 0x7f4804105330 2024-04-23T14:48:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.598+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec004cf0 con 0x7f4804105330 2024-04-23T14:48:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.598+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48041a2740 con 0x7f4804105330 2024-04-23T14:48:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.599+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480410b460 con 0x7f4804105330 2024-04-23T14:48:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.601+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f47ec004e90 con 0x7f4804105330 2024-04-23T14:48:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.602+0000 7f47fb400640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f47e80a3c30 0x7f47e80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.602+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f47ec0d01c0 con 0x7f4804105330 2024-04-23T14:48:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.603+0000 7f4802a00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f47e80a3c30 0x7f47e80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.603+0000 7f4802a00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f47e80a3c30 0x7f47e80a60f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005d00 tx=0x7f47f4005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.607+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f47ec09c7e0 con 0x7f4804105330 2024-04-23T14:48:45.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.817+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4804062c00 con 0x7f4804105330 2024-04-23T14:48:45.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.818+0000 7f47fb400640 1 -- 172.21.15.7:0/108987892 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f47ec09c0e0 con 0x7f4804105330 2024-04-23T14:48:45.819 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T14:48:45.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f47e80a3c30 msgr2=0x7f47e80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f47e80a3c30 0x7f47e80a60f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005d00 tx=0x7f47f4005c90 comp rx=0 tx=0).stop 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 msgr2=0x7f480419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 0x7f480419a820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00d770 tx=0x7f47ec00dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 shutdown_connections 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f47e80a3c30 0x7f47e80a60f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4804105cf0 0x7f48041a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4804105330 0x7f480419a820 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 --2- 172.21.15.7:0/108987892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4804104140 0x7f480419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:45.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 >> 172.21.15.7:0/108987892 conn(0x7f48040ff6b0 msgr2=0x7f4804108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:45.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.821+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 shutdown_connections 2024-04-23T14:48:45.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:45.822+0000 7f4803e00640 1 -- 172.21.15.7:0/108987892 wait complete. 2024-04-23T14:48:45.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T14:48:46.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 -- 172.21.15.7:0/1732202259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340769c0 msgr2=0x7fdb34076de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 --2- 172.21.15.7:0/1732202259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340769c0 0x7fdb34076de0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009900 tx=0x7fdb2402a400 comp rx=0 tx=0).stop 2024-04-23T14:48:46.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 -- 172.21.15.7:0/1732202259 shutdown_connections 2024-04-23T14:48:46.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 --2- 172.21.15.7:0/1732202259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 0x7fdb34078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 --2- 172.21.15.7:0/1732202259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb340785a0 0x7fdb34078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 --2- 172.21.15.7:0/1732202259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340769c0 0x7fdb34076de0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 -- 172.21.15.7:0/1732202259 >> 172.21.15.7:0/1732202259 conn(0x7fdb340ff6b0 msgr2=0x7fdb34101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 -- 172.21.15.7:0/1732202259 shutdown_connections 2024-04-23T14:48:46.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.053+0000 7fdb33e00640 1 -- 172.21.15.7:0/1732202259 wait complete. 2024-04-23T14:48:46.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.054+0000 7fdb33e00640 1 Processor -- start 2024-04-23T14:48:46.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.054+0000 7fdb33e00640 1 -- start start 2024-04-23T14:48:46.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb340769c0 0x7fdb3419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 0x7fdb3419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 0x7fdb341a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb34114080 con 0x7fdb340785a0 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb34113f00 con 0x7fdb34077c00 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb34114200 con 0x7fdb340769c0 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 0x7fdb341a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 0x7fdb341a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33506/0 (socket says 172.21.15.7:33506) 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 -- 172.21.15.7:0/3665756427 learned_addr learned my addr 172.21.15.7:0/3665756427 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb32a00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb340769c0 0x7fdb3419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb32000640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 0x7fdb3419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 -- 172.21.15.7:0/3665756427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb340769c0 msgr2=0x7fdb3419e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb340769c0 0x7fdb3419e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 -- 172.21.15.7:0/3665756427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 msgr2=0x7fdb3419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 0x7fdb3419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.055+0000 7fdb33400640 1 -- 172.21.15.7:0/3665756427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb341a62c0 con 0x7fdb340785a0 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb32000640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 0x7fdb3419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb33400640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 0x7fdb341a5c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00cce0 tx=0x7fdb2c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00f450 con 0x7fdb340785a0 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb2c00faa0 con 0x7fdb340785a0 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb341a65b0 con 0x7fdb340785a0 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c018b70 con 0x7fdb340785a0 2024-04-23T14:48:46.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.056+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb341a6b00 con 0x7fdb340785a0 2024-04-23T14:48:46.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.058+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb34110ba0 con 0x7fdb340785a0 2024-04-23T14:48:46.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.059+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fdb2c018d10 con 0x7fdb340785a0 2024-04-23T14:48:46.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.061+0000 7fdb2b400640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdb180a3c30 0x7fdb180a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.061+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fdb2c0d0c20 con 0x7fdb340785a0 2024-04-23T14:48:46.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.061+0000 7fdb32a00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdb180a3c30 0x7fdb180a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.062+0000 7fdb32a00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdb180a3c30 0x7fdb180a60f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb24000c00 tx=0x7fdb240314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.065+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdb2c014030 con 0x7fdb340785a0 2024-04-23T14:48:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:45 smithi007 ceph-mon[27906]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-04-23T14:48:46.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:45 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1727408671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:46.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:45 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3119254208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:48:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:45 smithi186 ceph-mon[31814]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-04-23T14:48:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:45 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1727408671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:45 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3119254208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:48:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:45 smithi137 ceph-mon[31694]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-04-23T14:48:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:45 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1727408671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:48:46.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:45 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3119254208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:48:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.270+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdb34062c00 con 0x7fdb340785a0 2024-04-23T14:48:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.271+0000 7fdb2b400640 1 -- 172.21.15.7:0/3665756427 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fdb2c09d240 con 0x7fdb340785a0 2024-04-23T14:48:46.272 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdb180a3c30 msgr2=0x7fdb180a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdb180a3c30 0x7fdb180a60f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb24000c00 tx=0x7fdb240314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 msgr2=0x7fdb341a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 0x7fdb341a5c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00cce0 tx=0x7fdb2c00a620 comp rx=0 tx=0).stop 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 shutdown_connections 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdb180a3c30 0x7fdb180a60f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb34077c00 0x7fdb3419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb340785a0 0x7fdb341a5c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 --2- 172.21.15.7:0/3665756427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb340769c0 0x7fdb3419e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 >> 172.21.15.7:0/3665756427 conn(0x7fdb340ff6b0 msgr2=0x7fdb34100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.274+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 shutdown_connections 2024-04-23T14:48:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.275+0000 7fdb33e00640 1 -- 172.21.15.7:0/3665756427 wait complete. 2024-04-23T14:48:46.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T14:48:46.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3082311766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e0076040 msgr2=0x7fb5e0074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3082311766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e0076040 0x7fb5e0074490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009930 tx=0x7fb5d002a420 comp rx=0 tx=0).stop 2024-04-23T14:48:46.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3082311766 shutdown_connections 2024-04-23T14:48:46.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3082311766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3082311766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5e0074a60 0x7fb5e0074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3082311766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e0076040 0x7fb5e0074490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3082311766 >> 172.21.15.7:0/3082311766 conn(0x7fb5e00fd4a0 msgr2=0x7fb5e00ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:46.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3082311766 shutdown_connections 2024-04-23T14:48:46.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.498+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3082311766 wait complete. 2024-04-23T14:48:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.499+0000 7fb5dfe00640 1 Processor -- start 2024-04-23T14:48:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 -- start start 2024-04-23T14:48:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5e0074a60 0x7fb5e019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e0076040 0x7fb5e019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0114050 con 0x7fb5e010e4e0 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0113ed0 con 0x7fb5e0076040 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5dfe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e01141d0 con 0x7fb5e0074a60 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5df400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5df400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33526/0 (socket says 172.21.15.7:33526) 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5df400640 1 -- 172.21.15.7:0/3216755790 learned_addr learned my addr 172.21.15.7:0/3216755790 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.500+0000 7fb5de000640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e0076040 0x7fb5e019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5dea00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5e0074a60 0x7fb5e019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5df400640 1 -- 172.21.15.7:0/3216755790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5e0074a60 msgr2=0x7fb5e019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5df400640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5e0074a60 0x7fb5e019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5df400640 1 -- 172.21.15.7:0/3216755790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e0076040 msgr2=0x7fb5e019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5df400640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e0076040 0x7fb5e019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5df400640 1 -- 172.21.15.7:0/3216755790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e01a63b0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5df400640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01a5d40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800eaa0 tx=0x7fb5d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800cdb0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5d8005020 con 0x7fb5e010e4e0 2024-04-23T14:48:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e01a66a0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.501+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80116d0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.502+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e01a6bf0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.503+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e01046b0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.507+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fb5d80051d0 con 0x7fb5e010e4e0 2024-04-23T14:48:46.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.508+0000 7fb5d7400640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb5c40a3c30 0x7fb5c40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:46.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.508+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb5d80d0d40 con 0x7fb5e010e4e0 2024-04-23T14:48:46.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.508+0000 7fb5dea00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb5c40a3c30 0x7fb5c40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:46.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.509+0000 7fb5dea00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb5c40a3c30 0x7fb5c40a60f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0000c00 tx=0x7fb5d00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:46.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.511+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb5d8016030 con 0x7fb5e010e4e0 2024-04-23T14:48:46.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.753+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb5e002d620 con 0x7fb5e010e4e0 2024-04-23T14:48:46.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.754+0000 7fb5d7400640 1 -- 172.21.15.7:0/3216755790 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+580 (secure 0 0 0) 0x7fb5d809d440 con 0x7fb5e010e4e0 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/890429947 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2805710934 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/147420039 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4250737482 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3290686917 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1124398484 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T14:48:46.756 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T14:48:46.756 INFO:teuthology.orchestra.run.smithi007.stderr:listed 10 entries 2024-04-23T14:48:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.756+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb5c40a3c30 msgr2=0x7fb5c40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.756+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb5c40a3c30 0x7fb5c40a60f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0000c00 tx=0x7fb5d00314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.756+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 msgr2=0x7fb5e01a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.756+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01a5d40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800eaa0 tx=0x7fb5d800ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 shutdown_connections 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb5c40a3c30 0x7fb5c40a60f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5e0076040 0x7fb5e019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e010e4e0 0x7fb5e01a5d40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 --2- 172.21.15.7:0/3216755790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5e0074a60 0x7fb5e019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 >> 172.21.15.7:0/3216755790 conn(0x7fb5e00fd4a0 msgr2=0x7fb5e0101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 shutdown_connections 2024-04-23T14:48:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:46.757+0000 7fb5dfe00640 1 -- 172.21.15.7:0/3216755790 wait complete. 2024-04-23T14:48:46.776 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2024-04-23T14:48:46.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:46.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-23T14:48:46.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[69212]: fuse finished with error 0 and tester_r 0 2024-04-23T14:48:46.864 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T14:48:46.922 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:48:46.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:48:46.922 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-23T14:48:46.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:47.065 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:46 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/108987892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:48:47.065 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:46 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3665756427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:48:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:46 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/108987892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:48:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:46 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3665756427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:48:47.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:46 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/108987892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:48:47.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:46 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3665756427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:48:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 -- 172.21.15.7:0/2975660726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320109670 msgr2=0x7f9320109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 --2- 172.21.15.7:0/2975660726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320109670 0x7f9320109af0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f930c009900 tx=0x7f930c02a410 comp rx=0 tx=0).stop 2024-04-23T14:48:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 -- 172.21.15.7:0/2975660726 shutdown_connections 2024-04-23T14:48:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 --2- 172.21.15.7:0/2975660726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f932010a030 0x7f93201108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 --2- 172.21.15.7:0/2975660726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320109670 0x7f9320109af0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 --2- 172.21.15.7:0/2975660726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9320108480 0x7f93201088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 -- 172.21.15.7:0/2975660726 >> 172.21.15.7:0/2975660726 conn(0x7f9320077440 msgr2=0x7f9320079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.206+0000 7f9325200640 1 -- 172.21.15.7:0/2975660726 shutdown_connections 2024-04-23T14:48:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.207+0000 7f9325200640 1 -- 172.21.15.7:0/2975660726 wait complete. 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.207+0000 7f9325200640 1 Processor -- start 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 -- start start 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 0x7f932019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9320109670 0x7f932019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f932010a030 0x7f93201a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9320114010 con 0x7f9320108480 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9320113e90 con 0x7f932010a030 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f9325200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9320114190 con 0x7f9320109670 2024-04-23T14:48:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f931f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 0x7f932019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f931f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 0x7f932019e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33552/0 (socket says 172.21.15.7:33552) 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.208+0000 7f931f400640 1 -- 172.21.15.7:0/645700974 learned_addr learned my addr 172.21.15.7:0/645700974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931fe00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f932010a030 0x7f93201a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931ea00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9320109670 0x7f932019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931f400640 1 -- 172.21.15.7:0/645700974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9320109670 msgr2=0x7f932019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931f400640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9320109670 0x7f932019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931f400640 1 -- 172.21.15.7:0/645700974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f932010a030 msgr2=0x7f93201a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931f400640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f932010a030 0x7f93201a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931f400640 1 -- 172.21.15.7:0/645700974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93201a6290 con 0x7f9320108480 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931ea00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9320109670 0x7f932019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931fe00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f932010a030 0x7f93201a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f931f400640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 0x7f932019e6c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f931000c970 tx=0x7f931000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310004220 con 0x7f9320108480 2024-04-23T14:48:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f93100043c0 con 0x7f9320108480 2024-04-23T14:48:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931000f450 con 0x7f9320108480 2024-04-23T14:48:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93201a6580 con 0x7f9320108480 2024-04-23T14:48:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.209+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201a6a80 con 0x7f9320108480 2024-04-23T14:48:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.211+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f932010f7a0 con 0x7f9320108480 2024-04-23T14:48:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.213+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f93100079b0 con 0x7f9320108480 2024-04-23T14:48:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.215+0000 7f9317e00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f93040a3c30 0x7f93040a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.215+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f93100d0580 con 0x7f9320108480 2024-04-23T14:48:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.215+0000 7f931ea00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f93040a3c30 0x7f93040a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.216+0000 7f931ea00640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f93040a3c30 0x7f93040a60f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f930c02a930 tx=0x7f930c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.220+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9310014030 con 0x7f9320108480 2024-04-23T14:48:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.427+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9320062c30 con 0x7f9320108480 2024-04-23T14:48:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.429+0000 7f9317e00640 1 -- 172.21.15.7:0/645700974 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24527 (secure 0 0 0) 0x7f931009cba0 con 0x7f9320108480 2024-04-23T14:48:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:47.431 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:43.702260+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.432+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f93040a3c30 msgr2=0x7f93040a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f93040a3c30 0x7f93040a60f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f930c02a930 tx=0x7f930c005fd0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 msgr2=0x7f932019e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 0x7f932019e6c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f931000c970 tx=0x7f931000ce30 comp rx=0 tx=0).stop 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 shutdown_connections 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f93040a3c30 0x7f93040a60f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f932010a030 0x7f93201a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9320109670 0x7f932019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 --2- 172.21.15.7:0/645700974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9320108480 0x7f932019e6c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 >> 172.21.15.7:0/645700974 conn(0x7f9320077440 msgr2=0x7f932010c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 shutdown_connections 2024-04-23T14:48:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.433+0000 7f9325200640 1 -- 172.21.15.7:0/645700974 wait complete. 2024-04-23T14:48:47.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.666+0000 7fa48fe00640 1 -- 172.21.15.7:0/1768455698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 msgr2=0x7fa490107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.666+0000 7fa48fe00640 1 --2- 172.21.15.7:0/1768455698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa490107620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa478009900 tx=0x7fa47802a410 comp rx=0 tx=0).stop 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 -- 172.21.15.7:0/1768455698 shutdown_connections 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 --2- 172.21.15.7:0/1768455698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 0x7fa490109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 --2- 172.21.15.7:0/1768455698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa490107620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 --2- 172.21.15.7:0/1768455698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa490102900 0x7fa490104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 -- 172.21.15.7:0/1768455698 >> 172.21.15.7:0/1768455698 conn(0x7fa4900fc310 msgr2=0x7fa4900fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 -- 172.21.15.7:0/1768455698 shutdown_connections 2024-04-23T14:48:47.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.667+0000 7fa48fe00640 1 -- 172.21.15.7:0/1768455698 wait complete. 2024-04-23T14:48:47.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.668+0000 7fa48fe00640 1 Processor -- start 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.668+0000 7fa48fe00640 1 -- start start 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa490102900 0x7fa490102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa4901008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 0x7fa490100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa49010da60 con 0x7fa490105230 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa49010d8e0 con 0x7fa490107b60 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa49010dbe0 con 0x7fa490102900 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa4901008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa4901008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33576/0 (socket says 172.21.15.7:33576) 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 -- 172.21.15.7:0/3595928041 learned_addr learned my addr 172.21.15.7:0/3595928041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48f400640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 0x7fa490100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48ea00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa490102900 0x7fa490102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 -- 172.21.15.7:0/3595928041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa490102900 msgr2=0x7fa490102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa490102900 0x7fa490102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 -- 172.21.15.7:0/3595928041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 msgr2=0x7fa490100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 0x7fa490100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa487e00640 1 -- 172.21.15.7:0/3595928041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4901016b0 con 0x7fa490105230 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.669+0000 7fa48f400640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 0x7fa490100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.670+0000 7fa487e00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa4901008b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa4780314e0 tx=0x7fa478003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.670+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47803f070 con 0x7fa490105230 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.670+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa478031e40 con 0x7fa490105230 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.670+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4901a22c0 con 0x7fa490105230 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.670+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478035030 con 0x7fa490105230 2024-04-23T14:48:47.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.670+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4901a2800 con 0x7fa490105230 2024-04-23T14:48:47.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.672+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490069190 con 0x7fa490105230 2024-04-23T14:48:47.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.674+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fa478042070 con 0x7fa490105230 2024-04-23T14:48:47.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.675+0000 7fa487400640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa4740a3bb0 0x7fa4740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.675+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa4780f1260 con 0x7fa490105230 2024-04-23T14:48:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.675+0000 7fa48ea00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa4740a3bb0 0x7fa4740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:47.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.676+0000 7fa48ea00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa4740a3bb0 0x7fa4740a6070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa48000a810 tx=0x7fa480008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:47.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.679+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa4780bd880 con 0x7fa490105230 2024-04-23T14:48:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.891+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa490062c00 con 0x7fa490105230 2024-04-23T14:48:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.895+0000 7fa487400640 1 -- 172.21.15.7:0/3595928041 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24527 (secure 0 0 0) 0x7fa4780bd180 con 0x7fa490105230 2024-04-23T14:48:47.896 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:47.896 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:43.702260+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.897+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa4740a3bb0 msgr2=0x7fa4740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.897+0000 7fa48fe00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa4740a3bb0 0x7fa4740a6070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa48000a810 tx=0x7fa480008040 comp rx=0 tx=0).stop 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.897+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 msgr2=0x7fa4901008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.897+0000 7fa48fe00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa4901008b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa4780314e0 tx=0x7fa478003d50 comp rx=0 tx=0).stop 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 shutdown_connections 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa4740a3bb0 0x7fa4740a6070 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa490107b60 0x7fa490100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa490105230 0x7fa4901008b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 --2- 172.21.15.7:0/3595928041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa490102900 0x7fa490102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 >> 172.21.15.7:0/3595928041 conn(0x7fa4900fc310 msgr2=0x7fa490103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 shutdown_connections 2024-04-23T14:48:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:47.898+0000 7fa48fe00640 1 -- 172.21.15.7:0/3595928041 wait complete. 2024-04-23T14:48:47.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-23T14:48:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:47 smithi007 ceph-mon[27906]: pgmap v383: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-23T14:48:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:47 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3216755790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T14:48:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:47 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/645700974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:47 smithi186 ceph-mon[31814]: pgmap v383: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-23T14:48:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:47 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3216755790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T14:48:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:47 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/645700974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.133+0000 7fb91e000640 1 -- 172.21.15.7:0/3033311508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918105450 msgr2=0x7fb9181058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.133+0000 7fb91e000640 1 --2- 172.21.15.7:0/3033311508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918105450 0x7fb9181058d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb904009900 tx=0x7fb90402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 -- 172.21.15.7:0/3033311508 shutdown_connections 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 --2- 172.21.15.7:0/3033311508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105e10 0x7fb91810c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 --2- 172.21.15.7:0/3033311508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918105450 0x7fb9181058d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 --2- 172.21.15.7:0/3033311508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918104260 0x7fb918104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 -- 172.21.15.7:0/3033311508 >> 172.21.15.7:0/3033311508 conn(0x7fb9180ff7b0 msgr2=0x7fb918101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 -- 172.21.15.7:0/3033311508 shutdown_connections 2024-04-23T14:48:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.134+0000 7fb91e000640 1 -- 172.21.15.7:0/3033311508 wait complete. 2024-04-23T14:48:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.135+0000 7fb91e000640 1 Processor -- start 2024-04-23T14:48:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.135+0000 7fb91e000640 1 -- start start 2024-04-23T14:48:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.135+0000 7fb91e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 0x7fb91819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.135+0000 7fb91e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105450 0x7fb91819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.135+0000 7fb91e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918105e10 0x7fb9181a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb91e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810fdf0 con 0x7fb918104260 2024-04-23T14:48:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb91e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810fc70 con 0x7fb918105450 2024-04-23T14:48:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb91e000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810ff70 con 0x7fb918105e10 2024-04-23T14:48:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 0x7fb91819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 0x7fb91819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33594/0 (socket says 172.21.15.7:33594) 2024-04-23T14:48:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 -- 172.21.15.7:0/2710482061 learned_addr learned my addr 172.21.15.7:0/2710482061 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb916a00640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105450 0x7fb91819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917e00640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918105e10 0x7fb9181a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 -- 172.21.15.7:0/2710482061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918105e10 msgr2=0x7fb9181a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918105e10 0x7fb9181a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 -- 172.21.15.7:0/2710482061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105450 msgr2=0x7fb91819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105450 0x7fb91819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb917400640 1 -- 172.21.15.7:0/2710482061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9181a2060 con 0x7fb918104260 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.136+0000 7fb916a00640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105450 0x7fb91819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.137+0000 7fb917400640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 0x7fb91819a440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb90800d950 tx=0x7fb90800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.137+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908017070 con 0x7fb918104260 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.137+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb908009c30 con 0x7fb918104260 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.137+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90800f620 con 0x7fb918104260 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.137+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9181a2350 con 0x7fb918104260 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.137+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9181a2850 con 0x7fb918104260 2024-04-23T14:48:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.138+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91810b5d0 con 0x7fb918104260 2024-04-23T14:48:48.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.142+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fb90801a070 con 0x7fb918104260 2024-04-23T14:48:48.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.143+0000 7fb90fe00640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb8fc0a3bb0 0x7fb8fc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.144+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fb9080d02e0 con 0x7fb918104260 2024-04-23T14:48:48.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.144+0000 7fb916a00640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb8fc0a3bb0 0x7fb8fc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.145+0000 7fb916a00640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb8fc0a3bb0 0x7fb8fc0a6070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb90402a930 tx=0x7fb904005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.146+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb908009de0 con 0x7fb918104260 2024-04-23T14:48:48.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:47 smithi137 ceph-mon[31694]: pgmap v383: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-23T14:48:48.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:47 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3216755790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T14:48:48.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:47 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/645700974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.405+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb91802d620 con 0x7fb918104260 2024-04-23T14:48:48.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.758+0000 7fb90fe00640 1 -- 172.21.15.7:0/2710482061 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fb90809c900 con 0x7fb918104260 2024-04-23T14:48:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.762+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb8fc0a3bb0 msgr2=0x7fb8fc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.762+0000 7fb91e000640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb8fc0a3bb0 0x7fb8fc0a6070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb90402a930 tx=0x7fb904005fd0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.762+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 msgr2=0x7fb91819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.762+0000 7fb91e000640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 0x7fb91819a440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb90800d950 tx=0x7fb90800de10 comp rx=0 tx=0).stop 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 shutdown_connections 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb8fc0a3bb0 0x7fb8fc0a6070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb918105450 0x7fb91819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918105e10 0x7fb9181a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 --2- 172.21.15.7:0/2710482061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb918104260 0x7fb91819a440 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 >> 172.21.15.7:0/2710482061 conn(0x7fb9180ff7b0 msgr2=0x7fb9181087a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 shutdown_connections 2024-04-23T14:48:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.763+0000 7fb91e000640 1 -- 172.21.15.7:0/2710482061 wait complete. 2024-04-23T14:48:48.786 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-04-23T14:48:48.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 -- 172.21.15.7:0/3877884341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 msgr2=0x7f51d4110aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 --2- 172.21.15.7:0/3877884341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d4110aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009ca0 tx=0x7f51cc02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 -- 172.21.15.7:0/3877884341 shutdown_connections 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 --2- 172.21.15.7:0/3877884341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d4110aa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 --2- 172.21.15.7:0/3877884341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51d4109850 0x7f51d4109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 --2- 172.21.15.7:0/3877884341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d4108660 0x7f51d4108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 -- 172.21.15.7:0/3877884341 >> 172.21.15.7:0/3877884341 conn(0x7f51d4077600 msgr2=0x7f51d4079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:48.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 -- 172.21.15.7:0/3877884341 shutdown_connections 2024-04-23T14:48:48.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.992+0000 7f51daa00640 1 -- 172.21.15.7:0/3877884341 wait complete. 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.993+0000 7f51daa00640 1 Processor -- start 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.993+0000 7f51daa00640 1 -- start start 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.993+0000 7f51daa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d4108660 0x7f51d419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.993+0000 7f51daa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51d4109850 0x7f51d419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.993+0000 7f51daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d41a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.993+0000 7f51daa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51d41141e0 con 0x7f51d410a210 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51daa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4114060 con 0x7f51d4108660 2024-04-23T14:48:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51daa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4114360 con 0x7f51d4109850 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d41a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d41a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33616/0 (socket says 172.21.15.7:33616) 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 -- 172.21.15.7:0/4067243443 learned_addr learned my addr 172.21.15.7:0/4067243443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d3400640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51d4109850 0x7f51d419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d3e00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d4108660 0x7f51d419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 -- 172.21.15.7:0/4067243443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51d4109850 msgr2=0x7f51d419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51d4109850 0x7f51d419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 -- 172.21.15.7:0/4067243443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d4108660 msgr2=0x7f51d419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d4108660 0x7f51d419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.994+0000 7f51d8a00640 1 -- 172.21.15.7:0/4067243443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d41a6470 con 0x7f51d410a210 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.995+0000 7f51d8a00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d41a5e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f51cc031040 tx=0x7f51cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.995+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc032ec0 con 0x7f51d410a210 2024-04-23T14:48:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.995+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51cc0044f0 con 0x7f51d410a210 2024-04-23T14:48:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.995+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d41a6700 con 0x7f51d410a210 2024-04-23T14:48:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.995+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc030d10 con 0x7f51d410a210 2024-04-23T14:48:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.995+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d41a6c50 con 0x7f51d410a210 2024-04-23T14:48:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.997+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d410f9d0 con 0x7f51d410a210 2024-04-23T14:48:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:48.998+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f51cc004040 con 0x7f51d410a210 2024-04-23T14:48:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.000+0000 7f51d0c00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f51b80a3d50 0x7f51b80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.000+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f51cc0f1ee0 con 0x7f51d410a210 2024-04-23T14:48:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.000+0000 7f51d3e00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f51b80a3d50 0x7f51b80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.001+0000 7f51d3e00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f51b80a3d50 0x7f51b80a6210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51c4005fd0 tx=0x7f51c4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.005+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f51cc0be500 con 0x7f51d410a210 2024-04-23T14:48:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:48 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3595928041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:48 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2710482061' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-23T14:48:49.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:48 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3595928041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:49.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:48 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2710482061' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-23T14:48:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:48 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3595928041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:48 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2710482061' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-23T14:48:49.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.256+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f51d4062c00 con 0x7f51d410a210 2024-04-23T14:48:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.762+0000 7f51d0c00640 1 -- 172.21.15.7:0/4067243443 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f51cc039e10 con 0x7f51d410a210 2024-04-23T14:48:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.768+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f51b80a3d50 msgr2=0x7f51b80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.768+0000 7f51daa00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f51b80a3d50 0x7f51b80a6210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51c4005fd0 tx=0x7f51c4005850 comp rx=0 tx=0).stop 2024-04-23T14:48:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.768+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 msgr2=0x7f51d41a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.768+0000 7f51daa00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d41a5e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f51cc031040 tx=0x7f51cc003ba0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 shutdown_connections 2024-04-23T14:48:49.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f51b80a3d50 0x7f51b80a6210 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d410a210 0x7f51d41a5e00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51d4109850 0x7f51d419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 --2- 172.21.15.7:0/4067243443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51d4108660 0x7f51d419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 >> 172.21.15.7:0/4067243443 conn(0x7f51d4077600 msgr2=0x7f51d410cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 shutdown_connections 2024-04-23T14:48:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:49.769+0000 7f51daa00640 1 -- 172.21.15.7:0/4067243443 wait complete. 2024-04-23T14:48:49.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-23T14:48:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.007+0000 7f55c4a00640 1 -- 172.21.15.7:0/12973588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c0077c00 msgr2=0x7f55c0078060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.007+0000 7f55c4a00640 1 --2- 172.21.15.7:0/12973588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c0077c00 0x7f55c0078060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009900 tx=0x7f55ac02a410 comp rx=0 tx=0).stop 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 -- 172.21.15.7:0/12973588 shutdown_connections 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 --2- 172.21.15.7:0/12973588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 0x7f55c0078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 --2- 172.21.15.7:0/12973588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c0077c00 0x7f55c0078060 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 --2- 172.21.15.7:0/12973588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c00769c0 0x7f55c0076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 -- 172.21.15.7:0/12973588 >> 172.21.15.7:0/12973588 conn(0x7f55c00ff6b0 msgr2=0x7f55c0101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 -- 172.21.15.7:0/12973588 shutdown_connections 2024-04-23T14:48:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.008+0000 7f55c4a00640 1 -- 172.21.15.7:0/12973588 wait complete. 2024-04-23T14:48:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 Processor -- start 2024-04-23T14:48:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 -- start start 2024-04-23T14:48:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 0x7f55c019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c0077c00 0x7f55c019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 0x7f55c01a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55c01140c0 con 0x7f55c00769c0 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55c0113f40 con 0x7f55c0077c00 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.009+0000 7f55c4a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f55c0114240 con 0x7f55c00785a0 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 0x7f55c019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 0x7f55c019e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33626/0 (socket says 172.21.15.7:33626) 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 -- 172.21.15.7:0/2974609093 learned_addr learned my addr 172.21.15.7:0/2974609093 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55bde00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c0077c00 0x7f55c019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55bf200640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 0x7f55c01a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 -- 172.21.15.7:0/2974609093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 msgr2=0x7f55c01a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 0x7f55c01a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 -- 172.21.15.7:0/2974609093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c0077c00 msgr2=0x7f55c019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c0077c00 0x7f55c019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 -- 172.21.15.7:0/2974609093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c01a6370 con 0x7f55c00769c0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55bf200640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 0x7f55c01a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.010+0000 7f55be800640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 0x7f55c019e750 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d950 tx=0x7f55b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.011+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0017030 con 0x7f55c00769c0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.011+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55b0004020 con 0x7f55c00769c0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.011+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00047a0 con 0x7f55c00769c0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.011+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c01a6660 con 0x7f55c00769c0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.011+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c01a6b30 con 0x7f55c00769c0 2024-04-23T14:48:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.012+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c0110ab0 con 0x7f55c00769c0 2024-04-23T14:48:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.014+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f55b00041d0 con 0x7f55c00769c0 2024-04-23T14:48:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.015+0000 7f55b7400640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f55a40a3c30 0x7f55a40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.016+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f55b00d0330 con 0x7f55c00769c0 2024-04-23T14:48:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.016+0000 7f55bde00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f55a40a3c30 0x7f55a40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.017+0000 7f55bde00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f55a40a3c30 0x7f55a40a60f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f55ac000c00 tx=0x7f55ac0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.020+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f55b009c950 con 0x7f55c00769c0 2024-04-23T14:48:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:49 smithi007 ceph-mon[27906]: pgmap v384: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-23T14:48:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:49 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2710482061' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-23T14:48:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:49 smithi007 ceph-mon[27906]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:49 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4067243443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-23T14:48:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:49 smithi186 ceph-mon[31814]: pgmap v384: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-23T14:48:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:49 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2710482061' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-23T14:48:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:49 smithi186 ceph-mon[31814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:50.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:49 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4067243443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-23T14:48:50.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:49 smithi137 ceph-mon[31694]: pgmap v384: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-23T14:48:50.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:49 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2710482061' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-23T14:48:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:49 smithi137 ceph-mon[31694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:49 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4067243443' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-23T14:48:50.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.270+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f55c0062c00 con 0x7f55c00769c0 2024-04-23T14:48:50.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.787+0000 7f55b7400640 1 -- 172.21.15.7:0/2974609093 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f55b009c250 con 0x7f55c00769c0 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.791+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f55a40a3c30 msgr2=0x7f55a40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.791+0000 7f55c4a00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f55a40a3c30 0x7f55a40a60f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f55ac000c00 tx=0x7f55ac0314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 msgr2=0x7f55c019e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 0x7f55c019e750 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55b000d950 tx=0x7f55b000de10 comp rx=0 tx=0).stop 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 shutdown_connections 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f55a40a3c30 0x7f55a40a60f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55c0077c00 0x7f55c019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55c00785a0 0x7f55c01a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 --2- 172.21.15.7:0/2974609093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55c00769c0 0x7f55c019e750 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 >> 172.21.15.7:0/2974609093 conn(0x7f55c00ff6b0 msgr2=0x7f55c01011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:50.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 shutdown_connections 2024-04-23T14:48:50.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:50.792+0000 7f55c4a00640 1 -- 172.21.15.7:0/2974609093 wait complete. 2024-04-23T14:48:50.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-23T14:48:51.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 -- 172.21.15.7:0/3563611654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028109730 msgr2=0x7fe028109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 --2- 172.21.15.7:0/3563611654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028109730 0x7fe028109bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe014009900 tx=0x7fe01402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 -- 172.21.15.7:0/3563611654 shutdown_connections 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 --2- 172.21.15.7:0/3563611654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 0x7fe028110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 --2- 172.21.15.7:0/3563611654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028109730 0x7fe028109bb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 --2- 172.21.15.7:0/3563611654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe028108540 0x7fe028108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.032+0000 7fe02d400640 1 -- 172.21.15.7:0/3563611654 >> 172.21.15.7:0/3563611654 conn(0x7fe0280774d0 msgr2=0x7fe028079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.033+0000 7fe02d400640 1 -- 172.21.15.7:0/3563611654 shutdown_connections 2024-04-23T14:48:51.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.033+0000 7fe02d400640 1 -- 172.21.15.7:0/3563611654 wait complete. 2024-04-23T14:48:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 Processor -- start 2024-04-23T14:48:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 -- start start 2024-04-23T14:48:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 0x7fe02819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe028109730 0x7fe02819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 0x7fe0281a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe028114080 con 0x7fe028108540 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe028113f00 con 0x7fe028109730 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe02d400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe028114200 con 0x7fe02810a0f0 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe027e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 0x7fe02819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe027e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 0x7fe02819e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33648/0 (socket says 172.21.15.7:33648) 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.034+0000 7fe027e00640 1 -- 172.21.15.7:0/3622776413 learned_addr learned my addr 172.21.15.7:0/3622776413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe028109730 0x7fe02819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe02ca00640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 0x7fe0281a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027e00640 1 -- 172.21.15.7:0/3622776413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 msgr2=0x7fe0281a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027e00640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 0x7fe0281a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027e00640 1 -- 172.21.15.7:0/3622776413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe028109730 msgr2=0x7fe02819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027e00640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe028109730 0x7fe02819ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027e00640 1 -- 172.21.15.7:0/3622776413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0281a6330 con 0x7fe028108540 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe02ca00640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 0x7fe0281a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:51.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe027e00640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 0x7fe02819e710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe01800d770 tx=0x7fe01800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.035+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018017070 con 0x7fe028108540 2024-04-23T14:48:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.036+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0281a6620 con 0x7fe028108540 2024-04-23T14:48:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.036+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe018009c30 con 0x7fe028108540 2024-04-23T14:48:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.036+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018003d00 con 0x7fe028108540 2024-04-23T14:48:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.036+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0281a6bc0 con 0x7fe028108540 2024-04-23T14:48:51.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.037+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02810f930 con 0x7fe028108540 2024-04-23T14:48:51.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.039+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fe018003ea0 con 0x7fe028108540 2024-04-23T14:48:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.042+0000 7fe024c00640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe00c0a3bb0 0x7fe00c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.042+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe0180d05d0 con 0x7fe028108540 2024-04-23T14:48:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.042+0000 7fe027400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe00c0a3bb0 0x7fe00c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.043+0000 7fe027400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe00c0a3bb0 0x7fe00c0a6070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe02819fc20 tx=0x7fe0140314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.045+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe01809cbf0 con 0x7fe028108540 2024-04-23T14:48:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T14:48:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4067243443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-23T14:48:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-23T14:48:51.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:51.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-23T14:48:51.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-23T14:48:51.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:50 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2974609093' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T14:48:51.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T14:48:51.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4067243443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-23T14:48:51.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-23T14:48:51.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:51.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-23T14:48:51.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-23T14:48:51.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:50 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2974609093' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T14:48:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T14:48:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4067243443' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-23T14:48:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-23T14:48:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-23T14:48:51.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-23T14:48:51.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-23T14:48:51.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:50 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2974609093' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T14:48:51.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.295+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe02802d620 con 0x7fe028108540 2024-04-23T14:48:51.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.804+0000 7fe024c00640 1 -- 172.21.15.7:0/3622776413 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7fe018009de0 con 0x7fe028108540 2024-04-23T14:48:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.807+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe00c0a3bb0 msgr2=0x7fe00c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.807+0000 7fe02d400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe00c0a3bb0 0x7fe00c0a6070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe02819fc20 tx=0x7fe0140314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.807+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 msgr2=0x7fe02819e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.807+0000 7fe02d400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 0x7fe02819e710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe01800d770 tx=0x7fe01800dc30 comp rx=0 tx=0).stop 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 shutdown_connections 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe00c0a3bb0 0x7fe00c0a6070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe028109730 0x7fe02819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe02810a0f0 0x7fe0281a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 --2- 172.21.15.7:0/3622776413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe028108540 0x7fe02819e710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 >> 172.21.15.7:0/3622776413 conn(0x7fe0280774d0 msgr2=0x7fe02810cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 shutdown_connections 2024-04-23T14:48:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:51.808+0000 7fe02d400640 1 -- 172.21.15.7:0/3622776413 wait complete. 2024-04-23T14:48:51.836 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-04-23T14:48:51.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 -- 172.21.15.7:0/757703694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 msgr2=0x7f7708110980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 --2- 172.21.15.7:0/757703694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f7708110980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7700009ca0 tx=0x7f770002a8c0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 -- 172.21.15.7:0/757703694 shutdown_connections 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 --2- 172.21.15.7:0/757703694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f7708110980 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 --2- 172.21.15.7:0/757703694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708109730 0x7f7708109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 --2- 172.21.15.7:0/757703694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7708108540 0x7f7708108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 -- 172.21.15.7:0/757703694 >> 172.21.15.7:0/757703694 conn(0x7f77080774d0 msgr2=0x7f7708079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 -- 172.21.15.7:0/757703694 shutdown_connections 2024-04-23T14:48:52.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.030+0000 7f770dc00640 1 -- 172.21.15.7:0/757703694 wait complete. 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 Processor -- start 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 -- start start 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708108540 0x7f770819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7708109730 0x7f770819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f77081a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77081140d0 con 0x7f770810a0f0 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7708113f50 con 0x7f7708109730 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.031+0000 7f770dc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7708114250 con 0x7f7708108540 2024-04-23T14:48:52.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f77081a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f77081a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33674/0 (socket says 172.21.15.7:33674) 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 -- 172.21.15.7:0/643396705 learned_addr learned my addr 172.21.15.7:0/643396705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f7707400640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7708109730 0x7f770819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f7707e00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708108540 0x7f770819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 -- 172.21.15.7:0/643396705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708108540 msgr2=0x7f770819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708108540 0x7f770819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 -- 172.21.15.7:0/643396705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7708109730 msgr2=0x7f770819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7708109730 0x7f770819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f770d200640 1 -- 172.21.15.7:0/643396705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77081a62e0 con 0x7f770810a0f0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.032+0000 7f7707e00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708108540 0x7f770819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.033+0000 7f770d200640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f77081a5c70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7700031040 tx=0x7f7700003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.033+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700032ec0 con 0x7f770810a0f0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.033+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77000044f0 con 0x7f770810a0f0 2024-04-23T14:48:52.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.033+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700030d10 con 0x7f770810a0f0 2024-04-23T14:48:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.033+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77081a6570 con 0x7f770810a0f0 2024-04-23T14:48:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.033+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77081a6b10 con 0x7f770810a0f0 2024-04-23T14:48:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.034+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770810f800 con 0x7f770810a0f0 2024-04-23T14:48:52.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.036+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f7700004040 con 0x7f770810a0f0 2024-04-23T14:48:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.038+0000 7f7704c00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76ec0a3dd0 0x7f76ec0a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:52.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.038+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f77000f1e30 con 0x7f770810a0f0 2024-04-23T14:48:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.038+0000 7f7707e00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76ec0a3dd0 0x7f76ec0a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:52.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.039+0000 7f7707e00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76ec0a3dd0 0x7f76ec0a6290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7708109590 tx=0x7f76f8005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.043+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f77000be4b0 con 0x7f770810a0f0 2024-04-23T14:48:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: pgmap v385: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s wr, 0 op/s 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2974609093' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] up:active 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-23T14:48:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:51 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3622776413' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-23T14:48:52.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: pgmap v385: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s wr, 0 op/s 2024-04-23T14:48:52.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2974609093' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T14:48:52.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] up:active 2024-04-23T14:48:52.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-23T14:48:52.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-23T14:48:52.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-04-23T14:48:52.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-23T14:48:52.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:51 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3622776413' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: pgmap v385: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s wr, 0 op/s 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2974609093' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] up:active 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-23T14:48:52.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:51 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3622776413' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-23T14:48:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.280+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7708062440 con 0x7f76ec0a3dd0 2024-04-23T14:48:52.586 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:48:52.293+0000 7f41b7600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:48:52.586 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:48:52.293+0000 7f41b7600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:48:52.586 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:48:52.293+0000 7f41b7600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:48:52.586 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:48:52.293+0000 7f41b7600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:48:52.586 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:48:52.293+0000 7f41b7600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:48:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.873+0000 7f7704c00640 1 -- 172.21.15.7:0/643396705 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7708062440 con 0x7f76ec0a3dd0 2024-04-23T14:48:52.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.876+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76ec0a3dd0 msgr2=0x7f76ec0a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.876+0000 7f770dc00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76ec0a3dd0 0x7f76ec0a6290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7708109590 tx=0x7f76f8005e70 comp rx=0 tx=0).stop 2024-04-23T14:48:52.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.876+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 msgr2=0x7f77081a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f77081a5c70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7700031040 tx=0x7f7700003ba0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 shutdown_connections 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f76ec0a3dd0 0x7f76ec0a6290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7708109730 0x7f770819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f770810a0f0 0x7f77081a5c70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 --2- 172.21.15.7:0/643396705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7708108540 0x7f770819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 >> 172.21.15.7:0/643396705 conn(0x7f77080774d0 msgr2=0x7f770810c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 shutdown_connections 2024-04-23T14:48:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:52.877+0000 7f770dc00640 1 -- 172.21.15.7:0/643396705 wait complete. 2024-04-23T14:48:52.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-23T14:48:53.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3622776413' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-23T14:48:53.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] up:active 2024-04-23T14:48:53.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-mon[27906]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-23T14:48:53.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-mon[27906]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-04-23T14:48:53.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-mon[27906]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-04-23T14:48:53.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:52 smithi007 ceph-mon[27906]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-04-23T14:48:53.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:52 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3622776413' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-23T14:48:53.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:52 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] up:active 2024-04-23T14:48:53.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:52 smithi137 ceph-mon[31694]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-23T14:48:53.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:52 smithi137 ceph-mon[31694]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-04-23T14:48:53.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:52 smithi137 ceph-mon[31694]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-04-23T14:48:53.101 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:52 smithi137 ceph-mon[31694]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 -- 172.21.15.7:0/443819134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313810e620 msgr2=0x7f3138110a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 --2- 172.21.15.7:0/443819134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313810e620 0x7f3138110a10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3130009cd0 tx=0x7f313002a8e0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 -- 172.21.15.7:0/443819134 shutdown_connections 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 --2- 172.21.15.7:0/443819134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f313810e620 0x7f3138110a10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 --2- 172.21.15.7:0/443819134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3138074a60 0x7f3138074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 --2- 172.21.15.7:0/443819134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138076040 0x7f3138074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 -- 172.21.15.7:0/443819134 >> 172.21.15.7:0/443819134 conn(0x7f31380fd5e0 msgr2=0x7f31380ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 -- 172.21.15.7:0/443819134 shutdown_connections 2024-04-23T14:48:53.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.106+0000 7f313e200640 1 -- 172.21.15.7:0/443819134 wait complete. 2024-04-23T14:48:53.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.107+0000 7f313e200640 1 Processor -- start 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.107+0000 7f313e200640 1 -- start start 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.107+0000 7f313e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138074a60 0x7f313819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f313e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 0x7f313819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f313e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f313810e620 0x7f31381a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f313e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31381141d0 con 0x7f3138076040 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f313e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3138114050 con 0x7f3138074a60 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f313e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3138114350 con 0x7f313810e620 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 0x7f313819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 0x7f313819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46242/0 (socket says 172.21.15.7:46242) 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 -- 172.21.15.7:0/2070955958 learned_addr learned my addr 172.21.15.7:0/2070955958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3137400640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138074a60 0x7f313819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 -- 172.21.15.7:0/2070955958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f313810e620 msgr2=0x7f31381a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f313810e620 0x7f31381a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 -- 172.21.15.7:0/2070955958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138074a60 msgr2=0x7f313819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138074a60 0x7f313819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3136a00640 1 -- 172.21.15.7:0/2070955958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31381a6510 con 0x7f3138076040 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.108+0000 7f3137400640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138074a60 0x7f313819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.109+0000 7f3136a00640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 0x7f313819ee30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f312400b4a0 tx=0x7f312400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.109+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124014070 con 0x7f3138076040 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.109+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3124010ac0 con 0x7f3138076040 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.109+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124017c30 con 0x7f3138076040 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.109+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31381a6800 con 0x7f3138076040 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.109+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31381a6d80 con 0x7f3138076040 2024-04-23T14:48:53.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.111+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31381047f0 con 0x7f3138076040 2024-04-23T14:48:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:52 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3622776413' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-23T14:48:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:52 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] up:active 2024-04-23T14:48:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:52 smithi186 ceph-mon[31814]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-23T14:48:53.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:52 smithi186 ceph-mon[31814]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-04-23T14:48:53.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:52 smithi186 ceph-mon[31814]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-04-23T14:48:53.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:52 smithi186 ceph-mon[31814]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-04-23T14:48:53.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.113+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7f3124017070 con 0x7f3138076040 2024-04-23T14:48:53.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.115+0000 7f312fe00640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f311c0a3c30 0x7f311c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.115+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f31240cfe90 con 0x7f3138076040 2024-04-23T14:48:53.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.115+0000 7f3137400640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f311c0a3c30 0x7f311c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.116+0000 7f3137400640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f311c0a3c30 0x7f311c0a60f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3128009b40 tx=0x7f3128005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:53.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.120+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f312409c4b0 con 0x7f3138076040 2024-04-23T14:48:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.358+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3138062440 con 0x7f311c0a3c30 2024-04-23T14:48:53.418 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: 2024-04-23T14:48:53.098+0000 7f19c8000700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-23T14:48:53.418 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: 2024-04-23T14:48:53.098+0000 7f19c8000700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-23T14:48:53.418 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: 2024-04-23T14:48:53.098+0000 7f19c8000700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-23T14:48:53.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.430+0000 7f312fe00640 1 -- 172.21.15.7:0/2070955958 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3138062440 con 0x7f311c0a3c30 2024-04-23T14:48:53.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f311c0a3c30 msgr2=0x7f311c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f311c0a3c30 0x7f311c0a60f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3128009b40 tx=0x7f3128005e50 comp rx=0 tx=0).stop 2024-04-23T14:48:53.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 msgr2=0x7f313819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 0x7f313819ee30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f312400b4a0 tx=0x7f312400b960 comp rx=0 tx=0).stop 2024-04-23T14:48:53.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 shutdown_connections 2024-04-23T14:48:53.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f311c0a3c30 0x7f311c0a60f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f313810e620 0x7f31381a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3138076040 0x7f313819ee30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 --2- 172.21.15.7:0/2070955958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138074a60 0x7f313819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.433+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 >> 172.21.15.7:0/2070955958 conn(0x7f31380fd5e0 msgr2=0x7f31381019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:53.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.434+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 shutdown_connections 2024-04-23T14:48:53.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.434+0000 7f313e200640 1 -- 172.21.15.7:0/2070955958 wait complete. 2024-04-23T14:48:53.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 -- 172.21.15.7:0/2460505517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8076040 msgr2=0x7fecb8074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 --2- 172.21.15.7:0/2460505517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8076040 0x7fecb8074490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feca8009900 tx=0x7feca802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 -- 172.21.15.7:0/2460505517 shutdown_connections 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 --2- 172.21.15.7:0/2460505517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecb8074a60 0x7fecb8074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 --2- 172.21.15.7:0/2460505517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecb8109f00 0x7fecb810c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 --2- 172.21.15.7:0/2460505517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8076040 0x7fecb8074490 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 -- 172.21.15.7:0/2460505517 >> 172.21.15.7:0/2460505517 conn(0x7fecb80fd5b0 msgr2=0x7fecb80ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 -- 172.21.15.7:0/2460505517 shutdown_connections 2024-04-23T14:48:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.673+0000 7fecbce00640 1 -- 172.21.15.7:0/2460505517 wait complete. 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.674+0000 7fecbce00640 1 Processor -- start 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.674+0000 7fecbce00640 1 -- start start 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.674+0000 7fecbce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecb8074a60 0x7fecb819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.674+0000 7fecbce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecb8076040 0x7fecb819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.674+0000 7fecbce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 0x7fecb81a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecbce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fecb810fdc0 con 0x7fecb8109f00 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecbce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fecb810fc40 con 0x7fecb8076040 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecbce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fecb810ff40 con 0x7fecb8074a60 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 0x7fecb81a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 0x7fecb81a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46252/0 (socket says 172.21.15.7:46252) 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 -- 172.21.15.7:0/3487048002 learned_addr learned my addr 172.21.15.7:0/3487048002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb5400640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecb8076040 0x7fecb819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb5e00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecb8074a60 0x7fecb819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 -- 172.21.15.7:0/3487048002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecb8074a60 msgr2=0x7fecb819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecb8074a60 0x7fecb819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 -- 172.21.15.7:0/3487048002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecb8076040 msgr2=0x7fecb819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecb8076040 0x7fecb819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.675+0000 7fecb6800640 1 -- 172.21.15.7:0/3487048002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb81a20e0 con 0x7fecb8109f00 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.676+0000 7fecb6800640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 0x7fecb81a1a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecb000eaa0 tx=0x7fecb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.676+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb000cdb0 con 0x7fecb8109f00 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.676+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecb0005020 con 0x7fecb8109f00 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.676+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00116d0 con 0x7fecb8109f00 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.676+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb81a23d0 con 0x7fecb8109f00 2024-04-23T14:48:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.676+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb81a28d0 con 0x7fecb8109f00 2024-04-23T14:48:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.677+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb8108c30 con 0x7fecb8109f00 2024-04-23T14:48:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.679+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fecb00051d0 con 0x7fecb8109f00 2024-04-23T14:48:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.681+0000 7fecaea00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec9c0a3c30 0x7fec9c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.681+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fecb00d0910 con 0x7fecb8109f00 2024-04-23T14:48:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.681+0000 7fecb5e00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec9c0a3c30 0x7fec9c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.682+0000 7fecb5e00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec9c0a3c30 0x7fec9c0a60f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feca8000c00 tx=0x7feca80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:53.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.685+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fecb0016030 con 0x7fecb8109f00 2024-04-23T14:48:53.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.934+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fecb8062440 con 0x7fec9c0a3c30 2024-04-23T14:48:53.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.942+0000 7fecaea00640 1 -- 172.21.15.7:0/3487048002 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fecb8062440 con 0x7fec9c0a3c30 2024-04-23T14:48:53.943 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_0/a2313d80-c0a6-47a1-ac3a-6ff4afedb789 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec9c0a3c30 msgr2=0x7fec9c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec9c0a3c30 0x7fec9c0a60f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feca8000c00 tx=0x7feca80314a0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 msgr2=0x7fecb81a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 0x7fecb81a1a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecb000eaa0 tx=0x7fecb000ef60 comp rx=0 tx=0).stop 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 shutdown_connections 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec9c0a3c30 0x7fec9c0a60f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecb8076040 0x7fecb819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8109f00 0x7fecb81a1a70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 --2- 172.21.15.7:0/3487048002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecb8074a60 0x7fecb819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 >> 172.21.15.7:0/3487048002 conn(0x7fecb80fd5b0 msgr2=0x7fecb8105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 shutdown_connections 2024-04-23T14:48:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:53.945+0000 7fecbce00640 1 -- 172.21.15.7:0/3487048002 wait complete. 2024-04-23T14:48:53.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-23T14:48:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: pgmap v386: 129 pgs: 129 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 958 B/s wr, 2 op/s 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] up:active 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: Cluster is now healthy 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-23T14:48:54.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:53 smithi007 ceph-mon[27906]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-04-23T14:48:54.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: pgmap v386: 129 pgs: 129 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 958 B/s wr, 2 op/s 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] up:active 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: Cluster is now healthy 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-23T14:48:54.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:53 smithi186 ceph-mon[31814]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: pgmap v386: 129 pgs: 129 active+clean; 582 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 958 B/s wr, 2 op/s 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] up:active 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: Cluster is now healthy 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-23T14:48:54.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:53 smithi137 ceph-mon[31694]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-04-23T14:48:54.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 -- 172.21.15.7:0/1696027602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 msgr2=0x7fa75c1057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 --2- 172.21.15.7:0/1696027602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c1057b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa744009900 tx=0x7fa74402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:54.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 -- 172.21.15.7:0/1696027602 shutdown_connections 2024-04-23T14:48:54.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 --2- 172.21.15.7:0/1696027602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa75c105cf0 0x7fa75c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 --2- 172.21.15.7:0/1696027602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c1057b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 --2- 172.21.15.7:0/1696027602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c104140 0x7fa75c104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.178+0000 7fa761c00640 1 -- 172.21.15.7:0/1696027602 >> 172.21.15.7:0/1696027602 conn(0x7fa75c0ff6b0 msgr2=0x7fa75c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:54.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.179+0000 7fa761c00640 1 -- 172.21.15.7:0/1696027602 shutdown_connections 2024-04-23T14:48:54.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.179+0000 7fa761c00640 1 -- 172.21.15.7:0/1696027602 wait complete. 2024-04-23T14:48:54.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 Processor -- start 2024-04-23T14:48:54.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 -- start start 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c104140 0x7fa75c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa75c105cf0 0x7fa75c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c10fcd0 con 0x7fa75c105330 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c10fb50 con 0x7fa75c105cf0 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.180+0000 7fa761c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c10fe50 con 0x7fa75c104140 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c19a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46264/0 (socket says 172.21.15.7:46264) 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 -- 172.21.15.7:0/273262257 learned_addr learned my addr 172.21.15.7:0/273262257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa75be00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c104140 0x7fa75c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa761200640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa75c105cf0 0x7fa75c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 -- 172.21.15.7:0/273262257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c104140 msgr2=0x7fa75c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c104140 0x7fa75c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 -- 172.21.15.7:0/273262257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa75c105cf0 msgr2=0x7fa75c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa75c105cf0 0x7fa75c1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.181+0000 7fa753400640 1 -- 172.21.15.7:0/273262257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c1a1f60 con 0x7fa75c105330 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.182+0000 7fa753400640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c19a880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa7440314e0 tx=0x7fa744003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.182+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74403f070 con 0x7fa75c105330 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.182+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa744031e40 con 0x7fa75c105330 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.182+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c1a21f0 con 0x7fa75c105330 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.182+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744035030 con 0x7fa75c105330 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.182+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c1a2730 con 0x7fa75c105330 2024-04-23T14:48:54.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.183+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c10b4d0 con 0x7fa75c105330 2024-04-23T14:48:54.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.185+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fa744042070 con 0x7fa75c105330 2024-04-23T14:48:54.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.187+0000 7fa759600640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7400a3c30 0x7fa7400a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.187+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fa7440f1140 con 0x7fa75c105330 2024-04-23T14:48:54.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.187+0000 7fa75be00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7400a3c30 0x7fa7400a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.188+0000 7fa75be00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7400a3c30 0x7fa7400a60f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa75c105190 tx=0x7fa74c009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:54.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.191+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa7440bd760 con 0x7fa75c105330 2024-04-23T14:48:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.431+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa75c0624d0 con 0x7fa7400a3c30 2024-04-23T14:48:54.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.495+0000 7fa759600640 1 -- 172.21.15.7:0/273262257 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa75c0624d0 con 0x7fa7400a3c30 2024-04-23T14:48:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.498+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7400a3c30 msgr2=0x7fa7400a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.498+0000 7fa761c00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7400a3c30 0x7fa7400a60f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa75c105190 tx=0x7fa74c009870 comp rx=0 tx=0).stop 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.498+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 msgr2=0x7fa75c19a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.498+0000 7fa761c00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c19a880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa7440314e0 tx=0x7fa744003c80 comp rx=0 tx=0).stop 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 shutdown_connections 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7400a3c30 0x7fa7400a60f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa75c105cf0 0x7fa75c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa75c105330 0x7fa75c19a880 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 --2- 172.21.15.7:0/273262257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c104140 0x7fa75c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 >> 172.21.15.7:0/273262257 conn(0x7fa75c0ff6b0 msgr2=0x7fa75c1086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 shutdown_connections 2024-04-23T14:48:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.499+0000 7fa761c00640 1 -- 172.21.15.7:0/273262257 wait complete. 2024-04-23T14:48:54.522 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-23T14:48:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 -- 172.21.15.7:0/3436549828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa010a210 msgr2=0x7fcaa0110aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 --2- 172.21.15.7:0/3436549828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa010a210 0x7fcaa0110aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fca98009ca0 tx=0x7fca9802a8b0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 -- 172.21.15.7:0/3436549828 shutdown_connections 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 --2- 172.21.15.7:0/3436549828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcaa0109850 0x7fcaa0109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 --2- 172.21.15.7:0/3436549828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa010a210 0x7fcaa0110aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 --2- 172.21.15.7:0/3436549828 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa0108660 0x7fcaa0108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 -- 172.21.15.7:0/3436549828 >> 172.21.15.7:0/3436549828 conn(0x7fcaa0077600 msgr2=0x7fcaa0079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 -- 172.21.15.7:0/3436549828 shutdown_connections 2024-04-23T14:48:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.740+0000 7fcaa6800640 1 -- 172.21.15.7:0/3436549828 wait complete. 2024-04-23T14:48:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 Processor -- start 2024-04-23T14:48:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 -- start start 2024-04-23T14:48:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 0x7fcaa019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcaa0109850 0x7fcaa019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa010a210 0x7fcaa01a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0114190 con 0x7fcaa0108660 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0114010 con 0x7fcaa0109850 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.741+0000 7fcaa6800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0114310 con 0x7fcaa010a210 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 0x7fcaa019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 0x7fcaa019e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46276/0 (socket says 172.21.15.7:46276) 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 -- 172.21.15.7:0/1532374498 learned_addr learned my addr 172.21.15.7:0/1532374498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9ea00640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcaa0109850 0x7fcaa019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9fe00640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa010a210 0x7fcaa01a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 -- 172.21.15.7:0/1532374498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa010a210 msgr2=0x7fcaa01a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa010a210 0x7fcaa01a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 -- 172.21.15.7:0/1532374498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcaa0109850 msgr2=0x7fcaa019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcaa0109850 0x7fcaa019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 -- 172.21.15.7:0/1532374498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa01a63f0 con 0x7fcaa0108660 2024-04-23T14:48:54.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9fe00640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa010a210 0x7fcaa01a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.742+0000 7fca9f400640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 0x7fcaa019e7d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c970 tx=0x7fca9000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.743+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90004220 con 0x7fcaa0108660 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.743+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca900043c0 con 0x7fcaa0108660 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.743+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa01a66e0 con 0x7fcaa0108660 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.743+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90004a00 con 0x7fcaa0108660 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.743+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa01a6be0 con 0x7fcaa0108660 2024-04-23T14:48:54.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.744+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa010f980 con 0x7fcaa0108660 2024-04-23T14:48:54.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.746+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138645+0+0 (secure 0 0 0) 0x7fca900079b0 con 0x7fcaa0108660 2024-04-23T14:48:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.747+0000 7fca97e00640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fca840a3bb0 0x7fca840a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.748+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fca900d05d0 con 0x7fcaa0108660 2024-04-23T14:48:54.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.748+0000 7fca9ea00640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fca840a3bb0 0x7fca840a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.749+0000 7fca9ea00640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fca840a3bb0 0x7fca840a6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca8c005e10 tx=0x7fca8c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.752+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fca90014030 con 0x7fcaa0108660 2024-04-23T14:48:54.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:54.892+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fca90007ca0 con 0x7fcaa0108660 2024-04-23T14:48:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.002+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fcaa0062440 con 0x7fca840a3bb0 2024-04-23T14:48:55.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.014+0000 7fca97e00640 1 -- 172.21.15.7:0/1532374498 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fcaa0062440 con 0x7fca840a3bb0 2024-04-23T14:48:55.015 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_1/ed307083-5fcc-4849-968d-cd75d660e28f 2024-04-23T14:48:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fca840a3bb0 msgr2=0x7fca840a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fca840a3bb0 0x7fca840a6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca8c005e10 tx=0x7fca8c005da0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 msgr2=0x7fcaa019e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 0x7fcaa019e7d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c970 tx=0x7fca9000ce30 comp rx=0 tx=0).stop 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 shutdown_connections 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fca840a3bb0 0x7fca840a6070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcaa0109850 0x7fcaa019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcaa010a210 0x7fcaa01a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 --2- 172.21.15.7:0/1532374498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaa0108660 0x7fcaa019e7d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 >> 172.21.15.7:0/1532374498 conn(0x7fcaa0077600 msgr2=0x7fcaa010cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 shutdown_connections 2024-04-23T14:48:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.017+0000 7fcaa6800640 1 -- 172.21.15.7:0/1532374498 wait complete. 2024-04-23T14:48:55.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:48:55.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:54 smithi007 ceph-mon[27906]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:55.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:54 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] up:active 2024-04-23T14:48:55.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:54 smithi007 ceph-mon[27906]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-23T14:48:55.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:54 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:48:55.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:54 smithi007 ceph-mon[27906]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:55.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:54 smithi186 ceph-mon[31814]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:55.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:54 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] up:active 2024-04-23T14:48:55.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:54 smithi186 ceph-mon[31814]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-23T14:48:55.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:54 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:48:55.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:54 smithi186 ceph-mon[31814]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:54 smithi137 ceph-mon[31694]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:54 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] up:active 2024-04-23T14:48:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:54 smithi137 ceph-mon[31694]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-23T14:48:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:54 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:48:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:54 smithi137 ceph-mon[31694]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:55.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.243+0000 7f6974c00640 1 -- 172.21.15.7:0/1165029148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 msgr2=0x7f697010a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.243+0000 7f6974c00640 1 --2- 172.21.15.7:0/1165029148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f697010a170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6968009900 tx=0x7f696802a410 comp rx=0 tx=0).stop 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 -- 172.21.15.7:0/1165029148 shutdown_connections 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 --2- 172.21.15.7:0/1165029148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6970100690 0x7f69701077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 --2- 172.21.15.7:0/1165029148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f697010a170 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 --2- 172.21.15.7:0/1165029148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700ffca0 0x7f69701000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 -- 172.21.15.7:0/1165029148 >> 172.21.15.7:0/1165029148 conn(0x7f69700fb7f0 msgr2=0x7f69700fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 -- 172.21.15.7:0/1165029148 shutdown_connections 2024-04-23T14:48:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.244+0000 7f6974c00640 1 -- 172.21.15.7:0/1165029148 wait complete. 2024-04-23T14:48:55.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 Processor -- start 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 -- start start 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700ffca0 0x7f697019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6970100690 0x7f697019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f69701a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f697010dbd0 con 0x7f6970107d20 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f697010da50 con 0x7f6970100690 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f6974c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f697010dd50 con 0x7f69700ffca0 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f696e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f69701a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f696e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f69701a19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46288/0 (socket says 172.21.15.7:46288) 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.245+0000 7f696e800640 1 -- 172.21.15.7:0/2259712270 learned_addr learned my addr 172.21.15.7:0/2259712270 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696d400640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6970100690 0x7f697019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696de00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700ffca0 0x7f697019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696e800640 1 -- 172.21.15.7:0/2259712270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700ffca0 msgr2=0x7f697019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696e800640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700ffca0 0x7f697019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696e800640 1 -- 172.21.15.7:0/2259712270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6970100690 msgr2=0x7f697019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696e800640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6970100690 0x7f697019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696e800640 1 -- 172.21.15.7:0/2259712270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69701a2010 con 0x7f6970107d20 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.246+0000 7f696e800640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f69701a19a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6968005ab0 tx=0x7f6968003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.247+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696803f070 con 0x7f6970107d20 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.247+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69701a22a0 con 0x7f6970107d20 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.247+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6968003e40 con 0x7f6970107d20 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.247+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968035030 con 0x7f6970107d20 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.247+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69701a27e0 con 0x7f6970107d20 2024-04-23T14:48:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.248+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69701a2b00 con 0x7f6970107d20 2024-04-23T14:48:55.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.250+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f6968042070 con 0x7f6970107d20 2024-04-23T14:48:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.252+0000 7f6966a00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f69540a3cc0 0x7f69540a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.253+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f69680f1210 con 0x7f6970107d20 2024-04-23T14:48:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.253+0000 7f696de00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f69540a3cc0 0x7f69540a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.253+0000 7f696de00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f69540a3cc0 0x7f69540a6180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6960005c40 tx=0x7f696000a780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:55.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.258+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f69680bd730 con 0x7f6970107d20 2024-04-23T14:48:55.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.505+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69701a2e90 con 0x7f6970107d20 2024-04-23T14:48:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.507+0000 7f6966a00640 1 -- 172.21.15.7:0/2259712270 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11926 (secure 0 0 0) 0x7f696803be20 con 0x7f6970107d20 2024-04-23T14:48:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:55.508 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:53.850115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[34484,34526,34424,34448,24508]},"id":1}]} 2024-04-23T14:48:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f69540a3cc0 msgr2=0x7f69540a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f69540a3cc0 0x7f69540a6180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6960005c40 tx=0x7f696000a780 comp rx=0 tx=0).stop 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 msgr2=0x7f69701a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f69701a19a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6968005ab0 tx=0x7f6968003cd0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 shutdown_connections 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f69540a3cc0 0x7f69540a6180 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6970100690 0x7f697019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6970107d20 0x7f69701a19a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 --2- 172.21.15.7:0/2259712270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700ffca0 0x7f697019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 >> 172.21.15.7:0/2259712270 conn(0x7f69700fb7f0 msgr2=0x7f69700fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 shutdown_connections 2024-04-23T14:48:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.510+0000 7f6974c00640 1 -- 172.21.15.7:0/2259712270 wait complete. 2024-04-23T14:48:55.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 -- 172.21.15.7:0/3555772434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 msgr2=0x7f6634076de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 --2- 172.21.15.7:0/3555772434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f6634076de0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6624009900 tx=0x7f662402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 -- 172.21.15.7:0/3555772434 shutdown_connections 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 --2- 172.21.15.7:0/3555772434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 0x7f6634078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 --2- 172.21.15.7:0/3555772434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 0x7f6634078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 --2- 172.21.15.7:0/3555772434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f6634076de0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 -- 172.21.15.7:0/3555772434 >> 172.21.15.7:0/3555772434 conn(0x7f66340ff610 msgr2=0x7f6634101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 -- 172.21.15.7:0/3555772434 shutdown_connections 2024-04-23T14:48:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.743+0000 7f6639c00640 1 -- 172.21.15.7:0/3555772434 wait complete. 2024-04-23T14:48:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.744+0000 7f6639c00640 1 Processor -- start 2024-04-23T14:48:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.744+0000 7f6639c00640 1 -- start start 2024-04-23T14:48:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6639c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f663419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6639c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 0x7f663419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6639c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 0x7f66341a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6639c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6634114000 con 0x7f66340769c0 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6639c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6634113e80 con 0x7f6634077c00 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6639c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6634114180 con 0x7f66340785a0 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6633e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f663419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6633e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f663419e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46304/0 (socket says 172.21.15.7:46304) 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6633e00640 1 -- 172.21.15.7:0/238704812 learned_addr learned my addr 172.21.15.7:0/238704812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.745+0000 7f6633400640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 0x7f663419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6639200640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 0x7f66341a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633e00640 1 -- 172.21.15.7:0/238704812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 msgr2=0x7f66341a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633e00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 0x7f66341a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633e00640 1 -- 172.21.15.7:0/238704812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 msgr2=0x7f663419ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633e00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 0x7f663419ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633e00640 1 -- 172.21.15.7:0/238704812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66341a62d0 con 0x7f66340769c0 2024-04-23T14:48:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6639200640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 0x7f66341a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633400640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 0x7f663419ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.746+0000 7f6633e00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f663419e6b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f66240314e0 tx=0x7f6624003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.747+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662403f070 con 0x7f66340769c0 2024-04-23T14:48:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.747+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6624031c40 con 0x7f66340769c0 2024-04-23T14:48:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.747+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66341a6560 con 0x7f66340769c0 2024-04-23T14:48:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.747+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624035030 con 0x7f66340769c0 2024-04-23T14:48:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.747+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66341a6a50 con 0x7f66340769c0 2024-04-23T14:48:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.748+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6634110b80 con 0x7f66340769c0 2024-04-23T14:48:55.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.750+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f6624042070 con 0x7f66340769c0 2024-04-23T14:48:55.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.751+0000 7f6630c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f66180a3c40 0x7f66180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:55.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.752+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f66240f11e0 con 0x7f66340769c0 2024-04-23T14:48:55.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.752+0000 7f6633400640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f66180a3c40 0x7f66180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:55.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.753+0000 7f6633400640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f66180a3c40 0x7f66180a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f663419fbc0 tx=0x7f6620005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:55.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.756+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f66240bd6a0 con 0x7f66340769c0 2024-04-23T14:48:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.964+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6634062c00 con 0x7f66340769c0 2024-04-23T14:48:55.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.968+0000 7f6630c00640 1 -- 172.21.15.7:0/238704812 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24527 (secure 0 0 0) 0x7f66240bcfa0 con 0x7f66340769c0 2024-04-23T14:48:55.970 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:55.970 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:43.702260+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f66180a3c40 msgr2=0x7f66180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f66180a3c40 0x7f66180a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f663419fbc0 tx=0x7f6620005f90 comp rx=0 tx=0).stop 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 msgr2=0x7f663419e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f663419e6b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f66240314e0 tx=0x7f6624003c10 comp rx=0 tx=0).stop 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 shutdown_connections 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f66180a3c40 0x7f66180a6100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6634077c00 0x7f663419ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66340785a0 0x7f66341a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 --2- 172.21.15.7:0/238704812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66340769c0 0x7f663419e6b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 >> 172.21.15.7:0/238704812 conn(0x7f66340ff610 msgr2=0x7f6634100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 shutdown_connections 2024-04-23T14:48:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:55.971+0000 7f6639c00640 1 -- 172.21.15.7:0/238704812 wait complete. 2024-04-23T14:48:55.991 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-23T14:48:55.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T14:48:56.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:55 smithi137 ceph-mon[31694]: pgmap v387: 129 pgs: 129 active+clean; 586 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 193 B/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-23T14:48:56.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:55 smithi137 ceph-mon[31694]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:56.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:55 smithi137 ceph-mon[31694]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-04-23T14:48:56.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:55 smithi137 ceph-mon[31694]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:56.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:55 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2259712270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 -- 172.21.15.7:0/3290422346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 msgr2=0x7f54681058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 --2- 172.21.15.7:0/3290422346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f54681058f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5454009900 tx=0x7f545402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 -- 172.21.15.7:0/3290422346 shutdown_connections 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 --2- 172.21.15.7:0/3290422346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468105e30 0x7f546810c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 --2- 172.21.15.7:0/3290422346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f54681058f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 --2- 172.21.15.7:0/3290422346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5468104280 0x7f54681046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 -- 172.21.15.7:0/3290422346 >> 172.21.15.7:0/3290422346 conn(0x7f54680ff7f0 msgr2=0x7f5468101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 -- 172.21.15.7:0/3290422346 shutdown_connections 2024-04-23T14:48:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.202+0000 7f546f600640 1 -- 172.21.15.7:0/3290422346 wait complete. 2024-04-23T14:48:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.203+0000 7f546f600640 1 Processor -- start 2024-04-23T14:48:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 -- start start 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468104280 0x7f546819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f546819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5468105e30 0x7f54681a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f546810fe10 con 0x7f5468105470 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f546810fc90 con 0x7f5468105e30 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f546f600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f546810ff90 con 0x7f5468104280 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f5467e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f546819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f5467e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f546819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46320/0 (socket says 172.21.15.7:46320) 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.204+0000 7f5467e00640 1 -- 172.21.15.7:0/3522412496 learned_addr learned my addr 172.21.15.7:0/3522412496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f546d600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5468105e30 0x7f54681a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f546cc00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468104280 0x7f546819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5467e00640 1 -- 172.21.15.7:0/3522412496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468104280 msgr2=0x7f546819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5467e00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468104280 0x7f546819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5467e00640 1 -- 172.21.15.7:0/3522412496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5468105e30 msgr2=0x7f54681a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5467e00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5468105e30 0x7f54681a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5467e00640 1 -- 172.21.15.7:0/3522412496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54681a2090 con 0x7f5468105470 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f546cc00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468104280 0x7f546819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5467e00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f546819a9b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54540314e0 tx=0x7f5454003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545403f070 con 0x7f5468105470 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5454031e40 con 0x7f5468105470 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54681a2320 con 0x7f5468105470 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.205+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454035030 con 0x7f5468105470 2024-04-23T14:48:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.206+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54681a2860 con 0x7f5468105470 2024-04-23T14:48:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.207+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546810b5a0 con 0x7f5468105470 2024-04-23T14:48:56.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.209+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f5454042070 con 0x7f5468105470 2024-04-23T14:48:56.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.211+0000 7f5465600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54500a3cc0 0x7f54500a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.211+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f54540f12d0 con 0x7f5468105470 2024-04-23T14:48:56.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.211+0000 7f546cc00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54500a3cc0 0x7f54500a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.212+0000 7f546cc00640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54500a3cc0 0x7f54500a6180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54681052d0 tx=0x7f545c005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:56.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.215+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f54540bd790 con 0x7f5468105470 2024-04-23T14:48:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:55 smithi007 ceph-mon[27906]: pgmap v387: 129 pgs: 129 active+clean; 586 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 193 B/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-23T14:48:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:55 smithi007 ceph-mon[27906]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:55 smithi007 ceph-mon[27906]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-04-23T14:48:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:55 smithi007 ceph-mon[27906]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:55 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2259712270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:55 smithi186 ceph-mon[31814]: pgmap v387: 129 pgs: 129 active+clean; 586 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 193 B/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-23T14:48:56.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:55 smithi186 ceph-mon[31814]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:56.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:55 smithi186 ceph-mon[31814]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-04-23T14:48:56.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:55 smithi186 ceph-mon[31814]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:56.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:55 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2259712270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:48:56.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.408+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5468062440 con 0x7f54500a3cc0 2024-04-23T14:48:56.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.427+0000 7f5465600640 1 -- 172.21.15.7:0/3522412496 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340505 (secure 0 0 0) 0x7f5468062440 con 0x7f54500a3cc0 2024-04-23T14:48:56.433 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:56.435 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.434+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54500a3cc0 msgr2=0x7f54500a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.434+0000 7f546f600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54500a3cc0 0x7f54500a6180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54681052d0 tx=0x7f545c005e70 comp rx=0 tx=0).stop 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.434+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 msgr2=0x7f546819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f546819a9b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54540314e0 tx=0x7f5454003c80 comp rx=0 tx=0).stop 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 shutdown_connections 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54500a3cc0 0x7f54500a6180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5468105e30 0x7f54681a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5468105470 0x7f546819a9b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 --2- 172.21.15.7:0/3522412496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5468104280 0x7f546819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 >> 172.21.15.7:0/3522412496 conn(0x7f54680ff7f0 msgr2=0x7f5468108770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 shutdown_connections 2024-04-23T14:48:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.435+0000 7f546f600640 1 -- 172.21.15.7:0/3522412496 wait complete. 2024-04-23T14:48:56.456 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-04-23T14:48:56.323307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639053,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":161,"num_read_kb":179,"num_write":393,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":324,"ondisk_log_size":324,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371508,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570316,"statfs":{"total":1151940427776,"available":1151560003584,"internally_reserved":0,"allocated":14372864,"data_stored":7808501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45826,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":25,"num_read_kb":60,"num_write":166,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005846"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.793477+0000","last_change":"2024-04-23T14:48:24.207434+0000","last_active":"2024-04-23T14:48:43.793477+0000","last_peered":"2024-04-23T14:48:43.793477+0000","last_clean":"2024-04-23T14:48:43.793477+0000","last_became_active":"2024-04-23T14:48:24.204367+0000","last_became_peered":"2024-04-23T14:48:24.204367+0000","last_unstale":"2024-04-23T14:48:43.793477+0000","last_undegraded":"2024-04-23T14:48:43.793477+0000","last_fullsized":"2024-04-23T14:48:43.793477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:50.125997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723646+0000","last_change":"2024-04-23T14:48:24.207435+0000","last_active":"2024-04-23T14:48:43.723646+0000","last_peered":"2024-04-23T14:48:43.723646+0000","last_clean":"2024-04-23T14:48:43.723646+0000","last_became_active":"2024-04-23T14:48:24.207086+0000","last_became_peered":"2024-04-23T14:48:24.207086+0000","last_unstale":"2024-04-23T14:48:43.723646+0000","last_undegraded":"2024-04-23T14:48:43.723646+0000","last_fullsized":"2024-04-23T14:48:43.723646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:53:39.864396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.725248+0000","last_change":"2024-04-23T14:48:24.208293+0000","last_active":"2024-04-23T14:48:43.725248+0000","last_peered":"2024-04-23T14:48:43.725248+0000","last_clean":"2024-04-23T14:48:43.725248+0000","last_became_active":"2024-04-23T14:48:24.207935+0000","last_became_peered":"2024-04-23T14:48:24.207935+0000","last_unstale":"2024-04-23T14:48:43.725248+0000","last_undegraded":"2024-04-23T14:48:43.725248+0000","last_fullsized":"2024-04-23T14:48:43.725248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:26.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727514+0000","last_change":"2024-04-23T14:48:24.201916+0000","last_active":"2024-04-23T14:48:43.727514+0000","last_peered":"2024-04-23T14:48:43.727514+0000","last_clean":"2024-04-23T14:48:43.727514+0000","last_became_active":"2024-04-23T14:48:24.201500+0000","last_became_peered":"2024-04-23T14:48:24.201500+0000","last_unstale":"2024-04-23T14:48:43.727514+0000","last_undegraded":"2024-04-23T14:48:43.727514+0000","last_fullsized":"2024-04-23T14:48:43.727514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:02.697609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724795+0000","last_change":"2024-04-23T14:48:24.210928+0000","last_active":"2024-04-23T14:48:43.724795+0000","last_peered":"2024-04-23T14:48:43.724795+0000","last_clean":"2024-04-23T14:48:43.724795+0000","last_became_active":"2024-04-23T14:48:24.210576+0000","last_became_peered":"2024-04-23T14:48:24.210576+0000","last_unstale":"2024-04-23T14:48:43.724795+0000","last_undegraded":"2024-04-23T14:48:43.724795+0000","last_fullsized":"2024-04-23T14:48:43.724795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:49.662992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009463+0000","last_change":"2024-04-23T14:48:24.206641+0000","last_active":"2024-04-23T14:48:44.009463+0000","last_peered":"2024-04-23T14:48:44.009463+0000","last_clean":"2024-04-23T14:48:44.009463+0000","last_became_active":"2024-04-23T14:48:24.206298+0000","last_became_peered":"2024-04-23T14:48:24.206298+0000","last_unstale":"2024-04-23T14:48:44.009463+0000","last_undegraded":"2024-04-23T14:48:44.009463+0000","last_fullsized":"2024-04-23T14:48:44.009463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:50.150157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734531+0000","last_change":"2024-04-23T14:48:24.204762+0000","last_active":"2024-04-23T14:48:43.734531+0000","last_peered":"2024-04-23T14:48:43.734531+0000","last_clean":"2024-04-23T14:48:43.734531+0000","last_became_active":"2024-04-23T14:48:24.204396+0000","last_became_peered":"2024-04-23T14:48:24.204396+0000","last_unstale":"2024-04-23T14:48:43.734531+0000","last_undegraded":"2024-04-23T14:48:43.734531+0000","last_fullsized":"2024-04-23T14:48:43.734531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:53.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.007927+0000","last_change":"2024-04-23T14:48:24.214064+0000","last_active":"2024-04-23T14:48:44.007927+0000","last_peered":"2024-04-23T14:48:44.007927+0000","last_clean":"2024-04-23T14:48:44.007927+0000","last_became_active":"2024-04-23T14:48:24.213748+0000","last_became_peered":"2024-04-23T14:48:24.213748+0000","last_unstale":"2024-04-23T14:48:44.007927+0000","last_undegraded":"2024-04-23T14:48:44.007927+0000","last_fullsized":"2024-04-23T14:48:44.007927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:52.011095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729495+0000","last_change":"2024-04-23T14:48:24.196420+0000","last_active":"2024-04-23T14:48:43.729495+0000","last_peered":"2024-04-23T14:48:43.729495+0000","last_clean":"2024-04-23T14:48:43.729495+0000","last_became_active":"2024-04-23T14:48:24.196086+0000","last_became_peered":"2024-04-23T14:48:24.196086+0000","last_unstale":"2024-04-23T14:48:43.729495+0000","last_undegraded":"2024-04-23T14:48:43.729495+0000","last_fullsized":"2024-04-23T14:48:43.729495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:38.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009956+0000","last_change":"2024-04-23T14:48:24.208801+0000","last_active":"2024-04-23T14:48:44.009956+0000","last_peered":"2024-04-23T14:48:44.009956+0000","last_clean":"2024-04-23T14:48:44.009956+0000","last_became_active":"2024-04-23T14:48:24.208088+0000","last_became_peered":"2024-04-23T14:48:24.208088+0000","last_unstale":"2024-04-23T14:48:44.009956+0000","last_undegraded":"2024-04-23T14:48:44.009956+0000","last_fullsized":"2024-04-23T14:48:44.009956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:30.684820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735191+0000","last_change":"2024-04-23T14:48:24.207387+0000","last_active":"2024-04-23T14:48:43.735191+0000","last_peered":"2024-04-23T14:48:43.735191+0000","last_clean":"2024-04-23T14:48:43.735191+0000","last_became_active":"2024-04-23T14:48:24.205524+0000","last_became_peered":"2024-04-23T14:48:24.205524+0000","last_unstale":"2024-04-23T14:48:43.735191+0000","last_undegraded":"2024-04-23T14:48:43.735191+0000","last_fullsized":"2024-04-23T14:48:43.735191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:24:52.196823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727202+0000","last_change":"2024-04-23T14:48:24.198132+0000","last_active":"2024-04-23T14:48:43.727202+0000","last_peered":"2024-04-23T14:48:43.727202+0000","last_clean":"2024-04-23T14:48:43.727202+0000","last_became_active":"2024-04-23T14:48:24.197714+0000","last_became_peered":"2024-04-23T14:48:24.197714+0000","last_unstale":"2024-04-23T14:48:43.727202+0000","last_undegraded":"2024-04-23T14:48:43.727202+0000","last_fullsized":"2024-04-23T14:48:43.727202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:41.208307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724810+0000","last_change":"2024-04-23T14:48:24.205780+0000","last_active":"2024-04-23T14:48:43.724810+0000","last_peered":"2024-04-23T14:48:43.724810+0000","last_clean":"2024-04-23T14:48:43.724810+0000","last_became_active":"2024-04-23T14:48:24.205413+0000","last_became_peered":"2024-04-23T14:48:24.205413+0000","last_unstale":"2024-04-23T14:48:43.724810+0000","last_undegraded":"2024-04-23T14:48:43.724810+0000","last_fullsized":"2024-04-23T14:48:43.724810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:06.002666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723759+0000","last_change":"2024-04-23T14:48:24.205304+0000","last_active":"2024-04-23T14:48:43.723759+0000","last_peered":"2024-04-23T14:48:43.723759+0000","last_clean":"2024-04-23T14:48:43.723759+0000","last_became_active":"2024-04-23T14:48:24.204915+0000","last_became_peered":"2024-04-23T14:48:24.204915+0000","last_unstale":"2024-04-23T14:48:43.723759+0000","last_undegraded":"2024-04-23T14:48:43.723759+0000","last_fullsized":"2024-04-23T14:48:43.723759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:53.835101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723561+0000","last_change":"2024-04-23T14:48:24.208371+0000","last_active":"2024-04-23T14:48:43.723561+0000","last_peered":"2024-04-23T14:48:43.723561+0000","last_clean":"2024-04-23T14:48:43.723561+0000","last_became_active":"2024-04-23T14:48:24.208084+0000","last_became_peered":"2024-04-23T14:48:24.208084+0000","last_unstale":"2024-04-23T14:48:43.723561+0000","last_undegraded":"2024-04-23T14:48:43.723561+0000","last_fullsized":"2024-04-23T14:48:43.723561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:01.263469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.726357+0000","last_change":"2024-04-23T14:48:24.204211+0000","last_active":"2024-04-23T14:48:43.726357+0000","last_peered":"2024-04-23T14:48:43.726357+0000","last_clean":"2024-04-23T14:48:43.726357+0000","last_became_active":"2024-04-23T14:48:24.203890+0000","last_became_peered":"2024-04-23T14:48:24.203890+0000","last_unstale":"2024-04-23T14:48:43.726357+0000","last_undegraded":"2024-04-23T14:48:43.726357+0000","last_fullsized":"2024-04-23T14:48:43.726357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:05.730785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.793242+0000","last_change":"2024-04-23T14:48:24.204731+0000","last_active":"2024-04-23T14:48:43.793242+0000","last_peered":"2024-04-23T14:48:43.793242+0000","last_clean":"2024-04-23T14:48:43.793242+0000","last_became_active":"2024-04-23T14:48:24.204121+0000","last_became_peered":"2024-04-23T14:48:24.204121+0000","last_unstale":"2024-04-23T14:48:43.793242+0000","last_undegraded":"2024-04-23T14:48:43.793242+0000","last_fullsized":"2024-04-23T14:48:43.793242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:04:57.777924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.719681+0000","last_change":"2024-04-23T14:48:24.208297+0000","last_active":"2024-04-23T14:48:43.719681+0000","last_peered":"2024-04-23T14:48:43.719681+0000","last_clean":"2024-04-23T14:48:43.719681+0000","last_became_active":"2024-04-23T14:48:24.207960+0000","last_became_peered":"2024-04-23T14:48:24.207960+0000","last_unstale":"2024-04-23T14:48:43.719681+0000","last_undegraded":"2024-04-23T14:48:43.719681+0000","last_fullsized":"2024-04-23T14:48:43.719681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:46.393630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723697+0000","last_change":"2024-04-23T14:48:24.212739+0000","last_active":"2024-04-23T14:48:43.723697+0000","last_peered":"2024-04-23T14:48:43.723697+0000","last_clean":"2024-04-23T14:48:43.723697+0000","last_became_active":"2024-04-23T14:48:24.212259+0000","last_became_peered":"2024-04-23T14:48:24.212259+0000","last_unstale":"2024-04-23T14:48:43.723697+0000","last_undegraded":"2024-04-23T14:48:43.723697+0000","last_fullsized":"2024-04-23T14:48:43.723697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:15:23.268086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722833+0000","last_change":"2024-04-23T14:48:28.692932+0000","last_active":"2024-04-23T14:48:43.722833+0000","last_peered":"2024-04-23T14:48:43.722833+0000","last_clean":"2024-04-23T14:48:43.722833+0000","last_became_active":"2024-04-23T14:48:28.692188+0000","last_became_peered":"2024-04-23T14:48:28.692188+0000","last_unstale":"2024-04-23T14:48:43.722833+0000","last_undegraded":"2024-04-23T14:48:43.722833+0000","last_fullsized":"2024-04-23T14:48:43.722833+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:44.695181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:53.872282+0000","last_change":"2024-04-23T14:48:23.167934+0000","last_active":"2024-04-23T14:48:53.872282+0000","last_peered":"2024-04-23T14:48:53.872282+0000","last_clean":"2024-04-23T14:48:53.872282+0000","last_became_active":"2024-04-23T14:48:23.167483+0000","last_became_peered":"2024-04-23T14:48:23.167483+0000","last_unstale":"2024-04-23T14:48:53.872282+0000","last_undegraded":"2024-04-23T14:48:53.872282+0000","last_fullsized":"2024-04-23T14:48:53.872282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:16.011021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009331+0000","last_change":"2024-04-23T14:48:24.209028+0000","last_active":"2024-04-23T14:48:44.009331+0000","last_peered":"2024-04-23T14:48:44.009331+0000","last_clean":"2024-04-23T14:48:44.009331+0000","last_became_active":"2024-04-23T14:48:24.208648+0000","last_became_peered":"2024-04-23T14:48:24.208648+0000","last_unstale":"2024-04-23T14:48:44.009331+0000","last_undegraded":"2024-04-23T14:48:44.009331+0000","last_fullsized":"2024-04-23T14:48:44.009331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:28:17.432131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.011555+0000","last_change":"2024-04-23T14:48:44.011555+0000","last_active":"2024-04-23T14:48:44.011555+0000","last_peered":"2024-04-23T14:48:44.011555+0000","last_clean":"2024-04-23T14:48:44.011555+0000","last_became_active":"2024-04-23T14:48:44.010556+0000","last_became_peered":"2024-04-23T14:48:44.010556+0000","last_unstale":"2024-04-23T14:48:44.011555+0000","last_undegraded":"2024-04-23T14:48:44.011555+0000","last_fullsized":"2024-04-23T14:48:44.011555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:03.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009624+0000","last_change":"2024-04-23T14:48:23.170507+0000","last_active":"2024-04-23T14:48:44.009624+0000","last_peered":"2024-04-23T14:48:44.009624+0000","last_clean":"2024-04-23T14:48:44.009624+0000","last_became_active":"2024-04-23T14:48:23.166478+0000","last_became_peered":"2024-04-23T14:48:23.166478+0000","last_unstale":"2024-04-23T14:48:44.009624+0000","last_undegraded":"2024-04-23T14:48:44.009624+0000","last_fullsized":"2024-04-23T14:48:44.009624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:13.163752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724617+0000","last_change":"2024-04-23T14:48:24.202716+0000","last_active":"2024-04-23T14:48:43.724617+0000","last_peered":"2024-04-23T14:48:43.724617+0000","last_clean":"2024-04-23T14:48:43.724617+0000","last_became_active":"2024-04-23T14:48:24.201811+0000","last_became_peered":"2024-04-23T14:48:24.201811+0000","last_unstale":"2024-04-23T14:48:43.724617+0000","last_undegraded":"2024-04-23T14:48:43.724617+0000","last_fullsized":"2024-04-23T14:48:43.724617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:12.834493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724995+0000","last_change":"2024-04-23T14:48:28.690956+0000","last_active":"2024-04-23T14:48:43.724995+0000","last_peered":"2024-04-23T14:48:43.724995+0000","last_clean":"2024-04-23T14:48:43.724995+0000","last_became_active":"2024-04-23T14:48:28.689949+0000","last_became_peered":"2024-04-23T14:48:28.689949+0000","last_unstale":"2024-04-23T14:48:43.724995+0000","last_undegraded":"2024-04-23T14:48:43.724995+0000","last_fullsized":"2024-04-23T14:48:43.724995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:57.646314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.865604+0000","last_change":"2024-04-23T14:48:23.175420+0000","last_active":"2024-04-23T14:48:52.865604+0000","last_peered":"2024-04-23T14:48:52.865604+0000","last_clean":"2024-04-23T14:48:52.865604+0000","last_became_active":"2024-04-23T14:48:23.175009+0000","last_became_peered":"2024-04-23T14:48:23.175009+0000","last_unstale":"2024-04-23T14:48:52.865604+0000","last_undegraded":"2024-04-23T14:48:52.865604+0000","last_fullsized":"2024-04-23T14:48:52.865604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:17.902941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728344+0000","last_change":"2024-04-23T14:48:24.197838+0000","last_active":"2024-04-23T14:48:43.728344+0000","last_peered":"2024-04-23T14:48:43.728344+0000","last_clean":"2024-04-23T14:48:43.728344+0000","last_became_active":"2024-04-23T14:48:24.196112+0000","last_became_peered":"2024-04-23T14:48:24.196112+0000","last_unstale":"2024-04-23T14:48:43.728344+0000","last_undegraded":"2024-04-23T14:48:43.728344+0000","last_fullsized":"2024-04-23T14:48:43.728344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:06.829973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723640+0000","last_change":"2024-04-23T14:48:28.691296+0000","last_active":"2024-04-23T14:48:43.723640+0000","last_peered":"2024-04-23T14:48:43.723640+0000","last_clean":"2024-04-23T14:48:43.723640+0000","last_became_active":"2024-04-23T14:48:28.690695+0000","last_became_peered":"2024-04-23T14:48:28.690695+0000","last_unstale":"2024-04-23T14:48:43.723640+0000","last_undegraded":"2024-04-23T14:48:43.723640+0000","last_fullsized":"2024-04-23T14:48:43.723640+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:17.028864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.863757+0000","last_change":"2024-04-23T14:48:23.162403+0000","last_active":"2024-04-23T14:48:52.863757+0000","last_peered":"2024-04-23T14:48:52.863757+0000","last_clean":"2024-04-23T14:48:52.863757+0000","last_became_active":"2024-04-23T14:48:23.162010+0000","last_became_peered":"2024-04-23T14:48:23.162010+0000","last_unstale":"2024-04-23T14:48:52.863757+0000","last_undegraded":"2024-04-23T14:48:52.863757+0000","last_fullsized":"2024-04-23T14:48:52.863757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:59.213131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.732659+0000","last_change":"2024-04-23T14:48:24.197815+0000","last_active":"2024-04-23T14:48:43.732659+0000","last_peered":"2024-04-23T14:48:43.732659+0000","last_clean":"2024-04-23T14:48:43.732659+0000","last_became_active":"2024-04-23T14:48:24.194153+0000","last_became_peered":"2024-04-23T14:48:24.194153+0000","last_unstale":"2024-04-23T14:48:43.732659+0000","last_undegraded":"2024-04-23T14:48:43.732659+0000","last_fullsized":"2024-04-23T14:48:43.732659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:37:30.113646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722774+0000","last_change":"2024-04-23T14:48:28.693952+0000","last_active":"2024-04-23T14:48:43.722774+0000","last_peered":"2024-04-23T14:48:43.722774+0000","last_clean":"2024-04-23T14:48:43.722774+0000","last_became_active":"2024-04-23T14:48:28.691769+0000","last_became_peered":"2024-04-23T14:48:28.691769+0000","last_unstale":"2024-04-23T14:48:43.722774+0000","last_undegraded":"2024-04-23T14:48:43.722774+0000","last_fullsized":"2024-04-23T14:48:43.722774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:40:29.883206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:53.871668+0000","last_change":"2024-04-23T14:48:23.174584+0000","last_active":"2024-04-23T14:48:53.871668+0000","last_peered":"2024-04-23T14:48:53.871668+0000","last_clean":"2024-04-23T14:48:53.871668+0000","last_became_active":"2024-04-23T14:48:23.170982+0000","last_became_peered":"2024-04-23T14:48:23.170982+0000","last_unstale":"2024-04-23T14:48:53.871668+0000","last_undegraded":"2024-04-23T14:48:53.871668+0000","last_fullsized":"2024-04-23T14:48:53.871668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:21.304149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728169+0000","last_change":"2024-04-23T14:48:24.190360+0000","last_active":"2024-04-23T14:48:43.728169+0000","last_peered":"2024-04-23T14:48:43.728169+0000","last_clean":"2024-04-23T14:48:43.728169+0000","last_became_active":"2024-04-23T14:48:24.188138+0000","last_became_peered":"2024-04-23T14:48:24.188138+0000","last_unstale":"2024-04-23T14:48:43.728169+0000","last_undegraded":"2024-04-23T14:48:43.728169+0000","last_fullsized":"2024-04-23T14:48:43.728169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:55:27.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723495+0000","last_change":"2024-04-23T14:48:28.693859+0000","last_active":"2024-04-23T14:48:43.723495+0000","last_peered":"2024-04-23T14:48:43.723495+0000","last_clean":"2024-04-23T14:48:43.723495+0000","last_became_active":"2024-04-23T14:48:28.693338+0000","last_became_peered":"2024-04-23T14:48:28.693338+0000","last_unstale":"2024-04-23T14:48:43.723495+0000","last_undegraded":"2024-04-23T14:48:43.723495+0000","last_fullsized":"2024-04-23T14:48:43.723495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:46.176604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.834112+0000","last_change":"2024-04-23T14:48:23.173206+0000","last_active":"2024-04-23T14:48:51.834112+0000","last_peered":"2024-04-23T14:48:51.834112+0000","last_clean":"2024-04-23T14:48:51.834112+0000","last_became_active":"2024-04-23T14:48:23.172780+0000","last_became_peered":"2024-04-23T14:48:23.172780+0000","last_unstale":"2024-04-23T14:48:51.834112+0000","last_undegraded":"2024-04-23T14:48:51.834112+0000","last_fullsized":"2024-04-23T14:48:51.834112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:51.870634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.012145+0000","last_change":"2024-04-23T14:48:44.010379+0000","last_active":"2024-04-23T14:48:44.012145+0000","last_peered":"2024-04-23T14:48:44.012145+0000","last_clean":"2024-04-23T14:48:44.012145+0000","last_became_active":"2024-04-23T14:48:44.009673+0000","last_became_peered":"2024-04-23T14:48:44.009673+0000","last_unstale":"2024-04-23T14:48:44.012145+0000","last_undegraded":"2024-04-23T14:48:44.012145+0000","last_fullsized":"2024-04-23T14:48:44.012145+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:46.552062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792672+0000","last_change":"2024-04-23T14:48:28.684186+0000","last_active":"2024-04-23T14:48:43.792672+0000","last_peered":"2024-04-23T14:48:43.792672+0000","last_clean":"2024-04-23T14:48:43.792672+0000","last_became_active":"2024-04-23T14:48:28.683109+0000","last_became_peered":"2024-04-23T14:48:28.683109+0000","last_unstale":"2024-04-23T14:48:43.792672+0000","last_undegraded":"2024-04-23T14:48:43.792672+0000","last_fullsized":"2024-04-23T14:48:43.792672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:03.782346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:50.834164+0000","last_change":"2024-04-23T14:48:23.159599+0000","last_active":"2024-04-23T14:48:50.834164+0000","last_peered":"2024-04-23T14:48:50.834164+0000","last_clean":"2024-04-23T14:48:50.834164+0000","last_became_active":"2024-04-23T14:48:23.158986+0000","last_became_peered":"2024-04-23T14:48:23.158986+0000","last_unstale":"2024-04-23T14:48:50.834164+0000","last_undegraded":"2024-04-23T14:48:50.834164+0000","last_fullsized":"2024-04-23T14:48:50.834164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:00.254987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008401+0000","last_change":"2024-04-23T14:48:24.200644+0000","last_active":"2024-04-23T14:48:44.008401+0000","last_peered":"2024-04-23T14:48:44.008401+0000","last_clean":"2024-04-23T14:48:44.008401+0000","last_became_active":"2024-04-23T14:48:24.200236+0000","last_became_peered":"2024-04-23T14:48:24.200236+0000","last_unstale":"2024-04-23T14:48:44.008401+0000","last_undegraded":"2024-04-23T14:48:44.008401+0000","last_fullsized":"2024-04-23T14:48:44.008401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:51.634416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723581+0000","last_change":"2024-04-23T14:48:28.699959+0000","last_active":"2024-04-23T14:48:43.723581+0000","last_peered":"2024-04-23T14:48:43.723581+0000","last_clean":"2024-04-23T14:48:43.723581+0000","last_became_active":"2024-04-23T14:48:28.699327+0000","last_became_peered":"2024-04-23T14:48:28.699327+0000","last_unstale":"2024-04-23T14:48:43.723581+0000","last_undegraded":"2024-04-23T14:48:43.723581+0000","last_fullsized":"2024-04-23T14:48:43.723581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:41:32.257355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.866189+0000","last_change":"2024-04-23T14:48:23.165179+0000","last_active":"2024-04-23T14:48:52.866189+0000","last_peered":"2024-04-23T14:48:52.866189+0000","last_clean":"2024-04-23T14:48:52.866189+0000","last_became_active":"2024-04-23T14:48:23.164784+0000","last_became_peered":"2024-04-23T14:48:23.164784+0000","last_unstale":"2024-04-23T14:48:52.866189+0000","last_undegraded":"2024-04-23T14:48:52.866189+0000","last_fullsized":"2024-04-23T14:48:52.866189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:02.522867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.718962+0000","last_change":"2024-04-23T14:48:24.202092+0000","last_active":"2024-04-23T14:48:43.718962+0000","last_peered":"2024-04-23T14:48:43.718962+0000","last_clean":"2024-04-23T14:48:43.718962+0000","last_became_active":"2024-04-23T14:48:24.200676+0000","last_became_peered":"2024-04-23T14:48:24.200676+0000","last_unstale":"2024-04-23T14:48:43.718962+0000","last_undegraded":"2024-04-23T14:48:43.718962+0000","last_fullsized":"2024-04-23T14:48:43.718962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:55:31.584366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008076+0000","last_change":"2024-04-23T14:48:28.692929+0000","last_active":"2024-04-23T14:48:44.008076+0000","last_peered":"2024-04-23T14:48:44.008076+0000","last_clean":"2024-04-23T14:48:44.008076+0000","last_became_active":"2024-04-23T14:48:28.692405+0000","last_became_peered":"2024-04-23T14:48:28.692405+0000","last_unstale":"2024-04-23T14:48:44.008076+0000","last_undegraded":"2024-04-23T14:48:44.008076+0000","last_fullsized":"2024-04-23T14:48:44.008076+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:13:30.063548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:54.871030+0000","last_change":"2024-04-23T14:48:23.165520+0000","last_active":"2024-04-23T14:48:54.871030+0000","last_peered":"2024-04-23T14:48:54.871030+0000","last_clean":"2024-04-23T14:48:54.871030+0000","last_became_active":"2024-04-23T14:48:23.163725+0000","last_became_peered":"2024-04-23T14:48:23.163725+0000","last_unstale":"2024-04-23T14:48:54.871030+0000","last_undegraded":"2024-04-23T14:48:54.871030+0000","last_fullsized":"2024-04-23T14:48:54.871030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:58.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729188+0000","last_change":"2024-04-23T14:48:24.200779+0000","last_active":"2024-04-23T14:48:43.729188+0000","last_peered":"2024-04-23T14:48:43.729188+0000","last_clean":"2024-04-23T14:48:43.729188+0000","last_became_active":"2024-04-23T14:48:24.199391+0000","last_became_peered":"2024-04-23T14:48:24.199391+0000","last_unstale":"2024-04-23T14:48:43.729188+0000","last_undegraded":"2024-04-23T14:48:43.729188+0000","last_fullsized":"2024-04-23T14:48:43.729188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:26.333246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.718879+0000","last_change":"2024-04-23T14:48:28.688860+0000","last_active":"2024-04-23T14:48:43.718879+0000","last_peered":"2024-04-23T14:48:43.718879+0000","last_clean":"2024-04-23T14:48:43.718879+0000","last_became_active":"2024-04-23T14:48:28.688427+0000","last_became_peered":"2024-04-23T14:48:28.688427+0000","last_unstale":"2024-04-23T14:48:43.718879+0000","last_undegraded":"2024-04-23T14:48:43.718879+0000","last_fullsized":"2024-04-23T14:48:43.718879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:02.196099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.866377+0000","last_change":"2024-04-23T14:48:23.170515+0000","last_active":"2024-04-23T14:48:52.866377+0000","last_peered":"2024-04-23T14:48:52.866377+0000","last_clean":"2024-04-23T14:48:52.866377+0000","last_became_active":"2024-04-23T14:48:23.170078+0000","last_became_peered":"2024-04-23T14:48:23.170078+0000","last_unstale":"2024-04-23T14:48:52.866377+0000","last_undegraded":"2024-04-23T14:48:52.866377+0000","last_fullsized":"2024-04-23T14:48:52.866377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:33:52.560319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724950+0000","last_change":"2024-04-23T14:48:24.202989+0000","last_active":"2024-04-23T14:48:43.724950+0000","last_peered":"2024-04-23T14:48:43.724950+0000","last_clean":"2024-04-23T14:48:43.724950+0000","last_became_active":"2024-04-23T14:48:24.202334+0000","last_became_peered":"2024-04-23T14:48:24.202334+0000","last_unstale":"2024-04-23T14:48:43.724950+0000","last_undegraded":"2024-04-23T14:48:43.724950+0000","last_fullsized":"2024-04-23T14:48:43.724950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:48:16.044242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.012817+0000","last_change":"2024-04-23T14:48:44.012817+0000","last_active":"2024-04-23T14:48:44.012817+0000","last_peered":"2024-04-23T14:48:44.012817+0000","last_clean":"2024-04-23T14:48:44.012817+0000","last_became_active":"2024-04-23T14:48:44.011680+0000","last_became_peered":"2024-04-23T14:48:44.011680+0000","last_unstale":"2024-04-23T14:48:44.012817+0000","last_undegraded":"2024-04-23T14:48:44.012817+0000","last_fullsized":"2024-04-23T14:48:44.012817+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:36.289301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.835235+0000","last_change":"2024-04-23T14:48:23.174183+0000","last_active":"2024-04-23T14:48:51.835235+0000","last_peered":"2024-04-23T14:48:51.835235+0000","last_clean":"2024-04-23T14:48:51.835235+0000","last_became_active":"2024-04-23T14:48:23.173345+0000","last_became_peered":"2024-04-23T14:48:23.173345+0000","last_unstale":"2024-04-23T14:48:51.835235+0000","last_undegraded":"2024-04-23T14:48:51.835235+0000","last_fullsized":"2024-04-23T14:48:51.835235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:24.557598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728477+0000","last_change":"2024-04-23T14:48:24.187891+0000","last_active":"2024-04-23T14:48:43.728477+0000","last_peered":"2024-04-23T14:48:43.728477+0000","last_clean":"2024-04-23T14:48:43.728477+0000","last_became_active":"2024-04-23T14:48:24.187495+0000","last_became_peered":"2024-04-23T14:48:24.187495+0000","last_unstale":"2024-04-23T14:48:43.728477+0000","last_undegraded":"2024-04-23T14:48:43.728477+0000","last_fullsized":"2024-04-23T14:48:43.728477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:54.561153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.719126+0000","last_change":"2024-04-23T14:48:28.690722+0000","last_active":"2024-04-23T14:48:43.719126+0000","last_peered":"2024-04-23T14:48:43.719126+0000","last_clean":"2024-04-23T14:48:43.719126+0000","last_became_active":"2024-04-23T14:48:28.690294+0000","last_became_peered":"2024-04-23T14:48:28.690294+0000","last_unstale":"2024-04-23T14:48:43.719126+0000","last_undegraded":"2024-04-23T14:48:43.719126+0000","last_fullsized":"2024-04-23T14:48:43.719126+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:50.657059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'25","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:54.876774+0000","last_change":"2024-04-23T14:48:23.164136+0000","last_active":"2024-04-23T14:48:54.876774+0000","last_peered":"2024-04-23T14:48:54.876774+0000","last_clean":"2024-04-23T14:48:54.876774+0000","last_became_active":"2024-04-23T14:48:23.162342+0000","last_became_peered":"2024-04-23T14:48:23.162342+0000","last_unstale":"2024-04-23T14:48:54.876774+0000","last_undegraded":"2024-04-23T14:48:54.876774+0000","last_fullsized":"2024-04-23T14:48:54.876774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:50:50.956006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41906,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":44,"num_write":27,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727622+0000","last_change":"2024-04-23T14:48:24.199242+0000","last_active":"2024-04-23T14:48:43.727622+0000","last_peered":"2024-04-23T14:48:43.727622+0000","last_clean":"2024-04-23T14:48:43.727622+0000","last_became_active":"2024-04-23T14:48:24.198870+0000","last_became_peered":"2024-04-23T14:48:24.198870+0000","last_unstale":"2024-04-23T14:48:43.727622+0000","last_undegraded":"2024-04-23T14:48:43.727622+0000","last_fullsized":"2024-04-23T14:48:43.727622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:55.824352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.733432+0000","last_change":"2024-04-23T14:48:28.696469+0000","last_active":"2024-04-23T14:48:43.733432+0000","last_peered":"2024-04-23T14:48:43.733432+0000","last_clean":"2024-04-23T14:48:43.733432+0000","last_became_active":"2024-04-23T14:48:28.695973+0000","last_became_peered":"2024-04-23T14:48:28.695973+0000","last_unstale":"2024-04-23T14:48:43.733432+0000","last_undegraded":"2024-04-23T14:48:43.733432+0000","last_fullsized":"2024-04-23T14:48:43.733432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:34.793357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:50.827759+0000","last_change":"2024-04-23T14:48:23.155889+0000","last_active":"2024-04-23T14:48:50.827759+0000","last_peered":"2024-04-23T14:48:50.827759+0000","last_clean":"2024-04-23T14:48:50.827759+0000","last_became_active":"2024-04-23T14:48:23.155494+0000","last_became_peered":"2024-04-23T14:48:23.155494+0000","last_unstale":"2024-04-23T14:48:50.827759+0000","last_undegraded":"2024-04-23T14:48:50.827759+0000","last_fullsized":"2024-04-23T14:48:50.827759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:14.567618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723243+0000","last_change":"2024-04-23T14:48:24.216976+0000","last_active":"2024-04-23T14:48:43.723243+0000","last_peered":"2024-04-23T14:48:43.723243+0000","last_clean":"2024-04-23T14:48:43.723243+0000","last_became_active":"2024-04-23T14:48:24.216561+0000","last_became_peered":"2024-04-23T14:48:24.216561+0000","last_unstale":"2024-04-23T14:48:43.723243+0000","last_undegraded":"2024-04-23T14:48:43.723243+0000","last_fullsized":"2024-04-23T14:48:43.723243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:40:02.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792239+0000","last_change":"2024-04-23T14:48:28.684812+0000","last_active":"2024-04-23T14:48:43.792239+0000","last_peered":"2024-04-23T14:48:43.792239+0000","last_clean":"2024-04-23T14:48:43.792239+0000","last_became_active":"2024-04-23T14:48:28.682284+0000","last_became_peered":"2024-04-23T14:48:28.682284+0000","last_unstale":"2024-04-23T14:48:43.792239+0000","last_undegraded":"2024-04-23T14:48:43.792239+0000","last_fullsized":"2024-04-23T14:48:43.792239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:19.702778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.863773+0000","last_change":"2024-04-23T14:48:23.173640+0000","last_active":"2024-04-23T14:48:52.863773+0000","last_peered":"2024-04-23T14:48:52.863773+0000","last_clean":"2024-04-23T14:48:52.863773+0000","last_became_active":"2024-04-23T14:48:23.173259+0000","last_became_peered":"2024-04-23T14:48:23.173259+0000","last_unstale":"2024-04-23T14:48:52.863773+0000","last_undegraded":"2024-04-23T14:48:52.863773+0000","last_fullsized":"2024-04-23T14:48:52.863773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:19.355340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734772+0000","last_change":"2024-04-23T14:48:24.198531+0000","last_active":"2024-04-23T14:48:43.734772+0000","last_peered":"2024-04-23T14:48:43.734772+0000","last_clean":"2024-04-23T14:48:43.734772+0000","last_became_active":"2024-04-23T14:48:24.198217+0000","last_became_peered":"2024-04-23T14:48:24.198217+0000","last_unstale":"2024-04-23T14:48:43.734772+0000","last_undegraded":"2024-04-23T14:48:43.734772+0000","last_fullsized":"2024-04-23T14:48:43.734772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:15:17.130409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.720165+0000","last_change":"2024-04-23T14:48:28.690796+0000","last_active":"2024-04-23T14:48:43.720165+0000","last_peered":"2024-04-23T14:48:43.720165+0000","last_clean":"2024-04-23T14:48:43.720165+0000","last_became_active":"2024-04-23T14:48:28.686712+0000","last_became_peered":"2024-04-23T14:48:28.686712+0000","last_unstale":"2024-04-23T14:48:43.720165+0000","last_undegraded":"2024-04-23T14:48:43.720165+0000","last_fullsized":"2024-04-23T14:48:43.720165+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:46.769848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.823456+0000","last_change":"2024-04-23T14:48:23.171753+0000","last_active":"2024-04-23T14:48:51.823456+0000","last_peered":"2024-04-23T14:48:51.823456+0000","last_clean":"2024-04-23T14:48:51.823456+0000","last_became_active":"2024-04-23T14:48:23.171177+0000","last_became_peered":"2024-04-23T14:48:23.171177+0000","last_unstale":"2024-04-23T14:48:51.823456+0000","last_undegraded":"2024-04-23T14:48:51.823456+0000","last_fullsized":"2024-04-23T14:48:51.823456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:26:06.666044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734655+0000","last_change":"2024-04-23T14:48:24.206308+0000","last_active":"2024-04-23T14:48:43.734655+0000","last_peered":"2024-04-23T14:48:43.734655+0000","last_clean":"2024-04-23T14:48:43.734655+0000","last_became_active":"2024-04-23T14:48:24.205989+0000","last_became_peered":"2024-04-23T14:48:24.205989+0000","last_unstale":"2024-04-23T14:48:43.734655+0000","last_undegraded":"2024-04-23T14:48:43.734655+0000","last_fullsized":"2024-04-23T14:48:43.734655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:53.172538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.725467+0000","last_change":"2024-04-23T14:48:28.691952+0000","last_active":"2024-04-23T14:48:43.725467+0000","last_peered":"2024-04-23T14:48:43.725467+0000","last_clean":"2024-04-23T14:48:43.725467+0000","last_became_active":"2024-04-23T14:48:28.690781+0000","last_became_peered":"2024-04-23T14:48:28.690781+0000","last_unstale":"2024-04-23T14:48:43.725467+0000","last_undegraded":"2024-04-23T14:48:43.725467+0000","last_fullsized":"2024-04-23T14:48:43.725467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:50.832695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.835831+0000","last_change":"2024-04-23T14:48:23.169165+0000","last_active":"2024-04-23T14:48:51.835831+0000","last_peered":"2024-04-23T14:48:51.835831+0000","last_clean":"2024-04-23T14:48:51.835831+0000","last_became_active":"2024-04-23T14:48:23.168822+0000","last_became_peered":"2024-04-23T14:48:23.168822+0000","last_unstale":"2024-04-23T14:48:51.835831+0000","last_undegraded":"2024-04-23T14:48:51.835831+0000","last_fullsized":"2024-04-23T14:48:51.835831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:29:49.397506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.737904+0000","last_change":"2024-04-23T14:48:43.737904+0000","last_active":"2024-04-23T14:48:43.737904+0000","last_peered":"2024-04-23T14:48:43.737904+0000","last_clean":"2024-04-23T14:48:43.737904+0000","last_became_active":"2024-04-23T14:48:43.736639+0000","last_became_peered":"2024-04-23T14:48:43.736639+0000","last_unstale":"2024-04-23T14:48:43.737904+0000","last_undegraded":"2024-04-23T14:48:43.737904+0000","last_fullsized":"2024-04-23T14:48:43.737904+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:43.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.732204+0000","last_change":"2024-04-23T14:48:28.692199+0000","last_active":"2024-04-23T14:48:43.732204+0000","last_peered":"2024-04-23T14:48:43.732204+0000","last_clean":"2024-04-23T14:48:43.732204+0000","last_became_active":"2024-04-23T14:48:28.691673+0000","last_became_peered":"2024-04-23T14:48:28.691673+0000","last_unstale":"2024-04-23T14:48:43.732204+0000","last_undegraded":"2024-04-23T14:48:43.732204+0000","last_fullsized":"2024-04-23T14:48:43.732204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:19.323509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728517+0000","last_change":"2024-04-23T14:48:23.167091+0000","last_active":"2024-04-23T14:48:43.728517+0000","last_peered":"2024-04-23T14:48:43.728517+0000","last_clean":"2024-04-23T14:48:43.728517+0000","last_became_active":"2024-04-23T14:48:23.166734+0000","last_became_peered":"2024-04-23T14:48:23.166734+0000","last_unstale":"2024-04-23T14:48:43.728517+0000","last_undegraded":"2024-04-23T14:48:43.728517+0000","last_fullsized":"2024-04-23T14:48:43.728517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:49:11.486630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792850+0000","last_change":"2024-04-23T14:48:24.208251+0000","last_active":"2024-04-23T14:48:43.792850+0000","last_peered":"2024-04-23T14:48:43.792850+0000","last_clean":"2024-04-23T14:48:43.792850+0000","last_became_active":"2024-04-23T14:48:24.207905+0000","last_became_peered":"2024-04-23T14:48:24.207905+0000","last_unstale":"2024-04-23T14:48:43.792850+0000","last_undegraded":"2024-04-23T14:48:43.792850+0000","last_fullsized":"2024-04-23T14:48:43.792850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:52.803336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.013832+0000","last_change":"2024-04-23T14:48:44.013832+0000","last_active":"2024-04-23T14:48:44.013832+0000","last_peered":"2024-04-23T14:48:44.013832+0000","last_clean":"2024-04-23T14:48:44.013832+0000","last_became_active":"2024-04-23T14:48:44.012529+0000","last_became_peered":"2024-04-23T14:48:44.012529+0000","last_unstale":"2024-04-23T14:48:44.013832+0000","last_undegraded":"2024-04-23T14:48:44.013832+0000","last_fullsized":"2024-04-23T14:48:44.013832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:49:50.898163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.795944+0000","last_change":"2024-04-23T14:48:43.794890+0000","last_active":"2024-04-23T14:48:43.795944+0000","last_peered":"2024-04-23T14:48:43.795944+0000","last_clean":"2024-04-23T14:48:43.795944+0000","last_became_active":"2024-04-23T14:48:43.794157+0000","last_became_peered":"2024-04-23T14:48:43.794157+0000","last_unstale":"2024-04-23T14:48:43.795944+0000","last_undegraded":"2024-04-23T14:48:43.795944+0000","last_fullsized":"2024-04-23T14:48:43.795944+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:40.335060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009387+0000","last_change":"2024-04-23T14:48:24.213085+0000","last_active":"2024-04-23T14:48:44.009387+0000","last_peered":"2024-04-23T14:48:44.009387+0000","last_clean":"2024-04-23T14:48:44.009387+0000","last_became_active":"2024-04-23T14:48:24.212634+0000","last_became_peered":"2024-04-23T14:48:24.212634+0000","last_unstale":"2024-04-23T14:48:44.009387+0000","last_undegraded":"2024-04-23T14:48:44.009387+0000","last_fullsized":"2024-04-23T14:48:44.009387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:56:16.680842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723267+0000","last_change":"2024-04-23T14:48:28.691938+0000","last_active":"2024-04-23T14:48:43.723267+0000","last_peered":"2024-04-23T14:48:43.723267+0000","last_clean":"2024-04-23T14:48:43.723267+0000","last_became_active":"2024-04-23T14:48:28.691410+0000","last_became_peered":"2024-04-23T14:48:28.691410+0000","last_unstale":"2024-04-23T14:48:43.723267+0000","last_undegraded":"2024-04-23T14:48:43.723267+0000","last_fullsized":"2024-04-23T14:48:43.723267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:52.384117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.874927+0000","last_change":"2024-04-23T14:48:23.174726+0000","last_active":"2024-04-23T14:48:52.874927+0000","last_peered":"2024-04-23T14:48:52.874927+0000","last_clean":"2024-04-23T14:48:52.874927+0000","last_became_active":"2024-04-23T14:48:23.174163+0000","last_became_peered":"2024-04-23T14:48:23.174163+0000","last_unstale":"2024-04-23T14:48:52.874927+0000","last_undegraded":"2024-04-23T14:48:52.874927+0000","last_fullsized":"2024-04-23T14:48:52.874927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:17.294653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009296+0000","last_change":"2024-04-23T14:48:24.212406+0000","last_active":"2024-04-23T14:48:44.009296+0000","last_peered":"2024-04-23T14:48:44.009296+0000","last_clean":"2024-04-23T14:48:44.009296+0000","last_became_active":"2024-04-23T14:48:24.212025+0000","last_became_peered":"2024-04-23T14:48:24.212025+0000","last_unstale":"2024-04-23T14:48:44.009296+0000","last_undegraded":"2024-04-23T14:48:44.009296+0000","last_fullsized":"2024-04-23T14:48:44.009296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:09.890480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723005+0000","last_change":"2024-04-23T14:48:28.868780+0000","last_active":"2024-04-23T14:48:43.723005+0000","last_peered":"2024-04-23T14:48:43.723005+0000","last_clean":"2024-04-23T14:48:43.723005+0000","last_became_active":"2024-04-23T14:48:28.868214+0000","last_became_peered":"2024-04-23T14:48:28.868214+0000","last_unstale":"2024-04-23T14:48:43.723005+0000","last_undegraded":"2024-04-23T14:48:43.723005+0000","last_fullsized":"2024-04-23T14:48:43.723005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:16:19.606569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.730878+0000","last_change":"2024-04-23T14:48:24.189017+0000","last_active":"2024-04-23T14:48:43.730878+0000","last_peered":"2024-04-23T14:48:43.730878+0000","last_clean":"2024-04-23T14:48:43.730878+0000","last_became_active":"2024-04-23T14:48:24.187165+0000","last_became_peered":"2024-04-23T14:48:24.187165+0000","last_unstale":"2024-04-23T14:48:43.730878+0000","last_undegraded":"2024-04-23T14:48:43.730878+0000","last_fullsized":"2024-04-23T14:48:43.730878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:44.844255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:53.861771+0000","last_change":"2024-04-23T14:48:23.174186+0000","last_active":"2024-04-23T14:48:53.861771+0000","last_peered":"2024-04-23T14:48:53.861771+0000","last_clean":"2024-04-23T14:48:53.861771+0000","last_became_active":"2024-04-23T14:48:23.173365+0000","last_became_peered":"2024-04-23T14:48:23.173365+0000","last_unstale":"2024-04-23T14:48:53.861771+0000","last_undegraded":"2024-04-23T14:48:53.861771+0000","last_fullsized":"2024-04-23T14:48:53.861771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:04.193405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735045+0000","last_change":"2024-04-23T14:48:28.689151+0000","last_active":"2024-04-23T14:48:43.735045+0000","last_peered":"2024-04-23T14:48:43.735045+0000","last_clean":"2024-04-23T14:48:43.735045+0000","last_became_active":"2024-04-23T14:48:28.688396+0000","last_became_peered":"2024-04-23T14:48:28.688396+0000","last_unstale":"2024-04-23T14:48:43.735045+0000","last_undegraded":"2024-04-23T14:48:43.735045+0000","last_fullsized":"2024-04-23T14:48:43.735045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:06.922068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008316+0000","last_change":"2024-04-23T14:48:24.214609+0000","last_active":"2024-04-23T14:48:44.008316+0000","last_peered":"2024-04-23T14:48:44.008316+0000","last_clean":"2024-04-23T14:48:44.008316+0000","last_became_active":"2024-04-23T14:48:24.211298+0000","last_became_peered":"2024-04-23T14:48:24.211298+0000","last_unstale":"2024-04-23T14:48:44.008316+0000","last_undegraded":"2024-04-23T14:48:44.008316+0000","last_fullsized":"2024-04-23T14:48:44.008316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:59.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.827070+0000","last_change":"2024-04-23T14:48:23.154856+0000","last_active":"2024-04-23T14:48:51.827070+0000","last_peered":"2024-04-23T14:48:51.827070+0000","last_clean":"2024-04-23T14:48:51.827070+0000","last_became_active":"2024-04-23T14:48:23.154225+0000","last_became_peered":"2024-04-23T14:48:23.154225+0000","last_unstale":"2024-04-23T14:48:51.827070+0000","last_undegraded":"2024-04-23T14:48:51.827070+0000","last_fullsized":"2024-04-23T14:48:51.827070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:48.059364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":359,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.733944+0000","last_change":"2024-04-23T14:46:43.008733+0000","last_active":"2024-04-23T14:48:43.733944+0000","last_peered":"2024-04-23T14:48:43.733944+0000","last_clean":"2024-04-23T14:48:43.733944+0000","last_became_active":"2024-04-23T14:46:43.008289+0000","last_became_peered":"2024-04-23T14:46:43.008289+0000","last_unstale":"2024-04-23T14:48:43.733944+0000","last_undegraded":"2024-04-23T14:48:43.733944+0000","last_fullsized":"2024-04-23T14:48:43.733944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_clean_scrub_stamp":"2024-04-23T14:41:57.297296+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:40.997119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.732648+0000","last_change":"2024-04-23T14:48:28.870098+0000","last_active":"2024-04-23T14:48:43.732648+0000","last_peered":"2024-04-23T14:48:43.732648+0000","last_clean":"2024-04-23T14:48:43.732648+0000","last_became_active":"2024-04-23T14:48:28.868925+0000","last_became_peered":"2024-04-23T14:48:28.868925+0000","last_unstale":"2024-04-23T14:48:43.732648+0000","last_undegraded":"2024-04-23T14:48:43.732648+0000","last_fullsized":"2024-04-23T14:48:43.732648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:22.408757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722612+0000","last_change":"2024-04-23T14:48:24.189462+0000","last_active":"2024-04-23T14:48:43.722612+0000","last_peered":"2024-04-23T14:48:43.722612+0000","last_clean":"2024-04-23T14:48:43.722612+0000","last_became_active":"2024-04-23T14:48:24.188714+0000","last_became_peered":"2024-04-23T14:48:24.188714+0000","last_unstale":"2024-04-23T14:48:43.722612+0000","last_undegraded":"2024-04-23T14:48:43.722612+0000","last_fullsized":"2024-04-23T14:48:43.722612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:56.589476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:50.830840+0000","last_change":"2024-04-23T14:48:23.166096+0000","last_active":"2024-04-23T14:48:50.830840+0000","last_peered":"2024-04-23T14:48:50.830840+0000","last_clean":"2024-04-23T14:48:50.830840+0000","last_became_active":"2024-04-23T14:48:23.165514+0000","last_became_peered":"2024-04-23T14:48:23.165514+0000","last_unstale":"2024-04-23T14:48:50.830840+0000","last_undegraded":"2024-04-23T14:48:50.830840+0000","last_fullsized":"2024-04-23T14:48:50.830840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:27.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.791779+0000","last_change":"2024-04-23T14:48:28.690086+0000","last_active":"2024-04-23T14:48:43.791779+0000","last_peered":"2024-04-23T14:48:43.791779+0000","last_clean":"2024-04-23T14:48:43.791779+0000","last_became_active":"2024-04-23T14:48:28.689346+0000","last_became_peered":"2024-04-23T14:48:28.689346+0000","last_unstale":"2024-04-23T14:48:43.791779+0000","last_undegraded":"2024-04-23T14:48:43.791779+0000","last_fullsized":"2024-04-23T14:48:43.791779+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:02.594389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.836109+0000","last_change":"2024-04-23T14:48:23.170977+0000","last_active":"2024-04-23T14:48:51.836109+0000","last_peered":"2024-04-23T14:48:51.836109+0000","last_clean":"2024-04-23T14:48:51.836109+0000","last_became_active":"2024-04-23T14:48:23.170640+0000","last_became_peered":"2024-04-23T14:48:23.170640+0000","last_unstale":"2024-04-23T14:48:51.836109+0000","last_undegraded":"2024-04-23T14:48:51.836109+0000","last_fullsized":"2024-04-23T14:48:51.836109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:28:18.488187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723975+0000","last_change":"2024-04-23T14:48:24.190631+0000","last_active":"2024-04-23T14:48:43.723975+0000","last_peered":"2024-04-23T14:48:43.723975+0000","last_clean":"2024-04-23T14:48:43.723975+0000","last_became_active":"2024-04-23T14:48:24.190245+0000","last_became_peered":"2024-04-23T14:48:24.190245+0000","last_unstale":"2024-04-23T14:48:43.723975+0000","last_undegraded":"2024-04-23T14:48:43.723975+0000","last_fullsized":"2024-04-23T14:48:43.723975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:09.641687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008243+0000","last_change":"2024-04-23T14:48:28.867735+0000","last_active":"2024-04-23T14:48:44.008243+0000","last_peered":"2024-04-23T14:48:44.008243+0000","last_clean":"2024-04-23T14:48:44.008243+0000","last_became_active":"2024-04-23T14:48:28.867165+0000","last_became_peered":"2024-04-23T14:48:28.867165+0000","last_unstale":"2024-04-23T14:48:44.008243+0000","last_undegraded":"2024-04-23T14:48:44.008243+0000","last_fullsized":"2024-04-23T14:48:44.008243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:46.973396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:54.299788+0000","last_change":"2024-04-23T14:48:23.159980+0000","last_active":"2024-04-23T14:48:54.299788+0000","last_peered":"2024-04-23T14:48:54.299788+0000","last_clean":"2024-04-23T14:48:54.299788+0000","last_became_active":"2024-04-23T14:48:23.158407+0000","last_became_peered":"2024-04-23T14:48:23.158407+0000","last_unstale":"2024-04-23T14:48:54.299788+0000","last_undegraded":"2024-04-23T14:48:54.299788+0000","last_fullsized":"2024-04-23T14:48:54.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:06:07.110430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009659+0000","last_change":"2024-04-23T14:48:24.215285+0000","last_active":"2024-04-23T14:48:44.009659+0000","last_peered":"2024-04-23T14:48:44.009659+0000","last_clean":"2024-04-23T14:48:44.009659+0000","last_became_active":"2024-04-23T14:48:24.209934+0000","last_became_peered":"2024-04-23T14:48:24.209934+0000","last_unstale":"2024-04-23T14:48:44.009659+0000","last_undegraded":"2024-04-23T14:48:44.009659+0000","last_fullsized":"2024-04-23T14:48:44.009659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:00.673701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722151+0000","last_change":"2024-04-23T14:48:28.689933+0000","last_active":"2024-04-23T14:48:43.722151+0000","last_peered":"2024-04-23T14:48:43.722151+0000","last_clean":"2024-04-23T14:48:43.722151+0000","last_became_active":"2024-04-23T14:48:28.687999+0000","last_became_peered":"2024-04-23T14:48:28.687999+0000","last_unstale":"2024-04-23T14:48:43.722151+0000","last_undegraded":"2024-04-23T14:48:43.722151+0000","last_fullsized":"2024-04-23T14:48:43.722151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:10.605796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.796376+0000","last_change":"2024-04-23T14:48:23.167935+0000","last_active":"2024-04-23T14:48:49.796376+0000","last_peered":"2024-04-23T14:48:49.796376+0000","last_clean":"2024-04-23T14:48:49.796376+0000","last_became_active":"2024-04-23T14:48:23.167597+0000","last_became_peered":"2024-04-23T14:48:23.167597+0000","last_unstale":"2024-04-23T14:48:49.796376+0000","last_undegraded":"2024-04-23T14:48:49.796376+0000","last_fullsized":"2024-04-23T14:48:49.796376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:14:25.667816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.012004+0000","last_change":"2024-04-23T14:48:44.012004+0000","last_active":"2024-04-23T14:48:44.012004+0000","last_peered":"2024-04-23T14:48:44.012004+0000","last_clean":"2024-04-23T14:48:44.012004+0000","last_became_active":"2024-04-23T14:48:44.010779+0000","last_became_peered":"2024-04-23T14:48:44.010779+0000","last_unstale":"2024-04-23T14:48:44.012004+0000","last_undegraded":"2024-04-23T14:48:44.012004+0000","last_fullsized":"2024-04-23T14:48:44.012004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:09.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.013213+0000","last_change":"2024-04-23T14:48:44.013213+0000","last_active":"2024-04-23T14:48:44.013213+0000","last_peered":"2024-04-23T14:48:44.013213+0000","last_clean":"2024-04-23T14:48:44.013213+0000","last_became_active":"2024-04-23T14:48:44.012710+0000","last_became_peered":"2024-04-23T14:48:44.012710+0000","last_unstale":"2024-04-23T14:48:44.013213+0000","last_undegraded":"2024-04-23T14:48:44.013213+0000","last_fullsized":"2024-04-23T14:48:44.013213+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.805453+0000","last_change":"2024-04-23T14:48:23.157529+0000","last_active":"2024-04-23T14:48:49.805453+0000","last_peered":"2024-04-23T14:48:49.805453+0000","last_clean":"2024-04-23T14:48:49.805453+0000","last_became_active":"2024-04-23T14:48:23.156780+0000","last_became_peered":"2024-04-23T14:48:23.156780+0000","last_unstale":"2024-04-23T14:48:49.805453+0000","last_undegraded":"2024-04-23T14:48:49.805453+0000","last_fullsized":"2024-04-23T14:48:49.805453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:32.747563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724403+0000","last_change":"2024-04-23T14:48:24.196328+0000","last_active":"2024-04-23T14:48:43.724403+0000","last_peered":"2024-04-23T14:48:43.724403+0000","last_clean":"2024-04-23T14:48:43.724403+0000","last_became_active":"2024-04-23T14:48:24.195875+0000","last_became_peered":"2024-04-23T14:48:24.195875+0000","last_unstale":"2024-04-23T14:48:43.724403+0000","last_undegraded":"2024-04-23T14:48:43.724403+0000","last_fullsized":"2024-04-23T14:48:43.724403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:34:03.377786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.720297+0000","last_change":"2024-04-23T14:48:28.692397+0000","last_active":"2024-04-23T14:48:43.720297+0000","last_peered":"2024-04-23T14:48:43.720297+0000","last_clean":"2024-04-23T14:48:43.720297+0000","last_became_active":"2024-04-23T14:48:28.691916+0000","last_became_peered":"2024-04-23T14:48:28.691916+0000","last_unstale":"2024-04-23T14:48:43.720297+0000","last_undegraded":"2024-04-23T14:48:43.720297+0000","last_fullsized":"2024-04-23T14:48:43.720297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:59.357790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.802066+0000","last_change":"2024-04-23T14:48:23.165072+0000","last_active":"2024-04-23T14:48:49.802066+0000","last_peered":"2024-04-23T14:48:49.802066+0000","last_clean":"2024-04-23T14:48:49.802066+0000","last_became_active":"2024-04-23T14:48:23.164732+0000","last_became_peered":"2024-04-23T14:48:23.164732+0000","last_unstale":"2024-04-23T14:48:49.802066+0000","last_undegraded":"2024-04-23T14:48:49.802066+0000","last_fullsized":"2024-04-23T14:48:49.802066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:04.921227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.791337+0000","last_change":"2024-04-23T14:48:24.203322+0000","last_active":"2024-04-23T14:48:43.791337+0000","last_peered":"2024-04-23T14:48:43.791337+0000","last_clean":"2024-04-23T14:48:43.791337+0000","last_became_active":"2024-04-23T14:48:24.202889+0000","last_became_peered":"2024-04-23T14:48:24.202889+0000","last_unstale":"2024-04-23T14:48:43.791337+0000","last_undegraded":"2024-04-23T14:48:43.791337+0000","last_fullsized":"2024-04-23T14:48:43.791337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:18:19.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.726721+0000","last_change":"2024-04-23T14:48:28.686064+0000","last_active":"2024-04-23T14:48:43.726721+0000","last_peered":"2024-04-23T14:48:43.726721+0000","last_clean":"2024-04-23T14:48:43.726721+0000","last_became_active":"2024-04-23T14:48:28.685389+0000","last_became_peered":"2024-04-23T14:48:28.685389+0000","last_unstale":"2024-04-23T14:48:43.726721+0000","last_undegraded":"2024-04-23T14:48:43.726721+0000","last_fullsized":"2024-04-23T14:48:43.726721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:06:35.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.791152+0000","last_change":"2024-04-23T14:48:23.164926+0000","last_active":"2024-04-23T14:48:51.791152+0000","last_peered":"2024-04-23T14:48:51.791152+0000","last_clean":"2024-04-23T14:48:51.791152+0000","last_became_active":"2024-04-23T14:48:23.164550+0000","last_became_peered":"2024-04-23T14:48:23.164550+0000","last_unstale":"2024-04-23T14:48:51.791152+0000","last_undegraded":"2024-04-23T14:48:51.791152+0000","last_fullsized":"2024-04-23T14:48:51.791152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:53:33.512403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008834+0000","last_change":"2024-04-23T14:48:24.208535+0000","last_active":"2024-04-23T14:48:44.008834+0000","last_peered":"2024-04-23T14:48:44.008834+0000","last_clean":"2024-04-23T14:48:44.008834+0000","last_became_active":"2024-04-23T14:48:24.208183+0000","last_became_peered":"2024-04-23T14:48:24.208183+0000","last_unstale":"2024-04-23T14:48:44.008834+0000","last_undegraded":"2024-04-23T14:48:44.008834+0000","last_fullsized":"2024-04-23T14:48:44.008834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:33:37.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727526+0000","last_change":"2024-04-23T14:48:28.870055+0000","last_active":"2024-04-23T14:48:43.727526+0000","last_peered":"2024-04-23T14:48:43.727526+0000","last_clean":"2024-04-23T14:48:43.727526+0000","last_became_active":"2024-04-23T14:48:28.868671+0000","last_became_peered":"2024-04-23T14:48:28.868671+0000","last_unstale":"2024-04-23T14:48:43.727526+0000","last_undegraded":"2024-04-23T14:48:43.727526+0000","last_fullsized":"2024-04-23T14:48:43.727526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:26:23.756484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.806878+0000","last_change":"2024-04-23T14:48:23.171324+0000","last_active":"2024-04-23T14:48:49.806878+0000","last_peered":"2024-04-23T14:48:49.806878+0000","last_clean":"2024-04-23T14:48:49.806878+0000","last_became_active":"2024-04-23T14:48:23.170523+0000","last_became_peered":"2024-04-23T14:48:23.170523+0000","last_unstale":"2024-04-23T14:48:49.806878+0000","last_undegraded":"2024-04-23T14:48:49.806878+0000","last_fullsized":"2024-04-23T14:48:49.806878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:06.578119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734732+0000","last_change":"2024-04-23T14:48:24.199577+0000","last_active":"2024-04-23T14:48:43.734732+0000","last_peered":"2024-04-23T14:48:43.734732+0000","last_clean":"2024-04-23T14:48:43.734732+0000","last_became_active":"2024-04-23T14:48:24.199174+0000","last_became_peered":"2024-04-23T14:48:24.199174+0000","last_unstale":"2024-04-23T14:48:43.734732+0000","last_undegraded":"2024-04-23T14:48:43.734732+0000","last_fullsized":"2024-04-23T14:48:43.734732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:00.078179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729368+0000","last_change":"2024-04-23T14:48:28.693416+0000","last_active":"2024-04-23T14:48:43.729368+0000","last_peered":"2024-04-23T14:48:43.729368+0000","last_clean":"2024-04-23T14:48:43.729368+0000","last_became_active":"2024-04-23T14:48:28.691823+0000","last_became_peered":"2024-04-23T14:48:28.691823+0000","last_unstale":"2024-04-23T14:48:43.729368+0000","last_undegraded":"2024-04-23T14:48:43.729368+0000","last_fullsized":"2024-04-23T14:48:43.729368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:11:41.027479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.834808+0000","last_change":"2024-04-23T14:48:23.160695+0000","last_active":"2024-04-23T14:48:51.834808+0000","last_peered":"2024-04-23T14:48:51.834808+0000","last_clean":"2024-04-23T14:48:51.834808+0000","last_became_active":"2024-04-23T14:48:23.160255+0000","last_became_peered":"2024-04-23T14:48:23.160255+0000","last_unstale":"2024-04-23T14:48:51.834808+0000","last_undegraded":"2024-04-23T14:48:51.834808+0000","last_fullsized":"2024-04-23T14:48:51.834808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:10.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735323+0000","last_change":"2024-04-23T14:48:24.204085+0000","last_active":"2024-04-23T14:48:43.735323+0000","last_peered":"2024-04-23T14:48:43.735323+0000","last_clean":"2024-04-23T14:48:43.735323+0000","last_became_active":"2024-04-23T14:48:24.203100+0000","last_became_peered":"2024-04-23T14:48:24.203100+0000","last_unstale":"2024-04-23T14:48:43.735323+0000","last_undegraded":"2024-04-23T14:48:43.735323+0000","last_fullsized":"2024-04-23T14:48:43.735323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:06:42.999237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723821+0000","last_change":"2024-04-23T14:48:28.687315+0000","last_active":"2024-04-23T14:48:43.723821+0000","last_peered":"2024-04-23T14:48:43.723821+0000","last_clean":"2024-04-23T14:48:43.723821+0000","last_became_active":"2024-04-23T14:48:28.686867+0000","last_became_peered":"2024-04-23T14:48:28.686867+0000","last_unstale":"2024-04-23T14:48:43.723821+0000","last_undegraded":"2024-04-23T14:48:43.723821+0000","last_fullsized":"2024-04-23T14:48:43.723821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:49.455073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.869061+0000","last_change":"2024-04-23T14:48:23.154736+0000","last_active":"2024-04-23T14:48:52.869061+0000","last_peered":"2024-04-23T14:48:52.869061+0000","last_clean":"2024-04-23T14:48:52.869061+0000","last_became_active":"2024-04-23T14:48:23.154388+0000","last_became_peered":"2024-04-23T14:48:23.154388+0000","last_unstale":"2024-04-23T14:48:52.869061+0000","last_undegraded":"2024-04-23T14:48:52.869061+0000","last_fullsized":"2024-04-23T14:48:52.869061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:16.856764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.737734+0000","last_change":"2024-04-23T14:48:43.737734+0000","last_active":"2024-04-23T14:48:43.737734+0000","last_peered":"2024-04-23T14:48:43.737734+0000","last_clean":"2024-04-23T14:48:43.737734+0000","last_became_active":"2024-04-23T14:48:43.736678+0000","last_became_peered":"2024-04-23T14:48:43.736678+0000","last_unstale":"2024-04-23T14:48:43.737734+0000","last_undegraded":"2024-04-23T14:48:43.737734+0000","last_fullsized":"2024-04-23T14:48:43.737734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:57.583820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.730182+0000","last_change":"2024-04-23T14:48:28.695478+0000","last_active":"2024-04-23T14:48:43.730182+0000","last_peered":"2024-04-23T14:48:43.730182+0000","last_clean":"2024-04-23T14:48:43.730182+0000","last_became_active":"2024-04-23T14:48:28.694836+0000","last_became_peered":"2024-04-23T14:48:28.694836+0000","last_unstale":"2024-04-23T14:48:43.730182+0000","last_undegraded":"2024-04-23T14:48:43.730182+0000","last_fullsized":"2024-04-23T14:48:43.730182+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:11:16.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.873833+0000","last_change":"2024-04-23T14:48:23.164866+0000","last_active":"2024-04-23T14:48:52.873833+0000","last_peered":"2024-04-23T14:48:52.873833+0000","last_clean":"2024-04-23T14:48:52.873833+0000","last_became_active":"2024-04-23T14:48:23.164570+0000","last_became_peered":"2024-04-23T14:48:23.164570+0000","last_unstale":"2024-04-23T14:48:52.873833+0000","last_undegraded":"2024-04-23T14:48:52.873833+0000","last_fullsized":"2024-04-23T14:48:52.873833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:48.247715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735480+0000","last_change":"2024-04-23T14:48:24.202600+0000","last_active":"2024-04-23T14:48:43.735480+0000","last_peered":"2024-04-23T14:48:43.735480+0000","last_clean":"2024-04-23T14:48:43.735480+0000","last_became_active":"2024-04-23T14:48:24.202243+0000","last_became_peered":"2024-04-23T14:48:24.202243+0000","last_unstale":"2024-04-23T14:48:43.735480+0000","last_undegraded":"2024-04-23T14:48:43.735480+0000","last_fullsized":"2024-04-23T14:48:43.735480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:19.162967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.791448+0000","last_change":"2024-04-23T14:48:24.206142+0000","last_active":"2024-04-23T14:48:43.791448+0000","last_peered":"2024-04-23T14:48:43.791448+0000","last_clean":"2024-04-23T14:48:43.791448+0000","last_became_active":"2024-04-23T14:48:24.203397+0000","last_became_peered":"2024-04-23T14:48:24.203397+0000","last_unstale":"2024-04-23T14:48:43.791448+0000","last_undegraded":"2024-04-23T14:48:43.791448+0000","last_fullsized":"2024-04-23T14:48:43.791448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:35:56.363914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722531+0000","last_change":"2024-04-23T14:48:24.197058+0000","last_active":"2024-04-23T14:48:43.722531+0000","last_peered":"2024-04-23T14:48:43.722531+0000","last_clean":"2024-04-23T14:48:43.722531+0000","last_became_active":"2024-04-23T14:48:24.196662+0000","last_became_peered":"2024-04-23T14:48:24.196662+0000","last_unstale":"2024-04-23T14:48:43.722531+0000","last_undegraded":"2024-04-23T14:48:43.722531+0000","last_fullsized":"2024-04-23T14:48:43.722531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.884032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722596+0000","last_change":"2024-04-23T14:48:24.213823+0000","last_active":"2024-04-23T14:48:43.722596+0000","last_peered":"2024-04-23T14:48:43.722596+0000","last_clean":"2024-04-23T14:48:43.722596+0000","last_became_active":"2024-04-23T14:48:24.213480+0000","last_became_peered":"2024-04-23T14:48:24.213480+0000","last_unstale":"2024-04-23T14:48:43.722596+0000","last_undegraded":"2024-04-23T14:48:43.722596+0000","last_fullsized":"2024-04-23T14:48:43.722596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:03.046216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724133+0000","last_change":"2024-04-23T14:48:24.199440+0000","last_active":"2024-04-23T14:48:43.724133+0000","last_peered":"2024-04-23T14:48:43.724133+0000","last_clean":"2024-04-23T14:48:43.724133+0000","last_became_active":"2024-04-23T14:48:24.199119+0000","last_became_peered":"2024-04-23T14:48:24.199119+0000","last_unstale":"2024-04-23T14:48:43.724133+0000","last_undegraded":"2024-04-23T14:48:43.724133+0000","last_fullsized":"2024-04-23T14:48:43.724133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:34.638393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729061+0000","last_change":"2024-04-23T14:48:43.729061+0000","last_active":"2024-04-23T14:48:43.729061+0000","last_peered":"2024-04-23T14:48:43.729061+0000","last_clean":"2024-04-23T14:48:43.729061+0000","last_became_active":"2024-04-23T14:48:43.728485+0000","last_became_peered":"2024-04-23T14:48:43.728485+0000","last_unstale":"2024-04-23T14:48:43.729061+0000","last_undegraded":"2024-04-23T14:48:43.729061+0000","last_fullsized":"2024-04-23T14:48:43.729061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:44:02.348446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792825+0000","last_change":"2024-04-23T14:48:24.204207+0000","last_active":"2024-04-23T14:48:43.792825+0000","last_peered":"2024-04-23T14:48:43.792825+0000","last_clean":"2024-04-23T14:48:43.792825+0000","last_became_active":"2024-04-23T14:48:24.203325+0000","last_became_peered":"2024-04-23T14:48:24.203325+0000","last_unstale":"2024-04-23T14:48:43.792825+0000","last_undegraded":"2024-04-23T14:48:43.792825+0000","last_fullsized":"2024-04-23T14:48:43.792825+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:00.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.725059+0000","last_change":"2024-04-23T14:48:24.191811+0000","last_active":"2024-04-23T14:48:43.725059+0000","last_peered":"2024-04-23T14:48:43.725059+0000","last_clean":"2024-04-23T14:48:43.725059+0000","last_became_active":"2024-04-23T14:48:24.191458+0000","last_became_peered":"2024-04-23T14:48:24.191458+0000","last_unstale":"2024-04-23T14:48:43.725059+0000","last_undegraded":"2024-04-23T14:48:43.725059+0000","last_fullsized":"2024-04-23T14:48:43.725059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:11.676842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009843+0000","last_change":"2024-04-23T14:48:24.214997+0000","last_active":"2024-04-23T14:48:44.009843+0000","last_peered":"2024-04-23T14:48:44.009843+0000","last_clean":"2024-04-23T14:48:44.009843+0000","last_became_active":"2024-04-23T14:48:24.211941+0000","last_became_peered":"2024-04-23T14:48:24.211941+0000","last_unstale":"2024-04-23T14:48:44.009843+0000","last_undegraded":"2024-04-23T14:48:44.009843+0000","last_fullsized":"2024-04-23T14:48:44.009843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:29.903690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.730765+0000","last_change":"2024-04-23T14:48:24.202327+0000","last_active":"2024-04-23T14:48:43.730765+0000","last_peered":"2024-04-23T14:48:43.730765+0000","last_clean":"2024-04-23T14:48:43.730765+0000","last_became_active":"2024-04-23T14:48:24.201986+0000","last_became_peered":"2024-04-23T14:48:24.201986+0000","last_unstale":"2024-04-23T14:48:43.730765+0000","last_undegraded":"2024-04-23T14:48:43.730765+0000","last_fullsized":"2024-04-23T14:48:43.730765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:48.633762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008339+0000","last_change":"2024-04-23T14:48:24.202931+0000","last_active":"2024-04-23T14:48:44.008339+0000","last_peered":"2024-04-23T14:48:44.008339+0000","last_clean":"2024-04-23T14:48:44.008339+0000","last_became_active":"2024-04-23T14:48:24.201767+0000","last_became_peered":"2024-04-23T14:48:24.201767+0000","last_unstale":"2024-04-23T14:48:44.008339+0000","last_undegraded":"2024-04-23T14:48:44.008339+0000","last_fullsized":"2024-04-23T14:48:44.008339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:39.542403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729951+0000","last_change":"2024-04-23T14:48:24.216891+0000","last_active":"2024-04-23T14:48:43.729951+0000","last_peered":"2024-04-23T14:48:43.729951+0000","last_clean":"2024-04-23T14:48:43.729951+0000","last_became_active":"2024-04-23T14:48:24.216419+0000","last_became_peered":"2024-04-23T14:48:24.216419+0000","last_unstale":"2024-04-23T14:48:43.729951+0000","last_undegraded":"2024-04-23T14:48:43.729951+0000","last_fullsized":"2024-04-23T14:48:43.729951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:42.302965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724909+0000","last_change":"2024-04-23T14:48:24.206828+0000","last_active":"2024-04-23T14:48:43.724909+0000","last_peered":"2024-04-23T14:48:43.724909+0000","last_clean":"2024-04-23T14:48:43.724909+0000","last_became_active":"2024-04-23T14:48:24.203562+0000","last_became_peered":"2024-04-23T14:48:24.203562+0000","last_unstale":"2024-04-23T14:48:43.724909+0000","last_undegraded":"2024-04-23T14:48:43.724909+0000","last_fullsized":"2024-04-23T14:48:43.724909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:59.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792556+0000","last_change":"2024-04-23T14:48:24.208440+0000","last_active":"2024-04-23T14:48:43.792556+0000","last_peered":"2024-04-23T14:48:43.792556+0000","last_clean":"2024-04-23T14:48:43.792556+0000","last_became_active":"2024-04-23T14:48:24.208052+0000","last_became_peered":"2024-04-23T14:48:24.208052+0000","last_unstale":"2024-04-23T14:48:43.792556+0000","last_undegraded":"2024-04-23T14:48:43.792556+0000","last_fullsized":"2024-04-23T14:48:43.792556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:19.906675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48685,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":25,"num_read_kb":60,"num_write":212,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":76449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383702,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":501433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645340,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1708032,"data_stored":1130155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1060864,"data_stored":505459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":496883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1642496,"data_stored":1090046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":496867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":500960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":498323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":501337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1032192,"data_stored":496429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":496789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1093820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":43642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T14:48:56.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 -- 172.21.15.7:0/129955795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc105400 msgr2=0x7fc5bc1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/129955795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc105400 0x7fc5bc1077f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009900 tx=0x7fc5a402a410 comp rx=0 tx=0).stop 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 -- 172.21.15.7:0/129955795 shutdown_connections 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/129955795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5bc107d30 0x7fc5bc10a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/129955795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc105400 0x7fc5bc1077f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/129955795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 -- 172.21.15.7:0/129955795 >> 172.21.15.7:0/129955795 conn(0x7fc5bc0fc4e0 msgr2=0x7fc5bc0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 -- 172.21.15.7:0/129955795 shutdown_connections 2024-04-23T14:48:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.703+0000 7fc5c2e00640 1 -- 172.21.15.7:0/129955795 wait complete. 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 Processor -- start 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 -- start start 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc105400 0x7fc5bc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5bc107d30 0x7fc5bc1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc10dbe0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc10da60 con 0x7fc5bc107d30 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.704+0000 7fc5c2e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc10dd60 con 0x7fc5bc105400 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46342/0 (socket says 172.21.15.7:46342) 2024-04-23T14:48:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 -- 172.21.15.7:0/1709468861 learned_addr learned my addr 172.21.15.7:0/1709468861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bb400640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc105400 0x7fc5bc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5c0e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5bc107d30 0x7fc5bc1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 -- 172.21.15.7:0/1709468861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc105400 msgr2=0x7fc5bc19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc105400 0x7fc5bc19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 -- 172.21.15.7:0/1709468861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5bc107d30 msgr2=0x7fc5bc1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5bc107d30 0x7fc5bc1a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 -- 172.21.15.7:0/1709468861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc1a20b0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bb400640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc105400 0x7fc5bc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.705+0000 7fc5bbe00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc19a490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00ea80 tx=0x7fc5ac00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.706+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00ce40 con 0x7fc5bc102ad0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.706+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5ac005020 con 0x7fc5bc102ad0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.706+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac0116d0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.706+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5bc1a23a0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.706+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5bc1a28f0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.707+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5bc109880 con 0x7fc5bc102ad0 2024-04-23T14:48:56.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.709+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fc5ac0051d0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.710+0000 7fc5b8c00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc5a00a3cc0 0x7fc5a00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:56.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.710+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc5ac0d0bf0 con 0x7fc5bc102ad0 2024-04-23T14:48:56.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.711+0000 7fc5bb400640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc5a00a3cc0 0x7fc5a00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.711+0000 7fc5bb400640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc5a00a3cc0 0x7fc5a00a6180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402a930 tx=0x7fc5a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:56.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.715+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc5ac016030 con 0x7fc5bc102ad0 2024-04-23T14:48:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.920+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5bc062440 con 0x7fc5a00a3cc0 2024-04-23T14:48:56.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.936+0000 7fc5b8c00640 1 -- 172.21.15.7:0/1709468861 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340505 (secure 0 0 0) 0x7fc5bc062440 con 0x7fc5a00a3cc0 2024-04-23T14:48:56.941 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:48:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-23T14:48:56.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.942+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc5a00a3cc0 msgr2=0x7fc5a00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.942+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc5a00a3cc0 0x7fc5a00a6180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402a930 tx=0x7fc5a4005fd0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 msgr2=0x7fc5bc19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:56.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc19a490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00ea80 tx=0x7fc5ac00ef40 comp rx=0 tx=0).stop 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 shutdown_connections 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc5a00a3cc0 0x7fc5a00a6180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5bc107d30 0x7fc5bc1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5bc105400 0x7fc5bc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 --2- 172.21.15.7:0/1709468861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5bc102ad0 0x7fc5bc19a490 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 >> 172.21.15.7:0/1709468861 conn(0x7fc5bc0fc4e0 msgr2=0x7fc5bc1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 shutdown_connections 2024-04-23T14:48:56.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:56.943+0000 7fc5c2e00640 1 -- 172.21.15.7:0/1709468861 wait complete. 2024-04-23T14:48:56.962 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-04-23T14:48:56.323307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639053,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":161,"num_read_kb":179,"num_write":393,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":324,"ondisk_log_size":324,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371508,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570316,"statfs":{"total":1151940427776,"available":1151560003584,"internally_reserved":0,"allocated":14372864,"data_stored":7808501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45826,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":25,"num_read_kb":60,"num_write":166,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005846"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.793477+0000","last_change":"2024-04-23T14:48:24.207434+0000","last_active":"2024-04-23T14:48:43.793477+0000","last_peered":"2024-04-23T14:48:43.793477+0000","last_clean":"2024-04-23T14:48:43.793477+0000","last_became_active":"2024-04-23T14:48:24.204367+0000","last_became_peered":"2024-04-23T14:48:24.204367+0000","last_unstale":"2024-04-23T14:48:43.793477+0000","last_undegraded":"2024-04-23T14:48:43.793477+0000","last_fullsized":"2024-04-23T14:48:43.793477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:50.125997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723646+0000","last_change":"2024-04-23T14:48:24.207435+0000","last_active":"2024-04-23T14:48:43.723646+0000","last_peered":"2024-04-23T14:48:43.723646+0000","last_clean":"2024-04-23T14:48:43.723646+0000","last_became_active":"2024-04-23T14:48:24.207086+0000","last_became_peered":"2024-04-23T14:48:24.207086+0000","last_unstale":"2024-04-23T14:48:43.723646+0000","last_undegraded":"2024-04-23T14:48:43.723646+0000","last_fullsized":"2024-04-23T14:48:43.723646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:53:39.864396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.725248+0000","last_change":"2024-04-23T14:48:24.208293+0000","last_active":"2024-04-23T14:48:43.725248+0000","last_peered":"2024-04-23T14:48:43.725248+0000","last_clean":"2024-04-23T14:48:43.725248+0000","last_became_active":"2024-04-23T14:48:24.207935+0000","last_became_peered":"2024-04-23T14:48:24.207935+0000","last_unstale":"2024-04-23T14:48:43.725248+0000","last_undegraded":"2024-04-23T14:48:43.725248+0000","last_fullsized":"2024-04-23T14:48:43.725248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:26.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727514+0000","last_change":"2024-04-23T14:48:24.201916+0000","last_active":"2024-04-23T14:48:43.727514+0000","last_peered":"2024-04-23T14:48:43.727514+0000","last_clean":"2024-04-23T14:48:43.727514+0000","last_became_active":"2024-04-23T14:48:24.201500+0000","last_became_peered":"2024-04-23T14:48:24.201500+0000","last_unstale":"2024-04-23T14:48:43.727514+0000","last_undegraded":"2024-04-23T14:48:43.727514+0000","last_fullsized":"2024-04-23T14:48:43.727514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:02.697609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724795+0000","last_change":"2024-04-23T14:48:24.210928+0000","last_active":"2024-04-23T14:48:43.724795+0000","last_peered":"2024-04-23T14:48:43.724795+0000","last_clean":"2024-04-23T14:48:43.724795+0000","last_became_active":"2024-04-23T14:48:24.210576+0000","last_became_peered":"2024-04-23T14:48:24.210576+0000","last_unstale":"2024-04-23T14:48:43.724795+0000","last_undegraded":"2024-04-23T14:48:43.724795+0000","last_fullsized":"2024-04-23T14:48:43.724795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:49.662992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009463+0000","last_change":"2024-04-23T14:48:24.206641+0000","last_active":"2024-04-23T14:48:44.009463+0000","last_peered":"2024-04-23T14:48:44.009463+0000","last_clean":"2024-04-23T14:48:44.009463+0000","last_became_active":"2024-04-23T14:48:24.206298+0000","last_became_peered":"2024-04-23T14:48:24.206298+0000","last_unstale":"2024-04-23T14:48:44.009463+0000","last_undegraded":"2024-04-23T14:48:44.009463+0000","last_fullsized":"2024-04-23T14:48:44.009463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:50.150157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734531+0000","last_change":"2024-04-23T14:48:24.204762+0000","last_active":"2024-04-23T14:48:43.734531+0000","last_peered":"2024-04-23T14:48:43.734531+0000","last_clean":"2024-04-23T14:48:43.734531+0000","last_became_active":"2024-04-23T14:48:24.204396+0000","last_became_peered":"2024-04-23T14:48:24.204396+0000","last_unstale":"2024-04-23T14:48:43.734531+0000","last_undegraded":"2024-04-23T14:48:43.734531+0000","last_fullsized":"2024-04-23T14:48:43.734531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:53.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.007927+0000","last_change":"2024-04-23T14:48:24.214064+0000","last_active":"2024-04-23T14:48:44.007927+0000","last_peered":"2024-04-23T14:48:44.007927+0000","last_clean":"2024-04-23T14:48:44.007927+0000","last_became_active":"2024-04-23T14:48:24.213748+0000","last_became_peered":"2024-04-23T14:48:24.213748+0000","last_unstale":"2024-04-23T14:48:44.007927+0000","last_undegraded":"2024-04-23T14:48:44.007927+0000","last_fullsized":"2024-04-23T14:48:44.007927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:52.011095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729495+0000","last_change":"2024-04-23T14:48:24.196420+0000","last_active":"2024-04-23T14:48:43.729495+0000","last_peered":"2024-04-23T14:48:43.729495+0000","last_clean":"2024-04-23T14:48:43.729495+0000","last_became_active":"2024-04-23T14:48:24.196086+0000","last_became_peered":"2024-04-23T14:48:24.196086+0000","last_unstale":"2024-04-23T14:48:43.729495+0000","last_undegraded":"2024-04-23T14:48:43.729495+0000","last_fullsized":"2024-04-23T14:48:43.729495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:38.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009956+0000","last_change":"2024-04-23T14:48:24.208801+0000","last_active":"2024-04-23T14:48:44.009956+0000","last_peered":"2024-04-23T14:48:44.009956+0000","last_clean":"2024-04-23T14:48:44.009956+0000","last_became_active":"2024-04-23T14:48:24.208088+0000","last_became_peered":"2024-04-23T14:48:24.208088+0000","last_unstale":"2024-04-23T14:48:44.009956+0000","last_undegraded":"2024-04-23T14:48:44.009956+0000","last_fullsized":"2024-04-23T14:48:44.009956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:30.684820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735191+0000","last_change":"2024-04-23T14:48:24.207387+0000","last_active":"2024-04-23T14:48:43.735191+0000","last_peered":"2024-04-23T14:48:43.735191+0000","last_clean":"2024-04-23T14:48:43.735191+0000","last_became_active":"2024-04-23T14:48:24.205524+0000","last_became_peered":"2024-04-23T14:48:24.205524+0000","last_unstale":"2024-04-23T14:48:43.735191+0000","last_undegraded":"2024-04-23T14:48:43.735191+0000","last_fullsized":"2024-04-23T14:48:43.735191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:24:52.196823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727202+0000","last_change":"2024-04-23T14:48:24.198132+0000","last_active":"2024-04-23T14:48:43.727202+0000","last_peered":"2024-04-23T14:48:43.727202+0000","last_clean":"2024-04-23T14:48:43.727202+0000","last_became_active":"2024-04-23T14:48:24.197714+0000","last_became_peered":"2024-04-23T14:48:24.197714+0000","last_unstale":"2024-04-23T14:48:43.727202+0000","last_undegraded":"2024-04-23T14:48:43.727202+0000","last_fullsized":"2024-04-23T14:48:43.727202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:41.208307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724810+0000","last_change":"2024-04-23T14:48:24.205780+0000","last_active":"2024-04-23T14:48:43.724810+0000","last_peered":"2024-04-23T14:48:43.724810+0000","last_clean":"2024-04-23T14:48:43.724810+0000","last_became_active":"2024-04-23T14:48:24.205413+0000","last_became_peered":"2024-04-23T14:48:24.205413+0000","last_unstale":"2024-04-23T14:48:43.724810+0000","last_undegraded":"2024-04-23T14:48:43.724810+0000","last_fullsized":"2024-04-23T14:48:43.724810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:06.002666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723759+0000","last_change":"2024-04-23T14:48:24.205304+0000","last_active":"2024-04-23T14:48:43.723759+0000","last_peered":"2024-04-23T14:48:43.723759+0000","last_clean":"2024-04-23T14:48:43.723759+0000","last_became_active":"2024-04-23T14:48:24.204915+0000","last_became_peered":"2024-04-23T14:48:24.204915+0000","last_unstale":"2024-04-23T14:48:43.723759+0000","last_undegraded":"2024-04-23T14:48:43.723759+0000","last_fullsized":"2024-04-23T14:48:43.723759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:53.835101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723561+0000","last_change":"2024-04-23T14:48:24.208371+0000","last_active":"2024-04-23T14:48:43.723561+0000","last_peered":"2024-04-23T14:48:43.723561+0000","last_clean":"2024-04-23T14:48:43.723561+0000","last_became_active":"2024-04-23T14:48:24.208084+0000","last_became_peered":"2024-04-23T14:48:24.208084+0000","last_unstale":"2024-04-23T14:48:43.723561+0000","last_undegraded":"2024-04-23T14:48:43.723561+0000","last_fullsized":"2024-04-23T14:48:43.723561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:01.263469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.726357+0000","last_change":"2024-04-23T14:48:24.204211+0000","last_active":"2024-04-23T14:48:43.726357+0000","last_peered":"2024-04-23T14:48:43.726357+0000","last_clean":"2024-04-23T14:48:43.726357+0000","last_became_active":"2024-04-23T14:48:24.203890+0000","last_became_peered":"2024-04-23T14:48:24.203890+0000","last_unstale":"2024-04-23T14:48:43.726357+0000","last_undegraded":"2024-04-23T14:48:43.726357+0000","last_fullsized":"2024-04-23T14:48:43.726357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:05.730785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.793242+0000","last_change":"2024-04-23T14:48:24.204731+0000","last_active":"2024-04-23T14:48:43.793242+0000","last_peered":"2024-04-23T14:48:43.793242+0000","last_clean":"2024-04-23T14:48:43.793242+0000","last_became_active":"2024-04-23T14:48:24.204121+0000","last_became_peered":"2024-04-23T14:48:24.204121+0000","last_unstale":"2024-04-23T14:48:43.793242+0000","last_undegraded":"2024-04-23T14:48:43.793242+0000","last_fullsized":"2024-04-23T14:48:43.793242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:04:57.777924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.719681+0000","last_change":"2024-04-23T14:48:24.208297+0000","last_active":"2024-04-23T14:48:43.719681+0000","last_peered":"2024-04-23T14:48:43.719681+0000","last_clean":"2024-04-23T14:48:43.719681+0000","last_became_active":"2024-04-23T14:48:24.207960+0000","last_became_peered":"2024-04-23T14:48:24.207960+0000","last_unstale":"2024-04-23T14:48:43.719681+0000","last_undegraded":"2024-04-23T14:48:43.719681+0000","last_fullsized":"2024-04-23T14:48:43.719681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:46.393630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723697+0000","last_change":"2024-04-23T14:48:24.212739+0000","last_active":"2024-04-23T14:48:43.723697+0000","last_peered":"2024-04-23T14:48:43.723697+0000","last_clean":"2024-04-23T14:48:43.723697+0000","last_became_active":"2024-04-23T14:48:24.212259+0000","last_became_peered":"2024-04-23T14:48:24.212259+0000","last_unstale":"2024-04-23T14:48:43.723697+0000","last_undegraded":"2024-04-23T14:48:43.723697+0000","last_fullsized":"2024-04-23T14:48:43.723697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:15:23.268086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722833+0000","last_change":"2024-04-23T14:48:28.692932+0000","last_active":"2024-04-23T14:48:43.722833+0000","last_peered":"2024-04-23T14:48:43.722833+0000","last_clean":"2024-04-23T14:48:43.722833+0000","last_became_active":"2024-04-23T14:48:28.692188+0000","last_became_peered":"2024-04-23T14:48:28.692188+0000","last_unstale":"2024-04-23T14:48:43.722833+0000","last_undegraded":"2024-04-23T14:48:43.722833+0000","last_fullsized":"2024-04-23T14:48:43.722833+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:44.695181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:53.872282+0000","last_change":"2024-04-23T14:48:23.167934+0000","last_active":"2024-04-23T14:48:53.872282+0000","last_peered":"2024-04-23T14:48:53.872282+0000","last_clean":"2024-04-23T14:48:53.872282+0000","last_became_active":"2024-04-23T14:48:23.167483+0000","last_became_peered":"2024-04-23T14:48:23.167483+0000","last_unstale":"2024-04-23T14:48:53.872282+0000","last_undegraded":"2024-04-23T14:48:53.872282+0000","last_fullsized":"2024-04-23T14:48:53.872282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:16.011021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009331+0000","last_change":"2024-04-23T14:48:24.209028+0000","last_active":"2024-04-23T14:48:44.009331+0000","last_peered":"2024-04-23T14:48:44.009331+0000","last_clean":"2024-04-23T14:48:44.009331+0000","last_became_active":"2024-04-23T14:48:24.208648+0000","last_became_peered":"2024-04-23T14:48:24.208648+0000","last_unstale":"2024-04-23T14:48:44.009331+0000","last_undegraded":"2024-04-23T14:48:44.009331+0000","last_fullsized":"2024-04-23T14:48:44.009331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:28:17.432131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.011555+0000","last_change":"2024-04-23T14:48:44.011555+0000","last_active":"2024-04-23T14:48:44.011555+0000","last_peered":"2024-04-23T14:48:44.011555+0000","last_clean":"2024-04-23T14:48:44.011555+0000","last_became_active":"2024-04-23T14:48:44.010556+0000","last_became_peered":"2024-04-23T14:48:44.010556+0000","last_unstale":"2024-04-23T14:48:44.011555+0000","last_undegraded":"2024-04-23T14:48:44.011555+0000","last_fullsized":"2024-04-23T14:48:44.011555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:03.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009624+0000","last_change":"2024-04-23T14:48:23.170507+0000","last_active":"2024-04-23T14:48:44.009624+0000","last_peered":"2024-04-23T14:48:44.009624+0000","last_clean":"2024-04-23T14:48:44.009624+0000","last_became_active":"2024-04-23T14:48:23.166478+0000","last_became_peered":"2024-04-23T14:48:23.166478+0000","last_unstale":"2024-04-23T14:48:44.009624+0000","last_undegraded":"2024-04-23T14:48:44.009624+0000","last_fullsized":"2024-04-23T14:48:44.009624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:13.163752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724617+0000","last_change":"2024-04-23T14:48:24.202716+0000","last_active":"2024-04-23T14:48:43.724617+0000","last_peered":"2024-04-23T14:48:43.724617+0000","last_clean":"2024-04-23T14:48:43.724617+0000","last_became_active":"2024-04-23T14:48:24.201811+0000","last_became_peered":"2024-04-23T14:48:24.201811+0000","last_unstale":"2024-04-23T14:48:43.724617+0000","last_undegraded":"2024-04-23T14:48:43.724617+0000","last_fullsized":"2024-04-23T14:48:43.724617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:12.834493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724995+0000","last_change":"2024-04-23T14:48:28.690956+0000","last_active":"2024-04-23T14:48:43.724995+0000","last_peered":"2024-04-23T14:48:43.724995+0000","last_clean":"2024-04-23T14:48:43.724995+0000","last_became_active":"2024-04-23T14:48:28.689949+0000","last_became_peered":"2024-04-23T14:48:28.689949+0000","last_unstale":"2024-04-23T14:48:43.724995+0000","last_undegraded":"2024-04-23T14:48:43.724995+0000","last_fullsized":"2024-04-23T14:48:43.724995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:57.646314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.865604+0000","last_change":"2024-04-23T14:48:23.175420+0000","last_active":"2024-04-23T14:48:52.865604+0000","last_peered":"2024-04-23T14:48:52.865604+0000","last_clean":"2024-04-23T14:48:52.865604+0000","last_became_active":"2024-04-23T14:48:23.175009+0000","last_became_peered":"2024-04-23T14:48:23.175009+0000","last_unstale":"2024-04-23T14:48:52.865604+0000","last_undegraded":"2024-04-23T14:48:52.865604+0000","last_fullsized":"2024-04-23T14:48:52.865604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:17.902941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728344+0000","last_change":"2024-04-23T14:48:24.197838+0000","last_active":"2024-04-23T14:48:43.728344+0000","last_peered":"2024-04-23T14:48:43.728344+0000","last_clean":"2024-04-23T14:48:43.728344+0000","last_became_active":"2024-04-23T14:48:24.196112+0000","last_became_peered":"2024-04-23T14:48:24.196112+0000","last_unstale":"2024-04-23T14:48:43.728344+0000","last_undegraded":"2024-04-23T14:48:43.728344+0000","last_fullsized":"2024-04-23T14:48:43.728344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:06.829973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723640+0000","last_change":"2024-04-23T14:48:28.691296+0000","last_active":"2024-04-23T14:48:43.723640+0000","last_peered":"2024-04-23T14:48:43.723640+0000","last_clean":"2024-04-23T14:48:43.723640+0000","last_became_active":"2024-04-23T14:48:28.690695+0000","last_became_peered":"2024-04-23T14:48:28.690695+0000","last_unstale":"2024-04-23T14:48:43.723640+0000","last_undegraded":"2024-04-23T14:48:43.723640+0000","last_fullsized":"2024-04-23T14:48:43.723640+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:17.028864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.863757+0000","last_change":"2024-04-23T14:48:23.162403+0000","last_active":"2024-04-23T14:48:52.863757+0000","last_peered":"2024-04-23T14:48:52.863757+0000","last_clean":"2024-04-23T14:48:52.863757+0000","last_became_active":"2024-04-23T14:48:23.162010+0000","last_became_peered":"2024-04-23T14:48:23.162010+0000","last_unstale":"2024-04-23T14:48:52.863757+0000","last_undegraded":"2024-04-23T14:48:52.863757+0000","last_fullsized":"2024-04-23T14:48:52.863757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:59.213131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.732659+0000","last_change":"2024-04-23T14:48:24.197815+0000","last_active":"2024-04-23T14:48:43.732659+0000","last_peered":"2024-04-23T14:48:43.732659+0000","last_clean":"2024-04-23T14:48:43.732659+0000","last_became_active":"2024-04-23T14:48:24.194153+0000","last_became_peered":"2024-04-23T14:48:24.194153+0000","last_unstale":"2024-04-23T14:48:43.732659+0000","last_undegraded":"2024-04-23T14:48:43.732659+0000","last_fullsized":"2024-04-23T14:48:43.732659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:37:30.113646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722774+0000","last_change":"2024-04-23T14:48:28.693952+0000","last_active":"2024-04-23T14:48:43.722774+0000","last_peered":"2024-04-23T14:48:43.722774+0000","last_clean":"2024-04-23T14:48:43.722774+0000","last_became_active":"2024-04-23T14:48:28.691769+0000","last_became_peered":"2024-04-23T14:48:28.691769+0000","last_unstale":"2024-04-23T14:48:43.722774+0000","last_undegraded":"2024-04-23T14:48:43.722774+0000","last_fullsized":"2024-04-23T14:48:43.722774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:40:29.883206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:53.871668+0000","last_change":"2024-04-23T14:48:23.174584+0000","last_active":"2024-04-23T14:48:53.871668+0000","last_peered":"2024-04-23T14:48:53.871668+0000","last_clean":"2024-04-23T14:48:53.871668+0000","last_became_active":"2024-04-23T14:48:23.170982+0000","last_became_peered":"2024-04-23T14:48:23.170982+0000","last_unstale":"2024-04-23T14:48:53.871668+0000","last_undegraded":"2024-04-23T14:48:53.871668+0000","last_fullsized":"2024-04-23T14:48:53.871668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:21.304149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728169+0000","last_change":"2024-04-23T14:48:24.190360+0000","last_active":"2024-04-23T14:48:43.728169+0000","last_peered":"2024-04-23T14:48:43.728169+0000","last_clean":"2024-04-23T14:48:43.728169+0000","last_became_active":"2024-04-23T14:48:24.188138+0000","last_became_peered":"2024-04-23T14:48:24.188138+0000","last_unstale":"2024-04-23T14:48:43.728169+0000","last_undegraded":"2024-04-23T14:48:43.728169+0000","last_fullsized":"2024-04-23T14:48:43.728169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:55:27.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723495+0000","last_change":"2024-04-23T14:48:28.693859+0000","last_active":"2024-04-23T14:48:43.723495+0000","last_peered":"2024-04-23T14:48:43.723495+0000","last_clean":"2024-04-23T14:48:43.723495+0000","last_became_active":"2024-04-23T14:48:28.693338+0000","last_became_peered":"2024-04-23T14:48:28.693338+0000","last_unstale":"2024-04-23T14:48:43.723495+0000","last_undegraded":"2024-04-23T14:48:43.723495+0000","last_fullsized":"2024-04-23T14:48:43.723495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:46.176604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.834112+0000","last_change":"2024-04-23T14:48:23.173206+0000","last_active":"2024-04-23T14:48:51.834112+0000","last_peered":"2024-04-23T14:48:51.834112+0000","last_clean":"2024-04-23T14:48:51.834112+0000","last_became_active":"2024-04-23T14:48:23.172780+0000","last_became_peered":"2024-04-23T14:48:23.172780+0000","last_unstale":"2024-04-23T14:48:51.834112+0000","last_undegraded":"2024-04-23T14:48:51.834112+0000","last_fullsized":"2024-04-23T14:48:51.834112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:51.870634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.012145+0000","last_change":"2024-04-23T14:48:44.010379+0000","last_active":"2024-04-23T14:48:44.012145+0000","last_peered":"2024-04-23T14:48:44.012145+0000","last_clean":"2024-04-23T14:48:44.012145+0000","last_became_active":"2024-04-23T14:48:44.009673+0000","last_became_peered":"2024-04-23T14:48:44.009673+0000","last_unstale":"2024-04-23T14:48:44.012145+0000","last_undegraded":"2024-04-23T14:48:44.012145+0000","last_fullsized":"2024-04-23T14:48:44.012145+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:46.552062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792672+0000","last_change":"2024-04-23T14:48:28.684186+0000","last_active":"2024-04-23T14:48:43.792672+0000","last_peered":"2024-04-23T14:48:43.792672+0000","last_clean":"2024-04-23T14:48:43.792672+0000","last_became_active":"2024-04-23T14:48:28.683109+0000","last_became_peered":"2024-04-23T14:48:28.683109+0000","last_unstale":"2024-04-23T14:48:43.792672+0000","last_undegraded":"2024-04-23T14:48:43.792672+0000","last_fullsized":"2024-04-23T14:48:43.792672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:03.782346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:50.834164+0000","last_change":"2024-04-23T14:48:23.159599+0000","last_active":"2024-04-23T14:48:50.834164+0000","last_peered":"2024-04-23T14:48:50.834164+0000","last_clean":"2024-04-23T14:48:50.834164+0000","last_became_active":"2024-04-23T14:48:23.158986+0000","last_became_peered":"2024-04-23T14:48:23.158986+0000","last_unstale":"2024-04-23T14:48:50.834164+0000","last_undegraded":"2024-04-23T14:48:50.834164+0000","last_fullsized":"2024-04-23T14:48:50.834164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:00.254987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008401+0000","last_change":"2024-04-23T14:48:24.200644+0000","last_active":"2024-04-23T14:48:44.008401+0000","last_peered":"2024-04-23T14:48:44.008401+0000","last_clean":"2024-04-23T14:48:44.008401+0000","last_became_active":"2024-04-23T14:48:24.200236+0000","last_became_peered":"2024-04-23T14:48:24.200236+0000","last_unstale":"2024-04-23T14:48:44.008401+0000","last_undegraded":"2024-04-23T14:48:44.008401+0000","last_fullsized":"2024-04-23T14:48:44.008401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:51.634416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723581+0000","last_change":"2024-04-23T14:48:28.699959+0000","last_active":"2024-04-23T14:48:43.723581+0000","last_peered":"2024-04-23T14:48:43.723581+0000","last_clean":"2024-04-23T14:48:43.723581+0000","last_became_active":"2024-04-23T14:48:28.699327+0000","last_became_peered":"2024-04-23T14:48:28.699327+0000","last_unstale":"2024-04-23T14:48:43.723581+0000","last_undegraded":"2024-04-23T14:48:43.723581+0000","last_fullsized":"2024-04-23T14:48:43.723581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:41:32.257355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.866189+0000","last_change":"2024-04-23T14:48:23.165179+0000","last_active":"2024-04-23T14:48:52.866189+0000","last_peered":"2024-04-23T14:48:52.866189+0000","last_clean":"2024-04-23T14:48:52.866189+0000","last_became_active":"2024-04-23T14:48:23.164784+0000","last_became_peered":"2024-04-23T14:48:23.164784+0000","last_unstale":"2024-04-23T14:48:52.866189+0000","last_undegraded":"2024-04-23T14:48:52.866189+0000","last_fullsized":"2024-04-23T14:48:52.866189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:02.522867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.718962+0000","last_change":"2024-04-23T14:48:24.202092+0000","last_active":"2024-04-23T14:48:43.718962+0000","last_peered":"2024-04-23T14:48:43.718962+0000","last_clean":"2024-04-23T14:48:43.718962+0000","last_became_active":"2024-04-23T14:48:24.200676+0000","last_became_peered":"2024-04-23T14:48:24.200676+0000","last_unstale":"2024-04-23T14:48:43.718962+0000","last_undegraded":"2024-04-23T14:48:43.718962+0000","last_fullsized":"2024-04-23T14:48:43.718962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:55:31.584366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008076+0000","last_change":"2024-04-23T14:48:28.692929+0000","last_active":"2024-04-23T14:48:44.008076+0000","last_peered":"2024-04-23T14:48:44.008076+0000","last_clean":"2024-04-23T14:48:44.008076+0000","last_became_active":"2024-04-23T14:48:28.692405+0000","last_became_peered":"2024-04-23T14:48:28.692405+0000","last_unstale":"2024-04-23T14:48:44.008076+0000","last_undegraded":"2024-04-23T14:48:44.008076+0000","last_fullsized":"2024-04-23T14:48:44.008076+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:13:30.063548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:54.871030+0000","last_change":"2024-04-23T14:48:23.165520+0000","last_active":"2024-04-23T14:48:54.871030+0000","last_peered":"2024-04-23T14:48:54.871030+0000","last_clean":"2024-04-23T14:48:54.871030+0000","last_became_active":"2024-04-23T14:48:23.163725+0000","last_became_peered":"2024-04-23T14:48:23.163725+0000","last_unstale":"2024-04-23T14:48:54.871030+0000","last_undegraded":"2024-04-23T14:48:54.871030+0000","last_fullsized":"2024-04-23T14:48:54.871030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:58.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729188+0000","last_change":"2024-04-23T14:48:24.200779+0000","last_active":"2024-04-23T14:48:43.729188+0000","last_peered":"2024-04-23T14:48:43.729188+0000","last_clean":"2024-04-23T14:48:43.729188+0000","last_became_active":"2024-04-23T14:48:24.199391+0000","last_became_peered":"2024-04-23T14:48:24.199391+0000","last_unstale":"2024-04-23T14:48:43.729188+0000","last_undegraded":"2024-04-23T14:48:43.729188+0000","last_fullsized":"2024-04-23T14:48:43.729188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:26.333246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.718879+0000","last_change":"2024-04-23T14:48:28.688860+0000","last_active":"2024-04-23T14:48:43.718879+0000","last_peered":"2024-04-23T14:48:43.718879+0000","last_clean":"2024-04-23T14:48:43.718879+0000","last_became_active":"2024-04-23T14:48:28.688427+0000","last_became_peered":"2024-04-23T14:48:28.688427+0000","last_unstale":"2024-04-23T14:48:43.718879+0000","last_undegraded":"2024-04-23T14:48:43.718879+0000","last_fullsized":"2024-04-23T14:48:43.718879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:02.196099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.866377+0000","last_change":"2024-04-23T14:48:23.170515+0000","last_active":"2024-04-23T14:48:52.866377+0000","last_peered":"2024-04-23T14:48:52.866377+0000","last_clean":"2024-04-23T14:48:52.866377+0000","last_became_active":"2024-04-23T14:48:23.170078+0000","last_became_peered":"2024-04-23T14:48:23.170078+0000","last_unstale":"2024-04-23T14:48:52.866377+0000","last_undegraded":"2024-04-23T14:48:52.866377+0000","last_fullsized":"2024-04-23T14:48:52.866377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:33:52.560319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724950+0000","last_change":"2024-04-23T14:48:24.202989+0000","last_active":"2024-04-23T14:48:43.724950+0000","last_peered":"2024-04-23T14:48:43.724950+0000","last_clean":"2024-04-23T14:48:43.724950+0000","last_became_active":"2024-04-23T14:48:24.202334+0000","last_became_peered":"2024-04-23T14:48:24.202334+0000","last_unstale":"2024-04-23T14:48:43.724950+0000","last_undegraded":"2024-04-23T14:48:43.724950+0000","last_fullsized":"2024-04-23T14:48:43.724950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:48:16.044242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.012817+0000","last_change":"2024-04-23T14:48:44.012817+0000","last_active":"2024-04-23T14:48:44.012817+0000","last_peered":"2024-04-23T14:48:44.012817+0000","last_clean":"2024-04-23T14:48:44.012817+0000","last_became_active":"2024-04-23T14:48:44.011680+0000","last_became_peered":"2024-04-23T14:48:44.011680+0000","last_unstale":"2024-04-23T14:48:44.012817+0000","last_undegraded":"2024-04-23T14:48:44.012817+0000","last_fullsized":"2024-04-23T14:48:44.012817+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:36.289301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.835235+0000","last_change":"2024-04-23T14:48:23.174183+0000","last_active":"2024-04-23T14:48:51.835235+0000","last_peered":"2024-04-23T14:48:51.835235+0000","last_clean":"2024-04-23T14:48:51.835235+0000","last_became_active":"2024-04-23T14:48:23.173345+0000","last_became_peered":"2024-04-23T14:48:23.173345+0000","last_unstale":"2024-04-23T14:48:51.835235+0000","last_undegraded":"2024-04-23T14:48:51.835235+0000","last_fullsized":"2024-04-23T14:48:51.835235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:24.557598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728477+0000","last_change":"2024-04-23T14:48:24.187891+0000","last_active":"2024-04-23T14:48:43.728477+0000","last_peered":"2024-04-23T14:48:43.728477+0000","last_clean":"2024-04-23T14:48:43.728477+0000","last_became_active":"2024-04-23T14:48:24.187495+0000","last_became_peered":"2024-04-23T14:48:24.187495+0000","last_unstale":"2024-04-23T14:48:43.728477+0000","last_undegraded":"2024-04-23T14:48:43.728477+0000","last_fullsized":"2024-04-23T14:48:43.728477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:54.561153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.719126+0000","last_change":"2024-04-23T14:48:28.690722+0000","last_active":"2024-04-23T14:48:43.719126+0000","last_peered":"2024-04-23T14:48:43.719126+0000","last_clean":"2024-04-23T14:48:43.719126+0000","last_became_active":"2024-04-23T14:48:28.690294+0000","last_became_peered":"2024-04-23T14:48:28.690294+0000","last_unstale":"2024-04-23T14:48:43.719126+0000","last_undegraded":"2024-04-23T14:48:43.719126+0000","last_fullsized":"2024-04-23T14:48:43.719126+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:50.657059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'25","reported_seq":58,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:54.876774+0000","last_change":"2024-04-23T14:48:23.164136+0000","last_active":"2024-04-23T14:48:54.876774+0000","last_peered":"2024-04-23T14:48:54.876774+0000","last_clean":"2024-04-23T14:48:54.876774+0000","last_became_active":"2024-04-23T14:48:23.162342+0000","last_became_peered":"2024-04-23T14:48:23.162342+0000","last_unstale":"2024-04-23T14:48:54.876774+0000","last_undegraded":"2024-04-23T14:48:54.876774+0000","last_fullsized":"2024-04-23T14:48:54.876774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:50:50.956006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41906,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":44,"num_write":27,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727622+0000","last_change":"2024-04-23T14:48:24.199242+0000","last_active":"2024-04-23T14:48:43.727622+0000","last_peered":"2024-04-23T14:48:43.727622+0000","last_clean":"2024-04-23T14:48:43.727622+0000","last_became_active":"2024-04-23T14:48:24.198870+0000","last_became_peered":"2024-04-23T14:48:24.198870+0000","last_unstale":"2024-04-23T14:48:43.727622+0000","last_undegraded":"2024-04-23T14:48:43.727622+0000","last_fullsized":"2024-04-23T14:48:43.727622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:55.824352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.733432+0000","last_change":"2024-04-23T14:48:28.696469+0000","last_active":"2024-04-23T14:48:43.733432+0000","last_peered":"2024-04-23T14:48:43.733432+0000","last_clean":"2024-04-23T14:48:43.733432+0000","last_became_active":"2024-04-23T14:48:28.695973+0000","last_became_peered":"2024-04-23T14:48:28.695973+0000","last_unstale":"2024-04-23T14:48:43.733432+0000","last_undegraded":"2024-04-23T14:48:43.733432+0000","last_fullsized":"2024-04-23T14:48:43.733432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:34.793357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:50.827759+0000","last_change":"2024-04-23T14:48:23.155889+0000","last_active":"2024-04-23T14:48:50.827759+0000","last_peered":"2024-04-23T14:48:50.827759+0000","last_clean":"2024-04-23T14:48:50.827759+0000","last_became_active":"2024-04-23T14:48:23.155494+0000","last_became_peered":"2024-04-23T14:48:23.155494+0000","last_unstale":"2024-04-23T14:48:50.827759+0000","last_undegraded":"2024-04-23T14:48:50.827759+0000","last_fullsized":"2024-04-23T14:48:50.827759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:14.567618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723243+0000","last_change":"2024-04-23T14:48:24.216976+0000","last_active":"2024-04-23T14:48:43.723243+0000","last_peered":"2024-04-23T14:48:43.723243+0000","last_clean":"2024-04-23T14:48:43.723243+0000","last_became_active":"2024-04-23T14:48:24.216561+0000","last_became_peered":"2024-04-23T14:48:24.216561+0000","last_unstale":"2024-04-23T14:48:43.723243+0000","last_undegraded":"2024-04-23T14:48:43.723243+0000","last_fullsized":"2024-04-23T14:48:43.723243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:40:02.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792239+0000","last_change":"2024-04-23T14:48:28.684812+0000","last_active":"2024-04-23T14:48:43.792239+0000","last_peered":"2024-04-23T14:48:43.792239+0000","last_clean":"2024-04-23T14:48:43.792239+0000","last_became_active":"2024-04-23T14:48:28.682284+0000","last_became_peered":"2024-04-23T14:48:28.682284+0000","last_unstale":"2024-04-23T14:48:43.792239+0000","last_undegraded":"2024-04-23T14:48:43.792239+0000","last_fullsized":"2024-04-23T14:48:43.792239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:19.702778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.863773+0000","last_change":"2024-04-23T14:48:23.173640+0000","last_active":"2024-04-23T14:48:52.863773+0000","last_peered":"2024-04-23T14:48:52.863773+0000","last_clean":"2024-04-23T14:48:52.863773+0000","last_became_active":"2024-04-23T14:48:23.173259+0000","last_became_peered":"2024-04-23T14:48:23.173259+0000","last_unstale":"2024-04-23T14:48:52.863773+0000","last_undegraded":"2024-04-23T14:48:52.863773+0000","last_fullsized":"2024-04-23T14:48:52.863773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:19.355340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734772+0000","last_change":"2024-04-23T14:48:24.198531+0000","last_active":"2024-04-23T14:48:43.734772+0000","last_peered":"2024-04-23T14:48:43.734772+0000","last_clean":"2024-04-23T14:48:43.734772+0000","last_became_active":"2024-04-23T14:48:24.198217+0000","last_became_peered":"2024-04-23T14:48:24.198217+0000","last_unstale":"2024-04-23T14:48:43.734772+0000","last_undegraded":"2024-04-23T14:48:43.734772+0000","last_fullsized":"2024-04-23T14:48:43.734772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:15:17.130409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.720165+0000","last_change":"2024-04-23T14:48:28.690796+0000","last_active":"2024-04-23T14:48:43.720165+0000","last_peered":"2024-04-23T14:48:43.720165+0000","last_clean":"2024-04-23T14:48:43.720165+0000","last_became_active":"2024-04-23T14:48:28.686712+0000","last_became_peered":"2024-04-23T14:48:28.686712+0000","last_unstale":"2024-04-23T14:48:43.720165+0000","last_undegraded":"2024-04-23T14:48:43.720165+0000","last_fullsized":"2024-04-23T14:48:43.720165+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:46.769848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.823456+0000","last_change":"2024-04-23T14:48:23.171753+0000","last_active":"2024-04-23T14:48:51.823456+0000","last_peered":"2024-04-23T14:48:51.823456+0000","last_clean":"2024-04-23T14:48:51.823456+0000","last_became_active":"2024-04-23T14:48:23.171177+0000","last_became_peered":"2024-04-23T14:48:23.171177+0000","last_unstale":"2024-04-23T14:48:51.823456+0000","last_undegraded":"2024-04-23T14:48:51.823456+0000","last_fullsized":"2024-04-23T14:48:51.823456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:26:06.666044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734655+0000","last_change":"2024-04-23T14:48:24.206308+0000","last_active":"2024-04-23T14:48:43.734655+0000","last_peered":"2024-04-23T14:48:43.734655+0000","last_clean":"2024-04-23T14:48:43.734655+0000","last_became_active":"2024-04-23T14:48:24.205989+0000","last_became_peered":"2024-04-23T14:48:24.205989+0000","last_unstale":"2024-04-23T14:48:43.734655+0000","last_undegraded":"2024-04-23T14:48:43.734655+0000","last_fullsized":"2024-04-23T14:48:43.734655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:53.172538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.725467+0000","last_change":"2024-04-23T14:48:28.691952+0000","last_active":"2024-04-23T14:48:43.725467+0000","last_peered":"2024-04-23T14:48:43.725467+0000","last_clean":"2024-04-23T14:48:43.725467+0000","last_became_active":"2024-04-23T14:48:28.690781+0000","last_became_peered":"2024-04-23T14:48:28.690781+0000","last_unstale":"2024-04-23T14:48:43.725467+0000","last_undegraded":"2024-04-23T14:48:43.725467+0000","last_fullsized":"2024-04-23T14:48:43.725467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:50.832695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.835831+0000","last_change":"2024-04-23T14:48:23.169165+0000","last_active":"2024-04-23T14:48:51.835831+0000","last_peered":"2024-04-23T14:48:51.835831+0000","last_clean":"2024-04-23T14:48:51.835831+0000","last_became_active":"2024-04-23T14:48:23.168822+0000","last_became_peered":"2024-04-23T14:48:23.168822+0000","last_unstale":"2024-04-23T14:48:51.835831+0000","last_undegraded":"2024-04-23T14:48:51.835831+0000","last_fullsized":"2024-04-23T14:48:51.835831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:29:49.397506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.737904+0000","last_change":"2024-04-23T14:48:43.737904+0000","last_active":"2024-04-23T14:48:43.737904+0000","last_peered":"2024-04-23T14:48:43.737904+0000","last_clean":"2024-04-23T14:48:43.737904+0000","last_became_active":"2024-04-23T14:48:43.736639+0000","last_became_peered":"2024-04-23T14:48:43.736639+0000","last_unstale":"2024-04-23T14:48:43.737904+0000","last_undegraded":"2024-04-23T14:48:43.737904+0000","last_fullsized":"2024-04-23T14:48:43.737904+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:43.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.732204+0000","last_change":"2024-04-23T14:48:28.692199+0000","last_active":"2024-04-23T14:48:43.732204+0000","last_peered":"2024-04-23T14:48:43.732204+0000","last_clean":"2024-04-23T14:48:43.732204+0000","last_became_active":"2024-04-23T14:48:28.691673+0000","last_became_peered":"2024-04-23T14:48:28.691673+0000","last_unstale":"2024-04-23T14:48:43.732204+0000","last_undegraded":"2024-04-23T14:48:43.732204+0000","last_fullsized":"2024-04-23T14:48:43.732204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:19.323509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.728517+0000","last_change":"2024-04-23T14:48:23.167091+0000","last_active":"2024-04-23T14:48:43.728517+0000","last_peered":"2024-04-23T14:48:43.728517+0000","last_clean":"2024-04-23T14:48:43.728517+0000","last_became_active":"2024-04-23T14:48:23.166734+0000","last_became_peered":"2024-04-23T14:48:23.166734+0000","last_unstale":"2024-04-23T14:48:43.728517+0000","last_undegraded":"2024-04-23T14:48:43.728517+0000","last_fullsized":"2024-04-23T14:48:43.728517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:49:11.486630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792850+0000","last_change":"2024-04-23T14:48:24.208251+0000","last_active":"2024-04-23T14:48:43.792850+0000","last_peered":"2024-04-23T14:48:43.792850+0000","last_clean":"2024-04-23T14:48:43.792850+0000","last_became_active":"2024-04-23T14:48:24.207905+0000","last_became_peered":"2024-04-23T14:48:24.207905+0000","last_unstale":"2024-04-23T14:48:43.792850+0000","last_undegraded":"2024-04-23T14:48:43.792850+0000","last_fullsized":"2024-04-23T14:48:43.792850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:52.803336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.013832+0000","last_change":"2024-04-23T14:48:44.013832+0000","last_active":"2024-04-23T14:48:44.013832+0000","last_peered":"2024-04-23T14:48:44.013832+0000","last_clean":"2024-04-23T14:48:44.013832+0000","last_became_active":"2024-04-23T14:48:44.012529+0000","last_became_peered":"2024-04-23T14:48:44.012529+0000","last_unstale":"2024-04-23T14:48:44.013832+0000","last_undegraded":"2024-04-23T14:48:44.013832+0000","last_fullsized":"2024-04-23T14:48:44.013832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:49:50.898163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.795944+0000","last_change":"2024-04-23T14:48:43.794890+0000","last_active":"2024-04-23T14:48:43.795944+0000","last_peered":"2024-04-23T14:48:43.795944+0000","last_clean":"2024-04-23T14:48:43.795944+0000","last_became_active":"2024-04-23T14:48:43.794157+0000","last_became_peered":"2024-04-23T14:48:43.794157+0000","last_unstale":"2024-04-23T14:48:43.795944+0000","last_undegraded":"2024-04-23T14:48:43.795944+0000","last_fullsized":"2024-04-23T14:48:43.795944+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:40.335060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009387+0000","last_change":"2024-04-23T14:48:24.213085+0000","last_active":"2024-04-23T14:48:44.009387+0000","last_peered":"2024-04-23T14:48:44.009387+0000","last_clean":"2024-04-23T14:48:44.009387+0000","last_became_active":"2024-04-23T14:48:24.212634+0000","last_became_peered":"2024-04-23T14:48:24.212634+0000","last_unstale":"2024-04-23T14:48:44.009387+0000","last_undegraded":"2024-04-23T14:48:44.009387+0000","last_fullsized":"2024-04-23T14:48:44.009387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:56:16.680842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723267+0000","last_change":"2024-04-23T14:48:28.691938+0000","last_active":"2024-04-23T14:48:43.723267+0000","last_peered":"2024-04-23T14:48:43.723267+0000","last_clean":"2024-04-23T14:48:43.723267+0000","last_became_active":"2024-04-23T14:48:28.691410+0000","last_became_peered":"2024-04-23T14:48:28.691410+0000","last_unstale":"2024-04-23T14:48:43.723267+0000","last_undegraded":"2024-04-23T14:48:43.723267+0000","last_fullsized":"2024-04-23T14:48:43.723267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:52.384117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.874927+0000","last_change":"2024-04-23T14:48:23.174726+0000","last_active":"2024-04-23T14:48:52.874927+0000","last_peered":"2024-04-23T14:48:52.874927+0000","last_clean":"2024-04-23T14:48:52.874927+0000","last_became_active":"2024-04-23T14:48:23.174163+0000","last_became_peered":"2024-04-23T14:48:23.174163+0000","last_unstale":"2024-04-23T14:48:52.874927+0000","last_undegraded":"2024-04-23T14:48:52.874927+0000","last_fullsized":"2024-04-23T14:48:52.874927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:17.294653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009296+0000","last_change":"2024-04-23T14:48:24.212406+0000","last_active":"2024-04-23T14:48:44.009296+0000","last_peered":"2024-04-23T14:48:44.009296+0000","last_clean":"2024-04-23T14:48:44.009296+0000","last_became_active":"2024-04-23T14:48:24.212025+0000","last_became_peered":"2024-04-23T14:48:24.212025+0000","last_unstale":"2024-04-23T14:48:44.009296+0000","last_undegraded":"2024-04-23T14:48:44.009296+0000","last_fullsized":"2024-04-23T14:48:44.009296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:09.890480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723005+0000","last_change":"2024-04-23T14:48:28.868780+0000","last_active":"2024-04-23T14:48:43.723005+0000","last_peered":"2024-04-23T14:48:43.723005+0000","last_clean":"2024-04-23T14:48:43.723005+0000","last_became_active":"2024-04-23T14:48:28.868214+0000","last_became_peered":"2024-04-23T14:48:28.868214+0000","last_unstale":"2024-04-23T14:48:43.723005+0000","last_undegraded":"2024-04-23T14:48:43.723005+0000","last_fullsized":"2024-04-23T14:48:43.723005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:16:19.606569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.730878+0000","last_change":"2024-04-23T14:48:24.189017+0000","last_active":"2024-04-23T14:48:43.730878+0000","last_peered":"2024-04-23T14:48:43.730878+0000","last_clean":"2024-04-23T14:48:43.730878+0000","last_became_active":"2024-04-23T14:48:24.187165+0000","last_became_peered":"2024-04-23T14:48:24.187165+0000","last_unstale":"2024-04-23T14:48:43.730878+0000","last_undegraded":"2024-04-23T14:48:43.730878+0000","last_fullsized":"2024-04-23T14:48:43.730878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:44.844255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:53.861771+0000","last_change":"2024-04-23T14:48:23.174186+0000","last_active":"2024-04-23T14:48:53.861771+0000","last_peered":"2024-04-23T14:48:53.861771+0000","last_clean":"2024-04-23T14:48:53.861771+0000","last_became_active":"2024-04-23T14:48:23.173365+0000","last_became_peered":"2024-04-23T14:48:23.173365+0000","last_unstale":"2024-04-23T14:48:53.861771+0000","last_undegraded":"2024-04-23T14:48:53.861771+0000","last_fullsized":"2024-04-23T14:48:53.861771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:04.193405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735045+0000","last_change":"2024-04-23T14:48:28.689151+0000","last_active":"2024-04-23T14:48:43.735045+0000","last_peered":"2024-04-23T14:48:43.735045+0000","last_clean":"2024-04-23T14:48:43.735045+0000","last_became_active":"2024-04-23T14:48:28.688396+0000","last_became_peered":"2024-04-23T14:48:28.688396+0000","last_unstale":"2024-04-23T14:48:43.735045+0000","last_undegraded":"2024-04-23T14:48:43.735045+0000","last_fullsized":"2024-04-23T14:48:43.735045+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:06.922068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008316+0000","last_change":"2024-04-23T14:48:24.214609+0000","last_active":"2024-04-23T14:48:44.008316+0000","last_peered":"2024-04-23T14:48:44.008316+0000","last_clean":"2024-04-23T14:48:44.008316+0000","last_became_active":"2024-04-23T14:48:24.211298+0000","last_became_peered":"2024-04-23T14:48:24.211298+0000","last_unstale":"2024-04-23T14:48:44.008316+0000","last_undegraded":"2024-04-23T14:48:44.008316+0000","last_fullsized":"2024-04-23T14:48:44.008316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:59.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.827070+0000","last_change":"2024-04-23T14:48:23.154856+0000","last_active":"2024-04-23T14:48:51.827070+0000","last_peered":"2024-04-23T14:48:51.827070+0000","last_clean":"2024-04-23T14:48:51.827070+0000","last_became_active":"2024-04-23T14:48:23.154225+0000","last_became_peered":"2024-04-23T14:48:23.154225+0000","last_unstale":"2024-04-23T14:48:51.827070+0000","last_undegraded":"2024-04-23T14:48:51.827070+0000","last_fullsized":"2024-04-23T14:48:51.827070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:48.059364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":359,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.733944+0000","last_change":"2024-04-23T14:46:43.008733+0000","last_active":"2024-04-23T14:48:43.733944+0000","last_peered":"2024-04-23T14:48:43.733944+0000","last_clean":"2024-04-23T14:48:43.733944+0000","last_became_active":"2024-04-23T14:46:43.008289+0000","last_became_peered":"2024-04-23T14:46:43.008289+0000","last_unstale":"2024-04-23T14:48:43.733944+0000","last_undegraded":"2024-04-23T14:48:43.733944+0000","last_fullsized":"2024-04-23T14:48:43.733944+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_clean_scrub_stamp":"2024-04-23T14:41:57.297296+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:40.997119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.732648+0000","last_change":"2024-04-23T14:48:28.870098+0000","last_active":"2024-04-23T14:48:43.732648+0000","last_peered":"2024-04-23T14:48:43.732648+0000","last_clean":"2024-04-23T14:48:43.732648+0000","last_became_active":"2024-04-23T14:48:28.868925+0000","last_became_peered":"2024-04-23T14:48:28.868925+0000","last_unstale":"2024-04-23T14:48:43.732648+0000","last_undegraded":"2024-04-23T14:48:43.732648+0000","last_fullsized":"2024-04-23T14:48:43.732648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:22.408757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722612+0000","last_change":"2024-04-23T14:48:24.189462+0000","last_active":"2024-04-23T14:48:43.722612+0000","last_peered":"2024-04-23T14:48:43.722612+0000","last_clean":"2024-04-23T14:48:43.722612+0000","last_became_active":"2024-04-23T14:48:24.188714+0000","last_became_peered":"2024-04-23T14:48:24.188714+0000","last_unstale":"2024-04-23T14:48:43.722612+0000","last_undegraded":"2024-04-23T14:48:43.722612+0000","last_fullsized":"2024-04-23T14:48:43.722612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:56.589476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:50.830840+0000","last_change":"2024-04-23T14:48:23.166096+0000","last_active":"2024-04-23T14:48:50.830840+0000","last_peered":"2024-04-23T14:48:50.830840+0000","last_clean":"2024-04-23T14:48:50.830840+0000","last_became_active":"2024-04-23T14:48:23.165514+0000","last_became_peered":"2024-04-23T14:48:23.165514+0000","last_unstale":"2024-04-23T14:48:50.830840+0000","last_undegraded":"2024-04-23T14:48:50.830840+0000","last_fullsized":"2024-04-23T14:48:50.830840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:27.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.791779+0000","last_change":"2024-04-23T14:48:28.690086+0000","last_active":"2024-04-23T14:48:43.791779+0000","last_peered":"2024-04-23T14:48:43.791779+0000","last_clean":"2024-04-23T14:48:43.791779+0000","last_became_active":"2024-04-23T14:48:28.689346+0000","last_became_peered":"2024-04-23T14:48:28.689346+0000","last_unstale":"2024-04-23T14:48:43.791779+0000","last_undegraded":"2024-04-23T14:48:43.791779+0000","last_fullsized":"2024-04-23T14:48:43.791779+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:02.594389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.836109+0000","last_change":"2024-04-23T14:48:23.170977+0000","last_active":"2024-04-23T14:48:51.836109+0000","last_peered":"2024-04-23T14:48:51.836109+0000","last_clean":"2024-04-23T14:48:51.836109+0000","last_became_active":"2024-04-23T14:48:23.170640+0000","last_became_peered":"2024-04-23T14:48:23.170640+0000","last_unstale":"2024-04-23T14:48:51.836109+0000","last_undegraded":"2024-04-23T14:48:51.836109+0000","last_fullsized":"2024-04-23T14:48:51.836109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:28:18.488187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723975+0000","last_change":"2024-04-23T14:48:24.190631+0000","last_active":"2024-04-23T14:48:43.723975+0000","last_peered":"2024-04-23T14:48:43.723975+0000","last_clean":"2024-04-23T14:48:43.723975+0000","last_became_active":"2024-04-23T14:48:24.190245+0000","last_became_peered":"2024-04-23T14:48:24.190245+0000","last_unstale":"2024-04-23T14:48:43.723975+0000","last_undegraded":"2024-04-23T14:48:43.723975+0000","last_fullsized":"2024-04-23T14:48:43.723975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:09.641687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008243+0000","last_change":"2024-04-23T14:48:28.867735+0000","last_active":"2024-04-23T14:48:44.008243+0000","last_peered":"2024-04-23T14:48:44.008243+0000","last_clean":"2024-04-23T14:48:44.008243+0000","last_became_active":"2024-04-23T14:48:28.867165+0000","last_became_peered":"2024-04-23T14:48:28.867165+0000","last_unstale":"2024-04-23T14:48:44.008243+0000","last_undegraded":"2024-04-23T14:48:44.008243+0000","last_fullsized":"2024-04-23T14:48:44.008243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:46.973396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:54.299788+0000","last_change":"2024-04-23T14:48:23.159980+0000","last_active":"2024-04-23T14:48:54.299788+0000","last_peered":"2024-04-23T14:48:54.299788+0000","last_clean":"2024-04-23T14:48:54.299788+0000","last_became_active":"2024-04-23T14:48:23.158407+0000","last_became_peered":"2024-04-23T14:48:23.158407+0000","last_unstale":"2024-04-23T14:48:54.299788+0000","last_undegraded":"2024-04-23T14:48:54.299788+0000","last_fullsized":"2024-04-23T14:48:54.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:06:07.110430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009659+0000","last_change":"2024-04-23T14:48:24.215285+0000","last_active":"2024-04-23T14:48:44.009659+0000","last_peered":"2024-04-23T14:48:44.009659+0000","last_clean":"2024-04-23T14:48:44.009659+0000","last_became_active":"2024-04-23T14:48:24.209934+0000","last_became_peered":"2024-04-23T14:48:24.209934+0000","last_unstale":"2024-04-23T14:48:44.009659+0000","last_undegraded":"2024-04-23T14:48:44.009659+0000","last_fullsized":"2024-04-23T14:48:44.009659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:00.673701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722151+0000","last_change":"2024-04-23T14:48:28.689933+0000","last_active":"2024-04-23T14:48:43.722151+0000","last_peered":"2024-04-23T14:48:43.722151+0000","last_clean":"2024-04-23T14:48:43.722151+0000","last_became_active":"2024-04-23T14:48:28.687999+0000","last_became_peered":"2024-04-23T14:48:28.687999+0000","last_unstale":"2024-04-23T14:48:43.722151+0000","last_undegraded":"2024-04-23T14:48:43.722151+0000","last_fullsized":"2024-04-23T14:48:43.722151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:10.605796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.796376+0000","last_change":"2024-04-23T14:48:23.167935+0000","last_active":"2024-04-23T14:48:49.796376+0000","last_peered":"2024-04-23T14:48:49.796376+0000","last_clean":"2024-04-23T14:48:49.796376+0000","last_became_active":"2024-04-23T14:48:23.167597+0000","last_became_peered":"2024-04-23T14:48:23.167597+0000","last_unstale":"2024-04-23T14:48:49.796376+0000","last_undegraded":"2024-04-23T14:48:49.796376+0000","last_fullsized":"2024-04-23T14:48:49.796376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:14:25.667816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.012004+0000","last_change":"2024-04-23T14:48:44.012004+0000","last_active":"2024-04-23T14:48:44.012004+0000","last_peered":"2024-04-23T14:48:44.012004+0000","last_clean":"2024-04-23T14:48:44.012004+0000","last_became_active":"2024-04-23T14:48:44.010779+0000","last_became_peered":"2024-04-23T14:48:44.010779+0000","last_unstale":"2024-04-23T14:48:44.012004+0000","last_undegraded":"2024-04-23T14:48:44.012004+0000","last_fullsized":"2024-04-23T14:48:44.012004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:09.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.013213+0000","last_change":"2024-04-23T14:48:44.013213+0000","last_active":"2024-04-23T14:48:44.013213+0000","last_peered":"2024-04-23T14:48:44.013213+0000","last_clean":"2024-04-23T14:48:44.013213+0000","last_became_active":"2024-04-23T14:48:44.012710+0000","last_became_peered":"2024-04-23T14:48:44.012710+0000","last_unstale":"2024-04-23T14:48:44.013213+0000","last_undegraded":"2024-04-23T14:48:44.013213+0000","last_fullsized":"2024-04-23T14:48:44.013213+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.805453+0000","last_change":"2024-04-23T14:48:23.157529+0000","last_active":"2024-04-23T14:48:49.805453+0000","last_peered":"2024-04-23T14:48:49.805453+0000","last_clean":"2024-04-23T14:48:49.805453+0000","last_became_active":"2024-04-23T14:48:23.156780+0000","last_became_peered":"2024-04-23T14:48:23.156780+0000","last_unstale":"2024-04-23T14:48:49.805453+0000","last_undegraded":"2024-04-23T14:48:49.805453+0000","last_fullsized":"2024-04-23T14:48:49.805453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:32.747563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724403+0000","last_change":"2024-04-23T14:48:24.196328+0000","last_active":"2024-04-23T14:48:43.724403+0000","last_peered":"2024-04-23T14:48:43.724403+0000","last_clean":"2024-04-23T14:48:43.724403+0000","last_became_active":"2024-04-23T14:48:24.195875+0000","last_became_peered":"2024-04-23T14:48:24.195875+0000","last_unstale":"2024-04-23T14:48:43.724403+0000","last_undegraded":"2024-04-23T14:48:43.724403+0000","last_fullsized":"2024-04-23T14:48:43.724403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:34:03.377786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.720297+0000","last_change":"2024-04-23T14:48:28.692397+0000","last_active":"2024-04-23T14:48:43.720297+0000","last_peered":"2024-04-23T14:48:43.720297+0000","last_clean":"2024-04-23T14:48:43.720297+0000","last_became_active":"2024-04-23T14:48:28.691916+0000","last_became_peered":"2024-04-23T14:48:28.691916+0000","last_unstale":"2024-04-23T14:48:43.720297+0000","last_undegraded":"2024-04-23T14:48:43.720297+0000","last_fullsized":"2024-04-23T14:48:43.720297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:59.357790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.802066+0000","last_change":"2024-04-23T14:48:23.165072+0000","last_active":"2024-04-23T14:48:49.802066+0000","last_peered":"2024-04-23T14:48:49.802066+0000","last_clean":"2024-04-23T14:48:49.802066+0000","last_became_active":"2024-04-23T14:48:23.164732+0000","last_became_peered":"2024-04-23T14:48:23.164732+0000","last_unstale":"2024-04-23T14:48:49.802066+0000","last_undegraded":"2024-04-23T14:48:49.802066+0000","last_fullsized":"2024-04-23T14:48:49.802066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:04.921227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.791337+0000","last_change":"2024-04-23T14:48:24.203322+0000","last_active":"2024-04-23T14:48:43.791337+0000","last_peered":"2024-04-23T14:48:43.791337+0000","last_clean":"2024-04-23T14:48:43.791337+0000","last_became_active":"2024-04-23T14:48:24.202889+0000","last_became_peered":"2024-04-23T14:48:24.202889+0000","last_unstale":"2024-04-23T14:48:43.791337+0000","last_undegraded":"2024-04-23T14:48:43.791337+0000","last_fullsized":"2024-04-23T14:48:43.791337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:18:19.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.726721+0000","last_change":"2024-04-23T14:48:28.686064+0000","last_active":"2024-04-23T14:48:43.726721+0000","last_peered":"2024-04-23T14:48:43.726721+0000","last_clean":"2024-04-23T14:48:43.726721+0000","last_became_active":"2024-04-23T14:48:28.685389+0000","last_became_peered":"2024-04-23T14:48:28.685389+0000","last_unstale":"2024-04-23T14:48:43.726721+0000","last_undegraded":"2024-04-23T14:48:43.726721+0000","last_fullsized":"2024-04-23T14:48:43.726721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:06:35.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.791152+0000","last_change":"2024-04-23T14:48:23.164926+0000","last_active":"2024-04-23T14:48:51.791152+0000","last_peered":"2024-04-23T14:48:51.791152+0000","last_clean":"2024-04-23T14:48:51.791152+0000","last_became_active":"2024-04-23T14:48:23.164550+0000","last_became_peered":"2024-04-23T14:48:23.164550+0000","last_unstale":"2024-04-23T14:48:51.791152+0000","last_undegraded":"2024-04-23T14:48:51.791152+0000","last_fullsized":"2024-04-23T14:48:51.791152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:53:33.512403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008834+0000","last_change":"2024-04-23T14:48:24.208535+0000","last_active":"2024-04-23T14:48:44.008834+0000","last_peered":"2024-04-23T14:48:44.008834+0000","last_clean":"2024-04-23T14:48:44.008834+0000","last_became_active":"2024-04-23T14:48:24.208183+0000","last_became_peered":"2024-04-23T14:48:24.208183+0000","last_unstale":"2024-04-23T14:48:44.008834+0000","last_undegraded":"2024-04-23T14:48:44.008834+0000","last_fullsized":"2024-04-23T14:48:44.008834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:33:37.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.727526+0000","last_change":"2024-04-23T14:48:28.870055+0000","last_active":"2024-04-23T14:48:43.727526+0000","last_peered":"2024-04-23T14:48:43.727526+0000","last_clean":"2024-04-23T14:48:43.727526+0000","last_became_active":"2024-04-23T14:48:28.868671+0000","last_became_peered":"2024-04-23T14:48:28.868671+0000","last_unstale":"2024-04-23T14:48:43.727526+0000","last_undegraded":"2024-04-23T14:48:43.727526+0000","last_fullsized":"2024-04-23T14:48:43.727526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:26:23.756484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:49.806878+0000","last_change":"2024-04-23T14:48:23.171324+0000","last_active":"2024-04-23T14:48:49.806878+0000","last_peered":"2024-04-23T14:48:49.806878+0000","last_clean":"2024-04-23T14:48:49.806878+0000","last_became_active":"2024-04-23T14:48:23.170523+0000","last_became_peered":"2024-04-23T14:48:23.170523+0000","last_unstale":"2024-04-23T14:48:49.806878+0000","last_undegraded":"2024-04-23T14:48:49.806878+0000","last_fullsized":"2024-04-23T14:48:49.806878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:06.578119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.734732+0000","last_change":"2024-04-23T14:48:24.199577+0000","last_active":"2024-04-23T14:48:43.734732+0000","last_peered":"2024-04-23T14:48:43.734732+0000","last_clean":"2024-04-23T14:48:43.734732+0000","last_became_active":"2024-04-23T14:48:24.199174+0000","last_became_peered":"2024-04-23T14:48:24.199174+0000","last_unstale":"2024-04-23T14:48:43.734732+0000","last_undegraded":"2024-04-23T14:48:43.734732+0000","last_fullsized":"2024-04-23T14:48:43.734732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:00.078179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729368+0000","last_change":"2024-04-23T14:48:28.693416+0000","last_active":"2024-04-23T14:48:43.729368+0000","last_peered":"2024-04-23T14:48:43.729368+0000","last_clean":"2024-04-23T14:48:43.729368+0000","last_became_active":"2024-04-23T14:48:28.691823+0000","last_became_peered":"2024-04-23T14:48:28.691823+0000","last_unstale":"2024-04-23T14:48:43.729368+0000","last_undegraded":"2024-04-23T14:48:43.729368+0000","last_fullsized":"2024-04-23T14:48:43.729368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:11:41.027479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:51.834808+0000","last_change":"2024-04-23T14:48:23.160695+0000","last_active":"2024-04-23T14:48:51.834808+0000","last_peered":"2024-04-23T14:48:51.834808+0000","last_clean":"2024-04-23T14:48:51.834808+0000","last_became_active":"2024-04-23T14:48:23.160255+0000","last_became_peered":"2024-04-23T14:48:23.160255+0000","last_unstale":"2024-04-23T14:48:51.834808+0000","last_undegraded":"2024-04-23T14:48:51.834808+0000","last_fullsized":"2024-04-23T14:48:51.834808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:10.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735323+0000","last_change":"2024-04-23T14:48:24.204085+0000","last_active":"2024-04-23T14:48:43.735323+0000","last_peered":"2024-04-23T14:48:43.735323+0000","last_clean":"2024-04-23T14:48:43.735323+0000","last_became_active":"2024-04-23T14:48:24.203100+0000","last_became_peered":"2024-04-23T14:48:24.203100+0000","last_unstale":"2024-04-23T14:48:43.735323+0000","last_undegraded":"2024-04-23T14:48:43.735323+0000","last_fullsized":"2024-04-23T14:48:43.735323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:06:42.999237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.723821+0000","last_change":"2024-04-23T14:48:28.687315+0000","last_active":"2024-04-23T14:48:43.723821+0000","last_peered":"2024-04-23T14:48:43.723821+0000","last_clean":"2024-04-23T14:48:43.723821+0000","last_became_active":"2024-04-23T14:48:28.686867+0000","last_became_peered":"2024-04-23T14:48:28.686867+0000","last_unstale":"2024-04-23T14:48:43.723821+0000","last_undegraded":"2024-04-23T14:48:43.723821+0000","last_fullsized":"2024-04-23T14:48:43.723821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:49.455073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.869061+0000","last_change":"2024-04-23T14:48:23.154736+0000","last_active":"2024-04-23T14:48:52.869061+0000","last_peered":"2024-04-23T14:48:52.869061+0000","last_clean":"2024-04-23T14:48:52.869061+0000","last_became_active":"2024-04-23T14:48:23.154388+0000","last_became_peered":"2024-04-23T14:48:23.154388+0000","last_unstale":"2024-04-23T14:48:52.869061+0000","last_undegraded":"2024-04-23T14:48:52.869061+0000","last_fullsized":"2024-04-23T14:48:52.869061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:16.856764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.737734+0000","last_change":"2024-04-23T14:48:43.737734+0000","last_active":"2024-04-23T14:48:43.737734+0000","last_peered":"2024-04-23T14:48:43.737734+0000","last_clean":"2024-04-23T14:48:43.737734+0000","last_became_active":"2024-04-23T14:48:43.736678+0000","last_became_peered":"2024-04-23T14:48:43.736678+0000","last_unstale":"2024-04-23T14:48:43.737734+0000","last_undegraded":"2024-04-23T14:48:43.737734+0000","last_fullsized":"2024-04-23T14:48:43.737734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:57.583820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.730182+0000","last_change":"2024-04-23T14:48:28.695478+0000","last_active":"2024-04-23T14:48:43.730182+0000","last_peered":"2024-04-23T14:48:43.730182+0000","last_clean":"2024-04-23T14:48:43.730182+0000","last_became_active":"2024-04-23T14:48:28.694836+0000","last_became_peered":"2024-04-23T14:48:28.694836+0000","last_unstale":"2024-04-23T14:48:43.730182+0000","last_undegraded":"2024-04-23T14:48:43.730182+0000","last_fullsized":"2024-04-23T14:48:43.730182+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:11:16.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:52.873833+0000","last_change":"2024-04-23T14:48:23.164866+0000","last_active":"2024-04-23T14:48:52.873833+0000","last_peered":"2024-04-23T14:48:52.873833+0000","last_clean":"2024-04-23T14:48:52.873833+0000","last_became_active":"2024-04-23T14:48:23.164570+0000","last_became_peered":"2024-04-23T14:48:23.164570+0000","last_unstale":"2024-04-23T14:48:52.873833+0000","last_undegraded":"2024-04-23T14:48:52.873833+0000","last_fullsized":"2024-04-23T14:48:52.873833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:48.247715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.735480+0000","last_change":"2024-04-23T14:48:24.202600+0000","last_active":"2024-04-23T14:48:43.735480+0000","last_peered":"2024-04-23T14:48:43.735480+0000","last_clean":"2024-04-23T14:48:43.735480+0000","last_became_active":"2024-04-23T14:48:24.202243+0000","last_became_peered":"2024-04-23T14:48:24.202243+0000","last_unstale":"2024-04-23T14:48:43.735480+0000","last_undegraded":"2024-04-23T14:48:43.735480+0000","last_fullsized":"2024-04-23T14:48:43.735480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:19.162967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.791448+0000","last_change":"2024-04-23T14:48:24.206142+0000","last_active":"2024-04-23T14:48:43.791448+0000","last_peered":"2024-04-23T14:48:43.791448+0000","last_clean":"2024-04-23T14:48:43.791448+0000","last_became_active":"2024-04-23T14:48:24.203397+0000","last_became_peered":"2024-04-23T14:48:24.203397+0000","last_unstale":"2024-04-23T14:48:43.791448+0000","last_undegraded":"2024-04-23T14:48:43.791448+0000","last_fullsized":"2024-04-23T14:48:43.791448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:35:56.363914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722531+0000","last_change":"2024-04-23T14:48:24.197058+0000","last_active":"2024-04-23T14:48:43.722531+0000","last_peered":"2024-04-23T14:48:43.722531+0000","last_clean":"2024-04-23T14:48:43.722531+0000","last_became_active":"2024-04-23T14:48:24.196662+0000","last_became_peered":"2024-04-23T14:48:24.196662+0000","last_unstale":"2024-04-23T14:48:43.722531+0000","last_undegraded":"2024-04-23T14:48:43.722531+0000","last_fullsized":"2024-04-23T14:48:43.722531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.884032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.722596+0000","last_change":"2024-04-23T14:48:24.213823+0000","last_active":"2024-04-23T14:48:43.722596+0000","last_peered":"2024-04-23T14:48:43.722596+0000","last_clean":"2024-04-23T14:48:43.722596+0000","last_became_active":"2024-04-23T14:48:24.213480+0000","last_became_peered":"2024-04-23T14:48:24.213480+0000","last_unstale":"2024-04-23T14:48:43.722596+0000","last_undegraded":"2024-04-23T14:48:43.722596+0000","last_fullsized":"2024-04-23T14:48:43.722596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:03.046216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724133+0000","last_change":"2024-04-23T14:48:24.199440+0000","last_active":"2024-04-23T14:48:43.724133+0000","last_peered":"2024-04-23T14:48:43.724133+0000","last_clean":"2024-04-23T14:48:43.724133+0000","last_became_active":"2024-04-23T14:48:24.199119+0000","last_became_peered":"2024-04-23T14:48:24.199119+0000","last_unstale":"2024-04-23T14:48:43.724133+0000","last_undegraded":"2024-04-23T14:48:43.724133+0000","last_fullsized":"2024-04-23T14:48:43.724133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:34.638393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729061+0000","last_change":"2024-04-23T14:48:43.729061+0000","last_active":"2024-04-23T14:48:43.729061+0000","last_peered":"2024-04-23T14:48:43.729061+0000","last_clean":"2024-04-23T14:48:43.729061+0000","last_became_active":"2024-04-23T14:48:43.728485+0000","last_became_peered":"2024-04-23T14:48:43.728485+0000","last_unstale":"2024-04-23T14:48:43.729061+0000","last_undegraded":"2024-04-23T14:48:43.729061+0000","last_fullsized":"2024-04-23T14:48:43.729061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:44:02.348446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792825+0000","last_change":"2024-04-23T14:48:24.204207+0000","last_active":"2024-04-23T14:48:43.792825+0000","last_peered":"2024-04-23T14:48:43.792825+0000","last_clean":"2024-04-23T14:48:43.792825+0000","last_became_active":"2024-04-23T14:48:24.203325+0000","last_became_peered":"2024-04-23T14:48:24.203325+0000","last_unstale":"2024-04-23T14:48:43.792825+0000","last_undegraded":"2024-04-23T14:48:43.792825+0000","last_fullsized":"2024-04-23T14:48:43.792825+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:00.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.725059+0000","last_change":"2024-04-23T14:48:24.191811+0000","last_active":"2024-04-23T14:48:43.725059+0000","last_peered":"2024-04-23T14:48:43.725059+0000","last_clean":"2024-04-23T14:48:43.725059+0000","last_became_active":"2024-04-23T14:48:24.191458+0000","last_became_peered":"2024-04-23T14:48:24.191458+0000","last_unstale":"2024-04-23T14:48:43.725059+0000","last_undegraded":"2024-04-23T14:48:43.725059+0000","last_fullsized":"2024-04-23T14:48:43.725059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:11.676842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.009843+0000","last_change":"2024-04-23T14:48:24.214997+0000","last_active":"2024-04-23T14:48:44.009843+0000","last_peered":"2024-04-23T14:48:44.009843+0000","last_clean":"2024-04-23T14:48:44.009843+0000","last_became_active":"2024-04-23T14:48:24.211941+0000","last_became_peered":"2024-04-23T14:48:24.211941+0000","last_unstale":"2024-04-23T14:48:44.009843+0000","last_undegraded":"2024-04-23T14:48:44.009843+0000","last_fullsized":"2024-04-23T14:48:44.009843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:29.903690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.730765+0000","last_change":"2024-04-23T14:48:24.202327+0000","last_active":"2024-04-23T14:48:43.730765+0000","last_peered":"2024-04-23T14:48:43.730765+0000","last_clean":"2024-04-23T14:48:43.730765+0000","last_became_active":"2024-04-23T14:48:24.201986+0000","last_became_peered":"2024-04-23T14:48:24.201986+0000","last_unstale":"2024-04-23T14:48:43.730765+0000","last_undegraded":"2024-04-23T14:48:43.730765+0000","last_fullsized":"2024-04-23T14:48:43.730765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:48.633762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:44.008339+0000","last_change":"2024-04-23T14:48:24.202931+0000","last_active":"2024-04-23T14:48:44.008339+0000","last_peered":"2024-04-23T14:48:44.008339+0000","last_clean":"2024-04-23T14:48:44.008339+0000","last_became_active":"2024-04-23T14:48:24.201767+0000","last_became_peered":"2024-04-23T14:48:24.201767+0000","last_unstale":"2024-04-23T14:48:44.008339+0000","last_undegraded":"2024-04-23T14:48:44.008339+0000","last_fullsized":"2024-04-23T14:48:44.008339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:39.542403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.729951+0000","last_change":"2024-04-23T14:48:24.216891+0000","last_active":"2024-04-23T14:48:43.729951+0000","last_peered":"2024-04-23T14:48:43.729951+0000","last_clean":"2024-04-23T14:48:43.729951+0000","last_became_active":"2024-04-23T14:48:24.216419+0000","last_became_peered":"2024-04-23T14:48:24.216419+0000","last_unstale":"2024-04-23T14:48:43.729951+0000","last_undegraded":"2024-04-23T14:48:43.729951+0000","last_fullsized":"2024-04-23T14:48:43.729951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:42.302965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.724909+0000","last_change":"2024-04-23T14:48:24.206828+0000","last_active":"2024-04-23T14:48:43.724909+0000","last_peered":"2024-04-23T14:48:43.724909+0000","last_clean":"2024-04-23T14:48:43.724909+0000","last_became_active":"2024-04-23T14:48:24.203562+0000","last_became_peered":"2024-04-23T14:48:24.203562+0000","last_unstale":"2024-04-23T14:48:43.724909+0000","last_undegraded":"2024-04-23T14:48:43.724909+0000","last_fullsized":"2024-04-23T14:48:43.724909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:59.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-23T14:48:43.792556+0000","last_change":"2024-04-23T14:48:24.208440+0000","last_active":"2024-04-23T14:48:43.792556+0000","last_peered":"2024-04-23T14:48:43.792556+0000","last_clean":"2024-04-23T14:48:43.792556+0000","last_became_active":"2024-04-23T14:48:24.208052+0000","last_became_peered":"2024-04-23T14:48:24.208052+0000","last_unstale":"2024-04-23T14:48:43.792556+0000","last_undegraded":"2024-04-23T14:48:43.792556+0000","last_fullsized":"2024-04-23T14:48:43.792556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:19.906675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48685,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":25,"num_read_kb":60,"num_write":212,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":76449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383702,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":501433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645340,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1708032,"data_stored":1130155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1060864,"data_stored":505459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":496883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1642496,"data_stored":1090046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":496867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":500960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1056768,"data_stored":498323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":501337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1032192,"data_stored":496429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":496789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1093820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":43642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T14:48:56.967 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-23T14:48:56.968 INFO:tasks.cephadm:Setting up client nodes... 2024-04-23T14:48:56.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-23T14:48:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:56 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/238704812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:56 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/238704812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:56 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/238704812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:48:57.464 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:48:58.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:57 smithi007 ceph-mon[27906]: pgmap v388: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-04-23T14:48:58.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:57 smithi007 ceph-mon[27906]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:48:58.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:57 smithi007 ceph-mon[27906]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:48:58.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:57 smithi137 ceph-mon[31694]: pgmap v388: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-04-23T14:48:58.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:57 smithi137 ceph-mon[31694]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:48:58.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:57 smithi137 ceph-mon[31694]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:48:58.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:57 smithi186 ceph-mon[31814]: pgmap v388: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-04-23T14:48:58.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:57 smithi186 ceph-mon[31814]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:48:58.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:57 smithi186 ceph-mon[31814]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:48:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 -- 172.21.15.7:0/1064173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4103600 msgr2=0x7f63d41059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 --2- 172.21.15.7:0/1064173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4103600 0x7f63d41059f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009990 tx=0x7f63c8009ca0 comp rx=0 tx=0).stop 2024-04-23T14:48:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 -- 172.21.15.7:0/1064173550 shutdown_connections 2024-04-23T14:48:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 --2- 172.21.15.7:0/1064173550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63d4108860 0x7f63d410acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 --2- 172.21.15.7:0/1064173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4103600 0x7f63d41059f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 --2- 172.21.15.7:0/1064173550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63d4105f30 0x7f63d4108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 -- 172.21.15.7:0/1064173550 >> 172.21.15.7:0/1064173550 conn(0x7f63d40fd010 msgr2=0x7f63d40ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 -- 172.21.15.7:0/1064173550 shutdown_connections 2024-04-23T14:48:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.829+0000 7f63db600700 1 -- 172.21.15.7:0/1064173550 wait complete. 2024-04-23T14:48:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.830+0000 7f63db600700 1 Processor -- start 2024-04-23T14:48:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 -- start start 2024-04-23T14:48:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63d4103600 0x7f63d419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 0x7f63d419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63d4108860 0x7f63d41a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410e620 con 0x7f63d4105f30 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410e4a0 con 0x7f63d4103600 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63db600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410e7a0 con 0x7f63d4108860 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.831+0000 7f63d3e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 0x7f63d419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 0x7f63d419b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46360/0 (socket says 172.21.15.7:46360) 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 -- 172.21.15.7:0/1209310496 learned_addr learned my addr 172.21.15.7:0/1209310496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d8c00700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63d4103600 0x7f63d419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d9600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63d4108860 0x7f63d41a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 -- 172.21.15.7:0/1209310496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63d4108860 msgr2=0x7f63d41a2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63d4108860 0x7f63d41a2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 -- 172.21.15.7:0/1209310496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63d4103600 msgr2=0x7f63d419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63d4103600 0x7f63d419adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 -- 172.21.15.7:0/1209310496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d41a2a20 con 0x7f63d4105f30 2024-04-23T14:48:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.832+0000 7f63d3e00700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 0x7f63d419b300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63c000d980 tx=0x7f63c000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.833+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c0016070 con 0x7f63d4105f30 2024-04-23T14:48:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.833+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63c0010460 con 0x7f63d4105f30 2024-04-23T14:48:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.833+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d41a2d10 con 0x7f63d4105f30 2024-04-23T14:48:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.833+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c000f620 con 0x7f63d4105f30 2024-04-23T14:48:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.833+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d41a3240 con 0x7f63d4105f30 2024-04-23T14:48:59.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.834+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d4051030 con 0x7f63d4105f30 2024-04-23T14:48:59.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.836+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f63c0019070 con 0x7f63d4105f30 2024-04-23T14:48:59.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.837+0000 7f63d1600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63bc0a3e00 0x7f63bc0a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:59.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.838+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f63c00d0490 con 0x7f63d4105f30 2024-04-23T14:48:59.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.838+0000 7f63d8c00700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63bc0a3e00 0x7f63bc0a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:59.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.839+0000 7f63d8c00700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63bc0a3e00 0x7f63bc0a62c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b5c0 tx=0x7f63c8003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:59.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:48:59.842+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f63c009c950 con 0x7f63d4105f30 2024-04-23T14:49:00.166 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:48:59 smithi186 ceph-mon[31814]: pgmap v389: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.1 KiB/s wr, 19 op/s 2024-04-23T14:49:00.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:48:59 smithi137 ceph-mon[31694]: pgmap v389: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.1 KiB/s wr, 19 op/s 2024-04-23T14:49:00.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.180+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f63d402e0b0 con 0x7f63d4105f30 2024-04-23T14:49:00.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:48:59 smithi007 ceph-mon[27906]: pgmap v389: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.1 KiB/s wr, 19 op/s 2024-04-23T14:49:00.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.186+0000 7f63d1600700 1 -- 172.21.15.7:0/1209310496 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) ==== 170+0+59 (secure 0 0 0) 0x7f63c009c250 con 0x7f63d4105f30 2024-04-23T14:49:00.187 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-23T14:49:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBcyidmQOPWChAAGbVNfy/u6+PSZN6PzyT05Q== 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63bc0a3e00 msgr2=0x7f63bc0a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63bc0a3e00 0x7f63bc0a62c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b5c0 tx=0x7f63c8003680 comp rx=0 tx=0).stop 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 msgr2=0x7f63d419b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 0x7f63d419b300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63c000d980 tx=0x7f63c000dd40 comp rx=0 tx=0).stop 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 shutdown_connections 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63bc0a3e00 0x7f63bc0a62c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63d4108860 0x7f63d41a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63d4103600 0x7f63d419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 --2- 172.21.15.7:0/1209310496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63d4105f30 0x7f63d419b300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:00.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 >> 172.21.15.7:0/1209310496 conn(0x7f63d40fd010 msgr2=0x7f63d4102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:00.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 shutdown_connections 2024-04-23T14:49:00.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:00.189+0000 7f63db600700 1 -- 172.21.15.7:0/1209310496 wait complete. 2024-04-23T14:49:01.109 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:49:01.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-23T14:49:01.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T14:49:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:00 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1209310496' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:49:01.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:00 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1209310496' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:49:01.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:00 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1209310496' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:49:01.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:00 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1209310496' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:49:01.259 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T14:49:01.260 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-23T14:49:01.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-23T14:49:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:00 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1209310496' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:49:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:00 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1209310496' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:49:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:02.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:01 smithi137 ceph-mon[31694]: pgmap v390: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 KiB/s wr, 20 op/s 2024-04-23T14:49:02.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:01 smithi007 ceph-mon[27906]: pgmap v390: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 KiB/s wr, 20 op/s 2024-04-23T14:49:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:01 smithi186 ceph-mon[31814]: pgmap v390: 129 pgs: 129 active+clean; 624 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 KiB/s wr, 20 op/s 2024-04-23T14:49:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 -- 172.21.15.7:0/163804052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe868074d20 msgr2=0x7fe868075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 --2- 172.21.15.7:0/163804052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe868074d20 0x7fe868075100 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe858009990 tx=0x7fe858009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 -- 172.21.15.7:0/163804052 shutdown_connections 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 --2- 172.21.15.7:0/163804052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe86810f550 0x7fe868111940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 --2- 172.21.15.7:0/163804052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe868074d20 0x7fe868075100 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 --2- 172.21.15.7:0/163804052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868075640 0x7fe86810f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 -- 172.21.15.7:0/163804052 >> 172.21.15.7:0/163804052 conn(0x7fe868079c50 msgr2=0x7fe86807a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 -- 172.21.15.7:0/163804052 shutdown_connections 2024-04-23T14:49:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.015+0000 7fe86ee00700 1 -- 172.21.15.7:0/163804052 wait complete. 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.016+0000 7fe86ee00700 1 Processor -- start 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 -- start start 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868074d20 0x7fe86819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe868075640 0x7fe86819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 0x7fe86819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe868114f60 con 0x7fe86810f550 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe868114de0 con 0x7fe868075640 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.017+0000 7fe86ee00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8681150e0 con 0x7fe868074d20 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 0x7fe86819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 0x7fe86819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42426/0 (socket says 172.21.15.7:42426) 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 -- 172.21.15.7:0/1027463629 learned_addr learned my addr 172.21.15.7:0/1027463629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe867e00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868074d20 0x7fe86819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe867400700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe868075640 0x7fe86819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 -- 172.21.15.7:0/1027463629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868074d20 msgr2=0x7fe86819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868074d20 0x7fe86819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 -- 172.21.15.7:0/1027463629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe868075640 msgr2=0x7fe86819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe868075640 0x7fe86819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe86ce00700 1 -- 172.21.15.7:0/1027463629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8681a0380 con 0x7fe86810f550 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe867400700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe868075640 0x7fe86819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.018+0000 7fe867e00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868074d20 0x7fe86819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.019+0000 7fe86ce00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 0x7fe86819fc40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe860007ee0 tx=0x7fe86000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.019+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86000ddd0 con 0x7fe86810f550 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.019+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe860004bb0 con 0x7fe86810f550 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.019+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8681a0670 con 0x7fe86810f550 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.019+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860015400 con 0x7fe86810f550 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.019+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8681a7ef0 con 0x7fe86810f550 2024-04-23T14:49:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.020+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8680697e0 con 0x7fe86810f550 2024-04-23T14:49:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.022+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fe860004d60 con 0x7fe86810f550 2024-04-23T14:49:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.024+0000 7fe864c00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe84c0a3cd0 0x7fe84c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.024+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fe8600d0360 con 0x7fe86810f550 2024-04-23T14:49:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.024+0000 7fe867e00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe84c0a3cd0 0x7fe84c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.025+0000 7fe867e00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe84c0a3cd0 0x7fe84c0a6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe858006010 tx=0x7fe85801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:04.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.029+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe860010070 con 0x7fe86810f550 2024-04-23T14:49:04.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:03 smithi137 ceph-mon[31694]: pgmap v391: 129 pgs: 129 active+clean; 629 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.7 KiB/s wr, 23 op/s 2024-04-23T14:49:04.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.326+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe8681a8120 con 0x7fe86810f550 2024-04-23T14:49:04.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:03 smithi007 ceph-mon[27906]: pgmap v391: 129 pgs: 129 active+clean; 629 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.7 KiB/s wr, 23 op/s 2024-04-23T14:49:04.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.336+0000 7fe864c00700 1 -- 172.21.15.7:0/1027463629 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264987 (secure 0 0 0) 0x7fe86009c820 con 0x7fe86810f550 2024-04-23T14:49:04.339 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:49:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe84c0a3cd0 msgr2=0x7fe84c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe84c0a3cd0 0x7fe84c0a6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe858006010 tx=0x7fe85801a040 comp rx=0 tx=0).stop 2024-04-23T14:49:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 msgr2=0x7fe86819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 0x7fe86819fc40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe860007ee0 tx=0x7fe86000d3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 shutdown_connections 2024-04-23T14:49:04.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe84c0a3cd0 0x7fe84c0a6190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe86810f550 0x7fe86819fc40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe868074d20 0x7fe86819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 --2- 172.21.15.7:0/1027463629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe868075640 0x7fe86819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 >> 172.21.15.7:0/1027463629 conn(0x7fe868079c50 msgr2=0x7fe8680ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.344+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 shutdown_connections 2024-04-23T14:49:04.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:04.345+0000 7fe86ee00700 1 -- 172.21.15.7:0/1027463629 wait complete. 2024-04-23T14:49:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:03 smithi186 ceph-mon[31814]: pgmap v391: 129 pgs: 129 active+clean; 629 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.7 KiB/s wr, 23 op/s 2024-04-23T14:49:05.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:04 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1027463629' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T14:49:05.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:04 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1027463629' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T14:49:05.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:04 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1027463629' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T14:49:05.381 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3440122157},{"type":"v1","addr":"172.21.15.7:6801","nonce":3440122157}]},"active_addr":"172.21.15.7:6801/3440122157","active_change":"2024-04-23T14:38:42.138932+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3573875988}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3733281875}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":53488990}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3240450123}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1354231444}]}]} 2024-04-23T14:49:05.386 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-23T14:49:05.386 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-23T14:49:05.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T14:49:05.909 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:06.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:05 smithi137 ceph-mon[31694]: pgmap v392: 129 pgs: 129 active+clean; 629 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-04-23T14:49:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:05 smithi007 ceph-mon[27906]: pgmap v392: 129 pgs: 129 active+clean; 629 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-04-23T14:49:06.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:05 smithi186 ceph-mon[31814]: pgmap v392: 129 pgs: 129 active+clean; 629 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-04-23T14:49:07.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:07 smithi007 ceph-mon[27906]: pgmap v393: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 -- 172.21.15.7:0/217916606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044113cc0 msgr2=0x7fc0441160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 --2- 172.21.15.7:0/217916606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044113cc0 0x7fc0441160b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00b0a0 tx=0x7fc03c00b3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 -- 172.21.15.7:0/217916606 shutdown_connections 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 --2- 172.21.15.7:0/217916606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044113cc0 0x7fc0441160b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 --2- 172.21.15.7:0/217916606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044074d20 0x7fc044075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 --2- 172.21.15.7:0/217916606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc044075640 0x7fc044113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 -- 172.21.15.7:0/217916606 >> 172.21.15.7:0/217916606 conn(0x7fc044079c50 msgr2=0x7fc04407a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:08.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 -- 172.21.15.7:0/217916606 shutdown_connections 2024-04-23T14:49:08.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.253+0000 7fc04ae00700 1 -- 172.21.15.7:0/217916606 wait complete. 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.254+0000 7fc04ae00700 1 Processor -- start 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.254+0000 7fc04ae00700 1 -- start start 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc04ae00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 0x7fc0441a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc04ae00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc044075640 0x7fc0441a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc04ae00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044113cc0 0x7fc04419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc04ae00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0441192d0 con 0x7fc044074d20 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc04ae00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc044119150 con 0x7fc044113cc0 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc04ae00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc044119450 con 0x7fc044075640 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc043e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 0x7fc0441a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc043e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 0x7fc0441a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42450/0 (socket says 172.21.15.7:42450) 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc043e00700 1 -- 172.21.15.7:0/999458056 learned_addr learned my addr 172.21.15.7:0/999458056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc048e00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044113cc0 0x7fc04419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:08.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.255+0000 7fc043400700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc044075640 0x7fc0441a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc043e00700 1 -- 172.21.15.7:0/999458056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc044075640 msgr2=0x7fc0441a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc043e00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc044075640 0x7fc0441a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc043e00700 1 -- 172.21.15.7:0/999458056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044113cc0 msgr2=0x7fc04419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc043e00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044113cc0 0x7fc04419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc043e00700 1 -- 172.21.15.7:0/999458056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04419fd50 con 0x7fc044074d20 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc048e00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044113cc0 0x7fc04419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc043e00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 0x7fc0441a5430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc03400d950 tx=0x7fc03400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034016070 con 0x7fc044074d20 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc034010460 con 0x7fc044074d20 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0441a0040 con 0x7fc044074d20 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.256+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03400f620 con 0x7fc044074d20 2024-04-23T14:49:08.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.257+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0441ac300 con 0x7fc044074d20 2024-04-23T14:49:08.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.258+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0440697e0 con 0x7fc044074d20 2024-04-23T14:49:08.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.260+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fc034019070 con 0x7fc044074d20 2024-04-23T14:49:08.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.261+0000 7fc040c00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc0280a3cd0 0x7fc0280a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:08.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.261+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fc0340d05c0 con 0x7fc044074d20 2024-04-23T14:49:08.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.262+0000 7fc043400700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc0280a3cd0 0x7fc0280a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.262+0000 7fc043400700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc0280a3cd0 0x7fc0280a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc030005950 tx=0x7fc0300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.266+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc03409ca80 con 0x7fc044074d20 2024-04-23T14:49:08.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:07 smithi186 ceph-mon[31814]: pgmap v393: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-04-23T14:49:08.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:07 smithi137 ceph-mon[31694]: pgmap v393: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-04-23T14:49:08.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.497+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0441ac530 con 0x7fc044074d20 2024-04-23T14:49:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.501+0000 7fc040c00700 1 -- 172.21.15.7:0/999458056 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24527 (secure 0 0 0) 0x7fc03409c380 con 0x7fc044074d20 2024-04-23T14:49:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:49:08.504 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:43.702260+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:49:08.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.504+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc0280a3cd0 msgr2=0x7fc0280a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.504+0000 7fc04ae00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc0280a3cd0 0x7fc0280a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc030005950 tx=0x7fc0300058e0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.504+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 msgr2=0x7fc0441a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.504+0000 7fc04ae00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 0x7fc0441a5430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc03400d950 tx=0x7fc03400dd10 comp rx=0 tx=0).stop 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 shutdown_connections 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc0280a3cd0 0x7fc0280a6190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc044113cc0 0x7fc04419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc044074d20 0x7fc0441a5430 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 --2- 172.21.15.7:0/999458056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc044075640 0x7fc0441a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 >> 172.21.15.7:0/999458056 conn(0x7fc044079c50 msgr2=0x7fc044112a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:08.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 shutdown_connections 2024-04-23T14:49:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:08.505+0000 7fc04ae00700 1 -- 172.21.15.7:0/999458056 wait complete. 2024-04-23T14:49:09.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/999458056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:49:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/999458056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:49:09.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/999458056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:49:09.448 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-23T14:49:09.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T14:49:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:10.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:09 smithi007 ceph-mon[27906]: pgmap v394: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:49:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:09 smithi186 ceph-mon[31814]: pgmap v394: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:49:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:09 smithi137 ceph-mon[31694]: pgmap v394: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:49:12.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:11 smithi007 ceph-mon[27906]: pgmap v395: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-04-23T14:49:12.221 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:11 smithi137 ceph-mon[31694]: pgmap v395: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-04-23T14:49:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 -- 172.21.15.7:0/2161804413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28075640 msgr2=0x7fbf2810efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/2161804413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28075640 0x7fbf2810efb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009990 tx=0x7fbf14009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 -- 172.21.15.7:0/2161804413 shutdown_connections 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/2161804413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2810f4f0 0x7fbf281118e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/2161804413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf28074d20 0x7fbf28075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/2161804413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28075640 0x7fbf2810efb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 -- 172.21.15.7:0/2161804413 >> 172.21.15.7:0/2161804413 conn(0x7fbf28079c50 msgr2=0x7fbf2807a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 -- 172.21.15.7:0/2161804413 shutdown_connections 2024-04-23T14:49:12.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.324+0000 7fbf2ea00700 1 -- 172.21.15.7:0/2161804413 wait complete. 2024-04-23T14:49:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 Processor -- start 2024-04-23T14:49:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 -- start start 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf28074d20 0x7fbf2819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf28075640 0x7fbf2819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 0x7fbf2819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28114f00 con 0x7fbf2810f4f0 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28114d80 con 0x7fbf28074d20 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.326+0000 7fbf2ea00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28115080 con 0x7fbf28075640 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 0x7fbf2819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 0x7fbf2819fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42464/0 (socket says 172.21.15.7:42464) 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 -- 172.21.15.7:0/921346010 learned_addr learned my addr 172.21.15.7:0/921346010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf27400700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf28075640 0x7fbf2819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf27e00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf28074d20 0x7fbf2819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 -- 172.21.15.7:0/921346010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf28075640 msgr2=0x7fbf2819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf28075640 0x7fbf2819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 -- 172.21.15.7:0/921346010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf28074d20 msgr2=0x7fbf2819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:12.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf28074d20 0x7fbf2819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.327+0000 7fbf2ca00700 1 -- 172.21.15.7:0/921346010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf281a03a0 con 0x7fbf2810f4f0 2024-04-23T14:49:12.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.328+0000 7fbf2ca00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 0x7fbf2819fc60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbf20007d40 tx=0x7fbf2000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.328+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20016020 con 0x7fbf2810f4f0 2024-04-23T14:49:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.328+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf2000ad40 con 0x7fbf2810f4f0 2024-04-23T14:49:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.328+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf281a0690 con 0x7fbf2810f4f0 2024-04-23T14:49:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.328+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200115e0 con 0x7fbf2810f4f0 2024-04-23T14:49:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.328+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf281a7f10 con 0x7fbf2810f4f0 2024-04-23T14:49:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.329+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf280697e0 con 0x7fbf2810f4f0 2024-04-23T14:49:12.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.331+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fbf20019020 con 0x7fbf2810f4f0 2024-04-23T14:49:12.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.334+0000 7fbf24c00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbf0c0a3cd0 0x7fbf0c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:12.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.334+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fbf200d0b70 con 0x7fbf2810f4f0 2024-04-23T14:49:12.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.334+0000 7fbf27e00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbf0c0a3cd0 0x7fbf0c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:12.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.335+0000 7fbf27e00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbf0c0a3cd0 0x7fbf0c0a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf18005fd0 tx=0x7fbf1800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:12.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.338+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf20020020 con 0x7fbf2810f4f0 2024-04-23T14:49:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:11 smithi186 ceph-mon[31814]: pgmap v395: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-04-23T14:49:12.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.575+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf2819c6f0 con 0x7fbf2810f4f0 2024-04-23T14:49:12.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.578+0000 7fbf24c00700 1 -- 172.21.15.7:0/921346010 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24527 (secure 0 0 0) 0x7fbf2819c6f0 con 0x7fbf2810f4f0 2024-04-23T14:49:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:49:12.581 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:48:43.702260+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:49:12.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.581+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbf0c0a3cd0 msgr2=0x7fbf0c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:12.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.581+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbf0c0a3cd0 0x7fbf0c0a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf18005fd0 tx=0x7fbf1800a560 comp rx=0 tx=0).stop 2024-04-23T14:49:12.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.581+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 msgr2=0x7fbf2819fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:12.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.581+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 0x7fbf2819fc60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbf20007d40 tx=0x7fbf2000a340 comp rx=0 tx=0).stop 2024-04-23T14:49:12.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 shutdown_connections 2024-04-23T14:49:12.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fbf0c0a3cd0 0x7fbf0c0a6190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2810f4f0 0x7fbf2819fc60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf28074d20 0x7fbf2819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 --2- 172.21.15.7:0/921346010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf28075640 0x7fbf2819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 >> 172.21.15.7:0/921346010 conn(0x7fbf28079c50 msgr2=0x7fbf280ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 shutdown_connections 2024-04-23T14:49:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:12.582+0000 7fbf2ea00700 1 -- 172.21.15.7:0/921346010 wait complete. 2024-04-23T14:49:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:12 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/921346010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:49:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:12 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/921346010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:49:13.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:12 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/921346010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:49:13.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-23T14:49:13.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-23T14:49:13.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-23T14:49:13.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-23T14:49:13.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-23T14:49:13.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-23T14:49:13.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-23T14:49:13.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-23T14:49:13.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-23T14:49:13.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-23T14:49:13.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-23T14:49:13.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-23T14:49:13.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:13 smithi007 ceph-mon[27906]: pgmap v396: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-04-23T14:49:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:13 smithi186 ceph-mon[31814]: pgmap v396: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-04-23T14:49:14.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:13 smithi137 ceph-mon[31694]: pgmap v396: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-04-23T14:49:14.566 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:14.581 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:14.581 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:14.729 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:16.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:15 smithi007 ceph-mon[27906]: pgmap v397: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-23T14:49:16.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:15 smithi186 ceph-mon[31814]: pgmap v397: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-23T14:49:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:15 smithi137 ceph-mon[31694]: pgmap v397: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-23T14:49:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:17 smithi007 ceph-mon[27906]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-23T14:49:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:17 smithi186 ceph-mon[31814]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-23T14:49:18.383 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:18.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:17 smithi137 ceph-mon[31694]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-23T14:49:20.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:19 smithi007 ceph-mon[27906]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T14:49:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:19 smithi186 ceph-mon[31814]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T14:49:20.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:19 smithi137 ceph-mon[31694]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T14:49:21.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 -- 172.21.15.7:0/3855589378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3754107a20 msgr2=0x7f375406a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 --2- 172.21.15.7:0/3855589378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3754107a20 0x7f375406a800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3744009990 tx=0x7f3744009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 -- 172.21.15.7:0/3855589378 shutdown_connections 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 --2- 172.21.15.7:0/3855589378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3754105530 0x7f37541059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 --2- 172.21.15.7:0/3855589378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3754107a20 0x7f375406a800 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 --2- 172.21.15.7:0/3855589378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f375406ad40 0x7f375406b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 -- 172.21.15.7:0/3855589378 >> 172.21.15.7:0/3855589378 conn(0x7f37540789a0 msgr2=0x7f3754078db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 -- 172.21.15.7:0/3855589378 shutdown_connections 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.667+0000 7f375ac00700 1 -- 172.21.15.7:0/3855589378 wait complete. 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.668+0000 7f375ac00700 1 Processor -- start 2024-04-23T14:49:21.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.668+0000 7f375ac00700 1 -- start start 2024-04-23T14:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f375ac00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375406ad40 0x7f37541a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f375ac00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3754105530 0x7f37541a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f375ac00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3754107a20 0x7f375419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:21.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f375ac00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3754119360 con 0x7f375406ad40 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f375ac00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37541191e0 con 0x7f3754105530 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f375ac00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f37541194e0 con 0x7f3754107a20 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f3753e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375406ad40 0x7f37541a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f3753e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375406ad40 0x7f37541a5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48294/0 (socket says 172.21.15.7:48294) 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f3753e00700 1 -- 172.21.15.7:0/2685698795 learned_addr learned my addr 172.21.15.7:0/2685698795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f3758c00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3754107a20 0x7f375419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.669+0000 7f3753400700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3754105530 0x7f37541a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3753e00700 1 -- 172.21.15.7:0/2685698795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3754107a20 msgr2=0x7f375419f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3753e00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3754107a20 0x7f375419f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3753e00700 1 -- 172.21.15.7:0/2685698795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3754105530 msgr2=0x7f37541a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3753e00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3754105530 0x7f37541a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3753e00700 1 -- 172.21.15.7:0/2685698795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375419ffe0 con 0x7f375406ad40 2024-04-23T14:49:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3753e00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375406ad40 0x7f37541a5630 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3744003ab0 tx=0x7f3744003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744027070 con 0x7f375406ad40 2024-04-23T14:49:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f374400bdc0 con 0x7f375406ad40 2024-04-23T14:49:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744022de0 con 0x7f375406ad40 2024-04-23T14:49:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.670+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37541a0270 con 0x7f375406ad40 2024-04-23T14:49:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.671+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37541ac3e0 con 0x7f375406ad40 2024-04-23T14:49:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.672+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37541013c0 con 0x7f375406ad40 2024-04-23T14:49:21.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.674+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f3744022470 con 0x7f375406ad40 2024-04-23T14:49:21.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.675+0000 7f3750c00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37380a3cd0 0x7f37380a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:21.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.676+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f37440d2570 con 0x7f375406ad40 2024-04-23T14:49:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.676+0000 7f3753400700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37380a3cd0 0x7f37380a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.676+0000 7f3750c00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] conn(0x7f37380aee20 0x7f37380b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.676+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 --> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f374400b0b0 con 0x7f37380aee20 2024-04-23T14:49:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.676+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f37440d2920 con 0x7f375406ad40 2024-04-23T14:49:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.676+0000 7f3758c00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] conn(0x7f37380aee20 0x7f37380b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:21.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.677+0000 7f3753400700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37380a3cd0 0x7f37380a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3740006fd0 tx=0x7f3740008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:21.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.677+0000 7f3758c00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] conn(0x7f37380aee20 0x7f37380b12c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.678+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== osd.6 v2:172.21.15.7:6818/2119533144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f374400b0b0 con 0x7f37380aee20 2024-04-23T14:49:21.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.697+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 --> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3754102010 con 0x7f37380aee20 2024-04-23T14:49:21.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.697+0000 7f3750c00700 1 -- 172.21.15.7:0/2685698795 <== osd.6 v2:172.21.15.7:6818/2119533144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3754102010 con 0x7f37380aee20 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] conn(0x7f37380aee20 msgr2=0x7f37380b12c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] conn(0x7f37380aee20 0x7f37380b12c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37380a3cd0 msgr2=0x7f37380a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f37380a3cd0 0x7f37380a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3740006fd0 tx=0x7f3740008040 comp rx=0 tx=0).stop 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375406ad40 msgr2=0x7f37541a5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 --2- 172.21.15.7:0/2685698795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375406ad40 0x7f37541a5630 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3744003ab0 tx=0x7f3744003ae0 comp rx=0 tx=0).stop 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f3758c00700 1 -- 172.21.15.7:0/2685698795 reap_dead start 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 shutdown_connections 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 >> 172.21.15.7:0/2685698795 conn(0x7f37540789a0 msgr2=0x7f37541009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.698+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 shutdown_connections 2024-04-23T14:49:21.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:21.699+0000 7f375ac00700 1 -- 172.21.15.7:0/2685698795 wait complete. 2024-04-23T14:49:22.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:21 smithi007 ceph-mon[27906]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-23T14:49:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:21 smithi186 ceph-mon[31814]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-23T14:49:22.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:21 smithi137 ceph-mon[31694]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-04-23T14:49:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:24.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:23 smithi007 ceph-mon[27906]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:49:24.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:23 smithi186 ceph-mon[31814]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:49:24.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:23 smithi137 ceph-mon[31694]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:49:25.132 INFO:teuthology.orchestra.run.smithi007.stdout:197568495679 2024-04-23T14:49:25.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 -- 172.21.15.7:0/758048935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c103500 msgr2=0x7fd31c10f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 --2- 172.21.15.7:0/758048935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c103500 0x7fd31c10f960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd31800b0a0 tx=0x7fd31800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 -- 172.21.15.7:0/758048935 shutdown_connections 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 --2- 172.21.15.7:0/758048935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c103500 0x7fd31c10f960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 --2- 172.21.15.7:0/758048935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd31c108b90 0x7fd31c108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 --2- 172.21.15.7:0/758048935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd31c102b40 0x7fd31c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 -- 172.21.15.7:0/758048935 >> 172.21.15.7:0/758048935 conn(0x7fd31c079c50 msgr2=0x7fd31c07a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 -- 172.21.15.7:0/758048935 shutdown_connections 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.995+0000 7fd324800700 1 -- 172.21.15.7:0/758048935 wait complete. 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.996+0000 7fd324800700 1 Processor -- start 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 -- start start 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd31c102b40 0x7fd31c074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd31c103500 0x7fd31c075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c108b90 0x7fd31c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112ca0 con 0x7fd31c108b90 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112b20 con 0x7fd31c102b40 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.997+0000 7fd324800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112e20 con 0x7fd31c103500 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c108b90 0x7fd31c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd321e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd31c102b40 0x7fd31c074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c108b90 0x7fd31c075870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48020/0 (socket says 172.21.15.7:48020) 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 -- 172.21.15.7:0/2178990421 learned_addr learned my addr 172.21.15.7:0/2178990421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd321400700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd31c103500 0x7fd31c075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 -- 172.21.15.7:0/2178990421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd31c103500 msgr2=0x7fd31c075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd31c103500 0x7fd31c075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 -- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd31c102b40 msgr2=0x7fd31c074df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd31c102b40 0x7fd31c074df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd322800700 1 -- 172.21.15.7:0/2178990421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1a76b0 con 0x7fd31c108b90 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd321e00700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd31c102b40 0x7fd31c074df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.998+0000 7fd321400700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd31c103500 0x7fd31c075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:25.999+0000 7fd322800700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c108b90 0x7fd31c075870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd31800b830 tx=0x7fd318004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.002+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318021070 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.002+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd318003c00 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.002+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1a7940 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.002+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318004810 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.002+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c1a7e40 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.003+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd31c0631c0 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.006+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fd318003db0 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.007+0000 7fd316a00700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd3040a3d50 0x7fd3040a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.007+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd31800f020 con 0x7fd31c108b90 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.007+0000 7fd321e00700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd3040a3d50 0x7fd3040a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.007+0000 7fd316a00700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] conn(0x7fd3040aeeb0 0x7fd3040b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.008+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 --> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd31801de50 con 0x7fd3040aeeb0 2024-04-23T14:49:26.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.008+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fd3180d2510 con 0x7fd31c108b90 2024-04-23T14:49:26.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.008+0000 7fd321e00700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd3040a3d50 0x7fd3040a6210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd310005fd0 tx=0x7fd31000a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.022+0000 7fd321400700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] conn(0x7fd3040aeeb0 0x7fd3040b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.024+0000 7fd321400700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] conn(0x7fd3040aeeb0 0x7fd3040b1350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.026+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== osd.4 v2:172.21.15.137:6808/3040772889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd31801de50 con 0x7fd3040aeeb0 2024-04-23T14:49:26.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.044+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 --> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd31c0635c0 con 0x7fd3040aeeb0 2024-04-23T14:49:26.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.045+0000 7fd316a00700 1 -- 172.21.15.7:0/2178990421 <== osd.4 v2:172.21.15.137:6808/3040772889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd31c0635c0 con 0x7fd3040aeeb0 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.046+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] conn(0x7fd3040aeeb0 msgr2=0x7fd3040b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.046+0000 7fd324800700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] conn(0x7fd3040aeeb0 0x7fd3040b1350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd3040a3d50 msgr2=0x7fd3040a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd3040a3d50 0x7fd3040a6210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd310005fd0 tx=0x7fd31000a5e0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c108b90 msgr2=0x7fd31c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 --2- 172.21.15.7:0/2178990421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd31c108b90 0x7fd31c075870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd31800b830 tx=0x7fd318004d90 comp rx=0 tx=0).stop 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd322800700 1 -- 172.21.15.7:0/2178990421 reap_dead start 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 shutdown_connections 2024-04-23T14:49:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 >> 172.21.15.7:0/2178990421 conn(0x7fd31c079c50 msgr2=0x7fd31c101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 shutdown_connections 2024-04-23T14:49:26.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.047+0000 7fd324800700 1 -- 172.21.15.7:0/2178990421 wait complete. 2024-04-23T14:49:26.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:25 smithi007 ceph-mon[27906]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:49:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:25 smithi186 ceph-mon[31814]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:49:26.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:25 smithi137 ceph-mon[31694]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 -- 172.21.15.7:0/2338483701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 msgr2=0x7fce541134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 --2- 172.21.15.7:0/2338483701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce541134f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fce40009990 tx=0x7fce40009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 -- 172.21.15.7:0/2338483701 shutdown_connections 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 --2- 172.21.15.7:0/2338483701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce54113a30 0x7fce54115e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 --2- 172.21.15.7:0/2338483701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce54074e90 0x7fce54075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 --2- 172.21.15.7:0/2338483701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce541134f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.099+0000 7fce5aa00700 1 -- 172.21.15.7:0/2338483701 >> 172.21.15.7:0/2338483701 conn(0x7fce540fe570 msgr2=0x7fce54100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.100+0000 7fce5aa00700 1 -- 172.21.15.7:0/2338483701 shutdown_connections 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.100+0000 7fce5aa00700 1 -- 172.21.15.7:0/2338483701 wait complete. 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 Processor -- start 2024-04-23T14:49:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 -- start start 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce54074e90 0x7fce5419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce5419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce54113a30 0x7fce541a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce54119210 con 0x7fce540757b0 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce54119090 con 0x7fce54113a30 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.101+0000 7fce5aa00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fce54119390 con 0x7fce54074e90 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.102+0000 7fce58c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce5419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.102+0000 7fce58c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce5419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48036/0 (socket says 172.21.15.7:48036) 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.102+0000 7fce58c00700 1 -- 172.21.15.7:0/16876899 learned_addr learned my addr 172.21.15.7:0/16876899 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.102+0000 7fce59600700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce54074e90 0x7fce5419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.102+0000 7fce58c00700 1 -- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce54074e90 msgr2=0x7fce5419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.103+0000 7fce58c00700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce54074e90 0x7fce5419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.103+0000 7fce58c00700 1 -- 172.21.15.7:0/16876899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce54113a30 msgr2=0x7fce541a3f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T14:49:26.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.103+0000 7fce58c00700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce54113a30 0x7fce541a3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.103+0000 7fce58c00700 1 -- 172.21.15.7:0/16876899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce541a4680 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.103+0000 7fce58c00700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce5419fc00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fce40003ab0 tx=0x7fce40003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.103+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40027070 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.104+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce4000bdc0 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.104+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40022d40 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.104+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce541a4910 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.104+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce541ac1f0 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.105+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce34001030 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.108+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fce40003fc0 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.109+0000 7fce52000700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fce3c0a3d50 0x7fce3c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.109+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fce400d2230 con 0x7fce540757b0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.109+0000 7fce59600700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fce3c0a3d50 0x7fce3c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.110+0000 7fce52000700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] conn(0x7fce3c0aeeb0 0x7fce3c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.110+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 --> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce4000b0b0 con 0x7fce3c0aeeb0 2024-04-23T14:49:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.110+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fce400d25e0 con 0x7fce540757b0 2024-04-23T14:49:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.110+0000 7fce5a000700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] conn(0x7fce3c0aeeb0 0x7fce3c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.111+0000 7fce59600700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fce3c0a3d50 0x7fce3c0a6210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce48005950 tx=0x7fce4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.112+0000 7fce5a000700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] conn(0x7fce3c0aeeb0 0x7fce3c0b1350 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.114+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== osd.2 v2:172.21.15.186:6800/3205554231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce4000b0b0 con 0x7fce3c0aeeb0 2024-04-23T14:49:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.133+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 --> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce34002e60 con 0x7fce3c0aeeb0 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce52000700 1 -- 172.21.15.7:0/16876899 <== osd.2 v2:172.21.15.186:6800/3205554231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce34002e60 con 0x7fce3c0aeeb0 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] conn(0x7fce3c0aeeb0 msgr2=0x7fce3c0b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce5aa00700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] conn(0x7fce3c0aeeb0 0x7fce3c0b1350 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fce3c0a3d50 msgr2=0x7fce3c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce5aa00700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fce3c0a3d50 0x7fce3c0a6210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce48005950 tx=0x7fce4800b410 comp rx=0 tx=0).stop 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 msgr2=0x7fce5419fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.134+0000 7fce5aa00700 1 --2- 172.21.15.7:0/16876899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce540757b0 0x7fce5419fc00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fce40003ab0 tx=0x7fce40003ae0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.135+0000 7fce5a000700 1 -- 172.21.15.7:0/16876899 reap_dead start 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.135+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 shutdown_connections 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.135+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 >> 172.21.15.7:0/16876899 conn(0x7fce540fe570 msgr2=0x7fce540ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.135+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 shutdown_connections 2024-04-23T14:49:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:26.135+0000 7fce5aa00700 1 -- 172.21.15.7:0/16876899 wait complete. 2024-04-23T14:49:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:27 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:49:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:27 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:49:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:27 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:49:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:28 smithi007 ceph-mon[27906]: pgmap v403: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-23T14:49:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:28 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:28 smithi186 ceph-mon[31814]: pgmap v403: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-23T14:49:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:28 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:28 smithi137 ceph-mon[31694]: pgmap v403: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-23T14:49:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:28 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.178+0000 7effec800700 1 -- 172.21.15.7:0/4286106186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4108b70 msgr2=0x7effe4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.178+0000 7effec800700 1 --2- 172.21.15.7:0/4286106186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4108b70 0x7effe4108f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7effd8009990 tx=0x7effd8009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.178+0000 7effec800700 1 -- 172.21.15.7:0/4286106186 shutdown_connections 2024-04-23T14:49:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.179+0000 7effec800700 1 --2- 172.21.15.7:0/4286106186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe406b1a0 0x7effe410f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.179+0000 7effec800700 1 --2- 172.21.15.7:0/4286106186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4108b70 0x7effe4108f50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.179+0000 7effec800700 1 --2- 172.21.15.7:0/4286106186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe406a800 0x7effe406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.179+0000 7effec800700 1 -- 172.21.15.7:0/4286106186 >> 172.21.15.7:0/4286106186 conn(0x7effe40789a0 msgr2=0x7effe4078db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.179+0000 7effec800700 1 -- 172.21.15.7:0/4286106186 shutdown_connections 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.179+0000 7effec800700 1 -- 172.21.15.7:0/4286106186 wait complete. 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 Processor -- start 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 -- start start 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe406a800 0x7effe419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe406b1a0 0x7effe419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4108b70 0x7effe419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effe4112cd0 con 0x7effe406a800 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7effe4112b50 con 0x7effe4108b70 2024-04-23T14:49:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.180+0000 7effec800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7effe4112e50 con 0x7effe406b1a0 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe406a800 0x7effe419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe406a800 0x7effe419b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48044/0 (socket says 172.21.15.7:48044) 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 -- 172.21.15.7:0/1218463220 learned_addr learned my addr 172.21.15.7:0/1218463220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effea800700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4108b70 0x7effe419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9400700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe406b1a0 0x7effe419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 -- 172.21.15.7:0/1218463220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe406b1a0 msgr2=0x7effe419b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe406b1a0 0x7effe419b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 -- 172.21.15.7:0/1218463220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4108b70 msgr2=0x7effe419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effe4108b70 0x7effe419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.181+0000 7effe9e00700 1 -- 172.21.15.7:0/1218463220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe41a0430 con 0x7effe406a800 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.182+0000 7effe9e00700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe406a800 0x7effe419b420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7effd8000c00 tx=0x7effd80057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.182+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8027070 con 0x7effe406a800 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.182+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effd8022470 con 0x7effe406a800 2024-04-23T14:49:29.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.182+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe41a06c0 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.182+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd800b610 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.182+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe41a7fa0 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.183+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effe4063200 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.185+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7effd802a070 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.187+0000 7effdea00700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7effcc0a3d50 0x7effcc0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.187+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7effd80d1aa0 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.187+0000 7effe9400700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7effcc0a3d50 0x7effcc0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.187+0000 7effdea00700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] conn(0x7effcc0aed80 0x7effcc0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.187+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 --> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effd8007e80 con 0x7effcc0aed80 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.187+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7effd80d1e50 con 0x7effe406a800 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.188+0000 7effea800700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] conn(0x7effcc0aed80 0x7effcc0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.188+0000 7effe9400700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7effcc0a3d50 0x7effcc0a6210 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7effe4079080 tx=0x7effd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.188+0000 7effea800700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] conn(0x7effcc0aed80 0x7effcc0b1220 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:29.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.190+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== osd.3 v2:172.21.15.7:6810/2158265578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effd8007e80 con 0x7effcc0aed80 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.209+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 --> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effe4063600 con 0x7effcc0aed80 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effdea00700 1 -- 172.21.15.7:0/1218463220 <== osd.3 v2:172.21.15.7:6810/2158265578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7effe4063600 con 0x7effcc0aed80 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] conn(0x7effcc0aed80 msgr2=0x7effcc0b1220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effec800700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] conn(0x7effcc0aed80 0x7effcc0b1220 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7effcc0a3d50 msgr2=0x7effcc0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effec800700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7effcc0a3d50 0x7effcc0a6210 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7effe4079080 tx=0x7effd4009260 comp rx=0 tx=0).stop 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe406a800 msgr2=0x7effe419b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.210+0000 7effec800700 1 --2- 172.21.15.7:0/1218463220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe406a800 0x7effe419b420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7effd8000c00 tx=0x7effd80057a0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.211+0000 7effea800700 1 -- 172.21.15.7:0/1218463220 reap_dead start 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.211+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 shutdown_connections 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.211+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 >> 172.21.15.7:0/1218463220 conn(0x7effe40789a0 msgr2=0x7effe410dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.211+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 shutdown_connections 2024-04-23T14:49:29.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.211+0000 7effec800700 1 -- 172.21.15.7:0/1218463220 wait complete. 2024-04-23T14:49:29.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 -- 172.21.15.7:0/2382565742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c108b90 msgr2=0x7f2f7c108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 --2- 172.21.15.7:0/2382565742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c108b90 0x7f2f7c108f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009990 tx=0x7f2f70009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 -- 172.21.15.7:0/2382565742 shutdown_connections 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 --2- 172.21.15.7:0/2382565742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f7c103500 0x7f2f7c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 --2- 172.21.15.7:0/2382565742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c108b90 0x7f2f7c108f70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 --2- 172.21.15.7:0/2382565742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f7c102b40 0x7f2f7c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 -- 172.21.15.7:0/2382565742 >> 172.21.15.7:0/2382565742 conn(0x7f2f7c079c50 msgr2=0x7f2f7c07a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 -- 172.21.15.7:0/2382565742 shutdown_connections 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.279+0000 7f2f84000700 1 -- 172.21.15.7:0/2382565742 wait complete. 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.280+0000 7f2f84000700 1 Processor -- start 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.280+0000 7f2f84000700 1 -- start start 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f84000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c102b40 0x7f2f7c074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f84000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f7c103500 0x7f2f7c075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f84000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f7c108b90 0x7f2f7c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f84000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c112d10 con 0x7f2f7c102b40 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f84000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c112b90 con 0x7f2f7c103500 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f84000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c112e90 con 0x7f2f7c108b90 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f81600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c102b40 0x7f2f7c074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f81600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c102b40 0x7f2f7c074df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48068/0 (socket says 172.21.15.7:48068) 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f81600700 1 -- 172.21.15.7:0/3915077164 learned_addr learned my addr 172.21.15.7:0/3915077164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f82000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f7c108b90 0x7f2f7c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.281+0000 7f2f80c00700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f7c103500 0x7f2f7c075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f81600700 1 -- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f7c108b90 msgr2=0x7f2f7c075870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f81600700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f7c108b90 0x7f2f7c075870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f81600700 1 -- 172.21.15.7:0/3915077164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f7c103500 msgr2=0x7f2f7c075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f81600700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f7c103500 0x7f2f7c075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f81600700 1 -- 172.21.15.7:0/3915077164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c1a77b0 con 0x7f2f7c102b40 2024-04-23T14:49:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f80c00700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f7c103500 0x7f2f7c075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f81600700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c102b40 0x7f2f7c074df0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f70000c00 tx=0x7f2f700057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70027070 con 0x7f2f7c102b40 2024-04-23T14:49:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f70022470 con 0x7f2f7c102b40 2024-04-23T14:49:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000b610 con 0x7f2f7c102b40 2024-04-23T14:49:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7c1a7a40 con 0x7f2f7c102b40 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.282+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7c1a7ed0 con 0x7f2f7c102b40 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.283+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f7c0631c0 con 0x7f2f7c102b40 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.286+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f2f7002a070 con 0x7f2f7c102b40 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.287+0000 7f2f7a000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2f640a3cd0 0x7f2f640a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.287+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f2f700d1bd0 con 0x7f2f7c102b40 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.287+0000 7f2f80c00700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2f640a3cd0 0x7f2f640a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.288+0000 7f2f7a000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] conn(0x7f2f640aed00 0x7f2f640b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.288+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 --> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f7001ae50 con 0x7f2f640aed00 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.288+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f2f700d1f80 con 0x7f2f7c102b40 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.288+0000 7f2f80c00700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2f640a3cd0 0x7f2f640a6190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c07a2c0 tx=0x7f2f68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.288+0000 7f2f82000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] conn(0x7f2f640aed00 0x7f2f640b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.289+0000 7f2f82000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] conn(0x7f2f640aed00 0x7f2f640b11a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.290+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== osd.5 v2:172.21.15.186:6808/2388437494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f7001ae50 con 0x7f2f640aed00 2024-04-23T14:49:29.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.309+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 --> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f7c063640 con 0x7f2f640aed00 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f7a000700 1 -- 172.21.15.7:0/3915077164 <== osd.5 v2:172.21.15.186:6808/2388437494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2f7c063640 con 0x7f2f640aed00 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] conn(0x7f2f640aed00 msgr2=0x7f2f640b11a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] conn(0x7f2f640aed00 0x7f2f640b11a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2f640a3cd0 msgr2=0x7f2f640a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2f640a3cd0 0x7f2f640a6190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c07a2c0 tx=0x7f2f68009260 comp rx=0 tx=0).stop 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c102b40 msgr2=0x7f2f7c074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 --2- 172.21.15.7:0/3915077164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f7c102b40 0x7f2f7c074df0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f70000c00 tx=0x7f2f700057a0 comp rx=0 tx=0).stop 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f82000700 1 -- 172.21.15.7:0/3915077164 reap_dead start 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 shutdown_connections 2024-04-23T14:49:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.311+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 >> 172.21.15.7:0/3915077164 conn(0x7f2f7c079c50 msgr2=0x7f2f7c1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.312+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 shutdown_connections 2024-04-23T14:49:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:29.312+0000 7f2f84000700 1 -- 172.21.15.7:0/3915077164 wait complete. 2024-04-23T14:49:30.104 INFO:teuthology.orchestra.run.smithi007.stdout:141733920845 2024-04-23T14:49:30.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-23T14:49:30.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:30 smithi007 ceph-mon[27906]: pgmap v404: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T14:49:30.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:30 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:30 smithi186 ceph-mon[31814]: pgmap v404: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T14:49:30.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:30 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:30 smithi137 ceph-mon[31694]: pgmap v404: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T14:49:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:30 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:49:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 -- 172.21.15.7:0/2023402504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c074d20 msgr2=0x7f546c075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 --2- 172.21.15.7:0/2023402504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c074d20 0x7f546c075100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5460009990 tx=0x7f5460009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 -- 172.21.15.7:0/2023402504 shutdown_connections 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 --2- 172.21.15.7:0/2023402504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f546c10f4f0 0x7f546c1118e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 --2- 172.21.15.7:0/2023402504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c074d20 0x7f546c075100 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 --2- 172.21.15.7:0/2023402504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f546c075640 0x7f546c10efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 -- 172.21.15.7:0/2023402504 >> 172.21.15.7:0/2023402504 conn(0x7f546c079c50 msgr2=0x7f546c07a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 -- 172.21.15.7:0/2023402504 shutdown_connections 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.966+0000 7f5473a00700 1 -- 172.21.15.7:0/2023402504 wait complete. 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.968+0000 7f5473a00700 1 Processor -- start 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.968+0000 7f5473a00700 1 -- start start 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5473a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f546c074d20 0x7f546c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5473a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c075640 0x7f546c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5473a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f546c10f4f0 0x7f546c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5473a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f546c115010 con 0x7f546c075640 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5473a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f546c114e90 con 0x7f546c074d20 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5473a00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f546c115190 con 0x7f546c10f4f0 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f546be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c075640 0x7f546c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f546be00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c075640 0x7f546c19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48082/0 (socket says 172.21.15.7:48082) 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f546be00700 1 -- 172.21.15.7:0/3026027352 learned_addr learned my addr 172.21.15.7:0/3026027352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.969+0000 7f5471000700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f546c074d20 0x7f546c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f546be00700 1 -- 172.21.15.7:0/3026027352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f546c10f4f0 msgr2=0x7f546c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f546be00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f546c10f4f0 0x7f546c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f546be00700 1 -- 172.21.15.7:0/3026027352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f546c074d20 msgr2=0x7f546c19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f546be00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f546c074d20 0x7f546c19b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f546be00700 1 -- 172.21.15.7:0/3026027352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c1a04a0 con 0x7f546c075640 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f546be00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c075640 0x7f546c19ba20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f545800b500 tx=0x7f545800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458015020 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.970+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5458011ce0 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.971+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458010d60 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.971+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c1a0790 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.971+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c1a8010 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.972+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f546c063240 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.974+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f5458018020 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.976+0000 7f5469600700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54540a3cd0 0x7f54540a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.977+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f54580d06a0 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.977+0000 7f5471000700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54540a3cd0 0x7f54540a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.977+0000 7f5469600700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] conn(0x7f54540aee30 0x7f54540b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.977+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 --> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5458018ec0 con 0x7f54540aee30 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.977+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f54580d0a50 con 0x7f546c075640 2024-04-23T14:49:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.977+0000 7f5471a00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] conn(0x7f54540aee30 0x7f54540b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.978+0000 7f5471000700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54540a3cd0 0x7f54540a6190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f546000b5c0 tx=0x7f5460005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.978+0000 7f5471a00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] conn(0x7f54540aee30 0x7f54540b12d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.979+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== osd.0 v2:172.21.15.7:6802/3865208541 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5458018ec0 con 0x7f54540aee30 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.999+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 --> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f546c0636c0 con 0x7f54540aee30 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:30.999+0000 7f5469600700 1 -- 172.21.15.7:0/3026027352 <== osd.0 v2:172.21.15.7:6802/3865208541 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f546c0636c0 con 0x7f54540aee30 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] conn(0x7f54540aee30 msgr2=0x7f54540b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] conn(0x7f54540aee30 0x7f54540b12d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54540a3cd0 msgr2=0x7f54540a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f54540a3cd0 0x7f54540a6190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f546000b5c0 tx=0x7f5460005fd0 comp rx=0 tx=0).stop 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c075640 msgr2=0x7f546c19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 --2- 172.21.15.7:0/3026027352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f546c075640 0x7f546c19ba20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f545800b500 tx=0x7f545800b810 comp rx=0 tx=0).stop 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5471a00700 1 -- 172.21.15.7:0/3026027352 reap_dead start 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 shutdown_connections 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.000+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 >> 172.21.15.7:0/3026027352 conn(0x7f546c079c50 msgr2=0x7f546c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.001+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 shutdown_connections 2024-04-23T14:49:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:31.001+0000 7f5473a00700 1 -- 172.21.15.7:0/3026027352 wait complete. 2024-04-23T14:49:32.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:32 smithi007 ceph-mon[27906]: pgmap v405: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T14:49:32.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:32 smithi186 ceph-mon[31814]: pgmap v405: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T14:49:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:32 smithi137 ceph-mon[31694]: pgmap v405: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T14:49:34.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:34 smithi007 ceph-mon[27906]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:34.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:34 smithi186 ceph-mon[31814]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:34.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:34 smithi137 ceph-mon[31694]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:34.502 INFO:teuthology.orchestra.run.smithi007.stdout:163208757321 2024-04-23T14:49:34.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-23T14:49:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.114+0000 7fec3aa00700 1 -- 172.21.15.7:0/2761307476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec34109380 msgr2=0x7fec34109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.114+0000 7fec3aa00700 1 --2- 172.21.15.7:0/2761307476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec34109380 0x7fec34109760 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec2400b0d0 tx=0x7fec2400b3e0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 -- 172.21.15.7:0/2761307476 shutdown_connections 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 --2- 172.21.15.7:0/2761307476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec3410e460 0x7fec34116030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 --2- 172.21.15.7:0/2761307476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec34109380 0x7fec34109760 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 --2- 172.21.15.7:0/2761307476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec34109d30 0x7fec3410dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 -- 172.21.15.7:0/2761307476 >> 172.21.15.7:0/2761307476 conn(0x7fec340762c0 msgr2=0x7fec34107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 -- 172.21.15.7:0/2761307476 shutdown_connections 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.115+0000 7fec3aa00700 1 -- 172.21.15.7:0/2761307476 wait complete. 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 Processor -- start 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 -- start start 2024-04-23T14:49:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec34109380 0x7fec341a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec34109d30 0x7fec341a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec3410e460 0x7fec3419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec34119340 con 0x7fec3410e460 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec341191c0 con 0x7fec34109d30 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.116+0000 7fec3aa00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fec341194c0 con 0x7fec34109380 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec3410e460 0x7fec3419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec3410e460 0x7fec3419f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54998/0 (socket says 172.21.15.7:54998) 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 -- 172.21.15.7:0/1655442407 learned_addr learned my addr 172.21.15.7:0/1655442407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 -- 172.21.15.7:0/1655442407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec34109380 msgr2=0x7fec341a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec34109380 0x7fec341a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 -- 172.21.15.7:0/1655442407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec34109d30 msgr2=0x7fec341a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec34109d30 0x7fec341a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.117+0000 7fec38a00700 1 -- 172.21.15.7:0/1655442407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3419fd20 con 0x7fec3410e460 2024-04-23T14:49:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.118+0000 7fec38a00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec3410e460 0x7fec3419f5c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00c900 tx=0x7fec2c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.118+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c007b00 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.118+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec2c007ca0 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.118+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec341a0010 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.118+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c018660 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.118+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec341ac2d0 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.119+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec34063280 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.122+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fec2c00f450 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec31600700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec180a3cd0 0x7fec180a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fec2c0d0a50 con 0x7fec3410e460 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec33e00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec180a3cd0 0x7fec180a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec31600700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] conn(0x7fec180aee30 0x7fec180b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 --> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec2c012ec0 con 0x7fec180aee30 2024-04-23T14:49:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fec2c0d0e00 con 0x7fec3410e460 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.123+0000 7fec2b400700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] conn(0x7fec180aee30 0x7fec180b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.124+0000 7fec33e00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec180a3cd0 0x7fec180a6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec24009fd0 tx=0x7fec2400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.124+0000 7fec2b400700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] conn(0x7fec180aee30 0x7fec180b12d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.125+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== osd.9 v2:172.21.15.7:6826/938090792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec2c012ec0 con 0x7fec180aee30 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.143+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 --> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec34063700 con 0x7fec180aee30 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.144+0000 7fec31600700 1 -- 172.21.15.7:0/1655442407 <== osd.9 v2:172.21.15.7:6826/938090792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fec34063700 con 0x7fec180aee30 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.144+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] conn(0x7fec180aee30 msgr2=0x7fec180b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.144+0000 7fec3aa00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] conn(0x7fec180aee30 0x7fec180b12d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec180a3cd0 msgr2=0x7fec180a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fec180a3cd0 0x7fec180a6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec24009fd0 tx=0x7fec2400b040 comp rx=0 tx=0).stop 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec3410e460 msgr2=0x7fec3419f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 --2- 172.21.15.7:0/1655442407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec3410e460 0x7fec3419f5c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00c900 tx=0x7fec2c00ccc0 comp rx=0 tx=0).stop 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec38a00700 1 -- 172.21.15.7:0/1655442407 reap_dead start 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 shutdown_connections 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 >> 172.21.15.7:0/1655442407 conn(0x7fec340762c0 msgr2=0x7fec340768e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 shutdown_connections 2024-04-23T14:49:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:33.145+0000 7fec3aa00700 1 -- 172.21.15.7:0/1655442407 wait complete. 2024-04-23T14:49:35.451 INFO:teuthology.orchestra.run.smithi007.stdout:34359738474 2024-04-23T14:49:35.452 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-23T14:49:36.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:36 smithi007 ceph-mon[27906]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:36.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:36 smithi186 ceph-mon[31814]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:36.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:36 smithi137 ceph-mon[31694]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 -- 172.21.15.7:0/2826275185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 msgr2=0x7f6c6c075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 --2- 172.21.15.7:0/2826275185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c075100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009990 tx=0x7f6c5c009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 -- 172.21.15.7:0/2826275185 shutdown_connections 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 --2- 172.21.15.7:0/2826275185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c6c10f550 0x7f6c6c111940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 --2- 172.21.15.7:0/2826275185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c075100 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 --2- 172.21.15.7:0/2826275185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c6c075640 0x7f6c6c10f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 -- 172.21.15.7:0/2826275185 >> 172.21.15.7:0/2826275185 conn(0x7f6c6c079c50 msgr2=0x7f6c6c07a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 -- 172.21.15.7:0/2826275185 shutdown_connections 2024-04-23T14:49:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.565+0000 7f6c72200700 1 -- 172.21.15.7:0/2826275185 wait complete. 2024-04-23T14:49:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.566+0000 7f6c72200700 1 Processor -- start 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.566+0000 7f6c72200700 1 -- start start 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c72200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c72200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c6c075640 0x7f6c6c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c72200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c6c10f550 0x7f6c6c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c72200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c114ef0 con 0x7f6c6c074d20 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c72200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c114d70 con 0x7f6c6c075640 2024-04-23T14:49:36.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c72200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c115070 con 0x7f6c6c10f550 2024-04-23T14:49:36.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c6b400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:36.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.567+0000 7f6c6b400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c19b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55012/0 (socket says 172.21.15.7:55012) 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6b400700 1 -- 172.21.15.7:0/3236120802 learned_addr learned my addr 172.21.15.7:0/3236120802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6aa00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c6c075640 0x7f6c6c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6b400700 1 -- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c6c10f550 msgr2=0x7f6c6c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6be00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c6c10f550 0x7f6c6c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6b400700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c6c10f550 0x7f6c6c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6b400700 1 -- 172.21.15.7:0/3236120802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c6c075640 msgr2=0x7f6c6c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6b400700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c6c075640 0x7f6c6c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6b400700 1 -- 172.21.15.7:0/3236120802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c1a03d0 con 0x7f6c6c074d20 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6aa00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c6c075640 0x7f6c6c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.568+0000 7f6c6be00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c6c10f550 0x7f6c6c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.569+0000 7f6c6b400700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c19b3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c003ab0 tx=0x7f6c5c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:36.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.569+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c027070 con 0x7f6c6c074d20 2024-04-23T14:49:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.569+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c5c00bdc0 con 0x7f6c6c074d20 2024-04-23T14:49:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.569+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c1a0660 con 0x7f6c6c074d20 2024-04-23T14:49:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.569+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c022d40 con 0x7f6c6c074d20 2024-04-23T14:49:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.569+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c1a7f40 con 0x7f6c6c074d20 2024-04-23T14:49:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.570+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c6c063180 con 0x7f6c6c074d20 2024-04-23T14:49:36.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.573+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f6c5c02a070 con 0x7f6c6c074d20 2024-04-23T14:49:36.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.574+0000 7f6c63e00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6c500a3d50 0x7f6c500a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:36.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.574+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6c5c0d2210 con 0x7f6c6c074d20 2024-04-23T14:49:36.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.574+0000 7f6c6aa00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6c500a3d50 0x7f6c500a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:36.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.574+0000 7f6c63e00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] conn(0x7f6c500aeeb0 0x7f6c500b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:36.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.574+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 --> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c5c009030 con 0x7f6c500aeeb0 2024-04-23T14:49:36.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.574+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f6c5c0d25c0 con 0x7f6c6c074d20 2024-04-23T14:49:36.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.575+0000 7f6c6aa00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6c500a3d50 0x7f6c500a6210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c58005d90 tx=0x7f6c58005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:36.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.575+0000 7f6c6be00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] conn(0x7f6c500aeeb0 0x7f6c500b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:36.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.576+0000 7f6c6be00700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] conn(0x7f6c500aeeb0 0x7f6c500b1350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:36.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.578+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== osd.11 v2:172.21.15.186:6824/25472290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c5c009030 con 0x7f6c500aeeb0 2024-04-23T14:49:36.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.597+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 --> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c6c063580 con 0x7f6c500aeeb0 2024-04-23T14:49:36.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c63e00700 1 -- 172.21.15.7:0/3236120802 <== osd.11 v2:172.21.15.186:6824/25472290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6c6c063580 con 0x7f6c500aeeb0 2024-04-23T14:49:36.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] conn(0x7f6c500aeeb0 msgr2=0x7f6c500b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c72200700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] conn(0x7f6c500aeeb0 0x7f6c500b1350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6c500a3d50 msgr2=0x7f6c500a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c72200700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6c500a3d50 0x7f6c500a6210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c58005d90 tx=0x7f6c58005d00 comp rx=0 tx=0).stop 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 msgr2=0x7f6c6c19b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.598+0000 7f6c72200700 1 --2- 172.21.15.7:0/3236120802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c6c074d20 0x7f6c6c19b3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c003ab0 tx=0x7f6c5c003b90 comp rx=0 tx=0).stop 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.599+0000 7f6c6be00700 1 -- 172.21.15.7:0/3236120802 reap_dead start 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.599+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 shutdown_connections 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.599+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 >> 172.21.15.7:0/3236120802 conn(0x7f6c6c079c50 msgr2=0x7f6c6c100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.599+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 shutdown_connections 2024-04-23T14:49:36.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:36.599+0000 7f6c72200700 1 -- 172.21.15.7:0/3236120802 wait complete. 2024-04-23T14:49:37.200 INFO:teuthology.orchestra.run.smithi007.stdout:77309411420 2024-04-23T14:49:37.201 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-23T14:49:37.550 INFO:teuthology.orchestra.run.smithi007.stdout:107374182485 2024-04-23T14:49:37.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-23T14:49:38.080 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:38 smithi007 ceph-mon[27906]: pgmap v408: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:38.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:38 smithi186 ceph-mon[31814]: pgmap v408: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:38.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:38 smithi137 ceph-mon[31694]: pgmap v408: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-23T14:49:38.508 INFO:teuthology.orchestra.run.smithi007.stdout:287762808876 2024-04-23T14:49:38.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 -- 172.21.15.7:0/3654004204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406a800 msgr2=0x7faf3406ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 --2- 172.21.15.7:0/3654004204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406a800 0x7faf3406ac60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf24009990 tx=0x7faf24009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 -- 172.21.15.7:0/3654004204 shutdown_connections 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 --2- 172.21.15.7:0/3654004204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf3406b1a0 0x7faf3410f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 --2- 172.21.15.7:0/3654004204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf34108b70 0x7faf34108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 --2- 172.21.15.7:0/3654004204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406a800 0x7faf3406ac60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 -- 172.21.15.7:0/3654004204 >> 172.21.15.7:0/3654004204 conn(0x7faf340789a0 msgr2=0x7faf34078db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 -- 172.21.15.7:0/3654004204 shutdown_connections 2024-04-23T14:49:39.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.372+0000 7faf3c800700 1 -- 172.21.15.7:0/3654004204 wait complete. 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.374+0000 7faf3c800700 1 Processor -- start 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.374+0000 7faf3c800700 1 -- start start 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3c800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406a800 0x7faf3419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3c800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406b1a0 0x7faf3419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3c800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf34108b70 0x7faf3419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3c800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf34112c80 con 0x7faf3406b1a0 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3c800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf34112b00 con 0x7faf34108b70 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3c800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faf34112e00 con 0x7faf3406a800 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406b1a0 0x7faf3419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406b1a0 0x7faf3419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55058/0 (socket says 172.21.15.7:55058) 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 -- 172.21.15.7:0/3288540682 learned_addr learned my addr 172.21.15.7:0/3288540682 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3a800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf34108b70 0x7faf3419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 -- 172.21.15.7:0/3288540682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406a800 msgr2=0x7faf3419b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39e00700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406a800 0x7faf3419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406a800 0x7faf3419b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 -- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf34108b70 msgr2=0x7faf3419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf34108b70 0x7faf3419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39400700 1 -- 172.21.15.7:0/3288540682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf341a03d0 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf3a800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf34108b70 0x7faf3419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.375+0000 7faf39e00700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406a800 0x7faf3419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.376+0000 7faf39400700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406b1a0 0x7faf3419b950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faf24003ab0 tx=0x7faf24003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.376+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24027070 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.376+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf341a0660 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.376+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf2400bdc0 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.376+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24022d40 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.376+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341a7f40 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.377+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf34063200 con 0x7faf3406b1a0 2024-04-23T14:49:39.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.380+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7faf2402a070 con 0x7faf3406b1a0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.382+0000 7faf2ea00700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf1c0a3cd0 0x7faf1c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.382+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7faf240d21e0 con 0x7faf3406b1a0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.382+0000 7faf39e00700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf1c0a3cd0 0x7faf1c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.382+0000 7faf2ea00700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] conn(0x7faf1c0aee30 0x7faf1c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.382+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 --> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf2400b0b0 con 0x7faf1c0aee30 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.382+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7faf240d2590 con 0x7faf3406b1a0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.383+0000 7faf3a800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] conn(0x7faf1c0aee30 0x7faf1c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.383+0000 7faf39e00700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf1c0a3cd0 0x7faf1c0a6190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf28005e90 tx=0x7faf28005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.384+0000 7faf3a800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] conn(0x7faf1c0aee30 0x7faf1c0b12d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:39.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.386+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== osd.7 v2:172.21.15.137:6816/342014063 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf2400b0b0 con 0x7faf1c0aee30 2024-04-23T14:49:39.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.405+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 --> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf34063630 con 0x7faf1c0aee30 2024-04-23T14:49:39.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.407+0000 7faf2ea00700 1 -- 172.21.15.7:0/3288540682 <== osd.7 v2:172.21.15.137:6816/342014063 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf34063630 con 0x7faf1c0aee30 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.407+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] conn(0x7faf1c0aee30 msgr2=0x7faf1c0b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.407+0000 7faf3c800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] conn(0x7faf1c0aee30 0x7faf1c0b12d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.407+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf1c0a3cd0 msgr2=0x7faf1c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.407+0000 7faf3c800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf1c0a3cd0 0x7faf1c0a6190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf28005e90 tx=0x7faf28005d20 comp rx=0 tx=0).stop 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.407+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406b1a0 msgr2=0x7faf3419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.408+0000 7faf3c800700 1 --2- 172.21.15.7:0/3288540682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406b1a0 0x7faf3419b950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faf24003ab0 tx=0x7faf24003b90 comp rx=0 tx=0).stop 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.408+0000 7faf3a800700 1 -- 172.21.15.7:0/3288540682 reap_dead start 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.408+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 shutdown_connections 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.408+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 >> 172.21.15.7:0/3288540682 conn(0x7faf340789a0 msgr2=0x7faf3410dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.408+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 shutdown_connections 2024-04-23T14:49:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.408+0000 7faf3c800700 1 -- 172.21.15.7:0/3288540682 wait complete. 2024-04-23T14:49:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.248+0000 7f8f1aa00700 1 -- 172.21.15.7:0/4243415942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f141033e0 msgr2=0x7f8f1410f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.248+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/4243415942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f141033e0 0x7f8f1410f8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00b0a0 tx=0x7f8f0c00b3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 -- 172.21.15.7:0/4243415942 shutdown_connections 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/4243415942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f141033e0 0x7f8f1410f8f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/4243415942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f14108a20 0x7f8f14108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/4243415942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f14102a20 0x7f8f14102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 -- 172.21.15.7:0/4243415942 >> 172.21.15.7:0/4243415942 conn(0x7f8f140fe570 msgr2=0x7f8f14100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 -- 172.21.15.7:0/4243415942 shutdown_connections 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.249+0000 7f8f1aa00700 1 -- 172.21.15.7:0/4243415942 wait complete. 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.250+0000 7f8f1aa00700 1 Processor -- start 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.250+0000 7f8f1aa00700 1 -- start start 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.250+0000 7f8f1aa00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f14102a20 0x7f8f141990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f1aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f141033e0 0x7f8f14199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f1aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f14108a20 0x7f8f1419d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f1aa00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14112c50 con 0x7f8f14102a20 2024-04-23T14:49:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f1aa00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14112ad0 con 0x7f8f14108a20 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f1aa00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14112dd0 con 0x7f8f141033e0 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f19600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f14102a20 0x7f8f141990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f19600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f14102a20 0x7f8f141990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55036/0 (socket says 172.21.15.7:55036) 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f19600700 1 -- 172.21.15.7:0/1612313307 learned_addr learned my addr 172.21.15.7:0/1612313307 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f18c00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f141033e0 0x7f8f14199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f1a000700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f14108a20 0x7f8f1419d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.251+0000 7f8f19600700 1 -- 172.21.15.7:0/1612313307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f141033e0 msgr2=0x7f8f14199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f19600700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f141033e0 0x7f8f14199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f19600700 1 -- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f14108a20 msgr2=0x7f8f1419d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f19600700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f14108a20 0x7f8f1419d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f19600700 1 -- 172.21.15.7:0/1612313307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1419e0a0 con 0x7f8f14102a20 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f18c00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f141033e0 0x7f8f14199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f19600700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f14102a20 0x7f8f141990e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800d950 tx=0x7f8f0800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08016070 con 0x7f8f14102a20 2024-04-23T14:49:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1419e390 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f08010460 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800f620 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.252+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f141a5c10 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.253+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f14063280 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.256+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f8f08019070 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.257+0000 7f8f12000700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8efc0a3cd0 0x7f8efc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.257+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f8f080d0a70 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.257+0000 7f8f18c00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8efc0a3cd0 0x7f8efc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.258+0000 7f8f12000700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] conn(0x7f8efc0aee30 0x7f8efc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.258+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 --> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8efc0b19a0 con 0x7f8efc0aee30 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.258+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f8f080d0e20 con 0x7f8f14102a20 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.258+0000 7f8f18c00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8efc0a3cd0 0x7f8efc0a6190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f00005950 tx=0x7f8f000058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:39.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.258+0000 7f8f1a000700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] conn(0x7f8efc0aee30 0x7f8efc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.259+0000 7f8f1a000700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] conn(0x7f8efc0aee30 0x7f8efc0b12d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.262+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== osd.10 v2:172.21.15.137:6824/2931599651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8efc0b19a0 con 0x7f8efc0aee30 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.280+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 --> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f14063680 con 0x7f8efc0aee30 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.281+0000 7f8f12000700 1 -- 172.21.15.7:0/1612313307 <== osd.10 v2:172.21.15.137:6824/2931599651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8f14063680 con 0x7f8efc0aee30 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] conn(0x7f8efc0aee30 msgr2=0x7f8efc0b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] conn(0x7f8efc0aee30 0x7f8efc0b12d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8efc0a3cd0 msgr2=0x7f8efc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8efc0a3cd0 0x7f8efc0a6190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f00005950 tx=0x7f8f000058e0 comp rx=0 tx=0).stop 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f14102a20 msgr2=0x7f8f141990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1aa00700 1 --2- 172.21.15.7:0/1612313307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f14102a20 0x7f8f141990e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800d950 tx=0x7f8f0800dd10 comp rx=0 tx=0).stop 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.282+0000 7f8f1a000700 1 -- 172.21.15.7:0/1612313307 reap_dead start 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.283+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 shutdown_connections 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.283+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 >> 172.21.15.7:0/1612313307 conn(0x7f8f140fe570 msgr2=0x7f8f140feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.283+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 shutdown_connections 2024-04-23T14:49:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:38.283+0000 7f8f1aa00700 1 -- 172.21.15.7:0/1612313307 wait complete. 2024-04-23T14:49:40.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:40 smithi007 ceph-mon[27906]: pgmap v409: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-23T14:49:40.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:40 smithi186 ceph-mon[31814]: pgmap v409: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-23T14:49:40.369 INFO:teuthology.orchestra.run.smithi007.stdout:309237645349 2024-04-23T14:49:40.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-23T14:49:40.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:40 smithi137 ceph-mon[31694]: pgmap v409: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 -- 172.21.15.7:0/1759393711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd806b1a0 msgr2=0x7f6cd810f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 --2- 172.21.15.7:0/1759393711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd806b1a0 0x7f6cd810f9b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000b0a0 tx=0x7f6cd000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 -- 172.21.15.7:0/1759393711 shutdown_connections 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 --2- 172.21.15.7:0/1759393711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd806b1a0 0x7f6cd810f9b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 --2- 172.21.15.7:0/1759393711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cd8108b70 0x7f6cd8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 --2- 172.21.15.7:0/1759393711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cd806a800 0x7f6cd806ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 -- 172.21.15.7:0/1759393711 >> 172.21.15.7:0/1759393711 conn(0x7f6cd80789a0 msgr2=0x7f6cd8078db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 -- 172.21.15.7:0/1759393711 shutdown_connections 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.485+0000 7f6cdd200700 1 -- 172.21.15.7:0/1759393711 wait complete. 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.486+0000 7f6cdd200700 1 Processor -- start 2024-04-23T14:49:40.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.486+0000 7f6cdd200700 1 -- start start 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cdd200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cd806a800 0x7f6cd8199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cdd200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cd806b1a0 0x7f6cd81996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cdd200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8108b70 0x7f6cd819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cdd200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8112c80 con 0x7f6cd8108b70 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cdd200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8112b00 con 0x7f6cd806a800 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cdd200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8112e00 con 0x7f6cd806b1a0 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8108b70 0x7f6cd819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8108b70 0x7f6cd819da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55070/0 (socket says 172.21.15.7:55070) 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 -- 172.21.15.7:0/718200663 learned_addr learned my addr 172.21.15.7:0/718200663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd5e00700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cd806a800 0x7f6cd8199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd5400700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cd806b1a0 0x7f6cd81996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 -- 172.21.15.7:0/718200663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cd806b1a0 msgr2=0x7f6cd81996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cd806b1a0 0x7f6cd81996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 -- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cd806a800 msgr2=0x7f6cd8199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:40.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.487+0000 7f6cd6800700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cd806a800 0x7f6cd8199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6cd6800700 1 -- 172.21.15.7:0/718200663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd819e180 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6cd5400700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cd806b1a0 0x7f6cd81996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6cd6800700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8108b70 0x7f6cd819da40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000b830 tx=0x7f6cd0004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0021070 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cd0003c00 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0004790 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd819e410 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.488+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd81a5cf0 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.489+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cd8063280 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.492+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f6cd0007a00 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.493+0000 7f6ccea00700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6cbc0a3cd0 0x7f6cbc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.493+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7f6cd00d1f70 con 0x7f6cd8108b70 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.494+0000 7f6cd5e00700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6cbc0a3cd0 0x7f6cbc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.494+0000 7f6ccea00700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] conn(0x7f6cbc0aee30 0x7f6cbc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.494+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 --> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cbc0b19a0 con 0x7f6cbc0aee30 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.494+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f6cd00d2320 con 0x7f6cd8108b70 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.494+0000 7f6cd5e00700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6cbc0a3cd0 0x7f6cbc0a6190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8005950 tx=0x7f6cc80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.495+0000 7f6cd5400700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] conn(0x7f6cbc0aee30 0x7f6cbc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.496+0000 7f6cd5400700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] conn(0x7f6cbc0aee30 0x7f6cbc0b12d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.498+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== osd.1 v2:172.21.15.137:6800/1298672167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cbc0b19a0 con 0x7f6cbc0aee30 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.516+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 --> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cd8063700 con 0x7f6cbc0aee30 2024-04-23T14:49:40.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.517+0000 7f6ccea00700 1 -- 172.21.15.7:0/718200663 <== osd.1 v2:172.21.15.137:6800/1298672167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6cd8063700 con 0x7f6cbc0aee30 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] conn(0x7f6cbc0aee30 msgr2=0x7f6cbc0b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] conn(0x7f6cbc0aee30 0x7f6cbc0b12d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6cbc0a3cd0 msgr2=0x7f6cbc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6cbc0a3cd0 0x7f6cbc0a6190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8005950 tx=0x7f6cc80058e0 comp rx=0 tx=0).stop 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8108b70 msgr2=0x7f6cd819da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 --2- 172.21.15.7:0/718200663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cd8108b70 0x7f6cd819da40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000b830 tx=0x7f6cd0004d90 comp rx=0 tx=0).stop 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cd6800700 1 -- 172.21.15.7:0/718200663 reap_dead start 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 shutdown_connections 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 >> 172.21.15.7:0/718200663 conn(0x7f6cd80789a0 msgr2=0x7f6cd80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 shutdown_connections 2024-04-23T14:49:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:39.518+0000 7f6cdd200700 1 -- 172.21.15.7:0/718200663 wait complete. 2024-04-23T14:49:41.905 INFO:teuthology.orchestra.run.smithi007.stdout:343597383711 2024-04-23T14:49:41.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-23T14:49:41.914 INFO:teuthology.orchestra.run.smithi007.stdout:219043332156 2024-04-23T14:49:41.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-23T14:49:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:42 smithi007 ceph-mon[27906]: pgmap v410: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-04-23T14:49:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:42 smithi186 ceph-mon[31814]: pgmap v410: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-04-23T14:49:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:42 smithi137 ceph-mon[31694]: pgmap v410: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-04-23T14:49:42.978 INFO:teuthology.orchestra.run.smithi007.stdout:55834574950 2024-04-23T14:49:42.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-23T14:49:43.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:43 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-04-23T14:49:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:43 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-04-23T14:49:43.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:43 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-04-23T14:49:43.515 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.517 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.523 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.525 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.536+0000 7f25ae800700 1 -- 172.21.15.7:0/2825521847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a81112d0 msgr2=0x7f25a8109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.536+0000 7f25ae800700 1 --2- 172.21.15.7:0/2825521847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a81112d0 0x7f25a8109af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25a000b0a0 tx=0x7f25a000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.537+0000 7f25ae800700 1 -- 172.21.15.7:0/2825521847 shutdown_connections 2024-04-23T14:49:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.537+0000 7f25ae800700 1 --2- 172.21.15.7:0/2825521847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a811c2d0 0x7f25a811e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.537+0000 7f25ae800700 1 --2- 172.21.15.7:0/2825521847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a81112d0 0x7f25a8109af0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.537+0000 7f25ae800700 1 --2- 172.21.15.7:0/2825521847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25a810a030 0x7f25a810a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.537+0000 7f25ae800700 1 -- 172.21.15.7:0/2825521847 >> 172.21.15.7:0/2825521847 conn(0x7f25a806dc60 msgr2=0x7f25a806e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.539+0000 7f25ae800700 1 -- 172.21.15.7:0/2825521847 shutdown_connections 2024-04-23T14:49:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.539+0000 7f25ae800700 1 -- 172.21.15.7:0/2825521847 wait complete. 2024-04-23T14:49:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.540+0000 7f25ae800700 1 Processor -- start 2024-04-23T14:49:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.540+0000 7f25ae800700 1 -- start start 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25ae800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a810a030 0x7f25a81a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25ae800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25a81112d0 0x7f25a81a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25ae800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a811c2d0 0x7f25a81aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25ae800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8121c30 con 0x7f25a81112d0 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25ae800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8121ab0 con 0x7f25a811c2d0 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25ae800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8121db0 con 0x7f25a810a030 2024-04-23T14:49:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25a6a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25a81112d0 0x7f25a81a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.541+0000 7f25a7e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a811c2d0 0x7f25a81aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.542+0000 7f25a7e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a811c2d0 0x7f25a81aca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:48514/0 (socket says 172.21.15.7:48514) 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.542+0000 7f25a7e00700 1 -- 172.21.15.7:0/2661025072 learned_addr learned my addr 172.21.15.7:0/2661025072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.542+0000 7f25a7400700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a810a030 0x7f25a81a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.542+0000 7f25a7e00700 1 -- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a810a030 msgr2=0x7f25a81a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.542+0000 7f25a7e00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a810a030 0x7f25a81a8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.542+0000 7f25a7e00700 1 -- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25a81112d0 msgr2=0x7f25a81a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.543+0000 7f25a7e00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25a81112d0 0x7f25a81a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.543+0000 7f25a7e00700 1 -- 172.21.15.7:0/2661025072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a81ad190 con 0x7f25a811c2d0 2024-04-23T14:49:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.543+0000 7f25a6a00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25a81112d0 0x7f25a81a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.544+0000 7f25a7e00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a811c2d0 0x7f25a81aca50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2594005950 tx=0x7f259400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.545+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400cbd0 con 0x7f25a811c2d0 2024-04-23T14:49:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.545+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25940044d0 con 0x7f25a811c2d0 2024-04-23T14:49:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.545+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a81ad480 con 0x7f25a811c2d0 2024-04-23T14:49:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.545+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a81b4d00 con 0x7f25a811c2d0 2024-04-23T14:49:43.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.545+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400cbd0 con 0x7f25a811c2d0 2024-04-23T14:49:43.548 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.547+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25a811ac60 con 0x7f25a811c2d0 2024-04-23T14:49:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.553+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f2594004850 con 0x7f25a811c2d0 2024-04-23T14:49:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.556+0000 7f259fe00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f258c0a3ed0 0x7f258c0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.556+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9121+0+0 (secure 0 0 0) 0x7f25940d0ac0 con 0x7f25a811c2d0 2024-04-23T14:49:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.556+0000 7f259fe00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] conn(0x7f258c0af0b0 0x7f258c0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.556+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 --> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f258c0b1c20 con 0x7f258c0af0b0 2024-04-23T14:49:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.556+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f25940d0e70 con 0x7f25a811c2d0 2024-04-23T14:49:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.559+0000 7f25a7400700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f258c0a3ed0 0x7f258c0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.562+0000 7f25a7400700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f258c0a3ed0 0x7f258c0a6390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009e60 tx=0x7f25a000b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.568+0000 7f25a6a00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] conn(0x7f258c0af0b0 0x7f258c0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.569+0000 7f25a6a00700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] conn(0x7f258c0af0b0 0x7f258c0b1550 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:43.571 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:43.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.571+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== osd.8 v2:172.21.15.186:6816/4105017585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f258c0b1c20 con 0x7f258c0af0b0 2024-04-23T14:49:43.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.611+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 --> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25a806f1f0 con 0x7f258c0af0b0 2024-04-23T14:49:43.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.613+0000 7f259fe00700 1 -- 172.21.15.7:0/2661025072 <== osd.8 v2:172.21.15.186:6816/4105017585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25a806f1f0 con 0x7f258c0af0b0 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.613+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] conn(0x7f258c0af0b0 msgr2=0x7f258c0b1550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.613+0000 7f25ae800700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] conn(0x7f258c0af0b0 0x7f258c0b1550 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f258c0a3ed0 msgr2=0x7f258c0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f258c0a3ed0 0x7f258c0a6390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009e60 tx=0x7f25a000b700 comp rx=0 tx=0).stop 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a811c2d0 msgr2=0x7f25a81aca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 --2- 172.21.15.7:0/2661025072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a811c2d0 0x7f25a81aca50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2594005950 tx=0x7f259400ecb0 comp rx=0 tx=0).stop 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25a7e00700 1 -- 172.21.15.7:0/2661025072 reap_dead start 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 shutdown_connections 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 >> 172.21.15.7:0/2661025072 conn(0x7f25a806dc60 msgr2=0x7f25a811a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:43.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 shutdown_connections 2024-04-23T14:49:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:43.616+0000 7f25ae800700 1 -- 172.21.15.7:0/2661025072 wait complete. 2024-04-23T14:49:44.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:44 smithi007 ceph-mon[27906]: pgmap v411: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:49:44.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:44 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-04-23T14:49:44.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:44 smithi007 ceph-mon[27906]: osdmap e92: 12 total, 12 up, 12 in 2024-04-23T14:49:44.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:44 smithi186 ceph-mon[31814]: pgmap v411: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:49:44.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:44 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-04-23T14:49:44.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:44 smithi186 ceph-mon[31814]: osdmap e92: 12 total, 12 up, 12 in 2024-04-23T14:49:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:44 smithi137 ceph-mon[31694]: pgmap v411: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:49:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:44 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-04-23T14:49:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:44 smithi137 ceph-mon[31694]: osdmap e92: 12 total, 12 up, 12 in 2024-04-23T14:49:45.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:45 smithi007 ceph-mon[27906]: osdmap e93: 12 total, 12 up, 12 in 2024-04-23T14:49:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:45 smithi186 ceph-mon[31814]: osdmap e93: 12 total, 12 up, 12 in 2024-04-23T14:49:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:45 smithi137 ceph-mon[31694]: osdmap e93: 12 total, 12 up, 12 in 2024-04-23T14:49:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:46 smithi186 ceph-mon[31814]: pgmap v414: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-04-23T14:49:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:46 smithi137 ceph-mon[31694]: pgmap v414: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-04-23T14:49:46.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:46 smithi007 ceph-mon[27906]: pgmap v414: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-04-23T14:49:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:47 smithi137 ceph-mon[31694]: pgmap v415: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:47.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:47 smithi007 ceph-mon[27906]: pgmap v415: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:47 smithi186 ceph-mon[31814]: pgmap v415: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:253403070518 2024-04-23T14:49:49.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-23T14:49:49.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:49 smithi007 ceph-mon[27906]: pgmap v416: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:49.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:49 smithi137 ceph-mon[31694]: pgmap v416: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:49 smithi186 ceph-mon[31814]: pgmap v416: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 10 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:51.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 -- 172.21.15.7:0/93496021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c107df0 msgr2=0x7faf2c10f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:51.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 --2- 172.21.15.7:0/93496021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c107df0 0x7faf2c10f9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf2400b0a0 tx=0x7faf2400b3b0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 -- 172.21.15.7:0/93496021 shutdown_connections 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 --2- 172.21.15.7:0/93496021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c107df0 0x7faf2c10f9a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 --2- 172.21.15.7:0/93496021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c101580 0x7faf2c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 --2- 172.21.15.7:0/93496021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf2c101f30 0x7faf2c107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 -- 172.21.15.7:0/93496021 >> 172.21.15.7:0/93496021 conn(0x7faf2c076ca0 msgr2=0x7faf2c0770b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 -- 172.21.15.7:0/93496021 shutdown_connections 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.324+0000 7faf31400700 1 -- 172.21.15.7:0/93496021 wait complete. 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.325+0000 7faf31400700 1 Processor -- start 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 -- start start 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf2c101580 0x7faf2c102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 0x7faf2c102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c107df0 0x7faf2c102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c112ca0 con 0x7faf2c101f30 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c112b20 con 0x7faf2c107df0 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf31400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c112e20 con 0x7faf2c101580 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.326+0000 7faf2b400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 0x7faf2c102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 0x7faf2c102a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33442/0 (socket says 172.21.15.7:33442) 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 -- 172.21.15.7:0/2556157209 learned_addr learned my addr 172.21.15.7:0/2556157209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf30a00700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c107df0 0x7faf2c102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2be00700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf2c101580 0x7faf2c102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 -- 172.21.15.7:0/2556157209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf2c101580 msgr2=0x7faf2c102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf2c101580 0x7faf2c102500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 -- 172.21.15.7:0/2556157209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c107df0 msgr2=0x7faf2c102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c107df0 0x7faf2c102f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 -- 172.21.15.7:0/2556157209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c1a7520 con 0x7faf2c101f30 2024-04-23T14:49:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.327+0000 7faf2b400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 0x7faf2c102a40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf1800d980 tx=0x7faf1800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.328+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18017070 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.328+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1a7810 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.328+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf18010460 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.328+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1a7d50 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.328+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18020060 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.329+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2c0697e0 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.331+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7faf18010610 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.333+0000 7faf28c00700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf100a3cd0 0x7faf100a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.333+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7faf180d0a50 con 0x7faf2c101f30 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.333+0000 7faf2be00700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf100a3cd0 0x7faf100a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.334+0000 7faf2be00700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf100a3cd0 0x7faf100a6190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005ea0 tx=0x7faf1c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.340+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faf1809cf50 con 0x7faf2c101f30 2024-04-23T14:49:51.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.580+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7faf2c1a7f20 con 0x7faf2c101f30 2024-04-23T14:49:51.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:51 smithi007 ceph-mon[27906]: pgmap v417: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:51.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.580+0000 7faf28c00700 1 -- 172.21.15.7:0/2556157209 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7faf1809c850 con 0x7faf2c101f30 2024-04-23T14:49:51.581 INFO:teuthology.orchestra.run.smithi007.stdout:309237645351 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf100a3cd0 msgr2=0x7faf100a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf100a3cd0 0x7faf100a6190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005ea0 tx=0x7faf1c005e30 comp rx=0 tx=0).stop 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 msgr2=0x7faf2c102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 0x7faf2c102a40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf1800d980 tx=0x7faf1800dd40 comp rx=0 tx=0).stop 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 shutdown_connections 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7faf100a3cd0 0x7faf100a6190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c107df0 0x7faf2c102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf2c101580 0x7faf2c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 --2- 172.21.15.7:0/2556157209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf2c101f30 0x7faf2c102a40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 >> 172.21.15.7:0/2556157209 conn(0x7faf2c076ca0 msgr2=0x7faf2c0ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:51.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 shutdown_connections 2024-04-23T14:49:51.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:51.584+0000 7faf31400700 1 -- 172.21.15.7:0/2556157209 wait complete. 2024-04-23T14:49:51.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:51 smithi137 ceph-mon[31694]: pgmap v417: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:51 smithi186 ceph-mon[31814]: pgmap v417: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s; 13 B/s, 0 objects/s recovering 2024-04-23T14:49:52.501 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:52 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2556157209' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-23T14:49:52.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:52 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2556157209' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-23T14:49:52.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:52 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2556157209' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-23T14:49:53.502 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:53 smithi007 ceph-mon[27906]: pgmap v418: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s; 12 B/s, 0 objects/s recovering 2024-04-23T14:49:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:53 smithi186 ceph-mon[31814]: pgmap v418: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s; 12 B/s, 0 objects/s recovering 2024-04-23T14:49:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:53 smithi137 ceph-mon[31694]: pgmap v418: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s; 12 B/s, 0 objects/s recovering 2024-04-23T14:49:55.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:55 smithi007 ceph-mon[27906]: pgmap v419: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2024-04-23T14:49:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:55 smithi186 ceph-mon[31814]: pgmap v419: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2024-04-23T14:49:55.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:55 smithi137 ceph-mon[31694]: pgmap v419: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 -- 172.21.15.7:0/3607116289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5810e460 msgr2=0x7f8e58116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 --2- 172.21.15.7:0/3607116289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5810e460 0x7f8e58116030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b0d0 tx=0x7f8e5000b3e0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 -- 172.21.15.7:0/3607116289 shutdown_connections 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 --2- 172.21.15.7:0/3607116289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e5810e460 0x7f8e58116030 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 --2- 172.21.15.7:0/3607116289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e58109380 0x7f8e58109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 --2- 172.21.15.7:0/3607116289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e58109d30 0x7f8e5810dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 -- 172.21.15.7:0/3607116289 >> 172.21.15.7:0/3607116289 conn(0x7f8e580762c0 msgr2=0x7f8e58107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 -- 172.21.15.7:0/3607116289 shutdown_connections 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.475+0000 7f8e5d600700 1 -- 172.21.15.7:0/3607116289 wait complete. 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.476+0000 7f8e5d600700 1 Processor -- start 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.476+0000 7f8e5d600700 1 -- start start 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e5d600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e58109380 0x7f8e581a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e5d600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 0x7f8e581a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e5d600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e5810e460 0x7f8e5819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e5d600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58119350 con 0x7f8e58109d30 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e5d600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581191d0 con 0x7f8e58109380 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e5d600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581194d0 con 0x7f8e5810e460 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e4fe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 0x7f8e581a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.477+0000 7f8e4fe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 0x7f8e581a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37836/0 (socket says 172.21.15.7:37836) 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 -- 172.21.15.7:0/2552809090 learned_addr learned my addr 172.21.15.7:0/2552809090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e56a00700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e58109380 0x7f8e581a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e57400700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e5810e460 0x7f8e5819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 -- 172.21.15.7:0/2552809090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e5810e460 msgr2=0x7f8e5819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e5810e460 0x7f8e5819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 -- 172.21.15.7:0/2552809090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e58109380 msgr2=0x7f8e581a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e58109380 0x7f8e581a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 -- 172.21.15.7:0/2552809090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5819fd10 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.478+0000 7f8e4fe00700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 0x7f8e581a5930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000d980 tx=0x7f8e4000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.479+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40017070 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.479+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e40010460 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.479+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4000de60 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.479+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581a0000 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.479+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e581ac2c0 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.480+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e580697e0 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.482+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f8e40010610 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.484+0000 7f8e4f400700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8e3c0a3d50 0x7f8e3c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.484+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f8e400d03f0 con 0x7f8e58109d30 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.484+0000 7f8e56a00700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8e3c0a3d50 0x7f8e3c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.485+0000 7f8e56a00700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8e3c0a3d50 0x7f8e3c0a6210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005fd0 tx=0x7f8e4800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:57.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.490+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8e4009c8f0 con 0x7f8e58109d30 2024-04-23T14:49:57.667 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:49:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.735+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8e5802dfe0 con 0x7f8e58109d30 2024-04-23T14:49:57.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:57 smithi007 ceph-mon[27906]: pgmap v420: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-04-23T14:49:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.736+0000 7f8e4f400700 1 -- 172.21.15.7:0/2552809090 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e4009c1f0 con 0x7f8e58109d30 2024-04-23T14:49:57.736 INFO:teuthology.orchestra.run.smithi007.stdout:77309411426 2024-04-23T14:49:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.738+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8e3c0a3d50 msgr2=0x7f8e3c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.738+0000 7f8e5d600700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8e3c0a3d50 0x7f8e3c0a6210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005fd0 tx=0x7f8e4800a560 comp rx=0 tx=0).stop 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.738+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 msgr2=0x7f8e581a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.738+0000 7f8e5d600700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 0x7f8e581a5930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000d980 tx=0x7f8e4000dd40 comp rx=0 tx=0).stop 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 shutdown_connections 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f8e3c0a3d50 0x7f8e3c0a6210 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e5810e460 0x7f8e5819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e58109380 0x7f8e581a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 --2- 172.21.15.7:0/2552809090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e58109d30 0x7f8e581a5930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 >> 172.21.15.7:0/2552809090 conn(0x7f8e580762c0 msgr2=0x7f8e58076840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 shutdown_connections 2024-04-23T14:49:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:57.739+0000 7f8e5d600700 1 -- 172.21.15.7:0/2552809090 wait complete. 2024-04-23T14:49:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:57 smithi186 ceph-mon[31814]: pgmap v420: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-04-23T14:49:57.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:57 smithi137 ceph-mon[31694]: pgmap v420: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-04-23T14:49:58.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:58 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2552809090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T14:49:58.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:58 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2552809090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T14:49:58.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:58 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2552809090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T14:49:58.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.856+0000 7f1fc5800700 1 -- 172.21.15.7:0/1257582909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0074d20 msgr2=0x7f1fc0075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.856+0000 7f1fc5800700 1 --2- 172.21.15.7:0/1257582909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0074d20 0x7f1fc0075100 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009990 tx=0x7f1fb0009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 -- 172.21.15.7:0/1257582909 shutdown_connections 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 --2- 172.21.15.7:0/1257582909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 0x7f1fc01160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 --2- 172.21.15.7:0/1257582909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0074d20 0x7f1fc0075100 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 --2- 172.21.15.7:0/1257582909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0075640 0x7f1fc0113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 -- 172.21.15.7:0/1257582909 >> 172.21.15.7:0/1257582909 conn(0x7f1fc0079ca0 msgr2=0x7f1fc007a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 -- 172.21.15.7:0/1257582909 shutdown_connections 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.857+0000 7f1fc5800700 1 -- 172.21.15.7:0/1257582909 wait complete. 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.858+0000 7f1fc5800700 1 Processor -- start 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 -- start start 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0074d20 0x7f1fc01a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 0x7f1fc01a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 0x7f1fc019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01192f0 con 0x7f1fc0075640 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0119170 con 0x7f1fc0113cc0 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.859+0000 7f1fc5800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0119470 con 0x7f1fc0074d20 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0074d20 0x7f1fc01a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbe000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 0x7f1fc01a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbe000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 0x7f1fc01a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37854/0 (socket says 172.21.15.7:37854) 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbe000700 1 -- 172.21.15.7:0/2532215922 learned_addr learned my addr 172.21.15.7:0/2532215922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbea00700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0074d20 0x7f1fc01a5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50632/0 (socket says 172.21.15.7:50632) 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbf400700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 0x7f1fc019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbe000700 1 -- 172.21.15.7:0/2532215922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0074d20 msgr2=0x7f1fc01a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbe000700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0074d20 0x7f1fc01a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.860+0000 7f1fbe000700 1 -- 172.21.15.7:0/2532215922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 msgr2=0x7f1fc019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fbe000700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 0x7f1fc019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fbe000700 1 -- 172.21.15.7:0/2532215922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc019ff10 con 0x7f1fc0075640 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fbf400700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 0x7f1fc019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:49:58.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fbe000700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 0x7f1fc01a5aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e9a0 tx=0x7f1fac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00cbd0 con 0x7f1fc0075640 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1fac00cd70 con 0x7f1fc0075640 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc01a0200 con 0x7f1fc0075640 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.861+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac018680 con 0x7f1fc0075640 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.862+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc01ac4e0 con 0x7f1fc0075640 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.863+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc0076440 con 0x7f1fc0075640 2024-04-23T14:49:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.865+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f1fac010430 con 0x7f1fc0075640 2024-04-23T14:49:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.867+0000 7f1fb7400700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fa40a3d50 0x7f1fa40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.868+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f1fac0d0ac0 con 0x7f1fc0075640 2024-04-23T14:49:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.868+0000 7f1fbea00700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fa40a3d50 0x7f1fa40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.868+0000 7f1fbea00700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fa40a3d50 0x7f1fa40a6210 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0006010 tx=0x7f1fb000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:58.872+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fac09cfc0 con 0x7f1fc0075640 2024-04-23T14:49:59.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.117+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1fc01ac6b0 con 0x7f1fc0075640 2024-04-23T14:49:59.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.118+0000 7f1fb7400700 1 -- 172.21.15.7:0/2532215922 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fac09c8c0 con 0x7f1fc0075640 2024-04-23T14:49:59.118 INFO:teuthology.orchestra.run.smithi007.stdout:34359738480 2024-04-23T14:49:59.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.120+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fa40a3d50 msgr2=0x7f1fa40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.120+0000 7f1fc5800700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fa40a3d50 0x7f1fa40a6210 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0006010 tx=0x7f1fb000b260 comp rx=0 tx=0).stop 2024-04-23T14:49:59.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.120+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 msgr2=0x7f1fc01a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.120+0000 7f1fc5800700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 0x7f1fc01a5aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e9a0 tx=0x7f1fac00ecb0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 shutdown_connections 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fa40a3d50 0x7f1fa40a6210 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fc0113cc0 0x7f1fc019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fc0074d20 0x7f1fc01a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 --2- 172.21.15.7:0/2532215922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fc0075640 0x7f1fc01a5aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 >> 172.21.15.7:0/2532215922 conn(0x7f1fc0079ca0 msgr2=0x7f1fc0112b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 shutdown_connections 2024-04-23T14:49:59.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.121+0000 7f1fc5800700 1 -- 172.21.15.7:0/2532215922 wait complete. 2024-04-23T14:49:59.753 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:59 smithi007 ceph-mon[27906]: pgmap v421: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:49:59.754 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:49:59 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2532215922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T14:49:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:59 smithi186 ceph-mon[31814]: pgmap v421: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:49:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:49:59 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2532215922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T14:49:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 -- 172.21.15.7:0/2487805711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec102b40 msgr2=0x7f1dec102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 --2- 172.21.15.7:0/2487805711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec102b40 0x7f1dec102fc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009990 tx=0x7f1dd8009ca0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 -- 172.21.15.7:0/2487805711 shutdown_connections 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 --2- 172.21.15.7:0/2487805711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec103500 0x7f1dec10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 --2- 172.21.15.7:0/2487805711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1dec108b90 0x7f1dec108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 --2- 172.21.15.7:0/2487805711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec102b40 0x7f1dec102fc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 -- 172.21.15.7:0/2487805711 >> 172.21.15.7:0/2487805711 conn(0x7f1dec079c50 msgr2=0x7f1dec07a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 -- 172.21.15.7:0/2487805711 shutdown_connections 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.806+0000 7f1df3400700 1 -- 172.21.15.7:0/2487805711 wait complete. 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.807+0000 7f1df3400700 1 Processor -- start 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 -- start start 2024-04-23T14:49:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1dec102b40 0x7f1dec19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 0x7f1dec19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec108b90 0x7f1dec19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec112cf0 con 0x7f1dec103500 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec112b70 con 0x7f1dec102b40 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1df3400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec112e70 con 0x7f1dec108b90 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1debe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 0x7f1dec19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1debe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 0x7f1dec19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37882/0 (socket says 172.21.15.7:37882) 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.808+0000 7f1debe00700 1 -- 172.21.15.7:0/2663575956 learned_addr learned my addr 172.21.15.7:0/2663575956 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1df0a00700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1dec102b40 0x7f1dec19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1df1400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec108b90 0x7f1dec19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1debe00700 1 -- 172.21.15.7:0/2663575956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec108b90 msgr2=0x7f1dec19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1debe00700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec108b90 0x7f1dec19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1debe00700 1 -- 172.21.15.7:0/2663575956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1dec102b40 msgr2=0x7f1dec19b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1debe00700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1dec102b40 0x7f1dec19b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1debe00700 1 -- 172.21.15.7:0/2663575956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec1a0410 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.809+0000 7f1debe00700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 0x7f1dec19b940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8000c00 tx=0x7f1dd80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.810+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8027070 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.810+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1dd80040c0 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.810+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dec1a06a0 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.810+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800f460 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.810+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dec1a7f80 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.811+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dec1041f0 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.813+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f1dd802a070 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.815+0000 7f1de9600700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1dd40a3cd0 0x7f1dd40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.815+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f1dd80d19b0 con 0x7f1dec103500 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.815+0000 7f1df0a00700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1dd40a3cd0 0x7f1dd40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.816+0000 7f1df0a00700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1dd40a3cd0 0x7f1dd40a6190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1de0007700 tx=0x7f1de0007690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.819+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1dd805eff0 con 0x7f1dec103500 2024-04-23T14:49:59.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:59 smithi137 ceph-mon[31694]: pgmap v421: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:49:59.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:49:59 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2532215922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T14:50:00.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.058+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1dec1a8150 con 0x7f1dec103500 2024-04-23T14:50:00.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.059+0000 7f1de9600700 1 -- 172.21.15.7:0/2663575956 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1dd8013070 con 0x7f1dec103500 2024-04-23T14:50:00.059 INFO:teuthology.orchestra.run.smithi007.stdout:163208757327 2024-04-23T14:50:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1dd40a3cd0 msgr2=0x7f1dd40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1dd40a3cd0 0x7f1dd40a6190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1de0007700 tx=0x7f1de0007690 comp rx=0 tx=0).stop 2024-04-23T14:50:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 msgr2=0x7f1dec19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 0x7f1dec19b940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8000c00 tx=0x7f1dd80047b0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 shutdown_connections 2024-04-23T14:50:00.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1dd40a3cd0 0x7f1dd40a6190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec108b90 0x7f1dec19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1dec102b40 0x7f1dec19b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 --2- 172.21.15.7:0/2663575956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1dec103500 0x7f1dec19b940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.062+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 >> 172.21.15.7:0/2663575956 conn(0x7f1dec079c50 msgr2=0x7f1dec101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.064+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 shutdown_connections 2024-04-23T14:50:00.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:00.064+0000 7f1df3400700 1 -- 172.21.15.7:0/2663575956 wait complete. 2024-04-23T14:50:00.296 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645349 got 309237645351 for osd.10 2024-04-23T14:50:00.296 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:00.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:00 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3023573048' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-23T14:50:00.766 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T14:50:00.766 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:00 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2663575956' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T14:50:00.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:00 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3023573048' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-23T14:50:00.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T14:50:00.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:00 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2663575956' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T14:50:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:00 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3023573048' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-23T14:50:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T14:50:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:00 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2663575956' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T14:50:00.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 -- 172.21.15.7:0/3685787487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 msgr2=0x7fa784111c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 --2- 172.21.15.7:0/3685787487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa784111c20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00b0d0 tx=0x7fa77c00b3e0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 -- 172.21.15.7:0/3685787487 shutdown_connections 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 --2- 172.21.15.7:0/3685787487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa784111c20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 --2- 172.21.15.7:0/3685787487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa784104f70 0x7fa784105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 --2- 172.21.15.7:0/3685787487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784105920 0x7fa784109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.622+0000 7fa789e00700 1 -- 172.21.15.7:0/3685787487 >> 172.21.15.7:0/3685787487 conn(0x7fa784100800 msgr2=0x7fa784102c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.623+0000 7fa789e00700 1 -- 172.21.15.7:0/3685787487 shutdown_connections 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.623+0000 7fa789e00700 1 -- 172.21.15.7:0/3685787487 wait complete. 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 Processor -- start 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 -- start start 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784104f70 0x7fa78419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa784105920 0x7fa78419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa78419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa784114f60 con 0x7fa78410a050 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa784114de0 con 0x7fa784105920 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.624+0000 7fa789e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841150e0 con 0x7fa784104f70 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa78419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa78419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37862/0 (socket says 172.21.15.7:37862) 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 -- 172.21.15.7:0/3023573048 learned_addr learned my addr 172.21.15.7:0/3023573048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa782a00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784104f70 0x7fa78419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa782000700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa784105920 0x7fa78419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 -- 172.21.15.7:0/3023573048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784104f70 msgr2=0x7fa78419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784104f70 0x7fa78419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 -- 172.21.15.7:0/3023573048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa784105920 msgr2=0x7fa78419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa784105920 0x7fa78419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa783400700 1 -- 172.21.15.7:0/3023573048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7841a0380 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.625+0000 7fa782a00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784104f70 0x7fa78419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.626+0000 7fa783400700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa78419fc40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00d010 tx=0x7fa77c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.626+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c01f070 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.626+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa77c003c00 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.626+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c01b6a0 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.626+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7841a0610 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.626+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7841a7ef0 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.627+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa784106450 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.629+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fa77c022070 con 0x7fa78410a050 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.631+0000 7fa788a00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7680a3cd0 0x7fa7680a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.631+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa77c0d16b0 con 0x7fa78410a050 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stdout:343597383715 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.631+0000 7fa782a00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7680a3cd0 0x7fa7680a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.632+0000 7fa782a00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7680a3cd0 0x7fa7680a6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa774005950 tx=0x7fa7740058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.635+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa77c09dbe0 con 0x7fa78410a050 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.882+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa7841a80c0 con 0x7fa78410a050 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.882+0000 7fa788a00700 1 -- 172.21.15.7:0/3023573048 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa77c09d4e0 con 0x7fa78410a050 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7680a3cd0 msgr2=0x7fa7680a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7680a3cd0 0x7fa7680a6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa774005950 tx=0x7fa7740058e0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 msgr2=0x7fa78419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa78419fc40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00d010 tx=0x7fa77c007a50 comp rx=0 tx=0).stop 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 shutdown_connections 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7680a3cd0 0x7fa7680a6190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa78410a050 0x7fa78419fc40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa784104f70 0x7fa78419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 --2- 172.21.15.7:0/3023573048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa784105920 0x7fa78419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.885+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 >> 172.21.15.7:0/3023573048 conn(0x7fa784100800 msgr2=0x7fa784101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.886+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 shutdown_connections 2024-04-23T14:50:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:49:59.886+0000 7fa789e00700 1 -- 172.21.15.7:0/3023573048 wait complete. 2024-04-23T14:50:01.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:01 smithi007 ceph-mon[27906]: pgmap v422: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:01.799 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:01 smithi186 ceph-mon[31814]: pgmap v422: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:01 smithi137 ceph-mon[31694]: pgmap v422: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:02.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411420 got 77309411426 for osd.2 2024-04-23T14:50:02.219 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:02.904 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738474 got 34359738480 for osd.0 2024-04-23T14:50:02.905 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:03.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:03 smithi007 ceph-mon[27906]: pgmap v423: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:03 smithi186 ceph-mon[31814]: pgmap v423: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:03 smithi137 ceph-mon[31694]: pgmap v423: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 -- 172.21.15.7:0/2525741079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 msgr2=0x7f73d810e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 --2- 172.21.15.7:0/2525741079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d810e8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f73d000b0a0 tx=0x7f73d000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 -- 172.21.15.7:0/2525741079 shutdown_connections 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 --2- 172.21.15.7:0/2525741079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d810e8a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 --2- 172.21.15.7:0/2525741079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d8107a60 0x7f73d8107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 --2- 172.21.15.7:0/2525741079 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d81021f0 0x7f73d8102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.761+0000 7f73dde00700 1 -- 172.21.15.7:0/2525741079 >> 172.21.15.7:0/2525741079 conn(0x7f73d8078090 msgr2=0x7f73d80ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.762+0000 7f73dde00700 1 -- 172.21.15.7:0/2525741079 shutdown_connections 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.762+0000 7f73dde00700 1 -- 172.21.15.7:0/2525741079 wait complete. 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.763+0000 7f73dde00700 1 Processor -- start 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.763+0000 7f73dde00700 1 -- start start 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.763+0000 7f73dde00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d81021f0 0x7f73d8199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73dde00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d81996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73dde00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8107a60 0x7f73d819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73dde00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73d8112ce0 con 0x7f73d8102bb0 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73dde00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73d8112b60 con 0x7f73d81021f0 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73dde00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f73d8112e60 con 0x7f73d8107a60 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d81996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d81996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50858/0 (socket says 172.21.15.7:50858) 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 -- 172.21.15.7:0/1003663703 learned_addr learned my addr 172.21.15.7:0/1003663703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6a00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d81021f0 0x7f73d8199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d7400700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8107a60 0x7f73d819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 -- 172.21.15.7:0/1003663703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8107a60 msgr2=0x7f73d819da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8107a60 0x7f73d819da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 -- 172.21.15.7:0/1003663703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d81021f0 msgr2=0x7f73d8199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d81021f0 0x7f73d8199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d6000700 1 -- 172.21.15.7:0/1003663703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d819e180 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.764+0000 7f73d7400700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8107a60 0x7f73d819da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.765+0000 7f73d6000700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d81996b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f73c400d950 tx=0x7f73c400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.765+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4016070 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.765+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d819e470 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.765+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73c4010460 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.765+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d81a5cf0 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.766+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4020060 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.766+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d8103200 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.769+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f73c4019070 con 0x7f73d8102bb0 2024-04-23T14:50:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.770+0000 7f73dca00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73bc0a3cd0 0x7f73bc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.770+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f73c40d0960 con 0x7f73d8102bb0 2024-04-23T14:50:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.770+0000 7f73d6a00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73bc0a3cd0 0x7f73bc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.771+0000 7f73d6a00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73bc0a3cd0 0x7f73bc0a6190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f73c8005950 tx=0x7f73c80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:04.775+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f73c409ce00 con 0x7f73d8102bb0 2024-04-23T14:50:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.012+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f73d802dfe0 con 0x7f73d8102bb0 2024-04-23T14:50:05.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.013+0000 7f73dca00700 1 -- 172.21.15.7:0/1003663703 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f73c409c700 con 0x7f73d8102bb0 2024-04-23T14:50:05.014 INFO:teuthology.orchestra.run.smithi007.stdout:197568495688 2024-04-23T14:50:05.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.016+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73bc0a3cd0 msgr2=0x7f73bc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:05.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.016+0000 7f73dde00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73bc0a3cd0 0x7f73bc0a6190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f73c8005950 tx=0x7f73c80058e0 comp rx=0 tx=0).stop 2024-04-23T14:50:05.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.016+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 msgr2=0x7f73d81996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:05.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.016+0000 7f73dde00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d81996b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f73c400d950 tx=0x7f73c400dd10 comp rx=0 tx=0).stop 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 shutdown_connections 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73bc0a3cd0 0x7f73bc0a6190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8107a60 0x7f73d819da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d81021f0 0x7f73d8199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 --2- 172.21.15.7:0/1003663703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102bb0 0x7f73d81996b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 >> 172.21.15.7:0/1003663703 conn(0x7f73d8078090 msgr2=0x7f73d80ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 shutdown_connections 2024-04-23T14:50:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:05.017+0000 7f73dde00700 1 -- 172.21.15.7:0/1003663703 wait complete. 2024-04-23T14:50:05.659 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:05 smithi007 ceph-mon[27906]: pgmap v424: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:05.659 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1003663703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-23T14:50:05.663 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757321 got 163208757327 for osd.5 2024-04-23T14:50:05.663 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:05 smithi186 ceph-mon[31814]: pgmap v424: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1003663703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-23T14:50:05.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:05 smithi137 ceph-mon[31694]: pgmap v424: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:05.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1003663703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.495+0000 7f8317a00700 1 -- 172.21.15.7:0/3110740606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 msgr2=0x7f8310105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.495+0000 7f8317a00700 1 --2- 172.21.15.7:0/3110740606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f8310105340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f83040099c0 tx=0x7f8304009cd0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 -- 172.21.15.7:0/3110740606 shutdown_connections 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 --2- 172.21.15.7:0/3110740606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f831010a040 0x7f8310111c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 --2- 172.21.15.7:0/3110740606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f8310105340 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 --2- 172.21.15.7:0/3110740606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f8310109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 -- 172.21.15.7:0/3110740606 >> 172.21.15.7:0/3110740606 conn(0x7f83101007f0 msgr2=0x7f8310102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 -- 172.21.15.7:0/3110740606 shutdown_connections 2024-04-23T14:50:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.496+0000 7f8317a00700 1 -- 172.21.15.7:0/3110740606 wait complete. 2024-04-23T14:50:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.497+0000 7f8317a00700 1 Processor -- start 2024-04-23T14:50:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.497+0000 7f8317a00700 1 -- start start 2024-04-23T14:50:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f8317a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f831019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f8317a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f831019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f8317a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f831010a040 0x7f831019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f8317a00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8310114fa0 con 0x7f8310104f60 2024-04-23T14:50:06.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f8317a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8310114e20 con 0x7f8310105910 2024-04-23T14:50:06.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f8317a00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8310115120 con 0x7f831010a040 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.498+0000 7f830fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f831019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f831019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:54044/0 (socket says 172.21.15.7:54044) 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 -- 172.21.15.7:0/3377059041 learned_addr learned my addr 172.21.15.7:0/3377059041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f8315a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f831010a040 0x7f831019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 -- 172.21.15.7:0/3377059041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f831010a040 msgr2=0x7f831019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f831010a040 0x7f831019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 -- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 msgr2=0x7f831019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f8315000700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f831019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f831019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.499+0000 7f830fe00700 1 -- 172.21.15.7:0/3377059041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83101a04c0 con 0x7f8310105910 2024-04-23T14:50:06.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.500+0000 7f8315000700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f831019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:06.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.500+0000 7f830fe00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f831019b9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c8f0 tx=0x7f82fc00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:06.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.500+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc007940 con 0x7f8310105910 2024-04-23T14:50:06.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.501+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83101a07b0 con 0x7f8310105910 2024-04-23T14:50:06.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.501+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82fc00f450 con 0x7f8310105910 2024-04-23T14:50:06.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.501+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83101a8030 con 0x7f8310105910 2024-04-23T14:50:06.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.501+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc018660 con 0x7f8310105910 2024-04-23T14:50:06.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.502+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0005330 con 0x7f8310105910 2024-04-23T14:50:06.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.506+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f82fc007ae0 con 0x7f8310105910 2024-04-23T14:50:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.508+0000 7f830d600700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82f80a3cd0 0x7f82f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.508+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f82fc0d06b0 con 0x7f8310105910 2024-04-23T14:50:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.508+0000 7f8315000700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82f80a3cd0 0x7f82f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.509+0000 7f8315000700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82f80a3cd0 0x7f82f80a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8304009fd0 tx=0x7f8304000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:06.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.525+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f82fc014030 con 0x7f8310105910 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 -- 172.21.15.7:0/439065110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 msgr2=0x7f80a4111940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 --2- 172.21.15.7:0/439065110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a4111940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b0a0 tx=0x7f809c00b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 -- 172.21.15.7:0/439065110 shutdown_connections 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 --2- 172.21.15.7:0/439065110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a4111940 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 --2- 172.21.15.7:0/439065110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80a4074d20 0x7f80a4075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 --2- 172.21.15.7:0/439065110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80a4075640 0x7f80a410f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 -- 172.21.15.7:0/439065110 >> 172.21.15.7:0/439065110 conn(0x7f80a4079c50 msgr2=0x7f80a407a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 -- 172.21.15.7:0/439065110 shutdown_connections 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.353+0000 7f80a8e00700 1 -- 172.21.15.7:0/439065110 wait complete. 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.354+0000 7f80a8e00700 1 Processor -- start 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.354+0000 7f80a8e00700 1 -- start start 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a8e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80a4074d20 0x7f80a419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a8e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80a4075640 0x7f80a419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a8e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a8e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4114f10 con 0x7f80a410f550 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a8e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4114d90 con 0x7f80a4074d20 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a8e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4115090 con 0x7f80a4075640 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.355+0000 7f80a2800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a1e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80a4074d20 0x7f80a419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a419fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50868/0 (socket says 172.21.15.7:50868) 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 -- 172.21.15.7:0/848120890 learned_addr learned my addr 172.21.15.7:0/848120890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 -- 172.21.15.7:0/848120890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80a4075640 msgr2=0x7f80a419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80a4075640 0x7f80a419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 -- 172.21.15.7:0/848120890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80a4074d20 msgr2=0x7f80a419b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80a4074d20 0x7f80a419b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.356+0000 7f80a2800700 1 -- 172.21.15.7:0/848120890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a41a0310 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.357+0000 7f80a2800700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a419fbd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f809c009fd0 tx=0x7f809c004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.357+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c021070 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.357+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f809c003c00 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.357+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a41a05a0 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.357+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c004850 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.358+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a41a7e80 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.359+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a40697e0 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.363+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7f809c007a00 con 0x7f80a410f550 2024-04-23T14:50:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.365+0000 7f809aa00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f80880a3cd0 0x7f80880a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:06.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.366+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f809c00f020 con 0x7f80a410f550 2024-04-23T14:50:06.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.366+0000 7f80a1e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f80880a3cd0 0x7f80880a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:06.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.367+0000 7f80a1e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f80880a3cd0 0x7f80880a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f809400ac50 tx=0x7f809400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:06.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.368+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f809c02a020 con 0x7f80a410f550 2024-04-23T14:50:06.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.643+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f80a41a8050 con 0x7f80a410f550 2024-04-23T14:50:06.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.643+0000 7f809aa00700 1 -- 172.21.15.7:0/848120890 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f809c0a4070 con 0x7f80a410f550 2024-04-23T14:50:06.644 INFO:teuthology.orchestra.run.smithi007.stdout:107374182492 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f80880a3cd0 msgr2=0x7f80880a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f80880a3cd0 0x7f80880a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f809400ac50 tx=0x7f809400a380 comp rx=0 tx=0).stop 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 msgr2=0x7f80a419fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a419fbd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f809c009fd0 tx=0x7f809c004dc0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 shutdown_connections 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f80880a3cd0 0x7f80880a6190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80a410f550 0x7f80a419fbd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80a4074d20 0x7f80a419b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 --2- 172.21.15.7:0/848120890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80a4075640 0x7f80a419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 >> 172.21.15.7:0/848120890 conn(0x7f80a4079c50 msgr2=0x7f80a40ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:06.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 shutdown_connections 2024-04-23T14:50:06.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.646+0000 7f80a8e00700 1 -- 172.21.15.7:0/848120890 wait complete. 2024-04-23T14:50:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.779+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f82f00058f0 con 0x7f8310105910 2024-04-23T14:50:06.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.780+0000 7f830d600700 1 -- 172.21.15.7:0/3377059041 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f82fc09cbb0 con 0x7f8310105910 2024-04-23T14:50:06.780 INFO:teuthology.orchestra.run.smithi007.stdout:141733920853 2024-04-23T14:50:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82f80a3cd0 msgr2=0x7f82f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82f80a3cd0 0x7f82f80a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8304009fd0 tx=0x7f8304000bc0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 msgr2=0x7f831019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:06.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f831019b9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c8f0 tx=0x7f82fc00cc00 comp rx=0 tx=0).stop 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 shutdown_connections 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f82f80a3cd0 0x7f82f80a6190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f831010a040 0x7f831019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8310104f60 0x7f831019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 --2- 172.21.15.7:0/3377059041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8310105910 0x7f831019b9f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 >> 172.21.15.7:0/3377059041 conn(0x7f83101007f0 msgr2=0x7f8310102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 shutdown_connections 2024-04-23T14:50:06.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.784+0000 7f8317a00700 1 -- 172.21.15.7:0/3377059041 wait complete. 2024-04-23T14:50:07.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:07 smithi007 ceph-mon[27906]: pgmap v425: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:07.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:07 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:07.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:07 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:07.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/848120890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T14:50:07.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3377059041' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T14:50:07.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3769928241' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-23T14:50:07.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 -- 172.21.15.7:0/621480260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 msgr2=0x7fd8f4108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/621480260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f4108f70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009990 tx=0x7fd8e8009ca0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 -- 172.21.15.7:0/621480260 shutdown_connections 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/621480260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f4103500 0x7fd8f410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/621480260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f4108f70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/621480260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f4102b40 0x7fd8f4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 -- 172.21.15.7:0/621480260 >> 172.21.15.7:0/621480260 conn(0x7fd8f4079c50 msgr2=0x7fd8f407a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 -- 172.21.15.7:0/621480260 shutdown_connections 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.650+0000 7fd8fbc00700 1 -- 172.21.15.7:0/621480260 wait complete. 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.652+0000 7fd8fbc00700 1 Processor -- start 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.652+0000 7fd8fbc00700 1 -- start start 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.652+0000 7fd8fbc00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f4102b40 0x7fd8f419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.652+0000 7fd8fbc00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f4103500 0x7fd8f419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:07.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.652+0000 7fd8fbc00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8fbc00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4112d70 con 0x7fd8f4108b90 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8fbc00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4112bf0 con 0x7fd8f4102b40 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8fbc00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4112ef0 con 0x7fd8f4103500 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8f9c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8f9c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50942/0 (socket says 172.21.15.7:50942) 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8f9c00700 1 -- 172.21.15.7:0/729173140 learned_addr learned my addr 172.21.15.7:0/729173140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8f3e00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f4103500 0x7fd8f419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.653+0000 7fd8f9200700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f4102b40 0x7fd8f419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f9c00700 1 -- 172.21.15.7:0/729173140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f4103500 msgr2=0x7fd8f419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f9c00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f4103500 0x7fd8f419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f9c00700 1 -- 172.21.15.7:0/729173140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f4102b40 msgr2=0x7fd8f419b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f9c00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f4102b40 0x7fd8f419b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f9c00700 1 -- 172.21.15.7:0/729173140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f41a04c0 con 0x7fd8f4108b90 2024-04-23T14:50:07.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f9c00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f419fd80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00b970 tx=0x7fd8ec00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.654+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00d860 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.655+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f41a07b0 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.655+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd8ec00e430 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.655+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec017660 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.655+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f41a8030 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.656+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f40697e0 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.658+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fd8ec00da00 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.660+0000 7fd8f1600700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8dc0a3cd0 0x7fd8dc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.660+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fd8ec0d0530 con 0x7fd8f4108b90 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.660+0000 7fd8f9200700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8dc0a3cd0 0x7fd8dc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.661+0000 7fd8f9200700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8dc0a3cd0 0x7fd8dc0a6190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8006010 tx=0x7fd8e800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:07.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.664+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd8ec013030 con 0x7fd8f4108b90 2024-04-23T14:50:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:07 smithi186 ceph-mon[31814]: pgmap v425: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:07 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:07 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:07.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/848120890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T14:50:07.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3377059041' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T14:50:07.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3769928241' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-23T14:50:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:07 smithi137 ceph-mon[31694]: pgmap v425: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:07 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:07 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/848120890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T14:50:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3377059041' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T14:50:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3769928241' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-23T14:50:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.948+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd8f41a8230 con 0x7fd8f4108b90 2024-04-23T14:50:07.949 INFO:teuthology.orchestra.run.smithi007.stdout:55834574955 2024-04-23T14:50:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.949+0000 7fd8f1600700 1 -- 172.21.15.7:0/729173140 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8ec09c9d0 con 0x7fd8f4108b90 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.951+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8dc0a3cd0 msgr2=0x7fd8dc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.951+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8dc0a3cd0 0x7fd8dc0a6190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8006010 tx=0x7fd8e800b540 comp rx=0 tx=0).stop 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.951+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 msgr2=0x7fd8f419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.951+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f419fd80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00b970 tx=0x7fd8ec00bc80 comp rx=0 tx=0).stop 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 shutdown_connections 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8dc0a3cd0 0x7fd8dc0a6190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8f4108b90 0x7fd8f419fd80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f4102b40 0x7fd8f419b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 --2- 172.21.15.7:0/729173140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f4103500 0x7fd8f419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 >> 172.21.15.7:0/729173140 conn(0x7fd8f4079c50 msgr2=0x7fd8f41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 shutdown_connections 2024-04-23T14:50:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.952+0000 7fd8fbc00700 1 -- 172.21.15.7:0/729173140 wait complete. 2024-04-23T14:50:08.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920845 got 141733920853 for osd.4 2024-04-23T14:50:08.210 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:08.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:08 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:08.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:08 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:50:08.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:08 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:08.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/729173140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T14:50:08.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1920233833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-23T14:50:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:08 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:08.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:08 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:50:08.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:08 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:08.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/729173140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T14:50:08.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1920233833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-23T14:50:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:08 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:08 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:50:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:08 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:50:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/729173140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T14:50:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1920233833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-23T14:50:09.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495679 got 197568495688 for osd.6 2024-04-23T14:50:09.031 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 -- 172.21.15.7:0/3803092612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0103500 msgr2=0x7fd7c010f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 --2- 172.21.15.7:0/3803092612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0103500 0x7fd7c010f960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800b0a0 tx=0x7fd7b800b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 -- 172.21.15.7:0/3803092612 shutdown_connections 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 --2- 172.21.15.7:0/3803092612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0103500 0x7fd7c010f960 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 --2- 172.21.15.7:0/3803092612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c0108b90 0x7fd7c0108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 --2- 172.21.15.7:0/3803092612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0102b40 0x7fd7c0102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.966+0000 7fd7c7200700 1 -- 172.21.15.7:0/3803092612 >> 172.21.15.7:0/3803092612 conn(0x7fd7c0079c50 msgr2=0x7fd7c007a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.967+0000 7fd7c7200700 1 -- 172.21.15.7:0/3803092612 shutdown_connections 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.967+0000 7fd7c7200700 1 -- 172.21.15.7:0/3803092612 wait complete. 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.968+0000 7fd7c7200700 1 Processor -- start 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.969+0000 7fd7c7200700 1 -- start start 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.969+0000 7fd7c7200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 0x7fd7c019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7c7200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c0103500 0x7fd7c019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:09.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7c7200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0108b90 0x7fd7c019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7c7200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112d10 con 0x7fd7c0102b40 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7c7200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112b90 con 0x7fd7c0108b90 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7c7200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112e90 con 0x7fd7c0103500 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7bfe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 0x7fd7c019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7bfe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 0x7fd7c019b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50970/0 (socket says 172.21.15.7:50970) 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7bfe00700 1 -- 172.21.15.7:0/1920233833 learned_addr learned my addr 172.21.15.7:0/1920233833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.970+0000 7fd7c5200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0108b90 0x7fd7c019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7bf400700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c0103500 0x7fd7c019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7c5200700 1 -- 172.21.15.7:0/1920233833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c0103500 msgr2=0x7fd7c019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7c5200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c0103500 0x7fd7c019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7c5200700 1 -- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 msgr2=0x7fd7c019b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7c5200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 0x7fd7c019b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7c5200700 1 -- 172.21.15.7:0/1920233833 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c01a03d0 con 0x7fd7c0108b90 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.971+0000 7fd7bfe00700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 0x7fd7c019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:50:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.972+0000 7fd7c5200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0108b90 0x7fd7c019fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80062a0 tx=0x7fd7b8004cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.972+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8021070 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.972+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c01a0660 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.972+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7b8007b80 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.973+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b801de60 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.973+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c01a7f40 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.974+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c00697e0 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.979+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7fd7b8024070 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.980+0000 7fd7bcc00700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7a40a3d50 0x7fd7a40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.980+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fd7b80d18d0 con 0x7fd7c0108b90 2024-04-23T14:50:09.324 INFO:teuthology.orchestra.run.smithi007.stdout:287762808883 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.980+0000 7fd7bfe00700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7a40a3d50 0x7fd7a40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.981+0000 7fd7bfe00700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7a40a3d50 0x7fd7a40a6210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00104e0 tx=0x7fd7b000b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.983+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd7b809de00 con 0x7fd7c0108b90 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.238+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd7c01a8110 con 0x7fd7c0108b90 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.239+0000 7fd7bcc00700 1 -- 172.21.15.7:0/1920233833 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd7b809d700 con 0x7fd7c0108b90 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.241+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7a40a3d50 msgr2=0x7fd7a40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.241+0000 7fd7c7200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7a40a3d50 0x7fd7a40a6210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00104e0 tx=0x7fd7b000b480 comp rx=0 tx=0).stop 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.241+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0108b90 msgr2=0x7fd7c019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.241+0000 7fd7c7200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0108b90 0x7fd7c019fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80062a0 tx=0x7fd7b8004cf0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 shutdown_connections 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd7a40a3d50 0x7fd7a40a6210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c0108b90 0x7fd7c019fc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7c0102b40 0x7fd7c019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 --2- 172.21.15.7:0/1920233833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c0103500 0x7fd7c019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 >> 172.21.15.7:0/1920233833 conn(0x7fd7c0079c50 msgr2=0x7fd7c010dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 shutdown_connections 2024-04-23T14:50:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:08.242+0000 7fd7c7200700 1 -- 172.21.15.7:0/1920233833 wait complete. 2024-04-23T14:50:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:09 smithi007 ceph-mon[27906]: pgmap v426: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:09 smithi186 ceph-mon[31814]: pgmap v426: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:10.155 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574950 got 55834574955 for osd.1 2024-04-23T14:50:10.155 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:09 smithi137 ceph-mon[31694]: pgmap v426: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:10.274 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808876 got 287762808883 for osd.9 2024-04-23T14:50:10.274 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 -- 172.21.15.7:0/3518573034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f410f4f0 msgr2=0x7ff1f41118e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3518573034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f410f4f0 0x7ff1f41118e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b0a0 tx=0x7ff1ec00b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 -- 172.21.15.7:0/3518573034 shutdown_connections 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3518573034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f410f4f0 0x7ff1f41118e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3518573034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f4074d20 0x7ff1f4075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3518573034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4075640 0x7ff1f410efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 -- 172.21.15.7:0/3518573034 >> 172.21.15.7:0/3518573034 conn(0x7ff1f4079ca0 msgr2=0x7ff1f407a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 -- 172.21.15.7:0/3518573034 shutdown_connections 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.945+0000 7ff1fb600700 1 -- 172.21.15.7:0/3518573034 wait complete. 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.946+0000 7ff1fb600700 1 Processor -- start 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 -- start start 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4074d20 0x7ff1f419b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 0x7ff1f419b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f410f4f0 0x7ff1f419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4114f20 con 0x7ff1f4075640 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4114da0 con 0x7ff1f4074d20 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.947+0000 7ff1fb600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41150a0 con 0x7ff1f410f4f0 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 0x7ff1f419b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 0x7ff1f419b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50914/0 (socket says 172.21.15.7:50914) 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 -- 172.21.15.7:0/3769928241 learned_addr learned my addr 172.21.15.7:0/3769928241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1f8c00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4074d20 0x7ff1f419b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1f9600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f410f4f0 0x7ff1f419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 -- 172.21.15.7:0/3769928241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f410f4f0 msgr2=0x7ff1f419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f410f4f0 0x7ff1f419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 -- 172.21.15.7:0/3769928241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4074d20 msgr2=0x7ff1f419b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4074d20 0x7ff1f419b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1ebe00700 1 -- 172.21.15.7:0/3769928241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f41a0400 con 0x7ff1f4075640 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1f9600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f410f4f0 0x7ff1f419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.948+0000 7ff1f8c00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4074d20 0x7ff1f419b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.949+0000 7ff1ebe00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 0x7ff1f419b930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00e9a0 tx=0x7ff1dc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:10.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.949+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00cbd0 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.949+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1dc00cd70 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.949+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f41a06f0 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.949+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc018750 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.949+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f41a7f70 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.950+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f40697e0 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.954+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138696+0+0 (secure 0 0 0) 0x7ff1dc010430 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.956+0000 7ff1f2000700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff1d80a3cd0 0x7ff1d80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.956+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7ff1dc0d0be0 con 0x7ff1f4075640 2024-04-23T14:50:10.347 INFO:teuthology.orchestra.run.smithi007.stdout:219043332161 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.956+0000 7ff1f8c00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff1d80a3cd0 0x7ff1d80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.958+0000 7ff1f8c00700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff1d80a3cd0 0x7ff1d80a6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009cb0 tx=0x7ff1e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:06.961+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff1dc09d080 con 0x7ff1f4075640 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.199+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff1f402dfe0 con 0x7ff1f4075640 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.199+0000 7ff1f2000700 1 -- 172.21.15.7:0/3769928241 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff1dc09c980 con 0x7ff1f4075640 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff1d80a3cd0 msgr2=0x7ff1d80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff1d80a3cd0 0x7ff1d80a6190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009cb0 tx=0x7ff1e4009260 comp rx=0 tx=0).stop 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 msgr2=0x7ff1f419b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 0x7ff1f419b930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00e9a0 tx=0x7ff1dc00ed60 comp rx=0 tx=0).stop 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 shutdown_connections 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff1d80a3cd0 0x7ff1d80a6190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f410f4f0 0x7ff1f419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1f4074d20 0x7ff1f419b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 --2- 172.21.15.7:0/3769928241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1f4075640 0x7ff1f419b930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:10.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.203+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 >> 172.21.15.7:0/3769928241 conn(0x7ff1f4079ca0 msgr2=0x7ff1f40ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:10.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.204+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 shutdown_connections 2024-04-23T14:50:10.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:07.204+0000 7ff1fb600700 1 -- 172.21.15.7:0/3769928241 wait complete. 2024-04-23T14:50:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:11.062 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332156 got 219043332161 for osd.7 2024-04-23T14:50:11.062 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:11.399 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383711 got 343597383715 for osd.11 2024-04-23T14:50:11.399 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:11.892 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182485 got 107374182492 for osd.3 2024-04-23T14:50:11.892 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:12.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:11 smithi007 ceph-mon[27906]: pgmap v427: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:11 smithi186 ceph-mon[31814]: pgmap v427: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:12.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:11 smithi137 ceph-mon[31694]: pgmap v427: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:13.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:13 smithi007 ceph-mon[27906]: pgmap v428: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:13.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:13 smithi007 ceph-mon[27906]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-04-23T14:50:14.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:13 smithi186 ceph-mon[31814]: pgmap v428: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:14.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:13 smithi186 ceph-mon[31814]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-04-23T14:50:14.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:13 smithi137 ceph-mon[31694]: pgmap v428: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:14.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:13 smithi137 ceph-mon[31694]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.245+0000 7fcfece00700 1 -- 172.21.15.7:0/3301792217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe810d080 msgr2=0x7fcfe810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.245+0000 7fcfece00700 1 --2- 172.21.15.7:0/3301792217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe810d080 0x7fcfe810f540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000b0a0 tx=0x7fcfe000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 -- 172.21.15.7:0/3301792217 shutdown_connections 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 --2- 172.21.15.7:0/3301792217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe810d080 0x7fcfe810f540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 --2- 172.21.15.7:0/3301792217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe8103c50 0x7fcfe8104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 --2- 172.21.15.7:0/3301792217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfe8104570 0x7fcfe810ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 -- 172.21.15.7:0/3301792217 >> 172.21.15.7:0/3301792217 conn(0x7fcfe80fd4a0 msgr2=0x7fcfe80ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 -- 172.21.15.7:0/3301792217 shutdown_connections 2024-04-23T14:50:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.246+0000 7fcfece00700 1 -- 172.21.15.7:0/3301792217 wait complete. 2024-04-23T14:50:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 Processor -- start 2024-04-23T14:50:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 -- start start 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfe8103c50 0x7fcfe819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 0x7fcfe819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe810d080 0x7fcfe819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8112cc0 con 0x7fcfe8104570 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8112b40 con 0x7fcfe810d080 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.248+0000 7fcfece00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8112e40 con 0x7fcfe8103c50 2024-04-23T14:50:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 0x7fcfe819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:14.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 0x7fcfe819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42560/0 (socket says 172.21.15.7:42560) 2024-04-23T14:50:14.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 -- 172.21.15.7:0/1938094309 learned_addr learned my addr 172.21.15.7:0/1938094309 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe7400700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfe8103c50 0x7fcfe819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe7e00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe810d080 0x7fcfe819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 -- 172.21.15.7:0/1938094309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfe8103c50 msgr2=0x7fcfe819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfe8103c50 0x7fcfe819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 -- 172.21.15.7:0/1938094309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe810d080 msgr2=0x7fcfe819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe810d080 0x7fcfe819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.249+0000 7fcfe6a00700 1 -- 172.21.15.7:0/1938094309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe81a02a0 con 0x7fcfe8104570 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.250+0000 7fcfe6a00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 0x7fcfe819b7d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c970 tx=0x7fcfd400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.250+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4007b00 con 0x7fcfe8104570 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.250+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfd400ce50 con 0x7fcfe8104570 2024-04-23T14:50:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.250+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe81a0590 con 0x7fcfe8104570 2024-04-23T14:50:14.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.250+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4018660 con 0x7fcfe8104570 2024-04-23T14:50:14.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.250+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe81a7e10 con 0x7fcfe8104570 2024-04-23T14:50:14.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.252+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe80697e0 con 0x7fcfe8104570 2024-04-23T14:50:14.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.254+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fcfd400f450 con 0x7fcfe8104570 2024-04-23T14:50:14.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.255+0000 7fcfdfe00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcfcc0a3c40 0x7fcfcc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:14.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.255+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fcfd40d0780 con 0x7fcfe8104570 2024-04-23T14:50:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.255+0000 7fcfe7400700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcfcc0a3c40 0x7fcfcc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.256+0000 7fcfe7400700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcfcc0a3c40 0x7fcfcc0a6100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8005ea0 tx=0x7fcfd8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:14.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.259+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcfd4014030 con 0x7fcfe8104570 2024-04-23T14:50:14.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.491+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fcfe81a7fe0 con 0x7fcfe8104570 2024-04-23T14:50:14.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.492+0000 7fcfdfe00700 1 -- 172.21.15.7:0/1938094309 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcfd409cd80 con 0x7fcfe8104570 2024-04-23T14:50:14.493 INFO:teuthology.orchestra.run.smithi007.stdout:253403070523 2024-04-23T14:50:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcfcc0a3c40 msgr2=0x7fcfcc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:14.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcfcc0a3c40 0x7fcfcc0a6100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8005ea0 tx=0x7fcfd8005e30 comp rx=0 tx=0).stop 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 msgr2=0x7fcfe819b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 0x7fcfe819b7d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c970 tx=0x7fcfd400cd30 comp rx=0 tx=0).stop 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 shutdown_connections 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcfcc0a3c40 0x7fcfcc0a6100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe810d080 0x7fcfe819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfe8103c50 0x7fcfe819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 --2- 172.21.15.7:0/1938094309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfe8104570 0x7fcfe819b7d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:14.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 >> 172.21.15.7:0/1938094309 conn(0x7fcfe80fd4a0 msgr2=0x7fcfe810f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 shutdown_connections 2024-04-23T14:50:14.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:14.495+0000 7fcfece00700 1 -- 172.21.15.7:0/1938094309 wait complete. 2024-04-23T14:50:15.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:14 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1938094309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-23T14:50:15.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:14 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1938094309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-23T14:50:15.316 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070518 got 253403070523 for osd.8 2024-04-23T14:50:15.316 DEBUG:teuthology.parallel:result is None 2024-04-23T14:50:15.316 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-23T14:50:15.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-23T14:50:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:14 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1938094309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-23T14:50:15.783 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:16.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:15 smithi007 ceph-mon[27906]: pgmap v429: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:16.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:15 smithi137 ceph-mon[31694]: pgmap v429: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:16.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:15 smithi186 ceph-mon[31814]: pgmap v429: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 -- 172.21.15.7:0/1001191693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 msgr2=0x7f48ac116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 --2- 172.21.15.7:0/1001191693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac116030 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48a400b0d0 tx=0x7f48a400b3e0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 -- 172.21.15.7:0/1001191693 shutdown_connections 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 --2- 172.21.15.7:0/1001191693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac116030 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 --2- 172.21.15.7:0/1001191693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48ac109380 0x7f48ac109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 --2- 172.21.15.7:0/1001191693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 0x7f48ac10dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 -- 172.21.15.7:0/1001191693 >> 172.21.15.7:0/1001191693 conn(0x7f48ac0762c0 msgr2=0x7f48ac107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 -- 172.21.15.7:0/1001191693 shutdown_connections 2024-04-23T14:50:18.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.018+0000 7f48b3000700 1 -- 172.21.15.7:0/1001191693 wait complete. 2024-04-23T14:50:18.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.019+0000 7f48b3000700 1 Processor -- start 2024-04-23T14:50:18.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.019+0000 7f48b3000700 1 -- start start 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b3000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48ac109380 0x7f48ac1a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b3000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 0x7f48ac1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b3000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b3000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac119350 con 0x7f48ac10e460 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b3000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1191d0 con 0x7f48ac109d30 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b3000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1194d0 con 0x7f48ac109380 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b1000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b1000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac19f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42572/0 (socket says 172.21.15.7:42572) 2024-04-23T14:50:18.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48b1000700 1 -- 172.21.15.7:0/717448887 learned_addr learned my addr 172.21.15.7:0/717448887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.020+0000 7f48abe00700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48ac109380 0x7f48ac1a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b1000700 1 -- 172.21.15.7:0/717448887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48ac109380 msgr2=0x7f48ac1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48ab400700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 0x7f48ac1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b1000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48ac109380 0x7f48ac1a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b1000700 1 -- 172.21.15.7:0/717448887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 msgr2=0x7f48ac1a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b1000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 0x7f48ac1a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b1000700 1 -- 172.21.15.7:0/717448887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac19fd70 con 0x7f48ac10e460 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48ab400700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 0x7f48ac1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b1000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac19f610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f48a400d010 tx=0x7f48a4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a401f070 con 0x7f48ac10e460 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48a4003c00 con 0x7f48ac10e460 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a401b6a0 con 0x7f48ac10e460 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.021+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac1a0000 con 0x7f48ac10e460 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.022+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1ac320 con 0x7f48ac10e460 2024-04-23T14:50:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.023+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ac10a860 con 0x7f48ac10e460 2024-04-23T14:50:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.025+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f48a4022070 con 0x7f48ac10e460 2024-04-23T14:50:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.026+0000 7f48a8c00700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48900a3cc0 0x7f48900a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.026+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f48a400f020 con 0x7f48ac10e460 2024-04-23T14:50:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.027+0000 7f48abe00700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48900a3cc0 0x7f48900a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.027+0000 7f48abe00700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48900a3cc0 0x7f48900a6180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f489c005950 tx=0x7f489c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.031+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f48a4029020 con 0x7f48ac10e460 2024-04-23T14:50:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:17 smithi137 ceph-mon[31694]: pgmap v430: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:18.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.257+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48ac062f30 con 0x7f48900a3cc0 2024-04-23T14:50:18.259 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:17 smithi007 ceph-mon[27906]: pgmap v430: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:18.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.293+0000 7f48a8c00700 1 -- 172.21.15.7:0/717448887 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340670 (secure 0 0 0) 0x7f48ac062f30 con 0x7f48900a3cc0 2024-04-23T14:50:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48900a3cc0 msgr2=0x7f48900a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48900a3cc0 0x7f48900a6180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f489c005950 tx=0x7f489c0058e0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 msgr2=0x7f48ac19f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac19f610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f48a400d010 tx=0x7f48a4007a50 comp rx=0 tx=0).stop 2024-04-23T14:50:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 shutdown_connections 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48900a3cc0 0x7f48900a6180 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48ac10e460 0x7f48ac19f610 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48ac109380 0x7f48ac1a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 --2- 172.21.15.7:0/717448887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac109d30 0x7f48ac1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.302+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 >> 172.21.15.7:0/717448887 conn(0x7f48ac0762c0 msgr2=0x7f48ac076840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.303+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 shutdown_connections 2024-04-23T14:50:18.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:18.303+0000 7f48b3000700 1 -- 172.21.15.7:0/717448887 wait complete. 2024-04-23T14:50:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-23T14:50:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:17 smithi186 ceph-mon[31814]: pgmap v430: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:19.129 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-04-23T14:50:16.360864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662011,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":984,"num_read_kb":624,"num_write":433,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":803,"ondisk_log_size":803,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372112,"kb_used_data":14624,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124569712,"statfs":{"total":1151940427776,"available":1151559385088,"internally_reserved":0,"allocated":14974976,"data_stored":8195597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":72,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004626"},"pg_stats":[{"pgid":"3.3f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327446+0000","last_change":"2024-04-23T14:48:24.207434+0000","last_active":"2024-04-23T14:50:12.327446+0000","last_peered":"2024-04-23T14:50:12.327446+0000","last_clean":"2024-04-23T14:50:12.327446+0000","last_became_active":"2024-04-23T14:48:24.204367+0000","last_became_peered":"2024-04-23T14:48:24.204367+0000","last_unstale":"2024-04-23T14:50:12.327446+0000","last_undegraded":"2024-04-23T14:50:12.327446+0000","last_fullsized":"2024-04-23T14:50:12.327446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:50.125997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314312+0000","last_change":"2024-04-23T14:48:24.207435+0000","last_active":"2024-04-23T14:50:12.314312+0000","last_peered":"2024-04-23T14:50:12.314312+0000","last_clean":"2024-04-23T14:50:12.314312+0000","last_became_active":"2024-04-23T14:48:24.207086+0000","last_became_peered":"2024-04-23T14:48:24.207086+0000","last_unstale":"2024-04-23T14:50:12.314312+0000","last_undegraded":"2024-04-23T14:50:12.314312+0000","last_fullsized":"2024-04-23T14:50:12.314312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:53:39.864396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323553+0000","last_change":"2024-04-23T14:48:24.208293+0000","last_active":"2024-04-23T14:50:12.323553+0000","last_peered":"2024-04-23T14:50:12.323553+0000","last_clean":"2024-04-23T14:50:12.323553+0000","last_became_active":"2024-04-23T14:48:24.207935+0000","last_became_peered":"2024-04-23T14:48:24.207935+0000","last_unstale":"2024-04-23T14:50:12.323553+0000","last_undegraded":"2024-04-23T14:50:12.323553+0000","last_fullsized":"2024-04-23T14:50:12.323553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:26.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.302551+0000","last_change":"2024-04-23T14:48:24.201916+0000","last_active":"2024-04-23T14:50:12.302551+0000","last_peered":"2024-04-23T14:50:12.302551+0000","last_clean":"2024-04-23T14:50:12.302551+0000","last_became_active":"2024-04-23T14:48:24.201500+0000","last_became_peered":"2024-04-23T14:48:24.201500+0000","last_unstale":"2024-04-23T14:50:12.302551+0000","last_undegraded":"2024-04-23T14:50:12.302551+0000","last_fullsized":"2024-04-23T14:50:12.302551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:02.697609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.305970+0000","last_change":"2024-04-23T14:48:24.210928+0000","last_active":"2024-04-23T14:50:12.305970+0000","last_peered":"2024-04-23T14:50:12.305970+0000","last_clean":"2024-04-23T14:50:12.305970+0000","last_became_active":"2024-04-23T14:48:24.210576+0000","last_became_peered":"2024-04-23T14:48:24.210576+0000","last_unstale":"2024-04-23T14:50:12.305970+0000","last_undegraded":"2024-04-23T14:50:12.305970+0000","last_fullsized":"2024-04-23T14:50:12.305970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:49.662992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.312946+0000","last_change":"2024-04-23T14:48:24.206641+0000","last_active":"2024-04-23T14:50:12.312946+0000","last_peered":"2024-04-23T14:50:12.312946+0000","last_clean":"2024-04-23T14:50:12.312946+0000","last_became_active":"2024-04-23T14:48:24.206298+0000","last_became_peered":"2024-04-23T14:48:24.206298+0000","last_unstale":"2024-04-23T14:50:12.312946+0000","last_undegraded":"2024-04-23T14:50:12.312946+0000","last_fullsized":"2024-04-23T14:50:12.312946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:50.150157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319759+0000","last_change":"2024-04-23T14:48:24.204762+0000","last_active":"2024-04-23T14:50:12.319759+0000","last_peered":"2024-04-23T14:50:12.319759+0000","last_clean":"2024-04-23T14:50:12.319759+0000","last_became_active":"2024-04-23T14:48:24.204396+0000","last_became_peered":"2024-04-23T14:48:24.204396+0000","last_unstale":"2024-04-23T14:50:12.319759+0000","last_undegraded":"2024-04-23T14:50:12.319759+0000","last_fullsized":"2024-04-23T14:50:12.319759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:53.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692482+0000","last_change":"2024-04-23T14:48:24.214064+0000","last_active":"2024-04-23T14:49:44.692482+0000","last_peered":"2024-04-23T14:49:44.692482+0000","last_clean":"2024-04-23T14:49:44.692482+0000","last_became_active":"2024-04-23T14:48:24.213748+0000","last_became_peered":"2024-04-23T14:48:24.213748+0000","last_unstale":"2024-04-23T14:49:44.692482+0000","last_undegraded":"2024-04-23T14:49:44.692482+0000","last_fullsized":"2024-04-23T14:49:44.692482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:52.011095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.326516+0000","last_change":"2024-04-23T14:48:24.196420+0000","last_active":"2024-04-23T14:50:12.326516+0000","last_peered":"2024-04-23T14:50:12.326516+0000","last_clean":"2024-04-23T14:50:12.326516+0000","last_became_active":"2024-04-23T14:48:24.196086+0000","last_became_peered":"2024-04-23T14:48:24.196086+0000","last_unstale":"2024-04-23T14:50:12.326516+0000","last_undegraded":"2024-04-23T14:50:12.326516+0000","last_fullsized":"2024-04-23T14:50:12.326516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:38.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.311336+0000","last_change":"2024-04-23T14:48:24.208801+0000","last_active":"2024-04-23T14:50:12.311336+0000","last_peered":"2024-04-23T14:50:12.311336+0000","last_clean":"2024-04-23T14:50:12.311336+0000","last_became_active":"2024-04-23T14:48:24.208088+0000","last_became_peered":"2024-04-23T14:48:24.208088+0000","last_unstale":"2024-04-23T14:50:12.311336+0000","last_undegraded":"2024-04-23T14:50:12.311336+0000","last_fullsized":"2024-04-23T14:50:12.311336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:30.684820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323636+0000","last_change":"2024-04-23T14:48:24.207387+0000","last_active":"2024-04-23T14:50:12.323636+0000","last_peered":"2024-04-23T14:50:12.323636+0000","last_clean":"2024-04-23T14:50:12.323636+0000","last_became_active":"2024-04-23T14:48:24.205524+0000","last_became_peered":"2024-04-23T14:48:24.205524+0000","last_unstale":"2024-04-23T14:50:12.323636+0000","last_undegraded":"2024-04-23T14:50:12.323636+0000","last_fullsized":"2024-04-23T14:50:12.323636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:24:52.196823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.310419+0000","last_change":"2024-04-23T14:48:24.198132+0000","last_active":"2024-04-23T14:50:12.310419+0000","last_peered":"2024-04-23T14:50:12.310419+0000","last_clean":"2024-04-23T14:50:12.310419+0000","last_became_active":"2024-04-23T14:48:24.197714+0000","last_became_peered":"2024-04-23T14:48:24.197714+0000","last_unstale":"2024-04-23T14:50:12.310419+0000","last_undegraded":"2024-04-23T14:50:12.310419+0000","last_fullsized":"2024-04-23T14:50:12.310419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:41.208307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.312442+0000","last_change":"2024-04-23T14:48:24.205780+0000","last_active":"2024-04-23T14:50:12.312442+0000","last_peered":"2024-04-23T14:50:12.312442+0000","last_clean":"2024-04-23T14:50:12.312442+0000","last_became_active":"2024-04-23T14:48:24.205413+0000","last_became_peered":"2024-04-23T14:48:24.205413+0000","last_unstale":"2024-04-23T14:50:12.312442+0000","last_undegraded":"2024-04-23T14:50:12.312442+0000","last_fullsized":"2024-04-23T14:50:12.312442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:06.002666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314100+0000","last_change":"2024-04-23T14:48:24.205304+0000","last_active":"2024-04-23T14:50:12.314100+0000","last_peered":"2024-04-23T14:50:12.314100+0000","last_clean":"2024-04-23T14:50:12.314100+0000","last_became_active":"2024-04-23T14:48:24.204915+0000","last_became_peered":"2024-04-23T14:48:24.204915+0000","last_unstale":"2024-04-23T14:50:12.314100+0000","last_undegraded":"2024-04-23T14:50:12.314100+0000","last_fullsized":"2024-04-23T14:50:12.314100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:53.835101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314525+0000","last_change":"2024-04-23T14:48:24.208371+0000","last_active":"2024-04-23T14:50:12.314525+0000","last_peered":"2024-04-23T14:50:12.314525+0000","last_clean":"2024-04-23T14:50:12.314525+0000","last_became_active":"2024-04-23T14:48:24.208084+0000","last_became_peered":"2024-04-23T14:48:24.208084+0000","last_unstale":"2024-04-23T14:50:12.314525+0000","last_undegraded":"2024-04-23T14:50:12.314525+0000","last_fullsized":"2024-04-23T14:50:12.314525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:01.263469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323460+0000","last_change":"2024-04-23T14:48:24.204211+0000","last_active":"2024-04-23T14:50:12.323460+0000","last_peered":"2024-04-23T14:50:12.323460+0000","last_clean":"2024-04-23T14:50:12.323460+0000","last_became_active":"2024-04-23T14:48:24.203890+0000","last_became_peered":"2024-04-23T14:48:24.203890+0000","last_unstale":"2024-04-23T14:50:12.323460+0000","last_undegraded":"2024-04-23T14:50:12.323460+0000","last_fullsized":"2024-04-23T14:50:12.323460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:05.730785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327534+0000","last_change":"2024-04-23T14:48:24.204731+0000","last_active":"2024-04-23T14:50:12.327534+0000","last_peered":"2024-04-23T14:50:12.327534+0000","last_clean":"2024-04-23T14:50:12.327534+0000","last_became_active":"2024-04-23T14:48:24.204121+0000","last_became_peered":"2024-04-23T14:48:24.204121+0000","last_unstale":"2024-04-23T14:50:12.327534+0000","last_undegraded":"2024-04-23T14:50:12.327534+0000","last_fullsized":"2024-04-23T14:50:12.327534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:04:57.777924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.325564+0000","last_change":"2024-04-23T14:48:24.208297+0000","last_active":"2024-04-23T14:50:12.325564+0000","last_peered":"2024-04-23T14:50:12.325564+0000","last_clean":"2024-04-23T14:50:12.325564+0000","last_became_active":"2024-04-23T14:48:24.207960+0000","last_became_peered":"2024-04-23T14:48:24.207960+0000","last_unstale":"2024-04-23T14:50:12.325564+0000","last_undegraded":"2024-04-23T14:50:12.325564+0000","last_fullsized":"2024-04-23T14:50:12.325564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:46.393630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.305555+0000","last_change":"2024-04-23T14:48:24.212739+0000","last_active":"2024-04-23T14:50:12.305555+0000","last_peered":"2024-04-23T14:50:12.305555+0000","last_clean":"2024-04-23T14:50:12.305555+0000","last_became_active":"2024-04-23T14:48:24.212259+0000","last_became_peered":"2024-04-23T14:48:24.212259+0000","last_unstale":"2024-04-23T14:50:12.305555+0000","last_undegraded":"2024-04-23T14:50:12.305555+0000","last_fullsized":"2024-04-23T14:50:12.305555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:15:23.268086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692965+0000","last_change":"2024-04-23T14:48:28.692932+0000","last_active":"2024-04-23T14:49:44.692965+0000","last_peered":"2024-04-23T14:49:44.692965+0000","last_clean":"2024-04-23T14:49:44.692965+0000","last_became_active":"2024-04-23T14:48:28.692188+0000","last_became_peered":"2024-04-23T14:48:28.692188+0000","last_unstale":"2024-04-23T14:49:44.692965+0000","last_undegraded":"2024-04-23T14:49:44.692965+0000","last_fullsized":"2024-04-23T14:49:44.692965+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:44.695181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:14.090607+0000","last_change":"2024-04-23T14:48:23.167934+0000","last_active":"2024-04-23T14:50:14.090607+0000","last_peered":"2024-04-23T14:50:14.090607+0000","last_clean":"2024-04-23T14:50:14.090607+0000","last_became_active":"2024-04-23T14:48:23.167483+0000","last_became_peered":"2024-04-23T14:48:23.167483+0000","last_unstale":"2024-04-23T14:50:14.090607+0000","last_undegraded":"2024-04-23T14:50:14.090607+0000","last_fullsized":"2024-04-23T14:50:14.090607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:16.011021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693725+0000","last_change":"2024-04-23T14:48:24.209028+0000","last_active":"2024-04-23T14:49:44.693725+0000","last_peered":"2024-04-23T14:49:44.693725+0000","last_clean":"2024-04-23T14:49:44.693725+0000","last_became_active":"2024-04-23T14:48:24.208648+0000","last_became_peered":"2024-04-23T14:48:24.208648+0000","last_unstale":"2024-04-23T14:49:44.693725+0000","last_undegraded":"2024-04-23T14:49:44.693725+0000","last_fullsized":"2024-04-23T14:49:44.693725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:28:17.432131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692177+0000","last_change":"2024-04-23T14:48:44.011555+0000","last_active":"2024-04-23T14:49:44.692177+0000","last_peered":"2024-04-23T14:49:44.692177+0000","last_clean":"2024-04-23T14:49:44.692177+0000","last_became_active":"2024-04-23T14:48:44.010556+0000","last_became_peered":"2024-04-23T14:48:44.010556+0000","last_unstale":"2024-04-23T14:49:44.692177+0000","last_undegraded":"2024-04-23T14:49:44.692177+0000","last_fullsized":"2024-04-23T14:49:44.692177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:03.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694045+0000","last_change":"2024-04-23T14:48:23.170507+0000","last_active":"2024-04-23T14:49:44.694045+0000","last_peered":"2024-04-23T14:49:44.694045+0000","last_clean":"2024-04-23T14:49:44.694045+0000","last_became_active":"2024-04-23T14:48:23.166478+0000","last_became_peered":"2024-04-23T14:48:23.166478+0000","last_unstale":"2024-04-23T14:49:44.694045+0000","last_undegraded":"2024-04-23T14:49:44.694045+0000","last_fullsized":"2024-04-23T14:49:44.694045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:13.163752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.321779+0000","last_change":"2024-04-23T14:48:24.202716+0000","last_active":"2024-04-23T14:50:12.321779+0000","last_peered":"2024-04-23T14:50:12.321779+0000","last_clean":"2024-04-23T14:50:12.321779+0000","last_became_active":"2024-04-23T14:48:24.201811+0000","last_became_peered":"2024-04-23T14:48:24.201811+0000","last_unstale":"2024-04-23T14:50:12.321779+0000","last_undegraded":"2024-04-23T14:50:12.321779+0000","last_fullsized":"2024-04-23T14:50:12.321779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:12.834493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692433+0000","last_change":"2024-04-23T14:48:28.690956+0000","last_active":"2024-04-23T14:49:44.692433+0000","last_peered":"2024-04-23T14:49:44.692433+0000","last_clean":"2024-04-23T14:49:44.692433+0000","last_became_active":"2024-04-23T14:48:28.689949+0000","last_became_peered":"2024-04-23T14:48:28.689949+0000","last_unstale":"2024-04-23T14:49:44.692433+0000","last_undegraded":"2024-04-23T14:49:44.692433+0000","last_fullsized":"2024-04-23T14:49:44.692433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:57.646314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.104408+0000","last_change":"2024-04-23T14:48:23.175420+0000","last_active":"2024-04-23T14:49:44.104408+0000","last_peered":"2024-04-23T14:49:44.104408+0000","last_clean":"2024-04-23T14:49:44.104408+0000","last_became_active":"2024-04-23T14:48:23.175009+0000","last_became_peered":"2024-04-23T14:48:23.175009+0000","last_unstale":"2024-04-23T14:49:44.104408+0000","last_undegraded":"2024-04-23T14:49:44.104408+0000","last_fullsized":"2024-04-23T14:49:44.104408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:17.902941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327223+0000","last_change":"2024-04-23T14:48:24.197838+0000","last_active":"2024-04-23T14:50:12.327223+0000","last_peered":"2024-04-23T14:50:12.327223+0000","last_clean":"2024-04-23T14:50:12.327223+0000","last_became_active":"2024-04-23T14:48:24.196112+0000","last_became_peered":"2024-04-23T14:48:24.196112+0000","last_unstale":"2024-04-23T14:50:12.327223+0000","last_undegraded":"2024-04-23T14:50:12.327223+0000","last_fullsized":"2024-04-23T14:50:12.327223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:06.829973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692434+0000","last_change":"2024-04-23T14:48:28.691296+0000","last_active":"2024-04-23T14:49:44.692434+0000","last_peered":"2024-04-23T14:49:44.692434+0000","last_clean":"2024-04-23T14:49:44.692434+0000","last_became_active":"2024-04-23T14:48:28.690695+0000","last_became_peered":"2024-04-23T14:48:28.690695+0000","last_unstale":"2024-04-23T14:49:44.692434+0000","last_undegraded":"2024-04-23T14:49:44.692434+0000","last_fullsized":"2024-04-23T14:49:44.692434+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:17.028864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103953+0000","last_change":"2024-04-23T14:48:23.162403+0000","last_active":"2024-04-23T14:49:44.103953+0000","last_peered":"2024-04-23T14:49:44.103953+0000","last_clean":"2024-04-23T14:49:44.103953+0000","last_became_active":"2024-04-23T14:48:23.162010+0000","last_became_peered":"2024-04-23T14:48:23.162010+0000","last_unstale":"2024-04-23T14:49:44.103953+0000","last_undegraded":"2024-04-23T14:49:44.103953+0000","last_fullsized":"2024-04-23T14:49:44.103953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:59.213131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323585+0000","last_change":"2024-04-23T14:48:24.197815+0000","last_active":"2024-04-23T14:50:12.323585+0000","last_peered":"2024-04-23T14:50:12.323585+0000","last_clean":"2024-04-23T14:50:12.323585+0000","last_became_active":"2024-04-23T14:48:24.194153+0000","last_became_peered":"2024-04-23T14:48:24.194153+0000","last_unstale":"2024-04-23T14:50:12.323585+0000","last_undegraded":"2024-04-23T14:50:12.323585+0000","last_fullsized":"2024-04-23T14:50:12.323585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:37:30.113646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693462+0000","last_change":"2024-04-23T14:48:28.693952+0000","last_active":"2024-04-23T14:49:44.693462+0000","last_peered":"2024-04-23T14:49:44.693462+0000","last_clean":"2024-04-23T14:49:44.693462+0000","last_became_active":"2024-04-23T14:48:28.691769+0000","last_became_peered":"2024-04-23T14:48:28.691769+0000","last_unstale":"2024-04-23T14:49:44.693462+0000","last_undegraded":"2024-04-23T14:49:44.693462+0000","last_fullsized":"2024-04-23T14:49:44.693462+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:40:29.883206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'7","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:14.107225+0000","last_change":"2024-04-23T14:48:23.174584+0000","last_active":"2024-04-23T14:50:14.107225+0000","last_peered":"2024-04-23T14:50:14.107225+0000","last_clean":"2024-04-23T14:50:14.107225+0000","last_became_active":"2024-04-23T14:48:23.170982+0000","last_became_peered":"2024-04-23T14:48:23.170982+0000","last_unstale":"2024-04-23T14:50:14.107225+0000","last_undegraded":"2024-04-23T14:50:14.107225+0000","last_fullsized":"2024-04-23T14:50:14.107225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:21.304149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.309477+0000","last_change":"2024-04-23T14:48:24.190360+0000","last_active":"2024-04-23T14:50:12.309477+0000","last_peered":"2024-04-23T14:50:12.309477+0000","last_clean":"2024-04-23T14:50:12.309477+0000","last_became_active":"2024-04-23T14:48:24.188138+0000","last_became_peered":"2024-04-23T14:48:24.188138+0000","last_unstale":"2024-04-23T14:50:12.309477+0000","last_undegraded":"2024-04-23T14:50:12.309477+0000","last_fullsized":"2024-04-23T14:50:12.309477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:55:27.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693378+0000","last_change":"2024-04-23T14:48:28.693859+0000","last_active":"2024-04-23T14:49:44.693378+0000","last_peered":"2024-04-23T14:49:44.693378+0000","last_clean":"2024-04-23T14:49:44.693378+0000","last_became_active":"2024-04-23T14:48:28.693338+0000","last_became_peered":"2024-04-23T14:48:28.693338+0000","last_unstale":"2024-04-23T14:49:44.693378+0000","last_undegraded":"2024-04-23T14:49:44.693378+0000","last_fullsized":"2024-04-23T14:49:44.693378+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:46.176604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092118+0000","last_change":"2024-04-23T14:48:23.173206+0000","last_active":"2024-04-23T14:49:44.092118+0000","last_peered":"2024-04-23T14:49:44.092118+0000","last_clean":"2024-04-23T14:49:44.092118+0000","last_became_active":"2024-04-23T14:48:23.172780+0000","last_became_peered":"2024-04-23T14:48:23.172780+0000","last_unstale":"2024-04-23T14:49:44.092118+0000","last_undegraded":"2024-04-23T14:49:44.092118+0000","last_fullsized":"2024-04-23T14:49:44.092118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:51.870634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322760+0000","last_change":"2024-04-23T14:48:44.010379+0000","last_active":"2024-04-23T14:50:12.322760+0000","last_peered":"2024-04-23T14:50:12.322760+0000","last_clean":"2024-04-23T14:50:12.322760+0000","last_became_active":"2024-04-23T14:48:44.009673+0000","last_became_peered":"2024-04-23T14:48:44.009673+0000","last_unstale":"2024-04-23T14:50:12.322760+0000","last_undegraded":"2024-04-23T14:50:12.322760+0000","last_fullsized":"2024-04-23T14:50:12.322760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:46.552062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.097792+0000","last_change":"2024-04-23T14:48:28.684186+0000","last_active":"2024-04-23T14:49:44.097792+0000","last_peered":"2024-04-23T14:49:44.097792+0000","last_clean":"2024-04-23T14:49:44.097792+0000","last_became_active":"2024-04-23T14:48:28.683109+0000","last_became_peered":"2024-04-23T14:48:28.683109+0000","last_unstale":"2024-04-23T14:49:44.097792+0000","last_undegraded":"2024-04-23T14:49:44.097792+0000","last_fullsized":"2024-04-23T14:49:44.097792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:03.782346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.089722+0000","last_change":"2024-04-23T14:48:23.159599+0000","last_active":"2024-04-23T14:49:44.089722+0000","last_peered":"2024-04-23T14:49:44.089722+0000","last_clean":"2024-04-23T14:49:44.089722+0000","last_became_active":"2024-04-23T14:48:23.158986+0000","last_became_peered":"2024-04-23T14:48:23.158986+0000","last_unstale":"2024-04-23T14:49:44.089722+0000","last_undegraded":"2024-04-23T14:49:44.089722+0000","last_fullsized":"2024-04-23T14:49:44.089722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:00.254987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693235+0000","last_change":"2024-04-23T14:48:24.200644+0000","last_active":"2024-04-23T14:49:44.693235+0000","last_peered":"2024-04-23T14:49:44.693235+0000","last_clean":"2024-04-23T14:49:44.693235+0000","last_became_active":"2024-04-23T14:48:24.200236+0000","last_became_peered":"2024-04-23T14:48:24.200236+0000","last_unstale":"2024-04-23T14:49:44.693235+0000","last_undegraded":"2024-04-23T14:49:44.693235+0000","last_fullsized":"2024-04-23T14:49:44.693235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:51.634416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.102011+0000","last_change":"2024-04-23T14:48:28.699959+0000","last_active":"2024-04-23T14:49:44.102011+0000","last_peered":"2024-04-23T14:49:44.102011+0000","last_clean":"2024-04-23T14:49:44.102011+0000","last_became_active":"2024-04-23T14:48:28.699327+0000","last_became_peered":"2024-04-23T14:48:28.699327+0000","last_unstale":"2024-04-23T14:49:44.102011+0000","last_undegraded":"2024-04-23T14:49:44.102011+0000","last_fullsized":"2024-04-23T14:49:44.102011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:41:32.257355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092341+0000","last_change":"2024-04-23T14:48:23.165179+0000","last_active":"2024-04-23T14:49:44.092341+0000","last_peered":"2024-04-23T14:49:44.092341+0000","last_clean":"2024-04-23T14:49:44.092341+0000","last_became_active":"2024-04-23T14:48:23.164784+0000","last_became_peered":"2024-04-23T14:48:23.164784+0000","last_unstale":"2024-04-23T14:49:44.092341+0000","last_undegraded":"2024-04-23T14:49:44.092341+0000","last_fullsized":"2024-04-23T14:49:44.092341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:02.522867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323284+0000","last_change":"2024-04-23T14:48:24.202092+0000","last_active":"2024-04-23T14:50:12.323284+0000","last_peered":"2024-04-23T14:50:12.323284+0000","last_clean":"2024-04-23T14:50:12.323284+0000","last_became_active":"2024-04-23T14:48:24.200676+0000","last_became_peered":"2024-04-23T14:48:24.200676+0000","last_unstale":"2024-04-23T14:50:12.323284+0000","last_undegraded":"2024-04-23T14:50:12.323284+0000","last_fullsized":"2024-04-23T14:50:12.323284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:55:31.584366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692813+0000","last_change":"2024-04-23T14:48:28.692929+0000","last_active":"2024-04-23T14:49:44.692813+0000","last_peered":"2024-04-23T14:49:44.692813+0000","last_clean":"2024-04-23T14:49:44.692813+0000","last_became_active":"2024-04-23T14:48:28.692405+0000","last_became_peered":"2024-04-23T14:48:28.692405+0000","last_unstale":"2024-04-23T14:49:44.692813+0000","last_undegraded":"2024-04-23T14:49:44.692813+0000","last_fullsized":"2024-04-23T14:49:44.692813+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:13:30.063548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'5","reported_seq":199,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:15.108606+0000","last_change":"2024-04-23T14:48:23.165520+0000","last_active":"2024-04-23T14:50:15.108606+0000","last_peered":"2024-04-23T14:50:15.108606+0000","last_clean":"2024-04-23T14:50:15.108606+0000","last_became_active":"2024-04-23T14:48:23.163725+0000","last_became_peered":"2024-04-23T14:48:23.163725+0000","last_unstale":"2024-04-23T14:50:15.108606+0000","last_undegraded":"2024-04-23T14:50:15.108606+0000","last_fullsized":"2024-04-23T14:50:15.108606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:58.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":164,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.326957+0000","last_change":"2024-04-23T14:48:24.200779+0000","last_active":"2024-04-23T14:50:12.326957+0000","last_peered":"2024-04-23T14:50:12.326957+0000","last_clean":"2024-04-23T14:50:12.326957+0000","last_became_active":"2024-04-23T14:48:24.199391+0000","last_became_peered":"2024-04-23T14:48:24.199391+0000","last_unstale":"2024-04-23T14:50:12.326957+0000","last_undegraded":"2024-04-23T14:50:12.326957+0000","last_fullsized":"2024-04-23T14:50:12.326957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:26.333246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.101654+0000","last_change":"2024-04-23T14:48:28.688860+0000","last_active":"2024-04-23T14:49:44.101654+0000","last_peered":"2024-04-23T14:49:44.101654+0000","last_clean":"2024-04-23T14:49:44.101654+0000","last_became_active":"2024-04-23T14:48:28.688427+0000","last_became_peered":"2024-04-23T14:48:28.688427+0000","last_unstale":"2024-04-23T14:49:44.101654+0000","last_undegraded":"2024-04-23T14:49:44.101654+0000","last_fullsized":"2024-04-23T14:49:44.101654+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:02.196099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694327+0000","last_change":"2024-04-23T14:48:23.170515+0000","last_active":"2024-04-23T14:49:44.694327+0000","last_peered":"2024-04-23T14:49:44.694327+0000","last_clean":"2024-04-23T14:49:44.694327+0000","last_became_active":"2024-04-23T14:48:23.170078+0000","last_became_peered":"2024-04-23T14:48:23.170078+0000","last_unstale":"2024-04-23T14:49:44.694327+0000","last_undegraded":"2024-04-23T14:49:44.694327+0000","last_fullsized":"2024-04-23T14:49:44.694327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:33:52.560319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319388+0000","last_change":"2024-04-23T14:48:24.202989+0000","last_active":"2024-04-23T14:50:12.319388+0000","last_peered":"2024-04-23T14:50:12.319388+0000","last_clean":"2024-04-23T14:50:12.319388+0000","last_became_active":"2024-04-23T14:48:24.202334+0000","last_became_peered":"2024-04-23T14:48:24.202334+0000","last_unstale":"2024-04-23T14:50:12.319388+0000","last_undegraded":"2024-04-23T14:50:12.319388+0000","last_fullsized":"2024-04-23T14:50:12.319388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:48:16.044242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692731+0000","last_change":"2024-04-23T14:48:44.012817+0000","last_active":"2024-04-23T14:49:44.692731+0000","last_peered":"2024-04-23T14:49:44.692731+0000","last_clean":"2024-04-23T14:49:44.692731+0000","last_became_active":"2024-04-23T14:48:44.011680+0000","last_became_peered":"2024-04-23T14:48:44.011680+0000","last_unstale":"2024-04-23T14:49:44.692731+0000","last_undegraded":"2024-04-23T14:49:44.692731+0000","last_fullsized":"2024-04-23T14:49:44.692731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:36.289301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092951+0000","last_change":"2024-04-23T14:48:23.174183+0000","last_active":"2024-04-23T14:49:44.092951+0000","last_peered":"2024-04-23T14:49:44.092951+0000","last_clean":"2024-04-23T14:49:44.092951+0000","last_became_active":"2024-04-23T14:48:23.173345+0000","last_became_peered":"2024-04-23T14:48:23.173345+0000","last_unstale":"2024-04-23T14:49:44.092951+0000","last_undegraded":"2024-04-23T14:49:44.092951+0000","last_fullsized":"2024-04-23T14:49:44.092951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:24.557598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.326373+0000","last_change":"2024-04-23T14:48:24.187891+0000","last_active":"2024-04-23T14:50:12.326373+0000","last_peered":"2024-04-23T14:50:12.326373+0000","last_clean":"2024-04-23T14:50:12.326373+0000","last_became_active":"2024-04-23T14:48:24.187495+0000","last_became_peered":"2024-04-23T14:48:24.187495+0000","last_unstale":"2024-04-23T14:50:12.326373+0000","last_undegraded":"2024-04-23T14:50:12.326373+0000","last_fullsized":"2024-04-23T14:50:12.326373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:54.561153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.102433+0000","last_change":"2024-04-23T14:48:28.690722+0000","last_active":"2024-04-23T14:49:44.102433+0000","last_peered":"2024-04-23T14:49:44.102433+0000","last_clean":"2024-04-23T14:49:44.102433+0000","last_became_active":"2024-04-23T14:48:28.690294+0000","last_became_peered":"2024-04-23T14:48:28.690294+0000","last_unstale":"2024-04-23T14:49:44.102433+0000","last_undegraded":"2024-04-23T14:49:44.102433+0000","last_fullsized":"2024-04-23T14:49:44.102433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:50.657059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'38","reported_seq":240,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:15.115242+0000","last_change":"2024-04-23T14:48:23.164136+0000","last_active":"2024-04-23T14:50:15.115242+0000","last_peered":"2024-04-23T14:50:15.115242+0000","last_clean":"2024-04-23T14:50:15.115242+0000","last_became_active":"2024-04-23T14:48:23.162342+0000","last_became_peered":"2024-04-23T14:48:23.162342+0000","last_unstale":"2024-04-23T14:50:15.115242+0000","last_undegraded":"2024-04-23T14:50:15.115242+0000","last_fullsized":"2024-04-23T14:50:15.115242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:50:50.956006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64455,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":149,"num_write":40,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.317398+0000","last_change":"2024-04-23T14:48:24.199242+0000","last_active":"2024-04-23T14:50:12.317398+0000","last_peered":"2024-04-23T14:50:12.317398+0000","last_clean":"2024-04-23T14:50:12.317398+0000","last_became_active":"2024-04-23T14:48:24.198870+0000","last_became_peered":"2024-04-23T14:48:24.198870+0000","last_unstale":"2024-04-23T14:50:12.317398+0000","last_undegraded":"2024-04-23T14:50:12.317398+0000","last_fullsized":"2024-04-23T14:50:12.317398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:55.824352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.094048+0000","last_change":"2024-04-23T14:48:28.696469+0000","last_active":"2024-04-23T14:49:44.094048+0000","last_peered":"2024-04-23T14:49:44.094048+0000","last_clean":"2024-04-23T14:49:44.094048+0000","last_became_active":"2024-04-23T14:48:28.695973+0000","last_became_peered":"2024-04-23T14:48:28.695973+0000","last_unstale":"2024-04-23T14:49:44.094048+0000","last_undegraded":"2024-04-23T14:49:44.094048+0000","last_fullsized":"2024-04-23T14:49:44.094048+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:34.793357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693448+0000","last_change":"2024-04-23T14:48:23.155889+0000","last_active":"2024-04-23T14:49:44.693448+0000","last_peered":"2024-04-23T14:49:44.693448+0000","last_clean":"2024-04-23T14:49:44.693448+0000","last_became_active":"2024-04-23T14:48:23.155494+0000","last_became_peered":"2024-04-23T14:48:23.155494+0000","last_unstale":"2024-04-23T14:49:44.693448+0000","last_undegraded":"2024-04-23T14:49:44.693448+0000","last_fullsized":"2024-04-23T14:49:44.693448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:14.567618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316964+0000","last_change":"2024-04-23T14:48:24.216976+0000","last_active":"2024-04-23T14:50:12.316964+0000","last_peered":"2024-04-23T14:50:12.316964+0000","last_clean":"2024-04-23T14:50:12.316964+0000","last_became_active":"2024-04-23T14:48:24.216561+0000","last_became_peered":"2024-04-23T14:48:24.216561+0000","last_unstale":"2024-04-23T14:50:12.316964+0000","last_undegraded":"2024-04-23T14:50:12.316964+0000","last_fullsized":"2024-04-23T14:50:12.316964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:40:02.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.097793+0000","last_change":"2024-04-23T14:48:28.684812+0000","last_active":"2024-04-23T14:49:44.097793+0000","last_peered":"2024-04-23T14:49:44.097793+0000","last_clean":"2024-04-23T14:49:44.097793+0000","last_became_active":"2024-04-23T14:48:28.682284+0000","last_became_peered":"2024-04-23T14:48:28.682284+0000","last_unstale":"2024-04-23T14:49:44.097793+0000","last_undegraded":"2024-04-23T14:49:44.097793+0000","last_fullsized":"2024-04-23T14:49:44.097793+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:19.702778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092986+0000","last_change":"2024-04-23T14:48:23.173640+0000","last_active":"2024-04-23T14:49:44.092986+0000","last_peered":"2024-04-23T14:49:44.092986+0000","last_clean":"2024-04-23T14:49:44.092986+0000","last_became_active":"2024-04-23T14:48:23.173259+0000","last_became_peered":"2024-04-23T14:48:23.173259+0000","last_unstale":"2024-04-23T14:49:44.092986+0000","last_undegraded":"2024-04-23T14:49:44.092986+0000","last_fullsized":"2024-04-23T14:49:44.092986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:19.355340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318790+0000","last_change":"2024-04-23T14:48:24.198531+0000","last_active":"2024-04-23T14:50:12.318790+0000","last_peered":"2024-04-23T14:50:12.318790+0000","last_clean":"2024-04-23T14:50:12.318790+0000","last_became_active":"2024-04-23T14:48:24.198217+0000","last_became_peered":"2024-04-23T14:48:24.198217+0000","last_unstale":"2024-04-23T14:50:12.318790+0000","last_undegraded":"2024-04-23T14:50:12.318790+0000","last_fullsized":"2024-04-23T14:50:12.318790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:15:17.130409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103840+0000","last_change":"2024-04-23T14:48:28.690796+0000","last_active":"2024-04-23T14:49:44.103840+0000","last_peered":"2024-04-23T14:49:44.103840+0000","last_clean":"2024-04-23T14:49:44.103840+0000","last_became_active":"2024-04-23T14:48:28.686712+0000","last_became_peered":"2024-04-23T14:48:28.686712+0000","last_unstale":"2024-04-23T14:49:44.103840+0000","last_undegraded":"2024-04-23T14:49:44.103840+0000","last_fullsized":"2024-04-23T14:49:44.103840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:46.769848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:11.111581+0000","last_change":"2024-04-23T14:48:23.171753+0000","last_active":"2024-04-23T14:50:11.111581+0000","last_peered":"2024-04-23T14:50:11.111581+0000","last_clean":"2024-04-23T14:50:11.111581+0000","last_became_active":"2024-04-23T14:48:23.171177+0000","last_became_peered":"2024-04-23T14:48:23.171177+0000","last_unstale":"2024-04-23T14:50:11.111581+0000","last_undegraded":"2024-04-23T14:50:11.111581+0000","last_fullsized":"2024-04-23T14:50:11.111581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:26:06.666044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318887+0000","last_change":"2024-04-23T14:48:24.206308+0000","last_active":"2024-04-23T14:50:12.318887+0000","last_peered":"2024-04-23T14:50:12.318887+0000","last_clean":"2024-04-23T14:50:12.318887+0000","last_became_active":"2024-04-23T14:48:24.205989+0000","last_became_peered":"2024-04-23T14:48:24.205989+0000","last_unstale":"2024-04-23T14:50:12.318887+0000","last_undegraded":"2024-04-23T14:50:12.318887+0000","last_fullsized":"2024-04-23T14:50:12.318887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:53.172538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.091001+0000","last_change":"2024-04-23T14:48:28.691952+0000","last_active":"2024-04-23T14:49:44.091001+0000","last_peered":"2024-04-23T14:49:44.091001+0000","last_clean":"2024-04-23T14:49:44.091001+0000","last_became_active":"2024-04-23T14:48:28.690781+0000","last_became_peered":"2024-04-23T14:48:28.690781+0000","last_unstale":"2024-04-23T14:49:44.091001+0000","last_undegraded":"2024-04-23T14:49:44.091001+0000","last_fullsized":"2024-04-23T14:49:44.091001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:50.832695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.102235+0000","last_change":"2024-04-23T14:48:23.169165+0000","last_active":"2024-04-23T14:49:44.102235+0000","last_peered":"2024-04-23T14:49:44.102235+0000","last_clean":"2024-04-23T14:49:44.102235+0000","last_became_active":"2024-04-23T14:48:23.168822+0000","last_became_peered":"2024-04-23T14:48:23.168822+0000","last_unstale":"2024-04-23T14:49:44.102235+0000","last_undegraded":"2024-04-23T14:49:44.102235+0000","last_fullsized":"2024-04-23T14:49:44.102235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:29:49.397506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.308252+0000","last_change":"2024-04-23T14:48:43.737904+0000","last_active":"2024-04-23T14:50:12.308252+0000","last_peered":"2024-04-23T14:50:12.308252+0000","last_clean":"2024-04-23T14:50:12.308252+0000","last_became_active":"2024-04-23T14:48:43.736639+0000","last_became_peered":"2024-04-23T14:48:43.736639+0000","last_unstale":"2024-04-23T14:50:12.308252+0000","last_undegraded":"2024-04-23T14:50:12.308252+0000","last_fullsized":"2024-04-23T14:50:12.308252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:43.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092306+0000","last_change":"2024-04-23T14:48:28.692199+0000","last_active":"2024-04-23T14:49:44.092306+0000","last_peered":"2024-04-23T14:49:44.092306+0000","last_clean":"2024-04-23T14:49:44.092306+0000","last_became_active":"2024-04-23T14:48:28.691673+0000","last_became_peered":"2024-04-23T14:48:28.691673+0000","last_unstale":"2024-04-23T14:49:44.092306+0000","last_undegraded":"2024-04-23T14:49:44.092306+0000","last_fullsized":"2024-04-23T14:49:44.092306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:19.323509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.104672+0000","last_change":"2024-04-23T14:48:23.167091+0000","last_active":"2024-04-23T14:49:44.104672+0000","last_peered":"2024-04-23T14:49:44.104672+0000","last_clean":"2024-04-23T14:49:44.104672+0000","last_became_active":"2024-04-23T14:48:23.166734+0000","last_became_peered":"2024-04-23T14:48:23.166734+0000","last_unstale":"2024-04-23T14:49:44.104672+0000","last_undegraded":"2024-04-23T14:49:44.104672+0000","last_fullsized":"2024-04-23T14:49:44.104672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:49:11.486630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316432+0000","last_change":"2024-04-23T14:48:24.208251+0000","last_active":"2024-04-23T14:50:12.316432+0000","last_peered":"2024-04-23T14:50:12.316432+0000","last_clean":"2024-04-23T14:50:12.316432+0000","last_became_active":"2024-04-23T14:48:24.207905+0000","last_became_peered":"2024-04-23T14:48:24.207905+0000","last_unstale":"2024-04-23T14:50:12.316432+0000","last_undegraded":"2024-04-23T14:50:12.316432+0000","last_fullsized":"2024-04-23T14:50:12.316432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:52.803336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103541+0000","last_change":"2024-04-23T14:48:44.013832+0000","last_active":"2024-04-23T14:49:44.103541+0000","last_peered":"2024-04-23T14:49:44.103541+0000","last_clean":"2024-04-23T14:49:44.103541+0000","last_became_active":"2024-04-23T14:48:44.012529+0000","last_became_peered":"2024-04-23T14:48:44.012529+0000","last_unstale":"2024-04-23T14:49:44.103541+0000","last_undegraded":"2024-04-23T14:49:44.103541+0000","last_fullsized":"2024-04-23T14:49:44.103541+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:49:50.898163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103192+0000","last_change":"2024-04-23T14:48:43.794890+0000","last_active":"2024-04-23T14:49:44.103192+0000","last_peered":"2024-04-23T14:49:44.103192+0000","last_clean":"2024-04-23T14:49:44.103192+0000","last_became_active":"2024-04-23T14:48:43.794157+0000","last_became_peered":"2024-04-23T14:48:43.794157+0000","last_unstale":"2024-04-23T14:49:44.103192+0000","last_undegraded":"2024-04-23T14:49:44.103192+0000","last_fullsized":"2024-04-23T14:49:44.103192+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:40.335060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.299065+0000","last_change":"2024-04-23T14:48:24.213085+0000","last_active":"2024-04-23T14:50:12.299065+0000","last_peered":"2024-04-23T14:50:12.299065+0000","last_clean":"2024-04-23T14:50:12.299065+0000","last_became_active":"2024-04-23T14:48:24.212634+0000","last_became_peered":"2024-04-23T14:48:24.212634+0000","last_unstale":"2024-04-23T14:50:12.299065+0000","last_undegraded":"2024-04-23T14:50:12.299065+0000","last_fullsized":"2024-04-23T14:50:12.299065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:56:16.680842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.090744+0000","last_change":"2024-04-23T14:48:28.691938+0000","last_active":"2024-04-23T14:49:44.090744+0000","last_peered":"2024-04-23T14:49:44.090744+0000","last_clean":"2024-04-23T14:49:44.090744+0000","last_became_active":"2024-04-23T14:48:28.691410+0000","last_became_peered":"2024-04-23T14:48:28.691410+0000","last_unstale":"2024-04-23T14:49:44.090744+0000","last_undegraded":"2024-04-23T14:49:44.090744+0000","last_fullsized":"2024-04-23T14:49:44.090744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:52.384117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.085368+0000","last_change":"2024-04-23T14:48:23.174726+0000","last_active":"2024-04-23T14:50:12.085368+0000","last_peered":"2024-04-23T14:50:12.085368+0000","last_clean":"2024-04-23T14:50:12.085368+0000","last_became_active":"2024-04-23T14:48:23.174163+0000","last_became_peered":"2024-04-23T14:48:23.174163+0000","last_unstale":"2024-04-23T14:50:12.085368+0000","last_undegraded":"2024-04-23T14:50:12.085368+0000","last_fullsized":"2024-04-23T14:50:12.085368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:17.294653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.307123+0000","last_change":"2024-04-23T14:48:24.212406+0000","last_active":"2024-04-23T14:50:12.307123+0000","last_peered":"2024-04-23T14:50:12.307123+0000","last_clean":"2024-04-23T14:50:12.307123+0000","last_became_active":"2024-04-23T14:48:24.212025+0000","last_became_peered":"2024-04-23T14:48:24.212025+0000","last_unstale":"2024-04-23T14:50:12.307123+0000","last_undegraded":"2024-04-23T14:50:12.307123+0000","last_fullsized":"2024-04-23T14:50:12.307123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:09.890480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.091151+0000","last_change":"2024-04-23T14:48:28.868780+0000","last_active":"2024-04-23T14:49:44.091151+0000","last_peered":"2024-04-23T14:49:44.091151+0000","last_clean":"2024-04-23T14:49:44.091151+0000","last_became_active":"2024-04-23T14:48:28.868214+0000","last_became_peered":"2024-04-23T14:48:28.868214+0000","last_unstale":"2024-04-23T14:49:44.091151+0000","last_undegraded":"2024-04-23T14:49:44.091151+0000","last_fullsized":"2024-04-23T14:49:44.091151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:16:19.606569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.312883+0000","last_change":"2024-04-23T14:48:24.189017+0000","last_active":"2024-04-23T14:50:12.312883+0000","last_peered":"2024-04-23T14:50:12.312883+0000","last_clean":"2024-04-23T14:50:12.312883+0000","last_became_active":"2024-04-23T14:48:24.187165+0000","last_became_peered":"2024-04-23T14:48:24.187165+0000","last_unstale":"2024-04-23T14:50:12.312883+0000","last_undegraded":"2024-04-23T14:50:12.312883+0000","last_fullsized":"2024-04-23T14:50:12.312883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:44.844255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.113285+0000","last_change":"2024-04-23T14:48:23.174186+0000","last_active":"2024-04-23T14:50:12.113285+0000","last_peered":"2024-04-23T14:50:12.113285+0000","last_clean":"2024-04-23T14:50:12.113285+0000","last_became_active":"2024-04-23T14:48:23.173365+0000","last_became_peered":"2024-04-23T14:48:23.173365+0000","last_unstale":"2024-04-23T14:50:12.113285+0000","last_undegraded":"2024-04-23T14:50:12.113285+0000","last_fullsized":"2024-04-23T14:50:12.113285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:04.193405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694464+0000","last_change":"2024-04-23T14:48:28.689151+0000","last_active":"2024-04-23T14:49:44.694464+0000","last_peered":"2024-04-23T14:49:44.694464+0000","last_clean":"2024-04-23T14:49:44.694464+0000","last_became_active":"2024-04-23T14:48:28.688396+0000","last_became_peered":"2024-04-23T14:48:28.688396+0000","last_unstale":"2024-04-23T14:49:44.694464+0000","last_undegraded":"2024-04-23T14:49:44.694464+0000","last_fullsized":"2024-04-23T14:49:44.694464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:06.922068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692901+0000","last_change":"2024-04-23T14:48:24.214609+0000","last_active":"2024-04-23T14:49:44.692901+0000","last_peered":"2024-04-23T14:49:44.692901+0000","last_clean":"2024-04-23T14:49:44.692901+0000","last_became_active":"2024-04-23T14:48:24.211298+0000","last_became_peered":"2024-04-23T14:48:24.211298+0000","last_unstale":"2024-04-23T14:49:44.692901+0000","last_undegraded":"2024-04-23T14:49:44.692901+0000","last_fullsized":"2024-04-23T14:49:44.692901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:59.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692615+0000","last_change":"2024-04-23T14:48:23.154856+0000","last_active":"2024-04-23T14:49:44.692615+0000","last_peered":"2024-04-23T14:49:44.692615+0000","last_clean":"2024-04-23T14:49:44.692615+0000","last_became_active":"2024-04-23T14:48:23.154225+0000","last_became_peered":"2024-04-23T14:48:23.154225+0000","last_unstale":"2024-04-23T14:49:44.692615+0000","last_undegraded":"2024-04-23T14:49:44.692615+0000","last_fullsized":"2024-04-23T14:49:44.692615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:48.059364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":364,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693717+0000","last_change":"2024-04-23T14:46:43.008733+0000","last_active":"2024-04-23T14:49:44.693717+0000","last_peered":"2024-04-23T14:49:44.693717+0000","last_clean":"2024-04-23T14:49:44.693717+0000","last_became_active":"2024-04-23T14:46:43.008289+0000","last_became_peered":"2024-04-23T14:46:43.008289+0000","last_unstale":"2024-04-23T14:49:44.693717+0000","last_undegraded":"2024-04-23T14:49:44.693717+0000","last_fullsized":"2024-04-23T14:49:44.693717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_clean_scrub_stamp":"2024-04-23T14:41:57.297296+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:40.997119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092984+0000","last_change":"2024-04-23T14:48:28.870098+0000","last_active":"2024-04-23T14:49:44.092984+0000","last_peered":"2024-04-23T14:49:44.092984+0000","last_clean":"2024-04-23T14:49:44.092984+0000","last_became_active":"2024-04-23T14:48:28.868925+0000","last_became_peered":"2024-04-23T14:48:28.868925+0000","last_unstale":"2024-04-23T14:49:44.092984+0000","last_undegraded":"2024-04-23T14:49:44.092984+0000","last_fullsized":"2024-04-23T14:49:44.092984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:22.408757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.305412+0000","last_change":"2024-04-23T14:48:24.189462+0000","last_active":"2024-04-23T14:50:12.305412+0000","last_peered":"2024-04-23T14:50:12.305412+0000","last_clean":"2024-04-23T14:50:12.305412+0000","last_became_active":"2024-04-23T14:48:24.188714+0000","last_became_peered":"2024-04-23T14:48:24.188714+0000","last_unstale":"2024-04-23T14:50:12.305412+0000","last_undegraded":"2024-04-23T14:50:12.305412+0000","last_fullsized":"2024-04-23T14:50:12.305412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:56.589476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694607+0000","last_change":"2024-04-23T14:48:23.166096+0000","last_active":"2024-04-23T14:49:44.694607+0000","last_peered":"2024-04-23T14:49:44.694607+0000","last_clean":"2024-04-23T14:49:44.694607+0000","last_became_active":"2024-04-23T14:48:23.165514+0000","last_became_peered":"2024-04-23T14:48:23.165514+0000","last_unstale":"2024-04-23T14:49:44.694607+0000","last_undegraded":"2024-04-23T14:49:44.694607+0000","last_fullsized":"2024-04-23T14:49:44.694607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:27.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.097364+0000","last_change":"2024-04-23T14:48:28.690086+0000","last_active":"2024-04-23T14:49:44.097364+0000","last_peered":"2024-04-23T14:49:44.097364+0000","last_clean":"2024-04-23T14:49:44.097364+0000","last_became_active":"2024-04-23T14:48:28.689346+0000","last_became_peered":"2024-04-23T14:48:28.689346+0000","last_unstale":"2024-04-23T14:49:44.097364+0000","last_undegraded":"2024-04-23T14:49:44.097364+0000","last_fullsized":"2024-04-23T14:49:44.097364+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:02.594389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.120063+0000","last_change":"2024-04-23T14:49:44.119019+0000","last_active":"2024-04-23T14:49:44.120063+0000","last_peered":"2024-04-23T14:49:44.120063+0000","last_clean":"2024-04-23T14:49:44.120063+0000","last_became_active":"2024-04-23T14:49:44.104949+0000","last_became_peered":"2024-04-23T14:49:44.104949+0000","last_unstale":"2024-04-23T14:49:44.120063+0000","last_undegraded":"2024-04-23T14:49:44.120063+0000","last_fullsized":"2024-04-23T14:49:44.120063+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:55.343324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.310002+0000","last_change":"2024-04-23T14:48:24.190631+0000","last_active":"2024-04-23T14:50:12.310002+0000","last_peered":"2024-04-23T14:50:12.310002+0000","last_clean":"2024-04-23T14:50:12.310002+0000","last_became_active":"2024-04-23T14:48:24.190245+0000","last_became_peered":"2024-04-23T14:48:24.190245+0000","last_unstale":"2024-04-23T14:50:12.310002+0000","last_undegraded":"2024-04-23T14:50:12.310002+0000","last_fullsized":"2024-04-23T14:50:12.310002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:09.641687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692988+0000","last_change":"2024-04-23T14:48:28.867735+0000","last_active":"2024-04-23T14:49:44.692988+0000","last_peered":"2024-04-23T14:49:44.692988+0000","last_clean":"2024-04-23T14:49:44.692988+0000","last_became_active":"2024-04-23T14:48:28.867165+0000","last_became_peered":"2024-04-23T14:48:28.867165+0000","last_unstale":"2024-04-23T14:49:44.692988+0000","last_undegraded":"2024-04-23T14:49:44.692988+0000","last_fullsized":"2024-04-23T14:49:44.692988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:46.973396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103921+0000","last_change":"2024-04-23T14:48:23.159980+0000","last_active":"2024-04-23T14:49:44.103921+0000","last_peered":"2024-04-23T14:49:44.103921+0000","last_clean":"2024-04-23T14:49:44.103921+0000","last_became_active":"2024-04-23T14:48:23.158407+0000","last_became_peered":"2024-04-23T14:48:23.158407+0000","last_unstale":"2024-04-23T14:49:44.103921+0000","last_undegraded":"2024-04-23T14:49:44.103921+0000","last_fullsized":"2024-04-23T14:49:44.103921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:06:07.110430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693974+0000","last_change":"2024-04-23T14:48:24.215285+0000","last_active":"2024-04-23T14:49:44.693974+0000","last_peered":"2024-04-23T14:49:44.693974+0000","last_clean":"2024-04-23T14:49:44.693974+0000","last_became_active":"2024-04-23T14:48:24.209934+0000","last_became_peered":"2024-04-23T14:48:24.209934+0000","last_unstale":"2024-04-23T14:49:44.693974+0000","last_undegraded":"2024-04-23T14:49:44.693974+0000","last_fullsized":"2024-04-23T14:49:44.693974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:00.673701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692474+0000","last_change":"2024-04-23T14:48:28.689933+0000","last_active":"2024-04-23T14:49:44.692474+0000","last_peered":"2024-04-23T14:49:44.692474+0000","last_clean":"2024-04-23T14:49:44.692474+0000","last_became_active":"2024-04-23T14:48:28.687999+0000","last_became_peered":"2024-04-23T14:48:28.687999+0000","last_unstale":"2024-04-23T14:49:44.692474+0000","last_undegraded":"2024-04-23T14:49:44.692474+0000","last_fullsized":"2024-04-23T14:49:44.692474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:10.605796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693376+0000","last_change":"2024-04-23T14:48:23.167935+0000","last_active":"2024-04-23T14:49:44.693376+0000","last_peered":"2024-04-23T14:49:44.693376+0000","last_clean":"2024-04-23T14:49:44.693376+0000","last_became_active":"2024-04-23T14:48:23.167597+0000","last_became_peered":"2024-04-23T14:48:23.167597+0000","last_unstale":"2024-04-23T14:49:44.693376+0000","last_undegraded":"2024-04-23T14:49:44.693376+0000","last_fullsized":"2024-04-23T14:49:44.693376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:14:25.667816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322141+0000","last_change":"2024-04-23T14:48:44.012004+0000","last_active":"2024-04-23T14:50:12.322141+0000","last_peered":"2024-04-23T14:50:12.322141+0000","last_clean":"2024-04-23T14:50:12.322141+0000","last_became_active":"2024-04-23T14:48:44.010779+0000","last_became_peered":"2024-04-23T14:48:44.010779+0000","last_unstale":"2024-04-23T14:50:12.322141+0000","last_undegraded":"2024-04-23T14:50:12.322141+0000","last_fullsized":"2024-04-23T14:50:12.322141+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:09.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693061+0000","last_change":"2024-04-23T14:48:44.013213+0000","last_active":"2024-04-23T14:49:44.693061+0000","last_peered":"2024-04-23T14:49:44.693061+0000","last_clean":"2024-04-23T14:49:44.693061+0000","last_became_active":"2024-04-23T14:48:44.012710+0000","last_became_peered":"2024-04-23T14:48:44.012710+0000","last_unstale":"2024-04-23T14:49:44.693061+0000","last_undegraded":"2024-04-23T14:49:44.693061+0000","last_fullsized":"2024-04-23T14:49:44.693061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.551488+0000","last_change":"2024-04-23T14:48:23.157529+0000","last_active":"2024-04-23T14:49:44.551488+0000","last_peered":"2024-04-23T14:49:44.551488+0000","last_clean":"2024-04-23T14:49:44.551488+0000","last_became_active":"2024-04-23T14:48:23.156780+0000","last_became_peered":"2024-04-23T14:48:23.156780+0000","last_unstale":"2024-04-23T14:49:44.551488+0000","last_undegraded":"2024-04-23T14:49:44.551488+0000","last_fullsized":"2024-04-23T14:49:44.551488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:32.747563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.269973+0000","last_change":"2024-04-23T14:48:24.196328+0000","last_active":"2024-04-23T14:50:12.269973+0000","last_peered":"2024-04-23T14:50:12.269973+0000","last_clean":"2024-04-23T14:50:12.269973+0000","last_became_active":"2024-04-23T14:48:24.195875+0000","last_became_peered":"2024-04-23T14:48:24.195875+0000","last_unstale":"2024-04-23T14:50:12.269973+0000","last_undegraded":"2024-04-23T14:50:12.269973+0000","last_fullsized":"2024-04-23T14:50:12.269973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:34:03.377786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103953+0000","last_change":"2024-04-23T14:48:28.692397+0000","last_active":"2024-04-23T14:49:44.103953+0000","last_peered":"2024-04-23T14:49:44.103953+0000","last_clean":"2024-04-23T14:49:44.103953+0000","last_became_active":"2024-04-23T14:48:28.691916+0000","last_became_peered":"2024-04-23T14:48:28.691916+0000","last_unstale":"2024-04-23T14:49:44.103953+0000","last_undegraded":"2024-04-23T14:49:44.103953+0000","last_fullsized":"2024-04-23T14:49:44.103953+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:59.357790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693013+0000","last_change":"2024-04-23T14:48:23.165072+0000","last_active":"2024-04-23T14:49:44.693013+0000","last_peered":"2024-04-23T14:49:44.693013+0000","last_clean":"2024-04-23T14:49:44.693013+0000","last_became_active":"2024-04-23T14:48:23.164732+0000","last_became_peered":"2024-04-23T14:48:23.164732+0000","last_unstale":"2024-04-23T14:49:44.693013+0000","last_undegraded":"2024-04-23T14:49:44.693013+0000","last_fullsized":"2024-04-23T14:49:44.693013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:04.921227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316567+0000","last_change":"2024-04-23T14:48:24.203322+0000","last_active":"2024-04-23T14:50:12.316567+0000","last_peered":"2024-04-23T14:50:12.316567+0000","last_clean":"2024-04-23T14:50:12.316567+0000","last_became_active":"2024-04-23T14:48:24.202889+0000","last_became_peered":"2024-04-23T14:48:24.202889+0000","last_unstale":"2024-04-23T14:50:12.316567+0000","last_undegraded":"2024-04-23T14:50:12.316567+0000","last_fullsized":"2024-04-23T14:50:12.316567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:18:19.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693031+0000","last_change":"2024-04-23T14:48:28.686064+0000","last_active":"2024-04-23T14:49:44.693031+0000","last_peered":"2024-04-23T14:49:44.693031+0000","last_clean":"2024-04-23T14:49:44.693031+0000","last_became_active":"2024-04-23T14:48:28.685389+0000","last_became_peered":"2024-04-23T14:48:28.685389+0000","last_unstale":"2024-04-23T14:49:44.693031+0000","last_undegraded":"2024-04-23T14:49:44.693031+0000","last_fullsized":"2024-04-23T14:49:44.693031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:06:35.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692835+0000","last_change":"2024-04-23T14:48:23.164926+0000","last_active":"2024-04-23T14:49:44.692835+0000","last_peered":"2024-04-23T14:49:44.692835+0000","last_clean":"2024-04-23T14:49:44.692835+0000","last_became_active":"2024-04-23T14:48:23.164550+0000","last_became_peered":"2024-04-23T14:48:23.164550+0000","last_unstale":"2024-04-23T14:49:44.692835+0000","last_undegraded":"2024-04-23T14:49:44.692835+0000","last_fullsized":"2024-04-23T14:49:44.692835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:53:33.512403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693626+0000","last_change":"2024-04-23T14:48:24.208535+0000","last_active":"2024-04-23T14:49:44.693626+0000","last_peered":"2024-04-23T14:49:44.693626+0000","last_clean":"2024-04-23T14:49:44.693626+0000","last_became_active":"2024-04-23T14:48:24.208183+0000","last_became_peered":"2024-04-23T14:48:24.208183+0000","last_unstale":"2024-04-23T14:49:44.693626+0000","last_undegraded":"2024-04-23T14:49:44.693626+0000","last_fullsized":"2024-04-23T14:49:44.693626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:33:37.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692690+0000","last_change":"2024-04-23T14:48:28.870055+0000","last_active":"2024-04-23T14:49:44.692690+0000","last_peered":"2024-04-23T14:49:44.692690+0000","last_clean":"2024-04-23T14:49:44.692690+0000","last_became_active":"2024-04-23T14:48:28.868671+0000","last_became_peered":"2024-04-23T14:48:28.868671+0000","last_unstale":"2024-04-23T14:49:44.692690+0000","last_undegraded":"2024-04-23T14:49:44.692690+0000","last_fullsized":"2024-04-23T14:49:44.692690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:26:23.756484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103166+0000","last_change":"2024-04-23T14:48:23.171324+0000","last_active":"2024-04-23T14:49:44.103166+0000","last_peered":"2024-04-23T14:49:44.103166+0000","last_clean":"2024-04-23T14:49:44.103166+0000","last_became_active":"2024-04-23T14:48:23.170523+0000","last_became_peered":"2024-04-23T14:48:23.170523+0000","last_unstale":"2024-04-23T14:49:44.103166+0000","last_undegraded":"2024-04-23T14:49:44.103166+0000","last_fullsized":"2024-04-23T14:49:44.103166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:06.578119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323964+0000","last_change":"2024-04-23T14:48:24.199577+0000","last_active":"2024-04-23T14:50:12.323964+0000","last_peered":"2024-04-23T14:50:12.323964+0000","last_clean":"2024-04-23T14:50:12.323964+0000","last_became_active":"2024-04-23T14:48:24.199174+0000","last_became_peered":"2024-04-23T14:48:24.199174+0000","last_unstale":"2024-04-23T14:50:12.323964+0000","last_undegraded":"2024-04-23T14:50:12.323964+0000","last_fullsized":"2024-04-23T14:50:12.323964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:00.078179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.551474+0000","last_change":"2024-04-23T14:48:28.693416+0000","last_active":"2024-04-23T14:49:44.551474+0000","last_peered":"2024-04-23T14:49:44.551474+0000","last_clean":"2024-04-23T14:49:44.551474+0000","last_became_active":"2024-04-23T14:48:28.691823+0000","last_became_peered":"2024-04-23T14:48:28.691823+0000","last_unstale":"2024-04-23T14:49:44.551474+0000","last_undegraded":"2024-04-23T14:49:44.551474+0000","last_fullsized":"2024-04-23T14:49:44.551474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:11:41.027479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:11.096567+0000","last_change":"2024-04-23T14:48:23.160695+0000","last_active":"2024-04-23T14:50:11.096567+0000","last_peered":"2024-04-23T14:50:11.096567+0000","last_clean":"2024-04-23T14:50:11.096567+0000","last_became_active":"2024-04-23T14:48:23.160255+0000","last_became_peered":"2024-04-23T14:48:23.160255+0000","last_unstale":"2024-04-23T14:50:11.096567+0000","last_undegraded":"2024-04-23T14:50:11.096567+0000","last_fullsized":"2024-04-23T14:50:11.096567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:10.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323826+0000","last_change":"2024-04-23T14:48:24.204085+0000","last_active":"2024-04-23T14:50:12.323826+0000","last_peered":"2024-04-23T14:50:12.323826+0000","last_clean":"2024-04-23T14:50:12.323826+0000","last_became_active":"2024-04-23T14:48:24.203100+0000","last_became_peered":"2024-04-23T14:48:24.203100+0000","last_unstale":"2024-04-23T14:50:12.323826+0000","last_undegraded":"2024-04-23T14:50:12.323826+0000","last_fullsized":"2024-04-23T14:50:12.323826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:06:42.999237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.101416+0000","last_change":"2024-04-23T14:48:28.687315+0000","last_active":"2024-04-23T14:49:44.101416+0000","last_peered":"2024-04-23T14:49:44.101416+0000","last_clean":"2024-04-23T14:49:44.101416+0000","last_became_active":"2024-04-23T14:48:28.686867+0000","last_became_peered":"2024-04-23T14:48:28.686867+0000","last_unstale":"2024-04-23T14:49:44.101416+0000","last_undegraded":"2024-04-23T14:49:44.101416+0000","last_fullsized":"2024-04-23T14:49:44.101416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:49.455073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.093744+0000","last_change":"2024-04-23T14:48:23.154736+0000","last_active":"2024-04-23T14:49:44.093744+0000","last_peered":"2024-04-23T14:49:44.093744+0000","last_clean":"2024-04-23T14:49:44.093744+0000","last_became_active":"2024-04-23T14:48:23.154388+0000","last_became_peered":"2024-04-23T14:48:23.154388+0000","last_unstale":"2024-04-23T14:49:44.093744+0000","last_undegraded":"2024-04-23T14:49:44.093744+0000","last_fullsized":"2024-04-23T14:49:44.093744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:16.856764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319204+0000","last_change":"2024-04-23T14:48:43.737734+0000","last_active":"2024-04-23T14:50:12.319204+0000","last_peered":"2024-04-23T14:50:12.319204+0000","last_clean":"2024-04-23T14:50:12.319204+0000","last_became_active":"2024-04-23T14:48:43.736678+0000","last_became_peered":"2024-04-23T14:48:43.736678+0000","last_unstale":"2024-04-23T14:50:12.319204+0000","last_undegraded":"2024-04-23T14:50:12.319204+0000","last_fullsized":"2024-04-23T14:50:12.319204+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:57.583820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.091785+0000","last_change":"2024-04-23T14:48:28.695478+0000","last_active":"2024-04-23T14:49:44.091785+0000","last_peered":"2024-04-23T14:49:44.091785+0000","last_clean":"2024-04-23T14:49:44.091785+0000","last_became_active":"2024-04-23T14:48:28.694836+0000","last_became_peered":"2024-04-23T14:48:28.694836+0000","last_unstale":"2024-04-23T14:49:44.091785+0000","last_undegraded":"2024-04-23T14:49:44.091785+0000","last_fullsized":"2024-04-23T14:49:44.091785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:11:16.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.090869+0000","last_change":"2024-04-23T14:48:23.164866+0000","last_active":"2024-04-23T14:49:44.090869+0000","last_peered":"2024-04-23T14:49:44.090869+0000","last_clean":"2024-04-23T14:49:44.090869+0000","last_became_active":"2024-04-23T14:48:23.164570+0000","last_became_peered":"2024-04-23T14:48:23.164570+0000","last_unstale":"2024-04-23T14:49:44.090869+0000","last_undegraded":"2024-04-23T14:49:44.090869+0000","last_fullsized":"2024-04-23T14:49:44.090869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:48.247715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319319+0000","last_change":"2024-04-23T14:48:24.202600+0000","last_active":"2024-04-23T14:50:12.319319+0000","last_peered":"2024-04-23T14:50:12.319319+0000","last_clean":"2024-04-23T14:50:12.319319+0000","last_became_active":"2024-04-23T14:48:24.202243+0000","last_became_peered":"2024-04-23T14:48:24.202243+0000","last_unstale":"2024-04-23T14:50:12.319319+0000","last_undegraded":"2024-04-23T14:50:12.319319+0000","last_fullsized":"2024-04-23T14:50:12.319319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:19.162967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.317248+0000","last_change":"2024-04-23T14:48:24.206142+0000","last_active":"2024-04-23T14:50:12.317248+0000","last_peered":"2024-04-23T14:50:12.317248+0000","last_clean":"2024-04-23T14:50:12.317248+0000","last_became_active":"2024-04-23T14:48:24.203397+0000","last_became_peered":"2024-04-23T14:48:24.203397+0000","last_unstale":"2024-04-23T14:50:12.317248+0000","last_undegraded":"2024-04-23T14:50:12.317248+0000","last_fullsized":"2024-04-23T14:50:12.317248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:35:56.363914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.311297+0000","last_change":"2024-04-23T14:48:24.197058+0000","last_active":"2024-04-23T14:50:12.311297+0000","last_peered":"2024-04-23T14:50:12.311297+0000","last_clean":"2024-04-23T14:50:12.311297+0000","last_became_active":"2024-04-23T14:48:24.196662+0000","last_became_peered":"2024-04-23T14:48:24.196662+0000","last_unstale":"2024-04-23T14:50:12.311297+0000","last_undegraded":"2024-04-23T14:50:12.311297+0000","last_fullsized":"2024-04-23T14:50:12.311297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.884032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.320193+0000","last_change":"2024-04-23T14:48:24.213823+0000","last_active":"2024-04-23T14:50:12.320193+0000","last_peered":"2024-04-23T14:50:12.320193+0000","last_clean":"2024-04-23T14:50:12.320193+0000","last_became_active":"2024-04-23T14:48:24.213480+0000","last_became_peered":"2024-04-23T14:48:24.213480+0000","last_unstale":"2024-04-23T14:50:12.320193+0000","last_undegraded":"2024-04-23T14:50:12.320193+0000","last_fullsized":"2024-04-23T14:50:12.320193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:03.046216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314893+0000","last_change":"2024-04-23T14:48:24.199440+0000","last_active":"2024-04-23T14:50:12.314893+0000","last_peered":"2024-04-23T14:50:12.314893+0000","last_clean":"2024-04-23T14:50:12.314893+0000","last_became_active":"2024-04-23T14:48:24.199119+0000","last_became_peered":"2024-04-23T14:48:24.199119+0000","last_unstale":"2024-04-23T14:50:12.314893+0000","last_undegraded":"2024-04-23T14:50:12.314893+0000","last_fullsized":"2024-04-23T14:50:12.314893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:34.638393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318351+0000","last_change":"2024-04-23T14:48:43.729061+0000","last_active":"2024-04-23T14:50:12.318351+0000","last_peered":"2024-04-23T14:50:12.318351+0000","last_clean":"2024-04-23T14:50:12.318351+0000","last_became_active":"2024-04-23T14:48:43.728485+0000","last_became_peered":"2024-04-23T14:48:43.728485+0000","last_unstale":"2024-04-23T14:50:12.318351+0000","last_undegraded":"2024-04-23T14:50:12.318351+0000","last_fullsized":"2024-04-23T14:50:12.318351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:44:02.348446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316548+0000","last_change":"2024-04-23T14:48:24.204207+0000","last_active":"2024-04-23T14:50:12.316548+0000","last_peered":"2024-04-23T14:50:12.316548+0000","last_clean":"2024-04-23T14:50:12.316548+0000","last_became_active":"2024-04-23T14:48:24.203325+0000","last_became_peered":"2024-04-23T14:48:24.203325+0000","last_unstale":"2024-04-23T14:50:12.316548+0000","last_undegraded":"2024-04-23T14:50:12.316548+0000","last_fullsized":"2024-04-23T14:50:12.316548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:00.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.309076+0000","last_change":"2024-04-23T14:48:24.191811+0000","last_active":"2024-04-23T14:50:12.309076+0000","last_peered":"2024-04-23T14:50:12.309076+0000","last_clean":"2024-04-23T14:50:12.309076+0000","last_became_active":"2024-04-23T14:48:24.191458+0000","last_became_peered":"2024-04-23T14:48:24.191458+0000","last_unstale":"2024-04-23T14:50:12.309076+0000","last_undegraded":"2024-04-23T14:50:12.309076+0000","last_fullsized":"2024-04-23T14:50:12.309076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:11.676842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694242+0000","last_change":"2024-04-23T14:48:24.214997+0000","last_active":"2024-04-23T14:49:44.694242+0000","last_peered":"2024-04-23T14:49:44.694242+0000","last_clean":"2024-04-23T14:49:44.694242+0000","last_became_active":"2024-04-23T14:48:24.211941+0000","last_became_peered":"2024-04-23T14:48:24.211941+0000","last_unstale":"2024-04-23T14:49:44.694242+0000","last_undegraded":"2024-04-23T14:49:44.694242+0000","last_fullsized":"2024-04-23T14:49:44.694242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:29.903690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322462+0000","last_change":"2024-04-23T14:48:24.202327+0000","last_active":"2024-04-23T14:50:12.322462+0000","last_peered":"2024-04-23T14:50:12.322462+0000","last_clean":"2024-04-23T14:50:12.322462+0000","last_became_active":"2024-04-23T14:48:24.201986+0000","last_became_peered":"2024-04-23T14:48:24.201986+0000","last_unstale":"2024-04-23T14:50:12.322462+0000","last_undegraded":"2024-04-23T14:50:12.322462+0000","last_fullsized":"2024-04-23T14:50:12.322462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:48.633762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693145+0000","last_change":"2024-04-23T14:48:24.202931+0000","last_active":"2024-04-23T14:49:44.693145+0000","last_peered":"2024-04-23T14:49:44.693145+0000","last_clean":"2024-04-23T14:49:44.693145+0000","last_became_active":"2024-04-23T14:48:24.201767+0000","last_became_peered":"2024-04-23T14:48:24.201767+0000","last_unstale":"2024-04-23T14:49:44.693145+0000","last_undegraded":"2024-04-23T14:49:44.693145+0000","last_fullsized":"2024-04-23T14:49:44.693145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:39.542403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327236+0000","last_change":"2024-04-23T14:48:24.216891+0000","last_active":"2024-04-23T14:50:12.327236+0000","last_peered":"2024-04-23T14:50:12.327236+0000","last_clean":"2024-04-23T14:50:12.327236+0000","last_became_active":"2024-04-23T14:48:24.216419+0000","last_became_peered":"2024-04-23T14:48:24.216419+0000","last_unstale":"2024-04-23T14:50:12.327236+0000","last_undegraded":"2024-04-23T14:50:12.327236+0000","last_fullsized":"2024-04-23T14:50:12.327236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:42.302965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.320288+0000","last_change":"2024-04-23T14:48:24.206828+0000","last_active":"2024-04-23T14:50:12.320288+0000","last_peered":"2024-04-23T14:50:12.320288+0000","last_clean":"2024-04-23T14:50:12.320288+0000","last_became_active":"2024-04-23T14:48:24.203562+0000","last_became_peered":"2024-04-23T14:48:24.203562+0000","last_unstale":"2024-04-23T14:50:12.320288+0000","last_undegraded":"2024-04-23T14:50:12.320288+0000","last_fullsized":"2024-04-23T14:50:12.320288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:59.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314268+0000","last_change":"2024-04-23T14:48:24.208440+0000","last_active":"2024-04-23T14:50:12.314268+0000","last_peered":"2024-04-23T14:50:12.314268+0000","last_clean":"2024-04-23T14:50:12.314268+0000","last_became_active":"2024-04-23T14:48:24.208052+0000","last_became_peered":"2024-04-23T14:48:24.208052+0000","last_unstale":"2024-04-23T14:50:12.314268+0000","last_undegraded":"2024-04-23T14:50:12.314268+0000","last_fullsized":"2024-04-23T14:50:12.314268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:19.906675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":447,"ondisk_log_size":447,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71409,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":848,"num_read_kb":505,"num_write":250,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":214227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383719,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":520224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645357,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32896,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712256,"statfs":{"total":95995035648,"available":95961350144,"internally_reserved":0,"allocated":1761280,"data_stored":1171383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":524138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070524,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":520308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332163,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1683456,"data_stored":1117058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495690,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":515546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":581031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738484,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":517002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1155072,"data_stored":581393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182494,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":515254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":519620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757331,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1691648,"data_stored":1112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T14:50:19.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-23T14:50:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:20.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:19 smithi007 ceph-mon[27906]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:50:20.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:19 smithi007 ceph-mon[27906]: pgmap v431: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:50:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:19 smithi137 ceph-mon[31694]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:50:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:19 smithi137 ceph-mon[31694]: pgmap v431: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:50:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:19 smithi186 ceph-mon[31814]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:50:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:19 smithi186 ceph-mon[31814]: pgmap v431: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.812+0000 7f4a90200700 1 -- 172.21.15.7:0/2492485590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806a800 msgr2=0x7f4a8806ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.812+0000 7f4a90200700 1 --2- 172.21.15.7:0/2492485590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806a800 0x7f4a8806ac60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009990 tx=0x7f4a74009ca0 comp rx=0 tx=0).stop 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 -- 172.21.15.7:0/2492485590 shutdown_connections 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 --2- 172.21.15.7:0/2492485590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a8806b1a0 0x7f4a8810f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 --2- 172.21.15.7:0/2492485590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a88108b70 0x7f4a88108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 --2- 172.21.15.7:0/2492485590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806a800 0x7f4a8806ac60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 -- 172.21.15.7:0/2492485590 >> 172.21.15.7:0/2492485590 conn(0x7f4a880789a0 msgr2=0x7f4a88078db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 -- 172.21.15.7:0/2492485590 shutdown_connections 2024-04-23T14:50:21.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.813+0000 7f4a90200700 1 -- 172.21.15.7:0/2492485590 wait complete. 2024-04-23T14:50:21.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.814+0000 7f4a90200700 1 Processor -- start 2024-04-23T14:50:21.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.814+0000 7f4a90200700 1 -- start start 2024-04-23T14:50:21.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a90200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a8806a800 0x7f4a8819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a90200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 0x7f4a8819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a90200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a88108b70 0x7f4a8819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a90200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88112cc0 con 0x7f4a8806b1a0 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a90200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88112b40 con 0x7f4a8806a800 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a90200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88112e40 con 0x7f4a88108b70 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a8ce00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 0x7f4a8819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a8ce00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 0x7f4a8819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42592/0 (socket says 172.21.15.7:42592) 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a8ce00700 1 -- 172.21.15.7:0/2887442127 learned_addr learned my addr 172.21.15.7:0/2887442127 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:21.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.815+0000 7f4a8d800700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a8806a800 0x7f4a8819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8ce00700 1 -- 172.21.15.7:0/2887442127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a88108b70 msgr2=0x7f4a8819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8ce00700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a88108b70 0x7f4a8819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8ce00700 1 -- 172.21.15.7:0/2887442127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a8806a800 msgr2=0x7f4a8819b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8ce00700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a8806a800 0x7f4a8819b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8ce00700 1 -- 172.21.15.7:0/2887442127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a881a0460 con 0x7f4a8806b1a0 2024-04-23T14:50:21.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8d800700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a8806a800 0x7f4a8819b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a8ce00700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 0x7f4a8819b990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a74003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74027070 con 0x7f4a8806b1a0 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.816+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a881a06f0 con 0x7f4a8806b1a0 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.817+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a7400bdc0 con 0x7f4a8806b1a0 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.817+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7400f460 con 0x7f4a8806b1a0 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.817+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a881a7fd0 con 0x7f4a8806b1a0 2024-04-23T14:50:21.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.818+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a880697e0 con 0x7f4a8806b1a0 2024-04-23T14:50:21.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.820+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f4a7402a070 con 0x7f4a8806b1a0 2024-04-23T14:50:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.821+0000 7f4a86000700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4a700a3c40 0x7f4a700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.822+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f4a740d16f0 con 0x7f4a8806b1a0 2024-04-23T14:50:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.822+0000 7f4a8d800700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4a700a3c40 0x7f4a700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.822+0000 7f4a8d800700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4a700a3c40 0x7f4a700a6100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c005e10 tx=0x7f4a7c005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:21.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:21.826+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4a74013070 con 0x7f4a8806b1a0 2024-04-23T14:50:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.058+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a8819c7b0 con 0x7f4a700a3c40 2024-04-23T14:50:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.087+0000 7f4a86000700 1 -- 172.21.15.7:0/2887442127 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340615 (secure 0 0 0) 0x7f4a8819c7b0 con 0x7f4a700a3c40 2024-04-23T14:50:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4a700a3c40 msgr2=0x7f4a700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:22.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4a700a3c40 0x7f4a700a6100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c005e10 tx=0x7f4a7c005d60 comp rx=0 tx=0).stop 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 msgr2=0x7f4a8819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 0x7f4a8819b990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a74003b30 comp rx=0 tx=0).stop 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 shutdown_connections 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4a700a3c40 0x7f4a700a6100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a88108b70 0x7f4a8819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a8806a800 0x7f4a8819b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 --2- 172.21.15.7:0/2887442127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a8806b1a0 0x7f4a8819b990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 >> 172.21.15.7:0/2887442127 conn(0x7f4a880789a0 msgr2=0x7f4a8810e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 shutdown_connections 2024-04-23T14:50:22.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:22.094+0000 7f4a90200700 1 -- 172.21.15.7:0/2887442127 wait complete. 2024-04-23T14:50:22.098 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-23T14:50:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:21 smithi137 ceph-mon[31694]: pgmap v432: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T14:50:22.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:21 smithi007 ceph-mon[27906]: pgmap v432: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T14:50:22.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:21 smithi186 ceph-mon[31814]: pgmap v432: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T14:50:22.897 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2024-04-23T14:50:20.362344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662011,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1004,"num_read_kb":629,"num_write":433,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372096,"kb_used_data":14624,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124569728,"statfs":{"total":1151940427776,"available":1151559401472,"internally_reserved":0,"allocated":14974976,"data_stored":8195987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004742"},"pg_stats":[{"pgid":"3.3f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327446+0000","last_change":"2024-04-23T14:48:24.207434+0000","last_active":"2024-04-23T14:50:12.327446+0000","last_peered":"2024-04-23T14:50:12.327446+0000","last_clean":"2024-04-23T14:50:12.327446+0000","last_became_active":"2024-04-23T14:48:24.204367+0000","last_became_peered":"2024-04-23T14:48:24.204367+0000","last_unstale":"2024-04-23T14:50:12.327446+0000","last_undegraded":"2024-04-23T14:50:12.327446+0000","last_fullsized":"2024-04-23T14:50:12.327446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:50.125997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314312+0000","last_change":"2024-04-23T14:48:24.207435+0000","last_active":"2024-04-23T14:50:12.314312+0000","last_peered":"2024-04-23T14:50:12.314312+0000","last_clean":"2024-04-23T14:50:12.314312+0000","last_became_active":"2024-04-23T14:48:24.207086+0000","last_became_peered":"2024-04-23T14:48:24.207086+0000","last_unstale":"2024-04-23T14:50:12.314312+0000","last_undegraded":"2024-04-23T14:50:12.314312+0000","last_fullsized":"2024-04-23T14:50:12.314312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:53:39.864396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323553+0000","last_change":"2024-04-23T14:48:24.208293+0000","last_active":"2024-04-23T14:50:12.323553+0000","last_peered":"2024-04-23T14:50:12.323553+0000","last_clean":"2024-04-23T14:50:12.323553+0000","last_became_active":"2024-04-23T14:48:24.207935+0000","last_became_peered":"2024-04-23T14:48:24.207935+0000","last_unstale":"2024-04-23T14:50:12.323553+0000","last_undegraded":"2024-04-23T14:50:12.323553+0000","last_fullsized":"2024-04-23T14:50:12.323553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:26.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.302551+0000","last_change":"2024-04-23T14:48:24.201916+0000","last_active":"2024-04-23T14:50:12.302551+0000","last_peered":"2024-04-23T14:50:12.302551+0000","last_clean":"2024-04-23T14:50:12.302551+0000","last_became_active":"2024-04-23T14:48:24.201500+0000","last_became_peered":"2024-04-23T14:48:24.201500+0000","last_unstale":"2024-04-23T14:50:12.302551+0000","last_undegraded":"2024-04-23T14:50:12.302551+0000","last_fullsized":"2024-04-23T14:50:12.302551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:02.697609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.305970+0000","last_change":"2024-04-23T14:48:24.210928+0000","last_active":"2024-04-23T14:50:12.305970+0000","last_peered":"2024-04-23T14:50:12.305970+0000","last_clean":"2024-04-23T14:50:12.305970+0000","last_became_active":"2024-04-23T14:48:24.210576+0000","last_became_peered":"2024-04-23T14:48:24.210576+0000","last_unstale":"2024-04-23T14:50:12.305970+0000","last_undegraded":"2024-04-23T14:50:12.305970+0000","last_fullsized":"2024-04-23T14:50:12.305970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:49.662992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.312946+0000","last_change":"2024-04-23T14:48:24.206641+0000","last_active":"2024-04-23T14:50:12.312946+0000","last_peered":"2024-04-23T14:50:12.312946+0000","last_clean":"2024-04-23T14:50:12.312946+0000","last_became_active":"2024-04-23T14:48:24.206298+0000","last_became_peered":"2024-04-23T14:48:24.206298+0000","last_unstale":"2024-04-23T14:50:12.312946+0000","last_undegraded":"2024-04-23T14:50:12.312946+0000","last_fullsized":"2024-04-23T14:50:12.312946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:50.150157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319759+0000","last_change":"2024-04-23T14:48:24.204762+0000","last_active":"2024-04-23T14:50:12.319759+0000","last_peered":"2024-04-23T14:50:12.319759+0000","last_clean":"2024-04-23T14:50:12.319759+0000","last_became_active":"2024-04-23T14:48:24.204396+0000","last_became_peered":"2024-04-23T14:48:24.204396+0000","last_unstale":"2024-04-23T14:50:12.319759+0000","last_undegraded":"2024-04-23T14:50:12.319759+0000","last_fullsized":"2024-04-23T14:50:12.319759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:53.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.321817+0000","last_change":"2024-04-23T14:48:24.214064+0000","last_active":"2024-04-23T14:50:12.321817+0000","last_peered":"2024-04-23T14:50:12.321817+0000","last_clean":"2024-04-23T14:50:12.321817+0000","last_became_active":"2024-04-23T14:48:24.213748+0000","last_became_peered":"2024-04-23T14:48:24.213748+0000","last_unstale":"2024-04-23T14:50:12.321817+0000","last_undegraded":"2024-04-23T14:50:12.321817+0000","last_fullsized":"2024-04-23T14:50:12.321817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:52.011095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.326516+0000","last_change":"2024-04-23T14:48:24.196420+0000","last_active":"2024-04-23T14:50:12.326516+0000","last_peered":"2024-04-23T14:50:12.326516+0000","last_clean":"2024-04-23T14:50:12.326516+0000","last_became_active":"2024-04-23T14:48:24.196086+0000","last_became_peered":"2024-04-23T14:48:24.196086+0000","last_unstale":"2024-04-23T14:50:12.326516+0000","last_undegraded":"2024-04-23T14:50:12.326516+0000","last_fullsized":"2024-04-23T14:50:12.326516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:38.434390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.311336+0000","last_change":"2024-04-23T14:48:24.208801+0000","last_active":"2024-04-23T14:50:12.311336+0000","last_peered":"2024-04-23T14:50:12.311336+0000","last_clean":"2024-04-23T14:50:12.311336+0000","last_became_active":"2024-04-23T14:48:24.208088+0000","last_became_peered":"2024-04-23T14:48:24.208088+0000","last_unstale":"2024-04-23T14:50:12.311336+0000","last_undegraded":"2024-04-23T14:50:12.311336+0000","last_fullsized":"2024-04-23T14:50:12.311336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:30.684820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323636+0000","last_change":"2024-04-23T14:48:24.207387+0000","last_active":"2024-04-23T14:50:12.323636+0000","last_peered":"2024-04-23T14:50:12.323636+0000","last_clean":"2024-04-23T14:50:12.323636+0000","last_became_active":"2024-04-23T14:48:24.205524+0000","last_became_peered":"2024-04-23T14:48:24.205524+0000","last_unstale":"2024-04-23T14:50:12.323636+0000","last_undegraded":"2024-04-23T14:50:12.323636+0000","last_fullsized":"2024-04-23T14:50:12.323636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:24:52.196823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.310419+0000","last_change":"2024-04-23T14:48:24.198132+0000","last_active":"2024-04-23T14:50:12.310419+0000","last_peered":"2024-04-23T14:50:12.310419+0000","last_clean":"2024-04-23T14:50:12.310419+0000","last_became_active":"2024-04-23T14:48:24.197714+0000","last_became_peered":"2024-04-23T14:48:24.197714+0000","last_unstale":"2024-04-23T14:50:12.310419+0000","last_undegraded":"2024-04-23T14:50:12.310419+0000","last_fullsized":"2024-04-23T14:50:12.310419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:41.208307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.312442+0000","last_change":"2024-04-23T14:48:24.205780+0000","last_active":"2024-04-23T14:50:12.312442+0000","last_peered":"2024-04-23T14:50:12.312442+0000","last_clean":"2024-04-23T14:50:12.312442+0000","last_became_active":"2024-04-23T14:48:24.205413+0000","last_became_peered":"2024-04-23T14:48:24.205413+0000","last_unstale":"2024-04-23T14:50:12.312442+0000","last_undegraded":"2024-04-23T14:50:12.312442+0000","last_fullsized":"2024-04-23T14:50:12.312442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:06.002666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314100+0000","last_change":"2024-04-23T14:48:24.205304+0000","last_active":"2024-04-23T14:50:12.314100+0000","last_peered":"2024-04-23T14:50:12.314100+0000","last_clean":"2024-04-23T14:50:12.314100+0000","last_became_active":"2024-04-23T14:48:24.204915+0000","last_became_peered":"2024-04-23T14:48:24.204915+0000","last_unstale":"2024-04-23T14:50:12.314100+0000","last_undegraded":"2024-04-23T14:50:12.314100+0000","last_fullsized":"2024-04-23T14:50:12.314100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:53.835101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314525+0000","last_change":"2024-04-23T14:48:24.208371+0000","last_active":"2024-04-23T14:50:12.314525+0000","last_peered":"2024-04-23T14:50:12.314525+0000","last_clean":"2024-04-23T14:50:12.314525+0000","last_became_active":"2024-04-23T14:48:24.208084+0000","last_became_peered":"2024-04-23T14:48:24.208084+0000","last_unstale":"2024-04-23T14:50:12.314525+0000","last_undegraded":"2024-04-23T14:50:12.314525+0000","last_fullsized":"2024-04-23T14:50:12.314525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:01.263469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323460+0000","last_change":"2024-04-23T14:48:24.204211+0000","last_active":"2024-04-23T14:50:12.323460+0000","last_peered":"2024-04-23T14:50:12.323460+0000","last_clean":"2024-04-23T14:50:12.323460+0000","last_became_active":"2024-04-23T14:48:24.203890+0000","last_became_peered":"2024-04-23T14:48:24.203890+0000","last_unstale":"2024-04-23T14:50:12.323460+0000","last_undegraded":"2024-04-23T14:50:12.323460+0000","last_fullsized":"2024-04-23T14:50:12.323460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:36:05.730785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327534+0000","last_change":"2024-04-23T14:48:24.204731+0000","last_active":"2024-04-23T14:50:12.327534+0000","last_peered":"2024-04-23T14:50:12.327534+0000","last_clean":"2024-04-23T14:50:12.327534+0000","last_became_active":"2024-04-23T14:48:24.204121+0000","last_became_peered":"2024-04-23T14:48:24.204121+0000","last_unstale":"2024-04-23T14:50:12.327534+0000","last_undegraded":"2024-04-23T14:50:12.327534+0000","last_fullsized":"2024-04-23T14:50:12.327534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:04:57.777924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.325564+0000","last_change":"2024-04-23T14:48:24.208297+0000","last_active":"2024-04-23T14:50:12.325564+0000","last_peered":"2024-04-23T14:50:12.325564+0000","last_clean":"2024-04-23T14:50:12.325564+0000","last_became_active":"2024-04-23T14:48:24.207960+0000","last_became_peered":"2024-04-23T14:48:24.207960+0000","last_unstale":"2024-04-23T14:50:12.325564+0000","last_undegraded":"2024-04-23T14:50:12.325564+0000","last_fullsized":"2024-04-23T14:50:12.325564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:46.393630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.305555+0000","last_change":"2024-04-23T14:48:24.212739+0000","last_active":"2024-04-23T14:50:12.305555+0000","last_peered":"2024-04-23T14:50:12.305555+0000","last_clean":"2024-04-23T14:50:12.305555+0000","last_became_active":"2024-04-23T14:48:24.212259+0000","last_became_peered":"2024-04-23T14:48:24.212259+0000","last_unstale":"2024-04-23T14:50:12.305555+0000","last_undegraded":"2024-04-23T14:50:12.305555+0000","last_fullsized":"2024-04-23T14:50:12.305555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:15:23.268086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692965+0000","last_change":"2024-04-23T14:48:28.692932+0000","last_active":"2024-04-23T14:49:44.692965+0000","last_peered":"2024-04-23T14:49:44.692965+0000","last_clean":"2024-04-23T14:49:44.692965+0000","last_became_active":"2024-04-23T14:48:28.692188+0000","last_became_peered":"2024-04-23T14:48:28.692188+0000","last_unstale":"2024-04-23T14:49:44.692965+0000","last_undegraded":"2024-04-23T14:49:44.692965+0000","last_fullsized":"2024-04-23T14:49:44.692965+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:44.695181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:14.090607+0000","last_change":"2024-04-23T14:48:23.167934+0000","last_active":"2024-04-23T14:50:14.090607+0000","last_peered":"2024-04-23T14:50:14.090607+0000","last_clean":"2024-04-23T14:50:14.090607+0000","last_became_active":"2024-04-23T14:48:23.167483+0000","last_became_peered":"2024-04-23T14:48:23.167483+0000","last_unstale":"2024-04-23T14:50:14.090607+0000","last_undegraded":"2024-04-23T14:50:14.090607+0000","last_fullsized":"2024-04-23T14:50:14.090607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:16.011021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.321292+0000","last_change":"2024-04-23T14:48:24.209028+0000","last_active":"2024-04-23T14:50:12.321292+0000","last_peered":"2024-04-23T14:50:12.321292+0000","last_clean":"2024-04-23T14:50:12.321292+0000","last_became_active":"2024-04-23T14:48:24.208648+0000","last_became_peered":"2024-04-23T14:48:24.208648+0000","last_unstale":"2024-04-23T14:50:12.321292+0000","last_undegraded":"2024-04-23T14:50:12.321292+0000","last_fullsized":"2024-04-23T14:50:12.321292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:28:17.432131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692177+0000","last_change":"2024-04-23T14:48:44.011555+0000","last_active":"2024-04-23T14:49:44.692177+0000","last_peered":"2024-04-23T14:49:44.692177+0000","last_clean":"2024-04-23T14:49:44.692177+0000","last_became_active":"2024-04-23T14:48:44.010556+0000","last_became_peered":"2024-04-23T14:48:44.010556+0000","last_unstale":"2024-04-23T14:49:44.692177+0000","last_undegraded":"2024-04-23T14:49:44.692177+0000","last_fullsized":"2024-04-23T14:49:44.692177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:03.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694045+0000","last_change":"2024-04-23T14:48:23.170507+0000","last_active":"2024-04-23T14:49:44.694045+0000","last_peered":"2024-04-23T14:49:44.694045+0000","last_clean":"2024-04-23T14:49:44.694045+0000","last_became_active":"2024-04-23T14:48:23.166478+0000","last_became_peered":"2024-04-23T14:48:23.166478+0000","last_unstale":"2024-04-23T14:49:44.694045+0000","last_undegraded":"2024-04-23T14:49:44.694045+0000","last_fullsized":"2024-04-23T14:49:44.694045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:13.163752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.321779+0000","last_change":"2024-04-23T14:48:24.202716+0000","last_active":"2024-04-23T14:50:12.321779+0000","last_peered":"2024-04-23T14:50:12.321779+0000","last_clean":"2024-04-23T14:50:12.321779+0000","last_became_active":"2024-04-23T14:48:24.201811+0000","last_became_peered":"2024-04-23T14:48:24.201811+0000","last_unstale":"2024-04-23T14:50:12.321779+0000","last_undegraded":"2024-04-23T14:50:12.321779+0000","last_fullsized":"2024-04-23T14:50:12.321779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:12.834493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692433+0000","last_change":"2024-04-23T14:48:28.690956+0000","last_active":"2024-04-23T14:49:44.692433+0000","last_peered":"2024-04-23T14:49:44.692433+0000","last_clean":"2024-04-23T14:49:44.692433+0000","last_became_active":"2024-04-23T14:48:28.689949+0000","last_became_peered":"2024-04-23T14:48:28.689949+0000","last_unstale":"2024-04-23T14:49:44.692433+0000","last_undegraded":"2024-04-23T14:49:44.692433+0000","last_fullsized":"2024-04-23T14:49:44.692433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:57.646314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.104408+0000","last_change":"2024-04-23T14:48:23.175420+0000","last_active":"2024-04-23T14:49:44.104408+0000","last_peered":"2024-04-23T14:49:44.104408+0000","last_clean":"2024-04-23T14:49:44.104408+0000","last_became_active":"2024-04-23T14:48:23.175009+0000","last_became_peered":"2024-04-23T14:48:23.175009+0000","last_unstale":"2024-04-23T14:49:44.104408+0000","last_undegraded":"2024-04-23T14:49:44.104408+0000","last_fullsized":"2024-04-23T14:49:44.104408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:17.902941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327223+0000","last_change":"2024-04-23T14:48:24.197838+0000","last_active":"2024-04-23T14:50:12.327223+0000","last_peered":"2024-04-23T14:50:12.327223+0000","last_clean":"2024-04-23T14:50:12.327223+0000","last_became_active":"2024-04-23T14:48:24.196112+0000","last_became_peered":"2024-04-23T14:48:24.196112+0000","last_unstale":"2024-04-23T14:50:12.327223+0000","last_undegraded":"2024-04-23T14:50:12.327223+0000","last_fullsized":"2024-04-23T14:50:12.327223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:06.829973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692434+0000","last_change":"2024-04-23T14:48:28.691296+0000","last_active":"2024-04-23T14:49:44.692434+0000","last_peered":"2024-04-23T14:49:44.692434+0000","last_clean":"2024-04-23T14:49:44.692434+0000","last_became_active":"2024-04-23T14:48:28.690695+0000","last_became_peered":"2024-04-23T14:48:28.690695+0000","last_unstale":"2024-04-23T14:49:44.692434+0000","last_undegraded":"2024-04-23T14:49:44.692434+0000","last_fullsized":"2024-04-23T14:49:44.692434+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:17.028864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103953+0000","last_change":"2024-04-23T14:48:23.162403+0000","last_active":"2024-04-23T14:49:44.103953+0000","last_peered":"2024-04-23T14:49:44.103953+0000","last_clean":"2024-04-23T14:49:44.103953+0000","last_became_active":"2024-04-23T14:48:23.162010+0000","last_became_peered":"2024-04-23T14:48:23.162010+0000","last_unstale":"2024-04-23T14:49:44.103953+0000","last_undegraded":"2024-04-23T14:49:44.103953+0000","last_fullsized":"2024-04-23T14:49:44.103953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:59.213131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323585+0000","last_change":"2024-04-23T14:48:24.197815+0000","last_active":"2024-04-23T14:50:12.323585+0000","last_peered":"2024-04-23T14:50:12.323585+0000","last_clean":"2024-04-23T14:50:12.323585+0000","last_became_active":"2024-04-23T14:48:24.194153+0000","last_became_peered":"2024-04-23T14:48:24.194153+0000","last_unstale":"2024-04-23T14:50:12.323585+0000","last_undegraded":"2024-04-23T14:50:12.323585+0000","last_fullsized":"2024-04-23T14:50:12.323585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:37:30.113646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693462+0000","last_change":"2024-04-23T14:48:28.693952+0000","last_active":"2024-04-23T14:49:44.693462+0000","last_peered":"2024-04-23T14:49:44.693462+0000","last_clean":"2024-04-23T14:49:44.693462+0000","last_became_active":"2024-04-23T14:48:28.691769+0000","last_became_peered":"2024-04-23T14:48:28.691769+0000","last_unstale":"2024-04-23T14:49:44.693462+0000","last_undegraded":"2024-04-23T14:49:44.693462+0000","last_fullsized":"2024-04-23T14:49:44.693462+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:40:29.883206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'7","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:14.107225+0000","last_change":"2024-04-23T14:48:23.174584+0000","last_active":"2024-04-23T14:50:14.107225+0000","last_peered":"2024-04-23T14:50:14.107225+0000","last_clean":"2024-04-23T14:50:14.107225+0000","last_became_active":"2024-04-23T14:48:23.170982+0000","last_became_peered":"2024-04-23T14:48:23.170982+0000","last_unstale":"2024-04-23T14:50:14.107225+0000","last_undegraded":"2024-04-23T14:50:14.107225+0000","last_fullsized":"2024-04-23T14:50:14.107225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:21.304149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.309477+0000","last_change":"2024-04-23T14:48:24.190360+0000","last_active":"2024-04-23T14:50:12.309477+0000","last_peered":"2024-04-23T14:50:12.309477+0000","last_clean":"2024-04-23T14:50:12.309477+0000","last_became_active":"2024-04-23T14:48:24.188138+0000","last_became_peered":"2024-04-23T14:48:24.188138+0000","last_unstale":"2024-04-23T14:50:12.309477+0000","last_undegraded":"2024-04-23T14:50:12.309477+0000","last_fullsized":"2024-04-23T14:50:12.309477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:55:27.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693378+0000","last_change":"2024-04-23T14:48:28.693859+0000","last_active":"2024-04-23T14:49:44.693378+0000","last_peered":"2024-04-23T14:49:44.693378+0000","last_clean":"2024-04-23T14:49:44.693378+0000","last_became_active":"2024-04-23T14:48:28.693338+0000","last_became_peered":"2024-04-23T14:48:28.693338+0000","last_unstale":"2024-04-23T14:49:44.693378+0000","last_undegraded":"2024-04-23T14:49:44.693378+0000","last_fullsized":"2024-04-23T14:49:44.693378+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:46.176604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092118+0000","last_change":"2024-04-23T14:48:23.173206+0000","last_active":"2024-04-23T14:49:44.092118+0000","last_peered":"2024-04-23T14:49:44.092118+0000","last_clean":"2024-04-23T14:49:44.092118+0000","last_became_active":"2024-04-23T14:48:23.172780+0000","last_became_peered":"2024-04-23T14:48:23.172780+0000","last_unstale":"2024-04-23T14:49:44.092118+0000","last_undegraded":"2024-04-23T14:49:44.092118+0000","last_fullsized":"2024-04-23T14:49:44.092118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:51:51.870634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322760+0000","last_change":"2024-04-23T14:48:44.010379+0000","last_active":"2024-04-23T14:50:12.322760+0000","last_peered":"2024-04-23T14:50:12.322760+0000","last_clean":"2024-04-23T14:50:12.322760+0000","last_became_active":"2024-04-23T14:48:44.009673+0000","last_became_peered":"2024-04-23T14:48:44.009673+0000","last_unstale":"2024-04-23T14:50:12.322760+0000","last_undegraded":"2024-04-23T14:50:12.322760+0000","last_fullsized":"2024-04-23T14:50:12.322760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:46.552062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.097792+0000","last_change":"2024-04-23T14:48:28.684186+0000","last_active":"2024-04-23T14:49:44.097792+0000","last_peered":"2024-04-23T14:49:44.097792+0000","last_clean":"2024-04-23T14:49:44.097792+0000","last_became_active":"2024-04-23T14:48:28.683109+0000","last_became_peered":"2024-04-23T14:48:28.683109+0000","last_unstale":"2024-04-23T14:49:44.097792+0000","last_undegraded":"2024-04-23T14:49:44.097792+0000","last_fullsized":"2024-04-23T14:49:44.097792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:47:03.782346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.089722+0000","last_change":"2024-04-23T14:48:23.159599+0000","last_active":"2024-04-23T14:49:44.089722+0000","last_peered":"2024-04-23T14:49:44.089722+0000","last_clean":"2024-04-23T14:49:44.089722+0000","last_became_active":"2024-04-23T14:48:23.158986+0000","last_became_peered":"2024-04-23T14:48:23.158986+0000","last_unstale":"2024-04-23T14:49:44.089722+0000","last_undegraded":"2024-04-23T14:49:44.089722+0000","last_fullsized":"2024-04-23T14:49:44.089722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:00.254987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.317997+0000","last_change":"2024-04-23T14:48:24.200644+0000","last_active":"2024-04-23T14:50:12.317997+0000","last_peered":"2024-04-23T14:50:12.317997+0000","last_clean":"2024-04-23T14:50:12.317997+0000","last_became_active":"2024-04-23T14:48:24.200236+0000","last_became_peered":"2024-04-23T14:48:24.200236+0000","last_unstale":"2024-04-23T14:50:12.317997+0000","last_undegraded":"2024-04-23T14:50:12.317997+0000","last_fullsized":"2024-04-23T14:50:12.317997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:51.634416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.102011+0000","last_change":"2024-04-23T14:48:28.699959+0000","last_active":"2024-04-23T14:49:44.102011+0000","last_peered":"2024-04-23T14:49:44.102011+0000","last_clean":"2024-04-23T14:49:44.102011+0000","last_became_active":"2024-04-23T14:48:28.699327+0000","last_became_peered":"2024-04-23T14:48:28.699327+0000","last_unstale":"2024-04-23T14:49:44.102011+0000","last_undegraded":"2024-04-23T14:49:44.102011+0000","last_fullsized":"2024-04-23T14:49:44.102011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:41:32.257355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092341+0000","last_change":"2024-04-23T14:48:23.165179+0000","last_active":"2024-04-23T14:49:44.092341+0000","last_peered":"2024-04-23T14:49:44.092341+0000","last_clean":"2024-04-23T14:49:44.092341+0000","last_became_active":"2024-04-23T14:48:23.164784+0000","last_became_peered":"2024-04-23T14:48:23.164784+0000","last_unstale":"2024-04-23T14:49:44.092341+0000","last_undegraded":"2024-04-23T14:49:44.092341+0000","last_fullsized":"2024-04-23T14:49:44.092341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:02.522867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323284+0000","last_change":"2024-04-23T14:48:24.202092+0000","last_active":"2024-04-23T14:50:12.323284+0000","last_peered":"2024-04-23T14:50:12.323284+0000","last_clean":"2024-04-23T14:50:12.323284+0000","last_became_active":"2024-04-23T14:48:24.200676+0000","last_became_peered":"2024-04-23T14:48:24.200676+0000","last_unstale":"2024-04-23T14:50:12.323284+0000","last_undegraded":"2024-04-23T14:50:12.323284+0000","last_fullsized":"2024-04-23T14:50:12.323284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:55:31.584366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692813+0000","last_change":"2024-04-23T14:48:28.692929+0000","last_active":"2024-04-23T14:49:44.692813+0000","last_peered":"2024-04-23T14:49:44.692813+0000","last_clean":"2024-04-23T14:49:44.692813+0000","last_became_active":"2024-04-23T14:48:28.692405+0000","last_became_peered":"2024-04-23T14:48:28.692405+0000","last_unstale":"2024-04-23T14:49:44.692813+0000","last_undegraded":"2024-04-23T14:49:44.692813+0000","last_fullsized":"2024-04-23T14:49:44.692813+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:13:30.063548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'5","reported_seq":199,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:15.108606+0000","last_change":"2024-04-23T14:48:23.165520+0000","last_active":"2024-04-23T14:50:15.108606+0000","last_peered":"2024-04-23T14:50:15.108606+0000","last_clean":"2024-04-23T14:50:15.108606+0000","last_became_active":"2024-04-23T14:48:23.163725+0000","last_became_peered":"2024-04-23T14:48:23.163725+0000","last_unstale":"2024-04-23T14:50:15.108606+0000","last_undegraded":"2024-04-23T14:50:15.108606+0000","last_fullsized":"2024-04-23T14:50:15.108606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:58.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":164,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.326957+0000","last_change":"2024-04-23T14:48:24.200779+0000","last_active":"2024-04-23T14:50:12.326957+0000","last_peered":"2024-04-23T14:50:12.326957+0000","last_clean":"2024-04-23T14:50:12.326957+0000","last_became_active":"2024-04-23T14:48:24.199391+0000","last_became_peered":"2024-04-23T14:48:24.199391+0000","last_unstale":"2024-04-23T14:50:12.326957+0000","last_undegraded":"2024-04-23T14:50:12.326957+0000","last_fullsized":"2024-04-23T14:50:12.326957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:26.333246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.101654+0000","last_change":"2024-04-23T14:48:28.688860+0000","last_active":"2024-04-23T14:49:44.101654+0000","last_peered":"2024-04-23T14:49:44.101654+0000","last_clean":"2024-04-23T14:49:44.101654+0000","last_became_active":"2024-04-23T14:48:28.688427+0000","last_became_peered":"2024-04-23T14:48:28.688427+0000","last_unstale":"2024-04-23T14:49:44.101654+0000","last_undegraded":"2024-04-23T14:49:44.101654+0000","last_fullsized":"2024-04-23T14:49:44.101654+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:02.196099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694327+0000","last_change":"2024-04-23T14:48:23.170515+0000","last_active":"2024-04-23T14:49:44.694327+0000","last_peered":"2024-04-23T14:49:44.694327+0000","last_clean":"2024-04-23T14:49:44.694327+0000","last_became_active":"2024-04-23T14:48:23.170078+0000","last_became_peered":"2024-04-23T14:48:23.170078+0000","last_unstale":"2024-04-23T14:49:44.694327+0000","last_undegraded":"2024-04-23T14:49:44.694327+0000","last_fullsized":"2024-04-23T14:49:44.694327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:33:52.560319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319388+0000","last_change":"2024-04-23T14:48:24.202989+0000","last_active":"2024-04-23T14:50:12.319388+0000","last_peered":"2024-04-23T14:50:12.319388+0000","last_clean":"2024-04-23T14:50:12.319388+0000","last_became_active":"2024-04-23T14:48:24.202334+0000","last_became_peered":"2024-04-23T14:48:24.202334+0000","last_unstale":"2024-04-23T14:50:12.319388+0000","last_undegraded":"2024-04-23T14:50:12.319388+0000","last_fullsized":"2024-04-23T14:50:12.319388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:48:16.044242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692731+0000","last_change":"2024-04-23T14:48:44.012817+0000","last_active":"2024-04-23T14:49:44.692731+0000","last_peered":"2024-04-23T14:49:44.692731+0000","last_clean":"2024-04-23T14:49:44.692731+0000","last_became_active":"2024-04-23T14:48:44.011680+0000","last_became_peered":"2024-04-23T14:48:44.011680+0000","last_unstale":"2024-04-23T14:49:44.692731+0000","last_undegraded":"2024-04-23T14:49:44.692731+0000","last_fullsized":"2024-04-23T14:49:44.692731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:36.289301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092951+0000","last_change":"2024-04-23T14:48:23.174183+0000","last_active":"2024-04-23T14:49:44.092951+0000","last_peered":"2024-04-23T14:49:44.092951+0000","last_clean":"2024-04-23T14:49:44.092951+0000","last_became_active":"2024-04-23T14:48:23.173345+0000","last_became_peered":"2024-04-23T14:48:23.173345+0000","last_unstale":"2024-04-23T14:49:44.092951+0000","last_undegraded":"2024-04-23T14:49:44.092951+0000","last_fullsized":"2024-04-23T14:49:44.092951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:24.557598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.326373+0000","last_change":"2024-04-23T14:48:24.187891+0000","last_active":"2024-04-23T14:50:12.326373+0000","last_peered":"2024-04-23T14:50:12.326373+0000","last_clean":"2024-04-23T14:50:12.326373+0000","last_became_active":"2024-04-23T14:48:24.187495+0000","last_became_peered":"2024-04-23T14:48:24.187495+0000","last_unstale":"2024-04-23T14:50:12.326373+0000","last_undegraded":"2024-04-23T14:50:12.326373+0000","last_fullsized":"2024-04-23T14:50:12.326373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:54.561153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.102433+0000","last_change":"2024-04-23T14:48:28.690722+0000","last_active":"2024-04-23T14:49:44.102433+0000","last_peered":"2024-04-23T14:49:44.102433+0000","last_clean":"2024-04-23T14:49:44.102433+0000","last_became_active":"2024-04-23T14:48:28.690294+0000","last_became_peered":"2024-04-23T14:48:28.690294+0000","last_unstale":"2024-04-23T14:49:44.102433+0000","last_undegraded":"2024-04-23T14:49:44.102433+0000","last_fullsized":"2024-04-23T14:49:44.102433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:50.657059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'38","reported_seq":240,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:15.115242+0000","last_change":"2024-04-23T14:48:23.164136+0000","last_active":"2024-04-23T14:50:15.115242+0000","last_peered":"2024-04-23T14:50:15.115242+0000","last_clean":"2024-04-23T14:50:15.115242+0000","last_became_active":"2024-04-23T14:48:23.162342+0000","last_became_peered":"2024-04-23T14:48:23.162342+0000","last_unstale":"2024-04-23T14:50:15.115242+0000","last_undegraded":"2024-04-23T14:50:15.115242+0000","last_fullsized":"2024-04-23T14:50:15.115242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:50:50.956006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64455,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":149,"num_write":40,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.317398+0000","last_change":"2024-04-23T14:48:24.199242+0000","last_active":"2024-04-23T14:50:12.317398+0000","last_peered":"2024-04-23T14:50:12.317398+0000","last_clean":"2024-04-23T14:50:12.317398+0000","last_became_active":"2024-04-23T14:48:24.198870+0000","last_became_peered":"2024-04-23T14:48:24.198870+0000","last_unstale":"2024-04-23T14:50:12.317398+0000","last_undegraded":"2024-04-23T14:50:12.317398+0000","last_fullsized":"2024-04-23T14:50:12.317398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:55.824352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.094048+0000","last_change":"2024-04-23T14:48:28.696469+0000","last_active":"2024-04-23T14:49:44.094048+0000","last_peered":"2024-04-23T14:49:44.094048+0000","last_clean":"2024-04-23T14:49:44.094048+0000","last_became_active":"2024-04-23T14:48:28.695973+0000","last_became_peered":"2024-04-23T14:48:28.695973+0000","last_unstale":"2024-04-23T14:49:44.094048+0000","last_undegraded":"2024-04-23T14:49:44.094048+0000","last_fullsized":"2024-04-23T14:49:44.094048+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:34.793357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693448+0000","last_change":"2024-04-23T14:48:23.155889+0000","last_active":"2024-04-23T14:49:44.693448+0000","last_peered":"2024-04-23T14:49:44.693448+0000","last_clean":"2024-04-23T14:49:44.693448+0000","last_became_active":"2024-04-23T14:48:23.155494+0000","last_became_peered":"2024-04-23T14:48:23.155494+0000","last_unstale":"2024-04-23T14:49:44.693448+0000","last_undegraded":"2024-04-23T14:49:44.693448+0000","last_fullsized":"2024-04-23T14:49:44.693448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:14.567618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316964+0000","last_change":"2024-04-23T14:48:24.216976+0000","last_active":"2024-04-23T14:50:12.316964+0000","last_peered":"2024-04-23T14:50:12.316964+0000","last_clean":"2024-04-23T14:50:12.316964+0000","last_became_active":"2024-04-23T14:48:24.216561+0000","last_became_peered":"2024-04-23T14:48:24.216561+0000","last_unstale":"2024-04-23T14:50:12.316964+0000","last_undegraded":"2024-04-23T14:50:12.316964+0000","last_fullsized":"2024-04-23T14:50:12.316964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:40:02.225167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.097793+0000","last_change":"2024-04-23T14:48:28.684812+0000","last_active":"2024-04-23T14:49:44.097793+0000","last_peered":"2024-04-23T14:49:44.097793+0000","last_clean":"2024-04-23T14:49:44.097793+0000","last_became_active":"2024-04-23T14:48:28.682284+0000","last_became_peered":"2024-04-23T14:48:28.682284+0000","last_unstale":"2024-04-23T14:49:44.097793+0000","last_undegraded":"2024-04-23T14:49:44.097793+0000","last_fullsized":"2024-04-23T14:49:44.097793+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:19.702778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092986+0000","last_change":"2024-04-23T14:48:23.173640+0000","last_active":"2024-04-23T14:49:44.092986+0000","last_peered":"2024-04-23T14:49:44.092986+0000","last_clean":"2024-04-23T14:49:44.092986+0000","last_became_active":"2024-04-23T14:48:23.173259+0000","last_became_peered":"2024-04-23T14:48:23.173259+0000","last_unstale":"2024-04-23T14:49:44.092986+0000","last_undegraded":"2024-04-23T14:49:44.092986+0000","last_fullsized":"2024-04-23T14:49:44.092986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:19.355340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318790+0000","last_change":"2024-04-23T14:48:24.198531+0000","last_active":"2024-04-23T14:50:12.318790+0000","last_peered":"2024-04-23T14:50:12.318790+0000","last_clean":"2024-04-23T14:50:12.318790+0000","last_became_active":"2024-04-23T14:48:24.198217+0000","last_became_peered":"2024-04-23T14:48:24.198217+0000","last_unstale":"2024-04-23T14:50:12.318790+0000","last_undegraded":"2024-04-23T14:50:12.318790+0000","last_fullsized":"2024-04-23T14:50:12.318790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:15:17.130409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103840+0000","last_change":"2024-04-23T14:48:28.690796+0000","last_active":"2024-04-23T14:49:44.103840+0000","last_peered":"2024-04-23T14:49:44.103840+0000","last_clean":"2024-04-23T14:49:44.103840+0000","last_became_active":"2024-04-23T14:48:28.686712+0000","last_became_peered":"2024-04-23T14:48:28.686712+0000","last_unstale":"2024-04-23T14:49:44.103840+0000","last_undegraded":"2024-04-23T14:49:44.103840+0000","last_fullsized":"2024-04-23T14:49:44.103840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:46.769848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:16.126297+0000","last_change":"2024-04-23T14:48:23.171753+0000","last_active":"2024-04-23T14:50:16.126297+0000","last_peered":"2024-04-23T14:50:16.126297+0000","last_clean":"2024-04-23T14:50:16.126297+0000","last_became_active":"2024-04-23T14:48:23.171177+0000","last_became_peered":"2024-04-23T14:48:23.171177+0000","last_unstale":"2024-04-23T14:50:16.126297+0000","last_undegraded":"2024-04-23T14:50:16.126297+0000","last_fullsized":"2024-04-23T14:50:16.126297+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:26:06.666044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318887+0000","last_change":"2024-04-23T14:48:24.206308+0000","last_active":"2024-04-23T14:50:12.318887+0000","last_peered":"2024-04-23T14:50:12.318887+0000","last_clean":"2024-04-23T14:50:12.318887+0000","last_became_active":"2024-04-23T14:48:24.205989+0000","last_became_peered":"2024-04-23T14:48:24.205989+0000","last_unstale":"2024-04-23T14:50:12.318887+0000","last_undegraded":"2024-04-23T14:50:12.318887+0000","last_fullsized":"2024-04-23T14:50:12.318887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:53.172538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.091001+0000","last_change":"2024-04-23T14:48:28.691952+0000","last_active":"2024-04-23T14:49:44.091001+0000","last_peered":"2024-04-23T14:49:44.091001+0000","last_clean":"2024-04-23T14:49:44.091001+0000","last_became_active":"2024-04-23T14:48:28.690781+0000","last_became_peered":"2024-04-23T14:48:28.690781+0000","last_unstale":"2024-04-23T14:49:44.091001+0000","last_undegraded":"2024-04-23T14:49:44.091001+0000","last_fullsized":"2024-04-23T14:49:44.091001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:50.832695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.102235+0000","last_change":"2024-04-23T14:48:23.169165+0000","last_active":"2024-04-23T14:49:44.102235+0000","last_peered":"2024-04-23T14:49:44.102235+0000","last_clean":"2024-04-23T14:49:44.102235+0000","last_became_active":"2024-04-23T14:48:23.168822+0000","last_became_peered":"2024-04-23T14:48:23.168822+0000","last_unstale":"2024-04-23T14:49:44.102235+0000","last_undegraded":"2024-04-23T14:49:44.102235+0000","last_fullsized":"2024-04-23T14:49:44.102235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:29:49.397506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.308252+0000","last_change":"2024-04-23T14:48:43.737904+0000","last_active":"2024-04-23T14:50:12.308252+0000","last_peered":"2024-04-23T14:50:12.308252+0000","last_clean":"2024-04-23T14:50:12.308252+0000","last_became_active":"2024-04-23T14:48:43.736639+0000","last_became_peered":"2024-04-23T14:48:43.736639+0000","last_unstale":"2024-04-23T14:50:12.308252+0000","last_undegraded":"2024-04-23T14:50:12.308252+0000","last_fullsized":"2024-04-23T14:50:12.308252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:43.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092306+0000","last_change":"2024-04-23T14:48:28.692199+0000","last_active":"2024-04-23T14:49:44.092306+0000","last_peered":"2024-04-23T14:49:44.092306+0000","last_clean":"2024-04-23T14:49:44.092306+0000","last_became_active":"2024-04-23T14:48:28.691673+0000","last_became_peered":"2024-04-23T14:48:28.691673+0000","last_unstale":"2024-04-23T14:49:44.092306+0000","last_undegraded":"2024-04-23T14:49:44.092306+0000","last_fullsized":"2024-04-23T14:49:44.092306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:19.323509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.104672+0000","last_change":"2024-04-23T14:48:23.167091+0000","last_active":"2024-04-23T14:49:44.104672+0000","last_peered":"2024-04-23T14:49:44.104672+0000","last_clean":"2024-04-23T14:49:44.104672+0000","last_became_active":"2024-04-23T14:48:23.166734+0000","last_became_peered":"2024-04-23T14:48:23.166734+0000","last_unstale":"2024-04-23T14:49:44.104672+0000","last_undegraded":"2024-04-23T14:49:44.104672+0000","last_fullsized":"2024-04-23T14:49:44.104672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:49:11.486630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316432+0000","last_change":"2024-04-23T14:48:24.208251+0000","last_active":"2024-04-23T14:50:12.316432+0000","last_peered":"2024-04-23T14:50:12.316432+0000","last_clean":"2024-04-23T14:50:12.316432+0000","last_became_active":"2024-04-23T14:48:24.207905+0000","last_became_peered":"2024-04-23T14:48:24.207905+0000","last_unstale":"2024-04-23T14:50:12.316432+0000","last_undegraded":"2024-04-23T14:50:12.316432+0000","last_fullsized":"2024-04-23T14:50:12.316432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:52.803336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103541+0000","last_change":"2024-04-23T14:48:44.013832+0000","last_active":"2024-04-23T14:49:44.103541+0000","last_peered":"2024-04-23T14:49:44.103541+0000","last_clean":"2024-04-23T14:49:44.103541+0000","last_became_active":"2024-04-23T14:48:44.012529+0000","last_became_peered":"2024-04-23T14:48:44.012529+0000","last_unstale":"2024-04-23T14:49:44.103541+0000","last_undegraded":"2024-04-23T14:49:44.103541+0000","last_fullsized":"2024-04-23T14:49:44.103541+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:49:50.898163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103192+0000","last_change":"2024-04-23T14:48:43.794890+0000","last_active":"2024-04-23T14:49:44.103192+0000","last_peered":"2024-04-23T14:49:44.103192+0000","last_clean":"2024-04-23T14:49:44.103192+0000","last_became_active":"2024-04-23T14:48:43.794157+0000","last_became_peered":"2024-04-23T14:48:43.794157+0000","last_unstale":"2024-04-23T14:49:44.103192+0000","last_undegraded":"2024-04-23T14:49:44.103192+0000","last_fullsized":"2024-04-23T14:49:44.103192+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:40.335060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.299065+0000","last_change":"2024-04-23T14:48:24.213085+0000","last_active":"2024-04-23T14:50:12.299065+0000","last_peered":"2024-04-23T14:50:12.299065+0000","last_clean":"2024-04-23T14:50:12.299065+0000","last_became_active":"2024-04-23T14:48:24.212634+0000","last_became_peered":"2024-04-23T14:48:24.212634+0000","last_unstale":"2024-04-23T14:50:12.299065+0000","last_undegraded":"2024-04-23T14:50:12.299065+0000","last_fullsized":"2024-04-23T14:50:12.299065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:56:16.680842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.090744+0000","last_change":"2024-04-23T14:48:28.691938+0000","last_active":"2024-04-23T14:49:44.090744+0000","last_peered":"2024-04-23T14:49:44.090744+0000","last_clean":"2024-04-23T14:49:44.090744+0000","last_became_active":"2024-04-23T14:48:28.691410+0000","last_became_peered":"2024-04-23T14:48:28.691410+0000","last_unstale":"2024-04-23T14:49:44.090744+0000","last_undegraded":"2024-04-23T14:49:44.090744+0000","last_fullsized":"2024-04-23T14:49:44.090744+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:52.384117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:17.100743+0000","last_change":"2024-04-23T14:48:23.174726+0000","last_active":"2024-04-23T14:50:17.100743+0000","last_peered":"2024-04-23T14:50:17.100743+0000","last_clean":"2024-04-23T14:50:17.100743+0000","last_became_active":"2024-04-23T14:48:23.174163+0000","last_became_peered":"2024-04-23T14:48:23.174163+0000","last_unstale":"2024-04-23T14:50:17.100743+0000","last_undegraded":"2024-04-23T14:50:17.100743+0000","last_fullsized":"2024-04-23T14:50:17.100743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:17.294653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.307123+0000","last_change":"2024-04-23T14:48:24.212406+0000","last_active":"2024-04-23T14:50:12.307123+0000","last_peered":"2024-04-23T14:50:12.307123+0000","last_clean":"2024-04-23T14:50:12.307123+0000","last_became_active":"2024-04-23T14:48:24.212025+0000","last_became_peered":"2024-04-23T14:48:24.212025+0000","last_unstale":"2024-04-23T14:50:12.307123+0000","last_undegraded":"2024-04-23T14:50:12.307123+0000","last_fullsized":"2024-04-23T14:50:12.307123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:09.890480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.091151+0000","last_change":"2024-04-23T14:48:28.868780+0000","last_active":"2024-04-23T14:49:44.091151+0000","last_peered":"2024-04-23T14:49:44.091151+0000","last_clean":"2024-04-23T14:49:44.091151+0000","last_became_active":"2024-04-23T14:48:28.868214+0000","last_became_peered":"2024-04-23T14:48:28.868214+0000","last_unstale":"2024-04-23T14:49:44.091151+0000","last_undegraded":"2024-04-23T14:49:44.091151+0000","last_fullsized":"2024-04-23T14:49:44.091151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:16:19.606569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.312883+0000","last_change":"2024-04-23T14:48:24.189017+0000","last_active":"2024-04-23T14:50:12.312883+0000","last_peered":"2024-04-23T14:50:12.312883+0000","last_clean":"2024-04-23T14:50:12.312883+0000","last_became_active":"2024-04-23T14:48:24.187165+0000","last_became_peered":"2024-04-23T14:48:24.187165+0000","last_unstale":"2024-04-23T14:50:12.312883+0000","last_undegraded":"2024-04-23T14:50:12.312883+0000","last_fullsized":"2024-04-23T14:50:12.312883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:44.844255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:17.127890+0000","last_change":"2024-04-23T14:48:23.174186+0000","last_active":"2024-04-23T14:50:17.127890+0000","last_peered":"2024-04-23T14:50:17.127890+0000","last_clean":"2024-04-23T14:50:17.127890+0000","last_became_active":"2024-04-23T14:48:23.173365+0000","last_became_peered":"2024-04-23T14:48:23.173365+0000","last_unstale":"2024-04-23T14:50:17.127890+0000","last_undegraded":"2024-04-23T14:50:17.127890+0000","last_fullsized":"2024-04-23T14:50:17.127890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:04.193405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694464+0000","last_change":"2024-04-23T14:48:28.689151+0000","last_active":"2024-04-23T14:49:44.694464+0000","last_peered":"2024-04-23T14:49:44.694464+0000","last_clean":"2024-04-23T14:49:44.694464+0000","last_became_active":"2024-04-23T14:48:28.688396+0000","last_became_peered":"2024-04-23T14:48:28.688396+0000","last_unstale":"2024-04-23T14:49:44.694464+0000","last_undegraded":"2024-04-23T14:49:44.694464+0000","last_fullsized":"2024-04-23T14:49:44.694464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:06.922068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327177+0000","last_change":"2024-04-23T14:48:24.214609+0000","last_active":"2024-04-23T14:50:12.327177+0000","last_peered":"2024-04-23T14:50:12.327177+0000","last_clean":"2024-04-23T14:50:12.327177+0000","last_became_active":"2024-04-23T14:48:24.211298+0000","last_became_peered":"2024-04-23T14:48:24.211298+0000","last_unstale":"2024-04-23T14:50:12.327177+0000","last_undegraded":"2024-04-23T14:50:12.327177+0000","last_fullsized":"2024-04-23T14:50:12.327177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:59.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692615+0000","last_change":"2024-04-23T14:48:23.154856+0000","last_active":"2024-04-23T14:49:44.692615+0000","last_peered":"2024-04-23T14:49:44.692615+0000","last_clean":"2024-04-23T14:49:44.692615+0000","last_became_active":"2024-04-23T14:48:23.154225+0000","last_became_peered":"2024-04-23T14:48:23.154225+0000","last_unstale":"2024-04-23T14:49:44.692615+0000","last_undegraded":"2024-04-23T14:49:44.692615+0000","last_fullsized":"2024-04-23T14:49:44.692615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:48.059364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":364,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693717+0000","last_change":"2024-04-23T14:46:43.008733+0000","last_active":"2024-04-23T14:49:44.693717+0000","last_peered":"2024-04-23T14:49:44.693717+0000","last_clean":"2024-04-23T14:49:44.693717+0000","last_became_active":"2024-04-23T14:46:43.008289+0000","last_became_peered":"2024-04-23T14:46:43.008289+0000","last_unstale":"2024-04-23T14:49:44.693717+0000","last_undegraded":"2024-04-23T14:49:44.693717+0000","last_fullsized":"2024-04-23T14:49:44.693717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:41:57.297296+0000","last_clean_scrub_stamp":"2024-04-23T14:41:57.297296+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:08:40.997119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.092984+0000","last_change":"2024-04-23T14:48:28.870098+0000","last_active":"2024-04-23T14:49:44.092984+0000","last_peered":"2024-04-23T14:49:44.092984+0000","last_clean":"2024-04-23T14:49:44.092984+0000","last_became_active":"2024-04-23T14:48:28.868925+0000","last_became_peered":"2024-04-23T14:48:28.868925+0000","last_unstale":"2024-04-23T14:49:44.092984+0000","last_undegraded":"2024-04-23T14:49:44.092984+0000","last_fullsized":"2024-04-23T14:49:44.092984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:22.408757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.305412+0000","last_change":"2024-04-23T14:48:24.189462+0000","last_active":"2024-04-23T14:50:12.305412+0000","last_peered":"2024-04-23T14:50:12.305412+0000","last_clean":"2024-04-23T14:50:12.305412+0000","last_became_active":"2024-04-23T14:48:24.188714+0000","last_became_peered":"2024-04-23T14:48:24.188714+0000","last_unstale":"2024-04-23T14:50:12.305412+0000","last_undegraded":"2024-04-23T14:50:12.305412+0000","last_fullsized":"2024-04-23T14:50:12.305412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:56.589476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.694607+0000","last_change":"2024-04-23T14:48:23.166096+0000","last_active":"2024-04-23T14:49:44.694607+0000","last_peered":"2024-04-23T14:49:44.694607+0000","last_clean":"2024-04-23T14:49:44.694607+0000","last_became_active":"2024-04-23T14:48:23.165514+0000","last_became_peered":"2024-04-23T14:48:23.165514+0000","last_unstale":"2024-04-23T14:49:44.694607+0000","last_undegraded":"2024-04-23T14:49:44.694607+0000","last_fullsized":"2024-04-23T14:49:44.694607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:27.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.097364+0000","last_change":"2024-04-23T14:48:28.690086+0000","last_active":"2024-04-23T14:49:44.097364+0000","last_peered":"2024-04-23T14:49:44.097364+0000","last_clean":"2024-04-23T14:49:44.097364+0000","last_became_active":"2024-04-23T14:48:28.689346+0000","last_became_peered":"2024-04-23T14:48:28.689346+0000","last_unstale":"2024-04-23T14:49:44.097364+0000","last_undegraded":"2024-04-23T14:49:44.097364+0000","last_fullsized":"2024-04-23T14:49:44.097364+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:02.594389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.120063+0000","last_change":"2024-04-23T14:49:44.119019+0000","last_active":"2024-04-23T14:49:44.120063+0000","last_peered":"2024-04-23T14:49:44.120063+0000","last_clean":"2024-04-23T14:49:44.120063+0000","last_became_active":"2024-04-23T14:49:44.104949+0000","last_became_peered":"2024-04-23T14:49:44.104949+0000","last_unstale":"2024-04-23T14:49:44.120063+0000","last_undegraded":"2024-04-23T14:49:44.120063+0000","last_fullsized":"2024-04-23T14:49:44.120063+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:55.343324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.310002+0000","last_change":"2024-04-23T14:48:24.190631+0000","last_active":"2024-04-23T14:50:12.310002+0000","last_peered":"2024-04-23T14:50:12.310002+0000","last_clean":"2024-04-23T14:50:12.310002+0000","last_became_active":"2024-04-23T14:48:24.190245+0000","last_became_peered":"2024-04-23T14:48:24.190245+0000","last_unstale":"2024-04-23T14:50:12.310002+0000","last_undegraded":"2024-04-23T14:50:12.310002+0000","last_fullsized":"2024-04-23T14:50:12.310002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:09.641687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692988+0000","last_change":"2024-04-23T14:48:28.867735+0000","last_active":"2024-04-23T14:49:44.692988+0000","last_peered":"2024-04-23T14:49:44.692988+0000","last_clean":"2024-04-23T14:49:44.692988+0000","last_became_active":"2024-04-23T14:48:28.867165+0000","last_became_peered":"2024-04-23T14:48:28.867165+0000","last_unstale":"2024-04-23T14:49:44.692988+0000","last_undegraded":"2024-04-23T14:49:44.692988+0000","last_fullsized":"2024-04-23T14:49:44.692988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:46.973396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103921+0000","last_change":"2024-04-23T14:48:23.159980+0000","last_active":"2024-04-23T14:49:44.103921+0000","last_peered":"2024-04-23T14:49:44.103921+0000","last_clean":"2024-04-23T14:49:44.103921+0000","last_became_active":"2024-04-23T14:48:23.158407+0000","last_became_peered":"2024-04-23T14:48:23.158407+0000","last_unstale":"2024-04-23T14:49:44.103921+0000","last_undegraded":"2024-04-23T14:49:44.103921+0000","last_fullsized":"2024-04-23T14:49:44.103921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:06:07.110430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.321493+0000","last_change":"2024-04-23T14:48:24.215285+0000","last_active":"2024-04-23T14:50:12.321493+0000","last_peered":"2024-04-23T14:50:12.321493+0000","last_clean":"2024-04-23T14:50:12.321493+0000","last_became_active":"2024-04-23T14:48:24.209934+0000","last_became_peered":"2024-04-23T14:48:24.209934+0000","last_unstale":"2024-04-23T14:50:12.321493+0000","last_undegraded":"2024-04-23T14:50:12.321493+0000","last_fullsized":"2024-04-23T14:50:12.321493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:00.673701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692474+0000","last_change":"2024-04-23T14:48:28.689933+0000","last_active":"2024-04-23T14:49:44.692474+0000","last_peered":"2024-04-23T14:49:44.692474+0000","last_clean":"2024-04-23T14:49:44.692474+0000","last_became_active":"2024-04-23T14:48:28.687999+0000","last_became_peered":"2024-04-23T14:48:28.687999+0000","last_unstale":"2024-04-23T14:49:44.692474+0000","last_undegraded":"2024-04-23T14:49:44.692474+0000","last_fullsized":"2024-04-23T14:49:44.692474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:10.605796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693376+0000","last_change":"2024-04-23T14:48:23.167935+0000","last_active":"2024-04-23T14:49:44.693376+0000","last_peered":"2024-04-23T14:49:44.693376+0000","last_clean":"2024-04-23T14:49:44.693376+0000","last_became_active":"2024-04-23T14:48:23.167597+0000","last_became_peered":"2024-04-23T14:48:23.167597+0000","last_unstale":"2024-04-23T14:49:44.693376+0000","last_undegraded":"2024-04-23T14:49:44.693376+0000","last_fullsized":"2024-04-23T14:49:44.693376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:14:25.667816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322141+0000","last_change":"2024-04-23T14:48:44.012004+0000","last_active":"2024-04-23T14:50:12.322141+0000","last_peered":"2024-04-23T14:50:12.322141+0000","last_clean":"2024-04-23T14:50:12.322141+0000","last_became_active":"2024-04-23T14:48:44.010779+0000","last_became_peered":"2024-04-23T14:48:44.010779+0000","last_unstale":"2024-04-23T14:50:12.322141+0000","last_undegraded":"2024-04-23T14:50:12.322141+0000","last_fullsized":"2024-04-23T14:50:12.322141+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:09.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693061+0000","last_change":"2024-04-23T14:48:44.013213+0000","last_active":"2024-04-23T14:49:44.693061+0000","last_peered":"2024-04-23T14:49:44.693061+0000","last_clean":"2024-04-23T14:49:44.693061+0000","last_became_active":"2024-04-23T14:48:44.012710+0000","last_became_peered":"2024-04-23T14:48:44.012710+0000","last_unstale":"2024-04-23T14:49:44.693061+0000","last_undegraded":"2024-04-23T14:49:44.693061+0000","last_fullsized":"2024-04-23T14:49:44.693061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:04.097096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.551488+0000","last_change":"2024-04-23T14:48:23.157529+0000","last_active":"2024-04-23T14:49:44.551488+0000","last_peered":"2024-04-23T14:49:44.551488+0000","last_clean":"2024-04-23T14:49:44.551488+0000","last_became_active":"2024-04-23T14:48:23.156780+0000","last_became_peered":"2024-04-23T14:48:23.156780+0000","last_unstale":"2024-04-23T14:49:44.551488+0000","last_undegraded":"2024-04-23T14:49:44.551488+0000","last_fullsized":"2024-04-23T14:49:44.551488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:32.747563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.269973+0000","last_change":"2024-04-23T14:48:24.196328+0000","last_active":"2024-04-23T14:50:12.269973+0000","last_peered":"2024-04-23T14:50:12.269973+0000","last_clean":"2024-04-23T14:50:12.269973+0000","last_became_active":"2024-04-23T14:48:24.195875+0000","last_became_peered":"2024-04-23T14:48:24.195875+0000","last_unstale":"2024-04-23T14:50:12.269973+0000","last_undegraded":"2024-04-23T14:50:12.269973+0000","last_fullsized":"2024-04-23T14:50:12.269973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:34:03.377786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103953+0000","last_change":"2024-04-23T14:48:28.692397+0000","last_active":"2024-04-23T14:49:44.103953+0000","last_peered":"2024-04-23T14:49:44.103953+0000","last_clean":"2024-04-23T14:49:44.103953+0000","last_became_active":"2024-04-23T14:48:28.691916+0000","last_became_peered":"2024-04-23T14:48:28.691916+0000","last_unstale":"2024-04-23T14:49:44.103953+0000","last_undegraded":"2024-04-23T14:49:44.103953+0000","last_fullsized":"2024-04-23T14:49:44.103953+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:59.357790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693013+0000","last_change":"2024-04-23T14:48:23.165072+0000","last_active":"2024-04-23T14:49:44.693013+0000","last_peered":"2024-04-23T14:49:44.693013+0000","last_clean":"2024-04-23T14:49:44.693013+0000","last_became_active":"2024-04-23T14:48:23.164732+0000","last_became_peered":"2024-04-23T14:48:23.164732+0000","last_unstale":"2024-04-23T14:49:44.693013+0000","last_undegraded":"2024-04-23T14:49:44.693013+0000","last_fullsized":"2024-04-23T14:49:44.693013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:04.921227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316567+0000","last_change":"2024-04-23T14:48:24.203322+0000","last_active":"2024-04-23T14:50:12.316567+0000","last_peered":"2024-04-23T14:50:12.316567+0000","last_clean":"2024-04-23T14:50:12.316567+0000","last_became_active":"2024-04-23T14:48:24.202889+0000","last_became_peered":"2024-04-23T14:48:24.202889+0000","last_unstale":"2024-04-23T14:50:12.316567+0000","last_undegraded":"2024-04-23T14:50:12.316567+0000","last_fullsized":"2024-04-23T14:50:12.316567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:18:19.880703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.693031+0000","last_change":"2024-04-23T14:48:28.686064+0000","last_active":"2024-04-23T14:49:44.693031+0000","last_peered":"2024-04-23T14:49:44.693031+0000","last_clean":"2024-04-23T14:49:44.693031+0000","last_became_active":"2024-04-23T14:48:28.685389+0000","last_became_peered":"2024-04-23T14:48:28.685389+0000","last_unstale":"2024-04-23T14:49:44.693031+0000","last_undegraded":"2024-04-23T14:49:44.693031+0000","last_fullsized":"2024-04-23T14:49:44.693031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:06:35.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692835+0000","last_change":"2024-04-23T14:48:23.164926+0000","last_active":"2024-04-23T14:49:44.692835+0000","last_peered":"2024-04-23T14:49:44.692835+0000","last_clean":"2024-04-23T14:49:44.692835+0000","last_became_active":"2024-04-23T14:48:23.164550+0000","last_became_peered":"2024-04-23T14:48:23.164550+0000","last_unstale":"2024-04-23T14:49:44.692835+0000","last_undegraded":"2024-04-23T14:49:44.692835+0000","last_fullsized":"2024-04-23T14:49:44.692835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:53:33.512403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322190+0000","last_change":"2024-04-23T14:48:24.208535+0000","last_active":"2024-04-23T14:50:12.322190+0000","last_peered":"2024-04-23T14:50:12.322190+0000","last_clean":"2024-04-23T14:50:12.322190+0000","last_became_active":"2024-04-23T14:48:24.208183+0000","last_became_peered":"2024-04-23T14:48:24.208183+0000","last_unstale":"2024-04-23T14:50:12.322190+0000","last_undegraded":"2024-04-23T14:50:12.322190+0000","last_fullsized":"2024-04-23T14:50:12.322190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:33:37.571569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.692690+0000","last_change":"2024-04-23T14:48:28.870055+0000","last_active":"2024-04-23T14:49:44.692690+0000","last_peered":"2024-04-23T14:49:44.692690+0000","last_clean":"2024-04-23T14:49:44.692690+0000","last_became_active":"2024-04-23T14:48:28.868671+0000","last_became_peered":"2024-04-23T14:48:28.868671+0000","last_unstale":"2024-04-23T14:49:44.692690+0000","last_undegraded":"2024-04-23T14:49:44.692690+0000","last_fullsized":"2024-04-23T14:49:44.692690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:26:23.756484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.103166+0000","last_change":"2024-04-23T14:48:23.171324+0000","last_active":"2024-04-23T14:49:44.103166+0000","last_peered":"2024-04-23T14:49:44.103166+0000","last_clean":"2024-04-23T14:49:44.103166+0000","last_became_active":"2024-04-23T14:48:23.170523+0000","last_became_peered":"2024-04-23T14:48:23.170523+0000","last_unstale":"2024-04-23T14:49:44.103166+0000","last_undegraded":"2024-04-23T14:49:44.103166+0000","last_fullsized":"2024-04-23T14:49:44.103166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:06.578119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323964+0000","last_change":"2024-04-23T14:48:24.199577+0000","last_active":"2024-04-23T14:50:12.323964+0000","last_peered":"2024-04-23T14:50:12.323964+0000","last_clean":"2024-04-23T14:50:12.323964+0000","last_became_active":"2024-04-23T14:48:24.199174+0000","last_became_peered":"2024-04-23T14:48:24.199174+0000","last_unstale":"2024-04-23T14:50:12.323964+0000","last_undegraded":"2024-04-23T14:50:12.323964+0000","last_fullsized":"2024-04-23T14:50:12.323964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:00.078179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.551474+0000","last_change":"2024-04-23T14:48:28.693416+0000","last_active":"2024-04-23T14:49:44.551474+0000","last_peered":"2024-04-23T14:49:44.551474+0000","last_clean":"2024-04-23T14:49:44.551474+0000","last_became_active":"2024-04-23T14:48:28.691823+0000","last_became_peered":"2024-04-23T14:48:28.691823+0000","last_unstale":"2024-04-23T14:49:44.551474+0000","last_undegraded":"2024-04-23T14:49:44.551474+0000","last_fullsized":"2024-04-23T14:49:44.551474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:11:41.027479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:16.112990+0000","last_change":"2024-04-23T14:48:23.160695+0000","last_active":"2024-04-23T14:50:16.112990+0000","last_peered":"2024-04-23T14:50:16.112990+0000","last_clean":"2024-04-23T14:50:16.112990+0000","last_became_active":"2024-04-23T14:48:23.160255+0000","last_became_peered":"2024-04-23T14:48:23.160255+0000","last_unstale":"2024-04-23T14:50:16.112990+0000","last_undegraded":"2024-04-23T14:50:16.112990+0000","last_fullsized":"2024-04-23T14:50:16.112990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:10.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.323826+0000","last_change":"2024-04-23T14:48:24.204085+0000","last_active":"2024-04-23T14:50:12.323826+0000","last_peered":"2024-04-23T14:50:12.323826+0000","last_clean":"2024-04-23T14:50:12.323826+0000","last_became_active":"2024-04-23T14:48:24.203100+0000","last_became_peered":"2024-04-23T14:48:24.203100+0000","last_unstale":"2024-04-23T14:50:12.323826+0000","last_undegraded":"2024-04-23T14:50:12.323826+0000","last_fullsized":"2024-04-23T14:50:12.323826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:06:42.999237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.101416+0000","last_change":"2024-04-23T14:48:28.687315+0000","last_active":"2024-04-23T14:49:44.101416+0000","last_peered":"2024-04-23T14:49:44.101416+0000","last_clean":"2024-04-23T14:49:44.101416+0000","last_became_active":"2024-04-23T14:48:28.686867+0000","last_became_peered":"2024-04-23T14:48:28.686867+0000","last_unstale":"2024-04-23T14:49:44.101416+0000","last_undegraded":"2024-04-23T14:49:44.101416+0000","last_fullsized":"2024-04-23T14:49:44.101416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:49.455073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.093744+0000","last_change":"2024-04-23T14:48:23.154736+0000","last_active":"2024-04-23T14:49:44.093744+0000","last_peered":"2024-04-23T14:49:44.093744+0000","last_clean":"2024-04-23T14:49:44.093744+0000","last_became_active":"2024-04-23T14:48:23.154388+0000","last_became_peered":"2024-04-23T14:48:23.154388+0000","last_unstale":"2024-04-23T14:49:44.093744+0000","last_undegraded":"2024-04-23T14:49:44.093744+0000","last_fullsized":"2024-04-23T14:49:44.093744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:16.856764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319204+0000","last_change":"2024-04-23T14:48:43.737734+0000","last_active":"2024-04-23T14:50:12.319204+0000","last_peered":"2024-04-23T14:50:12.319204+0000","last_clean":"2024-04-23T14:50:12.319204+0000","last_became_active":"2024-04-23T14:48:43.736678+0000","last_became_peered":"2024-04-23T14:48:43.736678+0000","last_unstale":"2024-04-23T14:50:12.319204+0000","last_undegraded":"2024-04-23T14:50:12.319204+0000","last_fullsized":"2024-04-23T14:50:12.319204+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:57.583820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.091785+0000","last_change":"2024-04-23T14:48:28.695478+0000","last_active":"2024-04-23T14:49:44.091785+0000","last_peered":"2024-04-23T14:49:44.091785+0000","last_clean":"2024-04-23T14:49:44.091785+0000","last_became_active":"2024-04-23T14:48:28.694836+0000","last_became_peered":"2024-04-23T14:48:28.694836+0000","last_unstale":"2024-04-23T14:49:44.091785+0000","last_undegraded":"2024-04-23T14:49:44.091785+0000","last_fullsized":"2024-04-23T14:49:44.091785+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:27.625625+0000","last_clean_scrub_stamp":"2024-04-23T14:48:27.625625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:11:16.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:49:44.090869+0000","last_change":"2024-04-23T14:48:23.164866+0000","last_active":"2024-04-23T14:49:44.090869+0000","last_peered":"2024-04-23T14:49:44.090869+0000","last_clean":"2024-04-23T14:49:44.090869+0000","last_became_active":"2024-04-23T14:48:23.164570+0000","last_became_peered":"2024-04-23T14:48:23.164570+0000","last_unstale":"2024-04-23T14:49:44.090869+0000","last_undegraded":"2024-04-23T14:49:44.090869+0000","last_fullsized":"2024-04-23T14:49:44.090869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:22.100979+0000","last_clean_scrub_stamp":"2024-04-23T14:48:22.100979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:48.247715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.319319+0000","last_change":"2024-04-23T14:48:24.202600+0000","last_active":"2024-04-23T14:50:12.319319+0000","last_peered":"2024-04-23T14:50:12.319319+0000","last_clean":"2024-04-23T14:50:12.319319+0000","last_became_active":"2024-04-23T14:48:24.202243+0000","last_became_peered":"2024-04-23T14:48:24.202243+0000","last_unstale":"2024-04-23T14:50:12.319319+0000","last_undegraded":"2024-04-23T14:50:12.319319+0000","last_fullsized":"2024-04-23T14:50:12.319319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:19.162967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.317248+0000","last_change":"2024-04-23T14:48:24.206142+0000","last_active":"2024-04-23T14:50:12.317248+0000","last_peered":"2024-04-23T14:50:12.317248+0000","last_clean":"2024-04-23T14:50:12.317248+0000","last_became_active":"2024-04-23T14:48:24.203397+0000","last_became_peered":"2024-04-23T14:48:24.203397+0000","last_unstale":"2024-04-23T14:50:12.317248+0000","last_undegraded":"2024-04-23T14:50:12.317248+0000","last_fullsized":"2024-04-23T14:50:12.317248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:35:56.363914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.311297+0000","last_change":"2024-04-23T14:48:24.197058+0000","last_active":"2024-04-23T14:50:12.311297+0000","last_peered":"2024-04-23T14:50:12.311297+0000","last_clean":"2024-04-23T14:50:12.311297+0000","last_became_active":"2024-04-23T14:48:24.196662+0000","last_became_peered":"2024-04-23T14:48:24.196662+0000","last_unstale":"2024-04-23T14:50:12.311297+0000","last_undegraded":"2024-04-23T14:50:12.311297+0000","last_fullsized":"2024-04-23T14:50:12.311297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.884032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.320193+0000","last_change":"2024-04-23T14:48:24.213823+0000","last_active":"2024-04-23T14:50:12.320193+0000","last_peered":"2024-04-23T14:50:12.320193+0000","last_clean":"2024-04-23T14:50:12.320193+0000","last_became_active":"2024-04-23T14:48:24.213480+0000","last_became_peered":"2024-04-23T14:48:24.213480+0000","last_unstale":"2024-04-23T14:50:12.320193+0000","last_undegraded":"2024-04-23T14:50:12.320193+0000","last_fullsized":"2024-04-23T14:50:12.320193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:10:03.046216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314893+0000","last_change":"2024-04-23T14:48:24.199440+0000","last_active":"2024-04-23T14:50:12.314893+0000","last_peered":"2024-04-23T14:50:12.314893+0000","last_clean":"2024-04-23T14:50:12.314893+0000","last_became_active":"2024-04-23T14:48:24.199119+0000","last_became_peered":"2024-04-23T14:48:24.199119+0000","last_unstale":"2024-04-23T14:50:12.314893+0000","last_undegraded":"2024-04-23T14:50:12.314893+0000","last_fullsized":"2024-04-23T14:50:12.314893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:21:34.638393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318351+0000","last_change":"2024-04-23T14:48:43.729061+0000","last_active":"2024-04-23T14:50:12.318351+0000","last_peered":"2024-04-23T14:50:12.318351+0000","last_clean":"2024-04-23T14:50:12.318351+0000","last_became_active":"2024-04-23T14:48:43.728485+0000","last_became_peered":"2024-04-23T14:48:43.728485+0000","last_unstale":"2024-04-23T14:50:12.318351+0000","last_undegraded":"2024-04-23T14:50:12.318351+0000","last_fullsized":"2024-04-23T14:50:12.318351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:44:02.348446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.316548+0000","last_change":"2024-04-23T14:48:24.204207+0000","last_active":"2024-04-23T14:50:12.316548+0000","last_peered":"2024-04-23T14:50:12.316548+0000","last_clean":"2024-04-23T14:50:12.316548+0000","last_became_active":"2024-04-23T14:48:24.203325+0000","last_became_peered":"2024-04-23T14:48:24.203325+0000","last_unstale":"2024-04-23T14:50:12.316548+0000","last_undegraded":"2024-04-23T14:50:12.316548+0000","last_fullsized":"2024-04-23T14:50:12.316548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:00.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.309076+0000","last_change":"2024-04-23T14:48:24.191811+0000","last_active":"2024-04-23T14:50:12.309076+0000","last_peered":"2024-04-23T14:50:12.309076+0000","last_clean":"2024-04-23T14:50:12.309076+0000","last_became_active":"2024-04-23T14:48:24.191458+0000","last_became_peered":"2024-04-23T14:48:24.191458+0000","last_unstale":"2024-04-23T14:50:12.309076+0000","last_undegraded":"2024-04-23T14:50:12.309076+0000","last_fullsized":"2024-04-23T14:50:12.309076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:11.676842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.309460+0000","last_change":"2024-04-23T14:48:24.214997+0000","last_active":"2024-04-23T14:50:12.309460+0000","last_peered":"2024-04-23T14:50:12.309460+0000","last_clean":"2024-04-23T14:50:12.309460+0000","last_became_active":"2024-04-23T14:48:24.211941+0000","last_became_peered":"2024-04-23T14:48:24.211941+0000","last_unstale":"2024-04-23T14:50:12.309460+0000","last_undegraded":"2024-04-23T14:50:12.309460+0000","last_fullsized":"2024-04-23T14:50:12.309460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:29.903690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.322462+0000","last_change":"2024-04-23T14:48:24.202327+0000","last_active":"2024-04-23T14:50:12.322462+0000","last_peered":"2024-04-23T14:50:12.322462+0000","last_clean":"2024-04-23T14:50:12.322462+0000","last_became_active":"2024-04-23T14:48:24.201986+0000","last_became_peered":"2024-04-23T14:48:24.201986+0000","last_unstale":"2024-04-23T14:50:12.322462+0000","last_undegraded":"2024-04-23T14:50:12.322462+0000","last_fullsized":"2024-04-23T14:50:12.322462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:04:48.633762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.318326+0000","last_change":"2024-04-23T14:48:24.202931+0000","last_active":"2024-04-23T14:50:12.318326+0000","last_peered":"2024-04-23T14:50:12.318326+0000","last_clean":"2024-04-23T14:50:12.318326+0000","last_became_active":"2024-04-23T14:48:24.201767+0000","last_became_peered":"2024-04-23T14:48:24.201767+0000","last_unstale":"2024-04-23T14:50:12.318326+0000","last_undegraded":"2024-04-23T14:50:12.318326+0000","last_fullsized":"2024-04-23T14:50:12.318326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:39.542403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.327236+0000","last_change":"2024-04-23T14:48:24.216891+0000","last_active":"2024-04-23T14:50:12.327236+0000","last_peered":"2024-04-23T14:50:12.327236+0000","last_clean":"2024-04-23T14:50:12.327236+0000","last_became_active":"2024-04-23T14:48:24.216419+0000","last_became_peered":"2024-04-23T14:48:24.216419+0000","last_unstale":"2024-04-23T14:50:12.327236+0000","last_undegraded":"2024-04-23T14:50:12.327236+0000","last_fullsized":"2024-04-23T14:50:12.327236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:42.302965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.320288+0000","last_change":"2024-04-23T14:48:24.206828+0000","last_active":"2024-04-23T14:50:12.320288+0000","last_peered":"2024-04-23T14:50:12.320288+0000","last_clean":"2024-04-23T14:50:12.320288+0000","last_became_active":"2024-04-23T14:48:24.203562+0000","last_became_peered":"2024-04-23T14:48:24.203562+0000","last_unstale":"2024-04-23T14:50:12.320288+0000","last_undegraded":"2024-04-23T14:50:12.320288+0000","last_fullsized":"2024-04-23T14:50:12.320288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:59.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-23T14:50:12.314268+0000","last_change":"2024-04-23T14:48:24.208440+0000","last_active":"2024-04-23T14:50:12.314268+0000","last_peered":"2024-04-23T14:50:12.314268+0000","last_clean":"2024-04-23T14:50:12.314268+0000","last_became_active":"2024-04-23T14:48:24.208052+0000","last_became_peered":"2024-04-23T14:48:24.208052+0000","last_unstale":"2024-04-23T14:50:12.314268+0000","last_undegraded":"2024-04-23T14:50:12.314268+0000","last_fullsized":"2024-04-23T14:50:12.314268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:48:23.120147+0000","last_clean_scrub_stamp":"2024-04-23T14:48:23.120147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:19.906675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71409,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":868,"num_read_kb":510,"num_write":250,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":214227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383719,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":520224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645357,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32896,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712256,"statfs":{"total":95995035648,"available":95961350144,"internally_reserved":0,"allocated":1761280,"data_stored":1171383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808885,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":524138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070525,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":520308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332164,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1683456,"data_stored":1117058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495691,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":515546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":581031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738484,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1089536,"data_stored":517002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":581783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":515254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":519620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757331,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1691648,"data_stored":1112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T14:50:22.902 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-23T14:50:22.902 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T14:50:22.902 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-23T14:50:22.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-23T14:50:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:22 smithi007 ceph-mon[27906]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:50:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:22 smithi137 ceph-mon[31694]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:50:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:22 smithi186 ceph-mon[31814]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:50:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:23 smithi007 ceph-mon[27906]: pgmap v433: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:24.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:23 smithi137 ceph-mon[31694]: pgmap v433: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:24.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:23 smithi186 ceph-mon[31814]: pgmap v433: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 -- 172.21.15.7:0/2551181004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6010e460 msgr2=0x7fed60116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 --2- 172.21.15.7:0/2551181004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6010e460 0x7fed60116030 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fed5800b0d0 tx=0x7fed5800b3e0 comp rx=0 tx=0).stop 2024-04-23T14:50:25.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 -- 172.21.15.7:0/2551181004 shutdown_connections 2024-04-23T14:50:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 --2- 172.21.15.7:0/2551181004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed6010e460 0x7fed60116030 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 --2- 172.21.15.7:0/2551181004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed60109380 0x7fed60109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 --2- 172.21.15.7:0/2551181004 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed60109d30 0x7fed6010dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 -- 172.21.15.7:0/2551181004 >> 172.21.15.7:0/2551181004 conn(0x7fed600762c0 msgr2=0x7fed60107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 -- 172.21.15.7:0/2551181004 shutdown_connections 2024-04-23T14:50:25.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.714+0000 7fed65600700 1 -- 172.21.15.7:0/2551181004 wait complete. 2024-04-23T14:50:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.715+0000 7fed65600700 1 Processor -- start 2024-04-23T14:50:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 -- start start 2024-04-23T14:50:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 0x7fed6019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed60109d30 0x7fed6019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed6010e460 0x7fed601a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fed60119300 con 0x7fed60109380 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed60119180 con 0x7fed6010e460 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed65600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fed60119480 con 0x7fed60109d30 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed5ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 0x7fed6019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed5ea00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 0x7fed6019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38300/0 (socket says 172.21.15.7:38300) 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.716+0000 7fed5ea00700 1 -- 172.21.15.7:0/3670858340 learned_addr learned my addr 172.21.15.7:0/3670858340 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5e000700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed60109d30 0x7fed6019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5f400700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed6010e460 0x7fed601a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5ea00700 1 -- 172.21.15.7:0/3670858340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed60109d30 msgr2=0x7fed6019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5ea00700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed60109d30 0x7fed6019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5ea00700 1 -- 172.21.15.7:0/3670858340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed6010e460 msgr2=0x7fed601a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5ea00700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed6010e460 0x7fed601a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5ea00700 1 -- 172.21.15.7:0/3670858340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed601a4740 con 0x7fed60109380 2024-04-23T14:50:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.717+0000 7fed5ea00700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 0x7fed6019f730 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fed5000d950 tx=0x7fed5000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.718+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50016070 con 0x7fed60109380 2024-04-23T14:50:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.718+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed50010460 con 0x7fed60109380 2024-04-23T14:50:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.718+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5000f620 con 0x7fed60109380 2024-04-23T14:50:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.718+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed601a4a30 con 0x7fed60109380 2024-04-23T14:50:25.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.718+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed601ac2b0 con 0x7fed60109380 2024-04-23T14:50:25.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.719+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed600697e0 con 0x7fed60109380 2024-04-23T14:50:25.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.722+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fed50019070 con 0x7fed60109380 2024-04-23T14:50:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.723+0000 7fed57400700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fed440a3cc0 0x7fed440a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.723+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fed500d03d0 con 0x7fed60109380 2024-04-23T14:50:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.723+0000 7fed5e000700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fed440a3cc0 0x7fed440a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:25.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.724+0000 7fed5e000700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fed440a3cc0 0x7fed440a6180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fed4c005950 tx=0x7fed4c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:25.728+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fed5009c9d0 con 0x7fed60109380 2024-04-23T14:50:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.007+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed6002e1a0 con 0x7fed60109380 2024-04-23T14:50:26.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:25 smithi007 ceph-mon[27906]: pgmap v434: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.008+0000 7fed57400700 1 -- 172.21.15.7:0/3670858340 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fed5009c2d0 con 0x7fed60109380 2024-04-23T14:50:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:26.010 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fed440a3cc0 msgr2=0x7fed440a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fed440a3cc0 0x7fed440a6180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fed4c005950 tx=0x7fed4c0058e0 comp rx=0 tx=0).stop 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 msgr2=0x7fed6019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 0x7fed6019f730 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fed5000d950 tx=0x7fed5000dd10 comp rx=0 tx=0).stop 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 shutdown_connections 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fed440a3cc0 0x7fed440a6180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed6010e460 0x7fed601a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed60109380 0x7fed6019f730 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 --2- 172.21.15.7:0/3670858340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed60109d30 0x7fed6019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 >> 172.21.15.7:0/3670858340 conn(0x7fed600762c0 msgr2=0x7fed60076840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:26.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.012+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 shutdown_connections 2024-04-23T14:50:26.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:26.013+0000 7fed65600700 1 -- 172.21.15.7:0/3670858340 wait complete. 2024-04-23T14:50:26.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:25 smithi137 ceph-mon[31694]: pgmap v434: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:50:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:25 smithi186 ceph-mon[31814]: pgmap v434: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T14:50:26.854 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-23T14:50:26.855 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:50:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:26 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3670858340' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T14:50:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.084+0000 7f6e19800640 1 -- 172.21.15.7:0/2412519721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e140769c0 msgr2=0x7f6e14076de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.084+0000 7f6e19800640 1 --2- 172.21.15.7:0/2412519721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e140769c0 0x7f6e14076de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009900 tx=0x7f6e0402a410 comp rx=0 tx=0).stop 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 -- 172.21.15.7:0/2412519721 shutdown_connections 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 --2- 172.21.15.7:0/2412519721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e14077c00 0x7f6e14078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 --2- 172.21.15.7:0/2412519721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e140785a0 0x7f6e14078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 --2- 172.21.15.7:0/2412519721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e140769c0 0x7f6e14076de0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 -- 172.21.15.7:0/2412519721 >> 172.21.15.7:0/2412519721 conn(0x7f6e140ff7f0 msgr2=0x7f6e14101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 -- 172.21.15.7:0/2412519721 shutdown_connections 2024-04-23T14:50:27.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.085+0000 7f6e19800640 1 -- 172.21.15.7:0/2412519721 wait complete. 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 Processor -- start 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 -- start start 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e140769c0 0x7f6e1419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 0x7f6e1419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e140785a0 0x7f6e141a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14114200 con 0x7f6e14077c00 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14114080 con 0x7f6e140785a0 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.086+0000 7f6e19800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14114380 con 0x7f6e140769c0 2024-04-23T14:50:27.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 0x7f6e1419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 0x7f6e1419edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38324/0 (socket says 172.21.15.7:38324) 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 -- 172.21.15.7:0/3766679534 learned_addr learned my addr 172.21.15.7:0/3766679534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12a00640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e140769c0 0x7f6e1419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e13400640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e140785a0 0x7f6e141a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 -- 172.21.15.7:0/3766679534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e140769c0 msgr2=0x7f6e1419e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e140769c0 0x7f6e1419e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 -- 172.21.15.7:0/3766679534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e140785a0 msgr2=0x7f6e141a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e140785a0 0x7f6e141a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 -- 172.21.15.7:0/3766679534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e141a64a0 con 0x7f6e14077c00 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.087+0000 7f6e12000640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 0x7f6e1419edc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000d950 tx=0x7f6e0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.088+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00017030 con 0x7f6e14077c00 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.088+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e00004020 con 0x7f6e14077c00 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.088+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e141a6790 con 0x7f6e14077c00 2024-04-23T14:50:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.088+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e000047a0 con 0x7f6e14077c00 2024-04-23T14:50:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.088+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e141a6ce0 con 0x7f6e14077c00 2024-04-23T14:50:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.089+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e14110dd0 con 0x7f6e14077c00 2024-04-23T14:50:27.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.092+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f6e000041d0 con 0x7f6e14077c00 2024-04-23T14:50:27.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.093+0000 7f6e0b400640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6df80a3bb0 0x7f6df80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.093+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f6e000d0390 con 0x7f6e14077c00 2024-04-23T14:50:27.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.093+0000 7f6e12a00640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6df80a3bb0 0x7f6df80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.094+0000 7f6e12a00640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6df80a3bb0 0x7f6df80a6070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e04000c00 tx=0x7f6e040314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.098+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6e0009c990 con 0x7f6e14077c00 2024-04-23T14:50:27.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.305+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e14062c00 con 0x7f6e14077c00 2024-04-23T14:50:27.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.310+0000 7f6e0b400640 1 -- 172.21.15.7:0/3766679534 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24630 (secure 0 0 0) 0x7f6e0009c290 con 0x7f6e14077c00 2024-04-23T14:50:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:27.312 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:49:44.075188+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6df80a3bb0 msgr2=0x7f6df80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6df80a3bb0 0x7f6df80a6070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e04000c00 tx=0x7f6e040314a0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 msgr2=0x7f6e1419edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 0x7f6e1419edc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000d950 tx=0x7f6e0000de10 comp rx=0 tx=0).stop 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 shutdown_connections 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f6df80a3bb0 0x7f6df80a6070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e140785a0 0x7f6e141a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e14077c00 0x7f6e1419edc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 --2- 172.21.15.7:0/3766679534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e140769c0 0x7f6e1419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 >> 172.21.15.7:0/3766679534 conn(0x7f6e140ff7f0 msgr2=0x7f6e14100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 shutdown_connections 2024-04-23T14:50:27.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.313+0000 7f6e19800640 1 -- 172.21.15.7:0/3766679534 wait complete. 2024-04-23T14:50:27.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:50:27.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:50:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:26 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3670858340' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T14:50:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:26 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3670858340' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T14:50:27.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 -- 172.21.15.7:0/2504356027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 msgr2=0x7f442810a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 --2- 172.21.15.7:0/2504356027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f442810a040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4420009900 tx=0x7f442002a410 comp rx=0 tx=0).stop 2024-04-23T14:50:27.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 -- 172.21.15.7:0/2504356027 shutdown_connections 2024-04-23T14:50:27.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 --2- 172.21.15.7:0/2504356027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44281052c0 0x7f44281076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 --2- 172.21.15.7:0/2504356027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f442810a040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 --2- 172.21.15.7:0/2504356027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4428102990 0x7f4428104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 -- 172.21.15.7:0/2504356027 >> 172.21.15.7:0/2504356027 conn(0x7f44280fc3a0 msgr2=0x7f44280fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:27.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.556+0000 7f4427e00640 1 -- 172.21.15.7:0/2504356027 shutdown_connections 2024-04-23T14:50:27.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.557+0000 7f4427e00640 1 -- 172.21.15.7:0/2504356027 wait complete. 2024-04-23T14:50:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.557+0000 7f4427e00640 1 Processor -- start 2024-04-23T14:50:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 -- start start 2024-04-23T14:50:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4428102990 0x7f442819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44281052c0 0x7f442819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f44281a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f442810daa0 con 0x7f4428107bf0 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f442810d920 con 0x7f44281052c0 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f442810dc20 con 0x7f4428102990 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f44281a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f44281a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38342/0 (socket says 172.21.15.7:38342) 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4427400640 1 -- 172.21.15.7:0/2970337271 learned_addr learned my addr 172.21.15.7:0/2970337271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.558+0000 7f4426a00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4428102990 0x7f442819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4426000640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44281052c0 0x7f442819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4427400640 1 -- 172.21.15.7:0/2970337271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4428102990 msgr2=0x7f442819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4427400640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4428102990 0x7f442819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4427400640 1 -- 172.21.15.7:0/2970337271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44281052c0 msgr2=0x7f442819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4427400640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44281052c0 0x7f442819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4427400640 1 -- 172.21.15.7:0/2970337271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44281a1f30 con 0x7f4428107bf0 2024-04-23T14:50:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f4427400640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f44281a18c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4420005ab0 tx=0x7f4420003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.559+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442003f070 con 0x7f4428107bf0 2024-04-23T14:50:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.560+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4420003e40 con 0x7f4428107bf0 2024-04-23T14:50:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.560+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44281a21c0 con 0x7f4428107bf0 2024-04-23T14:50:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.560+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420035030 con 0x7f4428107bf0 2024-04-23T14:50:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.560+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44281a26b0 con 0x7f4428107bf0 2024-04-23T14:50:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.561+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44281096e0 con 0x7f4428107bf0 2024-04-23T14:50:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.563+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f4420042070 con 0x7f4428107bf0 2024-04-23T14:50:27.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.564+0000 7f441f400640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f440c0a3bb0 0x7f440c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:27.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.565+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f44200f10d0 con 0x7f4428107bf0 2024-04-23T14:50:27.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.565+0000 7f4426a00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f440c0a3bb0 0x7f440c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:27.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.566+0000 7f4426a00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f440c0a3bb0 0x7f440c0a6070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4410005fd0 tx=0x7f441000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:27.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.569+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f44200bd6d0 con 0x7f4428107bf0 2024-04-23T14:50:27.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.772+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4428062c00 con 0x7f4428107bf0 2024-04-23T14:50:27.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.773+0000 7f441f400640 1 -- 172.21.15.7:0/2970337271 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f442003be20 con 0x7f4428107bf0 2024-04-23T14:50:27.775 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:50:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f440c0a3bb0 msgr2=0x7f440c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f440c0a3bb0 0x7f440c0a6070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4410005fd0 tx=0x7f441000b390 comp rx=0 tx=0).stop 2024-04-23T14:50:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 msgr2=0x7f44281a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f44281a18c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4420005ab0 tx=0x7f4420003cd0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 shutdown_connections 2024-04-23T14:50:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f440c0a3bb0 0x7f440c0a6070 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44281052c0 0x7f442819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4428107bf0 0x7f44281a18c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 --2- 172.21.15.7:0/2970337271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4428102990 0x7f442819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:27.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 >> 172.21.15.7:0/2970337271 conn(0x7f44280fc3a0 msgr2=0x7f4428102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:27.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 shutdown_connections 2024-04-23T14:50:27.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:27.776+0000 7f4427e00640 1 -- 172.21.15.7:0/2970337271 wait complete. 2024-04-23T14:50:27.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T14:50:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 -- 172.21.15.7:0/3237541837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 msgr2=0x7f2b8c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 --2- 172.21.15.7:0/3237541837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c104d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009ca0 tx=0x7f2b7c02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 -- 172.21.15.7:0/3237541837 shutdown_connections 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 --2- 172.21.15.7:0/3237541837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c1052c0 0x7f2b8c1076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 --2- 172.21.15.7:0/3237541837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b8c107bf0 0x7f2b8c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 --2- 172.21.15.7:0/3237541837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c104d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 -- 172.21.15.7:0/3237541837 >> 172.21.15.7:0/3237541837 conn(0x7f2b8c0fc3a0 msgr2=0x7f2b8c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 -- 172.21.15.7:0/3237541837 shutdown_connections 2024-04-23T14:50:28.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.022+0000 7f2b92000640 1 -- 172.21.15.7:0/3237541837 wait complete. 2024-04-23T14:50:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.023+0000 7f2b92000640 1 Processor -- start 2024-04-23T14:50:28.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 -- start start 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b8c1052c0 0x7f2b8c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c107bf0 0x7f2b8c1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10daa0 con 0x7f2b8c102990 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10d920 con 0x7f2b8c107bf0 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b92000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10dc20 con 0x7f2b8c1052c0 2024-04-23T14:50:28.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b90c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b90c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38350/0 (socket says 172.21.15.7:38350) 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.024+0000 7f2b90c00640 1 -- 172.21.15.7:0/1239200058 learned_addr learned my addr 172.21.15.7:0/1239200058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b90c00640 1 -- 172.21.15.7:0/1239200058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b8c1052c0 msgr2=0x7f2b8c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b90c00640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b8c1052c0 0x7f2b8c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b90c00640 1 -- 172.21.15.7:0/1239200058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c107bf0 msgr2=0x7f2b8c1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b91600640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c107bf0 0x7f2b8c1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b90c00640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c107bf0 0x7f2b8c1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b90c00640 1 -- 172.21.15.7:0/1239200058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c1a1f50 con 0x7f2b8c102990 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b91600640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c107bf0 0x7f2b8c1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b90c00640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c19a330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c02aeb0 tx=0x7f2b7c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c004240 con 0x7f2b8c102990 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b7c032ec0 con 0x7f2b8c102990 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c030d40 con 0x7f2b8c102990 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.025+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c1a21e0 con 0x7f2b8c102990 2024-04-23T14:50:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.026+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c1a26e0 con 0x7f2b8c102990 2024-04-23T14:50:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.027+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8c109740 con 0x7f2b8c102990 2024-04-23T14:50:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.029+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f2b7c0043e0 con 0x7f2b8c102990 2024-04-23T14:50:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.031+0000 7f2b8a000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2b700a3bb0 0x7f2b700a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.031+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f2b7c0f1e60 con 0x7f2b8c102990 2024-04-23T14:50:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.031+0000 7f2b83e00640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2b700a3bb0 0x7f2b700a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.032+0000 7f2b83e00640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2b700a3bb0 0x7f2b700a6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b74005fd0 tx=0x7f2b74005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.035+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2b7c0be4c0 con 0x7f2b8c102990 2024-04-23T14:50:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:27 smithi007 ceph-mon[27906]: pgmap v435: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:27 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3766679534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:27 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2970337271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:50:28.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.241+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b8c062c00 con 0x7f2b8c102990 2024-04-23T14:50:28.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.242+0000 7f2b8a000640 1 -- 172.21.15.7:0/1239200058 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f2b7c0bddc0 con 0x7f2b8c102990 2024-04-23T14:50:28.243 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2b700a3bb0 msgr2=0x7f2b700a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2b700a3bb0 0x7f2b700a6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b74005fd0 tx=0x7f2b74005850 comp rx=0 tx=0).stop 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 msgr2=0x7f2b8c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c19a330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c02aeb0 tx=0x7f2b7c003c20 comp rx=0 tx=0).stop 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 shutdown_connections 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f2b700a3bb0 0x7f2b700a6070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b8c107bf0 0x7f2b8c1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b8c1052c0 0x7f2b8c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 --2- 172.21.15.7:0/1239200058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c102990 0x7f2b8c19a330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 >> 172.21.15.7:0/1239200058 conn(0x7f2b8c0fc3a0 msgr2=0x7f2b8c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.244+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 shutdown_connections 2024-04-23T14:50:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.245+0000 7f2b92000640 1 -- 172.21.15.7:0/1239200058 wait complete. 2024-04-23T14:50:28.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T14:50:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:27 smithi186 ceph-mon[31814]: pgmap v435: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:27 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3766679534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:27 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2970337271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:50:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:27 smithi137 ceph-mon[31694]: pgmap v435: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-04-23T14:50:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:27 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3766679534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:28.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:27 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2970337271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 -- 172.21.15.7:0/1721381886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0076040 msgr2=0x7fdab0074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 --2- 172.21.15.7:0/1721381886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0076040 0x7fdab0074490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009930 tx=0x7fdaa402a420 comp rx=0 tx=0).stop 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 -- 172.21.15.7:0/1721381886 shutdown_connections 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 --2- 172.21.15.7:0/1721381886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdab010e4e0 0x7fdab01108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 --2- 172.21.15.7:0/1721381886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab0074a60 0x7fdab0074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 --2- 172.21.15.7:0/1721381886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0076040 0x7fdab0074490 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 -- 172.21.15.7:0/1721381886 >> 172.21.15.7:0/1721381886 conn(0x7fdab00fd4a0 msgr2=0x7fdab00ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:28.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 -- 172.21.15.7:0/1721381886 shutdown_connections 2024-04-23T14:50:28.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.482+0000 7fdab6c00640 1 -- 172.21.15.7:0/1721381886 wait complete. 2024-04-23T14:50:28.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.483+0000 7fdab6c00640 1 Processor -- start 2024-04-23T14:50:28.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 -- start start 2024-04-23T14:50:28.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 0x7fdab019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab0076040 0x7fdab019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdab010e4e0 0x7fdab01a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01140a0 con 0x7fdab0074a60 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdab0113f20 con 0x7fdab010e4e0 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.484+0000 7fdab6c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdab0114220 con 0x7fdab0076040 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 0x7fdab019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 0x7fdab019e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38372/0 (socket says 172.21.15.7:38372) 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 -- 172.21.15.7:0/28452974 learned_addr learned my addr 172.21.15.7:0/28452974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab4e00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab0076040 0x7fdab019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab6200640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdab010e4e0 0x7fdab01a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 -- 172.21.15.7:0/28452974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab0076040 msgr2=0x7fdab019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab0076040 0x7fdab019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 -- 172.21.15.7:0/28452974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdab010e4e0 msgr2=0x7fdab01a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdab010e4e0 0x7fdab01a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 -- 172.21.15.7:0/28452974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab01a63b0 con 0x7fdab0074a60 2024-04-23T14:50:28.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.485+0000 7fdab5800640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 0x7fdab019e790 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40314e0 tx=0x7fdaa4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:28.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.486+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa403f070 con 0x7fdab0074a60 2024-04-23T14:50:28.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.486+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaa4031e40 con 0x7fdab0074a60 2024-04-23T14:50:28.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.486+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab01a6640 con 0x7fdab0074a60 2024-04-23T14:50:28.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.486+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4035030 con 0x7fdab0074a60 2024-04-23T14:50:28.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.486+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab01a6b80 con 0x7fdab0074a60 2024-04-23T14:50:28.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.487+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab01046b0 con 0x7fdab0074a60 2024-04-23T14:50:28.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.489+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fdaa4042070 con 0x7fdab0074a60 2024-04-23T14:50:28.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.491+0000 7fdaae000640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fda980a3c30 0x7fda980a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.491+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fdaa40f10d0 con 0x7fdab0074a60 2024-04-23T14:50:28.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.491+0000 7fdab4e00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fda980a3c30 0x7fda980a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.492+0000 7fdab4e00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fda980a3c30 0x7fda980a60f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda9c005fd0 tx=0x7fda9c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:28.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.495+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdaa40bd6d0 con 0x7fdab0074a60 2024-04-23T14:50:28.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.707+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdab0062c00 con 0x7fdab0074a60 2024-04-23T14:50:28.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.708+0000 7fdaae000640 1 -- 172.21.15.7:0/28452974 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fdaa40bcfd0 con 0x7fdab0074a60 2024-04-23T14:50:28.710 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T14:50:28.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.710+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fda980a3c30 msgr2=0x7fda980a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fda980a3c30 0x7fda980a60f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda9c005fd0 tx=0x7fda9c005850 comp rx=0 tx=0).stop 2024-04-23T14:50:28.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 msgr2=0x7fdab019e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 0x7fdab019e790 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40314e0 tx=0x7fdaa4003c80 comp rx=0 tx=0).stop 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 shutdown_connections 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fda980a3c30 0x7fda980a60f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdab010e4e0 0x7fdab01a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab0076040 0x7fdab019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 --2- 172.21.15.7:0/28452974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdab0074a60 0x7fdab019e790 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 >> 172.21.15.7:0/28452974 conn(0x7fdab00fd4a0 msgr2=0x7fdab0101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 shutdown_connections 2024-04-23T14:50:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.711+0000 7fdab6c00640 1 -- 172.21.15.7:0/28452974 wait complete. 2024-04-23T14:50:28.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 -- 172.21.15.7:0/4119495393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c101f90 msgr2=0x7fc69c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 --2- 172.21.15.7:0/4119495393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c101f90 0x7fc69c1023b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009900 tx=0x7fc68c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 -- 172.21.15.7:0/4119495393 shutdown_connections 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 --2- 172.21.15.7:0/4119495393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c103b40 0x7fc69c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 --2- 172.21.15.7:0/4119495393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c103180 0x7fc69c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 --2- 172.21.15.7:0/4119495393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c101f90 0x7fc69c1023b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 -- 172.21.15.7:0/4119495393 >> 172.21.15.7:0/4119495393 conn(0x7fc69c0fd500 msgr2=0x7fc69c0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:28.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.953+0000 7fc6a1400640 1 -- 172.21.15.7:0/4119495393 shutdown_connections 2024-04-23T14:50:28.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.954+0000 7fc6a1400640 1 -- 172.21.15.7:0/4119495393 wait complete. 2024-04-23T14:50:28.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 Processor -- start 2024-04-23T14:50:28.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 -- start start 2024-04-23T14:50:28.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c101f90 0x7fc69c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c103180 0x7fc69c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 0x7fc69c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c10dab0 con 0x7fc69c103b40 2024-04-23T14:50:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c10d930 con 0x7fc69c103180 2024-04-23T14:50:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.955+0000 7fc6a1400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c10dc30 con 0x7fc69c101f90 2024-04-23T14:50:28.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 0x7fc69c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 0x7fc69c1a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38382/0 (socket says 172.21.15.7:38382) 2024-04-23T14:50:28.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 -- 172.21.15.7:0/3096465405 learned_addr learned my addr 172.21.15.7:0/3096465405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:28.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc69be00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c101f90 0x7fc69c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc69b400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c103180 0x7fc69c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 -- 172.21.15.7:0/3096465405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c101f90 msgr2=0x7fc69c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c101f90 0x7fc69c19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 -- 172.21.15.7:0/3096465405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c103180 msgr2=0x7fc69c19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c103180 0x7fc69c19a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 -- 172.21.15.7:0/3096465405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c1a1f20 con 0x7fc69c103b40 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc69be00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c101f90 0x7fc69c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.956+0000 7fc6a0a00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 0x7fc69c1a18b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc69400eaa0 tx=0x7fc69400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.957+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69400cdb0 con 0x7fc69c103b40 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.957+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc694005020 con 0x7fc69c103b40 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.957+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6940116d0 con 0x7fc69c103b40 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.957+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c1a2210 con 0x7fc69c103b40 2024-04-23T14:50:28.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.957+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c1a2710 con 0x7fc69c103b40 2024-04-23T14:50:28.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.958+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c1a29d0 con 0x7fc69c103b40 2024-04-23T14:50:28.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.960+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fc6940051d0 con 0x7fc69c103b40 2024-04-23T14:50:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.962+0000 7fc698c00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc6800a3c30 0x7fc6800a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.962+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fc6940d0a10 con 0x7fc69c103b40 2024-04-23T14:50:28.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.962+0000 7fc69be00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc6800a3c30 0x7fc6800a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:28.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.963+0000 7fc69be00640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc6800a3c30 0x7fc6800a60f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006010 tx=0x7fc68c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:28.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:28.966+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc694016030 con 0x7fc69c103b40 2024-04-23T14:50:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:28 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1239200058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:50:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:28 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/28452974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:50:29.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.174+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc69c1a2ba0 con 0x7fc69c103b40 2024-04-23T14:50:29.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.175+0000 7fc698c00640 1 -- 172.21.15.7:0/3096465405 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7fc69409d010 con 0x7fc69c103b40 2024-04-23T14:50:29.176 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:50:29.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc6800a3c30 msgr2=0x7fc6800a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc6800a3c30 0x7fc6800a60f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006010 tx=0x7fc68c000bc0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 msgr2=0x7fc69c1a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 0x7fc69c1a18b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc69400eaa0 tx=0x7fc69400ef60 comp rx=0 tx=0).stop 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 shutdown_connections 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fc6800a3c30 0x7fc6800a60f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c103180 0x7fc69c19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc69c103b40 0x7fc69c1a18b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 --2- 172.21.15.7:0/3096465405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69c101f90 0x7fc69c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 >> 172.21.15.7:0/3096465405 conn(0x7fc69c0fd500 msgr2=0x7fc69c074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 shutdown_connections 2024-04-23T14:50:29.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.178+0000 7fc6a1400640 1 -- 172.21.15.7:0/3096465405 wait complete. 2024-04-23T14:50:29.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:50:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:28 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1239200058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:50:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:28 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/28452974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.410+0000 7f7cf4800640 1 -- 172.21.15.7:0/3911292664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105470 msgr2=0x7f7cec1058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.410+0000 7f7cf4800640 1 --2- 172.21.15.7:0/3911292664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105470 0x7f7cec1058f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009900 tx=0x7f7cdc02a400 comp rx=0 tx=0).stop 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 -- 172.21.15.7:0/3911292664 shutdown_connections 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 --2- 172.21.15.7:0/3911292664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cec105e30 0x7f7cec10c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 --2- 172.21.15.7:0/3911292664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105470 0x7f7cec1058f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 --2- 172.21.15.7:0/3911292664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cec104280 0x7f7cec1046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 -- 172.21.15.7:0/3911292664 >> 172.21.15.7:0/3911292664 conn(0x7f7cec0ff7f0 msgr2=0x7f7cec101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:29.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 -- 172.21.15.7:0/3911292664 shutdown_connections 2024-04-23T14:50:29.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.411+0000 7f7cf4800640 1 -- 172.21.15.7:0/3911292664 wait complete. 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 Processor -- start 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 -- start start 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cec104280 0x7f7cec19e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cec105470 0x7f7cec19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 0x7f7cec1a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cec10fe10 con 0x7f7cec105e30 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cec10fc90 con 0x7f7cec105470 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf4800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cec10ff90 con 0x7f7cec104280 2024-04-23T14:50:29.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 0x7f7cec1a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 0x7f7cec1a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38400/0 (socket says 172.21.15.7:38400) 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.412+0000 7f7cf2800640 1 -- 172.21.15.7:0/626104415 learned_addr learned my addr 172.21.15.7:0/626104415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf1e00640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cec104280 0x7f7cec19e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf1400640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cec105470 0x7f7cec19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf2800640 1 -- 172.21.15.7:0/626104415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cec104280 msgr2=0x7f7cec19e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf2800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cec104280 0x7f7cec19e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf2800640 1 -- 172.21.15.7:0/626104415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cec105470 msgr2=0x7f7cec19ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf2800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cec105470 0x7f7cec19ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf2800640 1 -- 172.21.15.7:0/626104415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cec1a63a0 con 0x7f7cec105e30 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.413+0000 7f7cf2800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 0x7f7cec1a5d30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800cce0 tx=0x7f7ce800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.414+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800f450 con 0x7f7cec105e30 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.414+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ce800faa0 con 0x7f7cec105e30 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.414+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cec1a6690 con 0x7f7cec105e30 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.414+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8018b70 con 0x7f7cec105e30 2024-04-23T14:50:29.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.414+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cec1a6bb0 con 0x7f7cec105e30 2024-04-23T14:50:29.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.415+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cec1a6e70 con 0x7f7cec105e30 2024-04-23T14:50:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:28 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1239200058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:50:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:28 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/28452974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:50:29.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.417+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f7ce8018d10 con 0x7f7cec105e30 2024-04-23T14:50:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.418+0000 7f7ce6a00640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7cd40a3c30 0x7f7cd40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.419+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f7ce80d0c40 con 0x7f7cec105e30 2024-04-23T14:50:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.419+0000 7f7cf1e00640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7cd40a3c30 0x7f7cd40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.420+0000 7f7cf1e00640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7cd40a3c30 0x7f7cd40a60f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00058c0 tx=0x7f7ce0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:29.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.423+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7ce8014030 con 0x7f7cec105e30 2024-04-23T14:50:29.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.670+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cec1a7040 con 0x7f7cec105e30 2024-04-23T14:50:29.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.671+0000 7f7ce6a00640 1 -- 172.21.15.7:0/626104415 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11926 (secure 0 0 0) 0x7f7ce809d240 con 0x7f7cec105e30 2024-04-23T14:50:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:29.673 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:53.850115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[34484,34526,34424,34448,24508]},"id":1}]} 2024-04-23T14:50:29.673 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:50:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7cd40a3c30 msgr2=0x7f7cd40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7cd40a3c30 0x7f7cd40a60f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00058c0 tx=0x7f7ce0005850 comp rx=0 tx=0).stop 2024-04-23T14:50:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 msgr2=0x7f7cec1a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 0x7f7cec1a5d30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800cce0 tx=0x7f7ce800a620 comp rx=0 tx=0).stop 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 shutdown_connections 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7cd40a3c30 0x7f7cd40a60f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cec105470 0x7f7cec19ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cec105e30 0x7f7cec1a5d30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 --2- 172.21.15.7:0/626104415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cec104280 0x7f7cec19e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 >> 172.21.15.7:0/626104415 conn(0x7f7cec0ff7f0 msgr2=0x7f7cec078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 shutdown_connections 2024-04-23T14:50:29.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.674+0000 7f7cf4800640 1 -- 172.21.15.7:0/626104415 wait complete. 2024-04-23T14:50:29.696 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:50:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 -- 172.21.15.7:0/3539308942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 msgr2=0x7f10b41088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 --2- 172.21.15.7:0/3539308942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41088c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009ca0 tx=0x7f10ac02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 -- 172.21.15.7:0/3539308942 shutdown_connections 2024-04-23T14:50:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 --2- 172.21.15.7:0/3539308942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41088c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 --2- 172.21.15.7:0/3539308942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 0x7f10b4101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 --2- 172.21.15.7:0/3539308942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b40684b0 0x7f10b4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.911+0000 7f10baa00640 1 -- 172.21.15.7:0/3539308942 >> 172.21.15.7:0/3539308942 conn(0x7f10b40fb630 msgr2=0x7f10b40fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.912+0000 7f10baa00640 1 -- 172.21.15.7:0/3539308942 shutdown_connections 2024-04-23T14:50:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.912+0000 7f10baa00640 1 -- 172.21.15.7:0/3539308942 wait complete. 2024-04-23T14:50:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 Processor -- start 2024-04-23T14:50:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 -- start start 2024-04-23T14:50:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b40684b0 0x7f10b419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 0x7f10b419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10b410da30 con 0x7f10b41064d0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10b410d8b0 con 0x7f10b40684b0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.913+0000 7f10baa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f10b410dbb0 con 0x7f10b41017d0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38414/0 (socket says 172.21.15.7:38414) 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 -- 172.21.15.7:0/2053985489 learned_addr learned my addr 172.21.15.7:0/2053985489 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10b8c00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 0x7f10b419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10b9600640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b40684b0 0x7f10b419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 -- 172.21.15.7:0/2053985489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 msgr2=0x7f10b419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 0x7f10b419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 -- 172.21.15.7:0/2053985489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b40684b0 msgr2=0x7f10b419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b40684b0 0x7f10b419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 -- 172.21.15.7:0/2053985489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b41a2000 con 0x7f10b41064d0 2024-04-23T14:50:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10b8c00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 0x7f10b419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.914+0000 7f10ba000640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41a1990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f10ac031040 tx=0x7f10ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.915+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac032ec0 con 0x7f10b41064d0 2024-04-23T14:50:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.915+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10ac0044f0 con 0x7f10b41064d0 2024-04-23T14:50:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.915+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac030cb0 con 0x7f10b41064d0 2024-04-23T14:50:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.915+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b41a2290 con 0x7f10b41064d0 2024-04-23T14:50:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.915+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b41a2790 con 0x7f10b41064d0 2024-04-23T14:50:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.916+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b4069190 con 0x7f10b41064d0 2024-04-23T14:50:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.918+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f10ac004040 con 0x7f10b41064d0 2024-04-23T14:50:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.919+0000 7f10b2000640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f109c0a3dd0 0x7f109c0a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.920+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f10ac0f1da0 con 0x7f10b41064d0 2024-04-23T14:50:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.920+0000 7f10b9600640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f109c0a3dd0 0x7f109c0a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:29.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.920+0000 7f10b9600640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f109c0a3dd0 0x7f109c0a6290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10b41010f0 tx=0x7f10a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:29.924+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f10ac0be3a0 con 0x7f10b41064d0 2024-04-23T14:50:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.132+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10b41a30a0 con 0x7f10b41064d0 2024-04-23T14:50:30.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.135+0000 7f10b2000640 1 -- 172.21.15.7:0/2053985489 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24630 (secure 0 0 0) 0x7f10ac0bdca0 con 0x7f10b41064d0 2024-04-23T14:50:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:30.137 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:49:44.075188+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:50:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.137+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f109c0a3dd0 msgr2=0x7f109c0a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.137+0000 7f10baa00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f109c0a3dd0 0x7f109c0a6290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10b41010f0 tx=0x7f10a8005f90 comp rx=0 tx=0).stop 2024-04-23T14:50:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 msgr2=0x7f10b41a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41a1990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f10ac031040 tx=0x7f10ac003ba0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 shutdown_connections 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f109c0a3dd0 0x7f109c0a6290 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10b41064d0 0x7f10b41a1990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b41017d0 0x7f10b419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 --2- 172.21.15.7:0/2053985489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b40684b0 0x7f10b419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 >> 172.21.15.7:0/2053985489 conn(0x7f10b40fb630 msgr2=0x7f10b40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 shutdown_connections 2024-04-23T14:50:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.138+0000 7f10baa00640 1 -- 172.21.15.7:0/2053985489 wait complete. 2024-04-23T14:50:30.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:50:30.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:50:30.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:29 smithi007 ceph-mon[27906]: pgmap v436: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:30.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:29 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3096465405' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:50:30.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:29 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/626104415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:30.265 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:29 smithi186 ceph-mon[31814]: pgmap v436: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:30.265 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:29 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3096465405' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:50:30.265 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:29 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/626104415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 -- 172.21.15.7:0/4186993466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 msgr2=0x7f7df4103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 --2- 172.21.15.7:0/4186993466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df4103af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009900 tx=0x7f7de402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 -- 172.21.15.7:0/4186993466 shutdown_connections 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 --2- 172.21.15.7:0/4186993466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 0x7f7df4106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 --2- 172.21.15.7:0/4186993466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7df4106a90 0x7f7df4108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 --2- 172.21.15.7:0/4186993466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df4103af0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 -- 172.21.15.7:0/4186993466 >> 172.21.15.7:0/4186993466 conn(0x7f7df40fb6c0 msgr2=0x7f7df40fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:30.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 -- 172.21.15.7:0/4186993466 shutdown_connections 2024-04-23T14:50:30.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.381+0000 7f7df9800640 1 -- 172.21.15.7:0/4186993466 wait complete. 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.382+0000 7f7df9800640 1 Processor -- start 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.382+0000 7f7df9800640 1 -- start start 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 0x7f7df419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7df4106a90 0x7f7df41a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7df410c990 con 0x7f7df4101700 2024-04-23T14:50:30.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7df410c810 con 0x7f7df4104030 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df9800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7df410cb10 con 0x7f7df4106a90 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38440/0 (socket says 172.21.15.7:38440) 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7df3e00640 1 -- 172.21.15.7:0/4192134433 learned_addr learned my addr 172.21.15.7:0/4192134433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.383+0000 7f7debe00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 0x7f7df419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df3e00640 1 -- 172.21.15.7:0/4192134433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7df4106a90 msgr2=0x7f7df41a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df3e00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7df4106a90 0x7f7df41a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df3e00640 1 -- 172.21.15.7:0/4192134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 msgr2=0x7f7df419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df3e00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 0x7f7df419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df3e00640 1 -- 172.21.15.7:0/4192134433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df41a1fa0 con 0x7f7df4101700 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7debe00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 0x7f7df419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df3e00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df419a380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7de4005ab0 tx=0x7f7de4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de403f070 con 0x7f7df4101700 2024-04-23T14:50:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7de4031e40 con 0x7f7df4101700 2024-04-23T14:50:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4035030 con 0x7f7df4101700 2024-04-23T14:50:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df41a2230 con 0x7f7df4101700 2024-04-23T14:50:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.384+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df41a2720 con 0x7f7df4101700 2024-04-23T14:50:30.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.386+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df41a2980 con 0x7f7df4101700 2024-04-23T14:50:30.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.388+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f7de4042070 con 0x7f7df4101700 2024-04-23T14:50:30.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.390+0000 7f7df1600640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7dd80a3bb0 0x7f7dd80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.390+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f7de40f12f0 con 0x7f7df4101700 2024-04-23T14:50:30.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.390+0000 7f7debe00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7dd80a3bb0 0x7f7dd80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.391+0000 7f7debe00640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7dd80a3bb0 0x7f7dd80a6070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7df419b890 tx=0x7f7ddc005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:30.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.395+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7de40bd950 con 0x7f7df4101700 2024-04-23T14:50:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:29 smithi137 ceph-mon[31694]: pgmap v436: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:29 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3096465405' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:50:30.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:29 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/626104415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.602+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7df41a2d10 con 0x7f7df4101700 2024-04-23T14:50:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.603+0000 7f7df1600640 1 -- 172.21.15.7:0/4192134433 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f7de40bd250 con 0x7f7df4101700 2024-04-23T14:50:30.604 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.605+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7dd80a3bb0 msgr2=0x7f7dd80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.605+0000 7f7df9800640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7dd80a3bb0 0x7f7dd80a6070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7df419b890 tx=0x7f7ddc005db0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.605+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 msgr2=0x7f7df419a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.605+0000 7f7df9800640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df419a380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7de4005ab0 tx=0x7f7de4003d50 comp rx=0 tx=0).stop 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 shutdown_connections 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7dd80a3bb0 0x7f7dd80a6070 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7df4104030 0x7f7df419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7df4106a90 0x7f7df41a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 --2- 172.21.15.7:0/4192134433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7df4101700 0x7f7df419a380 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 >> 172.21.15.7:0/4192134433 conn(0x7f7df40fb6c0 msgr2=0x7f7df4100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 shutdown_connections 2024-04-23T14:50:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.606+0000 7f7df9800640 1 -- 172.21.15.7:0/4192134433 wait complete. 2024-04-23T14:50:30.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 -- 172.21.15.7:0/1562825956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc104260 msgr2=0x7fd8fc104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 --2- 172.21.15.7:0/1562825956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc104260 0x7fd8fc104680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009900 tx=0x7fd8f002a410 comp rx=0 tx=0).stop 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 -- 172.21.15.7:0/1562825956 shutdown_connections 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 --2- 172.21.15.7:0/1562825956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8fc105e10 0x7fd8fc10c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 --2- 172.21.15.7:0/1562825956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8fc105450 0x7fd8fc1058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 --2- 172.21.15.7:0/1562825956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc104260 0x7fd8fc104680 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 -- 172.21.15.7:0/1562825956 >> 172.21.15.7:0/1562825956 conn(0x7fd8fc0ff7f0 msgr2=0x7fd8fc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:30.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 -- 172.21.15.7:0/1562825956 shutdown_connections 2024-04-23T14:50:30.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.840+0000 7fd904000640 1 -- 172.21.15.7:0/1562825956 wait complete. 2024-04-23T14:50:30.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.841+0000 7fd904000640 1 Processor -- start 2024-04-23T14:50:30.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.841+0000 7fd904000640 1 -- start start 2024-04-23T14:50:30.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd904000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8fc104260 0x7fd8fc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd904000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8fc105450 0x7fd8fc19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd904000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 0x7fd8fc1a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd904000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc10fda0 con 0x7fd8fc105e10 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd904000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc10fc20 con 0x7fd8fc105450 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd904000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc10ff20 con 0x7fd8fc104260 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd902000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 0x7fd8fc1a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd902000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 0x7fd8fc1a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38452/0 (socket says 172.21.15.7:38452) 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd902000640 1 -- 172.21.15.7:0/3187958566 learned_addr learned my addr 172.21.15.7:0/3187958566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd900c00640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8fc105450 0x7fd8fc19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.842+0000 7fd901600640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8fc104260 0x7fd8fc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd902000640 1 -- 172.21.15.7:0/3187958566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8fc104260 msgr2=0x7fd8fc19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd902000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8fc104260 0x7fd8fc19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd902000640 1 -- 172.21.15.7:0/3187958566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8fc105450 msgr2=0x7fd8fc19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd902000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8fc105450 0x7fd8fc19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:30.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd902000640 1 -- 172.21.15.7:0/3187958566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc1a20e0 con 0x7fd8fc105e10 2024-04-23T14:50:30.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd902000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 0x7fd8fc1a1a70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009fd0 tx=0x7fd8f400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:30.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4017070 con 0x7fd8fc105e10 2024-04-23T14:50:30.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd8f4003e20 con 0x7fd8fc105e10 2024-04-23T14:50:30.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4010460 con 0x7fd8fc105e10 2024-04-23T14:50:30.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.843+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc1a23d0 con 0x7fd8fc105e10 2024-04-23T14:50:30.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.844+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc1a28d0 con 0x7fd8fc105e10 2024-04-23T14:50:30.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.845+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc10b6a0 con 0x7fd8fc105e10 2024-04-23T14:50:30.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.847+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fd8f4003970 con 0x7fd8fc105e10 2024-04-23T14:50:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.849+0000 7fd8fa000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8e40a3bb0 0x7fd8e40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.849+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fd8f40d0690 con 0x7fd8fc105e10 2024-04-23T14:50:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.849+0000 7fd901600640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8e40a3bb0 0x7fd8e40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:30.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.850+0000 7fd901600640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8e40a3bb0 0x7fd8e40a6070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0000c00 tx=0x7fd8f00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:30.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:30.854+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd8f409cc90 con 0x7fd8fc105e10 2024-04-23T14:50:31.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.066+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd8fc062c00 con 0x7fd8fc105e10 2024-04-23T14:50:31.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.067+0000 7fd8fa000640 1 -- 172.21.15.7:0/3187958566 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fd8f409c590 con 0x7fd8fc105e10 2024-04-23T14:50:31.068 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:50:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8e40a3bb0 msgr2=0x7fd8e40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8e40a3bb0 0x7fd8e40a6070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0000c00 tx=0x7fd8f00314a0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 msgr2=0x7fd8fc1a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 0x7fd8fc1a1a70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009fd0 tx=0x7fd8f400b260 comp rx=0 tx=0).stop 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 shutdown_connections 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd8e40a3bb0 0x7fd8e40a6070 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8fc105450 0x7fd8fc19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8fc105e10 0x7fd8fc1a1a70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 --2- 172.21.15.7:0/3187958566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8fc104260 0x7fd8fc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 >> 172.21.15.7:0/3187958566 conn(0x7fd8fc0ff7f0 msgr2=0x7fd8fc108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:31.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 shutdown_connections 2024-04-23T14:50:31.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.070+0000 7fd904000640 1 -- 172.21.15.7:0/3187958566 wait complete. 2024-04-23T14:50:31.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 -- 172.21.15.7:0/2864394501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 msgr2=0x7fd268074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 --2- 172.21.15.7:0/2864394501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd268074e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd254009900 tx=0x7fd25402a480 comp rx=0 tx=0).stop 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 -- 172.21.15.7:0/2864394501 shutdown_connections 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 --2- 172.21.15.7:0/2864394501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd268109f00 0x7fd26810c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 --2- 172.21.15.7:0/2864394501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd268074e40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 --2- 172.21.15.7:0/2864394501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd268075fc0 0x7fd268074410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 -- 172.21.15.7:0/2864394501 >> 172.21.15.7:0/2864394501 conn(0x7fd2680fd5e0 msgr2=0x7fd2680ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:31.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 -- 172.21.15.7:0/2864394501 shutdown_connections 2024-04-23T14:50:31.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.311+0000 7fd26f800640 1 -- 172.21.15.7:0/2864394501 wait complete. 2024-04-23T14:50:31.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.312+0000 7fd26f800640 1 Processor -- start 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 -- start start 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd26819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd268075fc0 0x7fd26819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd268109f00 0x7fd2681a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd26810fdc0 con 0x7fd2680749e0 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd26810fc40 con 0x7fd268075fc0 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26f800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd26810ff40 con 0x7fd268109f00 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd26819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd26819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38458/0 (socket says 172.21.15.7:38458) 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.313+0000 7fd26ce00640 1 -- 172.21.15.7:0/4208585973 learned_addr learned my addr 172.21.15.7:0/4208585973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd267e00640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd268075fc0 0x7fd26819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26ce00640 1 -- 172.21.15.7:0/4208585973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd268109f00 msgr2=0x7fd2681a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26ce00640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd268109f00 0x7fd2681a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26ce00640 1 -- 172.21.15.7:0/4208585973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd268075fc0 msgr2=0x7fd26819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26ce00640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd268075fc0 0x7fd26819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26ce00640 1 -- 172.21.15.7:0/4208585973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2681a20f0 con 0x7fd2680749e0 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26ce00640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd26819a4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00d770 tx=0x7fd25c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c017070 con 0x7fd2680749e0 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd25c0054d0 con 0x7fd2680749e0 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2681a23e0 con 0x7fd2680749e0 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.314+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c004cf0 con 0x7fd2680749e0 2024-04-23T14:50:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.315+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2681a28e0 con 0x7fd2680749e0 2024-04-23T14:50:31.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.316+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd268108cc0 con 0x7fd2680749e0 2024-04-23T14:50:31.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.318+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fd25c004e90 con 0x7fd2680749e0 2024-04-23T14:50:31.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.319+0000 7fd265600640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd2500a3bb0 0x7fd2500a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.319+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fd25c0d0300 con 0x7fd2680749e0 2024-04-23T14:50:31.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.320+0000 7fd267e00640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd2500a3bb0 0x7fd2500a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.320+0000 7fd267e00640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd2500a3bb0 0x7fd2500a6070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd25402a9a0 tx=0x7fd254000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:31.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.324+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd25c09c900 con 0x7fd2680749e0 2024-04-23T14:50:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2053985489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:30 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4192134433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:50:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:30 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2053985489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:30 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4192134433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:50:31.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:30 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2053985489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:31.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:30 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4192134433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:50:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.530+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd268062ca0 con 0x7fd2680749e0 2024-04-23T14:50:31.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.531+0000 7fd265600640 1 -- 172.21.15.7:0/4208585973 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fd25c09c200 con 0x7fd2680749e0 2024-04-23T14:50:31.533 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T14:50:31.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd2500a3bb0 msgr2=0x7fd2500a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd2500a3bb0 0x7fd2500a6070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd25402a9a0 tx=0x7fd254000bc0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 msgr2=0x7fd26819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd26819a4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00d770 tx=0x7fd25c00dc30 comp rx=0 tx=0).stop 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 shutdown_connections 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fd2500a3bb0 0x7fd2500a6070 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd268075fc0 0x7fd26819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd268109f00 0x7fd2681a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 --2- 172.21.15.7:0/4208585973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2680749e0 0x7fd26819a4d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 >> 172.21.15.7:0/4208585973 conn(0x7fd2680fd5e0 msgr2=0x7fd268105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 shutdown_connections 2024-04-23T14:50:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.534+0000 7fd26f800640 1 -- 172.21.15.7:0/4208585973 wait complete. 2024-04-23T14:50:31.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 -- 172.21.15.7:0/1272086760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4109dd0 msgr2=0x7f29f410c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 --2- 172.21.15.7:0/1272086760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4109dd0 0x7f29f410c260 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009ca0 tx=0x7f29ec02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 -- 172.21.15.7:0/1272086760 shutdown_connections 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 --2- 172.21.15.7:0/1272086760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4109dd0 0x7f29f410c260 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 --2- 172.21.15.7:0/1272086760 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f4074a60 0x7f29f4074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 --2- 172.21.15.7:0/1272086760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4076040 0x7f29f4074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 -- 172.21.15.7:0/1272086760 >> 172.21.15.7:0/1272086760 conn(0x7f29f40fd4a0 msgr2=0x7f29f40ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 -- 172.21.15.7:0/1272086760 shutdown_connections 2024-04-23T14:50:31.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.775+0000 7f29f3e00640 1 -- 172.21.15.7:0/1272086760 wait complete. 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.776+0000 7f29f3e00640 1 Processor -- start 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.776+0000 7f29f3e00640 1 -- start start 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 0x7f29f419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f4076040 0x7f29f419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4109dd0 0x7f29f41a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29f410fc90 con 0x7f29f4074a60 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29f410fb10 con 0x7f29f4109dd0 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f29f410fe10 con 0x7f29f4076040 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 0x7f29f419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 0x7f29f419a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38480/0 (socket says 172.21.15.7:38480) 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 -- 172.21.15.7:0/2994087395 learned_addr learned my addr 172.21.15.7:0/2994087395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29ea000640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f4076040 0x7f29f419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f3400640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4109dd0 0x7f29f41a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 -- 172.21.15.7:0/2994087395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f4076040 msgr2=0x7f29f419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f4076040 0x7f29f419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 -- 172.21.15.7:0/2994087395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4109dd0 msgr2=0x7f29f41a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4109dd0 0x7f29f41a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.777+0000 7f29f2a00640 1 -- 172.21.15.7:0/2994087395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f41a1ed0 con 0x7f29f4074a60 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.778+0000 7f29f2a00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 0x7f29f419a2b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29e400d950 tx=0x7f29e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.778+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4017070 con 0x7f29f4074a60 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.778+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29e4009c30 con 0x7f29f4074a60 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.778+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f41a21c0 con 0x7f29f4074a60 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.778+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e400f620 con 0x7f29f4074a60 2024-04-23T14:50:31.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.778+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f41a2710 con 0x7f29f4074a60 2024-04-23T14:50:31.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.780+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f4108b00 con 0x7f29f4074a60 2024-04-23T14:50:31.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.782+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f29e40109a0 con 0x7f29f4074a60 2024-04-23T14:50:31.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.783+0000 7f29ebe00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f29d80a3bb0 0x7f29d80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:31.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.783+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f29e40d04c0 con 0x7f29f4074a60 2024-04-23T14:50:31.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.783+0000 7f29ea000640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f29d80a3bb0 0x7f29d80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:31.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.784+0000 7f29ea000640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f29d80a3bb0 0x7f29d80a6070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29dc005fd0 tx=0x7f29dc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:31.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.788+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f29e4009de0 con 0x7f29f4074a60 2024-04-23T14:50:31.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.996+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f29f4062c00 con 0x7f29f4074a60 2024-04-23T14:50:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.997+0000 7f29ebe00640 1 -- 172.21.15.7:0/2994087395 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f29e409cac0 con 0x7f29f4074a60 2024-04-23T14:50:31.998 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f29d80a3bb0 msgr2=0x7f29d80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f29d80a3bb0 0x7f29d80a6070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29dc005fd0 tx=0x7f29dc005850 comp rx=0 tx=0).stop 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 msgr2=0x7f29f419a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 0x7f29f419a2b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29e400d950 tx=0x7f29e400de10 comp rx=0 tx=0).stop 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 shutdown_connections 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f29d80a3bb0 0x7f29d80a6070 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4109dd0 0x7f29f41a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f4076040 0x7f29f419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 --2- 172.21.15.7:0/2994087395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29f4074a60 0x7f29f419a2b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 >> 172.21.15.7:0/2994087395 conn(0x7f29f40fd4a0 msgr2=0x7f29f4105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:31.999+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 shutdown_connections 2024-04-23T14:50:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.000+0000 7f29f3e00640 1 -- 172.21.15.7:0/2994087395 wait complete. 2024-04-23T14:50:32.022 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:50:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 -- 172.21.15.7:0/1857941850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 msgr2=0x7f8374104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 --2- 172.21.15.7:0/1857941850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f8374104cf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8364009900 tx=0x7f836402a410 comp rx=0 tx=0).stop 2024-04-23T14:50:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 -- 172.21.15.7:0/1857941850 shutdown_connections 2024-04-23T14:50:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 --2- 172.21.15.7:0/1857941850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374107b60 0x7f8374109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 --2- 172.21.15.7:0/1857941850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374105230 0x7f8374107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 --2- 172.21.15.7:0/1857941850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f8374104cf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.222+0000 7f8373200640 1 -- 172.21.15.7:0/1857941850 >> 172.21.15.7:0/1857941850 conn(0x7f83740fc2d0 msgr2=0x7f83740fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.223+0000 7f8373200640 1 -- 172.21.15.7:0/1857941850 shutdown_connections 2024-04-23T14:50:32.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.223+0000 7f8373200640 1 -- 172.21.15.7:0/1857941850 wait complete. 2024-04-23T14:50:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 Processor -- start 2024-04-23T14:50:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 -- start start 2024-04-23T14:50:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f837419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374105230 0x7f837419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374107b60 0x7f83741a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f837410da50 con 0x7f8374102900 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f837410d8d0 con 0x7f8374105230 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8373200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f837410dbd0 con 0x7f8374107b60 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8371e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f837419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8371e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f837419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38506/0 (socket says 172.21.15.7:38506) 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.224+0000 7f8371e00640 1 -- 172.21.15.7:0/2077871326 learned_addr learned my addr 172.21.15.7:0/2077871326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371400640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374105230 0x7f837419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8372800640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374107b60 0x7f83741a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371e00640 1 -- 172.21.15.7:0/2077871326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374107b60 msgr2=0x7f83741a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371e00640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374107b60 0x7f83741a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371e00640 1 -- 172.21.15.7:0/2077871326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374105230 msgr2=0x7f837419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371e00640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374105230 0x7f837419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371e00640 1 -- 172.21.15.7:0/2077871326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83741a1f20 con 0x7f8374102900 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371400640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374105230 0x7f837419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8372800640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374107b60 0x7f83741a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f8371e00640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f837419a300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8364004770 tx=0x7f83640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.225+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836403f030 con 0x7f8374102900 2024-04-23T14:50:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.226+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8364003cb0 con 0x7f8374102900 2024-04-23T14:50:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.226+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83741a21b0 con 0x7f8374102900 2024-04-23T14:50:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.226+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364035070 con 0x7f8374102900 2024-04-23T14:50:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.226+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83741a2720 con 0x7f8374102900 2024-04-23T14:50:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.227+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8374109650 con 0x7f8374102900 2024-04-23T14:50:32.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.229+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f8364042030 con 0x7f8374102900 2024-04-23T14:50:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.230+0000 7f836aa00640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f83580a3bb0 0x7f83580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.230+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f83640f1220 con 0x7f8374102900 2024-04-23T14:50:32.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.231+0000 7f8371400640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f83580a3bb0 0x7f83580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.232+0000 7f8371400640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f83580a3bb0 0x7f83580a6070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f837419b810 tx=0x7f835c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:32.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.235+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f83640bd820 con 0x7f8374102900 2024-04-23T14:50:32.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:31 smithi007 ceph-mon[27906]: pgmap v437: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:32.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:31 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3187958566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:50:32.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:31 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4208585973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:50:32.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:31 smithi186 ceph-mon[31814]: pgmap v437: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:32.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:31 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3187958566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:50:32.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:31 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4208585973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:50:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:31 smithi137 ceph-mon[31694]: pgmap v437: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:31 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3187958566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:50:32.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:31 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4208585973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:50:32.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.483+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f837402d860 con 0x7f8374102900 2024-04-23T14:50:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.484+0000 7f836aa00640 1 -- 172.21.15.7:0/2077871326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11926 (secure 0 0 0) 0x7f83640bd120 con 0x7f8374102900 2024-04-23T14:50:32.486 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:32.487 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:53.850115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[34484,34526,34424,34448,24508]},"id":1}]} 2024-04-23T14:50:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f83580a3bb0 msgr2=0x7f83580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f83580a3bb0 0x7f83580a6070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f837419b810 tx=0x7f835c005e50 comp rx=0 tx=0).stop 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 msgr2=0x7f837419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f837419a300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8364004770 tx=0x7f83640042f0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 shutdown_connections 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f83580a3bb0 0x7f83580a6070 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8374105230 0x7f837419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8374107b60 0x7f83741a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 --2- 172.21.15.7:0/2077871326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8374102900 0x7f837419a300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.487+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 >> 172.21.15.7:0/2077871326 conn(0x7f83740fc2d0 msgr2=0x7f83741020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.488+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 shutdown_connections 2024-04-23T14:50:32.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.488+0000 7f8373200640 1 -- 172.21.15.7:0/2077871326 wait complete. 2024-04-23T14:50:32.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 -- 172.21.15.7:0/511136474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b20102ff0 msgr2=0x7f3b20103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 --2- 172.21.15.7:0/511136474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b20102ff0 0x7f3b20103470 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009900 tx=0x7f3b0802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 -- 172.21.15.7:0/511136474 shutdown_connections 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 --2- 172.21.15.7:0/511136474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b201039b0 0x7f3b2010a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 --2- 172.21.15.7:0/511136474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b20102ff0 0x7f3b20103470 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 --2- 172.21.15.7:0/511136474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b20101ea0 0x7f3b201022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 -- 172.21.15.7:0/511136474 >> 172.21.15.7:0/511136474 conn(0x7f3b200fd410 msgr2=0x7f3b200ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 -- 172.21.15.7:0/511136474 shutdown_connections 2024-04-23T14:50:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.719+0000 7f3b25e00640 1 -- 172.21.15.7:0/511136474 wait complete. 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.720+0000 7f3b25e00640 1 Processor -- start 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 -- start start 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b20101ea0 0x7f3b201980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b20102ff0 0x7f3b20198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 0x7f3b2019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2010da50 con 0x7f3b201039b0 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2010d8d0 con 0x7f3b20101ea0 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2010dbd0 con 0x7f3b20102ff0 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 0x7f3b2019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 0x7f3b2019f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38522/0 (socket says 172.21.15.7:38522) 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.721+0000 7f3b25400640 1 -- 172.21.15.7:0/1692911606 learned_addr learned my addr 172.21.15.7:0/1692911606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b24a00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b20101ea0 0x7f3b201980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b17e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b20102ff0 0x7f3b20198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25400640 1 -- 172.21.15.7:0/1692911606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b20102ff0 msgr2=0x7f3b20198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25400640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b20102ff0 0x7f3b20198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25400640 1 -- 172.21.15.7:0/1692911606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b20101ea0 msgr2=0x7f3b201980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25400640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b20101ea0 0x7f3b201980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25400640 1 -- 172.21.15.7:0/1692911606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2019fce0 con 0x7f3b201039b0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25400640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 0x7f3b2019f670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800d750 tx=0x7f3b1800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18017070 con 0x7f3b201039b0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2019ffd0 con 0x7f3b201039b0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.722+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b180054d0 con 0x7f3b201039b0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.723+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18004c60 con 0x7f3b201039b0 2024-04-23T14:50:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.723+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b201a0490 con 0x7f3b201039b0 2024-04-23T14:50:32.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.724+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b20109270 con 0x7f3b201039b0 2024-04-23T14:50:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.726+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f3b18004e00 con 0x7f3b201039b0 2024-04-23T14:50:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.728+0000 7f3b1e000640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3b040a3bb0 0x7f3b040a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.729+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f3b180d0240 con 0x7f3b201039b0 2024-04-23T14:50:32.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.729+0000 7f3b24a00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3b040a3bb0 0x7f3b040a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.729+0000 7f3b24a00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3b040a3bb0 0x7f3b040a6070 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005fd0 tx=0x7f3b10009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.733+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3b1809c840 con 0x7f3b201039b0 2024-04-23T14:50:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.943+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b20062c00 con 0x7f3b201039b0 2024-04-23T14:50:32.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.947+0000 7f3b1e000640 1 -- 172.21.15.7:0/1692911606 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24630 (secure 0 0 0) 0x7f3b1809c140 con 0x7f3b201039b0 2024-04-23T14:50:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:32.950 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:49:44.075188+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:50:32.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.950+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3b040a3bb0 msgr2=0x7f3b040a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.950+0000 7f3b25e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3b040a3bb0 0x7f3b040a6070 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005fd0 tx=0x7f3b10009870 comp rx=0 tx=0).stop 2024-04-23T14:50:32.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.950+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 msgr2=0x7f3b2019f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.950+0000 7f3b25e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 0x7f3b2019f670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800d750 tx=0x7f3b1800dc10 comp rx=0 tx=0).stop 2024-04-23T14:50:32.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 shutdown_connections 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f3b040a3bb0 0x7f3b040a6070 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b201039b0 0x7f3b2019f670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b20102ff0 0x7f3b20198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 --2- 172.21.15.7:0/1692911606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b20101ea0 0x7f3b201980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 >> 172.21.15.7:0/1692911606 conn(0x7f3b200fd410 msgr2=0x7f3b20106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 shutdown_connections 2024-04-23T14:50:32.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:32.951+0000 7f3b25e00640 1 -- 172.21.15.7:0/1692911606 wait complete. 2024-04-23T14:50:32.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:50:33.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.182+0000 7f3629400640 1 -- 172.21.15.7:0/3033077611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 msgr2=0x7f3624074e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.182+0000 7f3629400640 1 --2- 172.21.15.7:0/3033077611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f3624074e60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f360c009900 tx=0x7f360c02a480 comp rx=0 tx=0).stop 2024-04-23T14:50:33.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 -- 172.21.15.7:0/3033077611 shutdown_connections 2024-04-23T14:50:33.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 --2- 172.21.15.7:0/3033077611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3624109d30 0x7f362410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 --2- 172.21.15.7:0/3033077611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f3624074e60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 --2- 172.21.15.7:0/3033077611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3624075fe0 0x7f3624074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 -- 172.21.15.7:0/3033077611 >> 172.21.15.7:0/3033077611 conn(0x7f36240fd410 msgr2=0x7f36240ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 -- 172.21.15.7:0/3033077611 shutdown_connections 2024-04-23T14:50:33.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.183+0000 7f3629400640 1 -- 172.21.15.7:0/3033077611 wait complete. 2024-04-23T14:50:33.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 Processor -- start 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 -- start start 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f362419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3624075fe0 0x7f362419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3624109d30 0x7f36241a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f362410fbe0 con 0x7f3624074a00 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f362410fa60 con 0x7f3624075fe0 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3629400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f362410fd60 con 0x7f3624109d30 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.184+0000 7f3623e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f362419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f362419a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55956/0 (socket says 172.21.15.7:55956) 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 -- 172.21.15.7:0/2652959842 learned_addr learned my addr 172.21.15.7:0/2652959842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3628a00640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3624109d30 0x7f36241a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3624075fe0 0x7f362419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 -- 172.21.15.7:0/2652959842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3624109d30 msgr2=0x7f36241a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3624109d30 0x7f36241a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 -- 172.21.15.7:0/2652959842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3624075fe0 msgr2=0x7f362419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3624075fe0 0x7f362419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 -- 172.21.15.7:0/2652959842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36241a1ef0 con 0x7f3624074a00 2024-04-23T14:50:33.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.185+0000 7f3623e00640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f362419a2d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f361400eab0 tx=0x7f361400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.186+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361400ce40 con 0x7f3624074a00 2024-04-23T14:50:33.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.186+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3614011920 con 0x7f3624074a00 2024-04-23T14:50:33.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.186+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614010a00 con 0x7f3624074a00 2024-04-23T14:50:33.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.186+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36241a21e0 con 0x7f3624074a00 2024-04-23T14:50:33.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.186+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36241a26e0 con 0x7f3624074a00 2024-04-23T14:50:33.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.187+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3624108af0 con 0x7f3624074a00 2024-04-23T14:50:33.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.189+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f3614011ad0 con 0x7f3624074a00 2024-04-23T14:50:33.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.191+0000 7f3620c00640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f36080a3c30 0x7f36080a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.191+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f36140d0e90 con 0x7f3624074a00 2024-04-23T14:50:33.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.191+0000 7f3623400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f36080a3c30 0x7f36080a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.192+0000 7f3623400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f36080a3c30 0x7f36080a60f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f362419b7e0 tx=0x7f360c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.196+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3614016030 con 0x7f3624074a00 2024-04-23T14:50:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:32 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2994087395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:50:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:32 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2077871326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:32 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1692911606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:32 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2994087395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:50:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:32 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2077871326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:32 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1692911606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:32 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2994087395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:50:33.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:32 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2077871326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:32 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1692911606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.444+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f362402d620 con 0x7f3624074a00 2024-04-23T14:50:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.446+0000 7f3620c00640 1 -- 172.21.15.7:0/2652959842 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11926 (secure 0 0 0) 0x7f361409d490 con 0x7f3624074a00 2024-04-23T14:50:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:33.448 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:53.850115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[34484,34526,34424,34448,24508]},"id":1}]} 2024-04-23T14:50:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:50:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.448+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f36080a3c30 msgr2=0x7f36080a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.448+0000 7f3629400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f36080a3c30 0x7f36080a60f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f362419b7e0 tx=0x7f360c0314a0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.448+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 msgr2=0x7f362419a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.448+0000 7f3629400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f362419a2d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f361400eab0 tx=0x7f361400ef70 comp rx=0 tx=0).stop 2024-04-23T14:50:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.448+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 shutdown_connections 2024-04-23T14:50:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f36080a3c30 0x7f36080a60f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3624075fe0 0x7f362419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3624109d30 0x7f36241a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 --2- 172.21.15.7:0/2652959842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3624074a00 0x7f362419a2d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 >> 172.21.15.7:0/2652959842 conn(0x7f36240fd410 msgr2=0x7f3624105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 shutdown_connections 2024-04-23T14:50:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.449+0000 7f3629400640 1 -- 172.21.15.7:0/2652959842 wait complete. 2024-04-23T14:50:33.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-23T14:48:23.629029+0000', 'modified': '2024-04-23T14:48:53.850115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34526, 'mds_1': 34484, 'mds_2': 34448, 'mds_3': 34424, 'mds_4': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14628': {'gid': 14628, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6839/2766173942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 2766173942}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 2766173942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14640': {'gid': 14640, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/1212403180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 1212403180}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 1212403180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6833/156003904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 156003904}, {'type': 'v1', 'addr': '172.21.15.186:6833', 'nonce': 156003904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/77772242', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 77772242}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 77772242}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/2659046243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 2659046243}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 2659046243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.186:6839/4267150138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 4267150138}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 4267150138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34424': {'gid': 34424, 'name': 'k', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.137:6833/3754100416', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 3754100416}, {'type': 'v1', 'addr': '172.21.15.137:6833', 'nonce': 3754100416}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34448': {'gid': 34448, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.137:6835/2502711779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 2502711779}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 2502711779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34484': {'gid': 34484, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.137:6837/1247128385', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1247128385}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1247128385}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34526': {'gid': 34526, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6839/174749197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 174749197}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 174749197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34526, 'qdb_cluster': [34484, 34526, 34424, 34448, 24508]} 2024-04-23T14:50:33.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T14:50:33.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 -- 172.21.15.7:0/792954053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80105330 msgr2=0x7feb801057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 --2- 172.21.15.7:0/792954053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80105330 0x7feb801057b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009900 tx=0x7feb6c02a410 comp rx=0 tx=0).stop 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 -- 172.21.15.7:0/792954053 shutdown_connections 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 --2- 172.21.15.7:0/792954053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb80105cf0 0x7feb8010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 --2- 172.21.15.7:0/792954053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80105330 0x7feb801057b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 --2- 172.21.15.7:0/792954053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb80104140 0x7feb80104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 -- 172.21.15.7:0/792954053 >> 172.21.15.7:0/792954053 conn(0x7feb800ff6b0 msgr2=0x7feb80101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 -- 172.21.15.7:0/792954053 shutdown_connections 2024-04-23T14:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.665+0000 7feb85c00640 1 -- 172.21.15.7:0/792954053 wait complete. 2024-04-23T14:50:33.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.666+0000 7feb85c00640 1 Processor -- start 2024-04-23T14:50:33.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.666+0000 7feb85c00640 1 -- start start 2024-04-23T14:50:33.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb85c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 0x7feb8019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb85c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb80105330 0x7feb8019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb85c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb80105cf0 0x7feb801a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb85c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb8010fc80 con 0x7feb80104140 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb85c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feb8010fb00 con 0x7feb80105330 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb85c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feb8010fe00 con 0x7feb80105cf0 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 0x7feb8019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 0x7feb8019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55966/0 (socket says 172.21.15.7:55966) 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 -- 172.21.15.7:0/4037383650 learned_addr learned my addr 172.21.15.7:0/4037383650 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7f400640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb80105330 0x7feb8019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 -- 172.21.15.7:0/4037383650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb80105cf0 msgr2=0x7feb801a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb80105cf0 0x7feb801a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 -- 172.21.15.7:0/4037383650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb80105330 msgr2=0x7feb8019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb80105330 0x7feb8019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.667+0000 7feb7fe00640 1 -- 172.21.15.7:0/4037383650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb801a1f80 con 0x7feb80104140 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.668+0000 7feb7fe00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 0x7feb8019a360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feb7000eaa0 tx=0x7feb7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.668+0000 7feb7cc00640 1 -- 172.21.15.7:0/4037383650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70016070 con 0x7feb80104140 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.668+0000 7feb7cc00640 1 -- 172.21.15.7:0/4037383650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb70003e20 con 0x7feb80104140 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.668+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb801a2270 con 0x7feb80104140 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.668+0000 7feb7cc00640 1 -- 172.21.15.7:0/4037383650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb700116d0 con 0x7feb80104140 2024-04-23T14:50:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.668+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb801a2770 con 0x7feb80104140 2024-04-23T14:50:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.671+0000 7feb8a00c740 1 Processor -- start 2024-04-23T14:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb7cc00640 1 -- 172.21.15.7:0/4037383650 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7feb70019070 con 0x7feb80104140 2024-04-23T14:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 -- start start 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120eaf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eafc50 0x55b120eb4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120eb7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b120e14b10 con 0x55b120eaf260 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b120dbb2b0 con 0x55b120eafc50 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb8a00c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b120e10ad0 con 0x55b120eb4dc0 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb85200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120eaf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb85200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120eaf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55982/0 (socket says 172.21.15.7:55982) 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb85200640 1 -- 172.21.15.7:0/1561759197 learned_addr learned my addr 172.21.15.7:0/1561759197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.672+0000 7feb7fe00640 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eafc50 0x55b120eb4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb85200640 1 -- 172.21.15.7:0/1561759197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 msgr2=0x55b120eb7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb7f400640 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120eb7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb85200640 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120eb7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb85200640 1 -- 172.21.15.7:0/1561759197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eafc50 msgr2=0x55b120eb4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb85200640 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eafc50 0x55b120eb4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb85200640 1 -- 172.21.15.7:0/1561759197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b120b272d0 con 0x55b120eaf260 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb7fe00640 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eafc50 0x55b120eb4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb85200640 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120eaf680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feb7800a960 tx=0x7feb7800ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1864c8661faebbce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb75600640 1 -- 172.21.15.7:0/1561759197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7800cd80 con 0x55b120eaf260 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb75600640 1 -- 172.21.15.7:0/1561759197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb7800f900 con 0x55b120eaf260 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb75600640 1 -- 172.21.15.7:0/1561759197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78018950 con 0x55b120eaf260 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.673+0000 7feb7cc00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7feb640a3bb0 0x7feb640a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb7cc00640 1 -- 172.21.15.7:0/4037383650 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7feb700d0960 con 0x7feb80104140 2024-04-23T14:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb7fe00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7feb640a3bb0 0x7feb640a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 -- 172.21.15.7:0/1561759197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 msgr2=0x55b120eaf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120eaf680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feb7800a960 tx=0x7feb7800ae20 comp rx=0 tx=0).stop 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 -- 172.21.15.7:0/1561759197 shutdown_connections 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eafc50 0x55b120eb4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120eb7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1561759197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120eaf680 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 -- 172.21.15.7:0/1561759197 >> 172.21.15.7:0/1561759197 conn(0x55b120eaa8d0 msgr2=0x55b120eaacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 -- 172.21.15.7:0/1561759197 shutdown_connections 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb8a00c740 1 -- 172.21.15.7:0/1561759197 wait complete. 2024-04-23T14:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.674+0000 7feb7fe00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7feb640a3bb0 0x7feb640a6070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb7009c7f0 tx=0x7feb70004030 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.675+0000 7feb8a00c740 1 -- start start 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.675+0000 7feb8a00c740 1 Processor -- start 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.675+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.675+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120eb9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.675+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 0x55b120ec0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.675+0000 7feb8a00c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b120eb7d70 con 0x55b120eb4dc0 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb8a00c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b120dce590 con 0x55b120eaf260 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb8a00c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b120eb7ef0 con 0x55b120eafc50 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb8a00c740 10 client.0 _ll_register_callbacks cb 0x55b120db13a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 0x55b120ec0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 0x55b120ec0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55988/0 (socket says 172.21.15.7:55988) 2024-04-23T14:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 -- 172.21.15.7:0/3568617162 learned_addr learned my addr 172.21.15.7:0/3568617162 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb7f400640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120eb9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 -- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 msgr2=0x55b120eb9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120eb9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 -- 172.21.15.7:0/3568617162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 msgr2=0x55b120eb96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.676+0000 7feb85200640 1 -- 172.21.15.7:0/3568617162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b120bf16b0 con 0x55b120eb4dc0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb85200640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 0x55b120ec0c60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feb7800cf50 tx=0x7feb78018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd25a0b2ae1f8013 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb6a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb6a000640 1 -- 172.21.15.7:0/3568617162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7800f510 con 0x55b120eb4dc0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb6a000640 1 -- 172.21.15.7:0/3568617162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7feb7800f6b0 con 0x55b120eb4dc0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb7800f900 con 0x55b120eb4dc0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb6a000640 1 -- 172.21.15.7:0/3568617162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb78031050 con 0x55b120eb4dc0 2024-04-23T14:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb8a00c740 10 client.15222 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b120ec3f40 con 0x55b120eb4dc0 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.677+0000 7feb6a000640 1 -- 172.21.15.7:0/3568617162 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb7800f900 con 0x55b120eb4dc0 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb6a000640 1 -- 172.21.15.7:0/3568617162 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7feb78023a70 con 0x55b120eb4dc0 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb8a00c740 10 client.15222 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb8a00c740 10 client.15222 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb8a00c740 20 client.15222 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb8a00c740 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120ec6290 0x55b120ec7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb8a00c740 4 client.15222 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.678+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 --> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b120e22530 con 0x55b120ec6290 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.679+0000 7feb7f400640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120ec6290 0x55b120ec7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.680+0000 7feb7f400640 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120ec6290 0x55b120ec7700 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a383bf3f2ef53a20 server_cookie=5dd774e9e11cf07f in_seq=0 out_seq=0 2024-04-23T14:50:33.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.680+0000 7feb6a000640 10 client.15222 ms_handle_connect on v2:172.21.15.186:6838/4267150138 2024-04-23T14:50:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb6a000640 1 -- 172.21.15.7:0/3568617162 <== mds.4 v2:172.21.15.186:6838/4267150138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b120e22530 con 0x55b120ec6290 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb6a000640 10 client.15222 handle_command_reply: tid=0 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 client.15222 shutdown 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 msgr2=0x55b120ec0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 0x55b120ec0c60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feb7800cf50 tx=0x7feb78018400 comp rx=0 tx=0).stop 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 shutdown_connections 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120ec6290 0x55b120ec7700 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eb4dc0 0x55b120ec0c60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120eb9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 --2- 172.21.15.7:0/3568617162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb6a000640 0 client.15222 ms_handle_reset on v2:172.21.15.186:6838/4267150138 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 >> 172.21.15.7:0/3568617162 conn(0x55b120eaa8d0 msgr2=0x55b120ea9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 shutdown_connections 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 1 -- 172.21.15.7:0/3568617162 wait complete. 2024-04-23T14:50:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.682+0000 7feb8a00c740 20 client.15222 trim_cache size 0 max 16384 2024-04-23T14:50:33.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 Processor -- start 2024-04-23T14:50:33.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 -- start start 2024-04-23T14:50:33.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 0x55b120ec0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120ec5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b120ec5a40 con 0x55b120eafc50 2024-04-23T14:50:33.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b120ec6110 con 0x55b120eaf260 2024-04-23T14:50:33.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.702+0000 7feb8a00c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b120ec67e0 con 0x55b120eb4dc0 2024-04-23T14:50:33.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 0x55b120ec0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 0x55b120ec0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55998/0 (socket says 172.21.15.7:55998) 2024-04-23T14:50:33.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 -- 172.21.15.7:0/1253684042 learned_addr learned my addr 172.21.15.7:0/1253684042 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb85200640 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120ec5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb85200640 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 -- 172.21.15.7:0/1253684042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 msgr2=0x55b120ec5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120ec5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 -- 172.21.15.7:0/1253684042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 msgr2=0x55b120eb82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.703+0000 7feb7f400640 1 -- 172.21.15.7:0/1253684042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b120eb4350 con 0x55b120eafc50 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.704+0000 7feb7f400640 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 0x55b120ec0b80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feb8019b870 tx=0x7feb6c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6613a6ed904274b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.704+0000 7feb74c00640 1 -- 172.21.15.7:0/1253684042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c049070 con 0x55b120eafc50 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.704+0000 7feb74c00640 1 -- 172.21.15.7:0/1253684042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb6c005040 con 0x55b120eafc50 2024-04-23T14:50:33.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.704+0000 7feb74c00640 1 -- 172.21.15.7:0/1253684042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c035040 con 0x55b120eafc50 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.704+0000 7feb8a00c740 1 -- 172.21.15.7:0/1253684042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 msgr2=0x55b120ec0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.704+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 0x55b120ec0b80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feb8019b870 tx=0x7feb6c009260 comp rx=0 tx=0).stop 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 -- 172.21.15.7:0/1253684042 shutdown_connections 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eb4dc0 0x55b120ec5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eafc50 0x55b120ec0b80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 --2- 172.21.15.7:0/1253684042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eaf260 0x55b120eb82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 -- 172.21.15.7:0/1253684042 >> 172.21.15.7:0/1253684042 conn(0x55b120eaa8d0 msgr2=0x55b120eaacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 -- 172.21.15.7:0/1253684042 shutdown_connections 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 -- 172.21.15.7:0/1253684042 wait complete. 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 -- start start 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.705+0000 7feb8a00c740 1 Processor -- start 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120ebc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120ebc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eb4dc0 0x55b120ebf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b120ec7580 con 0x55b120eaf260 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b120ec6eb0 con 0x55b120eb4dc0 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b120ec7c50 con 0x55b120eafc50 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb8a00c740 10 client.0 _ll_register_callbacks cb 0x7feb78018760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120ebc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120ebc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56006/0 (socket says 172.21.15.7:56006) 2024-04-23T14:50:33.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 -- 172.21.15.7:0/471084045 learned_addr learned my addr 172.21.15.7:0/471084045 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb7f400640 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120ebc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 -- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 msgr2=0x55b120ebc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120ebc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 -- 172.21.15.7:0/471084045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eb4dc0 msgr2=0x55b120ebf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eb4dc0 0x55b120ebf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.706+0000 7feb85200640 1 -- 172.21.15.7:0/471084045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b120ebfe10 con 0x55b120eaf260 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb85200640 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120ebc410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb7800afd0 tx=0x7feb7800a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3c4733d5e007f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb6a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb6a000640 1 -- 172.21.15.7:0/471084045 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78039030 con 0x55b120eaf260 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb6a000640 1 -- 172.21.15.7:0/471084045 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7feb7802c430 con 0x55b120eaf260 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb6c005040 con 0x55b120eaf260 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb6a000640 1 -- 172.21.15.7:0/471084045 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb78043050 con 0x55b120eaf260 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb8a00c740 10 client.15228 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:33.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b120f2c2a0 con 0x55b120eaf260 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.707+0000 7feb6a000640 1 -- 172.21.15.7:0/471084045 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb6c005040 con 0x55b120eaf260 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb6a000640 1 -- 172.21.15.7:0/471084045 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7feb7802ccc0 con 0x55b120eaf260 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb8a00c740 10 client.15228 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb8a00c740 10 client.15228 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb8a00c740 20 client.15228 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb8a00c740 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120f30ec0 0x55b120f2d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb8a00c740 4 client.15228 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:50:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 --> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] -- command(tid 0: {"prefix": "status"}) -- 0x55b120e1c3a0 con 0x55b120f30ec0 2024-04-23T14:50:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.708+0000 7feb7f400640 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120f30ec0 0x55b120f2d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.710+0000 7feb7f400640 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120f30ec0 0x55b120f2d300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1140a49310e71ed7 server_cookie=e9ccec77f24184a5 in_seq=0 out_seq=0 2024-04-23T14:50:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.710+0000 7feb6a000640 10 client.15228 ms_handle_connect on v2:172.21.15.186:6838/4267150138 2024-04-23T14:50:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.710+0000 7feb6a000640 1 -- 172.21.15.7:0/471084045 <== mds.4 v2:172.21.15.186:6838/4267150138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b120e1c3a0 con 0x55b120f30ec0 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.710+0000 7feb6a000640 10 client.15228 handle_command_reply: tid=0 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.710+0000 7feb8a00c740 1 client.15228 shutdown 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 msgr2=0x55b120ebc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120ebc410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb7800afd0 tx=0x7feb7800a610 comp rx=0 tx=0).stop 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 shutdown_connections 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x55b120f30ec0 0x55b120f2d300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b120eb4dc0 0x55b120ebf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b120eafc50 0x55b120ebc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 --2- 172.21.15.7:0/471084045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b120eaf260 0x55b120ebc410 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 >> 172.21.15.7:0/471084045 conn(0x55b120eaa8d0 msgr2=0x55b120eb92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb6a000640 0 client.15228 ms_handle_reset on v2:172.21.15.186:6838/4267150138 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 shutdown_connections 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 1 -- 172.21.15.7:0/471084045 wait complete. 2024-04-23T14:50:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.711+0000 7feb8a00c740 20 client.15228 trim_cache size 0 max 16384 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24508, 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 100.86951948399999, 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:50:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 148.89048527400001 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7feb640a3bb0 msgr2=0x7feb640a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7feb640a3bb0 0x7feb640a6070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb7009c7f0 tx=0x7feb70004030 comp rx=0 tx=0).stop 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 msgr2=0x7feb8019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 0x7feb8019a360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feb7000eaa0 tx=0x7feb7000ef60 comp rx=0 tx=0).stop 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 shutdown_connections 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7feb640a3bb0 0x7feb640a6070 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb80105330 0x7feb8019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb80105cf0 0x7feb801a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 --2- 172.21.15.7:0/4037383650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb80104140 0x7feb8019a360 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 >> 172.21.15.7:0/4037383650 conn(0x7feb800ff6b0 msgr2=0x7feb801086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 shutdown_connections 2024-04-23T14:50:33.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.712+0000 7feb85c00640 1 -- 172.21.15.7:0/4037383650 wait complete. 2024-04-23T14:50:33.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 -- 172.21.15.7:0/2599919248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 msgr2=0x7fcf48108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 --2- 172.21.15.7:0/2599919248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf48108960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009900 tx=0x7fcf3c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 -- 172.21.15.7:0/2599919248 shutdown_connections 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 --2- 172.21.15.7:0/2599919248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 0x7fcf48109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 --2- 172.21.15.7:0/2599919248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 0x7fcf48110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 --2- 172.21.15.7:0/2599919248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf48108960 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 -- 172.21.15.7:0/2599919248 >> 172.21.15.7:0/2599919248 conn(0x7fcf480774d0 msgr2=0x7fcf48079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 -- 172.21.15.7:0/2599919248 shutdown_connections 2024-04-23T14:50:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.925+0000 7fcf4e200640 1 -- 172.21.15.7:0/2599919248 wait complete. 2024-04-23T14:50:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 Processor -- start 2024-04-23T14:50:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 -- start start 2024-04-23T14:50:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf4819e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 0x7fcf4819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 0x7fcf481a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48114080 con 0x7fcf48108540 2024-04-23T14:50:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113f00 con 0x7fcf48109730 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.927+0000 7fcf4e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48114200 con 0x7fcf4810a0f0 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf4819e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf4819e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56032/0 (socket says 172.21.15.7:56032) 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 -- 172.21.15.7:0/3194669675 learned_addr learned my addr 172.21.15.7:0/3194669675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf47e00640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 0x7fcf4819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4d800640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 0x7fcf481a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 -- 172.21.15.7:0/3194669675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 msgr2=0x7fcf481a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 0x7fcf481a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 -- 172.21.15.7:0/3194669675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 msgr2=0x7fcf4819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 0x7fcf4819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 -- 172.21.15.7:0/3194669675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf481a6380 con 0x7fcf48108540 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf47e00640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 0x7fcf4819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4d800640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 0x7fcf481a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.928+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf4819e760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0314e0 tx=0x7fcf3c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.929+0000 7fcf45600640 1 -- 172.21.15.7:0/3194669675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c03f030 con 0x7fcf48108540 2024-04-23T14:50:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.929+0000 7fcf45600640 1 -- 172.21.15.7:0/3194669675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf3c003cb0 con 0x7fcf48108540 2024-04-23T14:50:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.929+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf481a6610 con 0x7fcf48108540 2024-04-23T14:50:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.929+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a6b00 con 0x7fcf48108540 2024-04-23T14:50:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.929+0000 7fcf45600640 1 -- 172.21.15.7:0/3194669675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c049060 con 0x7fcf48108540 2024-04-23T14:50:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.932+0000 7fcf525b3740 1 Processor -- start 2024-04-23T14:50:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.932+0000 7fcf45600640 1 -- 172.21.15.7:0/3194669675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fcf3c042030 con 0x7fcf48108540 2024-04-23T14:50:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.932+0000 7fcf525b3740 1 -- start start 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3260 0x563e6ebb3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebb8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebbb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf525b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e6eb18b10 con 0x563e6ebb3c50 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf525b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e6eabf2b0 con 0x563e6ebb8dc0 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf525b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563e6eb14ad0 con 0x563e6ebb3260 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebb8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebb8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56038/0 (socket says 172.21.15.7:56038) 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf4ce00640 1 -- 172.21.15.7:0/2059804458 learned_addr learned my addr 172.21.15.7:0/2059804458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf47e00640 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebbb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.933+0000 7fcf4d800640 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3260 0x563e6ebb3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4ce00640 1 -- 172.21.15.7:0/2059804458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3260 msgr2=0x563e6ebb3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3260 0x563e6ebb3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4ce00640 1 -- 172.21.15.7:0/2059804458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 msgr2=0x563e6ebbb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebbb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4ce00640 1 -- 172.21.15.7:0/2059804458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6e82b2d0 con 0x563e6ebb3c50 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf45600640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcf300a3bb0 0x7fcf300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebb8750 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0f9320 tx=0x7fcf3c0f9410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f57bd055517cc13 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf45600640 1 -- 172.21.15.7:0/3194669675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fcf3c0f11a0 con 0x7fcf48108540 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf4d800640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcf300a3bb0 0x7fcf300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf3a000640 1 -- 172.21.15.7:0/2059804458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0b9340 con 0x563e6ebb3c50 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf3a000640 1 -- 172.21.15.7:0/2059804458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf3c0bd7a0 con 0x563e6ebb3c50 2024-04-23T14:50:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.934+0000 7fcf3a000640 1 -- 172.21.15.7:0/2059804458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0f4cd0 con 0x563e6ebb3c50 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 -- 172.21.15.7:0/2059804458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 msgr2=0x563e6ebb8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebb8750 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0f9320 tx=0x7fcf3c0f9410 comp rx=0 tx=0).stop 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf4d800640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcf300a3bb0 0x7fcf300a6070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563e6ebb44b0 tx=0x7fcf40009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 -- 172.21.15.7:0/2059804458 shutdown_connections 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebbb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebb8750 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 --2- 172.21.15.7:0/2059804458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3260 0x563e6ebb3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 -- 172.21.15.7:0/2059804458 >> 172.21.15.7:0/2059804458 conn(0x563e6ebae8d0 msgr2=0x563e6ebaecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.935+0000 7fcf525b3740 1 -- 172.21.15.7:0/2059804458 shutdown_connections 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.936+0000 7fcf525b3740 1 -- 172.21.15.7:0/2059804458 wait complete. 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.936+0000 7fcf525b3740 1 -- start start 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.936+0000 7fcf525b3740 1 Processor -- start 2024-04-23T14:50:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebbd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebbd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb8dc0 0x563e6ebc4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebbbb30 con 0x563e6ebb3c50 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e6ead2590 con 0x563e6ebb3260 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebbbcb0 con 0x563e6ebb8dc0 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf525b3740 10 client.0 _ll_register_callbacks cb 0x563e6eab53a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebbd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebbd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56050/0 (socket says 172.21.15.7:56050) 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 -- 172.21.15.7:0/3987057939 learned_addr learned my addr 172.21.15.7:0/3987057939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebbd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 -- 172.21.15.7:0/3987057939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb8dc0 msgr2=0x563e6ebc4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb8dc0 0x563e6ebc4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 -- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 msgr2=0x563e6ebbd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebbd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.937+0000 7fcf47e00640 1 -- 172.21.15.7:0/3987057939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6e8f56b0 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf47e00640 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebbd910 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcf34010670 tx=0x7fcf34010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee6779a5dd510b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf2ea00640 1 -- 172.21.15.7:0/3987057939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34004220 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf2ea00640 1 -- 172.21.15.7:0/3987057939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fcf340043c0 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf3c0bd7a0 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf2ea00640 1 -- 172.21.15.7:0/3987057939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf34023050 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf525b3740 10 client.15240 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.938+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e6ebc7d90 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf2ea00640 1 -- 172.21.15.7:0/3987057939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf3c0bd7a0 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf2ea00640 1 -- 172.21.15.7:0/3987057939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcf3400f040 con 0x563e6ebb3c50 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf525b3740 10 client.15240 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf525b3740 10 client.15240 resolve_mds: resolved name 'k' to daemon mds.k 2024-04-23T14:50:33.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf525b3740 20 client.15240 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf525b3740 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ebca490 0x563e6ebcb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf525b3740 4 client.15240 mds_command: new command op to 34424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:50:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.939+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 --> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e6eb26530 con 0x563e6ebca490 2024-04-23T14:50:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.940+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ebca490 0x563e6ebcb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.941+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ebca490 0x563e6ebcb900 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=60b06db33b23fa2a server_cookie=a08435f20dd6267 in_seq=0 out_seq=0 2024-04-23T14:50:33.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.941+0000 7fcf2ea00640 10 client.15240 ms_handle_connect on v2:172.21.15.137:6832/3754100416 2024-04-23T14:50:33.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.943+0000 7fcf2ea00640 1 -- 172.21.15.7:0/3987057939 <== mds.3 v2:172.21.15.137:6832/3754100416 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563e6eb26530 con 0x563e6ebca490 2024-04-23T14:50:33.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.943+0000 7fcf2ea00640 10 client.15240 handle_command_reply: tid=0 2024-04-23T14:50:33.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.943+0000 7fcf525b3740 1 client.15240 shutdown 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 msgr2=0x563e6ebbd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebbd910 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcf34010670 tx=0x7fcf34010b30 comp rx=0 tx=0).stop 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 shutdown_connections 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ebca490 0x563e6ebcb900 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb8dc0 0x563e6ebc4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3c50 0x563e6ebbd910 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 --2- 172.21.15.7:0/3987057939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebbd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 >> 172.21.15.7:0/3987057939 conn(0x563e6ebae8d0 msgr2=0x563e6ebad970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf2ea00640 0 client.15240 ms_handle_reset on v2:172.21.15.137:6832/3754100416 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 shutdown_connections 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 1 -- 172.21.15.7:0/3987057939 wait complete. 2024-04-23T14:50:33.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.944+0000 7fcf525b3740 20 client.15240 trim_cache size 0 max 16384 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 Processor -- start 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 -- start start 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 0x563e6ebcb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ebc4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebb5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebc9c40 con 0x563e6ebb3260 2024-04-23T14:50:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebca310 con 0x563e6ebb8dc0 2024-04-23T14:50:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.964+0000 7fcf525b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebca9e0 con 0x563e6ebb3c50 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 0x563e6ebcb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 0x563e6ebcb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56056/0 (socket says 172.21.15.7:56056) 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 -- 172.21.15.7:0/1258294104 learned_addr learned my addr 172.21.15.7:0/1258294104 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf47e00640 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ebc4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4d800640 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebb5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 -- 172.21.15.7:0/1258294104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 msgr2=0x563e6ebc4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ebc4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 -- 172.21.15.7:0/1258294104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 msgr2=0x563e6ebb5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebb5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.965+0000 7fcf4ce00640 1 -- 172.21.15.7:0/1258294104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6ebb44e0 con 0x563e6ebb3260 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.966+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 0x563e6ebcb230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0bd030 tx=0x7fcf3c003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88af0a5014e242df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.966+0000 7fcf39600640 1 -- 172.21.15.7:0/1258294104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c035040 con 0x563e6ebb3260 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.966+0000 7fcf39600640 1 -- 172.21.15.7:0/1258294104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf3c0bd7a0 con 0x563e6ebb3260 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.966+0000 7fcf39600640 1 -- 172.21.15.7:0/1258294104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0bca00 con 0x563e6ebb3260 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 -- 172.21.15.7:0/1258294104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 msgr2=0x563e6ebcb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 0x563e6ebcb230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0bd030 tx=0x7fcf3c003e60 comp rx=0 tx=0).stop 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 -- 172.21.15.7:0/1258294104 shutdown_connections 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb8dc0 0x563e6ebb5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ebc4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 --2- 172.21.15.7:0/1258294104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb3260 0x563e6ebcb230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 -- 172.21.15.7:0/1258294104 >> 172.21.15.7:0/1258294104 conn(0x563e6ebae8d0 msgr2=0x563e6ebaecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 -- 172.21.15.7:0/1258294104 shutdown_connections 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 -- 172.21.15.7:0/1258294104 wait complete. 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 -- start start 2024-04-23T14:50:33.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.967+0000 7fcf525b3740 1 Processor -- start 2024-04-23T14:50:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebc2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ec2c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 0x563e6ec2e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebcb780 con 0x563e6ebb8dc0 2024-04-23T14:50:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebcb0b0 con 0x563e6ebb3260 2024-04-23T14:50:33.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563e6ebcbe50 con 0x563e6ebb3c50 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf525b3740 10 client.0 _ll_register_callbacks cb 0x7fcf34009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf4d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 0x563e6ec2e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf4d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 0x563e6ec2e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56064/0 (socket says 172.21.15.7:56064) 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf4d800640 1 -- 172.21.15.7:0/623964567 learned_addr learned my addr 172.21.15.7:0/623964567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebc2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.968+0000 7fcf47e00640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ec2c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf4d800640 1 -- 172.21.15.7:0/623964567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 msgr2=0x563e6ec2c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf4d800640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ec2c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf4d800640 1 -- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 msgr2=0x563e6ebc2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf4d800640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebc2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf4d800640 1 -- 172.21.15.7:0/623964567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6ec2eeb0 con 0x563e6ebb8dc0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf4d800640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 0x563e6ec2e970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf400127c0 tx=0x7fcf40004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab88a926844d929 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:33.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.969+0000 7fcf2ea00640 1 -- 172.21.15.7:0/623964567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4001eab0 con 0x563e6ebb8dc0 2024-04-23T14:50:33.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.970+0000 7fcf2ea00640 1 -- 172.21.15.7:0/623964567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fcf4001ec50 con 0x563e6ebb8dc0 2024-04-23T14:50:33.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.970+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf3c0bd7a0 con 0x563e6ebb8dc0 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.973+0000 7fcf2ea00640 1 -- 172.21.15.7:0/623964567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf40032050 con 0x563e6ebb8dc0 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.973+0000 7fcf525b3740 10 client.15246 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.973+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e6ec30230 con 0x563e6ebb8dc0 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.973+0000 7fcf2ea00640 1 -- 172.21.15.7:0/623964567 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf3c0bd7a0 con 0x563e6ebb8dc0 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf2ea00640 1 -- 172.21.15.7:0/623964567 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcf4001c410 con 0x563e6ebb8dc0 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf525b3740 10 client.15246 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf525b3740 10 client.15246 resolve_mds: resolved name 'k' to daemon mds.k 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf525b3740 20 client.15246 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:33.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf525b3740 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ec34e70 0x563e6ec33b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf525b3740 4 client.15246 mds_command: new command op to 34424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:50:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 --> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] -- command(tid 0: {"prefix": "status"}) -- 0x563e6eb203a0 con 0x563e6ec34e70 2024-04-23T14:50:33.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.974+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ec34e70 0x563e6ec33b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.975+0000 7fcf4ce00640 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ec34e70 0x563e6ec33b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1047c559eebc6c5e server_cookie=8f1e5dd2e8cc7657 in_seq=0 out_seq=0 2024-04-23T14:50:33.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.975+0000 7fcf2ea00640 10 client.15246 ms_handle_connect on v2:172.21.15.137:6832/3754100416 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.976+0000 7fcf2ea00640 1 -- 172.21.15.7:0/623964567 <== mds.3 v2:172.21.15.137:6832/3754100416 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563e6eb203a0 con 0x563e6ec34e70 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.976+0000 7fcf2ea00640 10 client.15246 handle_command_reply: tid=0 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.976+0000 7fcf525b3740 1 client.15246 shutdown 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.976+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 msgr2=0x563e6ec2e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.976+0000 7fcf525b3740 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 0x563e6ec2e970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf400127c0 tx=0x7fcf40004ab0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 shutdown_connections 2024-04-23T14:50:33.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x563e6ec34e70 0x563e6ec33b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e6ebb8dc0 0x563e6ec2e970 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e6ebb3c50 0x563e6ec2c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 --2- 172.21.15.7:0/623964567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e6ebb3260 0x563e6ebc2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 >> 172.21.15.7:0/623964567 conn(0x563e6ebae8d0 msgr2=0x563e6ebc9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf2ea00640 0 client.15246 ms_handle_reset on v2:172.21.15.137:6832/3754100416 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 shutdown_connections 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 1 -- 172.21.15.7:0/623964567 wait complete. 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.977+0000 7fcf525b3740 20 client.15246 trim_cache size 0 max 16384 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:50:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34424, 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 102.16436682299999, 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 177.67959685899999 2024-04-23T14:50:33.980 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:50:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcf300a3bb0 msgr2=0x7fcf300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcf300a3bb0 0x7fcf300a6070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563e6ebb44b0 tx=0x7fcf40009590 comp rx=0 tx=0).stop 2024-04-23T14:50:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 msgr2=0x7fcf4819e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf4819e760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0314e0 tx=0x7fcf3c0042e0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 shutdown_connections 2024-04-23T14:50:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fcf300a3bb0 0x7fcf300a6070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48109730 0x7fcf4819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf4810a0f0 0x7fcf481a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 --2- 172.21.15.7:0/3194669675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf48108540 0x7fcf4819e760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 >> 172.21.15.7:0/3194669675 conn(0x7fcf480774d0 msgr2=0x7fcf4810cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 shutdown_connections 2024-04-23T14:50:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:33.978+0000 7fcf4e200640 1 -- 172.21.15.7:0/3194669675 wait complete. 2024-04-23T14:50:33.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:33 smithi007 ceph-mon[27906]: pgmap v438: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:33.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:33 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2652959842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:33.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T14:50:34.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.210+0000 7f011ea00640 1 -- 172.21.15.7:0/1165496544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181052d0 msgr2=0x7f01181076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.210+0000 7f011ea00640 1 --2- 172.21.15.7:0/1165496544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181052d0 0x7f01181076c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0104009900 tx=0x7f010402a410 comp rx=0 tx=0).stop 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 -- 172.21.15.7:0/1165496544 shutdown_connections 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 --2- 172.21.15.7:0/1165496544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 0x7f011810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 --2- 172.21.15.7:0/1165496544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181052d0 0x7f01181076c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 --2- 172.21.15.7:0/1165496544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01181029a0 0x7f0118104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 -- 172.21.15.7:0/1165496544 >> 172.21.15.7:0/1165496544 conn(0x7f01180fc3b0 msgr2=0x7f01180fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 -- 172.21.15.7:0/1165496544 shutdown_connections 2024-04-23T14:50:34.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.211+0000 7f011ea00640 1 -- 172.21.15.7:0/1165496544 wait complete. 2024-04-23T14:50:34.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 Processor -- start 2024-04-23T14:50:34.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 -- start start 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 0x7f0118198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01181052d0 0x7f01181986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 0x7f011819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f011810da90 con 0x7f01181029a0 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f011810d910 con 0x7f01181052d0 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011ea00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f011810dc10 con 0x7f0118107c00 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.212+0000 7f011d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 0x7f0118198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 0x7f0118198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56084/0 (socket says 172.21.15.7:56084) 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 -- 172.21.15.7:0/2914308122 learned_addr learned my addr 172.21.15.7:0/2914308122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011e000640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 0x7f011819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011cc00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01181052d0 0x7f01181986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 -- 172.21.15.7:0/2914308122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 msgr2=0x7f011819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 0x7f011819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 -- 172.21.15.7:0/2914308122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01181052d0 msgr2=0x7f01181986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01181052d0 0x7f01181986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 -- 172.21.15.7:0/2914308122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011819fd80 con 0x7f01181029a0 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011e000640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 0x7f011819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.213+0000 7f011d600640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 0x7f0118198160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f010c00d950 tx=0x7f010c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.214+0000 7f0116000640 1 -- 172.21.15.7:0/2914308122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c017070 con 0x7f01181029a0 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.214+0000 7f0116000640 1 -- 172.21.15.7:0/2914308122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f010c009c30 con 0x7f01181029a0 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.214+0000 7f0116000640 1 -- 172.21.15.7:0/2914308122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c00f620 con 0x7f01181029a0 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.214+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01181a0070 con 0x7f01181029a0 2024-04-23T14:50:34.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.214+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181a05c0 con 0x7f01181029a0 2024-04-23T14:50:34.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.217+0000 7f0122d92740 1 Processor -- start 2024-04-23T14:50:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.217+0000 7f0122d92740 1 -- start start 2024-04-23T14:50:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.217+0000 7f0116000640 1 -- 172.21.15.7:0/2914308122 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f010c0109a0 con 0x7f01181029a0 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f0122d92740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696ef260 0x5580696ef680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f0122d92740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f0122d92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696f4dc0 0x5580696f7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f0122d92740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558069654b10 con 0x5580696efc50 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f0122d92740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5580695fb2b0 con 0x5580696ef260 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f0122d92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558069650ad0 con 0x5580696f4dc0 2024-04-23T14:50:34.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f011d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f011d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56096/0 (socket says 172.21.15.7:56096) 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f011d600640 1 -- 172.21.15.7:0/2056665741 learned_addr learned my addr 172.21.15.7:0/2056665741 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f011e000640 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696ef260 0x5580696ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.218+0000 7f011cc00640 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696f4dc0 0x5580696f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011d600640 1 -- 172.21.15.7:0/2056665741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696f4dc0 msgr2=0x5580696f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011d600640 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696f4dc0 0x5580696f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011d600640 1 -- 172.21.15.7:0/2056665741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696ef260 msgr2=0x5580696ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011d600640 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696ef260 0x5580696ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011d600640 1 -- 172.21.15.7:0/2056665741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580693672d0 con 0x5580696efc50 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011e000640 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696ef260 0x5580696ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:34.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f0116000640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01000a3bb0 0x7f01000a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011d600640 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696f4750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f010c0d66b0 tx=0x7f010c0d6b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db3cfb059421d1c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f0116000640 1 -- 172.21.15.7:0/2914308122 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f010c0d0460 con 0x7f01181029a0 2024-04-23T14:50:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f011e000640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01000a3bb0 0x7f01000a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f010a600640 1 -- 172.21.15.7:0/2056665741 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c020070 con 0x5580696efc50 2024-04-23T14:50:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f010a600640 1 -- 172.21.15.7:0/2056665741 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f010c009de0 con 0x5580696efc50 2024-04-23T14:50:34.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.219+0000 7f010a600640 1 -- 172.21.15.7:0/2056665741 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c09bd20 con 0x5580696efc50 2024-04-23T14:50:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 -- 172.21.15.7:0/2056665741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 msgr2=0x5580696f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f011e000640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01000a3bb0 0x7f01000a6070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5580696f04b0 tx=0x7f01100095b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696f4750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f010c0d66b0 tx=0x7f010c0d6b70 comp rx=0 tx=0).stop 2024-04-23T14:50:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 -- 172.21.15.7:0/2056665741 shutdown_connections 2024-04-23T14:50:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696f4dc0 0x5580696f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696f4750 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 --2- 172.21.15.7:0/2056665741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696ef260 0x5580696ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 -- 172.21.15.7:0/2056665741 >> 172.21.15.7:0/2056665741 conn(0x5580696ea8d0 msgr2=0x5580696eacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 -- 172.21.15.7:0/2056665741 shutdown_connections 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.220+0000 7f0122d92740 1 -- 172.21.15.7:0/2056665741 wait complete. 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.221+0000 7f0122d92740 1 -- start start 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.221+0000 7f0122d92740 1 Processor -- start 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.221+0000 7f0122d92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696fda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.221+0000 7f0122d92740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696fdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.221+0000 7f0122d92740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069705010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f0122d92740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5580696f7d70 con 0x5580696efc50 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f0122d92740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55806960e590 con 0x5580696f4dc0 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f0122d92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5580696f7ef0 con 0x5580696ef260 2024-04-23T14:50:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f0122d92740 10 client.0 _ll_register_callbacks cb 0x5580695f13a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696fdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56110/0 (socket says 172.21.15.7:56110) 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 -- 172.21.15.7:0/1163317517 learned_addr learned my addr 172.21.15.7:0/1163317517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011d600640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696fda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011e000640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069705010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 -- 172.21.15.7:0/1163317517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 msgr2=0x5580696fda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696fda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 -- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 msgr2=0x558069705010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069705010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.222+0000 7f011cc00640 1 -- 172.21.15.7:0/1163317517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580694316b0 con 0x5580696efc50 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f011cc00640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696fdfd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f011806b160 tx=0x7f0104005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f44178a61bb0f42 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f00fea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f00fea00640 1 -- 172.21.15.7:0/1163317517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104035030 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f00fea00640 1 -- 172.21.15.7:0/1163317517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f01040048c0 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010c009de0 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f00fea00640 1 -- 172.21.15.7:0/1163317517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f010404c050 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f0122d92740 10 client.15258 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.223+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580697083f0 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f00fea00640 1 -- 172.21.15.7:0/1163317517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f010c009de0 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f00fea00640 1 -- 172.21.15.7:0/1163317517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0104003ae0 con 0x5580696efc50 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f0122d92740 10 client.15258 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f0122d92740 10 client.15258 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f0122d92740 20 client.15258 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f0122d92740 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55806970aa80 0x55806970bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f0122d92740 4 client.15258 mds_command: new command op to 34448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:50:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.224+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 --> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558069662530 con 0x55806970aa80 2024-04-23T14:50:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.225+0000 7f011d600640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55806970aa80 0x55806970bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.226+0000 7f011d600640 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55806970aa80 0x55806970bef0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5378359da430743e server_cookie=3cbd1b6353ae96dd in_seq=0 out_seq=0 2024-04-23T14:50:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.226+0000 7f00fea00640 10 client.15258 ms_handle_connect on v2:172.21.15.137:6834/2502711779 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.228+0000 7f00fea00640 1 -- 172.21.15.7:0/1163317517 <== mds.2 v2:172.21.15.137:6834/2502711779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558069662530 con 0x55806970aa80 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.228+0000 7f00fea00640 10 client.15258 handle_command_reply: tid=0 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.228+0000 7f0122d92740 1 client.15258 shutdown 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.228+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 msgr2=0x5580696fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.228+0000 7f0122d92740 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696fdfd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f011806b160 tx=0x7f0104005270 comp rx=0 tx=0).stop 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.228+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 shutdown_connections 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55806970aa80 0x55806970bef0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069705010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x5580696fdfd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 --2- 172.21.15.7:0/1163317517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696fda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f00fea00640 0 client.15258 ms_handle_reset on v2:172.21.15.137:6834/2502711779 2024-04-23T14:50:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 >> 172.21.15.7:0/1163317517 conn(0x5580696ea8d0 msgr2=0x5580696e9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 shutdown_connections 2024-04-23T14:50:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 1 -- 172.21.15.7:0/1163317517 wait complete. 2024-04-23T14:50:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.229+0000 7f0122d92740 20 client.15258 trim_cache size 0 max 16384 2024-04-23T14:50:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 Processor -- start 2024-04-23T14:50:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 -- start start 2024-04-23T14:50:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x558069704fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x5580696e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55806970a230 con 0x5580696efc50 2024-04-23T14:50:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55806970a900 con 0x5580696f4dc0 2024-04-23T14:50:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.248+0000 7f0122d92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55806970afd0 con 0x5580696ef260 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x558069704fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x558069704fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56126/0 (socket says 172.21.15.7:56126) 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 -- 172.21.15.7:0/3809132726 learned_addr learned my addr 172.21.15.7:0/3809132726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011d600640 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011e000640 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x5580696e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 -- 172.21.15.7:0/3809132726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 msgr2=0x5580696f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 -- 172.21.15.7:0/3809132726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 msgr2=0x5580696e5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x5580696e5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.249+0000 7f011cc00640 1 -- 172.21.15.7:0/3809132726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580696f0030 con 0x5580696efc50 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.250+0000 7f011cc00640 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x558069704fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0104009850 tx=0x7f010402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f3f0fa1ad5e615 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.250+0000 7f0109c00640 1 -- 172.21.15.7:0/3809132726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104035070 con 0x5580696efc50 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.250+0000 7f0109c00640 1 -- 172.21.15.7:0/3809132726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0104031650 con 0x5580696efc50 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.250+0000 7f0109c00640 1 -- 172.21.15.7:0/3809132726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104003b60 con 0x5580696efc50 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.250+0000 7f0122d92740 1 -- 172.21.15.7:0/3809132726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 msgr2=0x558069704fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.250+0000 7f0122d92740 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x558069704fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0104009850 tx=0x7f010402a410 comp rx=0 tx=0).stop 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 -- 172.21.15.7:0/3809132726 shutdown_connections 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x5580696e5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696efc50 0x558069704fd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 --2- 172.21.15.7:0/3809132726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696ef260 0x5580696f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 -- 172.21.15.7:0/3809132726 >> 172.21.15.7:0/3809132726 conn(0x5580696ea8d0 msgr2=0x5580696eacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 -- 172.21.15.7:0/3809132726 shutdown_connections 2024-04-23T14:50:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 -- 172.21.15.7:0/3809132726 wait complete. 2024-04-23T14:50:34.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 -- start start 2024-04-23T14:50:34.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.251+0000 7f0122d92740 1 Processor -- start 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 0x558069700380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696efc50 0x5580697008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069703890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55806970bd70 con 0x5580696ef260 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55806970b6a0 con 0x5580696f4dc0 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55806970c440 con 0x5580696efc50 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f0122d92740 10 client.0 _ll_register_callbacks cb 0x7f01040045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 0x558069700380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 0x558069700380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56140/0 (socket says 172.21.15.7:56140) 2024-04-23T14:50:34.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 -- 172.21.15.7:0/1338290481 learned_addr learned my addr 172.21.15.7:0/1338290481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 -- 172.21.15.7:0/1338290481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696efc50 msgr2=0x5580697008c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696efc50 0x5580697008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 -- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 msgr2=0x558069703890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069703890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.252+0000 7f011d600640 1 -- 172.21.15.7:0/1338290481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558069703e80 con 0x5580696ef260 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f011d600640 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 0x558069700380 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f010c0d66b0 tx=0x7f010c09c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99977b9fea0f0557 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f00fea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f00fea00640 1 -- 172.21.15.7:0/1338290481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c020040 con 0x5580696ef260 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f00fea00640 1 -- 172.21.15.7:0/1338290481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f010c09a6c0 con 0x5580696ef260 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0104031650 con 0x5580696ef260 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f00fea00640 1 -- 172.21.15.7:0/1338290481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f010c0b0e60 con 0x5580696ef260 2024-04-23T14:50:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f0122d92740 10 client.15264 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558069705180 con 0x5580696ef260 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f00fea00640 1 -- 172.21.15.7:0/1338290481 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0104031650 con 0x5580696ef260 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.253+0000 7f00fea00640 1 -- 172.21.15.7:0/1338290481 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f010c098a30 con 0x5580696ef260 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f0122d92740 10 client.15264 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f0122d92740 10 client.15264 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f0122d92740 20 client.15264 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f0122d92740 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x558069774d80 0x558069773a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f0122d92740 4 client.15264 mds_command: new command op to 34448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 --> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] -- command(tid 0: {"prefix": "status"}) -- 0x55806965c3a0 con 0x558069774d80 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.254+0000 7f011cc00640 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x558069774d80 0x558069773a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.255+0000 7f011cc00640 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x558069774d80 0x558069773a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b5818841c0351ea server_cookie=57354e8c7c9bfa2a in_seq=0 out_seq=0 2024-04-23T14:50:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.255+0000 7f00fea00640 10 client.15264 ms_handle_connect on v2:172.21.15.137:6834/2502711779 2024-04-23T14:50:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f00fea00640 1 -- 172.21.15.7:0/1338290481 <== mds.2 v2:172.21.15.137:6834/2502711779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55806965c3a0 con 0x558069774d80 2024-04-23T14:50:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f00fea00640 10 client.15264 handle_command_reply: tid=0 2024-04-23T14:50:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 client.15264 shutdown 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 msgr2=0x558069700380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 0x558069700380 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f010c0d66b0 tx=0x7f010c09c190 comp rx=0 tx=0).stop 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 shutdown_connections 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x558069774d80 0x558069773a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5580696f4dc0 0x558069703890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5580696efc50 0x5580697008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f00fea00640 0 client.15264 ms_handle_reset on v2:172.21.15.137:6834/2502711779 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 --2- 172.21.15.7:0/1338290481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5580696ef260 0x558069700380 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 >> 172.21.15.7:0/1338290481 conn(0x5580696ea8d0 msgr2=0x5580696eacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 shutdown_connections 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 1 -- 172.21.15.7:0/1338290481 wait complete. 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.256+0000 7f0122d92740 20 client.15264 trim_cache size 0 max 16384 2024-04-23T14:50:34.261 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34448, 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 103.454143579, 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 165.673675938 2024-04-23T14:50:34.262 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01000a3bb0 msgr2=0x7f01000a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01000a3bb0 0x7f01000a6070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5580696f04b0 tx=0x7f01100095b0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 msgr2=0x7f0118198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 0x7f0118198160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f010c00d950 tx=0x7f010c00de10 comp rx=0 tx=0).stop 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 shutdown_connections 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f01000a3bb0 0x7f01000a6070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01181052d0 0x7f01181986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0118107c00 0x7f011819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 --2- 172.21.15.7:0/2914308122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01181029a0 0x7f0118198160 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 >> 172.21.15.7:0/2914308122 conn(0x7f01180fc3b0 msgr2=0x7f0118103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 shutdown_connections 2024-04-23T14:50:34.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.257+0000 7f011ea00640 1 -- 172.21.15.7:0/2914308122 wait complete. 2024-04-23T14:50:34.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-23T14:50:34.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:33 smithi186 ceph-mon[31814]: pgmap v438: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:34.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:33 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2652959842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:34.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:33 smithi137 ceph-mon[31694]: pgmap v438: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:34.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:33 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2652959842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:50:34.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.476+0000 7fa02f200640 1 -- 172.21.15.7:0/1741457733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030104140 msgr2=0x7fa030104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.476+0000 7fa02f200640 1 --2- 172.21.15.7:0/1741457733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030104140 0x7fa030104560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa020009900 tx=0x7fa02002a410 comp rx=0 tx=0).stop 2024-04-23T14:50:34.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 -- 172.21.15.7:0/1741457733 shutdown_connections 2024-04-23T14:50:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 --2- 172.21.15.7:0/1741457733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa030105330 0x7fa0301057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 --2- 172.21.15.7:0/1741457733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030105cf0 0x7fa03010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 --2- 172.21.15.7:0/1741457733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030104140 0x7fa030104560 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 -- 172.21.15.7:0/1741457733 >> 172.21.15.7:0/1741457733 conn(0x7fa0300ff6b0 msgr2=0x7fa030101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 -- 172.21.15.7:0/1741457733 shutdown_connections 2024-04-23T14:50:34.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.477+0000 7fa02f200640 1 -- 172.21.15.7:0/1741457733 wait complete. 2024-04-23T14:50:34.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 Processor -- start 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 -- start start 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030104140 0x7fa03019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa030105330 0x7fa03019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 0x7fa0301a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa03010fc80 con 0x7fa030105cf0 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa03010fb00 con 0x7fa030105330 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.478+0000 7fa02f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa03010fe00 con 0x7fa030104140 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 0x7fa0301a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 0x7fa0301a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56166/0 (socket says 172.21.15.7:56166) 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 -- 172.21.15.7:0/4077782000 learned_addr learned my addr 172.21.15.7:0/4077782000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02de00640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030104140 0x7fa03019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02d400640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa030105330 0x7fa03019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 -- 172.21.15.7:0/4077782000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030104140 msgr2=0x7fa03019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030104140 0x7fa03019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 -- 172.21.15.7:0/4077782000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa030105330 msgr2=0x7fa03019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa030105330 0x7fa03019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 -- 172.21.15.7:0/4077782000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0301a1f80 con 0x7fa030105cf0 2024-04-23T14:50:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02de00640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030104140 0x7fa03019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:34.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.479+0000 7fa02e800640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 0x7fa0301a1910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa02800eb10 tx=0x7fa02800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.480+0000 7fa026a00640 1 -- 172.21.15.7:0/4077782000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028004b20 con 0x7fa030105cf0 2024-04-23T14:50:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.480+0000 7fa026a00640 1 -- 172.21.15.7:0/4077782000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa028004cc0 con 0x7fa030105cf0 2024-04-23T14:50:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.480+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0301a2270 con 0x7fa030105cf0 2024-04-23T14:50:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.480+0000 7fa026a00640 1 -- 172.21.15.7:0/4077782000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028010690 con 0x7fa030105cf0 2024-04-23T14:50:34.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.480+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0301a27c0 con 0x7fa030105cf0 2024-04-23T14:50:34.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.483+0000 7fa037a00740 1 Processor -- start 2024-04-23T14:50:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.483+0000 7fa026a00640 1 -- 172.21.15.7:0/4077782000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fa028005020 con 0x7fa030105cf0 2024-04-23T14:50:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 -- start start 2024-04-23T14:50:34.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 0x5577c8763680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763c50 0x5577c8768750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8768dc0 0x5577c876b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5577c86c8b10 con 0x5577c8763260 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577c866f2b0 con 0x5577c8763c50 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa037a00740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5577c86c4ad0 con 0x5577c8768dc0 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 0x5577c8763680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 0x5577c8763680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56180/0 (socket says 172.21.15.7:56180) 2024-04-23T14:50:34.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.484+0000 7fa02d400640 1 -- 172.21.15.7:0/3298661492 learned_addr learned my addr 172.21.15.7:0/3298661492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02de00640 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763c50 0x5577c8768750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02d400640 1 -- 172.21.15.7:0/3298661492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8768dc0 msgr2=0x5577c876b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02d400640 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8768dc0 0x5577c876b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02d400640 1 -- 172.21.15.7:0/3298661492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763c50 msgr2=0x5577c8768750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02d400640 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763c50 0x5577c8768750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02d400640 1 -- 172.21.15.7:0/3298661492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c83db2d0 con 0x5577c8763260 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02de00640 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763c50 0x5577c8768750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:34.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa026a00640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0140a3bb0 0x7fa0140a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa02d400640 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 0x5577c8763680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009cc0 tx=0x7fa01c0137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280f0b904744b403 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa026a00640 1 -- 172.21.15.7:0/4077782000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa0280d0fe0 con 0x7fa030105cf0 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa01b000640 1 -- 172.21.15.7:0/3298661492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c013070 con 0x5577c8763260 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.485+0000 7fa01b000640 1 -- 172.21.15.7:0/3298661492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa01c017030 con 0x5577c8763260 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa01b000640 1 -- 172.21.15.7:0/3298661492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c011640 con 0x5577c8763260 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa02de00640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0140a3bb0 0x7fa0140a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 -- 172.21.15.7:0/3298661492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 msgr2=0x5577c8763680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 0x5577c8763680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009cc0 tx=0x7fa01c0137d0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa02de00640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0140a3bb0 0x7fa0140a6070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa020000c00 tx=0x7fa0200058b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 -- 172.21.15.7:0/3298661492 shutdown_connections 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763c50 0x5577c8768750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8768dc0 0x5577c876b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 --2- 172.21.15.7:0/3298661492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763260 0x5577c8763680 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 -- 172.21.15.7:0/3298661492 >> 172.21.15.7:0/3298661492 conn(0x5577c875e8d0 msgr2=0x5577c875ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.486+0000 7fa037a00740 1 -- 172.21.15.7:0/3298661492 shutdown_connections 2024-04-23T14:50:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.487+0000 7fa037a00740 1 -- 172.21.15.7:0/3298661492 wait complete. 2024-04-23T14:50:34.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.487+0000 7fa037a00740 1 -- start start 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.487+0000 7fa037a00740 1 Processor -- start 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5577c876bd70 con 0x5577c8763c50 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577c8682590 con 0x5577c8768dc0 2024-04-23T14:50:34.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5577c876bef0 con 0x5577c8763260 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa037a00740 10 client.0 _ll_register_callbacks cb 0x5577c86653a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56184/0 (socket says 172.21.15.7:56184) 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 -- 172.21.15.7:0/4217224906 learned_addr learned my addr 172.21.15.7:0/4217224906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02de00640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02e800640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 -- 172.21.15.7:0/4217224906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 msgr2=0x5577c876d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 -- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 msgr2=0x5577c8774c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.488+0000 7fa02d400640 1 -- 172.21.15.7:0/4217224906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c84a56b0 con 0x5577c8763c50 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa02d400640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009690 tx=0x7fa01c009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c5f2f5f68f7877 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa00f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa00f400640 1 -- 172.21.15.7:0/4217224906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c004440 con 0x5577c8763c50 2024-04-23T14:50:34.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa01c017030 con 0x5577c8763c50 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa00f400640 1 -- 172.21.15.7:0/4217224906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa01c00f440 con 0x5577c8763c50 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa00f400640 1 -- 172.21.15.7:0/4217224906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa01c00f640 con 0x5577c8763c50 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa037a00740 10 client.15276 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.489+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5577c8777ef0 con 0x5577c8763c50 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa00f400640 1 -- 172.21.15.7:0/4217224906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa01c017030 con 0x5577c8763c50 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa00f400640 1 -- 172.21.15.7:0/4217224906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa01c004950 con 0x5577c8763c50 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa037a00740 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa037a00740 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa037a00740 20 client.15276 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa037a00740 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c877a340 0x5577c877b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa037a00740 4 client.15276 mds_command: new command op to 34484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.490+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 --> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577c86d6530 con 0x5577c877a340 2024-04-23T14:50:34.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.491+0000 7fa02de00640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c877a340 0x5577c877b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.492+0000 7fa02de00640 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c877a340 0x5577c877b7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=985ca42b72cc1ee7 server_cookie=22ea09ba5aa1a4e0 in_seq=0 out_seq=0 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.492+0000 7fa00f400640 10 client.15276 ms_handle_connect on v2:172.21.15.137:6836/1247128385 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa00f400640 1 -- 172.21.15.7:0/4217224906 <== mds.1 v2:172.21.15.137:6836/1247128385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5577c86d6530 con 0x5577c877a340 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa00f400640 10 client.15276 handle_command_reply: tid=0 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 client.15276 shutdown 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 msgr2=0x5577c876dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009690 tx=0x7fa01c009960 comp rx=0 tx=0).stop 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 shutdown_connections 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c877a340 0x5577c877b7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 --2- 172.21.15.7:0/4217224906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa00f400640 0 client.15276 ms_handle_reset on v2:172.21.15.137:6836/1247128385 2024-04-23T14:50:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 >> 172.21.15.7:0/4217224906 conn(0x5577c875e8d0 msgr2=0x5577c875d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 shutdown_connections 2024-04-23T14:50:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.494+0000 7fa037a00740 1 -- 172.21.15.7:0/4217224906 wait complete. 2024-04-23T14:50:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.495+0000 7fa037a00740 20 client.15276 trim_cache size 0 max 16384 2024-04-23T14:50:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 Processor -- start 2024-04-23T14:50:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 -- start start 2024-04-23T14:50:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5577c8779af0 con 0x5577c8763c50 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577c877a1c0 con 0x5577c8768dc0 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.515+0000 7fa037a00740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5577c877a890 con 0x5577c8763260 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56194/0 (socket says 172.21.15.7:56194) 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 -- 172.21.15.7:0/3913157885 learned_addr learned my addr 172.21.15.7:0/3913157885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02e800640 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02de00640 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 -- 172.21.15.7:0/3913157885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 msgr2=0x5577c876d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 -- 172.21.15.7:0/3913157885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 msgr2=0x5577c8774bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.516+0000 7fa02d400640 1 -- 172.21.15.7:0/3913157885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c877bae0 con 0x5577c8763c50 2024-04-23T14:50:34.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.517+0000 7fa02d400640 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa01c004d90 tx=0x7fa01c00f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bf768f99045cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.517+0000 7fa01a600640 1 -- 172.21.15.7:0/3913157885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c038030 con 0x5577c8763c50 2024-04-23T14:50:34.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.517+0000 7fa01a600640 1 -- 172.21.15.7:0/3913157885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa01c017040 con 0x5577c8763c50 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.517+0000 7fa01a600640 1 -- 172.21.15.7:0/3913157885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00fdc0 con 0x5577c8763c50 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 -- 172.21.15.7:0/3913157885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 msgr2=0x5577c876dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa01c004d90 tx=0x7fa01c00f5d0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 -- 172.21.15.7:0/3913157885 shutdown_connections 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8768dc0 0x5577c8774bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8763c50 0x5577c876dbd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 --2- 172.21.15.7:0/3913157885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8763260 0x5577c876d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 -- 172.21.15.7:0/3913157885 >> 172.21.15.7:0/3913157885 conn(0x5577c875e8d0 msgr2=0x5577c87792f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 -- 172.21.15.7:0/3913157885 shutdown_connections 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 -- 172.21.15.7:0/3913157885 wait complete. 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 -- start start 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.518+0000 7fa037a00740 1 Processor -- start 2024-04-23T14:50:34.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763260 0x5577c8770520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 0x5577c8770a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8773a80 0x5577c8773f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5577c877b630 con 0x5577c8768dc0 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577c877af60 con 0x5577c8763260 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5577c877bd00 con 0x5577c8773a80 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa037a00740 10 client.0 _ll_register_callbacks cb 0x7fa01c009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 0x5577c8770a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 0x5577c8770a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56198/0 (socket says 172.21.15.7:56198) 2024-04-23T14:50:34.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 -- 172.21.15.7:0/491008857 learned_addr learned my addr 172.21.15.7:0/491008857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 -- 172.21.15.7:0/491008857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8773a80 msgr2=0x5577c8773f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8773a80 0x5577c8773f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 -- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763260 msgr2=0x5577c8770520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.519+0000 7fa02d400640 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763260 0x5577c8770520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa02d400640 1 -- 172.21.15.7:0/491008857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c8774440 con 0x5577c8768dc0 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa02d400640 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 0x5577c8770a60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa01c013810 tx=0x7fa01c005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfa8795ddd0678b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa00f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:34.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa00f400640 1 -- 172.21.15.7:0/491008857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c009960 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa01c017040 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa00f400640 1 -- 172.21.15.7:0/491008857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa01c0035f0 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa00f400640 1 -- 172.21.15.7:0/491008857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa01c04c050 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa037a00740 10 client.15282 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.520+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5577c87e0830 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa00f400640 1 -- 172.21.15.7:0/491008857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa01c017040 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa00f400640 1 -- 172.21.15.7:0/491008857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa01c004360 con 0x5577c8768dc0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa037a00740 10 client.15282 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa037a00740 10 client.15282 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa037a00740 20 client.15282 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa037a00740 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c87e50e0 0x5577c87e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa037a00740 4 client.15282 mds_command: new command op to 34484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.521+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 --> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] -- command(tid 0: {"prefix": "status"}) -- 0x5577c86d03a0 con 0x5577c87e50e0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.522+0000 7fa02de00640 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c87e50e0 0x5577c87e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.522+0000 7fa02de00640 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c87e50e0 0x5577c87e3df0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d58fdd25d9c3ca89 server_cookie=233282c60585c6a3 in_seq=0 out_seq=0 2024-04-23T14:50:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.522+0000 7fa00f400640 10 client.15282 ms_handle_connect on v2:172.21.15.137:6836/1247128385 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.523+0000 7fa00f400640 1 -- 172.21.15.7:0/491008857 <== mds.1 v2:172.21.15.137:6836/1247128385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5577c86d03a0 con 0x5577c87e50e0 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.523+0000 7fa00f400640 10 client.15282 handle_command_reply: tid=0 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.523+0000 7fa037a00740 1 client.15282 shutdown 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.523+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 msgr2=0x5577c8770a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.523+0000 7fa037a00740 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 0x5577c8770a60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa01c013810 tx=0x7fa01c005130 comp rx=0 tx=0).stop 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 shutdown_connections 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x5577c87e50e0 0x5577c87e3df0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577c8773a80 0x5577c8773f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577c8768dc0 0x5577c8770a60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa00f400640 0 client.15282 ms_handle_reset on v2:172.21.15.137:6836/1247128385 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 --2- 172.21.15.7:0/491008857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577c8763260 0x5577c8770520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 >> 172.21.15.7:0/491008857 conn(0x5577c875e8d0 msgr2=0x5577c876d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 shutdown_connections 2024-04-23T14:50:34.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 1 -- 172.21.15.7:0/491008857 wait complete. 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa037a00740 20 client.15282 trim_cache size 0 max 16384 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34484, 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 104.74772404799999, 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:50:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:50:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:50:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 153.850979865 2024-04-23T14:50:34.529 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:50:34.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0140a3bb0 msgr2=0x7fa0140a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa02f200640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0140a3bb0 0x7fa0140a6070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa020000c00 tx=0x7fa0200058b0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 msgr2=0x7fa0301a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.524+0000 7fa02f200640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 0x7fa0301a1910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa02800eb10 tx=0x7fa02800c2d0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 shutdown_connections 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0140a3bb0 0x7fa0140a6070 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa030105330 0x7fa03019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa030105cf0 0x7fa0301a1910 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 --2- 172.21.15.7:0/4077782000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa030104140 0x7fa03019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 >> 172.21.15.7:0/4077782000 conn(0x7fa0300ff6b0 msgr2=0x7fa0301086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 shutdown_connections 2024-04-23T14:50:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.525+0000 7fa02f200640 1 -- 172.21.15.7:0/4077782000 wait complete. 2024-04-23T14:50:34.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 -- 172.21.15.7:0/1656441703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a0077c00 msgr2=0x7fa0a0078060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 --2- 172.21.15.7:0/1656441703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a0077c00 0x7fa0a0078060 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009900 tx=0x7fa08c02a400 comp rx=0 tx=0).stop 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 -- 172.21.15.7:0/1656441703 shutdown_connections 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 --2- 172.21.15.7:0/1656441703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a00785a0 0x7fa0a0078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 --2- 172.21.15.7:0/1656441703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a0077c00 0x7fa0a0078060 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 --2- 172.21.15.7:0/1656441703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a00769c0 0x7fa0a0076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 -- 172.21.15.7:0/1656441703 >> 172.21.15.7:0/1656441703 conn(0x7fa0a00ff6b0 msgr2=0x7fa0a0101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 -- 172.21.15.7:0/1656441703 shutdown_connections 2024-04-23T14:50:34.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.740+0000 7fa09fe00640 1 -- 172.21.15.7:0/1656441703 wait complete. 2024-04-23T14:50:34.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.741+0000 7fa09fe00640 1 Processor -- start 2024-04-23T14:50:34.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 -- start start 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 0x7fa0a019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a0077c00 0x7fa0a019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a00785a0 0x7fa0a01a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a0114080 con 0x7fa0a00769c0 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a0113f00 con 0x7fa0a0077c00 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.742+0000 7fa09fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a0114200 con 0x7fa0a00785a0 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 0x7fa0a019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 0x7fa0a019e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56214/0 (socket says 172.21.15.7:56214) 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 -- 172.21.15.7:0/3061857655 learned_addr learned my addr 172.21.15.7:0/3061857655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09f400640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a00785a0 0x7fa0a01a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09e000640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a0077c00 0x7fa0a019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 -- 172.21.15.7:0/3061857655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a00785a0 msgr2=0x7fa0a01a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a00785a0 0x7fa0a01a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 -- 172.21.15.7:0/3061857655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a0077c00 msgr2=0x7fa0a019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a0077c00 0x7fa0a019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.743+0000 7fa09ea00640 1 -- 172.21.15.7:0/3061857655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a01a6300 con 0x7fa0a00769c0 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.744+0000 7fa09ea00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 0x7fa0a019e6e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa09000d770 tx=0x7fa09000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.744+0000 7fa097400640 1 -- 172.21.15.7:0/3061857655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090017070 con 0x7fa0a00769c0 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.744+0000 7fa097400640 1 -- 172.21.15.7:0/3061857655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0900054d0 con 0x7fa0a00769c0 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.744+0000 7fa097400640 1 -- 172.21.15.7:0/3061857655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090004cf0 con 0x7fa0a00769c0 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.744+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a01a65f0 con 0x7fa0a00769c0 2024-04-23T14:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.744+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a01a6af0 con 0x7fa0a00769c0 2024-04-23T14:50:34.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.747+0000 7fa0a863b740 1 Processor -- start 2024-04-23T14:50:34.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa097400640 1 -- 172.21.15.7:0/3061857655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fa090004e90 con 0x7fa0a00769c0 2024-04-23T14:50:34.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 -- start start 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c743680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c748750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c74b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55999c6a8b10 con 0x55999c748dc0 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55999c64f2b0 con 0x55999c743260 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa0a863b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55999c6a4ad0 con 0x55999c743c50 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa09e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c74b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa09e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c74b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56226/0 (socket says 172.21.15.7:56226) 2024-04-23T14:50:34.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.748+0000 7fa09e000640 1 -- 172.21.15.7:0/3542407527 learned_addr learned my addr 172.21.15.7:0/3542407527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09ea00640 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c748750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09f400640 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c743680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09e000640 1 -- 172.21.15.7:0/3542407527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 msgr2=0x55999c748750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09e000640 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c748750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09e000640 1 -- 172.21.15.7:0/3542407527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 msgr2=0x55999c743680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09e000640 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c743680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09e000640 1 -- 172.21.15.7:0/3542407527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999c3bb2d0 con 0x55999c748dc0 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.749+0000 7fa09e000640 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c74b250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa08c02a920 tx=0x7fa08c032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d88df7f33ef49b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa08be00640 1 -- 172.21.15.7:0/3542407527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c03f070 con 0x55999c748dc0 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa097400640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0840a3c30 0x7fa0840a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa08be00640 1 -- 172.21.15.7:0/3542407527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa08c031780 con 0x55999c748dc0 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa08be00640 1 -- 172.21.15.7:0/3542407527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c035070 con 0x55999c748dc0 2024-04-23T14:50:34.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa097400640 1 -- 172.21.15.7:0/3061857655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa0900d0170 con 0x7fa0a00769c0 2024-04-23T14:50:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa09f400640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0840a3c30 0x7fa0840a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa0a863b740 1 -- 172.21.15.7:0/3542407527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 msgr2=0x55999c74b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.750+0000 7fa0a863b740 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c74b250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa08c02a920 tx=0x7fa08c032cc0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 -- 172.21.15.7:0/3542407527 shutdown_connections 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c74b250 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c748750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 --2- 172.21.15.7:0/3542407527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c743680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 -- 172.21.15.7:0/3542407527 >> 172.21.15.7:0/3542407527 conn(0x55999c73e8d0 msgr2=0x55999c73ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 -- 172.21.15.7:0/3542407527 shutdown_connections 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa09f400640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0840a3c30 0x7fa0840a60f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55999c7444b0 tx=0x7fa098007520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 -- 172.21.15.7:0/3542407527 wait complete. 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 -- start start 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.751+0000 7fa0a863b740 1 Processor -- start 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c74d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c74db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c748dc0 0x55999c754ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55999c74bd10 con 0x55999c743260 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55999c662590 con 0x55999c748dc0 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55999c74be90 con 0x55999c743c50 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa0a863b740 10 client.0 _ll_register_callbacks cb 0x55999c6453a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa09ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c74d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa09ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c74d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56240/0 (socket says 172.21.15.7:56240) 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa09ea00640 1 -- 172.21.15.7:0/2053758210 learned_addr learned my addr 172.21.15.7:0/2053758210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.752+0000 7fa09e000640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c74db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09f400640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c748dc0 0x55999c754ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09ea00640 1 -- 172.21.15.7:0/2053758210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 msgr2=0x55999c74db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c74db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09ea00640 1 -- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c748dc0 msgr2=0x55999c754ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c748dc0 0x55999c754ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09ea00640 1 -- 172.21.15.7:0/2053758210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999c4856b0 con 0x55999c743260 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09f400640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c748dc0 0x55999c754ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c74d620 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa0900cd8f0 tx=0x7fa09000df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366e27889a130216 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa088c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa088c00640 1 -- 172.21.15.7:0/2053758210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090020040 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa088c00640 1 -- 172.21.15.7:0/2053758210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa09009b520 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa08c031780 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa088c00640 1 -- 172.21.15.7:0/2053758210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa09009ba30 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.753+0000 7fa0a863b740 10 client.15294 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55999c757f80 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa088c00640 1 -- 172.21.15.7:0/2053758210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa08c031780 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa088c00640 1 -- 172.21.15.7:0/2053758210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa0900a0100 con 0x55999c743260 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 10 client.15294 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 10 client.15294 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 20 client.15294 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c75a5f0 0x55999c75ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 4 client.15294 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.754+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55999c6b6530 con 0x55999c75a5f0 2024-04-23T14:50:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.755+0000 7fa09e000640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c75a5f0 0x55999c75ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.756+0000 7fa09e000640 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c75a5f0 0x55999c75ba60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f719f89bb7bd80b2 server_cookie=556e639faee50a7b in_seq=0 out_seq=0 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.756+0000 7fa088c00640 10 client.15294 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa088c00640 1 -- 172.21.15.7:0/2053758210 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55999c6b6530 con 0x55999c75a5f0 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa088c00640 10 client.15294 handle_command_reply: tid=0 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 client.15294 shutdown 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 msgr2=0x55999c74d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c74d620 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa0900cd8f0 tx=0x7fa09000df80 comp rx=0 tx=0).stop 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 shutdown_connections 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c75a5f0 0x55999c75ba60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c748dc0 0x55999c754ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c74db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2053758210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c74d620 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa088c00640 0 client.15294 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.758+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 >> 172.21.15.7:0/2053758210 conn(0x55999c73e8d0 msgr2=0x55999c73d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.759+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 shutdown_connections 2024-04-23T14:50:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.759+0000 7fa0a863b740 1 -- 172.21.15.7:0/2053758210 wait complete. 2024-04-23T14:50:34.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.759+0000 7fa0a863b740 20 client.15294 trim_cache size 0 max 16384 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.778+0000 7fa0a863b740 1 Processor -- start 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 -- start start 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c7486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743c50 0x55999c754b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c748dc0 0x55999c74d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55999c759da0 con 0x55999c743260 2024-04-23T14:50:34.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55999c75a470 con 0x55999c743c50 2024-04-23T14:50:34.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa0a863b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55999c75ab40 con 0x55999c748dc0 2024-04-23T14:50:34.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.779+0000 7fa09ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c7486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743c50 0x55999c754b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c748dc0 0x55999c74d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743c50 0x55999c754b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:47296/0 (socket says 172.21.15.7:47296) 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c7486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56246/0 (socket says 172.21.15.7:56246) 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09e000640 1 -- 172.21.15.7:0/2134216670 learned_addr learned my addr 172.21.15.7:0/2134216670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 -- 172.21.15.7:0/2134216670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c748dc0 msgr2=0x55999c74d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c748dc0 0x55999c74d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 -- 172.21.15.7:0/2134216670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743c50 msgr2=0x55999c754b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743c50 0x55999c754b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 -- 172.21.15.7:0/2134216670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999c744030 con 0x55999c743260 2024-04-23T14:50:34.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.780+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c7486a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0900057a0 tx=0x7fa0900d0500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ddfd41b4c55ac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa08b400640 1 -- 172.21.15.7:0/2134216670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090020070 con 0x55999c743260 2024-04-23T14:50:34.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa08b400640 1 -- 172.21.15.7:0/2134216670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa090009c30 con 0x55999c743260 2024-04-23T14:50:34.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa08b400640 1 -- 172.21.15.7:0/2134216670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090005180 con 0x55999c743260 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 -- 172.21.15.7:0/2134216670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 msgr2=0x55999c7486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c7486a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0900057a0 tx=0x7fa0900d0500 comp rx=0 tx=0).stop 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 -- 172.21.15.7:0/2134216670 shutdown_connections 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743c50 0x55999c754b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c748dc0 0x55999c74d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2134216670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c743260 0x55999c7486a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.781+0000 7fa0a863b740 1 -- 172.21.15.7:0/2134216670 >> 172.21.15.7:0/2134216670 conn(0x55999c73e8d0 msgr2=0x55999c745050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.782+0000 7fa0a863b740 1 -- 172.21.15.7:0/2134216670 shutdown_connections 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.782+0000 7fa0a863b740 1 -- 172.21.15.7:0/2134216670 wait complete. 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.782+0000 7fa0a863b740 1 -- start start 2024-04-23T14:50:34.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.782+0000 7fa0a863b740 1 Processor -- start 2024-04-23T14:50:34.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.782+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c750780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.782+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c750cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa0a863b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c753c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa0a863b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55999c75b8e0 con 0x55999c748dc0 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa0a863b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55999c75b210 con 0x55999c743260 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa0a863b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55999c75bfb0 con 0x55999c743c50 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa0a863b740 10 client.0 _ll_register_callbacks cb 0x7fa0900046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c753c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c753c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56256/0 (socket says 172.21.15.7:56256) 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 -- 172.21.15.7:0/2749044614 learned_addr learned my addr 172.21.15.7:0/2749044614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09e000640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c750cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c750780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 -- 172.21.15.7:0/2749044614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 msgr2=0x55999c750cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c750cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 -- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 msgr2=0x55999c750780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c750780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09f400640 1 -- 172.21.15.7:0/2749044614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999c754260 con 0x55999c748dc0 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.783+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c750780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa09f400640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c753c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa0980045c0 tx=0x7fa098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee1eeb02a76d60b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa088c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa088c00640 1 -- 172.21.15.7:0/2749044614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09801e920 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa088c00640 1 -- 172.21.15.7:0/2749044614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa09801eac0 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55999c6b03a0 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa088c00640 1 -- 172.21.15.7:0/2749044614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa09801ecc0 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa0a863b740 10 client.15300 fetch_fsmap learned FSMap version 27 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.784+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55999c7c0a80 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa088c00640 1 -- 172.21.15.7:0/2749044614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55999c6b03a0 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa088c00640 1 -- 172.21.15.7:0/2749044614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa09801d410 con 0x55999c748dc0 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa0a863b740 10 client.15300 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa0a863b740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa0a863b740 20 client.15300 populate_metadata read hostname 'smithi007' 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c7c5790 0x55999c7c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa0a863b740 4 client.15300 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:50:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.785+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "status"}) -- 0x55999c62c860 con 0x55999c7c5790 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.786+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c7c5790 0x55999c7c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.786+0000 7fa09ea00640 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c7c5790 0x55999c7c1bd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=559483423c1a571b server_cookie=8edeae373f86defd in_seq=0 out_seq=0 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.786+0000 7fa088c00640 10 client.15300 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa088c00640 1 -- 172.21.15.7:0/2749044614 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55999c62c860 con 0x55999c7c5790 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa088c00640 10 client.15300 handle_command_reply: tid=0 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 client.15300 shutdown 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 msgr2=0x55999c753c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c753c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa0980045c0 tx=0x7fa098004a40 comp rx=0 tx=0).stop 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 shutdown_connections 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55999c7c5790 0x55999c7c1bd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55999c748dc0 0x55999c753c70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55999c743c50 0x55999c750cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa088c00640 0 client.15300 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 --2- 172.21.15.7:0/2749044614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55999c743260 0x55999c750780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 >> 172.21.15.7:0/2749044614 conn(0x55999c73e8d0 msgr2=0x55999c745050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 shutdown_connections 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.787+0000 7fa0a863b740 1 -- 172.21.15.7:0/2749044614 wait complete. 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa0a863b740 20 client.15300 trim_cache size 0 max 16384 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34526, 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:50:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 130.50223715300001, 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 137.44257691300001 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0840a3c30 msgr2=0x7fa0840a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0840a3c30 0x7fa0840a60f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55999c7444b0 tx=0x7fa098007520 comp rx=0 tx=0).stop 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 msgr2=0x7fa0a019e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 0x7fa0a019e6e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa09000d770 tx=0x7fa09000dc30 comp rx=0 tx=0).stop 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 shutdown_connections 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa0840a3c30 0x7fa0840a60f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a0077c00 0x7fa0a019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a00785a0 0x7fa0a01a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 --2- 172.21.15.7:0/3061857655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a00769c0 0x7fa0a019e6e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.788+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 >> 172.21.15.7:0/3061857655 conn(0x7fa0a00ff6b0 msgr2=0x7fa0a0100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.789+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 shutdown_connections 2024-04-23T14:50:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:34.789+0000 7fa09fe00640 1 -- 172.21.15.7:0/3061857655 wait complete. 2024-04-23T14:50:34.808 INFO:tasks.cephadm:Setup complete, yielding 2024-04-23T14:50:34.808 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:50:34.817 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:50:34.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-23T14:50:35.278 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:35 smithi007 ceph-mon[27906]: pgmap v439: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:36.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:35 smithi186 ceph-mon[31814]: pgmap v439: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:36.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:35 smithi137 ceph-mon[31694]: pgmap v439: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:37.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 -- 172.21.15.7:0/2689192805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c1091a0 msgr2=0x7f137c1095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 --2- 172.21.15.7:0/2689192805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c1091a0 0x7f137c1095c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f136c0099c0 tx=0x7f136c009cd0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 -- 172.21.15.7:0/2689192805 shutdown_connections 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 --2- 172.21.15.7:0/2689192805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10ad40 0x7f137c1115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 --2- 172.21.15.7:0/2689192805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c1091a0 0x7f137c1095c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 --2- 172.21.15.7:0/2689192805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f137c10a3a0 0x7f137c10a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 -- 172.21.15.7:0/2689192805 >> 172.21.15.7:0/2689192805 conn(0x7f137c078170 msgr2=0x7f137c07a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 -- 172.21.15.7:0/2689192805 shutdown_connections 2024-04-23T14:50:37.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.660+0000 7f1383000700 1 -- 172.21.15.7:0/2689192805 wait complete. 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.662+0000 7f1383000700 1 Processor -- start 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.662+0000 7f1383000700 1 -- start start 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.662+0000 7f1383000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f137c1091a0 0x7f137c19f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1383000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10a3a0 0x7f137c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1383000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 0x7f137c1a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1383000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f137c114c10 con 0x7f137c10ad40 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1383000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f137c114a90 con 0x7f137c10a3a0 2024-04-23T14:50:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1383000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f137c114d90 con 0x7f137c1091a0 2024-04-23T14:50:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1381000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 0x7f137c1a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1381000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 0x7f137c1a6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56276/0 (socket says 172.21.15.7:56276) 2024-04-23T14:50:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1381000700 1 -- 172.21.15.7:0/3912173148 learned_addr learned my addr 172.21.15.7:0/3912173148 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:37.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f137be00700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f137c1091a0 0x7f137c19f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.663+0000 7f1373400700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10a3a0 0x7f137c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1381000700 1 -- 172.21.15.7:0/3912173148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f137c1091a0 msgr2=0x7f137c19f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1381000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f137c1091a0 0x7f137c19f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1381000700 1 -- 172.21.15.7:0/3912173148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10a3a0 msgr2=0x7f137c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1381000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10a3a0 0x7f137c19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1381000700 1 -- 172.21.15.7:0/3912173148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c1a6e20 con 0x7f137c10ad40 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1373400700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10a3a0 0x7f137c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:50:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1381000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 0x7f137c1a6780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f137400c930 tx=0x7f137400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374007ac0 con 0x7f137c10ad40 2024-04-23T14:50:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1374007c60 con 0x7f137c10ad40 2024-04-23T14:50:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.664+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c1a7110 con 0x7f137c10ad40 2024-04-23T14:50:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.665+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c1a7650 con 0x7f137c10ad40 2024-04-23T14:50:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.665+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374018660 con 0x7f137c10ad40 2024-04-23T14:50:37.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.667+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c0697e0 con 0x7f137c10ad40 2024-04-23T14:50:37.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.668+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f137400f450 con 0x7f137c10ad40 2024-04-23T14:50:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.670+0000 7f1379600700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f13600a3c40 0x7f13600a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.671+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f13740d0710 con 0x7f137c10ad40 2024-04-23T14:50:37.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.671+0000 7f137be00700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f13600a3c40 0x7f13600a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.672+0000 7f137be00700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f13600a3c40 0x7f13600a6100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f136c0098e0 tx=0x7f136c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:37.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.677+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1374014030 con 0x7f137c10ad40 2024-04-23T14:50:37.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.932+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f137c062f30 con 0x7f13600a3c40 2024-04-23T14:50:37.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.936+0000 7f1379600700 1 -- 172.21.15.7:0/3912173148 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f137c062f30 con 0x7f13600a3c40 2024-04-23T14:50:37.936 INFO:teuthology.orchestra.run.smithi007.stdout:Backend: cephadm 2024-04-23T14:50:37.937 INFO:teuthology.orchestra.run.smithi007.stdout:Available: Yes 2024-04-23T14:50:37.937 INFO:teuthology.orchestra.run.smithi007.stdout:Paused: No 2024-04-23T14:50:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f13600a3c40 msgr2=0x7f13600a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f13600a3c40 0x7f13600a6100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f136c0098e0 tx=0x7f136c000bc0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 msgr2=0x7f137c1a6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 0x7f137c1a6780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f137400c930 tx=0x7f137400cc40 comp rx=0 tx=0).stop 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 shutdown_connections 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f13600a3c40 0x7f13600a6100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c10ad40 0x7f137c1a6780 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f137c1091a0 0x7f137c19f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 --2- 172.21.15.7:0/3912173148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f137c10a3a0 0x7f137c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 >> 172.21.15.7:0/3912173148 conn(0x7f137c078170 msgr2=0x7f137c10d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 shutdown_connections 2024-04-23T14:50:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:37.941+0000 7f1383000700 1 -- 172.21.15.7:0/3912173148 wait complete. 2024-04-23T14:50:38.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:37 smithi007 ceph-mon[27906]: pgmap v440: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:38.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:37 smithi186 ceph-mon[31814]: pgmap v440: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:38.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:37 smithi137 ceph-mon[31694]: pgmap v440: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:38.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-23T14:50:39.193 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:38 smithi007 ceph-mon[27906]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:38 smithi186 ceph-mon[31814]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:38 smithi137 ceph-mon[31694]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:40.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:39 smithi007 ceph-mon[27906]: pgmap v441: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:40.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:39 smithi186 ceph-mon[31814]: pgmap v441: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:40.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:39 smithi137 ceph-mon[31694]: pgmap v441: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 -- 172.21.15.7:0/3652546929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678104610 msgr2=0x7ff67810aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 --2- 172.21.15.7:0/3652546929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678104610 0x7ff67810aec0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff67000b0d0 tx=0x7ff67000b3e0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 -- 172.21.15.7:0/3652546929 shutdown_connections 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 --2- 172.21.15.7:0/3652546929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678104610 0x7ff67810aec0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 --2- 172.21.15.7:0/3652546929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff678102a70 0x7ff678102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 --2- 172.21.15.7:0/3652546929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678103c70 0x7ff6781040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 -- 172.21.15.7:0/3652546929 >> 172.21.15.7:0/3652546929 conn(0x7ff6780fe030 msgr2=0x7ff678100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 -- 172.21.15.7:0/3652546929 shutdown_connections 2024-04-23T14:50:41.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.585+0000 7ff677e00700 1 -- 172.21.15.7:0/3652546929 wait complete. 2024-04-23T14:50:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.586+0000 7ff677e00700 1 Processor -- start 2024-04-23T14:50:41.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 -- start start 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff678102a70 0x7ff678076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 0x7ff678074ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678104610 0x7ff678075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810e510 con 0x7ff678103c70 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810e390 con 0x7ff678104610 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.587+0000 7ff677e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810e690 con 0x7ff678102a70 2024-04-23T14:50:41.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 0x7ff678074ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:41.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 0x7ff678074ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56298/0 (socket says 172.21.15.7:56298) 2024-04-23T14:50:41.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 -- 172.21.15.7:0/3453826973 learned_addr learned my addr 172.21.15.7:0/3453826973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:41.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff676a00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff678102a70 0x7ff678076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff677400700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678104610 0x7ff678075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 -- 172.21.15.7:0/3453826973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff678102a70 msgr2=0x7ff678076890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff678102a70 0x7ff678076890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 -- 172.21.15.7:0/3453826973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678104610 msgr2=0x7ff678075420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678104610 0x7ff678075420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff66e000700 1 -- 172.21.15.7:0/3453826973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff678075cd0 con 0x7ff678103c70 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.588+0000 7ff677400700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678104610 0x7ff678075420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.589+0000 7ff66e000700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 0x7ff678074ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff66000d950 tx=0x7ff66000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.589+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660016070 con 0x7ff678103c70 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.589+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff660009df0 con 0x7ff678103c70 2024-04-23T14:50:41.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.589+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6781a2c90 con 0x7ff678103c70 2024-04-23T14:50:41.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.589+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66000f3c0 con 0x7ff678103c70 2024-04-23T14:50:41.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.589+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6781a31a0 con 0x7ff678103c70 2024-04-23T14:50:41.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.590+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6780697e0 con 0x7ff678103c70 2024-04-23T14:50:41.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.592+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7ff660019070 con 0x7ff678103c70 2024-04-23T14:50:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.594+0000 7ff67ca00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff65c0a3c40 0x7ff65c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.594+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7ff6600d0390 con 0x7ff678103c70 2024-04-23T14:50:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.594+0000 7ff676a00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff65c0a3c40 0x7ff65c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:41.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.595+0000 7ff676a00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff65c0a3c40 0x7ff65c0a6100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff678103ad0 tx=0x7ff66800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:41.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.599+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff66009c990 con 0x7ff678103c70 2024-04-23T14:50:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.839+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff678062ff0 con 0x7ff65c0a3c40 2024-04-23T14:50:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.883+0000 7ff67ca00700 1 -- 172.21.15.7:0/3453826973 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7ff678062ff0 con 0x7ff65c0a3c40 2024-04-23T14:50:41.885 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:50:41.885 INFO:teuthology.orchestra.run.smithi007.stdout:mds.a smithi007 running (2m) 35s ago 2m 15.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 82e6793760b9 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.b smithi137 running (2m) 71s ago 2m 24.7M - 19.0.0-3126-gd44fddd9 76e77f280c74 4892ba5e8170 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.c smithi186 running (2m) 72s ago 2m 15.7M - 19.0.0-3126-gd44fddd9 76e77f280c74 795c1a66aa21 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.d smithi007 running (2m) 35s ago 2m 12.5M - 19.0.0-3126-gd44fddd9 76e77f280c74 35522f579924 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.e smithi137 running (2m) 71s ago 2m 16.0M - 19.0.0-3126-gd44fddd9 76e77f280c74 95d0e9682963 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.f smithi186 running (2m) 72s ago 2m 14.6M - 19.0.0-3126-gd44fddd9 76e77f280c74 ce9c0f36bf10 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.g smithi007 running (2m) 35s ago 2m 15.2M - 19.0.0-3126-gd44fddd9 76e77f280c74 5620098a976b 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.h smithi137 running (2m) 71s ago 2m 16.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 58c48ee8b73c 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.i smithi186 running (2m) 72s ago 2m 15.4M - 19.0.0-3126-gd44fddd9 76e77f280c74 a2c22858d054 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.j smithi007 running (3m) 35s ago 3m 12.6M - 19.0.0-3126-gd44fddd9 76e77f280c74 fe05c0a97db9 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.k smithi137 running (3m) 71s ago 3m 16.0M - 19.0.0-3126-gd44fddd9 76e77f280c74 40d91a7db09c 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mds.l smithi186 running (3m) 72s ago 3m 14.6M - 19.0.0-3126-gd44fddd9 76e77f280c74 e41884369ddb 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi007 *:9283,8765 running (12m) 35s ago 12m 516M - 19.0.0-3126-gd44fddd9 76e77f280c74 62426bc78fd5 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi137 *:8443,8765 running (10m) 71s ago 10m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 c5bf3339a27d 2024-04-23T14:50:41.886 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.z smithi186 *:8443,8765 running (10m) 72s ago 10m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 b9040c215697 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (13m) 35s ago 13m 51.4M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 b6f0e14cdb06 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi137 running (10m) 71s ago 10m 40.1M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 cd17eb6ef5c7 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi186 running (10m) 72s ago 10m 40.5M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 7ee498c8dc60 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (9m) 35s ago 9m 51.1M 4273M 19.0.0-3126-gd44fddd9 76e77f280c74 517b07ff85c7 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi137 running (9m) 71s ago 9m 46.0M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 be911f1e8da6 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi186 running (8m) 72s ago 8m 47.1M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 d585770ee9fb 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (8m) 35s ago 8m 50.0M 4273M 19.0.0-3126-gd44fddd9 76e77f280c74 a9d62402d4e1 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi137 running (7m) 71s ago 7m 42.1M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 c30d4b916047 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi186 running (7m) 72s ago 7m 44.0M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 966745bce94e 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi007 running (6m) 35s ago 6m 41.4M 4273M 19.0.0-3126-gd44fddd9 76e77f280c74 11a1b7beb4c4 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi137 running (5m) 71s ago 5m 43.9M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 83a7b2bf4c1c 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 smithi186 running (5m) 72s ago 5m 53.7M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 7a2c990f33c3 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 smithi007 running (4m) 35s ago 4m 49.2M 4273M 19.0.0-3126-gd44fddd9 76e77f280c74 497956a28d7e 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 smithi137 running (4m) 71s ago 4m 51.6M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 147a6f161520 2024-04-23T14:50:41.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 smithi186 running (3m) 72s ago 3m 39.9M 4272M 19.0.0-3126-gd44fddd9 76e77f280c74 9e8e121bff32 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff65c0a3c40 msgr2=0x7ff65c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff65c0a3c40 0x7ff65c0a6100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff678103ad0 tx=0x7ff66800b410 comp rx=0 tx=0).stop 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 msgr2=0x7ff678074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 0x7ff678074ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff66000d950 tx=0x7ff66000dc60 comp rx=0 tx=0).stop 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 shutdown_connections 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff65c0a3c40 0x7ff65c0a6100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff678104610 0x7ff678075420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff678102a70 0x7ff678076890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 --2- 172.21.15.7:0/3453826973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff678103c70 0x7ff678074ee0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 >> 172.21.15.7:0/3453826973 conn(0x7ff6780fe030 msgr2=0x7ff678106f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.887+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 shutdown_connections 2024-04-23T14:50:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:41.888+0000 7ff677e00700 1 -- 172.21.15.7:0/3453826973 wait complete. 2024-04-23T14:50:42.247 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:42 smithi007 ceph-mon[27906]: pgmap v442: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:42.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:42 smithi186 ceph-mon[31814]: pgmap v442: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:42.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:42 smithi137 ceph-mon[31694]: pgmap v442: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:42.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-23T14:50:43.270 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:43.320 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:43 smithi137 ceph-mon[31694]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:43 smithi007 ceph-mon[27906]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:43 smithi186 ceph-mon[31814]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:44 smithi007 ceph-mon[27906]: pgmap v443: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:44.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:44 smithi186 ceph-mon[31814]: pgmap v443: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:44 smithi137 ceph-mon[31694]: pgmap v443: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.463+0000 7ff8f2c00700 1 -- 172.21.15.7:0/3428429739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec108840 msgr2=0x7ff8ec10acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.463+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/3428429739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec108840 0x7ff8ec10acb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400b0a0 tx=0x7ff8e400b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 -- 172.21.15.7:0/3428429739 shutdown_connections 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/3428429739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec108840 0x7ff8ec10acb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/3428429739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/3428429739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ec105f10 0x7ff8ec108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 -- 172.21.15.7:0/3428429739 >> 172.21.15.7:0/3428429739 conn(0x7ff8ec0fcff0 msgr2=0x7ff8ec0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 -- 172.21.15.7:0/3428429739 shutdown_connections 2024-04-23T14:50:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.464+0000 7ff8f2c00700 1 -- 172.21.15.7:0/3428429739 wait complete. 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.465+0000 7ff8f2c00700 1 Processor -- start 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.465+0000 7ff8f2c00700 1 -- start start 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.465+0000 7ff8f2c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.465+0000 7ff8f2c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8ec105f10 0x7ff8ec1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.465+0000 7ff8f2c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ec108840 0x7ff8ec1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8f2c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec10e5b0 con 0x7ff8ec1035e0 2024-04-23T14:50:45.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8f2c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec10e430 con 0x7ff8ec105f10 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8f2c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec10e730 con 0x7ff8ec108840 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34484/0 (socket says 172.21.15.7:34484) 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 -- 172.21.15.7:0/2108086266 learned_addr learned my addr 172.21.15.7:0/2108086266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8eb400700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8ec105f10 0x7ff8ec1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8f0c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ec108840 0x7ff8ec1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 -- 172.21.15.7:0/2108086266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ec108840 msgr2=0x7ff8ec1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ec108840 0x7ff8ec1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 -- 172.21.15.7:0/2108086266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8ec105f10 msgr2=0x7ff8ec1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8ec105f10 0x7ff8ec1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.466+0000 7ff8ebe00700 1 -- 172.21.15.7:0/2108086266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ec1a0860 con 0x7ff8ec1035e0 2024-04-23T14:50:45.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.467+0000 7ff8ebe00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec198cb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00c9b0 tx=0x7ff8dc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.467+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc007b00 con 0x7ff8ec1035e0 2024-04-23T14:50:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.467+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8dc007ca0 con 0x7ff8ec1035e0 2024-04-23T14:50:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.467+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ec1a0b50 con 0x7ff8ec1035e0 2024-04-23T14:50:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.467+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc018730 con 0x7ff8ec1035e0 2024-04-23T14:50:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.467+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ec1a10e0 con 0x7ff8ec1035e0 2024-04-23T14:50:45.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.469+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ec0697e0 con 0x7ff8ec1035e0 2024-04-23T14:50:45.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.471+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7ff8dc00f450 con 0x7ff8ec1035e0 2024-04-23T14:50:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.472+0000 7ff8e8c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff8d00a3cc0 0x7ff8d00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.473+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7ff8dc0d07c0 con 0x7ff8ec1035e0 2024-04-23T14:50:45.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.473+0000 7ff8eb400700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff8d00a3cc0 0x7ff8d00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:45.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.474+0000 7ff8eb400700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff8d00a3cc0 0x7ff8d00a6180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005950 tx=0x7ff8d80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.478+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff8dc014030 con 0x7ff8ec1035e0 2024-04-23T14:50:45.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.720+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff8ec062f30 con 0x7ff8d00a3cc0 2024-04-23T14:50:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.731+0000 7ff8e8c00700 1 -- 172.21.15.7:0/2108086266 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff8ec062f30 con 0x7ff8d00a3cc0 2024-04-23T14:50:45.732 INFO:teuthology.orchestra.run.smithi007.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-23T14:50:45.732 INFO:teuthology.orchestra.run.smithi007.stdout:mds.all 12/12 76s ago 3m smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-04-23T14:50:45.732 INFO:teuthology.orchestra.run.smithi007.stdout:mgr 3/3 76s ago 10m smithi007=x;smithi137=y;smithi186=z;count:3 2024-04-23T14:50:45.732 INFO:teuthology.orchestra.run.smithi007.stdout:mon 3/3 76s ago 11m smithi007:172.21.15.7=a;smithi137:172.21.15.137=b;smithi186:172.21.15.186=c;count:3 2024-04-23T14:50:45.732 INFO:teuthology.orchestra.run.smithi007.stdout:osd 12 76s ago - 2024-04-23T14:50:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.734+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff8d00a3cc0 msgr2=0x7ff8d00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.734+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff8d00a3cc0 0x7ff8d00a6180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005950 tx=0x7ff8d80058e0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.734+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 msgr2=0x7ff8ec198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:45.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.734+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec198cb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00c9b0 tx=0x7ff8dc00cd70 comp rx=0 tx=0).stop 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 shutdown_connections 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff8d00a3cc0 0x7ff8d00a6180 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ec108840 0x7ff8ec1a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8ec1035e0 0x7ff8ec198cb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 --2- 172.21.15.7:0/2108086266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8ec105f10 0x7ff8ec1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 >> 172.21.15.7:0/2108086266 conn(0x7ff8ec0fcff0 msgr2=0x7ff8ec103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 shutdown_connections 2024-04-23T14:50:45.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:45.735+0000 7ff8f2c00700 1 -- 172.21.15.7:0/2108086266 wait complete. 2024-04-23T14:50:46.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:46 smithi007 ceph-mon[27906]: pgmap v444: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:46 smithi186 ceph-mon[31814]: pgmap v444: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:46 smithi137 ceph-mon[31694]: pgmap v444: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:46.642 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-23T14:50:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:47 smithi007 ceph-mon[27906]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:47 smithi186 ceph-mon[31814]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:47 smithi137 ceph-mon[31694]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:48.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:48 smithi007 ceph-mon[27906]: pgmap v445: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:48.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:48 smithi186 ceph-mon[31814]: pgmap v445: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:48.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:48 smithi137 ceph-mon[31694]: pgmap v445: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 -- 172.21.15.7:0/1707367685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd001035f0 msgr2=0x7fdd00109ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 --2- 172.21.15.7:0/1707367685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd001035f0 0x7fdd00109ea0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80099c0 tx=0x7fdcf8009cd0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 -- 172.21.15.7:0/1707367685 shutdown_connections 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 --2- 172.21.15.7:0/1707367685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd001035f0 0x7fdd00109ea0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 --2- 172.21.15.7:0/1707367685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd00101a50 0x7fdd00101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 --2- 172.21.15.7:0/1707367685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd00102c50 0x7fdd001030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 -- 172.21.15.7:0/1707367685 >> 172.21.15.7:0/1707367685 conn(0x7fdd000fcff0 msgr2=0x7fdd000ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 -- 172.21.15.7:0/1707367685 shutdown_connections 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.384+0000 7fdd06200700 1 -- 172.21.15.7:0/1707367685 wait complete. 2024-04-23T14:50:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.385+0000 7fdd06200700 1 Processor -- start 2024-04-23T14:50:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.385+0000 7fdd06200700 1 -- start start 2024-04-23T14:50:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdd06200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 0x7fdd0019aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdd06200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd00102c50 0x7fdd0019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdd06200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd001035f0 0x7fdd001a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdd06200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010d540 con 0x7fdd00101a50 2024-04-23T14:50:49.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdd06200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010d3c0 con 0x7fdd001035f0 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdd06200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0010d6c0 con 0x7fdd00102c50 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdcff400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 0x7fdd0019aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdcff400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 0x7fdd0019aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34498/0 (socket says 172.21.15.7:34498) 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdcff400700 1 -- 172.21.15.7:0/373146296 learned_addr learned my addr 172.21.15.7:0/373146296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.386+0000 7fdcffe00700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd001035f0 0x7fdd001a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcf6a00700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd00102c50 0x7fdd0019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcff400700 1 -- 172.21.15.7:0/373146296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd00102c50 msgr2=0x7fdd0019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcff400700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd00102c50 0x7fdd0019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcff400700 1 -- 172.21.15.7:0/373146296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd001035f0 msgr2=0x7fdd001a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcff400700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd001035f0 0x7fdd001a2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcff400700 1 -- 172.21.15.7:0/373146296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd001a2b00 con 0x7fdd00101a50 2024-04-23T14:50:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.387+0000 7fdcff400700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 0x7fdd0019aea0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000d9b0 tx=0x7fdcf000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.388+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0017070 con 0x7fdd00101a50 2024-04-23T14:50:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.388+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdcf0010460 con 0x7fdd00101a50 2024-04-23T14:50:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.388+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000f620 con 0x7fdd00101a50 2024-04-23T14:50:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.388+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd001a2df0 con 0x7fdd00101a50 2024-04-23T14:50:49.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.388+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd001a31f0 con 0x7fdd00101a50 2024-04-23T14:50:49.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.389+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd001a3420 con 0x7fdd00101a50 2024-04-23T14:50:49.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.391+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fdcf0010610 con 0x7fdd00101a50 2024-04-23T14:50:49.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.393+0000 7fdcfcc00700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdce40a3cc0 0x7fdce40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.394+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fdcf00d0310 con 0x7fdd00101a50 2024-04-23T14:50:49.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.394+0000 7fdcf6a00700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdce40a3cc0 0x7fdce40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:49.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.395+0000 7fdcf6a00700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdce40a3cc0 0x7fdce40a6180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009d10 tx=0x7fdce8009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.398+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdcf009c910 con 0x7fdd00101a50 2024-04-23T14:50:49.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.638+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fdd0006aee0 con 0x7fdce40a3cc0 2024-04-23T14:50:49.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.641+0000 7fdcfcc00700 1 -- 172.21.15.7:0/373146296 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fdd0006aee0 con 0x7fdce40a3cc0 2024-04-23T14:50:49.642 INFO:teuthology.orchestra.run.smithi007.stdout:HOST ADDR LABELS STATUS 2024-04-23T14:50:49.642 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 172.21.15.7 2024-04-23T14:50:49.642 INFO:teuthology.orchestra.run.smithi007.stdout:smithi137 172.21.15.137 2024-04-23T14:50:49.642 INFO:teuthology.orchestra.run.smithi007.stdout:smithi186 172.21.15.186 2024-04-23T14:50:49.642 INFO:teuthology.orchestra.run.smithi007.stdout:3 hosts in cluster 2024-04-23T14:50:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.644+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdce40a3cc0 msgr2=0x7fdce40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.644+0000 7fdd06200700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdce40a3cc0 0x7fdce40a6180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009d10 tx=0x7fdce8009040 comp rx=0 tx=0).stop 2024-04-23T14:50:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.644+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 msgr2=0x7fdd0019aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.644+0000 7fdd06200700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 0x7fdd0019aea0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000d9b0 tx=0x7fdcf000dd70 comp rx=0 tx=0).stop 2024-04-23T14:50:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 shutdown_connections 2024-04-23T14:50:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fdce40a3cc0 0x7fdce40a6180 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd001035f0 0x7fdd001a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd00101a50 0x7fdd0019aea0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 --2- 172.21.15.7:0/373146296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd00102c50 0x7fdd0019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 >> 172.21.15.7:0/373146296 conn(0x7fdd000fcff0 msgr2=0x7fdd0006a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 shutdown_connections 2024-04-23T14:50:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:49.645+0000 7fdd06200700 1 -- 172.21.15.7:0/373146296 wait complete. 2024-04-23T14:50:50.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:50 smithi007 ceph-mon[27906]: pgmap v446: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:50.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:50 smithi186 ceph-mon[31814]: pgmap v446: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:50 smithi137 ceph-mon[31694]: pgmap v446: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:50:50.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-23T14:50:51.029 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:51.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:51 smithi007 ceph-mon[27906]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:51 smithi186 ceph-mon[31814]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:51 smithi137 ceph-mon[31694]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:52 smithi007 ceph-mon[27906]: pgmap v447: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:52.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:52 smithi186 ceph-mon[31814]: pgmap v447: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:52.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:52 smithi137 ceph-mon[31694]: pgmap v447: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 -- 172.21.15.7:0/1161675590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 msgr2=0x7f4208102fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 --2- 172.21.15.7:0/1161675590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f4208102fb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41f800b0d0 tx=0x7f41f800b3e0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 -- 172.21.15.7:0/1161675590 shutdown_connections 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 --2- 172.21.15.7:0/1161675590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 0x7f420810afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 --2- 172.21.15.7:0/1161675590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f4208102fb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 --2- 172.21.15.7:0/1161675590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4208103d90 0x7f42081041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 -- 172.21.15.7:0/1161675590 >> 172.21.15.7:0/1161675590 conn(0x7f42080fe130 msgr2=0x7f4208100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 -- 172.21.15.7:0/1161675590 shutdown_connections 2024-04-23T14:50:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.536+0000 7f420f200700 1 -- 172.21.15.7:0/1161675590 wait complete. 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.537+0000 7f420f200700 1 Processor -- start 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.537+0000 7f420f200700 1 -- start start 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420f200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f420819aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420f200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4208103d90 0x7f420819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420f200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 0x7f42081a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420f200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f420810e670 con 0x7f4208102b90 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420f200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f420810e4f0 con 0x7f4208103d90 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420f200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f420810e7f0 con 0x7f4208104730 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f4207e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f420819aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f4207e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f420819aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55236/0 (socket says 172.21.15.7:55236) 2024-04-23T14:50:53.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f4207e00700 1 -- 172.21.15.7:0/4105993248 learned_addr learned my addr 172.21.15.7:0/4105993248 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f41ff400700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4208103d90 0x7f420819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.538+0000 7f420d200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 0x7f42081a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4207e00700 1 -- 172.21.15.7:0/4105993248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 msgr2=0x7f42081a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4207e00700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 0x7f42081a2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4207e00700 1 -- 172.21.15.7:0/4105993248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4208103d90 msgr2=0x7f420819b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4207e00700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4208103d90 0x7f420819b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4207e00700 1 -- 172.21.15.7:0/4105993248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42081a2b20 con 0x7f4208102b90 2024-04-23T14:50:53.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f420d200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 0x7f42081a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4207e00700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f420819aec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009040 tx=0x7f41f8004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f801f030 con 0x7f4208102b90 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42081a2db0 con 0x7f4208102b90 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41f8007a80 con 0x7f4208102b90 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.539+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42081a31b0 con 0x7f4208102b90 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.540+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f801b430 con 0x7f4208102b90 2024-04-23T14:50:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.541+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42081a33e0 con 0x7f4208102b90 2024-04-23T14:50:53.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.543+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f41f8022030 con 0x7f4208102b90 2024-04-23T14:50:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.544+0000 7f4205600700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f41ec0a3c40 0x7f41ec0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.544+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f41f80d1960 con 0x7f4208102b90 2024-04-23T14:50:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.545+0000 7f41ff400700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f41ec0a3c40 0x7f41ec0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:53.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.545+0000 7f41ff400700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f41ec0a3c40 0x7f41ec0a6100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f41f0005fd0 tx=0x7f41f000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:53.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.547+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f41f8029020 con 0x7f4208102b90 2024-04-23T14:50:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.790+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 --> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4208076440 con 0x7f41ec0a3c40 2024-04-23T14:50:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.793+0000 7f4205600700 1 -- 172.21.15.7:0/4105993248 <== mgr.14152 v2:172.21.15.7:6800/3440122157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4208076440 con 0x7f41ec0a3c40 2024-04-23T14:50:53.793 INFO:teuthology.orchestra.run.smithi007.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-23T14:50:53.793 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-04-23T14:50:53.793 INFO:teuthology.orchestra.run.smithi007.stdout:smithi137 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233004A400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-23T14:50:53.793 INFO:teuthology.orchestra.run.smithi007.stdout:smithi186 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CB400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-23T14:50:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.795+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f41ec0a3c40 msgr2=0x7f41ec0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.795+0000 7f420f200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f41ec0a3c40 0x7f41ec0a6100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f41f0005fd0 tx=0x7f41f000a560 comp rx=0 tx=0).stop 2024-04-23T14:50:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.795+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 msgr2=0x7f420819aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.795+0000 7f420f200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f420819aec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009040 tx=0x7f41f8004e20 comp rx=0 tx=0).stop 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 shutdown_connections 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f41ec0a3c40 0x7f41ec0a6100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4208104730 0x7f42081a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4208102b90 0x7f420819aec0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 --2- 172.21.15.7:0/4105993248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4208103d90 0x7f420819b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 >> 172.21.15.7:0/4105993248 conn(0x7f42080fe130 msgr2=0x7f4208074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 shutdown_connections 2024-04-23T14:50:53.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:53.796+0000 7f420f200700 1 -- 172.21.15.7:0/4105993248 wait complete. 2024-04-23T14:50:54.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:54 smithi007 ceph-mon[27906]: pgmap v448: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:54.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:54 smithi186 ceph-mon[31814]: pgmap v448: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:54 smithi137 ceph-mon[31694]: pgmap v448: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:50:54.636 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:50:54.645 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:50:54.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-23T14:50:55.123 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:50:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:55 smithi007 ceph-mon[27906]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:55 smithi186 ceph-mon[31814]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:55 smithi137 ceph-mon[31694]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:56.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:56 smithi007 ceph-mon[27906]: pgmap v449: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:56 smithi186 ceph-mon[31814]: pgmap v449: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:56.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:56 smithi137 ceph-mon[31694]: pgmap v449: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:50:57.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.499+0000 7f350f200700 1 -- 172.21.15.7:0/1291411894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350810aa30 msgr2=0x7f350810cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:57.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.499+0000 7f350f200700 1 --2- 172.21.15.7:0/1291411894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350810aa30 0x7f350810cec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f350000b0a0 tx=0x7f350000b3b0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 -- 172.21.15.7:0/1291411894 shutdown_connections 2024-04-23T14:50:57.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 --2- 172.21.15.7:0/1291411894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350810aa30 0x7f350810cec0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 --2- 172.21.15.7:0/1291411894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3508076ac0 0x7f3508074f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 --2- 172.21.15.7:0/1291411894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35080754f0 0x7f3508075970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 -- 172.21.15.7:0/1291411894 >> 172.21.15.7:0/1291411894 conn(0x7f35080fe0f0 msgr2=0x7f3508100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 -- 172.21.15.7:0/1291411894 shutdown_connections 2024-04-23T14:50:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.500+0000 7f350f200700 1 -- 172.21.15.7:0/1291411894 wait complete. 2024-04-23T14:50:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 Processor -- start 2024-04-23T14:50:57.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 -- start start 2024-04-23T14:50:57.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35080754f0 0x7f350819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:57.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 0x7f350819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f350810aa30 0x7f35081a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3508110820 con 0x7f3508076ac0 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35081106a0 con 0x7f350810aa30 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.501+0000 7f350f200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f35081109a0 con 0x7f35080754f0 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 0x7f350819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 0x7f350819b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55250/0 (socket says 172.21.15.7:55250) 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 -- 172.21.15.7:0/2020158388 learned_addr learned my addr 172.21.15.7:0/2020158388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507e00700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35080754f0 0x7f350819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f350d200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f350810aa30 0x7f35081a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 -- 172.21.15.7:0/2020158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35080754f0 msgr2=0x7f350819ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35080754f0 0x7f350819ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 -- 172.21.15.7:0/2020158388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f350810aa30 msgr2=0x7f35081a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f350810aa30 0x7f35081a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.502+0000 7f3507400700 1 -- 172.21.15.7:0/2020158388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35081a2a80 con 0x7f3508076ac0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.503+0000 7f3507400700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 0x7f350819b360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f34f400d9b0 tx=0x7f34f400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.503+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4017070 con 0x7f3508076ac0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.503+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34f4004830 con 0x7f3508076ac0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.503+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35081a2d70 con 0x7f3508076ac0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.503+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40053a0 con 0x7f3508076ac0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.503+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35081a3250 con 0x7f3508076ac0 2024-04-23T14:50:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.505+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35080697e0 con 0x7f3508076ac0 2024-04-23T14:50:57.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.506+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f34f40049e0 con 0x7f3508076ac0 2024-04-23T14:50:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.508+0000 7f3504c00700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f34ec0a3cc0 0x7f34ec0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.508+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f34f40d06b0 con 0x7f3508076ac0 2024-04-23T14:50:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.508+0000 7f3507e00700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f34ec0a3cc0 0x7f34ec0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:57.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.509+0000 7f3507e00700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f34ec0a3cc0 0x7f34ec0a6180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005950 tx=0x7f34f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:57.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.512+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f34f4020020 con 0x7f3508076ac0 2024-04-23T14:50:57.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.800+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3508063700 con 0x7f3508076ac0 2024-04-23T14:50:57.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.802+0000 7f3504c00700 1 -- 172.21.15.7:0/2020158388 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3088 (secure 0 0 0) 0x7f34f409ccb0 con 0x7f3508076ac0 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:e27 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:legacy client fscid: 1 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:fs_name cephfs 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 27 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-04-23T14:48:23.629029+0000 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-04-23T14:48:53.850115+0000 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:tableserver 0 2024-04-23T14:50:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:root 0 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:session_timeout 300 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:session_autoclose 300 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:max_file_size 1099511627776 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:max_xattr_size 65536 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:required_client_features {} 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure 0 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure_osd_epoch 0 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:max_mds 5 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:in 0,1,2,3,4 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:up {0=34526,1=34484,2=34448,3=34424,4=24508} 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:failed 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:damaged 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:stopped 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:data_pools [3,4] 2024-04-23T14:50:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:metadata_pool 2 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:inline_data disabled 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:balancer 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:bal_rank_mask -1 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:standby_count_wanted 0 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:qdb_cluster leader: 34526 members: 34484,34526,34424,34448,24508 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b{0:34526} state up:active seq 3 addr [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c{0:24493} state up:standby-replay seq 1 addr [v2:172.21.15.186:6836/2659046243,v1:172.21.15.186:6837/2659046243] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.h{1:34484} state up:active seq 14 addr [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f{1:24478} state up:standby-replay seq 1 addr [v2:172.21.15.186:6834/77772242,v1:172.21.15.186:6835/77772242] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e{2:34448} state up:active seq 17 addr [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.l{2:24427} state up:standby-replay seq 1 addr [v2:172.21.15.186:6832/156003904,v1:172.21.15.186:6833/156003904] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.k{3:34424} state up:active seq 20 addr [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a{3:14640} state up:standby-replay seq 1 addr [v2:172.21.15.7:6840/1212403180,v1:172.21.15.7:6841/1212403180] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.i{4:24508} state up:active seq 14 addr [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.g{4:14628} state up:standby-replay seq 1 addr [v2:172.21.15.7:6838/2766173942,v1:172.21.15.7:6839/2766173942] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:57.806 INFO:teuthology.orchestra.run.smithi007.stdout:Standby daemons: 2024-04-23T14:50:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:50:57.806 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.7:6834/1858740077,v1:172.21.15.7:6835/1858740077] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.806 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.7:6836/4118329772,v1:172.21.15.7:6837/4118329772] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f34ec0a3cc0 msgr2=0x7f34ec0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f34ec0a3cc0 0x7f34ec0a6180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005950 tx=0x7f34f80058e0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 msgr2=0x7f350819b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 0x7f350819b360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f34f400d9b0 tx=0x7f34f400dd70 comp rx=0 tx=0).stop 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 shutdown_connections 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f34ec0a3cc0 0x7f34ec0a6180 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f350810aa30 0x7f35081a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35080754f0 0x7f350819ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 --2- 172.21.15.7:0/2020158388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3508076ac0 0x7f350819b360 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 >> 172.21.15.7:0/2020158388 conn(0x7f35080fe0f0 msgr2=0x7f3508106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.806+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 shutdown_connections 2024-04-23T14:50:57.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:50:57.807+0000 7f350f200700 1 -- 172.21.15.7:0/2020158388 wait complete. 2024-04-23T14:50:57.809 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:50:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:58 smithi186 ceph-mon[31814]: pgmap v450: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:50:58 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2020158388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:58 smithi137 ceph-mon[31694]: pgmap v450: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:58.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:50:58 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2020158388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:58 smithi007 ceph-mon[27906]: pgmap v450: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:50:58.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:50:58 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2020158388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:58.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-23T14:50:59.143 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:51:00.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:00 smithi007 ceph-mon[27906]: pgmap v451: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:51:00.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:00 smithi186 ceph-mon[31814]: pgmap v451: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:51:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:00 smithi137 ceph-mon[31694]: pgmap v451: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:51:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 -- 172.21.15.7:0/3229487271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890104d90 msgr2=0x7f18901051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 --2- 172.21.15.7:0/3229487271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890104d90 0x7f18901051b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18800099c0 tx=0x7f1880009cd0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 -- 172.21.15.7:0/3229487271 shutdown_connections 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 --2- 172.21.15.7:0/3229487271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1890106930 0x7f189010d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 --2- 172.21.15.7:0/3229487271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890104d90 0x7f18901051b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 --2- 172.21.15.7:0/3229487271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1890105f90 0x7f18901063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 -- 172.21.15.7:0/3229487271 >> 172.21.15.7:0/3229487271 conn(0x7f1890100350 msgr2=0x7f1890102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.414+0000 7f1895000700 1 -- 172.21.15.7:0/3229487271 shutdown_connections 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.415+0000 7f1895000700 1 -- 172.21.15.7:0/3229487271 wait complete. 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 Processor -- start 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 -- start start 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1890104d90 0x7f189019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 0x7f189019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1890106930 0x7f18901a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1890110870 con 0x7f1890105f90 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18901106f0 con 0x7f1890106930 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.416+0000 7f1895000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f18901109f0 con 0x7f1890104d90 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 0x7f189019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f188de00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1890104d90 0x7f189019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 0x7f189019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55264/0 (socket says 172.21.15.7:55264) 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 -- 172.21.15.7:0/1325115614 learned_addr learned my addr 172.21.15.7:0/1325115614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f188e800700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1890106930 0x7f18901a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 -- 172.21.15.7:0/1325115614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1890104d90 msgr2=0x7f189019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1890104d90 0x7f189019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 -- 172.21.15.7:0/1325115614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1890106930 msgr2=0x7f18901a24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1890106930 0x7f18901a24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.417+0000 7f1887e00700 1 -- 172.21.15.7:0/1325115614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18901a2b80 con 0x7f1890105f90 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.418+0000 7f1887e00700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 0x7f189019b460 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f187800d9b0 tx=0x7f187800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.418+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878017070 con 0x7f1890105f90 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.418+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1878005020 con 0x7f1890105f90 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.418+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878009b50 con 0x7f1890105f90 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.418+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18901a2e70 con 0x7f1890105f90 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.418+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18901a32d0 con 0x7f1890105f90 2024-04-23T14:51:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.420+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18900697e0 con 0x7f1890105f90 2024-04-23T14:51:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.422+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f1878009cf0 con 0x7f1890105f90 2024-04-23T14:51:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.423+0000 7f1886a00700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f18740a3c40 0x7f18740a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.423+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f18780d06d0 con 0x7f1890105f90 2024-04-23T14:51:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.423+0000 7f188de00700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f18740a3c40 0x7f18740a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.424+0000 7f188de00700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f18740a3c40 0x7f18740a6100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1880000c00 tx=0x7f1880005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.428+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1878020020 con 0x7f1890105f90 2024-04-23T14:51:01.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.659+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f189002dfe0 con 0x7f1890105f90 2024-04-23T14:51:01.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.661+0000 7f1886a00700 1 -- 172.21.15.7:0/1325115614 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) ==== 56+0+5596 (secure 0 0 0) 0x7f189002dfe0 con 0x7f1890105f90 2024-04-23T14:51:01.663 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 93 2024-04-23T14:51:01.663 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T14:51:01.663 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-04-23T14:37:32.261830+0000 2024-04-23T14:51:01.663 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-04-23T14:49:44.075188+0000 2024-04-23T14:51:01.663 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-23T14:51:01.663 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 27 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client luminous 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release squid 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 12 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6802/3865208541,v1:172.21.15.7:6803/3865208541] [v2:172.21.15.7:6804/3865208541,v1:172.21.15.7:6805/3865208541] exists,up bada9023-7750-40ab-88f9-04e037cac5af 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6800/1298672167,v1:172.21.15.137:6801/1298672167] [v2:172.21.15.137:6802/1298672167,v1:172.21.15.137:6803/1298672167] exists,up bb0cc325-66cb-4ed4-866d-ce8820287b97 2024-04-23T14:51:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/3205554231,v1:172.21.15.186:6801/3205554231] [v2:172.21.15.186:6802/3205554231,v1:172.21.15.186:6803/3205554231] exists,up d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6810/2158265578,v1:172.21.15.7:6811/2158265578] [v2:172.21.15.7:6812/2158265578,v1:172.21.15.7:6813/2158265578] exists,up 546655c4-16cd-4be5-a422-aa644ef9c0e3 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6808/3040772889,v1:172.21.15.137:6809/3040772889] [v2:172.21.15.137:6810/3040772889,v1:172.21.15.137:6811/3040772889] exists,up 06dad351-e05a-4c7b-83bc-e1e8757bc711 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 38 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6808/2388437494,v1:172.21.15.186:6809/2388437494] [v2:172.21.15.186:6810/2388437494,v1:172.21.15.186:6811/2388437494] exists,up 097180ed-48e5-4b8a-a06b-3190abf3df8f 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6818/2119533144,v1:172.21.15.7:6819/2119533144] [v2:172.21.15.7:6820/2119533144,v1:172.21.15.7:6821/2119533144] exists,up 3b57c273-5d0c-40e5-ba14-8704b6844d03 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 51 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6816/342014063,v1:172.21.15.137:6817/342014063] [v2:172.21.15.137:6818/342014063,v1:172.21.15.137:6819/342014063] exists,up c59e05c5-705e-49d3-92c8-d32881241f96 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 up in weight 1 up_from 59 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6816/4105017585,v1:172.21.15.186:6817/4105017585] [v2:172.21.15.186:6818/4105017585,v1:172.21.15.186:6819/4105017585] exists,up 0dc3fbc8-a0e3-4031-a338-30881b7db934 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 up in weight 1 up_from 67 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6826/938090792,v1:172.21.15.7:6827/938090792] [v2:172.21.15.7:6828/938090792,v1:172.21.15.7:6829/938090792] exists,up 6bc566f6-4686-46dc-b8a2-fffbeadd9025 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 up in weight 1 up_from 72 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6824/2931599651,v1:172.21.15.137:6825/2931599651] [v2:172.21.15.137:6826/2931599651,v1:172.21.15.137:6827/2931599651] exists,up f4c5d502-eef1-42eb-88fe-2b9c343deb6e 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 up in weight 1 up_from 80 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6824/25472290,v1:172.21.15.186:6825/25472290] [v2:172.21.15.186:6826/25472290,v1:172.21.15.186:6827/25472290] exists,up 793ab73a-d36f-4b60-9cb3-9a2a14b92148 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.4 [2,11] 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.5 [8,11] 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.6 [4,6] 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.c [3,9] 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.11 [4,8] 2024-04-23T14:51:01.665 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.1b [5,9] 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.24 [4,9] 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 4.2 [9,1] 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 4.e [5,8] 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 4.13 [9,10] 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 4.18 [9,8] 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/890429947 expires 2024-04-24T14:38:42.138800+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2805710934 expires 2024-04-24T14:38:42.138800+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/147420039 expires 2024-04-24T14:38:06.870414+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/4250737482 expires 2024-04-24T14:38:06.870414+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/2898788410 expires 2024-04-24T14:38:42.138800+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/3290686917 expires 2024-04-24T14:38:06.870414+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3246781913 expires 2024-04-24T14:38:06.870414+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1124398484 expires 2024-04-24T14:38:42.138800+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3246781913 expires 2024-04-24T14:38:06.870414+0000 2024-04-23T14:51:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/2898788410 expires 2024-04-24T14:38:42.138800+0000 2024-04-23T14:51:01.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f18740a3c40 msgr2=0x7f18740a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:01.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f18740a3c40 0x7f18740a6100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1880000c00 tx=0x7f1880005fb0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 msgr2=0x7f189019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:01.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 0x7f189019b460 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f187800d9b0 tx=0x7f187800dcc0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 shutdown_connections 2024-04-23T14:51:01.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f18740a3c40 0x7f18740a6100 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1890106930 0x7f18901a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1890104d90 0x7f189019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 --2- 172.21.15.7:0/1325115614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1890105f90 0x7f189019b460 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.664+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 >> 172.21.15.7:0/1325115614 conn(0x7f1890100350 msgr2=0x7f18901093b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.665+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 shutdown_connections 2024-04-23T14:51:01.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:01.665+0000 7f1895000700 1 -- 172.21.15.7:0/1325115614 wait complete. 2024-04-23T14:51:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:02 smithi007 ceph-mon[27906]: pgmap v452: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:51:02.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:02 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1325115614' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-23T14:51:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:02 smithi186 ceph-mon[31814]: pgmap v452: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:51:02.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:02 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1325115614' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-23T14:51:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:02 smithi137 ceph-mon[31694]: pgmap v452: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T14:51:02.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:02 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1325115614' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-23T14:51:02.558 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-23T14:51:02.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.792+0000 7f84e1600640 1 -- 172.21.15.7:0/1486767229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc10a030 msgr2=0x7f84dc1108c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.792+0000 7f84e1600640 1 --2- 172.21.15.7:0/1486767229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc10a030 0x7f84dc1108c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009ca0 tx=0x7f84d402a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 -- 172.21.15.7:0/1486767229 shutdown_connections 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 --2- 172.21.15.7:0/1486767229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc10a030 0x7f84dc1108c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 --2- 172.21.15.7:0/1486767229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84dc109670 0x7f84dc109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 --2- 172.21.15.7:0/1486767229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc108480 0x7f84dc1088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 -- 172.21.15.7:0/1486767229 >> 172.21.15.7:0/1486767229 conn(0x7f84dc077440 msgr2=0x7f84dc079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 -- 172.21.15.7:0/1486767229 shutdown_connections 2024-04-23T14:51:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.793+0000 7f84e1600640 1 -- 172.21.15.7:0/1486767229 wait complete. 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 Processor -- start 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 -- start start 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 0x7f84dc19e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc109670 0x7f84dc19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84dc10a030 0x7f84dc1a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc114010 con 0x7f84dc108480 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc113e90 con 0x7f84dc109670 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.794+0000 7f84e1600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc114190 con 0x7f84dc10a030 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 0x7f84dc19e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 0x7f84dc19e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55286/0 (socket says 172.21.15.7:55286) 2024-04-23T14:51:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 -- 172.21.15.7:0/3310364361 learned_addr learned my addr 172.21.15.7:0/3310364361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84e0c00640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84dc10a030 0x7f84dc1a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84d3400640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc109670 0x7f84dc19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 -- 172.21.15.7:0/3310364361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84dc10a030 msgr2=0x7f84dc1a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84dc10a030 0x7f84dc1a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 -- 172.21.15.7:0/3310364361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc109670 msgr2=0x7f84dc19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc109670 0x7f84dc19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 -- 172.21.15.7:0/3310364361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc1a6250 con 0x7f84dc108480 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84d3400640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc109670 0x7f84dc19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.795+0000 7f84dbe00640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 0x7f84dc19e630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c970 tx=0x7f84cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.796+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc007c10 con 0x7f84dc108480 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.796+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84cc007db0 con 0x7f84dc108480 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.796+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00f870 con 0x7f84dc108480 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.796+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc1a6540 con 0x7f84dc108480 2024-04-23T14:51:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.796+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc1a6a40 con 0x7f84dc108480 2024-04-23T14:51:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.797+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84dc10f740 con 0x7f84dc108480 2024-04-23T14:51:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.799+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f84cc00fa10 con 0x7f84dc108480 2024-04-23T14:51:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.801+0000 7f84d9600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84c00a3c30 0x7f84c00a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.801+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f84cc0d0bb0 con 0x7f84dc108480 2024-04-23T14:51:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.801+0000 7f84d3400640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84c00a3c30 0x7f84c00a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:02.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.802+0000 7f84d3400640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84c00a3c30 0x7f84c00a60f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f84dc19fb40 tx=0x7f84c4005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:02.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:02.805+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f84cc09d240 con 0x7f84dc108480 2024-04-23T14:51:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.012+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84dc062c30 con 0x7f84dc108480 2024-04-23T14:51:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.016+0000 7f84d9600640 1 -- 172.21.15.7:0/3310364361 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24630 (secure 0 0 0) 0x7f84cc09cb40 con 0x7f84dc108480 2024-04-23T14:51:03.017 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:51:03.017 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:49:44.075188+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:51:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.018+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84c00a3c30 msgr2=0x7f84c00a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.018+0000 7f84e1600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84c00a3c30 0x7f84c00a60f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f84dc19fb40 tx=0x7f84c4005e50 comp rx=0 tx=0).stop 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 msgr2=0x7f84dc19e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 0x7f84dc19e630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c970 tx=0x7f84cc00ce30 comp rx=0 tx=0).stop 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 shutdown_connections 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f84c00a3c30 0x7f84c00a60f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84dc109670 0x7f84dc19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84dc10a030 0x7f84dc1a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 --2- 172.21.15.7:0/3310364361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc108480 0x7f84dc19e630 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 >> 172.21.15.7:0/3310364361 conn(0x7f84dc077440 msgr2=0x7f84dc10c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 shutdown_connections 2024-04-23T14:51:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.019+0000 7f84e1600640 1 -- 172.21.15.7:0/3310364361 wait complete. 2024-04-23T14:51:03.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:51:03.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:51:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.271+0000 7f2387200640 1 -- 172.21.15.7:0/4064746679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388104140 msgr2=0x7f2388104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.271+0000 7f2387200640 1 --2- 172.21.15.7:0/4064746679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388104140 0x7f2388104560 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2378009900 tx=0x7f237802a410 comp rx=0 tx=0).stop 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 -- 172.21.15.7:0/4064746679 shutdown_connections 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 --2- 172.21.15.7:0/4064746679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105330 0x7f23881057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 --2- 172.21.15.7:0/4064746679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2388105cf0 0x7f238810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 --2- 172.21.15.7:0/4064746679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388104140 0x7f2388104560 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 -- 172.21.15.7:0/4064746679 >> 172.21.15.7:0/4064746679 conn(0x7f23880ff6b0 msgr2=0x7f2388101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 -- 172.21.15.7:0/4064746679 shutdown_connections 2024-04-23T14:51:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.272+0000 7f2387200640 1 -- 172.21.15.7:0/4064746679 wait complete. 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 Processor -- start 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 -- start start 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2388104140 0x7f238819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 0x7f238819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105cf0 0x7f23881a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f238810fcd0 con 0x7f2388105330 2024-04-23T14:51:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f238810fb50 con 0x7f2388105cf0 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2387200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f238810fe50 con 0x7f2388104140 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.273+0000 7f2385400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 0x7f238819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 0x7f238819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39166/0 (socket says 172.21.15.7:39166) 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 -- 172.21.15.7:0/3908528572 learned_addr learned my addr 172.21.15.7:0/3908528572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385e00640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2388104140 0x7f238819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2386800640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105cf0 0x7f23881a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 -- 172.21.15.7:0/3908528572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2388104140 msgr2=0x7f238819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2388104140 0x7f238819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 -- 172.21.15.7:0/3908528572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105cf0 msgr2=0x7f23881a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105cf0 0x7f23881a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 -- 172.21.15.7:0/3908528572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23881a1fa0 con 0x7f2388105330 2024-04-23T14:51:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2386800640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105cf0 0x7f23881a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.274+0000 7f2385400640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 0x7f238819a8c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f237400e9f0 tx=0x7f237400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.275+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237400cd80 con 0x7f2388105330 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.275+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23740108e0 con 0x7f2388105330 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.275+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23881a2290 con 0x7f2388105330 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.275+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374018920 con 0x7f2388105330 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.275+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23881a27e0 con 0x7f2388105330 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.276+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238810b500 con 0x7f2388105330 2024-04-23T14:51:03.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.278+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f2374010a90 con 0x7f2388105330 2024-04-23T14:51:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.280+0000 7f237ea00640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f236c0a3bb0 0x7f236c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.280+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f23740d0c20 con 0x7f2388105330 2024-04-23T14:51:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.280+0000 7f2385e00640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f236c0a3bb0 0x7f236c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.281+0000 7f2385e00640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f236c0a3bb0 0x7f236c0a6070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2378006010 tx=0x7f23780314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:03.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.284+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f237409d220 con 0x7f2388105330 2024-04-23T14:51:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:03 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3310364361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:03 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3310364361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:03.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:03 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3310364361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.491+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2388062c00 con 0x7f2388105330 2024-04-23T14:51:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.492+0000 7f237ea00640 1 -- 172.21.15.7:0/3908528572 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f237409cb20 con 0x7f2388105330 2024-04-23T14:51:03.493 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f236c0a3bb0 msgr2=0x7f236c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f236c0a3bb0 0x7f236c0a6070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2378006010 tx=0x7f23780314a0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 msgr2=0x7f238819a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 0x7f238819a8c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f237400e9f0 tx=0x7f237400eeb0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 shutdown_connections 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f236c0a3bb0 0x7f236c0a6070 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2388105cf0 0x7f23881a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2388105330 0x7f238819a8c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 --2- 172.21.15.7:0/3908528572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2388104140 0x7f238819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 >> 172.21.15.7:0/3908528572 conn(0x7f23880ff6b0 msgr2=0x7f23881086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 shutdown_connections 2024-04-23T14:51:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.495+0000 7f2387200640 1 -- 172.21.15.7:0/3908528572 wait complete. 2024-04-23T14:51:03.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T14:51:03.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 -- 172.21.15.7:0/4262929679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f8108540 msgr2=0x7f71f8108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 --2- 172.21.15.7:0/4262929679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f8108540 0x7f71f8108960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009900 tx=0x7f71e802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 -- 172.21.15.7:0/4262929679 shutdown_connections 2024-04-23T14:51:03.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 --2- 172.21.15.7:0/4262929679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f810a0f0 0x7f71f8110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 --2- 172.21.15.7:0/4262929679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 0x7f71f8109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 --2- 172.21.15.7:0/4262929679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f8108540 0x7f71f8108960 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.727+0000 7f71fd200640 1 -- 172.21.15.7:0/4262929679 >> 172.21.15.7:0/4262929679 conn(0x7f71f80774d0 msgr2=0x7f71f8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:03.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.728+0000 7f71fd200640 1 -- 172.21.15.7:0/4262929679 shutdown_connections 2024-04-23T14:51:03.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.728+0000 7f71fd200640 1 -- 172.21.15.7:0/4262929679 wait complete. 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.728+0000 7f71fd200640 1 Processor -- start 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 -- start start 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f8108540 0x7f71f819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 0x7f71f819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 0x7f71f81a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81140e0 con 0x7f71f810a0f0 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8113f60 con 0x7f71f8108540 2024-04-23T14:51:03.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71fd200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8114260 con 0x7f71f8109730 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 0x7f71f81a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 0x7f71f81a5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39182/0 (socket says 172.21.15.7:39182) 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.729+0000 7f71f7e00640 1 -- 172.21.15.7:0/4230475105 learned_addr learned my addr 172.21.15.7:0/4230475105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7400640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f8108540 0x7f71f819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f6a00640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 0x7f71f819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7e00640 1 -- 172.21.15.7:0/4230475105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 msgr2=0x7f71f819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7e00640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 0x7f71f819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7e00640 1 -- 172.21.15.7:0/4230475105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f8108540 msgr2=0x7f71f819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7e00640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f8108540 0x7f71f819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7e00640 1 -- 172.21.15.7:0/4230475105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f81a6400 con 0x7f71f810a0f0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f6a00640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 0x7f71f819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71f7e00640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 0x7f71f81a5d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71f000b970 tx=0x7f71f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.730+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0019070 con 0x7f71f810a0f0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.731+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71f0014440 con 0x7f71f810a0f0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.731+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f00075d0 con 0x7f71f810a0f0 2024-04-23T14:51:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.731+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f81a66f0 con 0x7f71f810a0f0 2024-04-23T14:51:03.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.731+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f81a6cc0 con 0x7f71f810a0f0 2024-04-23T14:51:03.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.732+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f810f900 con 0x7f71f810a0f0 2024-04-23T14:51:03.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.734+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f71f001c070 con 0x7f71f810a0f0 2024-04-23T14:51:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.735+0000 7f71efe00640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f71dc0a3c30 0x7f71dc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:03.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.735+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f71f00d0140 con 0x7f71f810a0f0 2024-04-23T14:51:03.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.736+0000 7f71f7400640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f71dc0a3c30 0x7f71dc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:03.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.737+0000 7f71f7400640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f71dc0a3c30 0x7f71dc0a60f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71e8004770 tx=0x7f71e8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:03.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.738+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f71f009c0f0 con 0x7f71f810a0f0 2024-04-23T14:51:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.944+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f71f8062c00 con 0x7f71f810a0f0 2024-04-23T14:51:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.945+0000 7f71efe00640 1 -- 172.21.15.7:0/4230475105 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f71f00a03f0 con 0x7f71f810a0f0 2024-04-23T14:51:03.946 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.948+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f71dc0a3c30 msgr2=0x7f71dc0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.948+0000 7f71fd200640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f71dc0a3c30 0x7f71dc0a60f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f71e8004770 tx=0x7f71e8000bc0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.948+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 msgr2=0x7f71f81a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.948+0000 7f71fd200640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 0x7f71f81a5d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71f000b970 tx=0x7f71f000be30 comp rx=0 tx=0).stop 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 shutdown_connections 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f71dc0a3c30 0x7f71dc0a60f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71f810a0f0 0x7f71f81a5d90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71f8109730 0x7f71f819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 --2- 172.21.15.7:0/4230475105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f8108540 0x7f71f819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:03.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 >> 172.21.15.7:0/4230475105 conn(0x7f71f80774d0 msgr2=0x7f71f810cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:03.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 shutdown_connections 2024-04-23T14:51:03.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:03.949+0000 7f71fd200640 1 -- 172.21.15.7:0/4230475105 wait complete. 2024-04-23T14:51:03.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T14:51:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 -- 172.21.15.7:0/1029954260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 msgr2=0x7fa7fc108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 --2- 172.21.15.7:0/1029954260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc108960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009900 tx=0x7fa7f002a410 comp rx=0 tx=0).stop 2024-04-23T14:51:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 -- 172.21.15.7:0/1029954260 shutdown_connections 2024-04-23T14:51:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 --2- 172.21.15.7:0/1029954260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7fc10a0f0 0x7fa7fc110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 --2- 172.21.15.7:0/1029954260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 0x7fa7fc109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 --2- 172.21.15.7:0/1029954260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc108960 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 -- 172.21.15.7:0/1029954260 >> 172.21.15.7:0/1029954260 conn(0x7fa7fc0774d0 msgr2=0x7fa7fc079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 -- 172.21.15.7:0/1029954260 shutdown_connections 2024-04-23T14:51:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.181+0000 7fa802600640 1 -- 172.21.15.7:0/1029954260 wait complete. 2024-04-23T14:51:04.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.182+0000 7fa802600640 1 Processor -- start 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 -- start start 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc19e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 0x7fa7fc19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7fc10a0f0 0x7fa7fc1a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc114080 con 0x7fa7fc108540 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc113f00 con 0x7fa7fc10a0f0 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa802600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc114200 con 0x7fa7fc109730 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa801200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc19e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa801200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc19e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39198/0 (socket says 172.21.15.7:39198) 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa801200640 1 -- 172.21.15.7:0/1445254626 learned_addr learned my addr 172.21.15.7:0/1445254626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.183+0000 7fa801c00640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7fc10a0f0 0x7fa7fc1a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa7fbe00640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 0x7fa7fc19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa801200640 1 -- 172.21.15.7:0/1445254626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 msgr2=0x7fa7fc19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa801200640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 0x7fa7fc19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa801200640 1 -- 172.21.15.7:0/1445254626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7fc10a0f0 msgr2=0x7fa7fc1a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa801200640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7fc10a0f0 0x7fa7fc1a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa801200640 1 -- 172.21.15.7:0/1445254626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc1a6380 con 0x7fa7fc108540 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa7fbe00640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 0x7fa7fc19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa801200640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc19e760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00314e0 tx=0x7fa7f0031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f003f030 con 0x7fa7fc108540 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7f00044b0 con 0x7fa7fc108540 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc1a6610 con 0x7fa7fc108540 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0035070 con 0x7fa7fc108540 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.184+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc1a6b50 con 0x7fa7fc108540 2024-04-23T14:51:04.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.186+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc10f930 con 0x7fa7fc108540 2024-04-23T14:51:04.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.188+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fa7f0042030 con 0x7fa7fc108540 2024-04-23T14:51:04.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.189+0000 7fa7f9600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7e40a3c30 0x7fa7e40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.189+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa7f00f0d80 con 0x7fa7fc108540 2024-04-23T14:51:04.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.190+0000 7fa7fbe00640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7e40a3c30 0x7fa7e40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.190+0000 7fa7fbe00640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7e40a3c30 0x7fa7e40a60f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc19fc70 tx=0x7fa7e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.193+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa7f00bd380 con 0x7fa7fc108540 2024-04-23T14:51:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:04 smithi007 ceph-mon[27906]: pgmap v453: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:51:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:04 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3908528572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:51:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:04 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4230475105' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:51:04.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.403+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa7fc062c00 con 0x7fa7fc108540 2024-04-23T14:51:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.404+0000 7fa7f9600640 1 -- 172.21.15.7:0/1445254626 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7fa7f00bcc80 con 0x7fa7fc108540 2024-04-23T14:51:04.404 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T14:51:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.406+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7e40a3c30 msgr2=0x7fa7e40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.406+0000 7fa802600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7e40a3c30 0x7fa7e40a60f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc19fc70 tx=0x7fa7e8005f90 comp rx=0 tx=0).stop 2024-04-23T14:51:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.406+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 msgr2=0x7fa7fc19e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc19e760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00314e0 tx=0x7fa7f0031a30 comp rx=0 tx=0).stop 2024-04-23T14:51:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 shutdown_connections 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa7e40a3c30 0x7fa7e40a60f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7fc10a0f0 0x7fa7fc1a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7fc109730 0x7fa7fc19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 --2- 172.21.15.7:0/1445254626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc108540 0x7fa7fc19e760 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 >> 172.21.15.7:0/1445254626 conn(0x7fa7fc0774d0 msgr2=0x7fa7fc10cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 shutdown_connections 2024-04-23T14:51:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.407+0000 7fa802600640 1 -- 172.21.15.7:0/1445254626 wait complete. 2024-04-23T14:51:04.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:04 smithi137 ceph-mon[31694]: pgmap v453: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:51:04.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:04 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3908528572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:51:04.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:04 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4230475105' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:51:04.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T14:51:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:04 smithi186 ceph-mon[31814]: pgmap v453: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T14:51:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:04 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3908528572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:51:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:04 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4230475105' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:51:04.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.651+0000 7f3410200640 1 -- 172.21.15.7:0/849390326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3408077c00 msgr2=0x7f3408078060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.651+0000 7f3410200640 1 --2- 172.21.15.7:0/849390326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3408077c00 0x7f3408078060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009900 tx=0x7f33f402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 -- 172.21.15.7:0/849390326 shutdown_connections 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 --2- 172.21.15.7:0/849390326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080785a0 0x7f3408078e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 --2- 172.21.15.7:0/849390326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3408077c00 0x7f3408078060 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 --2- 172.21.15.7:0/849390326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f34080769c0 0x7f3408076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 -- 172.21.15.7:0/849390326 >> 172.21.15.7:0/849390326 conn(0x7f34080ff7b0 msgr2=0x7f3408101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 -- 172.21.15.7:0/849390326 shutdown_connections 2024-04-23T14:51:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.652+0000 7f3410200640 1 -- 172.21.15.7:0/849390326 wait complete. 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 Processor -- start 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 -- start start 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080769c0 0x7f340819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3408077c00 0x7f340819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 0x7f34081a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f34081141a0 con 0x7f34080785a0 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3408114020 con 0x7f34080769c0 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.653+0000 7f3410200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3408114320 con 0x7f3408077c00 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 0x7f34081a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 0x7f34081a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39224/0 (socket says 172.21.15.7:39224) 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 -- 172.21.15.7:0/3559104223 learned_addr learned my addr 172.21.15.7:0/3559104223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340ce00640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3408077c00 0x7f340819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340d800640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080769c0 0x7f340819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 -- 172.21.15.7:0/3559104223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3408077c00 msgr2=0x7f340819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3408077c00 0x7f340819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 -- 172.21.15.7:0/3559104223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080769c0 msgr2=0x7f340819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080769c0 0x7f340819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.654+0000 7f340e200640 1 -- 172.21.15.7:0/3559104223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34081a6480 con 0x7f34080785a0 2024-04-23T14:51:04.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.655+0000 7f340e200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 0x7f34081a5e10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f340000eaa0 tx=0x7f340000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:04.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.655+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340000cdb0 con 0x7f34080785a0 2024-04-23T14:51:04.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.655+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34081a6770 con 0x7f34080785a0 2024-04-23T14:51:04.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.655+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3400005020 con 0x7f34080785a0 2024-04-23T14:51:04.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.655+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000116d0 con 0x7f34080785a0 2024-04-23T14:51:04.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.655+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081a6c70 con 0x7f34080785a0 2024-04-23T14:51:04.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.656+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408110e00 con 0x7f34080785a0 2024-04-23T14:51:04.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.658+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f34000051d0 con 0x7f34080785a0 2024-04-23T14:51:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.660+0000 7f3406000640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f33f00a3bb0 0x7f33f00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.660+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f34000d0a80 con 0x7f34080785a0 2024-04-23T14:51:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.660+0000 7f340d800640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f33f00a3bb0 0x7f33f00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:04.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.661+0000 7f340d800640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f33f00a3bb0 0x7f33f00a6070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005fd0 tx=0x7f33fc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:04.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.664+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f34000d2e20 con 0x7f34080785a0 2024-04-23T14:51:04.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.877+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3408062c00 con 0x7f34080785a0 2024-04-23T14:51:04.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.878+0000 7f3406000640 1 -- 172.21.15.7:0/3559104223 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f3400016030 con 0x7f34080785a0 2024-04-23T14:51:04.879 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:51:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f33f00a3bb0 msgr2=0x7f33f00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f33f00a3bb0 0x7f33f00a6070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005fd0 tx=0x7f33fc005850 comp rx=0 tx=0).stop 2024-04-23T14:51:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 msgr2=0x7f34081a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:04.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 0x7f34081a5e10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f340000eaa0 tx=0x7f340000ef60 comp rx=0 tx=0).stop 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 shutdown_connections 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f33f00a3bb0 0x7f33f00a6070 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34080785a0 0x7f34081a5e10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3408077c00 0x7f340819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 --2- 172.21.15.7:0/3559104223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080769c0 0x7f340819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 >> 172.21.15.7:0/3559104223 conn(0x7f34080ff7b0 msgr2=0x7f3408100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 shutdown_connections 2024-04-23T14:51:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:04.881+0000 7f3410200640 1 -- 172.21.15.7:0/3559104223 wait complete. 2024-04-23T14:51:04.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:51:05.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 -- 172.21.15.7:0/3371071944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984074a60 msgr2=0x7f5984074ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 --2- 172.21.15.7:0/3371071944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984074a60 0x7f5984074ee0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5970009930 tx=0x7f597002a420 comp rx=0 tx=0).stop 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 -- 172.21.15.7:0/3371071944 shutdown_connections 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 --2- 172.21.15.7:0/3371071944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f598410e620 0x7f5984110a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 --2- 172.21.15.7:0/3371071944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984074a60 0x7f5984074ee0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 --2- 172.21.15.7:0/3371071944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5984076040 0x7f5984074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 -- 172.21.15.7:0/3371071944 >> 172.21.15.7:0/3371071944 conn(0x7f59840fd600 msgr2=0x7f59840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 -- 172.21.15.7:0/3371071944 shutdown_connections 2024-04-23T14:51:05.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.118+0000 7f598bc00640 1 -- 172.21.15.7:0/3371071944 wait complete. 2024-04-23T14:51:05.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.119+0000 7f598bc00640 1 Processor -- start 2024-04-23T14:51:05.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.119+0000 7f598bc00640 1 -- start start 2024-04-23T14:51:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f598bc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5984074a60 0x7f598419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f598bc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 0x7f598419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f598bc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f598410e620 0x7f59841a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f598bc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5984114180 con 0x7f5984076040 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f598bc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5984114000 con 0x7f598410e620 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f598bc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5984114300 con 0x7f5984074a60 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f5983e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 0x7f598419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f5983e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 0x7f598419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39240/0 (socket says 172.21.15.7:39240) 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f5983e00640 1 -- 172.21.15.7:0/2714010237 learned_addr learned my addr 172.21.15.7:0/2714010237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f5989200640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5984074a60 0x7f598419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.120+0000 7f5989c00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f598410e620 0x7f59841a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.121+0000 7f5983e00640 1 -- 172.21.15.7:0/2714010237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5984074a60 msgr2=0x7f598419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.121+0000 7f5983e00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5984074a60 0x7f598419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.121+0000 7f5983e00640 1 -- 172.21.15.7:0/2714010237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f598410e620 msgr2=0x7f59841a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.121+0000 7f5983e00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f598410e620 0x7f59841a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.121+0000 7f5983e00640 1 -- 172.21.15.7:0/2714010237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59841a6520 con 0x7f5984076040 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.121+0000 7f5983e00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 0x7f598419ee40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f59700314e0 tx=0x7f59700042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.122+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597003f030 con 0x7f5984076040 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.122+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5970003cb0 con 0x7f5984076040 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.122+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59841a67b0 con 0x7f5984076040 2024-04-23T14:51:05.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.122+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970035070 con 0x7f5984076040 2024-04-23T14:51:05.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.122+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59841a6cf0 con 0x7f5984076040 2024-04-23T14:51:05.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.123+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59841047f0 con 0x7f5984076040 2024-04-23T14:51:05.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.126+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f5970042030 con 0x7f5984076040 2024-04-23T14:51:05.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.127+0000 7f5981600640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f596c0a3c30 0x7f596c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.127+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f59700f0cd0 con 0x7f5984076040 2024-04-23T14:51:05.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.128+0000 7f5989200640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f596c0a3c30 0x7f596c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.128+0000 7f5989200640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f596c0a3c30 0x7f596c0a60f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f597800bbe0 tx=0x7f597800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:05.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.135+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f59700bcc80 con 0x7f5984076040 2024-04-23T14:51:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1445254626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:51:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3559104223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:51:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.384+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5984062c00 con 0x7f5984076040 2024-04-23T14:51:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.385+0000 7f5981600640 1 -- 172.21.15.7:0/2714010237 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11926 (secure 0 0 0) 0x7f59700c0f80 con 0x7f5984076040 2024-04-23T14:51:05.386 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:51:05.386 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:53.850115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[34484,34526,34424,34448,24508]},"id":1}]} 2024-04-23T14:51:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:51:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f596c0a3c30 msgr2=0x7f596c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f596c0a3c30 0x7f596c0a60f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f597800bbe0 tx=0x7f597800b390 comp rx=0 tx=0).stop 2024-04-23T14:51:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 msgr2=0x7f598419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 0x7f598419ee40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f59700314e0 tx=0x7f59700042e0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 shutdown_connections 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f596c0a3c30 0x7f596c0a60f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f598410e620 0x7f59841a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5984076040 0x7f598419ee40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 --2- 172.21.15.7:0/2714010237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5984074a60 0x7f598419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 >> 172.21.15.7:0/2714010237 conn(0x7f59840fd600 msgr2=0x7f59841019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 shutdown_connections 2024-04-23T14:51:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.388+0000 7f598bc00640 1 -- 172.21.15.7:0/2714010237 wait complete. 2024-04-23T14:51:05.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:51:05.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1445254626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:51:05.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3559104223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:51:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1445254626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:51:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3559104223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:51:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 -- 172.21.15.7:0/104133329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 msgr2=0x7f7c801058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 --2- 172.21.15.7:0/104133329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c801058f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009900 tx=0x7f7c6c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 -- 172.21.15.7:0/104133329 shutdown_connections 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 --2- 172.21.15.7:0/104133329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80105e30 0x7f7c8010c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 --2- 172.21.15.7:0/104133329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c801058f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 --2- 172.21.15.7:0/104133329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c80104280 0x7f7c801046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 -- 172.21.15.7:0/104133329 >> 172.21.15.7:0/104133329 conn(0x7f7c800ff7f0 msgr2=0x7f7c80101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 -- 172.21.15.7:0/104133329 shutdown_connections 2024-04-23T14:51:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.616+0000 7f7c88400640 1 -- 172.21.15.7:0/104133329 wait complete. 2024-04-23T14:51:05.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 Processor -- start 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 -- start start 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80104280 0x7f7c8019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c8019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c80105e30 0x7f7c801a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010fdc0 con 0x7f7c80105470 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010fc40 con 0x7f7c80104280 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.617+0000 7f7c88400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8010ff40 con 0x7f7c80105e30 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c8019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c8019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39262/0 (socket says 172.21.15.7:39262) 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 -- 172.21.15.7:0/1690965588 learned_addr learned my addr 172.21.15.7:0/1690965588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c86400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c80105e30 0x7f7c801a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85a00640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80104280 0x7f7c8019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 -- 172.21.15.7:0/1690965588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c80105e30 msgr2=0x7f7c801a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c80105e30 0x7f7c801a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 -- 172.21.15.7:0/1690965588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80104280 msgr2=0x7f7c8019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80104280 0x7f7c8019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 -- 172.21.15.7:0/1690965588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c801a2090 con 0x7f7c80105470 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85a00640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80104280 0x7f7c8019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.618+0000 7f7c85000640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c8019a9b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c004770 tx=0x7f7c6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.619+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c03f030 con 0x7f7c80105470 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.619+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c6c003cb0 con 0x7f7c80105470 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.619+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c035070 con 0x7f7c80105470 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.619+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c801a2320 con 0x7f7c80105470 2024-04-23T14:51:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.619+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801a2810 con 0x7f7c80105470 2024-04-23T14:51:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.620+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8010b5f0 con 0x7f7c80105470 2024-04-23T14:51:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.622+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f7c6c042030 con 0x7f7c80105470 2024-04-23T14:51:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.624+0000 7f7c7e000640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7c680a3bb0 0x7f7c680a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.624+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f7c6c0f1220 con 0x7f7c80105470 2024-04-23T14:51:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.624+0000 7f7c85a00640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7c680a3bb0 0x7f7c680a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.625+0000 7f7c85a00640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7c680a3bb0 0x7f7c680a6070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c801052d0 tx=0x7f7c74005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.628+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7c6c0bd820 con 0x7f7c80105470 2024-04-23T14:51:05.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.834+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c80062c00 con 0x7f7c80105470 2024-04-23T14:51:05.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.836+0000 7f7c7e000640 1 -- 172.21.15.7:0/1690965588 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24630 (secure 0 0 0) 0x7f7c6c0bd120 con 0x7f7c80105470 2024-04-23T14:51:05.837 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:51:05.837 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:49:44.075188+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:51:05.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7c680a3bb0 msgr2=0x7f7c680a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7c680a3bb0 0x7f7c680a6070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c801052d0 tx=0x7f7c74005e70 comp rx=0 tx=0).stop 2024-04-23T14:51:05.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 msgr2=0x7f7c8019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:05.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c8019a9b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c004770 tx=0x7f7c6c0042f0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 shutdown_connections 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f7c680a3bb0 0x7f7c680a6070 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c80105e30 0x7f7c801a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c80105470 0x7f7c8019a9b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 --2- 172.21.15.7:0/1690965588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c80104280 0x7f7c8019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 >> 172.21.15.7:0/1690965588 conn(0x7f7c800ff7f0 msgr2=0x7f7c801087c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 shutdown_connections 2024-04-23T14:51:05.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:05.839+0000 7f7c88400640 1 -- 172.21.15.7:0/1690965588 wait complete. 2024-04-23T14:51:05.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:51:05.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:51:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 -- 172.21.15.7:0/4199291232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5960109730 msgr2=0x7f5960109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 --2- 172.21.15.7:0/4199291232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5960109730 0x7f5960109bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f594c009900 tx=0x7f594c02a400 comp rx=0 tx=0).stop 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 -- 172.21.15.7:0/4199291232 shutdown_connections 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 --2- 172.21.15.7:0/4199291232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f596010a0f0 0x7f5960110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 --2- 172.21.15.7:0/4199291232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5960109730 0x7f5960109bb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 --2- 172.21.15.7:0/4199291232 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5960108540 0x7f5960108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 -- 172.21.15.7:0/4199291232 >> 172.21.15.7:0/4199291232 conn(0x7f59600774d0 msgr2=0x7f5960079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 -- 172.21.15.7:0/4199291232 shutdown_connections 2024-04-23T14:51:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.077+0000 7f595fe00640 1 -- 172.21.15.7:0/4199291232 wait complete. 2024-04-23T14:51:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 Processor -- start 2024-04-23T14:51:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 -- start start 2024-04-23T14:51:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5960108540 0x7f596019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5960109730 0x7f596019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 0x7f59601a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5960114110 con 0x7f596010a0f0 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5960113f90 con 0x7f5960109730 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.078+0000 7f595fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5960114290 con 0x7f5960108540 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 0x7f59601a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 0x7f59601a5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39278/0 (socket says 172.21.15.7:39278) 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 -- 172.21.15.7:0/2221527770 learned_addr learned my addr 172.21.15.7:0/2221527770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595ea00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5960108540 0x7f596019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595e000640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5960109730 0x7f596019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 -- 172.21.15.7:0/2221527770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5960108540 msgr2=0x7f596019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5960108540 0x7f596019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 -- 172.21.15.7:0/2221527770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5960109730 msgr2=0x7f596019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5960109730 0x7f596019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.079+0000 7f595f400640 1 -- 172.21.15.7:0/2221527770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59601a63d0 con 0x7f596010a0f0 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.080+0000 7f595f400640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 0x7f59601a5d60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f595800b970 tx=0x7f595800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.080+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958019070 con 0x7f596010a0f0 2024-04-23T14:51:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.080+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5958014440 con 0x7f596010a0f0 2024-04-23T14:51:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.080+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59601a66c0 con 0x7f596010a0f0 2024-04-23T14:51:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.080+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59580075d0 con 0x7f596010a0f0 2024-04-23T14:51:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.080+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59601a6c60 con 0x7f596010a0f0 2024-04-23T14:51:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.081+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596010f860 con 0x7f596010a0f0 2024-04-23T14:51:06.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.083+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f595801c070 con 0x7f596010a0f0 2024-04-23T14:51:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.085+0000 7f5957400640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f59440a3c30 0x7f59440a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.085+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f59580cfd90 con 0x7f596010a0f0 2024-04-23T14:51:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.085+0000 7f595ea00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f59440a3c30 0x7f59440a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.086+0000 7f595ea00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f59440a3c30 0x7f59440a60f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5950005db0 tx=0x7f5950005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.089+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f595809c390 con 0x7f596010a0f0 2024-04-23T14:51:06.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.301+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5960062c00 con 0x7f596010a0f0 2024-04-23T14:51:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.302+0000 7f5957400640 1 -- 172.21.15.7:0/2221527770 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f595809bc90 con 0x7f596010a0f0 2024-04-23T14:51:06.302 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f59440a3c30 msgr2=0x7f59440a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f59440a3c30 0x7f59440a60f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5950005db0 tx=0x7f5950005d40 comp rx=0 tx=0).stop 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 msgr2=0x7f59601a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 0x7f59601a5d60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f595800b970 tx=0x7f595800be30 comp rx=0 tx=0).stop 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 shutdown_connections 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f59440a3c30 0x7f59440a60f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5960109730 0x7f596019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596010a0f0 0x7f59601a5d60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 --2- 172.21.15.7:0/2221527770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5960108540 0x7f596019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.304+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 >> 172.21.15.7:0/2221527770 conn(0x7f59600774d0 msgr2=0x7f596010ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.305+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 shutdown_connections 2024-04-23T14:51:06.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.305+0000 7f595fe00640 1 -- 172.21.15.7:0/2221527770 wait complete. 2024-04-23T14:51:06.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T14:51:06.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:06 smithi007 ceph-mon[27906]: pgmap v454: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:51:06.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:06 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2714010237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:51:06.401 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:06 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1690965588' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:06 smithi137 ceph-mon[31694]: pgmap v454: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:51:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:06 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2714010237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:51:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:06 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1690965588' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:06.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 -- 172.21.15.7:0/548353643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 msgr2=0x7f7904104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 --2- 172.21.15.7:0/548353643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f7904104ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009ca0 tx=0x7f78fc02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 -- 172.21.15.7:0/548353643 shutdown_connections 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 --2- 172.21.15.7:0/548353643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7904105410 0x7f7904107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 --2- 172.21.15.7:0/548353643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7904107d40 0x7f790410a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 --2- 172.21.15.7:0/548353643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f7904104ed0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 -- 172.21.15.7:0/548353643 >> 172.21.15.7:0/548353643 conn(0x7f79040fc4d0 msgr2=0x7f79040fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 -- 172.21.15.7:0/548353643 shutdown_connections 2024-04-23T14:51:06.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.544+0000 7f7909e00640 1 -- 172.21.15.7:0/548353643 wait complete. 2024-04-23T14:51:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 Processor -- start 2024-04-23T14:51:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 -- start start 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f790419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7904105410 0x7f790419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7904107d40 0x7f79041a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f790410dbf0 con 0x7f7904102ae0 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f790410da70 con 0x7f7904105410 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.545+0000 7f7909e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f790410dd70 con 0x7f7904107d40 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f790419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f790419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39282/0 (socket says 172.21.15.7:39282) 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 -- 172.21.15.7:0/2733673756 learned_addr learned my addr 172.21.15.7:0/2733673756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7903400640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7904107d40 0x7f79041a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902000640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7904105410 0x7f790419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 -- 172.21.15.7:0/2733673756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7904107d40 msgr2=0x7f79041a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7904107d40 0x7f79041a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 -- 172.21.15.7:0/2733673756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7904105410 msgr2=0x7f790419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7904105410 0x7f790419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 -- 172.21.15.7:0/2733673756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041a2120 con 0x7f7904102ae0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.546+0000 7f7902a00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f790419a500 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f78fc02aeb0 tx=0x7f78fc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.547+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004240 con 0x7f7904102ae0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.547+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78fc032ec0 con 0x7f7904102ae0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.547+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79041a23b0 con 0x7f7904102ae0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.547+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc030d40 con 0x7f7904102ae0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.547+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79041a2900 con 0x7f7904102ae0 2024-04-23T14:51:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.548+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7904109890 con 0x7f7904102ae0 2024-04-23T14:51:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.551+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f78fc0043e0 con 0x7f7904102ae0 2024-04-23T14:51:06.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.552+0000 7f7908a00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f78e80a3bb0 0x7f78e80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.552+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f78fc0f1e60 con 0x7f7904102ae0 2024-04-23T14:51:06.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.552+0000 7f7902000640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f78e80a3bb0 0x7f78e80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.553+0000 7f7902000640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f78e80a3bb0 0x7f78e80a6070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005fd0 tx=0x7f78ec005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.556+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f78fc0be4c0 con 0x7f7904102ae0 2024-04-23T14:51:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:06 smithi186 ceph-mon[31814]: pgmap v454: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T14:51:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:06 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2714010237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:51:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:06 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1690965588' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:06.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.769+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7904062c00 con 0x7f7904102ae0 2024-04-23T14:51:06.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.770+0000 7f7908a00640 1 -- 172.21.15.7:0/2733673756 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f78fc0bddc0 con 0x7f7904102ae0 2024-04-23T14:51:06.770 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.772+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f78e80a3bb0 msgr2=0x7f78e80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.772+0000 7f7909e00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f78e80a3bb0 0x7f78e80a6070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005fd0 tx=0x7f78ec005850 comp rx=0 tx=0).stop 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.772+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 msgr2=0x7f790419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.772+0000 7f7909e00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f790419a500 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f78fc02aeb0 tx=0x7f78fc003c20 comp rx=0 tx=0).stop 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 shutdown_connections 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f78e80a3bb0 0x7f78e80a6070 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7904105410 0x7f790419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7904107d40 0x7f79041a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 --2- 172.21.15.7:0/2733673756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7904102ae0 0x7f790419a500 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 >> 172.21.15.7:0/2733673756 conn(0x7f79040fc4d0 msgr2=0x7f7904102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.773+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 shutdown_connections 2024-04-23T14:51:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.774+0000 7f7909e00640 1 -- 172.21.15.7:0/2733673756 wait complete. 2024-04-23T14:51:06.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T14:51:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 -- 172.21.15.7:0/4196938960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 msgr2=0x7ff7241058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 --2- 172.21.15.7:0/4196938960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff7241058d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009900 tx=0x7ff70c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 -- 172.21.15.7:0/4196938960 shutdown_connections 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 --2- 172.21.15.7:0/4196938960 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff724105e10 0x7ff72410c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 --2- 172.21.15.7:0/4196938960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff7241058d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 --2- 172.21.15.7:0/4196938960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 0x7ff724104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 -- 172.21.15.7:0/4196938960 >> 172.21.15.7:0/4196938960 conn(0x7ff7240ff7b0 msgr2=0x7ff724101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 -- 172.21.15.7:0/4196938960 shutdown_connections 2024-04-23T14:51:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.995+0000 7ff729000640 1 -- 172.21.15.7:0/4196938960 wait complete. 2024-04-23T14:51:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 Processor -- start 2024-04-23T14:51:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 -- start start 2024-04-23T14:51:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 0x7ff72419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff72419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff724105e10 0x7ff7241a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:06.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff72410fdf0 con 0x7ff724105450 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff72410fc70 con 0x7ff724104260 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.996+0000 7ff729000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff72410ff70 con 0x7ff724105e10 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff72419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff72419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39302/0 (socket says 172.21.15.7:39302) 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 -- 172.21.15.7:0/1680248733 learned_addr learned my addr 172.21.15.7:0/1680248733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff722800640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff724105e10 0x7ff7241a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff721e00640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 0x7ff72419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 -- 172.21.15.7:0/1680248733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff724105e10 msgr2=0x7ff7241a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff724105e10 0x7ff7241a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 -- 172.21.15.7:0/1680248733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 msgr2=0x7ff72419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 0x7ff72419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff719400640 1 -- 172.21.15.7:0/1680248733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7241a2070 con 0x7ff724105450 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.997+0000 7ff721e00640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 0x7ff72419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.998+0000 7ff719400640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff72419a990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0314e0 tx=0x7ff70c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.998+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c03f070 con 0x7ff724105450 2024-04-23T14:51:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.998+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7241a2300 con 0x7ff724105450 2024-04-23T14:51:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.998+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff70c031e40 con 0x7ff724105450 2024-04-23T14:51:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.998+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c035030 con 0x7ff724105450 2024-04-23T14:51:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.998+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7241a27f0 con 0x7ff724105450 2024-04-23T14:51:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:06.999+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72410b600 con 0x7ff724105450 2024-04-23T14:51:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.001+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7ff70c042070 con 0x7ff724105450 2024-04-23T14:51:07.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.003+0000 7ff71b400640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7080a3bb0 0x7ff7080a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.003+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7ff70c0f1190 con 0x7ff724105450 2024-04-23T14:51:07.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.003+0000 7ff721e00640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7080a3bb0 0x7ff7080a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.004+0000 7ff721e00640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7080a3bb0 0x7ff7080a6070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7241052b0 tx=0x7ff7140082f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.007+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff70c0bd790 con 0x7ff724105450 2024-04-23T14:51:07.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.220+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff724062c00 con 0x7ff724105450 2024-04-23T14:51:07.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.222+0000 7ff71b400640 1 -- 172.21.15.7:0/1680248733 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7ff70c0bd090 con 0x7ff724105450 2024-04-23T14:51:07.222 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T14:51:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.224+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7080a3bb0 msgr2=0x7ff7080a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.224+0000 7ff729000640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7080a3bb0 0x7ff7080a6070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7241052b0 tx=0x7ff7140082f0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.224+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 msgr2=0x7ff72419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.224+0000 7ff729000640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff72419a990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0314e0 tx=0x7ff70c003c80 comp rx=0 tx=0).stop 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 shutdown_connections 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7ff7080a3bb0 0x7ff7080a6070 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff724105e10 0x7ff7241a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff724105450 0x7ff72419a990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 --2- 172.21.15.7:0/1680248733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff724104260 0x7ff72419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 >> 172.21.15.7:0/1680248733 conn(0x7ff7240ff7b0 msgr2=0x7ff7241087d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 shutdown_connections 2024-04-23T14:51:07.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.225+0000 7ff729000640 1 -- 172.21.15.7:0/1680248733 wait complete. 2024-04-23T14:51:07.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T14:51:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2221527770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:51:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:07 smithi007 ceph-mon[27906]: pgmap v455: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:51:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2733673756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:51:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2221527770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:51:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:07 smithi137 ceph-mon[31694]: pgmap v455: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:51:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2733673756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:51:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.444+0000 7f4dcae00640 1 -- 172.21.15.7:0/4037897481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103180 msgr2=0x7f4dc4103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.444+0000 7f4dcae00640 1 --2- 172.21.15.7:0/4037897481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103180 0x7f4dc4103600 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009900 tx=0x7f4db002a410 comp rx=0 tx=0).stop 2024-04-23T14:51:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 -- 172.21.15.7:0/4037897481 shutdown_connections 2024-04-23T14:51:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 --2- 172.21.15.7:0/4037897481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc4103b40 0x7f4dc410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 --2- 172.21.15.7:0/4037897481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103180 0x7f4dc4103600 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 --2- 172.21.15.7:0/4037897481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4101f90 0x7f4dc41023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 -- 172.21.15.7:0/4037897481 >> 172.21.15.7:0/4037897481 conn(0x7f4dc40fd500 msgr2=0x7f4dc40ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 -- 172.21.15.7:0/4037897481 shutdown_connections 2024-04-23T14:51:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.445+0000 7f4dcae00640 1 -- 172.21.15.7:0/4037897481 wait complete. 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 Processor -- start 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 -- start start 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc4101f90 0x7f4dc419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4103180 0x7f4dc419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 0x7f4dc41a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc410dab0 con 0x7f4dc4103b40 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc410d930 con 0x7f4dc4101f90 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.446+0000 7f4dcae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc410dc30 con 0x7f4dc4103180 2024-04-23T14:51:07.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 0x7f4dc41a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 0x7f4dc41a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39320/0 (socket says 172.21.15.7:39320) 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 -- 172.21.15.7:0/3838494363 learned_addr learned my addr 172.21.15.7:0/3838494363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dc9a00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc4101f90 0x7f4dc419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dc9000640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4103180 0x7f4dc419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 -- 172.21.15.7:0/3838494363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4103180 msgr2=0x7f4dc419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4103180 0x7f4dc419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 -- 172.21.15.7:0/3838494363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc4101f90 msgr2=0x7f4dc419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc4101f90 0x7f4dc419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 -- 172.21.15.7:0/3838494363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc41a1fb0 con 0x7f4dc4103b40 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.447+0000 7f4dca400640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 0x7f4dc41a1940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00cad0 tx=0x7f4dbc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.448+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00ae20 con 0x7f4dc4103b40 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.448+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4dbc005020 con 0x7f4dc4103b40 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.448+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00f6b0 con 0x7f4dc4103b40 2024-04-23T14:51:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.448+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc41a22a0 con 0x7f4dc4103b40 2024-04-23T14:51:07.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.448+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc41a27c0 con 0x7f4dc4103b40 2024-04-23T14:51:07.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.449+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc41a2a80 con 0x7f4dc4103b40 2024-04-23T14:51:07.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.451+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f4dbc0051d0 con 0x7f4dc4103b40 2024-04-23T14:51:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.452+0000 7f4dc2000640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4dac0a3c30 0x7f4dac0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.453+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f4dbc0d0830 con 0x7f4dc4103b40 2024-04-23T14:51:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.453+0000 7f4dc9a00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4dac0a3c30 0x7f4dac0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.453+0000 7f4dc9a00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4dac0a3c30 0x7f4dac0a60f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005db0 tx=0x7f4db8005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.456+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4dbc014030 con 0x7f4dc4103b40 2024-04-23T14:51:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2221527770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:51:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:07 smithi186 ceph-mon[31814]: pgmap v455: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-23T14:51:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2733673756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T14:51:07.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.659+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4dc41a2cf0 con 0x7f4dc4103b40 2024-04-23T14:51:07.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.659+0000 7f4dc2000640 1 -- 172.21.15.7:0/3838494363 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f4dbc09ce90 con 0x7f4dc4103b40 2024-04-23T14:51:07.660 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T14:51:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4dac0a3c30 msgr2=0x7f4dac0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4dac0a3c30 0x7f4dac0a60f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005db0 tx=0x7f4db8005d40 comp rx=0 tx=0).stop 2024-04-23T14:51:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 msgr2=0x7f4dc41a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 0x7f4dc41a1940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00cad0 tx=0x7f4dbc00cf90 comp rx=0 tx=0).stop 2024-04-23T14:51:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 shutdown_connections 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f4dac0a3c30 0x7f4dac0a60f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4103b40 0x7f4dc41a1940 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4103180 0x7f4dc419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 --2- 172.21.15.7:0/3838494363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc4101f90 0x7f4dc419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 >> 172.21.15.7:0/3838494363 conn(0x7f4dc40fd500 msgr2=0x7f4dc4074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 shutdown_connections 2024-04-23T14:51:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.662+0000 7f4dcae00640 1 -- 172.21.15.7:0/3838494363 wait complete. 2024-04-23T14:51:07.680 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:51:07.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.874+0000 7f1635a00640 1 -- 172.21.15.7:0/766667435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 msgr2=0x7f1630107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.874+0000 7f1635a00640 1 --2- 172.21.15.7:0/766667435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f1630107620 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f161c009900 tx=0x7f161c02a410 comp rx=0 tx=0).stop 2024-04-23T14:51:07.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 -- 172.21.15.7:0/766667435 shutdown_connections 2024-04-23T14:51:07.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 --2- 172.21.15.7:0/766667435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1630107b60 0x7f1630109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 --2- 172.21.15.7:0/766667435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f1630107620 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 --2- 172.21.15.7:0/766667435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 0x7f1630104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 -- 172.21.15.7:0/766667435 >> 172.21.15.7:0/766667435 conn(0x7f16300fc2d0 msgr2=0x7f16300fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 -- 172.21.15.7:0/766667435 shutdown_connections 2024-04-23T14:51:07.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.875+0000 7f1635a00640 1 -- 172.21.15.7:0/766667435 wait complete. 2024-04-23T14:51:07.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 Processor -- start 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 -- start start 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 0x7f1630102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f16301008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1630107b60 0x7f1630100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f163010d9f0 con 0x7f1630105230 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f163010d870 con 0x7f1630102900 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.876+0000 7f1635a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f163010db70 con 0x7f1630107b60 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f16301008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f16301008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39340/0 (socket says 172.21.15.7:39340) 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 -- 172.21.15.7:0/3808075485 learned_addr learned my addr 172.21.15.7:0/3808075485 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162fe00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 0x7f1630102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f1635000640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1630107b60 0x7f1630100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 -- 172.21.15.7:0/3808075485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1630107b60 msgr2=0x7f1630100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1630107b60 0x7f1630100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 -- 172.21.15.7:0/3808075485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 msgr2=0x7f1630102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 0x7f1630102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162f400640 1 -- 172.21.15.7:0/3808075485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1630101680 con 0x7f1630105230 2024-04-23T14:51:07.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.877+0000 7f162fe00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 0x7f1630102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:07.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.878+0000 7f162f400640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f16301008b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f161c0314e0 tx=0x7f161c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.878+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c03f070 con 0x7f1630105230 2024-04-23T14:51:07.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.878+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f161c031e40 con 0x7f1630105230 2024-04-23T14:51:07.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.878+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16301a2150 con 0x7f1630105230 2024-04-23T14:51:07.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.878+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c035030 con 0x7f1630105230 2024-04-23T14:51:07.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.878+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16301a26a0 con 0x7f1630105230 2024-04-23T14:51:07.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.879+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16300fddc0 con 0x7f1630105230 2024-04-23T14:51:07.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.881+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f161c042070 con 0x7f1630105230 2024-04-23T14:51:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.883+0000 7f162cc00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f16140a3bb0 0x7f16140a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.884+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f161c0f1170 con 0x7f1630105230 2024-04-23T14:51:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.884+0000 7f162fe00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f16140a3bb0 0x7f16140a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.884+0000 7f162fe00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f16140a3bb0 0x7f16140a6070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b40 tx=0x7f1620005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:07.887+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f161c0bd770 con 0x7f1630105230 2024-04-23T14:51:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.134+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f163002d620 con 0x7f1630105230 2024-04-23T14:51:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.136+0000 7f162cc00640 1 -- 172.21.15.7:0/3808075485 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11926 (secure 0 0 0) 0x7f161c0bd070 con 0x7f1630105230 2024-04-23T14:51:08.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:51:08.137 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T14:48:53.850115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[34484,34526,34424,34448,24508]},"id":1}]} 2024-04-23T14:51:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-04-23T14:51:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.138+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f16140a3bb0 msgr2=0x7f16140a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.138+0000 7f1635a00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f16140a3bb0 0x7f16140a6070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b40 tx=0x7f1620005e50 comp rx=0 tx=0).stop 2024-04-23T14:51:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.138+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 msgr2=0x7f16301008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.138+0000 7f1635a00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f16301008b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f161c0314e0 tx=0x7f161c003c80 comp rx=0 tx=0).stop 2024-04-23T14:51:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 shutdown_connections 2024-04-23T14:51:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f16140a3bb0 0x7f16140a6070 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1630107b60 0x7f1630100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1630105230 0x7f16301008b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 --2- 172.21.15.7:0/3808075485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1630102900 0x7f1630102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 >> 172.21.15.7:0/3808075485 conn(0x7f16300fc2d0 msgr2=0x7f1630103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 shutdown_connections 2024-04-23T14:51:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.139+0000 7f1635a00640 1 -- 172.21.15.7:0/3808075485 wait complete. 2024-04-23T14:51:08.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:51:08.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1680248733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:51:08.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3838494363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:51:08.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3808075485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 -- 172.21.15.7:0/4090193096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0102b60 msgr2=0x7f81c0104f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 --2- 172.21.15.7:0/4090193096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0102b60 0x7f81c0104f50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009900 tx=0x7f81b002a410 comp rx=0 tx=0).stop 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 -- 172.21.15.7:0/4090193096 shutdown_connections 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 --2- 172.21.15.7:0/4090193096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81c0105490 0x7f81c0107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 --2- 172.21.15.7:0/4090193096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81c0107dc0 0x7f81c010a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 --2- 172.21.15.7:0/4090193096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0102b60 0x7f81c0104f50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 -- 172.21.15.7:0/4090193096 >> 172.21.15.7:0/4090193096 conn(0x7f81c00fc4f0 msgr2=0x7f81c00fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 -- 172.21.15.7:0/4090193096 shutdown_connections 2024-04-23T14:51:08.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.384+0000 7f81c5400640 1 -- 172.21.15.7:0/4090193096 wait complete. 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.385+0000 7f81c5400640 1 Processor -- start 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.385+0000 7f81c5400640 1 -- start start 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81c5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81c0102b60 0x7f81c01024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81c5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81c0105490 0x7f81c0100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81c5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 0x7f81c0101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81c5400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81c010dbf0 con 0x7f81c0107dc0 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81c5400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81c010da70 con 0x7f81c0102b60 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81c5400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f81c010dd70 con 0x7f81c0105490 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81bf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 0x7f81c0101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81bf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 0x7f81c0101050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39358/0 (socket says 172.21.15.7:39358) 2024-04-23T14:51:08.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81b7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81c0105490 0x7f81c0100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81bf200640 1 -- 172.21.15.7:0/258898878 learned_addr learned my addr 172.21.15.7:0/258898878 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.386+0000 7f81be800640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81c0102b60 0x7f81c01024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81bf200640 1 -- 172.21.15.7:0/258898878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81c0105490 msgr2=0x7f81c0100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81bf200640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81c0105490 0x7f81c0100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81bf200640 1 -- 172.21.15.7:0/258898878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81c0102b60 msgr2=0x7f81c01024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81bf200640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81c0102b60 0x7f81c01024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81bf200640 1 -- 172.21.15.7:0/258898878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c0101590 con 0x7f81c0107dc0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81bf200640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 0x7f81c0101050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f81b800eb10 tx=0x7f81b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8004b20 con 0x7f81c0107dc0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81b8004cc0 con 0x7f81c0107dc0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8010690 con 0x7f81c0107dc0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c0101880 con 0x7f81c0107dc0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.387+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c01a6d30 con 0x7f81c0107dc0 2024-04-23T14:51:08.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.389+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c00fdfe0 con 0x7f81c0107dc0 2024-04-23T14:51:08.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.391+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f81b8005020 con 0x7f81c0107dc0 2024-04-23T14:51:08.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.393+0000 7f81b7400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f81a40a3c30 0x7f81a40a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.393+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f81b80d0e10 con 0x7f81c0107dc0 2024-04-23T14:51:08.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.393+0000 7f81be800640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f81a40a3c30 0x7f81a40a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.394+0000 7f81be800640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f81a40a3c30 0x7f81a40a60f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81b00314e0 tx=0x7f81b0005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.397+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f81b80d4030 con 0x7f81c0107dc0 2024-04-23T14:51:08.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1680248733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:51:08.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3838494363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:51:08.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3808075485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:51:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.596+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81c0062ca0 con 0x7f81c0107dc0 2024-04-23T14:51:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.598+0000 7f81b7400640 1 -- 172.21.15.7:0/258898878 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24630 (secure 0 0 0) 0x7f81b809d410 con 0x7f81c0107dc0 2024-04-23T14:51:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T14:51:08.599 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T14:49:44.075188+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:51:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.600+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f81a40a3c30 msgr2=0x7f81a40a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.600+0000 7f81c5400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f81a40a3c30 0x7f81a40a60f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81b00314e0 tx=0x7f81b0005a20 comp rx=0 tx=0).stop 2024-04-23T14:51:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.600+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 msgr2=0x7f81c0101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.600+0000 7f81c5400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 0x7f81c0101050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f81b800eb10 tx=0x7f81b800c2d0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 shutdown_connections 2024-04-23T14:51:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f81a40a3c30 0x7f81a40a60f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81c0107dc0 0x7f81c0101050 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81c0105490 0x7f81c0100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 --2- 172.21.15.7:0/258898878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81c0102b60 0x7f81c01024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 >> 172.21.15.7:0/258898878 conn(0x7f81c00fc4f0 msgr2=0x7f81c01034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 shutdown_connections 2024-04-23T14:51:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.601+0000 7f81c5400640 1 -- 172.21.15.7:0/258898878 wait complete. 2024-04-23T14:51:08.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1680248733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T14:51:08.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3838494363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T14:51:08.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3808075485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:51:08.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-23T14:48:23.629029+0000', 'modified': '2024-04-23T14:48:53.850115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34526, 'mds_1': 34484, 'mds_2': 34448, 'mds_3': 34424, 'mds_4': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14628': {'gid': 14628, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6839/2766173942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 2766173942}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 2766173942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14640': {'gid': 14640, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/1212403180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 1212403180}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 1212403180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6833/156003904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 156003904}, {'type': 'v1', 'addr': '172.21.15.186:6833', 'nonce': 156003904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/77772242', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 77772242}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 77772242}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/2659046243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 2659046243}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 2659046243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.186:6839/4267150138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 4267150138}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 4267150138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34424': {'gid': 34424, 'name': 'k', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.137:6833/3754100416', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 3754100416}, {'type': 'v1', 'addr': '172.21.15.137:6833', 'nonce': 3754100416}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34448': {'gid': 34448, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.137:6835/2502711779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 2502711779}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 2502711779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34484': {'gid': 34484, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.137:6837/1247128385', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1247128385}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1247128385}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34526': {'gid': 34526, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6839/174749197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 174749197}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 174749197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34526, 'qdb_cluster': [34484, 34526, 34424, 34448, 24508]} 2024-04-23T14:51:08.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T14:51:08.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-23T14:51:08.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 -- 172.21.15.7:0/2243007223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9500102990 msgr2=0x7f9500104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 --2- 172.21.15.7:0/2243007223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9500102990 0x7f9500104d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009900 tx=0x7f94f002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 -- 172.21.15.7:0/2243007223 shutdown_connections 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 --2- 172.21.15.7:0/2243007223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95001052c0 0x7f95001076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 --2- 172.21.15.7:0/2243007223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9500107bf0 0x7f950010a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 --2- 172.21.15.7:0/2243007223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9500102990 0x7f9500104d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 -- 172.21.15.7:0/2243007223 >> 172.21.15.7:0/2243007223 conn(0x7f95000fc3a0 msgr2=0x7f95000fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 -- 172.21.15.7:0/2243007223 shutdown_connections 2024-04-23T14:51:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.822+0000 7f94ff200640 1 -- 172.21.15.7:0/2243007223 wait complete. 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 Processor -- start 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 -- start start 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9500102990 0x7f9500102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 0x7f9500100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9500107bf0 0x7f9500100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f950010dab0 con 0x7f95001052c0 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f950010d930 con 0x7f9500102990 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94ff200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f950010dc30 con 0x7f9500107bf0 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.823+0000 7f94f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 0x7f9500100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 0x7f9500100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39378/0 (socket says 172.21.15.7:39378) 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 -- 172.21.15.7:0/2477950851 learned_addr learned my addr 172.21.15.7:0/2477950851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94fde00640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9500102990 0x7f9500102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94fe800640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9500107bf0 0x7f9500100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 -- 172.21.15.7:0/2477950851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9500107bf0 msgr2=0x7f9500100e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9500107bf0 0x7f9500100e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 -- 172.21.15.7:0/2477950851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9500102990 msgr2=0x7f9500102300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9500102990 0x7f9500102300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 -- 172.21.15.7:0/2477950851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9500101710 con 0x7f95001052c0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f5400640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 0x7f9500100940 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f94e800c970 tx=0x7f94e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.824+0000 7f94f7400640 1 -- 172.21.15.7:0/2477950851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8014070 con 0x7f95001052c0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.825+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95001a2210 con 0x7f95001052c0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.825+0000 7f94f7400640 1 -- 172.21.15.7:0/2477950851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94e8004440 con 0x7f95001052c0 2024-04-23T14:51:08.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.825+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95001a2830 con 0x7f95001052c0 2024-04-23T14:51:08.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.825+0000 7f94f7400640 1 -- 172.21.15.7:0/2477950851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8003df0 con 0x7f95001052c0 2024-04-23T14:51:08.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 Processor -- start 2024-04-23T14:51:08.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 -- start start 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x56060130b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130bc50 0x560601310750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560601310dc0 0x560601313250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560601270b10 con 0x56060130b260 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5606012172b0 con 0x56060130bc50 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f9507796740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56060126cad0 con 0x560601310dc0 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f94fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x56060130b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f94fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x56060130b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39392/0 (socket says 172.21.15.7:39392) 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f94fe800640 1 -- 172.21.15.7:0/4098464764 learned_addr learned my addr 172.21.15.7:0/4098464764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.828+0000 7f94f7400640 1 -- 172.21.15.7:0/2477950851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f94e8017070 con 0x7f95001052c0 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fde00640 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130bc50 0x560601310750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fe800640 1 -- 172.21.15.7:0/4098464764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560601310dc0 msgr2=0x560601313250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fe800640 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560601310dc0 0x560601313250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fe800640 1 -- 172.21.15.7:0/4098464764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130bc50 msgr2=0x560601310750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fe800640 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130bc50 0x560601310750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fe800640 1 -- 172.21.15.7:0/4098464764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560600f832d0 con 0x56060130b260 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94fe800640 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x56060130b680 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009f20 tx=0x7f94f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7509232681a29cec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.829+0000 7f94ef000640 1 -- 172.21.15.7:0/4098464764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f801a070 con 0x56060130b260 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f94ef000640 1 -- 172.21.15.7:0/4098464764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94f80158c0 con 0x56060130b260 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f94ef000640 1 -- 172.21.15.7:0/4098464764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f800a7c0 con 0x56060130b260 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f94f7400640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f94e40a3bb0 0x7f94e40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 -- 172.21.15.7:0/4098464764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 msgr2=0x56060130b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x56060130b680 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009f20 tx=0x7f94f800c8b0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f94f7400640 1 -- 172.21.15.7:0/2477950851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f94e80d0350 con 0x7f95001052c0 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 -- 172.21.15.7:0/4098464764 shutdown_connections 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130bc50 0x560601310750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560601310dc0 0x560601313250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 --2- 172.21.15.7:0/4098464764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x56060130b680 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.830+0000 7f9507796740 1 -- 172.21.15.7:0/4098464764 >> 172.21.15.7:0/4098464764 conn(0x5606013068d0 msgr2=0x560601306cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.831+0000 7f94fde00640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f94e40a3bb0 0x7f94e40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.831+0000 7f9507796740 1 -- 172.21.15.7:0/4098464764 shutdown_connections 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.831+0000 7f9507796740 1 -- 172.21.15.7:0/4098464764 wait complete. 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.831+0000 7f9507796740 1 -- start start 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.831+0000 7f94fde00640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f94e40a3bb0 0x7f94e40a6070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x56060130c6c0 tx=0x7f94f00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.831+0000 7f9507796740 1 Processor -- start 2024-04-23T14:51:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601315770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x560601315cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060131cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560601313d70 con 0x560601310dc0 2024-04-23T14:51:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56060122a590 con 0x56060130b260 2024-04-23T14:51:08.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560601313ef0 con 0x56060130bc50 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f9507796740 10 client.0 _ll_register_callbacks cb 0x56060120d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f94fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060131cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f94fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060131cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39400/0 (socket says 172.21.15.7:39400) 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f94fe800640 1 -- 172.21.15.7:0/2615578309 learned_addr learned my addr 172.21.15.7:0/2615578309 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f94fde00640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601315770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.832+0000 7f94f5400640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x560601315cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94fe800640 1 -- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 msgr2=0x560601315cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94fe800640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x560601315cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94fe800640 1 -- 172.21.15.7:0/2615578309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 msgr2=0x560601315770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94fe800640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601315770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94fe800640 1 -- 172.21.15.7:0/2615578309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060104d6b0 con 0x560601310dc0 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94fe800640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060131cc80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009a90 tx=0x7f94f8015ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faaa62e7a5f3dab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94e3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94e3400640 1 -- 172.21.15.7:0/2615578309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f801a040 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f94e3400640 1 -- 172.21.15.7:0/2615578309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f94f800a5a0 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.833+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f80158c0 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f94e3400640 1 -- 172.21.15.7:0/2615578309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f94f802d050 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 10 client.15432 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56060131fff0 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f94e3400640 1 -- 172.21.15.7:0/2615578309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94f80158c0 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f94e3400640 1 -- 172.21.15.7:0/2615578309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f94f8028030 con 0x560601310dc0 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 10 client.15432 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 20 client.15432 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x560601322290 0x560601323700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 4 client.15432 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.834+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 --> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56060127e530 con 0x560601322290 2024-04-23T14:51:08.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.835+0000 7f94fde00640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x560601322290 0x560601323700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.836+0000 7f94fde00640 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x560601322290 0x560601323700 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8449ed2211b94511 server_cookie=ebf8786b5b7595c2 in_seq=0 out_seq=0 2024-04-23T14:51:08.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.836+0000 7f94e3400640 10 client.15432 ms_handle_connect on v2:172.21.15.186:6838/4267150138 2024-04-23T14:51:08.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f94e3400640 1 -- 172.21.15.7:0/2615578309 <== mds.4 v2:172.21.15.186:6838/4267150138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56060127e530 con 0x560601322290 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f94e3400640 10 client.15432 handle_command_reply: tid=0 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 client.15432 shutdown 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 msgr2=0x56060131cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060131cc80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009a90 tx=0x7f94f8015ca0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 shutdown_connections 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x560601322290 0x560601323700 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060131cc80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x560601315cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 --2- 172.21.15.7:0/2615578309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601315770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 >> 172.21.15.7:0/2615578309 conn(0x5606013068d0 msgr2=0x560601305970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f94e3400640 0 client.15432 ms_handle_reset on v2:172.21.15.186:6838/4267150138 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 shutdown_connections 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.838+0000 7f9507796740 1 -- 172.21.15.7:0/2615578309 wait complete. 2024-04-23T14:51:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.839+0000 7f9507796740 20 client.15432 trim_cache size 0 max 16384 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 Processor -- start 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 -- start start 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601323030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060130c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560601321a40 con 0x560601310dc0 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560601322110 con 0x56060130b260 2024-04-23T14:51:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f9507796740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5606013227e0 con 0x56060130bc50 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f94fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060130c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f94fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060130c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39406/0 (socket says 172.21.15.7:39406) 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.858+0000 7f94fe800640 1 -- 172.21.15.7:0/831236230 learned_addr learned my addr 172.21.15.7:0/831236230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94f5400640 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fde00640 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601323030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fe800640 1 -- 172.21.15.7:0/831236230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 msgr2=0x56060131cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fe800640 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fe800640 1 -- 172.21.15.7:0/831236230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 msgr2=0x560601323030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fe800640 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601323030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fe800640 1 -- 172.21.15.7:0/831236230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560601316610 con 0x560601310dc0 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94fe800640 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060130c6f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f94f8004b90 tx=0x7f94f80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207cef0c5270e217 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.859+0000 7f94ee600640 1 -- 172.21.15.7:0/831236230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f801a040 con 0x560601310dc0 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f94ee600640 1 -- 172.21.15.7:0/831236230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94f80158c0 con 0x560601310dc0 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f94ee600640 1 -- 172.21.15.7:0/831236230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8020560 con 0x560601310dc0 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 -- 172.21.15.7:0/831236230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 msgr2=0x56060130c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060130c6f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f94f8004b90 tx=0x7f94f80093b0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 -- 172.21.15.7:0/831236230 shutdown_connections 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560601310dc0 0x56060130c6f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 --2- 172.21.15.7:0/831236230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56060130b260 0x560601323030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 -- 172.21.15.7:0/831236230 >> 172.21.15.7:0/831236230 conn(0x5606013068d0 msgr2=0x560601306cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 -- 172.21.15.7:0/831236230 shutdown_connections 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.860+0000 7f9507796740 1 -- 172.21.15.7:0/831236230 wait complete. 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 -- start start 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 Processor -- start 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x560601305970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560601310dc0 0x560601386230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560601323580 con 0x56060130b260 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560601322eb0 con 0x560601310dc0 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560601323c50 con 0x56060130bc50 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.861+0000 7f9507796740 10 client.0 _ll_register_callbacks cb 0x7f94f80049e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:08.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x560601305970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x560601305970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39414/0 (socket says 172.21.15.7:39414) 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 -- 172.21.15.7:0/3926613783 learned_addr learned my addr 172.21.15.7:0/3926613783 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 -- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 msgr2=0x56060131cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94f5400640 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 -- 172.21.15.7:0/3926613783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560601310dc0 msgr2=0x560601386230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560601310dc0 0x560601386230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 -- 172.21.15.7:0/3926613783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560601386970 con 0x56060130b260 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94fde00640 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x560601305970 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f94f002a910 tx=0x7f94f0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38b75b983915d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.862+0000 7f94e3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f94e3400640 1 -- 172.21.15.7:0/3926613783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0035050 con 0x56060130b260 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f94e3400640 1 -- 172.21.15.7:0/3926613783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f94f0004390 con 0x56060130b260 2024-04-23T14:51:08.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f80158c0 con 0x56060130b260 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f94e3400640 1 -- 172.21.15.7:0/3926613783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f94f0061050 con 0x56060130b260 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f9507796740 10 client.15438 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560601387d40 con 0x56060130b260 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f94e3400640 1 -- 172.21.15.7:0/3926613783 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94f80158c0 con 0x56060130b260 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f94e3400640 1 -- 172.21.15.7:0/3926613783 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f94f0003850 con 0x56060130b260 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.863+0000 7f9507796740 10 client.15438 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.864+0000 7f9507796740 10 client.15438 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.864+0000 7f9507796740 20 client.15438 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.864+0000 7f9507796740 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x56060138c9a0 0x56060138b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.864+0000 7f9507796740 4 client.15438 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:51:08.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.864+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 --> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] -- command(tid 0: {"prefix": "status"}) -- 0x5606012783a0 con 0x56060138c9a0 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.864+0000 7f94f5400640 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x56060138c9a0 0x56060138b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.865+0000 7f94f5400640 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x56060138c9a0 0x56060138b6b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=483ab6f1ec9808a4 server_cookie=619df9fe0e98e9cc in_seq=0 out_seq=0 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.865+0000 7f94e3400640 10 client.15438 ms_handle_connect on v2:172.21.15.186:6838/4267150138 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f94e3400640 1 -- 172.21.15.7:0/3926613783 <== mds.4 v2:172.21.15.186:6838/4267150138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5606012783a0 con 0x56060138c9a0 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f94e3400640 10 client.15438 handle_command_reply: tid=0 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 client.15438 shutdown 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 msgr2=0x560601305970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x560601305970 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f94f002a910 tx=0x7f94f0009260 comp rx=0 tx=0).stop 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 shutdown_connections 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:6838/4267150138,v1:172.21.15.186:6839/4267150138] conn(0x56060138c9a0 0x56060138b6b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560601310dc0 0x560601386230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56060130bc50 0x56060131cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 --2- 172.21.15.7:0/3926613783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060130b260 0x560601305970 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f94e3400640 0 client.15438 ms_handle_reset on v2:172.21.15.186:6838/4267150138 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 >> 172.21.15.7:0/3926613783 conn(0x5606013068d0 msgr2=0x56060130c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 shutdown_connections 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 1 -- 172.21.15.7:0/3926613783 wait complete. 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.866+0000 7f9507796740 20 client.15438 trim_cache size 0 max 16384 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-04-23T14:51:08.870 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24508, 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 136.02386000499999, 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 184.044824635 2024-04-23T14:51:08.871 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:51:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f94e40a3bb0 msgr2=0x7f94e40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f94e40a3bb0 0x7f94e40a6070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x56060130c6c0 tx=0x7f94f00314a0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 msgr2=0x7f9500100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 0x7f9500100940 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f94e800c970 tx=0x7f94e800ce30 comp rx=0 tx=0).stop 2024-04-23T14:51:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 shutdown_connections 2024-04-23T14:51:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f94e40a3bb0 0x7f94e40a6070 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9500107bf0 0x7f9500100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95001052c0 0x7f9500100940 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 --2- 172.21.15.7:0/2477950851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9500102990 0x7f9500102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 >> 172.21.15.7:0/2477950851 conn(0x7f95000fc3a0 msgr2=0x7f95001032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 shutdown_connections 2024-04-23T14:51:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:08.867+0000 7f94ff200640 1 -- 172.21.15.7:0/2477950851 wait complete. 2024-04-23T14:51:08.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-04-23T14:51:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 -- 172.21.15.7:0/4220475200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8102ae0 msgr2=0x7fe5d8104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 --2- 172.21.15.7:0/4220475200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8102ae0 0x7fe5d8104ed0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009900 tx=0x7fe5c802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 -- 172.21.15.7:0/4220475200 shutdown_connections 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 --2- 172.21.15.7:0/4220475200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5d8107d40 0x7fe5d810a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 --2- 172.21.15.7:0/4220475200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 0x7fe5d8107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 --2- 172.21.15.7:0/4220475200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8102ae0 0x7fe5d8104ed0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 -- 172.21.15.7:0/4220475200 >> 172.21.15.7:0/4220475200 conn(0x7fe5d80fc4d0 msgr2=0x7fe5d80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 -- 172.21.15.7:0/4220475200 shutdown_connections 2024-04-23T14:51:09.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.073+0000 7fe5df800640 1 -- 172.21.15.7:0/4220475200 wait complete. 2024-04-23T14:51:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 Processor -- start 2024-04-23T14:51:09.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 -- start start 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5d8102ae0 0x7fe5d819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 0x7fe5d819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 0x7fe5d81a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8101f60 con 0x7fe5d8107d40 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8101de0 con 0x7fe5d8102ae0 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.074+0000 7fe5df800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81020e0 con 0x7fe5d8105410 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 0x7fe5d81a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 0x7fe5d81a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39422/0 (socket says 172.21.15.7:39422) 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 -- 172.21.15.7:0/2721516170 learned_addr learned my addr 172.21.15.7:0/2721516170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dce00640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5d8102ae0 0x7fe5d819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 0x7fe5d819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 -- 172.21.15.7:0/2721516170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 msgr2=0x7fe5d819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 0x7fe5d819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 -- 172.21.15.7:0/2721516170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5d8102ae0 msgr2=0x7fe5d819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5d8102ae0 0x7fe5d819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 -- 172.21.15.7:0/2721516170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d81a20e0 con 0x7fe5d8107d40 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 0x7fe5d819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.075+0000 7fe5dd800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 0x7fe5d81a1a70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000eaa0 tx=0x7fe5d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.076+0000 7fe5d6000640 1 -- 172.21.15.7:0/2721516170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000cdb0 con 0x7fe5d8107d40 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.076+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d81a23d0 con 0x7fe5d8107d40 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.076+0000 7fe5d6000640 1 -- 172.21.15.7:0/2721516170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5d0005020 con 0x7fe5d8107d40 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.076+0000 7fe5d6000640 1 -- 172.21.15.7:0/2721516170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d001f060 con 0x7fe5d8107d40 2024-04-23T14:51:09.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.076+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d81a2920 con 0x7fe5d8107d40 2024-04-23T14:51:09.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 Processor -- start 2024-04-23T14:51:09.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5d6000640 1 -- 172.21.15.7:0/2721516170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fe5d00051d0 con 0x7fe5d8107d40 2024-04-23T14:51:09.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 -- start start 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x5586812464b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x55868124b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55868124bbf0 0x55868124e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5586811abb10 con 0x558681246090 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5586811522b0 con 0x558681246a80 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.080+0000 7fe5e276f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5586811a7ad0 con 0x55868124bbf0 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5cfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x5586812464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5dce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x55868124b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5cfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x5586812464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39436/0 (socket says 172.21.15.7:39436) 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5cfe00640 1 -- 172.21.15.7:0/3582288153 learned_addr learned my addr 172.21.15.7:0/3582288153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55868124bbf0 0x55868124e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5dce00640 1 -- 172.21.15.7:0/3582288153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55868124bbf0 msgr2=0x55868124e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55868124bbf0 0x55868124e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5dce00640 1 -- 172.21.15.7:0/3582288153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 msgr2=0x5586812464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x5586812464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5dce00640 1 -- 172.21.15.7:0/3582288153 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558680ebe2d0 con 0x558681246a80 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.081+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55868124bbf0 0x55868124e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x55868124b580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80314e0 tx=0x7fe5c8031dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5418b80ef5fcee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5ce000640 1 -- 172.21.15.7:0/3582288153 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8035030 con 0x558681246a80 2024-04-23T14:51:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5d6000640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe5bc0a3bb0 0x7fe5bc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5ce000640 1 -- 172.21.15.7:0/3582288153 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5c8040070 con 0x558681246a80 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5ce000640 1 -- 172.21.15.7:0/3582288153 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003be0 con 0x558681246a80 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5d6000640 1 -- 172.21.15.7:0/2721516170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fe5d00d09a0 con 0x7fe5d8107d40 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.082+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe5bc0a3bb0 0x7fe5bc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 -- 172.21.15.7:0/3582288153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 msgr2=0x55868124b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x55868124b580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80314e0 tx=0x7fe5c8031dc0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe5bc0a3bb0 0x7fe5bc0a6070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5586812472e0 tx=0x7fe5c000c620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 -- 172.21.15.7:0/3582288153 shutdown_connections 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x55868124b580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55868124bbf0 0x55868124e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3582288153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x5586812464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 -- 172.21.15.7:0/3582288153 >> 172.21.15.7:0/3582288153 conn(0x558681241700 msgr2=0x558681241b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 -- 172.21.15.7:0/3582288153 shutdown_connections 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.083+0000 7fe5e276f740 1 -- 172.21.15.7:0/3582288153 wait complete. 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 -- start start 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 Processor -- start 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246090 0x558681250440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x558681250980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x5586812579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55868124eb40 con 0x55868124bbf0 2024-04-23T14:51:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558681165590 con 0x558681246a80 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55868124ecc0 con 0x558681246090 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.084+0000 7fe5e276f740 10 client.0 _ll_register_callbacks cb 0x5586811483a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x5586812579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x5586812579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39444/0 (socket says 172.21.15.7:39444) 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 -- 172.21.15.7:0/4291043654 learned_addr learned my addr 172.21.15.7:0/4291043654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dce00640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246090 0x558681250440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x558681250980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 -- 172.21.15.7:0/4291043654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246090 msgr2=0x558681250440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246090 0x558681250440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 -- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 msgr2=0x558681250980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x558681250980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 -- 172.21.15.7:0/4291043654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558680f886b0 con 0x55868124bbf0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5dd800640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x5586812579c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe5d009c830 tx=0x7fe5d009d0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52845fef9798651 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.085+0000 7fe5c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5c6a00640 1 -- 172.21.15.7:0/4291043654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00870b0 con 0x55868124bbf0 2024-04-23T14:51:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5c6a00640 1 -- 172.21.15.7:0/4291043654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fe5d0087250 con 0x55868124bbf0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c8040070 con 0x55868124bbf0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5c6a00640 1 -- 172.21.15.7:0/4291043654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5d009dbd0 con 0x55868124bbf0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5e276f740 10 client.15450 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55868125ad10 con 0x55868124bbf0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5c6a00640 1 -- 172.21.15.7:0/4291043654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5c8040070 con 0x55868124bbf0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5c6a00640 1 -- 172.21.15.7:0/4291043654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe5d000f040 con 0x55868124bbf0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.086+0000 7fe5e276f740 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.087+0000 7fe5e276f740 10 client.15450 resolve_mds: resolved name 'k' to daemon mds.k 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.087+0000 7fe5e276f740 20 client.15450 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.087+0000 7fe5e276f740 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x55868125d3b0 0x55868125e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.087+0000 7fe5e276f740 4 client.15450 mds_command: new command op to 34424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.087+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 --> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586811b9530 con 0x55868125d3b0 2024-04-23T14:51:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.087+0000 7fe5dce00640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x55868125d3b0 0x55868125e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.088+0000 7fe5dce00640 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x55868125d3b0 0x55868125e820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=67e180166bbc3cce server_cookie=28434de0944f10fe in_seq=0 out_seq=0 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.088+0000 7fe5c6a00640 10 client.15450 ms_handle_connect on v2:172.21.15.137:6832/3754100416 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.088+0000 7fe5c6a00640 1 -- 172.21.15.7:0/4291043654 <== mds.3 v2:172.21.15.137:6832/3754100416 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5586811b9530 con 0x55868125d3b0 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.088+0000 7fe5c6a00640 10 client.15450 handle_command_reply: tid=0 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.088+0000 7fe5e276f740 1 client.15450 shutdown 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 msgr2=0x5586812579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x5586812579c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe5d009c830 tx=0x7fe5d009d0e0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 shutdown_connections 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x55868125d3b0 0x55868125e820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246a80 0x558681250980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x5586812579c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 --2- 172.21.15.7:0/4291043654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246090 0x558681250440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5c6a00640 0 client.15450 ms_handle_reset on v2:172.21.15.137:6832/3754100416 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 >> 172.21.15.7:0/4291043654 conn(0x558681241700 msgr2=0x5586812408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 shutdown_connections 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 1 -- 172.21.15.7:0/4291043654 wait complete. 2024-04-23T14:51:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.089+0000 7fe5e276f740 20 client.15450 trim_cache size 0 max 16384 2024-04-23T14:51:09.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 Processor -- start 2024-04-23T14:51:09.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 -- start start 2024-04-23T14:51:09.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246090 0x55868124b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x558681257980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x558681247e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55868125cb60 con 0x55868124bbf0 2024-04-23T14:51:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55868125d230 con 0x558681246090 2024-04-23T14:51:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5e276f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55868125d900 con 0x558681246a80 2024-04-23T14:51:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.111+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x558681247e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x558681247e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39448/0 (socket says 172.21.15.7:39448) 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 -- 172.21.15.7:0/3053644739 learned_addr learned my addr 172.21.15.7:0/3053644739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246090 0x55868124b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 -- 172.21.15.7:0/3053644739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 msgr2=0x558681257980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x558681257980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 -- 172.21.15.7:0/3053644739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246090 msgr2=0x55868124b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246090 0x55868124b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.112+0000 7fe5dd800640 1 -- 172.21.15.7:0/3053644739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868123d060 con 0x55868124bbf0 2024-04-23T14:51:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.113+0000 7fe5dd800640 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x558681247e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0098d00 tx=0x7fe5d009adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadf78bb3f635384 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.113+0000 7fe5cd600640 1 -- 172.21.15.7:0/3053644739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00a0c50 con 0x55868124bbf0 2024-04-23T14:51:09.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.113+0000 7fe5cd600640 1 -- 172.21.15.7:0/3053644739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5d00985f0 con 0x55868124bbf0 2024-04-23T14:51:09.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.113+0000 7fe5cd600640 1 -- 172.21.15.7:0/3053644739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00982a0 con 0x55868124bbf0 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 -- 172.21.15.7:0/3053644739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 msgr2=0x558681247e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x558681247e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0098d00 tx=0x7fe5d009adb0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 -- 172.21.15.7:0/3053644739 shutdown_connections 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55868124bbf0 0x558681247e80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x558681257980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3053644739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558681246090 0x55868124b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 -- 172.21.15.7:0/3053644739 >> 172.21.15.7:0/3053644739 conn(0x558681241700 msgr2=0x55868123c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 -- 172.21.15.7:0/3053644739 shutdown_connections 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.114+0000 7fe5e276f740 1 -- 172.21.15.7:0/3053644739 wait complete. 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 -- start start 2024-04-23T14:51:09.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 Processor -- start 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x558681255970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x5586812bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 0x5586812c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55868125e6a0 con 0x558681246090 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55868125dfd0 con 0x55868124bbf0 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55868125ed70 con 0x558681246a80 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.115+0000 7fe5e276f740 10 client.0 _ll_register_callbacks cb 0x7fe5d009c290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x558681255970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 0x5586812c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 0x5586812c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:37882/0 (socket says 172.21.15.7:37882) 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dd800640 1 -- 172.21.15.7:0/3370700218 learned_addr learned my addr 172.21.15.7:0/3370700218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x5586812bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dce00640 1 -- 172.21.15.7:0/3370700218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 msgr2=0x5586812bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x5586812bf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dce00640 1 -- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 msgr2=0x5586812c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 0x5586812c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dce00640 1 -- 172.21.15.7:0/3370700218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586812c1e80 con 0x558681246090 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.116+0000 7fe5dd800640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 0x5586812c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.117+0000 7fe5dce00640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x558681255970 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x5586812425d0 tx=0x7fe5c8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429641aba30b08f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.117+0000 7fe5c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.117+0000 7fe5c6a00640 1 -- 172.21.15.7:0/3370700218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8056060 con 0x558681246090 2024-04-23T14:51:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.117+0000 7fe5c6a00640 1 -- 172.21.15.7:0/3370700218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fe5c803c850 con 0x558681246090 2024-04-23T14:51:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.117+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d00985f0 con 0x558681246090 2024-04-23T14:51:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.120+0000 7fe5c6a00640 1 -- 172.21.15.7:0/3370700218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5c805d050 con 0x558681246090 2024-04-23T14:51:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 10 client.15456 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5586812c3180 con 0x558681246090 2024-04-23T14:51:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5c6a00640 1 -- 172.21.15.7:0/3370700218 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5d00985f0 con 0x558681246090 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5c6a00640 1 -- 172.21.15.7:0/3370700218 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe5c8050600 con 0x558681246090 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 10 client.15456 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 10 client.15456 resolve_mds: resolved name 'k' to daemon mds.k 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 20 client.15456 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x5586812c7880 0x5586812c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 4 client.15456 mds_command: new command op to 34424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:51:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.121+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 --> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] -- command(tid 0: {"prefix": "status"}) -- 0x5586811b33a0 con 0x5586812c7880 2024-04-23T14:51:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.122+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x5586812c7880 0x5586812c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5cfe00640 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x5586812c7880 0x5586812c6590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5bf5487d190091b4 server_cookie=b3ff4721a9337a01 in_seq=0 out_seq=0 2024-04-23T14:51:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5c6a00640 10 client.15456 ms_handle_connect on v2:172.21.15.137:6832/3754100416 2024-04-23T14:51:09.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5c6a00640 1 -- 172.21.15.7:0/3370700218 <== mds.3 v2:172.21.15.137:6832/3754100416 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5586811b33a0 con 0x5586812c7880 2024-04-23T14:51:09.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5c6a00640 10 client.15456 handle_command_reply: tid=0 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5e276f740 1 client.15456 shutdown 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 msgr2=0x558681255970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.123+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x558681255970 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x5586812425d0 tx=0x7fe5c8005d50 comp rx=0 tx=0).stop 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 shutdown_connections 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:6832/3754100416,v1:172.21.15.137:6833/3754100416] conn(0x5586812c7880 0x5586812c6590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55868124bbf0 0x5586812c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558681246a80 0x5586812bf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 --2- 172.21.15.7:0/3370700218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558681246090 0x558681255970 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 >> 172.21.15.7:0/3370700218 conn(0x558681241700 msgr2=0x558681247e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5c6a00640 0 client.15456 ms_handle_reset on v2:172.21.15.137:6832/3754100416 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 shutdown_connections 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 1 -- 172.21.15.7:0/3370700218 wait complete. 2024-04-23T14:51:09.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.124+0000 7fe5e276f740 20 client.15456 trim_cache size 0 max 16384 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34424, 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 137.310438358, 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:51:09.126 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 212.82566687400001 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe5bc0a3bb0 msgr2=0x7fe5bc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe5bc0a3bb0 0x7fe5bc0a6070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5586812472e0 tx=0x7fe5c000c620 comp rx=0 tx=0).stop 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 msgr2=0x7fe5d81a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 0x7fe5d81a1a70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000eaa0 tx=0x7fe5d000ef60 comp rx=0 tx=0).stop 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 shutdown_connections 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fe5bc0a3bb0 0x7fe5bc0a6070 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5d8107d40 0x7fe5d81a1a70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5d8105410 0x7fe5d819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 --2- 172.21.15.7:0/2721516170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5d8102ae0 0x7fe5d819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 >> 172.21.15.7:0/2721516170 conn(0x7fe5d80fc4d0 msgr2=0x7fe5d8103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 shutdown_connections 2024-04-23T14:51:09.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.125+0000 7fe5df800640 1 -- 172.21.15.7:0/2721516170 wait complete. 2024-04-23T14:51:09.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T14:51:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 -- 172.21.15.7:0/1999255750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954104140 msgr2=0x7fb954104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 --2- 172.21.15.7:0/1999255750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954104140 0x7fb954104560 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb944009ca0 tx=0x7fb94402a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 -- 172.21.15.7:0/1999255750 shutdown_connections 2024-04-23T14:51:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 --2- 172.21.15.7:0/1999255750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb954105330 0x7fb9541057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 --2- 172.21.15.7:0/1999255750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb954105cf0 0x7fb95410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 --2- 172.21.15.7:0/1999255750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954104140 0x7fb954104560 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.319+0000 7fb953200640 1 -- 172.21.15.7:0/1999255750 >> 172.21.15.7:0/1999255750 conn(0x7fb9540ff6b0 msgr2=0x7fb954101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.320+0000 7fb953200640 1 -- 172.21.15.7:0/1999255750 shutdown_connections 2024-04-23T14:51:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.320+0000 7fb953200640 1 -- 172.21.15.7:0/1999255750 wait complete. 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 Processor -- start 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 -- start start 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb954104140 0x7fb95419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb954105330 0x7fb95419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 0x7fb9541a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb95410fc80 con 0x7fb954105cf0 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb95410fb00 con 0x7fb954104140 2024-04-23T14:51:09.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb953200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb95410fe00 con 0x7fb954105330 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb952800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 0x7fb9541a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb952800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 0x7fb9541a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39478/0 (socket says 172.21.15.7:39478) 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb952800640 1 -- 172.21.15.7:0/1707127039 learned_addr learned my addr 172.21.15.7:0/1707127039 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.321+0000 7fb951400640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb954105330 0x7fb95419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb951e00640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb954104140 0x7fb95419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb952800640 1 -- 172.21.15.7:0/1707127039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb954105330 msgr2=0x7fb95419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb952800640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb954105330 0x7fb95419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb952800640 1 -- 172.21.15.7:0/1707127039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb954104140 msgr2=0x7fb95419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb952800640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb954104140 0x7fb95419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb952800640 1 -- 172.21.15.7:0/1707127039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9541a1f80 con 0x7fb954105cf0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb952800640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 0x7fb9541a1910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00e970 tx=0x7fb94c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb94aa00640 1 -- 172.21.15.7:0/1707127039 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00ccc0 con 0x7fb954105cf0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb94aa00640 1 -- 172.21.15.7:0/1707127039 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb94c00ce60 con 0x7fb954105cf0 2024-04-23T14:51:09.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9541a2270 con 0x7fb954105cf0 2024-04-23T14:51:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb94aa00640 1 -- 172.21.15.7:0/1707127039 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c010430 con 0x7fb954105cf0 2024-04-23T14:51:09.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.322+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9541a27c0 con 0x7fb954105cf0 2024-04-23T14:51:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.325+0000 7fb95bf97740 1 Processor -- start 2024-04-23T14:51:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.325+0000 7fb94aa00640 1 -- 172.21.15.7:0/1707127039 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fb94c004f90 con 0x7fb954105cf0 2024-04-23T14:51:09.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 -- start start 2024-04-23T14:51:09.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c8a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c8f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c92250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db09befb10 con 0x55db09c8fdc0 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55db09b962b0 con 0x55db09c8ac50 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb95bf97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55db09bebad0 con 0x55db09c8a260 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb951400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c92250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb951400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c92250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39490/0 (socket says 172.21.15.7:39490) 2024-04-23T14:51:09.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.326+0000 7fb951400640 1 -- 172.21.15.7:0/2887278337 learned_addr learned my addr 172.21.15.7:0/2887278337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951e00640 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c8f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 -- 172.21.15.7:0/2887278337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 msgr2=0x55db09c8a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb94aa00640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb9380a3bb0 0x7fb9380a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c8a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 -- 172.21.15.7:0/2887278337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 msgr2=0x55db09c8f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c8f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 -- 172.21.15.7:0/2887278337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db099022d0 con 0x55db09c8fdc0 2024-04-23T14:51:09.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb94aa00640 1 -- 172.21.15.7:0/1707127039 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fb94c0d0ca0 con 0x7fb954105cf0 2024-04-23T14:51:09.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb952800640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb9380a3bb0 0x7fb9380a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.327+0000 7fb951400640 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c92250 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb93c012750 tx=0x7fb93c0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c2ebb570f8ceb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb943400640 1 -- 172.21.15.7:0/2887278337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c012cd0 con 0x55db09c8fdc0 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb943400640 1 -- 172.21.15.7:0/2887278337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb93c0107d0 con 0x55db09c8fdc0 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb943400640 1 -- 172.21.15.7:0/2887278337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c003850 con 0x55db09c8fdc0 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 -- 172.21.15.7:0/2887278337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 msgr2=0x55db09c92250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c92250 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb93c012750 tx=0x7fb93c0096e0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb952800640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb9380a3bb0 0x7fb9380a6070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000c00 tx=0x7fb94c009720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 -- 172.21.15.7:0/2887278337 shutdown_connections 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c8f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c92250 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2887278337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c8a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.328+0000 7fb95bf97740 1 -- 172.21.15.7:0/2887278337 >> 172.21.15.7:0/2887278337 conn(0x55db09c858d0 msgr2=0x55db09c85cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.329+0000 7fb95bf97740 1 -- 172.21.15.7:0/2887278337 shutdown_connections 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.329+0000 7fb95bf97740 1 -- 172.21.15.7:0/2887278337 wait complete. 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.329+0000 7fb95bf97740 1 -- start start 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.329+0000 7fb95bf97740 1 Processor -- start 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c946b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c94bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c9bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db09c92d70 con 0x55db09c8fdc0 2024-04-23T14:51:09.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55db09ba9590 con 0x55db09c8ac50 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55db09c92ef0 con 0x55db09c8a260 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb95bf97740 10 client.0 _ll_register_callbacks cb 0x55db09b8c3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c9bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c9bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39502/0 (socket says 172.21.15.7:39502) 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 -- 172.21.15.7:0/3354353990 learned_addr learned my addr 172.21.15.7:0/3354353990 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951e00640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c94bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 -- 172.21.15.7:0/3354353990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 msgr2=0x55db09c946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c946b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 -- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 msgr2=0x55db09c94bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c94bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.330+0000 7fb951400640 1 -- 172.21.15.7:0/3354353990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db099cc6b0 con 0x55db09c8fdc0 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb951400640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c9bc30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb93c010f60 tx=0x7fb93c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778f230cce518ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb937e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb937e00640 1 -- 172.21.15.7:0/3354353990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c031060 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb937e00640 1 -- 172.21.15.7:0/3354353990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fb93c020b30 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb93c0107d0 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb937e00640 1 -- 172.21.15.7:0/3354353990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb93c020d30 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb95bf97740 10 client.15468 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.331+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55db09c9efa0 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb937e00640 1 -- 172.21.15.7:0/3354353990 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb93c0107d0 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb937e00640 1 -- 172.21.15.7:0/3354353990 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb93c00e3b0 con 0x55db09c8fdc0 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb95bf97740 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb95bf97740 10 client.15468 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb95bf97740 20 client.15468 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb95bf97740 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09ca11b0 0x55db09ca2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb95bf97740 4 client.15468 mds_command: new command op to 34448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:09.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.332+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 --> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db09bfd530 con 0x55db09ca11b0 2024-04-23T14:51:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.333+0000 7fb951e00640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09ca11b0 0x55db09ca2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.334+0000 7fb951e00640 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09ca11b0 0x55db09ca2620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48e4f9fdbe1e4d25 server_cookie=16b9f3aeb973568d in_seq=0 out_seq=0 2024-04-23T14:51:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.334+0000 7fb937e00640 10 client.15468 ms_handle_connect on v2:172.21.15.137:6834/2502711779 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.335+0000 7fb937e00640 1 -- 172.21.15.7:0/3354353990 <== mds.2 v2:172.21.15.137:6834/2502711779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55db09bfd530 con 0x55db09ca11b0 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.335+0000 7fb937e00640 10 client.15468 handle_command_reply: tid=0 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 client.15468 shutdown 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 msgr2=0x55db09c9bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c9bc30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb93c010f60 tx=0x7fb93c017040 comp rx=0 tx=0).stop 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 shutdown_connections 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09ca11b0 0x55db09ca2620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8ac50 0x55db09c94bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8fdc0 0x55db09c9bc30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 --2- 172.21.15.7:0/3354353990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c946b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb937e00640 0 client.15468 ms_handle_reset on v2:172.21.15.137:6834/2502711779 2024-04-23T14:51:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 >> 172.21.15.7:0/3354353990 conn(0x55db09c858d0 msgr2=0x55db09c84970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 shutdown_connections 2024-04-23T14:51:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 1 -- 172.21.15.7:0/3354353990 wait complete. 2024-04-23T14:51:09.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.336+0000 7fb95bf97740 20 client.15468 trim_cache size 0 max 16384 2024-04-23T14:51:09.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.356+0000 7fb95bf97740 1 Processor -- start 2024-04-23T14:51:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 -- start start 2024-04-23T14:51:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8a260 0x55db09c80800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 0x55db09c9bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c8c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db09ca0960 con 0x55db09c8a260 2024-04-23T14:51:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55db09ca1030 con 0x55db09c8fdc0 2024-04-23T14:51:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.357+0000 7fb95bf97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55db09ca1700 con 0x55db09c8ac50 2024-04-23T14:51:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 0x55db09c9bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 0x55db09c9bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46354/0 (socket says 172.21.15.7:46354) 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 -- 172.21.15.7:0/2273082933 learned_addr learned my addr 172.21.15.7:0/2273082933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951400640 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8a260 0x55db09c80800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951400640 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c8c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 -- 172.21.15.7:0/2273082933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 msgr2=0x55db09c8c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c8c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 -- 172.21.15.7:0/2273082933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8a260 msgr2=0x55db09c80800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8a260 0x55db09c80800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951e00640 1 -- 172.21.15.7:0/2273082933 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db09c85700 con 0x55db09c8ac50 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.358+0000 7fb951400640 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8a260 0x55db09c80800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.359+0000 7fb951e00640 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 0x55db09c9bb50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb944009a60 tx=0x7fb9440093f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1177811b33d72fe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.359+0000 7fb942a00640 1 -- 172.21.15.7:0/2273082933 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944031750 con 0x55db09c8ac50 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.359+0000 7fb942a00640 1 -- 172.21.15.7:0/2273082933 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb94404d070 con 0x55db09c8ac50 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.359+0000 7fb942a00640 1 -- 172.21.15.7:0/2273082933 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944004500 con 0x55db09c8ac50 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 -- 172.21.15.7:0/2273082933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 msgr2=0x55db09c9bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 0x55db09c9bb50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb944009a60 tx=0x7fb9440093f0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 -- 172.21.15.7:0/2273082933 shutdown_connections 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c8c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8ac50 0x55db09c9bb50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 --2- 172.21.15.7:0/2273082933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8a260 0x55db09c80800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 -- 172.21.15.7:0/2273082933 >> 172.21.15.7:0/2273082933 conn(0x55db09c858d0 msgr2=0x55db09c85cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 -- 172.21.15.7:0/2273082933 shutdown_connections 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.360+0000 7fb95bf97740 1 -- 172.21.15.7:0/2273082933 wait complete. 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 -- start start 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 Processor -- start 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c973a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 0x55db09c978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c9a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55db09ca24a0 con 0x55db09c8ac50 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55db09ca1dd0 con 0x55db09c8fdc0 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55db09ca2b70 con 0x55db09c8a260 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb95bf97740 10 client.0 _ll_register_callbacks cb 0x7fb93c010e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.361+0000 7fb951e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 0x55db09c978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 0x55db09c978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39520/0 (socket says 172.21.15.7:39520) 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 -- 172.21.15.7:0/4076422740 learned_addr learned my addr 172.21.15.7:0/4076422740 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951400640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951400640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c9a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 -- 172.21.15.7:0/4076422740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 msgr2=0x55db09c973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 -- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 msgr2=0x55db09c9a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c9a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 -- 172.21.15.7:0/4076422740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db09c866c0 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951400640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb951e00640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 0x55db09c978e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb944000f80 tx=0x7fb944009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23043abcc9481734 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.362+0000 7fb937e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb937e00640 1 -- 172.21.15.7:0/4076422740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94405f060 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb937e00640 1 -- 172.21.15.7:0/4076422740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fb944031d40 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb94404d070 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb937e00640 1 -- 172.21.15.7:0/4076422740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb944003970 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 10 client.15474 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55db09c9bf50 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb937e00640 1 -- 172.21.15.7:0/4076422740 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb94404d070 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb937e00640 1 -- 172.21.15.7:0/4076422740 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb944045070 con 0x55db09c8ac50 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 10 client.15474 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 10 client.15474 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T14:51:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 20 client.15474 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09d0b740 0x55db09d0a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 4 client.15474 mds_command: new command op to 34448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:51:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.363+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 --> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] -- command(tid 0: {"prefix": "status"}) -- 0x55db09bf73a0 con 0x55db09d0b740 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.364+0000 7fb951400640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09d0b740 0x55db09d0a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.365+0000 7fb951400640 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09d0b740 0x55db09d0a450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa394dd28765f225 server_cookie=65350d7f6742e94 in_seq=0 out_seq=0 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.365+0000 7fb937e00640 10 client.15474 ms_handle_connect on v2:172.21.15.137:6834/2502711779 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.365+0000 7fb937e00640 1 -- 172.21.15.7:0/4076422740 <== mds.2 v2:172.21.15.137:6834/2502711779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55db09bf73a0 con 0x55db09d0b740 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.365+0000 7fb937e00640 10 client.15474 handle_command_reply: tid=0 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.365+0000 7fb95bf97740 1 client.15474 shutdown 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 msgr2=0x55db09c978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 0x55db09c978e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb944000f80 tx=0x7fb944009880 comp rx=0 tx=0).stop 2024-04-23T14:51:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 shutdown_connections 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:6834/2502711779,v1:172.21.15.137:6835/2502711779] conn(0x55db09d0b740 0x55db09d0a450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db09c8fdc0 0x55db09c9a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55db09c8ac50 0x55db09c978e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb937e00640 0 client.15474 ms_handle_reset on v2:172.21.15.137:6834/2502711779 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 --2- 172.21.15.7:0/4076422740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55db09c8a260 0x55db09c973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 >> 172.21.15.7:0/4076422740 conn(0x55db09c858d0 msgr2=0x55db09c8b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 shutdown_connections 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 1 -- 172.21.15.7:0/4076422740 wait complete. 2024-04-23T14:51:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.366+0000 7fb95bf97740 20 client.15474 trim_cache size 0 max 16384 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34448, 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 138.56277373099999, 2024-04-23T14:51:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 200.782307463 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb9380a3bb0 msgr2=0x7fb9380a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb9380a3bb0 0x7fb9380a6070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000c00 tx=0x7fb94c009720 comp rx=0 tx=0).stop 2024-04-23T14:51:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 msgr2=0x7fb9541a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 0x7fb9541a1910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00e970 tx=0x7fb94c00ed70 comp rx=0 tx=0).stop 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 shutdown_connections 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fb9380a3bb0 0x7fb9380a6070 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb954105cf0 0x7fb9541a1910 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb954105330 0x7fb95419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 --2- 172.21.15.7:0/1707127039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb954104140 0x7fb95419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 >> 172.21.15.7:0/1707127039 conn(0x7fb9540ff6b0 msgr2=0x7fb954108750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 shutdown_connections 2024-04-23T14:51:09.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.367+0000 7fb953200640 1 -- 172.21.15.7:0/1707127039 wait complete. 2024-04-23T14:51:09.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-23T14:51:09.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:09.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:09 smithi137 ceph-mon[31694]: pgmap v456: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:51:09.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:09 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/258898878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:09.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:51:09.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:09 smithi137 ceph-mon[31694]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:51:09.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:09.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:09 smithi007 ceph-mon[27906]: pgmap v456: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:51:09.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:09 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/258898878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:09.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:51:09.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:09 smithi007 ceph-mon[27906]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:51:09.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 -- 172.21.15.7:0/1378017787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280103a40 msgr2=0x7fa28010a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 --2- 172.21.15.7:0/1378017787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280103a40 0x7fa28010a360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa278009ca0 tx=0x7fa27802a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 -- 172.21.15.7:0/1378017787 shutdown_connections 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 --2- 172.21.15.7:0/1378017787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280103a40 0x7fa28010a360 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 --2- 172.21.15.7:0/1378017787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa280103080 0x7fa280103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 --2- 172.21.15.7:0/1378017787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280101f30 0x7fa280102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 -- 172.21.15.7:0/1378017787 >> 172.21.15.7:0/1378017787 conn(0x7fa2800fd4a0 msgr2=0x7fa2800ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 -- 172.21.15.7:0/1378017787 shutdown_connections 2024-04-23T14:51:09.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.581+0000 7fa285c00640 1 -- 172.21.15.7:0/1378017787 wait complete. 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.582+0000 7fa285c00640 1 Processor -- start 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.582+0000 7fa285c00640 1 -- start start 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 0x7fa280075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa280103080 0x7fa2800743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280103a40 0x7fa280074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010dae0 con 0x7fa280101f30 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010d960 con 0x7fa280103a40 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010dc60 con 0x7fa280103080 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 0x7fa280075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 0x7fa280075db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39536/0 (socket says 172.21.15.7:39536) 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa27fe00640 1 -- 172.21.15.7:0/2916598829 learned_addr learned my addr 172.21.15.7:0/2916598829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa285200640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280103a40 0x7fa280074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.583+0000 7fa277e00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa280103080 0x7fa2800743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27fe00640 1 -- 172.21.15.7:0/2916598829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa280103080 msgr2=0x7fa2800743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa280103080 0x7fa2800743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27fe00640 1 -- 172.21.15.7:0/2916598829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280103a40 msgr2=0x7fa280074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280103a40 0x7fa280074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27fe00640 1 -- 172.21.15.7:0/2916598829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2800751c0 con 0x7fa280101f30 2024-04-23T14:51:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 0x7fa280075db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa27000d950 tx=0x7fa27000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27d600640 1 -- 172.21.15.7:0/2916598829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270017070 con 0x7fa280101f30 2024-04-23T14:51:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2801a21e0 con 0x7fa280101f30 2024-04-23T14:51:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa27d600640 1 -- 172.21.15.7:0/2916598829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa270009c30 con 0x7fa280101f30 2024-04-23T14:51:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.584+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a2730 con 0x7fa280101f30 2024-04-23T14:51:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.585+0000 7fa27d600640 1 -- 172.21.15.7:0/2916598829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270020060 con 0x7fa280101f30 2024-04-23T14:51:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.587+0000 7fa28a1c4740 1 Processor -- start 2024-04-23T14:51:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 -- start start 2024-04-23T14:51:09.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d84590680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84595750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84598250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d844f5b10 con 0x562d84590260 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d8449c2b0 con 0x562d84595dc0 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562d844f1ad0 con 0x562d84590c50 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa285200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d84590680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa285200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d84590680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39544/0 (socket says 172.21.15.7:39544) 2024-04-23T14:51:09.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.588+0000 7fa285200640 1 -- 172.21.15.7:0/1780367899 learned_addr learned my addr 172.21.15.7:0/1780367899 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa285200640 1 -- 172.21.15.7:0/1780367899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 msgr2=0x562d84595750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa285200640 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84595750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa285200640 1 -- 172.21.15.7:0/1780367899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 msgr2=0x562d84598250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa277e00640 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84598250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa285200640 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84598250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa285200640 1 -- 172.21.15.7:0/1780367899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d842082d0 con 0x562d84590260 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa277e00640 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84598250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa285200640 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d84590680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa27802f3a0 tx=0x7fa278009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac2c8c4890d52a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa27d600640 1 -- 172.21.15.7:0/2916598829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7fa2700109a0 con 0x7fa280101f30 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa275600640 1 -- 172.21.15.7:0/1780367899 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780316d0 con 0x562d84590260 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.589+0000 7fa275600640 1 -- 172.21.15.7:0/1780367899 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa278036040 con 0x562d84590260 2024-04-23T14:51:09.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 -- 172.21.15.7:0/1780367899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 msgr2=0x562d84590680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d84590680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa27802f3a0 tx=0x7fa278009a20 comp rx=0 tx=0).stop 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 -- 172.21.15.7:0/1780367899 shutdown_connections 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84598250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84595750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/1780367899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d84590680 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 -- 172.21.15.7:0/1780367899 >> 172.21.15.7:0/1780367899 conn(0x562d8458b8d0 msgr2=0x562d8458bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 -- 172.21.15.7:0/1780367899 shutdown_connections 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.590+0000 7fa28a1c4740 1 -- 172.21.15.7:0/1780367899 wait complete. 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa28a1c4740 1 -- start start 2024-04-23T14:51:09.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa27d600640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa2640a3a70 0x7fa2640a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa28a1c4740 1 Processor -- start 2024-04-23T14:51:09.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa27d600640 1 -- 172.21.15.7:0/2916598829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa2700d07f0 con 0x7fa280101f30 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa285200640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa2640a3a70 0x7fa2640a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590260 0x562d8459a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 0x562d8459ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.591+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d845a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d84598d60 con 0x562d84590c50 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d844af590 con 0x562d84595dc0 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562d84598ee0 con 0x562d84590260 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa28a1c4740 10 client.0 _ll_register_callbacks cb 0x562d844923a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 0x562d8459ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 0x562d8459ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39560/0 (socket says 172.21.15.7:39560) 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 -- 172.21.15.7:0/3517429689 learned_addr learned my addr 172.21.15.7:0/3517429689 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa285200640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa2640a3a70 0x7fa2640a5f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa278009430 tx=0x7fa27803e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa27fe00640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590260 0x562d8459a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa285200640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d845a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 -- 172.21.15.7:0/3517429689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590260 msgr2=0x562d8459a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590260 0x562d8459a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 -- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 msgr2=0x562d845a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d845a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa277e00640 1 -- 172.21.15.7:0/3517429689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d842d26b0 con 0x562d84590c50 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.592+0000 7fa285200640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d845a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa277e00640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 0x562d8459ab40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa268010670 tx=0x7fa268010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b53f8ad9e93b9f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa26e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa26e000640 1 -- 172.21.15.7:0/3517429689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26800ea70 con 0x562d84590c50 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa26e000640 1 -- 172.21.15.7:0/3517429689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa26800ec10 con 0x562d84590c50 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa278036040 con 0x562d84590c50 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa26e000640 1 -- 172.21.15.7:0/3517429689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa268025050 con 0x562d84590c50 2024-04-23T14:51:09.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa28a1c4740 10 client.15486 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.593+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562d845a4f80 con 0x562d84590c50 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa26e000640 1 -- 172.21.15.7:0/3517429689 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa278036040 con 0x562d84590c50 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa26e000640 1 -- 172.21.15.7:0/3517429689 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa26800f040 con 0x562d84590c50 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa28a1c4740 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa28a1c4740 10 client.15486 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa28a1c4740 20 client.15486 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d845a7610 0x562d845a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa28a1c4740 4 client.15486 mds_command: new command op to 34484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.594+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 --> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d84503530 con 0x562d845a7610 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.595+0000 7fa27fe00640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d845a7610 0x562d845a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.595+0000 7fa27fe00640 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d845a7610 0x562d845a8a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6326ef18159c12e3 server_cookie=bc87f27d10651f5b in_seq=0 out_seq=0 2024-04-23T14:51:09.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.595+0000 7fa26e000640 10 client.15486 ms_handle_connect on v2:172.21.15.137:6836/1247128385 2024-04-23T14:51:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.597+0000 7fa26e000640 1 -- 172.21.15.7:0/3517429689 <== mds.1 v2:172.21.15.137:6836/1247128385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d84503530 con 0x562d845a7610 2024-04-23T14:51:09.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.597+0000 7fa26e000640 10 client.15486 handle_command_reply: tid=0 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.597+0000 7fa28a1c4740 1 client.15486 shutdown 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 msgr2=0x562d8459ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 0x562d8459ab40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa268010670 tx=0x7fa268010b30 comp rx=0 tx=0).stop 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 shutdown_connections 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d845a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d845a7610 0x562d845a8a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590c50 0x562d8459ab40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/3517429689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590260 0x562d8459a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 >> 172.21.15.7:0/3517429689 conn(0x562d8458b8d0 msgr2=0x562d8458a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa26e000640 0 client.15486 ms_handle_reset on v2:172.21.15.137:6836/1247128385 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 shutdown_connections 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 1 -- 172.21.15.7:0/3517429689 wait complete. 2024-04-23T14:51:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.598+0000 7fa28a1c4740 20 client.15486 trim_cache size 0 max 16384 2024-04-23T14:51:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:09 smithi186 ceph-mon[31814]: pgmap v456: 129 pgs: 129 active+clean; 646 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T14:51:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:09 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/258898878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:51:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:51:09.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:09 smithi186 ceph-mon[31814]: from='mgr.14152 172.21.15.7:0/4193898340' entity='mgr.x' 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.618+0000 7fa28a1c4740 1 Processor -- start 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 -- start start 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d845981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d845a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84595650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d845a6dc0 con 0x562d84590260 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d845a7490 con 0x562d84595dc0 2024-04-23T14:51:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562d845a7b60 con 0x562d84590c50 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d845981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d845981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39564/0 (socket says 172.21.15.7:39564) 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.619+0000 7fa27fe00640 1 -- 172.21.15.7:0/2858830020 learned_addr learned my addr 172.21.15.7:0/2858830020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa285200640 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84595650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa277e00640 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d845a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa27fe00640 1 -- 172.21.15.7:0/2858830020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 msgr2=0x562d845a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d845a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa27fe00640 1 -- 172.21.15.7:0/2858830020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 msgr2=0x562d84595650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84595650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa27fe00640 1 -- 172.21.15.7:0/2858830020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d845a8db0 con 0x562d84590260 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d845981b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa2700cdfc0 tx=0x7fa27000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0d3ed442fbf9e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa274c00640 1 -- 172.21.15.7:0/2858830020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700ba070 con 0x562d84590260 2024-04-23T14:51:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa274c00640 1 -- 172.21.15.7:0/2858830020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa27009c750 con 0x562d84590260 2024-04-23T14:51:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.620+0000 7fa274c00640 1 -- 172.21.15.7:0/2858830020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270014030 con 0x562d84590260 2024-04-23T14:51:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2858830020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 msgr2=0x562d845981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d845981b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa2700cdfc0 tx=0x7fa27000bf60 comp rx=0 tx=0).stop 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2858830020 shutdown_connections 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84595dc0 0x562d84595650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d845a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2858830020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84590260 0x562d845981b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2858830020 >> 172.21.15.7:0/2858830020 conn(0x562d8458b8d0 msgr2=0x562d8458bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2858830020 shutdown_connections 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.621+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2858830020 wait complete. 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 -- start start 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 Processor -- start 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84590260 0x562d845940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84594610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 0x562d845a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d845a8900 con 0x562d84595dc0 2024-04-23T14:51:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d845a8230 con 0x562d84590260 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562d845a8fd0 con 0x562d84590c50 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.622+0000 7fa28a1c4740 10 client.0 _ll_register_callbacks cb 0x7fa26800bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 0x562d845a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 0x562d845a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39576/0 (socket says 172.21.15.7:39576) 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 -- 172.21.15.7:0/2734279553 learned_addr learned my addr 172.21.15.7:0/2734279553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84590260 0x562d845940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa277e00640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84594610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 -- 172.21.15.7:0/2734279553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 msgr2=0x562d84594610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84594610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 -- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84590260 msgr2=0x562d845940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84590260 0x562d845940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 -- 172.21.15.7:0/2734279553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d845a0770 con 0x562d84595dc0 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa285200640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 0x562d845a0130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa278000f80 tx=0x7fa278009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30993024efeb8ed8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.623+0000 7fa26e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa26e000640 1 -- 172.21.15.7:0/2734279553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278061060 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27009c750 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa26e000640 1 -- 172.21.15.7:0/2734279553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7fa278031d40 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa26e000640 1 -- 172.21.15.7:0/2734279553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa27804a040 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa28a1c4740 10 client.15492 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562d845a1a30 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.624+0000 7fa26e000640 1 -- 172.21.15.7:0/2734279553 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa27009c750 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa26e000640 1 -- 172.21.15.7:0/2734279553 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa27805b070 con 0x562d84595dc0 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa28a1c4740 10 client.15492 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa28a1c4740 10 client.15492 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T14:51:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa28a1c4740 20 client.15492 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d84611760 0x562d84610470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa28a1c4740 4 client.15492 mds_command: new command op to 34484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 --> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] -- command(tid 0: {"prefix": "status"}) -- 0x562d844fd3a0 con 0x562d84611760 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.625+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d84611760 0x562d84610470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.626+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d84611760 0x562d84610470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e31c29430f6270 server_cookie=df329093e49cfc37 in_seq=0 out_seq=0 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.626+0000 7fa26e000640 10 client.15492 ms_handle_connect on v2:172.21.15.137:6836/1247128385 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa26e000640 1 -- 172.21.15.7:0/2734279553 <== mds.1 v2:172.21.15.137:6836/1247128385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562d844fd3a0 con 0x562d84611760 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa26e000640 10 client.15492 handle_command_reply: tid=0 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 client.15492 shutdown 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 msgr2=0x562d845a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 0x562d845a0130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa278000f80 tx=0x7fa278009a20 comp rx=0 tx=0).stop 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 shutdown_connections 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:6836/1247128385,v1:172.21.15.137:6837/1247128385] conn(0x562d84611760 0x562d84610470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d84595dc0 0x562d845a0130 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d84590c50 0x562d84594610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 --2- 172.21.15.7:0/2734279553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d84590260 0x562d845940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa26e000640 0 client.15492 ms_handle_reset on v2:172.21.15.137:6836/1247128385 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 >> 172.21.15.7:0/2734279553 conn(0x562d8458b8d0 msgr2=0x562d84586800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 shutdown_connections 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 1 -- 172.21.15.7:0/2734279553 wait complete. 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.627+0000 7fa28a1c4740 20 client.15492 trim_cache size 0 max 16384 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-04-23T14:51:09.630 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34484, 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 139.85038377399999, 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 188.95364148499999 2024-04-23T14:51:09.631 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa2640a3a70 msgr2=0x7fa2640a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa2640a3a70 0x7fa2640a5f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa278009430 tx=0x7fa27803e040 comp rx=0 tx=0).stop 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 msgr2=0x7fa280075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 0x7fa280075db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa27000d950 tx=0x7fa27000de10 comp rx=0 tx=0).stop 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 shutdown_connections 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7fa2640a3a70 0x7fa2640a5f30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280103a40 0x7fa280074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa280103080 0x7fa2800743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 --2- 172.21.15.7:0/2916598829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa280101f30 0x7fa280075db0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 >> 172.21.15.7:0/2916598829 conn(0x7fa2800fd4a0 msgr2=0x7fa2801063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 shutdown_connections 2024-04-23T14:51:09.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.628+0000 7fa285c00640 1 -- 172.21.15.7:0/2916598829 wait complete. 2024-04-23T14:51:09.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T14:51:09.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 -- 172.21.15.7:0/463180316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 msgr2=0x7f982c1036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 --2- 172.21.15.7:0/463180316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c1036c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9814009900 tx=0x7f981402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 -- 172.21.15.7:0/463180316 shutdown_connections 2024-04-23T14:51:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 --2- 172.21.15.7:0/463180316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f982c103c00 0x7f982c10a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 --2- 172.21.15.7:0/463180316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c1036c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 --2- 172.21.15.7:0/463180316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c102050 0x7f982c102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 -- 172.21.15.7:0/463180316 >> 172.21.15.7:0/463180316 conn(0x7f982c0fd5e0 msgr2=0x7f982c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 -- 172.21.15.7:0/463180316 shutdown_connections 2024-04-23T14:51:09.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.834+0000 7f9831200640 1 -- 172.21.15.7:0/463180316 wait complete. 2024-04-23T14:51:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 Processor -- start 2024-04-23T14:51:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 -- start start 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f982c102050 0x7f982c075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c0743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c103c00 0x7f982c074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f982c10dbe0 con 0x7f982c103240 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f982c10da60 con 0x7f982c103c00 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.836+0000 7f9831200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f982c10dd60 con 0x7f982c102050 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c0743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c0743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39592/0 (socket says 172.21.15.7:39592) 2024-04-23T14:51:09.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 -- 172.21.15.7:0/225763678 learned_addr learned my addr 172.21.15.7:0/225763678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9829e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f982c102050 0x7f982c075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f982a800640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c103c00 0x7f982c074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 -- 172.21.15.7:0/225763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f982c102050 msgr2=0x7f982c075db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f982c102050 0x7f982c075db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 -- 172.21.15.7:0/225763678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c103c00 msgr2=0x7f982c074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c103c00 0x7f982c074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f9823e00640 1 -- 172.21.15.7:0/225763678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0751c0 con 0x7f982c103240 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.837+0000 7f982a800640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c103c00 0x7f982c074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.838+0000 7f9823e00640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c0743f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f98140314e0 tx=0x7f9814003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.838+0000 7f9822a00640 1 -- 172.21.15.7:0/225763678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981403f070 con 0x7f982c103240 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.838+0000 7f9822a00640 1 -- 172.21.15.7:0/225763678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9814031c40 con 0x7f982c103240 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.838+0000 7f9822a00640 1 -- 172.21.15.7:0/225763678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814035030 con 0x7f982c103240 2024-04-23T14:51:09.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.838+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1a2300 con 0x7f982c103240 2024-04-23T14:51:09.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.838+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1a28a0 con 0x7f982c103240 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.841+0000 7f9822a00640 1 -- 172.21.15.7:0/225763678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7f9814042070 con 0x7f982c103240 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.841+0000 7f98341d7740 1 Processor -- start 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 -- start start 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa5f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa64580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa64bf0 0x557c6aa67080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557c6a9c4b10 con 0x557c6aa5fa80 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557c6a96b2b0 con 0x557c6aa5f090 2024-04-23T14:51:09.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f98341d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557c6a9c0ad0 con 0x557c6aa64bf0 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.842+0000 7f9829e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa64580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9823e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa64bf0 0x557c6aa67080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa64580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39598/0 (socket says 172.21.15.7:39598) 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 -- 172.21.15.7:0/3424029420 learned_addr learned my addr 172.21.15.7:0/3424029420 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f982a800640 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa5f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 -- 172.21.15.7:0/3424029420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa64bf0 msgr2=0x557c6aa67080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa64bf0 0x557c6aa67080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 -- 172.21.15.7:0/3424029420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 msgr2=0x557c6aa5f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa5f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 -- 172.21.15.7:0/3424029420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6a6d72d0 con 0x557c6aa5fa80 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.843+0000 7f9829e00640 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa64580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f981c00bcb0 tx=0x7f981c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9cb3f79368496 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.844+0000 7f981b400640 1 -- 172.21.15.7:0/3424029420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c004020 con 0x557c6aa5fa80 2024-04-23T14:51:09.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.844+0000 7f981b400640 1 -- 172.21.15.7:0/3424029420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f981c0054d0 con 0x557c6aa5fa80 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.844+0000 7f981b400640 1 -- 172.21.15.7:0/3424029420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c004cc0 con 0x557c6aa5fa80 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.844+0000 7f9822a00640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f98100a3c30 0x7f98100a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.844+0000 7f9822a00640 1 -- 172.21.15.7:0/225763678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f98140f0fb0 con 0x7f982c103240 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.844+0000 7f982a800640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f98100a3c30 0x7f98100a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 -- 172.21.15.7:0/3424029420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 msgr2=0x557c6aa64580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa64580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f981c00bcb0 tx=0x7f981c0107a0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 -- 172.21.15.7:0/3424029420 shutdown_connections 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa64bf0 0x557c6aa67080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa64580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 --2- 172.21.15.7:0/3424029420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa5f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 -- 172.21.15.7:0/3424029420 >> 172.21.15.7:0/3424029420 conn(0x557c6aa5a700 msgr2=0x557c6aa5ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 -- 172.21.15.7:0/3424029420 shutdown_connections 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 -- 172.21.15.7:0/3424029420 wait complete. 2024-04-23T14:51:09.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f982a800640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f98100a3c30 0x7f98100a60f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x557c6aa602e0 tx=0x7f9824009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.845+0000 7f98341d7740 1 -- start start 2024-04-23T14:51:09.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 Processor -- start 2024-04-23T14:51:09.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 0x557c6aa69a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa67ba0 con 0x557c6aa64bf0 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557c6a97e590 con 0x557c6aa5f090 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa67d20 con 0x557c6aa5fa80 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f98341d7740 10 client.0 _ll_register_callbacks cb 0x557c6a9613a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f982a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f9823e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 0x557c6aa69a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f9823e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 0x557c6aa69a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46444/0 (socket says 172.21.15.7:46444) 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.846+0000 7f9823e00640 1 -- 172.21.15.7:0/1112794314 learned_addr learned my addr 172.21.15.7:0/1112794314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9829e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9823e00640 1 -- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 msgr2=0x557c6aa69540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9823e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9823e00640 1 -- 172.21.15.7:0/1112794314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 msgr2=0x557c6aa70ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9823e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9823e00640 1 -- 172.21.15.7:0/1112794314 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6a7a16b0 con 0x557c6aa5fa80 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9829e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f9823e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 0x557c6aa69a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98140bce40 tx=0x7f9814009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc6ae58c6a650ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f980fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.847+0000 7f980fe00640 1 -- 172.21.15.7:0/1112794314 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814049070 con 0x557c6aa5fa80 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f981c0054d0 con 0x557c6aa5fa80 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f980fe00640 1 -- 172.21.15.7:0/1112794314 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f98140b9520 con 0x557c6aa5fa80 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f980fe00640 1 -- 172.21.15.7:0/1112794314 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f98140bd5b0 con 0x557c6aa5fa80 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f98341d7740 10 client.25132 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557c6aa67c70 con 0x557c6aa5fa80 2024-04-23T14:51:09.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f980fe00640 1 -- 172.21.15.7:0/1112794314 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f981c0054d0 con 0x557c6aa5fa80 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f980fe00640 1 -- 172.21.15.7:0/1112794314 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f98140c5690 con 0x557c6aa5fa80 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f98341d7740 10 client.25132 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f98341d7740 10 client.25132 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.848+0000 7f98341d7740 20 client.25132 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.849+0000 7f98341d7740 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aa76550 0x557c6aa779c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.849+0000 7f98341d7740 4 client.25132 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.849+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c6a9d2530 con 0x557c6aa76550 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.849+0000 7f9829e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aa76550 0x557c6aa779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.850+0000 7f9829e00640 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aa76550 0x557c6aa779c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8235c9332b72c2 server_cookie=5f96838aa6d38fd4 in_seq=0 out_seq=0 2024-04-23T14:51:09.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.850+0000 7f980fe00640 10 client.25132 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:09.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.852+0000 7f980fe00640 1 -- 172.21.15.7:0/1112794314 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557c6a9d2530 con 0x557c6aa76550 2024-04-23T14:51:09.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.852+0000 7f980fe00640 10 client.25132 handle_command_reply: tid=0 2024-04-23T14:51:09.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 client.25132 shutdown 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 msgr2=0x557c6aa69a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 0x557c6aa69a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98140bce40 tx=0x7f9814009680 comp rx=0 tx=0).stop 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 shutdown_connections 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aa76550 0x557c6aa779c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5fa80 0x557c6aa69a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 --2- 172.21.15.7:0/1112794314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f980fe00640 0 client.25132 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 >> 172.21.15.7:0/1112794314 conn(0x557c6aa5a700 msgr2=0x557c6aa598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 shutdown_connections 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 1 -- 172.21.15.7:0/1112794314 wait complete. 2024-04-23T14:51:09.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.853+0000 7f98341d7740 20 client.25132 trim_cache size 0 max 16384 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.873+0000 7f98341d7740 1 Processor -- start 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.873+0000 7f98341d7740 1 -- start start 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f98341d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f98341d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa70a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f98341d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa64bf0 0x557c6aa69a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f98341d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa75d00 con 0x557c6aa5fa80 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f98341d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa763d0 con 0x557c6aa64bf0 2024-04-23T14:51:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f98341d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa76aa0 con 0x557c6aa5f090 2024-04-23T14:51:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f9823e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa70a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f9823e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa70a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39614/0 (socket says 172.21.15.7:39614) 2024-04-23T14:51:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f9829e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f9823e00640 1 -- 172.21.15.7:0/3458990049 learned_addr learned my addr 172.21.15.7:0/3458990049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.874+0000 7f982a800640 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa64bf0 0x557c6aa69a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f9823e00640 1 -- 172.21.15.7:0/3458990049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 msgr2=0x557c6aa69540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f9823e00640 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f9823e00640 1 -- 172.21.15.7:0/3458990049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa64bf0 msgr2=0x557c6aa69a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f9823e00640 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa64bf0 0x557c6aa69a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f9823e00640 1 -- 172.21.15.7:0/3458990049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6aa55ff0 con 0x557c6aa5fa80 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f9823e00640 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa70a80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98140b9310 tx=0x7f98140f1270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4e7b3fc3c3ca53 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f981aa00640 1 -- 172.21.15.7:0/3458990049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814049040 con 0x557c6aa5fa80 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f981aa00640 1 -- 172.21.15.7:0/3458990049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98140c5b20 con 0x557c6aa5fa80 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.875+0000 7f981aa00640 1 -- 172.21.15.7:0/3458990049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98140f4b60 con 0x557c6aa5fa80 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 -- 172.21.15.7:0/3458990049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 msgr2=0x557c6aa70a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa70a80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98140b9310 tx=0x7f98140f1270 comp rx=0 tx=0).stop 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 -- 172.21.15.7:0/3458990049 shutdown_connections 2024-04-23T14:51:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa64bf0 0x557c6aa69a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa5fa80 0x557c6aa70a80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 --2- 172.21.15.7:0/3458990049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 -- 172.21.15.7:0/3458990049 >> 172.21.15.7:0/3458990049 conn(0x557c6aa5a700 msgr2=0x557c6aa68150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 -- 172.21.15.7:0/3458990049 shutdown_connections 2024-04-23T14:51:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 -- 172.21.15.7:0/3458990049 wait complete. 2024-04-23T14:51:09.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.876+0000 7f98341d7740 1 -- start start 2024-04-23T14:51:09.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 Processor -- start 2024-04-23T14:51:09.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa6cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5fa80 0x557c6aa6d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa77840 con 0x557c6aa64bf0 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa77170 con 0x557c6aa5fa80 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557c6aa77f10 con 0x557c6aa5f090 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f98341d7740 10 client.0 _ll_register_callbacks cb 0x7f98140b9150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f982a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f982a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39628/0 (socket says 172.21.15.7:39628) 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f982a800640 1 -- 172.21.15.7:0/2908495200 learned_addr learned my addr 172.21.15.7:0/2908495200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.877+0000 7f9829e00640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa6cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f9823e00640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5fa80 0x557c6aa6d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f982a800640 1 -- 172.21.15.7:0/2908495200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 msgr2=0x557c6aa6cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f982a800640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa6cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f982a800640 1 -- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5fa80 msgr2=0x557c6aa6d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f982a800640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5fa80 0x557c6aa6d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f982a800640 1 -- 172.21.15.7:0/2908495200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6aa70640 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f982a800640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70050 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98240129d0 tx=0x7f9824004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd541f396686ff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f980fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f980fe00640 1 -- 172.21.15.7:0/2908495200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982402e060 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f980fe00640 1 -- 172.21.15.7:0/2908495200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f9824020c00 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.878+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98140c5b20 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f980fe00640 1 -- 172.21.15.7:0/2908495200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9824035050 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 10 client.15510 fetch_fsmap learned FSMap version 27 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557c6aadce10 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f980fe00640 1 -- 172.21.15.7:0/2908495200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98140c5b20 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f980fe00640 1 -- 172.21.15.7:0/2908495200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f982401e3b0 con 0x557c6aa64bf0 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 10 client.15510 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 10 client.15510 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 20 client.15510 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aae1ab0 0x557c6aaddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 4 client.15510 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T14:51:09.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.879+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "status"}) -- 0x557c6a9cc3a0 con 0x557c6aae1ab0 2024-04-23T14:51:09.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.880+0000 7f9829e00640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aae1ab0 0x557c6aaddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.881+0000 7f9829e00640 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aae1ab0 0x557c6aaddef0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72885e6e63bf952b server_cookie=d8fd4b6cd6d40393 in_seq=0 out_seq=0 2024-04-23T14:51:09.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.881+0000 7f980fe00640 10 client.15510 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f980fe00640 1 -- 172.21.15.7:0/2908495200 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557c6a9cc3a0 con 0x557c6aae1ab0 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f980fe00640 10 client.15510 handle_command_reply: tid=0 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 client.15510 shutdown 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 msgr2=0x557c6aa70050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70050 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98240129d0 tx=0x7f9824004a40 comp rx=0 tx=0).stop 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 shutdown_connections 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557c6aae1ab0 0x557c6aaddef0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c6aa5fa80 0x557c6aa6d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557c6aa64bf0 0x557c6aa70050 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 --2- 172.21.15.7:0/2908495200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557c6aa5f090 0x557c6aa6cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f980fe00640 0 client.15510 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.882+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 >> 172.21.15.7:0/2908495200 conn(0x557c6aa5a700 msgr2=0x557c6aa69540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 shutdown_connections 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f98341d7740 1 -- 172.21.15.7:0/2908495200 wait complete. 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f98341d7740 20 client.15510 trim_cache size 0 max 16384 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "7b70c844-017e-11ef-bc93-c7b262605968", 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-23T14:51:09.886 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 34526, 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 165.59631213200001, 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 93, 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 91, 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 172.536645717 2024-04-23T14:51:09.887 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f98100a3c30 msgr2=0x7f98100a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f98100a3c30 0x7f98100a60f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x557c6aa602e0 tx=0x7f9824009500 comp rx=0 tx=0).stop 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 msgr2=0x7f982c0743f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c0743f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f98140314e0 tx=0x7f9814003c10 comp rx=0 tx=0).stop 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 shutdown_connections 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f98100a3c30 0x7f98100a60f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.883+0000 7f9831200640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c103c00 0x7f982c074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.884+0000 7f9831200640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f982c103240 0x7f982c0743f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.884+0000 7f9831200640 1 --2- 172.21.15.7:0/225763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f982c102050 0x7f982c075db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.884+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 >> 172.21.15.7:0/225763678 conn(0x7f982c0fd5e0 msgr2=0x7f982c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.884+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 shutdown_connections 2024-04-23T14:51:09.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:09.884+0000 7f9831200640 1 -- 172.21.15.7:0/225763678 wait complete. 2024-04-23T14:51:09.901 INFO:teuthology.run_tasks:Running task sequential... 2024-04-23T14:51:09.911 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-23T14:51:09.911 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-23T14:51:09.912 INFO:teuthology.task.print:Enabling mgr modules 2024-04-23T14:51:09.912 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-23T14:51:09.913 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T14:51:09.913 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:51:09.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-23T14:51:10.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 -- 172.21.15.7:0/715314753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84109d50 msgr2=0x7efc8410c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 --2- 172.21.15.7:0/715314753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84109d50 0x7efc8410c1e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009ca0 tx=0x7efc7c02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 -- 172.21.15.7:0/715314753 shutdown_connections 2024-04-23T14:51:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 --2- 172.21.15.7:0/715314753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84109d50 0x7efc8410c1e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 --2- 172.21.15.7:0/715314753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc84074a60 0x7efc84074ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 --2- 172.21.15.7:0/715314753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc84076040 0x7efc84074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.106+0000 7efc83200640 1 -- 172.21.15.7:0/715314753 >> 172.21.15.7:0/715314753 conn(0x7efc840fd400 msgr2=0x7efc840ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.107+0000 7efc83200640 1 -- 172.21.15.7:0/715314753 shutdown_connections 2024-04-23T14:51:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.107+0000 7efc83200640 1 -- 172.21.15.7:0/715314753 wait complete. 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.108+0000 7efc83200640 1 Processor -- start 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.108+0000 7efc83200640 1 -- start start 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc83200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc84074a60 0x7efc8419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc83200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 0x7efc8419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc83200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc84109d50 0x7efc841a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc83200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efc8410fc10 con 0x7efc84076040 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc83200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc8410fa90 con 0x7efc84109d50 2024-04-23T14:51:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc83200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efc8410fd90 con 0x7efc84074a60 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc81400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 0x7efc8419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc81400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 0x7efc8419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39642/0 (socket says 172.21.15.7:39642) 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc81400640 1 -- 172.21.15.7:0/3936232525 learned_addr learned my addr 172.21.15.7:0/3936232525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc82800640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc84109d50 0x7efc841a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.109+0000 7efc81e00640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc84074a60 0x7efc8419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc81400640 1 -- 172.21.15.7:0/3936232525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc84074a60 msgr2=0x7efc8419a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc81400640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc84074a60 0x7efc8419a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc81400640 1 -- 172.21.15.7:0/3936232525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc84109d50 msgr2=0x7efc841a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc81400640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc84109d50 0x7efc841a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc81400640 1 -- 172.21.15.7:0/3936232525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc841a1e60 con 0x7efc84076040 2024-04-23T14:51:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc81400640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 0x7efc8419a780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7efc7000e9f0 tx=0x7efc7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7000cd80 con 0x7efc84076040 2024-04-23T14:51:10.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc700054d0 con 0x7efc84076040 2024-04-23T14:51:10.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc841a2150 con 0x7efc84076040 2024-04-23T14:51:10.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.110+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc841a2650 con 0x7efc84076040 2024-04-23T14:51:10.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.111+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70010490 con 0x7efc84076040 2024-04-23T14:51:10.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.112+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc84108a80 con 0x7efc84076040 2024-04-23T14:51:10.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.117+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138645+0+0 (secure 0 0 0) 0x7efc70005000 con 0x7efc84076040 2024-04-23T14:51:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.118+0000 7efc7aa00640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efc680a3ba0 0x7efc680a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.119+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7efc700d0da0 con 0x7efc84076040 2024-04-23T14:51:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.119+0000 7efc81e00640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efc680a3ba0 0x7efc680a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.120+0000 7efc81e00640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efc680a3ba0 0x7efc680a6060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc74009bd0 tx=0x7efc74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.121+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efc70053ff0 con 0x7efc84076040 2024-04-23T14:51:10.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.396+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7efc8402d620 con 0x7efc84076040 2024-04-23T14:51:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.453+0000 7efc7aa00640 1 -- 172.21.15.7:0/3936232525 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7efc700052f0 con 0x7efc84076040 2024-04-23T14:51:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.456+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efc680a3ba0 msgr2=0x7efc680a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.456+0000 7efc83200640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efc680a3ba0 0x7efc680a6060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc74009bd0 tx=0x7efc74005f90 comp rx=0 tx=0).stop 2024-04-23T14:51:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.456+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 msgr2=0x7efc8419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.456+0000 7efc83200640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 0x7efc8419a780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7efc7000e9f0 tx=0x7efc7000edf0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.457+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 shutdown_connections 2024-04-23T14:51:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.457+0000 7efc83200640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7efc680a3ba0 0x7efc680a6060 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.457+0000 7efc83200640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc84109d50 0x7efc841a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.457+0000 7efc83200640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc84076040 0x7efc8419a780 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.457+0000 7efc83200640 1 --2- 172.21.15.7:0/3936232525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc84074a60 0x7efc8419a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.457+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 >> 172.21.15.7:0/3936232525 conn(0x7efc840fd400 msgr2=0x7efc84105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.458+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 shutdown_connections 2024-04-23T14:51:10.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.459+0000 7efc83200640 1 -- 172.21.15.7:0/3936232525 wait complete. 2024-04-23T14:51:10.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-23T14:51:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.699+0000 7f1ffe800640 1 -- 172.21.15.7:0/1408463006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8102aa0 msgr2=0x7f1ff81093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.699+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1408463006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8102aa0 0x7f1ff81093c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009ca0 tx=0x7f1ff002a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 -- 172.21.15.7:0/1408463006 shutdown_connections 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1408463006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8102aa0 0x7f1ff81093c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1408463006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff81020e0 0x7f1ff8102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1408463006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff8100f10 0x7f1ff8101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 -- 172.21.15.7:0/1408463006 >> 172.21.15.7:0/1408463006 conn(0x7f1ff80fc4f0 msgr2=0x7f1ff80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 -- 172.21.15.7:0/1408463006 shutdown_connections 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.700+0000 7f1ffe800640 1 -- 172.21.15.7:0/1408463006 wait complete. 2024-04-23T14:51:10.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.701+0000 7f1ffe800640 1 Processor -- start 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 -- start start 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8100f10 0x7f1ff8104f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff81020e0 0x7f1ff8103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff8102aa0 0x7f1ff8103a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff810cab0 con 0x7f1ff8100f10 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff810c930 con 0x7f1ff81020e0 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ffe800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff810cc30 con 0x7f1ff8102aa0 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ff7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8100f10 0x7f1ff8104f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ff7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8100f10 0x7f1ff8104f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39678/0 (socket says 172.21.15.7:39678) 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ff6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff81020e0 0x7f1ff8103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.702+0000 7f1ff7400640 1 -- 172.21.15.7:0/1811230479 learned_addr learned my addr 172.21.15.7:0/1811230479 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff7e00640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff8102aa0 0x7f1ff8103a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff6a00640 1 -- 172.21.15.7:0/1811230479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff8102aa0 msgr2=0x7f1ff8103a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff6a00640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff8102aa0 0x7f1ff8103a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff6a00640 1 -- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8100f10 msgr2=0x7f1ff8104f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff6a00640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8100f10 0x7f1ff8104f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff6a00640 1 -- 172.21.15.7:0/1811230479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff8104320 con 0x7f1ff81020e0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.703+0000 7f1ff6a00640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff81020e0 0x7f1ff8103550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4005fd0 tx=0x7f1fe400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.704+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4009c30 con 0x7f1ff81020e0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.704+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1fe4009dd0 con 0x7f1ff81020e0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.704+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4003e40 con 0x7f1ff81020e0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.704+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff81a22a0 con 0x7f1ff81020e0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.704+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff81a2840 con 0x7f1ff81020e0 2024-04-23T14:51:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.705+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff81a2b00 con 0x7f1ff81020e0 2024-04-23T14:51:10.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.708+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 19) ==== 138662+0+0 (secure 0 0 0) 0x7f1fe4004000 con 0x7f1ff81020e0 2024-04-23T14:51:10.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.710+0000 7f1fefe00640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 0x7f1fdc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.710+0000 7f1ff7400640 1 -- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 msgr2=0x7f1fdc0a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.710+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f1fe40d0480 con 0x7f1ff81020e0 2024-04-23T14:51:10.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.710+0000 7f1ff7400640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 0x7f1fdc0a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:51:10.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.717+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fe4017020 con 0x7f1ff81020e0 2024-04-23T14:51:10.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:10 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3936232525' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-23T14:51:10.783 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:10 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: ignoring --setuser ceph since I am not root 2024-04-23T14:51:10.784 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:10 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: ignoring --setgroup ceph since I am not root 2024-04-23T14:51:10.784 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:10 smithi137 ceph-mgr[33088]: -- 172.21.15.137:0/135226065 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558de58505a0 con 0x558de5824c00 2024-04-23T14:51:10.784 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:10 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:10.782+0000 7f935f81d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:51:10.796 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:10 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3936232525' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-23T14:51:10.796 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:10 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: ignoring --setuser ceph since I am not root 2024-04-23T14:51:10.796 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:10 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: ignoring --setgroup ceph since I am not root 2024-04-23T14:51:10.796 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:10 smithi186 ceph-mgr[33768]: -- 172.21.15.186:0/2868609203 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7dd6d05a0 con 0x55a7dd6a4800 2024-04-23T14:51:10.797 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:10 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:10.795+0000 7f47a42ba200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:51:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:10 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3936232525' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-23T14:51:10.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:10 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: ignoring --setuser ceph since I am not root 2024-04-23T14:51:10.835 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:10 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: ignoring --setgroup ceph since I am not root 2024-04-23T14:51:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.911+0000 7f1ff7400640 1 -- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 msgr2=0x7f1fdc0a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.911+0000 7f1ff7400640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 0x7f1fdc0a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:51:10.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.960+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f1ff81a32e0 con 0x7f1ff81020e0 2024-04-23T14:51:10.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.973+0000 7f1fefe00640 1 -- 172.21.15.7:0/1811230479 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f1fe409ca80 con 0x7f1ff81020e0 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 msgr2=0x7f1fdc0a61e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 0x7f1fdc0a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff81020e0 msgr2=0x7f1ff8103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff81020e0 0x7f1ff8103550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4005fd0 tx=0x7f1fe400dde0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 shutdown_connections 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f1fdc0a3d20 0x7f1fdc0a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ff81020e0 0x7f1ff8103550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff8102aa0 0x7f1ff8103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 --2- 172.21.15.7:0/1811230479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff8100f10 0x7f1ff8104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.976+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 >> 172.21.15.7:0/1811230479 conn(0x7f1ff80fc4f0 msgr2=0x7f1ff80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.977+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 shutdown_connections 2024-04-23T14:51:10.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:10.977+0000 7f1ffe800640 1 -- 172.21.15.7:0/1811230479 wait complete. 2024-04-23T14:51:10.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-23T14:51:11.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:10 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:10.831+0000 7fea82e7d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 -- 172.21.15.7:0/1015594144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 msgr2=0x7f6358103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 --2- 172.21.15.7:0/1015594144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f6358103460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6344009900 tx=0x7f634402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 -- 172.21.15.7:0/1015594144 shutdown_connections 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 --2- 172.21.15.7:0/1015594144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63581039a0 0x7f635810a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 --2- 172.21.15.7:0/1015594144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f6358103460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 --2- 172.21.15.7:0/1015594144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358101e90 0x7f63581022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 -- 172.21.15.7:0/1015594144 >> 172.21.15.7:0/1015594144 conn(0x7f63580fd400 msgr2=0x7f63580ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 -- 172.21.15.7:0/1015594144 shutdown_connections 2024-04-23T14:51:11.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.175+0000 7f635ea00640 1 -- 172.21.15.7:0/1015594144 wait complete. 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 Processor -- start 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 -- start start 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 0x7f6358075d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f63580743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63581039a0 0x7f6358074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f635810da20 con 0x7f6358101e90 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f635810d8a0 con 0x7f63581039a0 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635ea00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f635810dba0 con 0x7f6358102fe0 2024-04-23T14:51:11.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 0x7f6358075d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.177+0000 7f635cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f63580743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f63580743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46532/0 (socket says 172.21.15.7:46532) 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635cc00640 1 -- 172.21.15.7:0/3952348640 learned_addr learned my addr 172.21.15.7:0/3952348640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 0x7f6358075d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39702/0 (socket says 172.21.15.7:39702) 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635e000640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63581039a0 0x7f6358074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 -- 172.21.15.7:0/3952348640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 msgr2=0x7f63580743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f63580743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 -- 172.21.15.7:0/3952348640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63581039a0 msgr2=0x7f6358074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63581039a0 0x7f6358074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 -- 172.21.15.7:0/3952348640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63580751f0 con 0x7f6358101e90 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.178+0000 7f635d600640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 0x7f6358075d60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f634c00e9f0 tx=0x7f634c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.179+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c00ccc0 con 0x7f6358101e90 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.179+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f634c0108e0 con 0x7f6358101e90 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.179+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63581a2270 con 0x7f6358101e90 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.179+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c018880 con 0x7f6358101e90 2024-04-23T14:51:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.179+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63581a27e0 con 0x7f6358101e90 2024-04-23T14:51:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.180+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63581091c0 con 0x7f6358101e90 2024-04-23T14:51:11.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.182+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138662+0+0 (secure 0 0 0) 0x7f634c010a90 con 0x7f6358101e90 2024-04-23T14:51:11.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.184+0000 7f6356000640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 0x7f63400a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.185+0000 7f635cc00640 1 -- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 msgr2=0x7f63400a6130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:11.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.185+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f634c0d0b80 con 0x7f6358101e90 2024-04-23T14:51:11.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.185+0000 7f635cc00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 0x7f63400a6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:51:11.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.189+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f634c09d180 con 0x7f6358101e90 2024-04-23T14:51:11.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:11.051+0000 7f47a42ba200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:51:11.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:11.205+0000 7f47a42ba200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:51:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.386+0000 7f635cc00640 1 -- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 msgr2=0x7f63400a6130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:11.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.386+0000 7f635cc00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 0x7f63400a6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:51:11.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.387+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f635802d620 con 0x7f6358101e90 2024-04-23T14:51:11.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.392+0000 7f6356000640 1 -- 172.21.15.7:0/3952348640 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f634c0bd0c0 con 0x7f6358101e90 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 msgr2=0x7f63400a6130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 0x7f63400a6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 msgr2=0x7f6358075d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 0x7f6358075d60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f634c00e9f0 tx=0x7f634c00eeb0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 shutdown_connections 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f63400a3c70 0x7f63400a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63581039a0 0x7f6358074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6358102fe0 0x7f63580743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 --2- 172.21.15.7:0/3952348640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6358101e90 0x7f6358075d60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.395+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 >> 172.21.15.7:0/3952348640 conn(0x7f63580fd400 msgr2=0x7f6358106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.396+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 shutdown_connections 2024-04-23T14:51:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:11.396+0000 7f635ea00640 1 -- 172.21.15.7:0/3952348640 wait complete. 2024-04-23T14:51:11.412 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:11.101+0000 7fea82e7d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:51:11.412 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:11.246+0000 7fea82e7d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:51:11.414 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-23T14:51:11.425 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-23T14:51:11.425 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-23T14:51:11.425 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-04-23T14:51:11.425 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T14:51:11.425 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:11.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:11.426 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-23T14:51:11.426 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:11.044+0000 7f935f81d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:51:11.427 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:11.181+0000 7f935f81d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T14:51:11.472 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-23T14:51:11.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:11.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T14:51:11.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:11.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-04-23T14:51:11.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3936232525' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-23T14:51:11.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-mon[27906]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-04-23T14:51:11.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-mon[27906]: from='client.? ' entity='client.admin' 2024-04-23T14:51:11.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3952348640' entity='client.admin' 2024-04-23T14:51:11.697 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-23T14:51:11.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-23T14:51:11.786 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:11.646+0000 7f47a42ba200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:51:11.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3936232525' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-23T14:51:11.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-mon[31814]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-04-23T14:51:11.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-mon[31814]: from='client.? ' entity='client.admin' 2024-04-23T14:51:11.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3952348640' entity='client.admin' 2024-04-23T14:51:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3936232525' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-23T14:51:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-mon[31694]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-04-23T14:51:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-mon[31694]: from='client.? ' entity='client.admin' 2024-04-23T14:51:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3952348640' entity='client.admin' 2024-04-23T14:51:11.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:11.569+0000 7f935f81d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:51:11.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:11.680+0000 7f935f81d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:51:12.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:11.670+0000 7fea82e7d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T14:51:12.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:11 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:11.794+0000 7fea82e7d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T14:51:12.113 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:11.785+0000 7f47a42ba200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T14:51:13.613 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:13.342+0000 7f47a42ba200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:51:13.614 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:13.569+0000 7f47a42ba200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:51:13.654 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:13 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:13.206+0000 7f935f81d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:51:13.654 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:13 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:13.435+0000 7f935f81d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:51:13.748 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:13.490+0000 7fea82e7d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T14:51:13.748 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:13.745+0000 7fea82e7d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T14:51:13.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:13 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:13.652+0000 7f935f81d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:51:14.013 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:13.973+0000 7fea82e7d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:51:14.113 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:13.785+0000 7f47a42ba200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T14:51:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 -- 172.21.15.7:0/1956781148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c10a070 msgr2=0x7f488c111c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 --2- 172.21.15.7:0/1956781148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c10a070 0x7f488c111c40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f48840099c0 tx=0x7f4884009cd0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 -- 172.21.15.7:0/1956781148 shutdown_connections 2024-04-23T14:51:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 --2- 172.21.15.7:0/1956781148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c10a070 0x7f488c111c40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 --2- 172.21.15.7:0/1956781148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c104f90 0x7f488c105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 --2- 172.21.15.7:0/1956781148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f488c105940 0x7f488c109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 -- 172.21.15.7:0/1956781148 >> 172.21.15.7:0/1956781148 conn(0x7f488c100820 msgr2=0x7f488c102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:14.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 -- 172.21.15.7:0/1956781148 shutdown_connections 2024-04-23T14:51:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.308+0000 7f4891c00700 1 -- 172.21.15.7:0/1956781148 wait complete. 2024-04-23T14:51:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.310+0000 7f4891c00700 1 Processor -- start 2024-04-23T14:51:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.310+0000 7f4891c00700 1 -- start start 2024-04-23T14:51:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.310+0000 7f4891c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f488c104f90 0x7f488c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.310+0000 7f4891c00700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 0x7f488c19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f4891c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c10a070 0x7f488c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f4891c00700 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f488c114f30 con 0x7f488c105940 2024-04-23T14:51:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f4891c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f488c114db0 con 0x7f488c10a070 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f4891c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1150b0 con 0x7f488c104f90 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 0x7f488c19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 0x7f488c19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44756/0 (socket says 172.21.15.7:44756) 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 -- 172.21.15.7:0/2718875501 learned_addr learned my addr 172.21.15.7:0/2718875501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488aa00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f488c104f90 0x7f488c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488b400700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c10a070 0x7f488c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 -- 172.21.15.7:0/2718875501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f488c104f90 msgr2=0x7f488c19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f488c104f90 0x7f488c19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 -- 172.21.15.7:0/2718875501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c10a070 msgr2=0x7f488c19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c10a070 0x7f488c19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.311+0000 7f488a000700 1 -- 172.21.15.7:0/2718875501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1a0390 con 0x7f488c105940 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f488b400700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c10a070 0x7f488c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f488a000700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 0x7f488c19b8c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f487800d950 tx=0x7f487800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878017070 con 0x7f488c105940 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4878005020 con 0x7f488c105940 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878009ab0 con 0x7f488c105940 2024-04-23T14:51:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1a0680 con 0x7f488c105940 2024-04-23T14:51:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.312+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a7f00 con 0x7f488c105940 2024-04-23T14:51:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.313+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c0697e0 con 0x7f488c105940 2024-04-23T14:51:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.317+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138662+0+0 (secure 0 0 0) 0x7f48780051d0 con 0x7f488c105940 2024-04-23T14:51:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.318+0000 7f4883400700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 0x7f48700a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.319+0000 7f488aa00700 1 -- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 msgr2=0x7f48700a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.319+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f48780cfff0 con 0x7f488c105940 2024-04-23T14:51:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.319+0000 7f488aa00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 0x7f48700a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:51:14.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.326+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f487809c650 con 0x7f488c105940 2024-04-23T14:51:14.330 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:14.049+0000 7f935f81d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:51:14.330 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:14.176+0000 7f935f81d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:51:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.520+0000 7f488aa00700 1 -- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 msgr2=0x7f48700a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.520+0000 7f488aa00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 0x7f48700a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:51:14.539 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:14.164+0000 7f47a42ba200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:51:14.540 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:14.285+0000 7f47a42ba200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:51:14.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:14 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:14.388+0000 7fea82e7d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T14:51:14.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:14 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:14.517+0000 7fea82e7d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T14:51:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.599+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f488c19c6e0 con 0x7f488c105940 2024-04-23T14:51:14.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.599+0000 7f4883400700 1 -- 172.21.15.7:0/2718875501 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7f487809bf50 con 0x7f488c105940 2024-04-23T14:51:14.601 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.602+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 msgr2=0x7f48700a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.602+0000 7f4891c00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 0x7f48700a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.602+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 msgr2=0x7f488c19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.602+0000 7f4891c00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 0x7f488c19b8c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f487800d950 tx=0x7f487800dc60 comp rx=0 tx=0).stop 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 shutdown_connections 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f48700a3c90 0x7f48700a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c10a070 0x7f488c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f488c104f90 0x7f488c19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 --2- 172.21.15.7:0/2718875501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f488c105940 0x7f488c19b8c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 >> 172.21.15.7:0/2718875501 conn(0x7f488c100820 msgr2=0x7f488c101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 shutdown_connections 2024-04-23T14:51:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:14.603+0000 7f4891c00700 1 -- 172.21.15.7:0/2718875501 wait complete. 2024-04-23T14:51:14.654 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:14.443+0000 7f935f81d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:51:14.794 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:14.538+0000 7f47a42ba200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:51:14.794 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:14 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2718875501' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:51:14.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:14 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2718875501' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:51:14.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:14.701+0000 7f935f81d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:51:15.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:14 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2718875501' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:51:15.021 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:14 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:14.785+0000 7fea82e7d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T14:51:15.113 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:14.792+0000 7f47a42ba200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:51:15.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:15.063+0000 7fea82e7d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T14:51:15.448 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T14:51:15.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T14:51:15.449 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-23T14:51:15.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:15.449 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-23T14:51:15.501 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 41496sec preferred_lft 41496sec 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-23T14:51:15.502 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-23T14:51:15.503 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T14:51:15.503 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:51:15.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:51:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:51:15.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:15.725 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T14:51:15.785 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-23T14:51:15.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:15.789 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-23T14:51:15.830 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-23T14:51:15.830 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T14:51:15.830 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-23T14:51:15.830 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-23T14:51:15.830 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T14:51:15.831 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:51:15.831 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:51:15.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T14:51:15.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T14:51:15.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T14:51:15.831 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:51:15.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:15 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:15.577+0000 7f47a42ba200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:51:15.917 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:15 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:15.492+0000 7f935f81d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:51:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:51:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:51:16.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:16.069 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-23T14:51:16.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:16.114 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-04-23T14:51:16.197 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:51:16.197 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:51:16.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:16.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-23T14:51:16.197 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:51:16.335 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:15.917+0000 7fea82e7d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T14:51:16.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:51:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:51:16.417 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:16 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:16.042+0000 7f935f81d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:51:16.418 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:16 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:16.168+0000 7f935f81d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:51:16.427 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-23T14:51:16.427 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:51:16.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:51:16.522 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:16.128+0000 7f47a42ba200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:51:16.523 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:16.255+0000 7f47a42ba200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:51:16.636 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:16 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:16.533+0000 7fea82e7d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T14:51:16.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:51:16.685 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:51:16.685 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-23T14:51:16.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-23T14:51:16.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T14:51:16.685 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-23T14:51:16.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:51:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:51:16.862 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:16 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:16.521+0000 7f47a42ba200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:51:16.868 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-04-23T14:51:16.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:51:16.869 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:16.909 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-23T14:51:16.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:51:16.910 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:16.917 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:16 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:16.432+0000 7f935f81d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:51:16.965 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:16 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:16.676+0000 7fea82e7d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T14:51:16.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-23T14:51:17.113 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-23T14:51:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-23T14:51:17.166 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/edb1041492cc53ed40e205e76e13b49e4b6afd508520ebaaf3ccb4b439a8a3b1/merged 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/390f1753f42e888b02b990766a1e735ddc718fdef64cec82baeda872f3c3c79e/merged 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:51:17.167 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/a76d24e5828a340883f18f62e785b9ee880c8bf67a11f2932b770341a8955189/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/ef156b56425315bc4ee396146c1b52d6f57ea2f523a669fcc757fa70c31e30b8/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/3301f49788caa715f06ea8eda2a2e337aa80433db5f176af05f01591d2175596/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/e54c40d66c16d2ba7921c007a4d665262c9d8817c0df21172678d58f56a9d4c5/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/f834b1d95f107cf8759c85cfec0b81b0ccec1ae71ca0dbb3619a12d90e7d1568/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/115d204ce59696846e575fba0f441fc5a9094f3bfece0364ba698afff8a72eea/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5267c3c3b73e3a40cf4bc47558bf1b51e4a7254851ffb1cd9c3592fe97e68f14/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5f3fb352d11c1389bf1c07f00817a01f17fac1618e579dc39c5b154fbddbd981/merged 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:17.168 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:17.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:17.169 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-23T14:51:17.217 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T14:51:17.217 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/a2313d80-c0a6-47a1-ac3a-6ff4afedb789 --client_fs=cephfs) 2024-04-23T14:51:17.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-23T14:51:17.275 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:16 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:16.963+0000 7fea82e7d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T14:51:17.289 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T14:51:17.328 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-23T14:51:17.328 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-23T14:51:17.328 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-23T14:51:17.328 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-23T14:51:17.328 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-23T14:51:17.328 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-23T14:51:17.329 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/edb1041492cc53ed40e205e76e13b49e4b6afd508520ebaaf3ccb4b439a8a3b1/merged 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/390f1753f42e888b02b990766a1e735ddc718fdef64cec82baeda872f3c3c79e/merged 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/a76d24e5828a340883f18f62e785b9ee880c8bf67a11f2932b770341a8955189/merged 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/ef156b56425315bc4ee396146c1b52d6f57ea2f523a669fcc757fa70c31e30b8/merged 2024-04-23T14:51:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/3301f49788caa715f06ea8eda2a2e337aa80433db5f176af05f01591d2175596/merged 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/e54c40d66c16d2ba7921c007a4d665262c9d8817c0df21172678d58f56a9d4c5/merged 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/f834b1d95f107cf8759c85cfec0b81b0ccec1ae71ca0dbb3619a12d90e7d1568/merged 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/115d204ce59696846e575fba0f441fc5a9094f3bfece0364ba698afff8a72eea/merged 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5267c3c3b73e3a40cf4bc47558bf1b51e4a7254851ffb1cd9c3592fe97e68f14/merged 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5f3fb352d11c1389bf1c07f00817a01f17fac1618e579dc39c5b154fbddbd981/merged 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:17.331 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:17.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:17.332 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-23T14:51:17.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2024-04-23T14:51:17.382+0000 7f445b521480 -1 init, newargv = 0x55b49b8d4500 newargc=15 2024-04-23T14:51:17.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[79935]: starting ceph client 2024-04-23T14:51:17.417 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:17.080+0000 7f935f81d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:51:17.418 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:17.204+0000 7f935f81d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:51:17.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[79935]: starting fuse 2024-04-23T14:51:17.613 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:17.175+0000 7f47a42ba200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:51:17.613 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:17.301+0000 7f47a42ba200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:51:17.854 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:17.547+0000 7f935f81d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:51:17.854 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:17.724+0000 7f935f81d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:51:17.854 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:17.852+0000 7f935f81d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:51:17.934 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:17.626+0000 7f47a42ba200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:51:17.934 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:17.805+0000 7f47a42ba200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:51:18.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:17.667+0000 7fea82e7d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T14:51:18.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:17.799+0000 7fea82e7d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T14:51:18.168 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:18 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:18.003+0000 7f935f81d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:51:18.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:17.932+0000 7f47a42ba200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:51:18.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:18.083+0000 7f47a42ba200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:51:18.472 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:18.141+0000 7fea82e7d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T14:51:18.472 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:18.334+0000 7fea82e7d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T14:51:18.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-23T14:51:18.600 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T14:51:18.647 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-23T14:51:18.648 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-04-23T14:51:18.649 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/edb1041492cc53ed40e205e76e13b49e4b6afd508520ebaaf3ccb4b439a8a3b1/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/390f1753f42e888b02b990766a1e735ddc718fdef64cec82baeda872f3c3c79e/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/a76d24e5828a340883f18f62e785b9ee880c8bf67a11f2932b770341a8955189/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/ef156b56425315bc4ee396146c1b52d6f57ea2f523a669fcc757fa70c31e30b8/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/3301f49788caa715f06ea8eda2a2e337aa80433db5f176af05f01591d2175596/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/e54c40d66c16d2ba7921c007a4d665262c9d8817c0df21172678d58f56a9d4c5/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/f834b1d95f107cf8759c85cfec0b81b0ccec1ae71ca0dbb3619a12d90e7d1568/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/115d204ce59696846e575fba0f441fc5a9094f3bfece0364ba698afff8a72eea/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5267c3c3b73e3a40cf4bc47558bf1b51e4a7254851ffb1cd9c3592fe97e68f14/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5f3fb352d11c1389bf1c07f00817a01f17fac1618e579dc39c5b154fbddbd981/merged 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:18.650 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:51:18.651 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:18.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:18.652 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-23T14:51:18.667 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:18 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:18.377+0000 7f935f81d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:51:18.692 INFO:teuthology.orchestra.run.smithi007.stdout:114 2024-04-23T14:51:18.693 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo stdin-killer -- python3 -c ' 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> import re 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2024-04-23T14:51:18.693 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> return f 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2024-04-23T14:51:18.694 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-23T14:51:18.795 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:18.470+0000 7fea82e7d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T14:51:18.795 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:18.632+0000 7fea82e7d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T14:51:18.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:18.458+0000 7f47a42ba200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:51:18.887 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.79935.asok 2024-04-23T14:51:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:51:18.904 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.79935.asok 2024-04-23T14:51:18.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:18.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.79935.asok status 2024-04-23T14:51:19.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:19.016+0000 7fea82e7d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "d44fddd910b5e94da0f2357af4be37d7bd495ae0", 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)", 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2024-04-23T14:51:19.131 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "79935", 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/volumes/qa/sv_0/a2313d80-c0a6-47a1-ac3a-6ff4afedb789" 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 25177, 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 25177 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-04-23T14:51:19.132 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2993643099 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2993643099 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.25177 192.168.0.1:0/2993643099", 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/2993643099", 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 5, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 27, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 93, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2024-04-23T14:51:19.133 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2024-04-23T14:51:19.134 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T14:51:19.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:19.146 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2024-04-23T14:51:19.146 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:19.196 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2024-04-23T14:51:19.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:19.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:51:19.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:19.270 INFO:teuthology.run_tasks:Running task exec... 2024-04-23T14:51:19.279 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T14:51:19.279 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:51:19.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-04-23T14:51:19.417 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:19.135+0000 7f935f81d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:51:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 -- 172.21.15.7:0/1259017611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8107b60 msgr2=0x7f73d8109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 --2- 172.21.15.7:0/1259017611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8107b60 0x7f73d8109fb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009900 tx=0x7f73d002a410 comp rx=0 tx=0).stop 2024-04-23T14:51:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 -- 172.21.15.7:0/1259017611 shutdown_connections 2024-04-23T14:51:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 --2- 172.21.15.7:0/1259017611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d8105230 0x7f73d8107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 --2- 172.21.15.7:0/1259017611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8107b60 0x7f73d8109fb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 --2- 172.21.15.7:0/1259017611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8102900 0x7f73d8104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.465+0000 7f73dea00640 1 -- 172.21.15.7:0/1259017611 >> 172.21.15.7:0/1259017611 conn(0x7f73d80fc2f0 msgr2=0x7f73d80fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.466+0000 7f73dea00640 1 -- 172.21.15.7:0/1259017611 shutdown_connections 2024-04-23T14:51:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.466+0000 7f73dea00640 1 -- 172.21.15.7:0/1259017611 wait complete. 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.466+0000 7f73dea00640 1 Processor -- start 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 -- start start 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 0x7f73d8102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8105230 0x7f73d81008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d8107b60 0x7f73d8100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73d810d9d0 con 0x7f73d8102900 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73d810d850 con 0x7f73d8107b60 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dea00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f73d810db50 con 0x7f73d8105230 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 0x7f73d8102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 0x7f73d8102270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44778/0 (socket says 172.21.15.7:44778) 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.467+0000 7f73dd600640 1 -- 172.21.15.7:0/1832384851 learned_addr learned my addr 172.21.15.7:0/1832384851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dcc00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8105230 0x7f73d81008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dd600640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8105230 msgr2=0x7f73d81008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dd600640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8105230 0x7f73d81008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dd600640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d8107b60 msgr2=0x7f73d8100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dd600640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d8107b60 0x7f73d8100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dd600640 1 -- 172.21.15.7:0/1832384851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d8101680 con 0x7f73d8102900 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dd600640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 0x7f73d8102270 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00ea80 tx=0x7f73cc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00ce40 con 0x7f73d8102900 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73cc005020 con 0x7f73d8102900 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d81a21f0 con 0x7f73d8102900 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.468+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0116d0 con 0x7f73d8102900 2024-04-23T14:51:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.469+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d81a26f0 con 0x7f73d8102900 2024-04-23T14:51:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.470+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d80fdde0 con 0x7f73d8102900 2024-04-23T14:51:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.472+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138662+0+0 (secure 0 0 0) 0x7f73cc0051d0 con 0x7f73d8102900 2024-04-23T14:51:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.473+0000 7f73d6000640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 0x7f73c00a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.473+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9121+0+0 (secure 0 0 0) 0x7f73cc0d0bb0 con 0x7f73d8102900 2024-04-23T14:51:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.473+0000 7f73dcc00640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 msgr2=0x7f73c00a60b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.473+0000 7f73dcc00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 0x7f73c00a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:51:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.478+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f73cc016030 con 0x7f73d8102900 2024-04-23T14:51:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.496+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 20) ==== 138662+0+0 (secure 0 0 0) 0x7f73cc099180 con 0x7f73d8102900 2024-04-23T14:51:19.500 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:19.210+0000 7f47a42ba200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:51:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.674+0000 7f73dcc00640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 msgr2=0x7f73c00a60b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.674+0000 7f73dcc00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 0x7f73c00a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:51:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:19.761+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f73d802d620 con 0x7f73d8102900 2024-04-23T14:51:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-mon[27906]: Standby manager daemon y restarted 2024-04-23T14:51:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-mon[27906]: Standby manager daemon y started 2024-04-23T14:51:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T14:51:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T14:51:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:19.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z[33764]: 2024-04-23T14:51:19.498+0000 7f47a42ba200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:51:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-mon[31814]: Standby manager daemon y restarted 2024-04-23T14:51:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-mon[31814]: Standby manager daemon y started 2024-04-23T14:51:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T14:51:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:19.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T14:51:19.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:19 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y[33084]: 2024-04-23T14:51:19.420+0000 7f935f81d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-mon[31694]: Standby manager daemon y restarted 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-mon[31694]: Standby manager daemon y started 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T14:51:19.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:19 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.137:0/1841334707' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:20.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.075+0000 7f73dcc00640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 msgr2=0x7f73c00a60b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3440122157 2024-04-23T14:51:20.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.075+0000 7f73dcc00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 0x7f73c00a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T14:51:20.177 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:19 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:19.872+0000 7fea82e7d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T14:51:20.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.209+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7f73cc09a7d0 con 0x7f73d8102900 2024-04-23T14:51:20.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.210+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 msgr2=0x7f73c00a60b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:51:20.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.210+0000 7f73d6000640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 0x7f73c00a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.428 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.175+0000 7fea82e7d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T14:51:20.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.526+0000 7f73d6000640 1 -- 172.21.15.7:0/1832384851 <== mon.0 v2:172.21.15.7:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f73d802d620 con 0x7f73d8102900 2024-04-23T14:51:20.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 msgr2=0x7f73d8102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:20.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 0x7f73d8102270 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00ea80 tx=0x7f73cc00ef40 comp rx=0 tx=0).stop 2024-04-23T14:51:20.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 shutdown_connections 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:6800/3440122157,v1:172.21.15.7:6801/3440122157] conn(0x7f73c00a3bf0 0x7f73c00a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73d8107b60 0x7f73d8100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d8105230 0x7f73d81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 --2- 172.21.15.7:0/1832384851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73d8102900 0x7f73d8102270 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.529+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 >> 172.21.15.7:0/1832384851 conn(0x7f73d80fc2f0 msgr2=0x7f73d8103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.530+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 shutdown_connections 2024-04-23T14:51:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.530+0000 7f73dea00640 1 -- 172.21.15.7:0/1832384851 wait complete. 2024-04-23T14:51:20.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-04-23T14:51:20.681 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.655+0000 7fe9d3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:20.681 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.655+0000 7fe9d3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:20.681 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.655+0000 7fe9d3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:20.681 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.655+0000 7fe9d3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:20.681 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.655+0000 7fe9d3800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:20.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-04-23T14:51:20.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: Standby manager daemon z restarted 2024-04-23T14:51:20.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: Standby manager daemon z started 2024-04-23T14:51:20.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1832384851' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: Active manager daemon x restarted 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: Activating manager daemon x 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: osdmap e94: 12 total, 12 up, 12 in 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: mgrmap e21: x(active, starting, since 0.0313965s), standbys: z, y 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T14:51:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:51:20.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: Manager daemon x is now available 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:51:20.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T14:51:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 -- 172.21.15.7:0/1778888452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4107b60 msgr2=0x7fa4e4109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1778888452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4107b60 0x7fa4e4109fb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009ca0 tx=0x7fa4dc02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 -- 172.21.15.7:0/1778888452 shutdown_connections 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1778888452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4107b60 0x7fa4e4109fb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1778888452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e4105230 0x7fa4e4107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1778888452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102900 0x7fa4e4104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 -- 172.21.15.7:0/1778888452 >> 172.21.15.7:0/1778888452 conn(0x7fa4e40fc2f0 msgr2=0x7fa4e40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 -- 172.21.15.7:0/1778888452 shutdown_connections 2024-04-23T14:51:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.751+0000 7fa4e9800640 1 -- 172.21.15.7:0/1778888452 wait complete. 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.752+0000 7fa4e9800640 1 Processor -- start 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.752+0000 7fa4e9800640 1 -- start start 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102900 0x7fa4e4198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 0x7fa4e41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e4107b60 0x7fa4e419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e410d9b0 con 0x7fa4e4105230 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e410d830 con 0x7fa4e4102900 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e9800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e410db30 con 0x7fa4e4107b60 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 0x7fa4e41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 0x7fa4e41985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44908/0 (socket says 172.21.15.7:44908) 2024-04-23T14:51:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 -- 172.21.15.7:0/1408036165 learned_addr learned my addr 172.21.15.7:0/1408036165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3e00640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102900 0x7fa4e4198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 -- 172.21.15.7:0/1408036165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e4107b60 msgr2=0x7fa4e419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e4107b60 0x7fa4e419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 -- 172.21.15.7:0/1408036165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102900 msgr2=0x7fa4e4198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102900 0x7fa4e4198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.753+0000 7fa4e3400640 1 -- 172.21.15.7:0/1408036165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e419fc80 con 0x7fa4e4105230 2024-04-23T14:51:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.754+0000 7fa4e3400640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 0x7fa4e41985a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000d770 tx=0x7fa4d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.754+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0017070 con 0x7fa4e4105230 2024-04-23T14:51:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.754+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4d0009c30 con 0x7fa4e4105230 2024-04-23T14:51:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.754+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000f620 con 0x7fa4e4105230 2024-04-23T14:51:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.754+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e419ff70 con 0x7fa4e4105230 2024-04-23T14:51:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.754+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e41a0430 con 0x7fa4e4105230 2024-04-23T14:51:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.756+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e40fdde0 con 0x7fa4e4105230 2024-04-23T14:51:20.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.758+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7fa4d001a070 con 0x7fa4e4105230 2024-04-23T14:51:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.760+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fa4d00cfdf0 con 0x7fa4e4105230 2024-04-23T14:51:20.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:20.764+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa4d0009de0 con 0x7fa4e4105230 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: Standby manager daemon z restarted 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: Standby manager daemon z started 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1832384851' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: Active manager daemon x restarted 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: Activating manager daemon x 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: osdmap e94: 12 total, 12 up, 12 in 2024-04-23T14:51:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: mgrmap e21: x(active, starting, since 0.0313965s), standbys: z, y 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T14:51:20.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:51:20.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: Manager daemon x is now available 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:51:20.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T14:51:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-04-23T14:51:20.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: Standby manager daemon z restarted 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: Standby manager daemon z started 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.? 172.21.15.186:0/3236230260' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1832384851' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: Active manager daemon x restarted 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: Activating manager daemon x 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: osdmap e94: 12 total, 12 up, 12 in 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: mgrmap e21: x(active, starting, since 0.0313965s), standbys: z, y 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T14:51:20.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:51:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: Manager daemon x is now available 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:51:20.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T14:51:21.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.679+0000 7fe9d9200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.679+0000 7fe9d9200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.679+0000 7fe9d9200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.679+0000 7fe9d9200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:20 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:20.679+0000 7fe9d9200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.220+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fa4d0097da0 con 0x7fa4e4105230 2024-04-23T14:51:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.221+0000 7fa4e0c00640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4c80abf40 0x7fa4c80ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.221+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fa4c801dc80 con 0x7fa4c80abf40 2024-04-23T14:51:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.226+0000 7fa4e3e00640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4c80abf40 0x7fa4c80ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:21.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.231+0000 7fa4e3e00640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4c80abf40 0x7fa4c80ae330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009bd0 tx=0x7fa4d4005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.283+0000 7fa4e0c00640 1 -- 172.21.15.7:0/1408036165 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fa4c801dc80 con 0x7fa4c80abf40 2024-04-23T14:51:21.285 INFO:teuthology.orchestra.run.smithi007.stdout:{} 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4c80abf40 msgr2=0x7fa4c80ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4c80abf40 0x7fa4c80ae330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009bd0 tx=0x7fa4d4005f90 comp rx=0 tx=0).stop 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 msgr2=0x7fa4e41985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 0x7fa4e41985a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000d770 tx=0x7fa4d000dc30 comp rx=0 tx=0).stop 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 shutdown_connections 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4c80abf40 0x7fa4c80ae330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e4107b60 0x7fa4e419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e4105230 0x7fa4e41985a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 --2- 172.21.15.7:0/1408036165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102900 0x7fa4e4198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 >> 172.21.15.7:0/1408036165 conn(0x7fa4e40fc2f0 msgr2=0x7fa4e4103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.286+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 shutdown_connections 2024-04-23T14:51:21.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.287+0000 7fa4e9800640 1 -- 172.21.15.7:0/1408036165 wait complete. 2024-04-23T14:51:21.304 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-23T14:51:21.316 INFO:teuthology.run_tasks:Running task exec... 2024-04-23T14:51:21.366 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T14:51:21.366 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:51:21.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-23T14:51:21.529 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:21.245+0000 7fe9d1a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.530 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:21.245+0000 7fe9d1a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.530 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:21.245+0000 7fe9d1a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.530 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:21.245+0000 7fe9d1a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.530 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:51:21.245+0000 7fe9d1a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 -- 172.21.15.7:0/787214608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 msgr2=0x7fb1e010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/787214608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e010c6d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009ca0 tx=0x7fb1d802a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 -- 172.21.15.7:0/787214608 shutdown_connections 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/787214608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e010c6d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/787214608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0105480 0x7fb1e0105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/787214608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0104290 0x7fb1e01046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.556+0000 7fb1e6c00640 1 -- 172.21.15.7:0/787214608 >> 172.21.15.7:0/787214608 conn(0x7fb1e00ff820 msgr2=0x7fb1e0101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.557+0000 7fb1e6c00640 1 -- 172.21.15.7:0/787214608 shutdown_connections 2024-04-23T14:51:21.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.557+0000 7fb1e6c00640 1 -- 172.21.15.7:0/787214608 wait complete. 2024-04-23T14:51:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.557+0000 7fb1e6c00640 1 Processor -- start 2024-04-23T14:51:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 -- start start 2024-04-23T14:51:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0104290 0x7fb1e019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0105480 0x7fb1e019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e01a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010fdd0 con 0x7fb1e0105e40 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010fc50 con 0x7fb1e0105480 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e6c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010ff50 con 0x7fb1e0104290 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e01a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1df400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0105480 0x7fb1e019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e01a1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44962/0 (socket says 172.21.15.7:44962) 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1e4c00640 1 -- 172.21.15.7:0/4157533221 learned_addr learned my addr 172.21.15.7:0/4157533221 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.558+0000 7fb1dfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0104290 0x7fb1e019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1df400640 1 -- 172.21.15.7:0/4157533221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0104290 msgr2=0x7fb1e019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1df400640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0104290 0x7fb1e019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1df400640 1 -- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 msgr2=0x7fb1e01a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1df400640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e01a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1df400640 1 -- 172.21.15.7:0/4157533221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01a1fd0 con 0x7fb1e0105480 2024-04-23T14:51:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1e4c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e01a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:51:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1df400640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0105480 0x7fb1e019a8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e9f0 tx=0x7fb1cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.559+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00ccc0 con 0x7fb1e0105480 2024-04-23T14:51:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.560+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1cc0108e0 con 0x7fb1e0105480 2024-04-23T14:51:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.560+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc018880 con 0x7fb1e0105480 2024-04-23T14:51:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.560+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e01a22c0 con 0x7fb1e0105480 2024-04-23T14:51:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.560+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e01a27c0 con 0x7fb1e0105480 2024-04-23T14:51:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.561+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e010b550 con 0x7fb1e0105480 2024-04-23T14:51:21.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.564+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fb1cc010a90 con 0x7fb1e0105480 2024-04-23T14:51:21.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.566+0000 7fb1dcc00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1c40a3ae0 0x7fb1c40a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.566+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fb1cc0d0870 con 0x7fb1e0105480 2024-04-23T14:51:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.566+0000 7fb1dfe00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1c40a3ae0 0x7fb1c40a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.567+0000 7fb1dfe00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1c40a3ae0 0x7fb1c40a5fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb1e01052e0 tx=0x7fb1d0005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.568+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1cc09ca30 con 0x7fb1e0105480 2024-04-23T14:51:21.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.798+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fb1e0062440 con 0x7fb1c40a3ae0 2024-04-23T14:51:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1832384851' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-23T14:51:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:51:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:21 smithi007 ceph-mon[27906]: mgrmap e22: x(active, since 1.03531s), standbys: z, y 2024-04-23T14:51:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:21 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1832384851' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-23T14:51:21.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:21 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:51:21.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:21 smithi186 ceph-mon[31814]: mgrmap e22: x(active, since 1.03531s), standbys: z, y 2024-04-23T14:51:21.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:21 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1832384851' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-23T14:51:21.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:21 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:51:21.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:21 smithi137 ceph-mon[31694]: mgrmap e22: x(active, since 1.03531s), standbys: z, y 2024-04-23T14:51:21.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.925+0000 7fb1dcc00640 1 -- 172.21.15.7:0/4157533221 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb1e0062440 con 0x7fb1c40a3ae0 2024-04-23T14:51:21.927 INFO:teuthology.orchestra.run.smithi007.stdout:Schedule set for path / 2024-04-23T14:51:21.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1c40a3ae0 msgr2=0x7fb1c40a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1c40a3ae0 0x7fb1c40a5fa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb1e01052e0 tx=0x7fb1d0005f90 comp rx=0 tx=0).stop 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0105480 msgr2=0x7fb1e019a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0105480 0x7fb1e019a8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e9f0 tx=0x7fb1cc00eeb0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 shutdown_connections 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1c40a3ae0 0x7fb1c40a5fa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e0105480 0x7fb1e019a8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e0105e40 0x7fb1e01a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 --2- 172.21.15.7:0/4157533221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0104290 0x7fb1e019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 >> 172.21.15.7:0/4157533221 conn(0x7fb1e00ff820 msgr2=0x7fb1e0108720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:21.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 shutdown_connections 2024-04-23T14:51:21.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:21.928+0000 7fb1e6c00640 1 -- 172.21.15.7:0/4157533221 wait complete. 2024-04-23T14:51:21.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-23T14:51:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 -- 172.21.15.7:0/2170591016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60107d40 msgr2=0x7f8c6010a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 --2- 172.21.15.7:0/2170591016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60107d40 0x7f8c6010a190 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009ca0 tx=0x7f8c5802a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 -- 172.21.15.7:0/2170591016 shutdown_connections 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 --2- 172.21.15.7:0/2170591016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c60105410 0x7f8c60107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 --2- 172.21.15.7:0/2170591016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60107d40 0x7f8c6010a190 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 --2- 172.21.15.7:0/2170591016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c60102ae0 0x7f8c60104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 -- 172.21.15.7:0/2170591016 >> 172.21.15.7:0/2170591016 conn(0x7f8c600fc4d0 msgr2=0x7f8c600fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 -- 172.21.15.7:0/2170591016 shutdown_connections 2024-04-23T14:51:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.154+0000 7f8c64c00640 1 -- 172.21.15.7:0/2170591016 wait complete. 2024-04-23T14:51:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 Processor -- start 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 -- start start 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c60102ae0 0x7f8c6019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 0x7f8c6019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c60107d40 0x7f8c601a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010dbf0 con 0x7f8c60105410 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010da70 con 0x7f8c60102ae0 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.155+0000 7f8c64c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010dd70 con 0x7f8c60107d40 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 0x7f8c6019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 0x7f8c6019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44976/0 (socket says 172.21.15.7:44976) 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 -- 172.21.15.7:0/3573938271 learned_addr learned my addr 172.21.15.7:0/3573938271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5e800640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c60107d40 0x7f8c601a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5de00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c60102ae0 0x7f8c6019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 -- 172.21.15.7:0/3573938271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c60107d40 msgr2=0x7f8c601a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c60107d40 0x7f8c601a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 -- 172.21.15.7:0/3573938271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c60102ae0 msgr2=0x7f8c6019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c60102ae0 0x7f8c6019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.156+0000 7f8c5d400640 1 -- 172.21.15.7:0/3573938271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601a2040 con 0x7f8c60105410 2024-04-23T14:51:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.157+0000 7f8c5d400640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 0x7f8c6019a960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00d770 tx=0x7f8c4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.157+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c017070 con 0x7f8c60105410 2024-04-23T14:51:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.157+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c4c009c30 con 0x7f8c60105410 2024-04-23T14:51:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.157+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601a2330 con 0x7f8c60105410 2024-04-23T14:51:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.157+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00f620 con 0x7f8c60105410 2024-04-23T14:51:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.157+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601a2880 con 0x7f8c60105410 2024-04-23T14:51:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.158+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60109830 con 0x7f8c60105410 2024-04-23T14:51:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.161+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f8c4c01a070 con 0x7f8c60105410 2024-04-23T14:51:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.162+0000 7f8c56a00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8c440a3a60 0x7f8c440a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.162+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f8c4c0d0040 con 0x7f8c60105410 2024-04-23T14:51:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.163+0000 7f8c5de00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8c440a3a60 0x7f8c440a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.163+0000 7f8c5de00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8c440a3a60 0x7f8c440a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8c50005fd0 tx=0x7f8c50005850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.172+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8c4c009de0 con 0x7f8c60105410 2024-04-23T14:51:22.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.408+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f8c600625a0 con 0x7f8c440a3a60 2024-04-23T14:51:22.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.564+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 23) ==== 138816+0+0 (secure 0 0 0) 0x7f8c4c098800 con 0x7f8c60105410 2024-04-23T14:51:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.574+0000 7f8c56a00640 1 -- 172.21.15.7:0/3573938271 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f8c600625a0 con 0x7f8c440a3a60 2024-04-23T14:51:22.576 INFO:teuthology.orchestra.run.smithi007.stdout:Retention added to path / 2024-04-23T14:51:22.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.577+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8c440a3a60 msgr2=0x7f8c440a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.577+0000 7f8c64c00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8c440a3a60 0x7f8c440a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8c50005fd0 tx=0x7f8c50005850 comp rx=0 tx=0).stop 2024-04-23T14:51:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.577+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 msgr2=0x7f8c6019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.577+0000 7f8c64c00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 0x7f8c6019a960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00d770 tx=0x7f8c4c00dc30 comp rx=0 tx=0).stop 2024-04-23T14:51:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 shutdown_connections 2024-04-23T14:51:22.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8c440a3a60 0x7f8c440a5f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c60107d40 0x7f8c601a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c60105410 0x7f8c6019a960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 --2- 172.21.15.7:0/3573938271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c60102ae0 0x7f8c6019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 >> 172.21.15.7:0/3573938271 conn(0x7f8c600fc4d0 msgr2=0x7f8c601021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 shutdown_connections 2024-04-23T14:51:22.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.578+0000 7f8c64c00640 1 -- 172.21.15.7:0/3573938271 wait complete. 2024-04-23T14:51:22.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.774+0000 7f1fb9400640 1 -- 172.21.15.7:0/2944700260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4104290 msgr2=0x7f1fb41046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.774+0000 7f1fb9400640 1 --2- 172.21.15.7:0/2944700260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4104290 0x7f1fb41046b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009900 tx=0x7f1fa402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 -- 172.21.15.7:0/2944700260 shutdown_connections 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 --2- 172.21.15.7:0/2944700260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fb4105480 0x7f1fb4105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 --2- 172.21.15.7:0/2944700260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4105e40 0x7f1fb410c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 --2- 172.21.15.7:0/2944700260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4104290 0x7f1fb41046b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 -- 172.21.15.7:0/2944700260 >> 172.21.15.7:0/2944700260 conn(0x7f1fb40ff820 msgr2=0x7f1fb4101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 -- 172.21.15.7:0/2944700260 shutdown_connections 2024-04-23T14:51:22.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.775+0000 7f1fb9400640 1 -- 172.21.15.7:0/2944700260 wait complete. 2024-04-23T14:51:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 Processor -- start 2024-04-23T14:51:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 -- start start 2024-04-23T14:51:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4104290 0x7f1fb419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fb4105480 0x7f1fb419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4105e40 0x7f1fb41a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410fdd0 con 0x7f1fb4105e40 2024-04-23T14:51:22.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410fc50 con 0x7f1fb4105480 2024-04-23T14:51:22.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.776+0000 7f1fb9400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410ff50 con 0x7f1fb4104290 2024-04-23T14:51:22.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4104290 0x7f1fb419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4105e40 0x7f1fb41a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4104290 0x7f1fb419a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:45740/0 (socket says 172.21.15.7:45740) 2024-04-23T14:51:22.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb2800640 1 -- 172.21.15.7:0/1508987008 learned_addr learned my addr 172.21.15.7:0/1508987008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fabe00640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fb4105480 0x7f1fb419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 -- 172.21.15.7:0/1508987008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4104290 msgr2=0x7f1fb419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4104290 0x7f1fb419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 -- 172.21.15.7:0/1508987008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fb4105480 msgr2=0x7f1fb419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fb4105480 0x7f1fb419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 -- 172.21.15.7:0/1508987008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41a2020 con 0x7f1fb4105e40 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.777+0000 7f1fb3200640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4105e40 0x7f1fb41a19b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009fd0 tx=0x7f1fac00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.778+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00ce20 con 0x7f1fb4105e40 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.778+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1fac005020 con 0x7f1fb4105e40 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.778+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac010690 con 0x7f1fb4105e40 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.778+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb41a2310 con 0x7f1fb4105e40 2024-04-23T14:51:22.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.778+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb41a2810 con 0x7f1fb4105e40 2024-04-23T14:51:22.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.779+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb410b630 con 0x7f1fb4105e40 2024-04-23T14:51:22.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.781+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138816+0+0 (secure 0 0 0) 0x7f1fac0051d0 con 0x7f1fb4105e40 2024-04-23T14:51:22.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.783+0000 7f1fab400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1f980a3e60 0x7f1f980a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:22.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.783+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f1fac0d1420 con 0x7f1fb4105e40 2024-04-23T14:51:22.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.784+0000 7f1fb2800640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1f980a3e60 0x7f1f980a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:22.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.784+0000 7f1fb2800640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1f980a3e60 0x7f1f980a6320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40096c0 tx=0x7f1fa4005dd0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:22.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:22.787+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fac09d590 con 0x7f1fb4105e40 2024-04-23T14:51:22.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:22 smithi007 ceph-mon[27906]: [23/Apr/2024:14:51:21] ENGINE Bus STARTING 2024-04-23T14:51:22.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:22 smithi186 ceph-mon[31814]: [23/Apr/2024:14:51:21] ENGINE Bus STARTING 2024-04-23T14:51:22.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:22 smithi137 ceph-mon[31694]: [23/Apr/2024:14:51:21] ENGINE Bus STARTING 2024-04-23T14:51:23.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.042+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f1fb4062440 con 0x7f1f980a3e60 2024-04-23T14:51:23.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.056+0000 7f1fab400640 1 -- 172.21.15.7:0/1508987008 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f1fb4062440 con 0x7f1f980a3e60 2024-04-23T14:51:23.058 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-23T00:00:00", "created": "2024-04-23T14:51:21", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-23T14:51:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1f980a3e60 msgr2=0x7f1f980a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1f980a3e60 0x7f1f980a6320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40096c0 tx=0x7f1fa4005dd0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4105e40 msgr2=0x7f1fb41a19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4105e40 0x7f1fb41a19b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009fd0 tx=0x7f1fac00ef10 comp rx=0 tx=0).stop 2024-04-23T14:51:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 shutdown_connections 2024-04-23T14:51:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1f980a3e60 0x7f1f980a6320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fb4105480 0x7f1fb419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fb4105e40 0x7f1fb41a19b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 --2- 172.21.15.7:0/1508987008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fb4104290 0x7f1fb419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 >> 172.21.15.7:0/1508987008 conn(0x7f1fb40ff820 msgr2=0x7f1fb4108800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 shutdown_connections 2024-04-23T14:51:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.059+0000 7f1fb9400640 1 -- 172.21.15.7:0/1508987008 wait complete. 2024-04-23T14:51:23.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 -- 172.21.15.7:0/2234982612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c102060 msgr2=0x7f7c1c102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 --2- 172.21.15.7:0/2234982612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c102060 0x7f7c1c102480 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009900 tx=0x7f7c0c02a410 comp rx=0 tx=0).stop 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 -- 172.21.15.7:0/2234982612 shutdown_connections 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 --2- 172.21.15.7:0/2234982612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c1c103c10 0x7f7c1c10a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 --2- 172.21.15.7:0/2234982612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103250 0x7f7c1c1036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 --2- 172.21.15.7:0/2234982612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c102060 0x7f7c1c102480 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.263+0000 7f7c21e00640 1 -- 172.21.15.7:0/2234982612 >> 172.21.15.7:0/2234982612 conn(0x7f7c1c0fd5f0 msgr2=0x7f7c1c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.264+0000 7f7c21e00640 1 -- 172.21.15.7:0/2234982612 shutdown_connections 2024-04-23T14:51:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.264+0000 7f7c21e00640 1 -- 172.21.15.7:0/2234982612 wait complete. 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 Processor -- start 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 -- start start 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c1c102060 0x7f7c1c075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 0x7f7c1c0743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103c10 0x7f7c1c074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c10dbf0 con 0x7f7c1c103250 2024-04-23T14:51:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c10da70 con 0x7f7c1c102060 2024-04-23T14:51:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c21e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c10dd70 con 0x7f7c1c103c10 2024-04-23T14:51:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.265+0000 7f7c13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 0x7f7c1c0743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 0x7f7c1c0743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39368/0 (socket says 172.21.15.7:39368) 2024-04-23T14:51:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 -- 172.21.15.7:0/802602625 learned_addr learned my addr 172.21.15.7:0/802602625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c1b400640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103c10 0x7f7c1c074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:23.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c1aa00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c1c102060 0x7f7c1c075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 -- 172.21.15.7:0/802602625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103c10 msgr2=0x7f7c1c074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103c10 0x7f7c1c074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 -- 172.21.15.7:0/802602625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c1c102060 msgr2=0x7f7c1c075db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c1c102060 0x7f7c1c075db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c13e00640 1 -- 172.21.15.7:0/802602625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c0751c0 con 0x7f7c1c103250 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.266+0000 7f7c1b400640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103c10 0x7f7c1c074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.267+0000 7f7c13e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 0x7f7c1c0743f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e9f0 tx=0x7f7c0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.267+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400cd80 con 0x7f7c1c103250 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.267+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c040054d0 con 0x7f7c1c103250 2024-04-23T14:51:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.267+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04010490 con 0x7f7c1c103250 2024-04-23T14:51:23.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.267+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c1a2360 con 0x7f7c1c103250 2024-04-23T14:51:23.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.267+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c1a2860 con 0x7f7c1c103250 2024-04-23T14:51:23.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.268+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c109380 con 0x7f7c1c103250 2024-04-23T14:51:23.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.270+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138816+0+0 (secure 0 0 0) 0x7f7c04005020 con 0x7f7c1c103250 2024-04-23T14:51:23.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.272+0000 7f7c20a00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7c000a3e60 0x7f7c000a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:23.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.272+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f7c040d10f0 con 0x7f7c1c103250 2024-04-23T14:51:23.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.272+0000 7f7c1aa00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7c000a3e60 0x7f7c000a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.273+0000 7f7c1aa00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7c000a3e60 0x7f7c000a6320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c005ab0 tx=0x7f7c0c005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:23.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.277+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7c0409d260 con 0x7f7c1c103250 2024-04-23T14:51:23.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.521+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7c1c062440 con 0x7f7c000a3e60 2024-04-23T14:51:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.546+0000 7f7c20a00640 1 -- 172.21.15.7:0/802602625 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7c1c062440 con 0x7f7c000a3e60 2024-04-23T14:51:23.548 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-04-23T14:51:23.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.549+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7c000a3e60 msgr2=0x7f7c000a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.549+0000 7f7c21e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7c000a3e60 0x7f7c000a6320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c005ab0 tx=0x7f7c0c005a20 comp rx=0 tx=0).stop 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.549+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 msgr2=0x7f7c1c0743f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.549+0000 7f7c21e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 0x7f7c1c0743f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e9f0 tx=0x7f7c0400edf0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 shutdown_connections 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7c000a3e60 0x7f7c000a6320 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c1c103c10 0x7f7c1c074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c1c103250 0x7f7c1c0743f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 --2- 172.21.15.7:0/802602625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c1c102060 0x7f7c1c075db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:23.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 >> 172.21.15.7:0/802602625 conn(0x7f7c1c0fd5f0 msgr2=0x7f7c1c106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:23.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 shutdown_connections 2024-04-23T14:51:23.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T14:51:23.550+0000 7f7c21e00640 1 -- 172.21.15.7:0/802602625 wait complete. 2024-04-23T14:51:23.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-23T14:51:23.647 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-23T14:51:23.658 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-23T14:51:23.684 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T14:51:23.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-23T14:51:23.692 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T14:51:23.755 INFO:tasks.workunit:Pulling workunits from ref d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:51:23.755 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T14:51:23.755 INFO:tasks.workunit:timeout=3h 2024-04-23T14:51:23.755 INFO:tasks.workunit:cleanup=True 2024-04-23T14:51:23.755 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 72h/114d Inode: 1 Links: 2 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-23 14:48:53.369515173 +0000 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-23 14:48:53.369515173 +0000 2024-04-23T14:51:23.800 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-23 14:51:19.262340969 +0000 2024-04-23T14:51:23.801 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-04-23T14:51:23.801 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-23T14:51:23.801 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-23T14:51:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: [23/Apr/2024:14:51:21] ENGINE Serving on https://172.21.15.7:7150 2024-04-23T14:51:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: [23/Apr/2024:14:51:21] ENGINE Serving on http://172.21.15.7:8765 2024-04-23T14:51:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: [23/Apr/2024:14:51:21] ENGINE Bus STARTED 2024-04-23T14:51:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: from='client.35189 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:23.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:23.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:23.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:23 smithi007 ceph-mon[27906]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: [23/Apr/2024:14:51:21] ENGINE Serving on https://172.21.15.7:7150 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: [23/Apr/2024:14:51:21] ENGINE Serving on http://172.21.15.7:8765 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: [23/Apr/2024:14:51:21] ENGINE Bus STARTED 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: from='client.35189 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:23 smithi186 ceph-mon[31814]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-23T14:51:23.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: [23/Apr/2024:14:51:21] ENGINE Serving on https://172.21.15.7:7150 2024-04-23T14:51:23.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: [23/Apr/2024:14:51:21] ENGINE Serving on http://172.21.15.7:8765 2024-04-23T14:51:23.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: [23/Apr/2024:14:51:21] ENGINE Bus STARTED 2024-04-23T14:51:23.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: from='client.35189 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:23.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:23.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:23.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:23 smithi137 ceph-mon[31694]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-23T14:51:23.929 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:51:23.982 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T14:51:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:24.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:24 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:24.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:24 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:24 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:25.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:25 smithi137 ceph-mon[31694]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:25 smithi137 ceph-mon[31694]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-23T14:51:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:25 smithi186 ceph-mon[31814]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:25 smithi186 ceph-mon[31814]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-23T14:51:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:25 smithi007 ceph-mon[27906]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:25 smithi007 ceph-mon[27906]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-23T14:51:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:51:27.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:51:27.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:26 smithi007 ceph-mon[27906]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:27.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:51:27.116 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:26 smithi186 ceph-mon[31814]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:27.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:27.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Updating smithi007:/etc/ceph/ceph.conf 2024-04-23T14:51:27.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-23T14:51:27.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: Updating smithi186:/etc/ceph/ceph.conf 2024-04-23T14:51:27.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:26 smithi137 ceph-mon[31694]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T14:51:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:27 smithi137 ceph-mon[31694]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:27 smithi137 ceph-mon[31694]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:27 smithi137 ceph-mon[31694]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:27 smithi137 ceph-mon[31694]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:27 smithi137 ceph-mon[31694]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:27 smithi137 ceph-mon[31694]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:27 smithi007 ceph-mon[27906]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:27 smithi007 ceph-mon[27906]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:27 smithi007 ceph-mon[27906]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:27 smithi007 ceph-mon[27906]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:27 smithi007 ceph-mon[27906]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:27 smithi007 ceph-mon[27906]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:27 smithi186 ceph-mon[31814]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:27 smithi186 ceph-mon[31814]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:27 smithi186 ceph-mon[31814]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:27 smithi186 ceph-mon[31814]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:27 smithi186 ceph-mon[31814]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:28.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:27 smithi186 ceph-mon[31814]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:28 smithi137 ceph-mon[31694]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 133 KiB/s wr, 81 op/s 2024-04-23T14:51:29.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:28 smithi137 ceph-mon[31694]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:28 smithi137 ceph-mon[31694]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:28 smithi137 ceph-mon[31694]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:28 smithi007 ceph-mon[27906]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 133 KiB/s wr, 81 op/s 2024-04-23T14:51:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:28 smithi007 ceph-mon[27906]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:28 smithi007 ceph-mon[27906]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:28 smithi007 ceph-mon[27906]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:28 smithi186 ceph-mon[31814]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 133 KiB/s wr, 81 op/s 2024-04-23T14:51:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:28 smithi186 ceph-mon[31814]: Updating smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:28 smithi186 ceph-mon[31814]: Updating smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:28 smithi186 ceph-mon[31814]: Updating smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:30.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:30.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:30.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:30.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:30.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:30.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:30.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:51:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:31 smithi186 ceph-mon[31814]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 103 KiB/s wr, 63 op/s 2024-04-23T14:51:31.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:31 smithi007 ceph-mon[27906]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 103 KiB/s wr, 63 op/s 2024-04-23T14:51:31.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:31 smithi137 ceph-mon[31694]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 103 KiB/s wr, 63 op/s 2024-04-23T14:51:33.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:33 smithi007 ceph-mon[27906]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 56 op/s 2024-04-23T14:51:33.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:33 smithi186 ceph-mon[31814]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 56 op/s 2024-04-23T14:51:33.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:33 smithi137 ceph-mon[31694]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 56 op/s 2024-04-23T14:51:35.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:35 smithi007 ceph-mon[27906]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-04-23T14:51:35.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:35 smithi186 ceph-mon[31814]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-04-23T14:51:35.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:35 smithi137 ceph-mon[31694]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-04-23T14:51:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.930+0000 7fdfddc00640 1 -- 172.21.15.7:0/1599797954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102a40 msgr2=0x7fdfd8106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.930+0000 7fdfddc00640 1 --2- 172.21.15.7:0/1599797954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102a40 0x7fdfd8106a80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009ca0 tx=0x7fdfc002a8c0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 -- 172.21.15.7:0/1599797954 shutdown_connections 2024-04-23T14:51:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 --2- 172.21.15.7:0/1599797954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd8107160 0x7fdfd810ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 --2- 172.21.15.7:0/1599797954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102a40 0x7fdfd8106a80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 --2- 172.21.15.7:0/1599797954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfd8102090 0x7fdfd8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 -- 172.21.15.7:0/1599797954 >> 172.21.15.7:0/1599797954 conn(0x7fdfd80fd950 msgr2=0x7fdfd80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 -- 172.21.15.7:0/1599797954 shutdown_connections 2024-04-23T14:51:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.931+0000 7fdfddc00640 1 -- 172.21.15.7:0/1599797954 wait complete. 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 Processor -- start 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 -- start start 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 0x7fdfd81a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfd8107160 0x7fdfd81a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd819a750 0x7fdfd819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81120d0 con 0x7fdfd8102090 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd8111f50 con 0x7fdfd819a750 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfddc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd8112250 con 0x7fdfd8107160 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 0x7fdfd81a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 0x7fdfd81a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39718/0 (socket says 172.21.15.7:39718) 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.932+0000 7fdfd7e00640 1 -- 172.21.15.7:0/3701230210 learned_addr learned my addr 172.21.15.7:0/3701230210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7400640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfd8107160 0x7fdfd81a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfdd200640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd819a750 0x7fdfd819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7e00640 1 -- 172.21.15.7:0/3701230210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfd8107160 msgr2=0x7fdfd81a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfd8107160 0x7fdfd81a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7e00640 1 -- 172.21.15.7:0/3701230210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd819a750 msgr2=0x7fdfd819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd819a750 0x7fdfd819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7e00640 1 -- 172.21.15.7:0/3701230210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd819b350 con 0x7fdfd8102090 2024-04-23T14:51:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 0x7fdfd81a0690 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800d950 tx=0x7fdfc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.933+0000 7fdfd4c00640 1 -- 172.21.15.7:0/3701230210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8017070 con 0x7fdfd8102090 2024-04-23T14:51:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.934+0000 7fdfd4c00640 1 -- 172.21.15.7:0/3701230210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc8009c30 con 0x7fdfd8102090 2024-04-23T14:51:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.934+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd81a7430 con 0x7fdfd8102090 2024-04-23T14:51:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.934+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd81a7830 con 0x7fdfd8102090 2024-04-23T14:51:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.934+0000 7fdfd4c00640 1 -- 172.21.15.7:0/3701230210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800f620 con 0x7fdfd8102090 2024-04-23T14:51:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 Processor -- start 2024-04-23T14:51:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 -- start start 2024-04-23T14:51:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfd4c00640 1 -- 172.21.15.7:0/3701230210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138872+0+0 (secure 0 0 0) 0x7fdfc80109a0 con 0x7fdfd8102090 2024-04-23T14:51:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3c0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3c2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55903f31b900 con 0x55903f3b5ce0 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55903f2c1f20 con 0x55903f3b53c0 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.937+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55903f3178c0 con 0x55903f3c05a0 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3c0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39734/0 (socket says 172.21.15.7:39734) 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 -- 172.21.15.7:0/2371428945 learned_addr learned my addr 172.21.15.7:0/2371428945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfdd200640 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7400640 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 -- 172.21.15.7:0/2371428945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 msgr2=0x55903f3c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 -- 172.21.15.7:0/2371428945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 msgr2=0x55903f3b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.938+0000 7fdfd7e00640 1 -- 172.21.15.7:0/2371428945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55903f2e6e10 con 0x55903f3b5ce0 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3c0060 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80cdcd0 tx=0x7fdfc80d95c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3c8e73f267dc47 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfd4c00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdfbc0a3e30 0x7fdfbc0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfcd600640 1 -- 172.21.15.7:0/2371428945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80d8040 con 0x55903f3b5ce0 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfcd600640 1 -- 172.21.15.7:0/2371428945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc80e2070 con 0x55903f3b5ce0 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfcd600640 1 -- 172.21.15.7:0/2371428945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8076030 con 0x55903f3b5ce0 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfd4c00640 1 -- 172.21.15.7:0/3701230210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fdfc80d0b20 con 0x7fdfd8102090 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.939+0000 7fdfdd200640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdfbc0a3e30 0x7fdfbc0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/2371428945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 msgr2=0x55903f3c0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3c0060 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80cdcd0 tx=0x7fdfc80d95c0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfdd200640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdfbc0a3e30 0x7fdfbc0a62f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0005fd0 tx=0x7fdfd0005dc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/2371428945 shutdown_connections 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3c0060 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/2371428945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/2371428945 >> 172.21.15.7:0/2371428945 conn(0x55903f3b18d0 msgr2=0x55903f3b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/2371428945 shutdown_connections 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.940+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/2371428945 wait complete. 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.941+0000 7fdfe1fc6740 1 -- start start 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.941+0000 7fdfe1fc6740 1 Processor -- start 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b5ce0 0x55903f3bdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 0x55903f3be020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55903f3c2fc0 con 0x55903f3c05a0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55903f2d52c0 con 0x55903f3b53c0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55903f3c3140 con 0x55903f3b5ce0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfe1fc6740 10 client.0 _ll_register_callbacks cb 0x55903f02da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 0x55903f3be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 0x55903f3be020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39750/0 (socket says 172.21.15.7:39750) 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 -- 172.21.15.7:0/1584186215 learned_addr learned my addr 172.21.15.7:0/1584186215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfd7400640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b5ce0 0x55903f3bdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 -- 172.21.15.7:0/1584186215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b5ce0 msgr2=0x55903f3bdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b5ce0 0x55903f3bdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 -- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 msgr2=0x55903f3bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.942+0000 7fdfdd200640 1 -- 172.21.15.7:0/1584186215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55903f2e5fd0 con 0x55903f3c05a0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 0x55903f3be020 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00119a0 tx=0x7fdfd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1843c7bfb2fb31f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfc6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfc6000640 1 -- 172.21.15.7:0/1584186215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0017070 con 0x55903f3c05a0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfc6000640 1 -- 172.21.15.7:0/1584186215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fdfd001cd40 con 0x55903f3c05a0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc80e2070 con 0x55903f3c05a0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfc6000640 1 -- 172.21.15.7:0/1584186215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdfd0031050 con 0x55903f3c05a0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfe1fc6740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.943+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55903f02e210 con 0x55903f3c05a0 2024-04-23T14:51:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfc6000640 1 -- 172.21.15.7:0/1584186215 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc80e2070 con 0x55903f3c05a0 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfc6000640 1 -- 172.21.15.7:0/1584186215 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdfd001d4b0 con 0x55903f3c05a0 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfe1fc6740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfe1fc6740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfe1fc6740 20 client.15648 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f3d06a0 0x55903f3d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfe1fc6740 4 client.15648 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.944+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55903f329320 con 0x55903f3d06a0 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.945+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f3d06a0 0x55903f3d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.946+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f3d06a0 0x55903f3d2a90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7dfbac8a36c276 server_cookie=b404d93b8493038b in_seq=0 out_seq=0 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.946+0000 7fdfc6000640 10 client.15648 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfc6000640 1 -- 172.21.15.7:0/1584186215 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55903f329320 con 0x55903f3d06a0 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfc6000640 10 client.15648 handle_command_reply: tid=0 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 client.15648 shutdown 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 msgr2=0x55903f3be020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 0x55903f3be020 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00119a0 tx=0x7fdfd00046c0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 shutdown_connections 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f3d06a0 0x55903f3d2a90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c05a0 0x55903f3be020 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b5ce0 0x55903f3bdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1584186215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 >> 172.21.15.7:0/1584186215 conn(0x55903f3b18d0 msgr2=0x55903f3b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.948+0000 7fdfc6000640 0 client.15648 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.949+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 shutdown_connections 2024-04-23T14:51:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.949+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1584186215 wait complete. 2024-04-23T14:51:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.949+0000 7fdfe1fc6740 20 client.15648 trim_cache size 0 max 16384 2024-04-23T14:51:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.965+0000 7fdfe1fc6740 1 Processor -- start 2024-04-23T14:51:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 -- start start 2024-04-23T14:51:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3d83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81b14f0 con 0x55903f3b5ce0 2024-04-23T14:51:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81b3030 con 0x55903f3b53c0 2024-04-23T14:51:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81b1bc0 con 0x55903f3c05a0 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfd7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfd7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3b7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39752/0 (socket says 172.21.15.7:39752) 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfd7400640 1 -- 172.21.15.7:0/1768518654 learned_addr learned my addr 172.21.15.7:0/1768518654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3d83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.966+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfd7400640 1 -- 172.21.15.7:0/1768518654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 msgr2=0x55903f3d83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfd7400640 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3d83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfd7400640 1 -- 172.21.15.7:0/1768518654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 msgr2=0x55903f3cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfd7400640 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfd7400640 1 -- 172.21.15.7:0/1768518654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55903f3b6790 con 0x55903f3b5ce0 2024-04-23T14:51:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3d83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.967+0000 7fdfd7400640 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3b7d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdfd806b460 tx=0x7fdfc0031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa157da3298375c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.968+0000 7fdfccc00640 1 -- 172.21.15.7:0/1768518654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc004a070 con 0x55903f3b5ce0 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.968+0000 7fdfccc00640 1 -- 172.21.15.7:0/1768518654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc0036040 con 0x55903f3b5ce0 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.968+0000 7fdfccc00640 1 -- 172.21.15.7:0/1768518654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0004040 con 0x55903f3b5ce0 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1768518654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 msgr2=0x55903f3b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3b7d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdfd806b460 tx=0x7fdfc0031b60 comp rx=0 tx=0).stop 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1768518654 shutdown_connections 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3c05a0 0x55903f3d83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3b5ce0 0x55903f3b7d80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1768518654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3b53c0 0x55903f3cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1768518654 >> 172.21.15.7:0/1768518654 conn(0x55903f3b18d0 msgr2=0x55903f3b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1768518654 shutdown_connections 2024-04-23T14:51:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1768518654 wait complete. 2024-04-23T14:51:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 -- start start 2024-04-23T14:51:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.969+0000 7fdfe1fc6740 1 Processor -- start 2024-04-23T14:51:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b53c0 0x55903f3c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3c05a0 0x55903f3c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 0x55903f435c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81b2960 con 0x55903f3c4bb0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81b2290 con 0x55903f3c05a0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81af4d0 con 0x55903f3b53c0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfe1fc6740 10 client.0 _ll_register_callbacks cb 0x7fdfd0005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfdd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 0x55903f435c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfdd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 0x55903f435c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39764/0 (socket says 172.21.15.7:39764) 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.970+0000 7fdfdd200640 1 -- 172.21.15.7:0/1209352388 learned_addr learned my addr 172.21.15.7:0/1209352388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfd7400640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3c05a0 0x55903f3c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b53c0 0x55903f3c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfdd200640 1 -- 172.21.15.7:0/1209352388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b53c0 msgr2=0x55903f3c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b53c0 0x55903f3c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfdd200640 1 -- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3c05a0 msgr2=0x55903f3c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3c05a0 0x55903f3c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfdd200640 1 -- 172.21.15.7:0/1209352388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55903f0fa620 con 0x55903f3c4bb0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b53c0 0x55903f3c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfdd200640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 0x55903f435c10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdfd001d9a0 tx=0x7fdfd001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a183e17eac859cee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.971+0000 7fdfc6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfc6000640 1 -- 172.21.15.7:0/1209352388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd002e040 con 0x55903f3c4bb0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc0036040 con 0x55903f3c4bb0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfc6000640 1 -- 172.21.15.7:0/1209352388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fdfd001ee00 con 0x55903f3c4bb0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfc6000640 1 -- 172.21.15.7:0/1209352388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdfd001d630 con 0x55903f3c4bb0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55903f437390 con 0x55903f3c4bb0 2024-04-23T14:51:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfc6000640 1 -- 172.21.15.7:0/1209352388 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfc0036040 con 0x55903f3c4bb0 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfc6000640 1 -- 172.21.15.7:0/1209352388 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdfd00047c0 con 0x55903f3c4bb0 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 20 client.15654 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f437b30 0x55903f439f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 4 client.15654 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.972+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55903f323190 con 0x55903f437b30 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.973+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f437b30 0x55903f439f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.974+0000 7fdfd7e00640 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f437b30 0x55903f439f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c70acf66115882c server_cookie=74d2b617181827b9 in_seq=0 out_seq=0 2024-04-23T14:51:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:36.974+0000 7fdfc6000640 10 client.15654 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.006+0000 7fdfc6000640 1 -- 172.21.15.7:0/1209352388 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55903f323190 con 0x55903f437b30 2024-04-23T14:51:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.006+0000 7fdfc6000640 10 client.15654 handle_command_reply: tid=0 2024-04-23T14:51:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.006+0000 7fdfe1fc6740 1 client.15654 shutdown 2024-04-23T14:51:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.006+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 msgr2=0x55903f435c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.006+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 0x55903f435c10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdfd001d9a0 tx=0x7fdfd001c870 comp rx=0 tx=0).stop 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 shutdown_connections 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55903f437b30 0x55903f439f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55903f3c05a0 0x55903f3c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55903f3c4bb0 0x55903f435c10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 --2- 172.21.15.7:0/1209352388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55903f3b53c0 0x55903f3c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfc6000640 0 client.15654 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 >> 172.21.15.7:0/1209352388 conn(0x55903f3b18d0 msgr2=0x55903f3b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 shutdown_connections 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 1 -- 172.21.15.7:0/1209352388 wait complete. 2024-04-23T14:51:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.007+0000 7fdfe1fc6740 20 client.15654 trim_cache size 0 max 16384 2024-04-23T14:51:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:51:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:51:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:51:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdfbc0a3e30 msgr2=0x7fdfbc0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdfbc0a3e30 0x7fdfbc0a62f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0005fd0 tx=0x7fdfd0005dc0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 msgr2=0x7fdfd81a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 0x7fdfd81a0690 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800d950 tx=0x7fdfc800de10 comp rx=0 tx=0).stop 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 shutdown_connections 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdfbc0a3e30 0x7fdfbc0a62f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfd819a750 0x7fdfd819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfd8107160 0x7fdfd81a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 --2- 172.21.15.7:0/3701230210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfd8102090 0x7fdfd81a0690 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 >> 172.21.15.7:0/3701230210 conn(0x7fdfd80fd950 msgr2=0x7fdfd80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 shutdown_connections 2024-04-23T14:51:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:37.008+0000 7fdfddc00640 1 -- 172.21.15.7:0/3701230210 wait complete. 2024-04-23T14:51:37.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:37 smithi007 ceph-mon[27906]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-04-23T14:51:37.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:37 smithi186 ceph-mon[31814]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-04-23T14:51:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:37 smithi137 ceph-mon[31694]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-04-23T14:51:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:39 smithi007 ceph-mon[27906]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-04-23T14:51:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:39 smithi186 ceph-mon[31814]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-04-23T14:51:39.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:39 smithi137 ceph-mon[31694]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-04-23T14:51:41.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:41 smithi007 ceph-mon[27906]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T14:51:41.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:41 smithi186 ceph-mon[31814]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T14:51:41.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:41 smithi137 ceph-mon[31694]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T14:51:43.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:43 smithi007 ceph-mon[27906]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-04-23T14:51:43.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:43 smithi186 ceph-mon[31814]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-04-23T14:51:43.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:43 smithi137 ceph-mon[31694]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-04-23T14:51:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:45 smithi137 ceph-mon[31694]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:51:45.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:45 smithi007 ceph-mon[27906]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:51:45.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:45 smithi186 ceph-mon[31814]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:51:47.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:47 smithi007 ceph-mon[27906]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:51:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:47 smithi186 ceph-mon[31814]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:51:47.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:47 smithi137 ceph-mon[31694]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-23T14:51:49.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:49 smithi007 ceph-mon[27906]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 17 op/s 2024-04-23T14:51:49.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:49 smithi186 ceph-mon[31814]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 17 op/s 2024-04-23T14:51:49.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:49 smithi137 ceph-mon[31694]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 17 op/s 2024-04-23T14:51:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 -- 172.21.15.7:0/309744409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414112cd0 msgr2=0x7f84141150c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 --2- 172.21.15.7:0/309744409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414112cd0 0x7f84141150c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a410 comp rx=0 tx=0).stop 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 -- 172.21.15.7:0/309744409 shutdown_connections 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 --2- 172.21.15.7:0/309744409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414112cd0 0x7f84141150c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 --2- 172.21.15.7:0/309744409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8414076e50 0x7f8414112790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 --2- 172.21.15.7:0/309744409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8414076530 0x7f8414076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 -- 172.21.15.7:0/309744409 >> 172.21.15.7:0/309744409 conn(0x7f84140ffae0 msgr2=0x7f8414101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 -- 172.21.15.7:0/309744409 shutdown_connections 2024-04-23T14:51:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.163+0000 7f8419a00640 1 -- 172.21.15.7:0/309744409 wait complete. 2024-04-23T14:51:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 Processor -- start 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 -- start start 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 0x7f84141a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8414076e50 0x7f84141a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8414112cd0 0x7f841419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84141186c0 con 0x7f8414076530 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8414118540 con 0x7f8414076e50 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.164+0000 7f8419a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8414118840 con 0x7f8414112cd0 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 0x7f84141a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 0x7f84141a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38586/0 (socket says 172.21.15.7:38586) 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 -- 172.21.15.7:0/820511927 learned_addr learned my addr 172.21.15.7:0/820511927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8419000640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8414112cd0 0x7f841419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f840b400640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8414076e50 0x7f84141a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 -- 172.21.15.7:0/820511927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8414112cd0 msgr2=0x7f841419ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8414112cd0 0x7f841419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 -- 172.21.15.7:0/820511927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8414076e50 msgr2=0x7f84141a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8414076e50 0x7f84141a4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 -- 172.21.15.7:0/820511927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841419f1e0 con 0x7f8414076530 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.165+0000 7f8413e00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 0x7f84141a48b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f840400eab0 tx=0x7f840400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.166+0000 7f8411600640 1 -- 172.21.15.7:0/820511927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840400ce40 con 0x7f8414076530 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.166+0000 7f8411600640 1 -- 172.21.15.7:0/820511927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8404011920 con 0x7f8414076530 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.166+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841419f4d0 con 0x7f8414076530 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.166+0000 7f8411600640 1 -- 172.21.15.7:0/820511927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404010a00 con 0x7f8414076530 2024-04-23T14:51:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.166+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84141ab770 con 0x7f8414076530 2024-04-23T14:51:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.169+0000 7f8411600640 1 -- 172.21.15.7:0/820511927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138872+0+0 (secure 0 0 0) 0x7f8404011ad0 con 0x7f8414076530 2024-04-23T14:51:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.169+0000 7f841dfe7740 1 Processor -- start 2024-04-23T14:51:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 -- start start 2024-04-23T14:51:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa08ce0 0x5633faa13060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa15990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633fa96e900 con 0x5633faa135a0 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633fa914f20 con 0x5633faa08ce0 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f841dfe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5633fa96a8c0 con 0x5633faa083c0 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f840b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa15990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f840b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa15990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38600/0 (socket says 172.21.15.7:38600) 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.170+0000 7f840b400640 1 -- 172.21.15.7:0/1277060662 learned_addr learned my addr 172.21.15.7:0/1277060662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f8413e00640 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa08ce0 0x5633faa13060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f8419000640 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f840b400640 1 -- 172.21.15.7:0/1277060662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 msgr2=0x5633faa087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f840b400640 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f840b400640 1 -- 172.21.15.7:0/1277060662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa08ce0 msgr2=0x5633faa13060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f840b400640 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa08ce0 0x5633faa13060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f840b400640 1 -- 172.21.15.7:0/1277060662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fa939e10 con 0x5633faa135a0 2024-04-23T14:51:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f840b400640 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa15990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009a90 tx=0x7f83fc009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df141e9b477de0c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.171+0000 7f8409600640 1 -- 172.21.15.7:0/1277060662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc016070 con 0x5633faa135a0 2024-04-23T14:51:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f8409600640 1 -- 172.21.15.7:0/1277060662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83fc00ecb0 con 0x5633faa135a0 2024-04-23T14:51:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f8409600640 1 -- 172.21.15.7:0/1277060662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc003db0 con 0x5633faa135a0 2024-04-23T14:51:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 -- 172.21.15.7:0/1277060662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 msgr2=0x5633faa15990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa15990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009a90 tx=0x7f83fc009f50 comp rx=0 tx=0).stop 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 -- 172.21.15.7:0/1277060662 shutdown_connections 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa08ce0 0x5633faa13060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa15990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 --2- 172.21.15.7:0/1277060662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 -- 172.21.15.7:0/1277060662 >> 172.21.15.7:0/1277060662 conn(0x5633faa048d0 msgr2=0x5633faa04cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.172+0000 7f841dfe7740 1 -- 172.21.15.7:0/1277060662 shutdown_connections 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.173+0000 7f841dfe7740 1 -- 172.21.15.7:0/1277060662 wait complete. 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.173+0000 7f8411600640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83f80a3d40 0x7f83f80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.173+0000 7f841dfe7740 1 -- start start 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.173+0000 7f841dfe7740 1 Processor -- start 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.173+0000 7f8411600640 1 -- 172.21.15.7:0/820511927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f84040d1580 con 0x7f8414076530 2024-04-23T14:51:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.173+0000 7f8419000640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83f80a3d40 0x7f83f80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa105b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 0x5633faa10af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633faa16170 con 0x5633faa08ce0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633fa9282c0 con 0x5633faa135a0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5633faa162f0 con 0x5633faa083c0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f841dfe7740 10 client.0 _ll_register_callbacks cb 0x5633fa680a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f8419000640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83f80a3d40 0x7f83f80a6200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f840c005ab0 tx=0x7f840c005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f840b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 0x5633faa10af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f840b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 0x5633faa10af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38608/0 (socket says 172.21.15.7:38608) 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f840b400640 1 -- 172.21.15.7:0/467092959 learned_addr learned my addr 172.21.15.7:0/467092959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f8413e00640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.174+0000 7f8419000640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f840b400640 1 -- 172.21.15.7:0/467092959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 msgr2=0x5633faa105b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f840b400640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa105b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f840b400640 1 -- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 msgr2=0x5633faa11030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f840b400640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa11030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f840b400640 1 -- 172.21.15.7:0/467092959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633fa938fd0 con 0x5633faa08ce0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f840b400640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 0x5633faa10af0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0042f0 tx=0x7f83fc004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a067f34e8f9031eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f8402000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f8402000640 1 -- 172.21.15.7:0/467092959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc028060 con 0x5633faa08ce0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f8402000640 1 -- 172.21.15.7:0/467092959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f83fc00eab0 con 0x5633faa08ce0 2024-04-23T14:51:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.175+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83fc00ecb0 con 0x5633faa08ce0 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f8402000640 1 -- 172.21.15.7:0/467092959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f83fc02f050 con 0x5633faa08ce0 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 10 client.15666 fetch_fsmap learned FSMap version 28 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5633fa681210 con 0x5633faa08ce0 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f8402000640 1 -- 172.21.15.7:0/467092959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83fc00ecb0 con 0x5633faa08ce0 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f8402000640 1 -- 172.21.15.7:0/467092959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83fc00f040 con 0x5633faa08ce0 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 10 client.15666 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 20 client.15666 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa23650 0x5633faa25a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 4 client.15666 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.176+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633fa97c320 con 0x5633faa23650 2024-04-23T14:51:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.177+0000 7f8413e00640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa23650 0x5633faa25a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.178+0000 7f8413e00640 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa23650 0x5633faa25a40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccea309f92970f49 server_cookie=6d75a92f5997eec1 in_seq=0 out_seq=0 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.178+0000 7f8402000640 10 client.15666 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f8402000640 1 -- 172.21.15.7:0/467092959 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633fa97c320 con 0x5633faa23650 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f8402000640 10 client.15666 handle_command_reply: tid=0 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 client.15666 shutdown 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 msgr2=0x5633faa10af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 0x5633faa10af0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0042f0 tx=0x7f83fc004320 comp rx=0 tx=0).stop 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 shutdown_connections 2024-04-23T14:51:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa23650 0x5633faa25a40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa11030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa08ce0 0x5633faa10af0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 --2- 172.21.15.7:0/467092959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa083c0 0x5633faa105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f8402000640 0 client.15666 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.180+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 >> 172.21.15.7:0/467092959 conn(0x5633faa048d0 msgr2=0x5633faa0a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.181+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 shutdown_connections 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.181+0000 7f841dfe7740 1 -- 172.21.15.7:0/467092959 wait complete. 2024-04-23T14:51:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.181+0000 7f841dfe7740 20 client.15666 trim_cache size 0 max 16384 2024-04-23T14:51:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 Processor -- start 2024-04-23T14:51:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 -- start start 2024-04-23T14:51:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 0x5633faa03cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa0ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa2b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b5740 con 0x5633faa083c0 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b7280 con 0x5633faa135a0 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f841dfe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b5e10 con 0x5633faa08ce0 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f8413e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 0x5633faa03cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f8413e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 0x5633faa03cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38614/0 (socket says 172.21.15.7:38614) 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.198+0000 7f8413e00640 1 -- 172.21.15.7:0/481408333 learned_addr learned my addr 172.21.15.7:0/481408333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f840b400640 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa0ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8419000640 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa2b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8413e00640 1 -- 172.21.15.7:0/481408333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 msgr2=0x5633faa0ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8413e00640 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa0ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8413e00640 1 -- 172.21.15.7:0/481408333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 msgr2=0x5633faa2b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8413e00640 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa2b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8413e00640 1 -- 172.21.15.7:0/481408333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fa74d620 con 0x5633faa083c0 2024-04-23T14:51:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.199+0000 7f8413e00640 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 0x5633faa03cd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f84040ce730 tx=0x7f84040d39d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931b495cfc702e52 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f8408c00640 1 -- 172.21.15.7:0/481408333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840409cf10 con 0x5633faa083c0 2024-04-23T14:51:50.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f8408c00640 1 -- 172.21.15.7:0/481408333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84040a12c0 con 0x5633faa083c0 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f8408c00640 1 -- 172.21.15.7:0/481408333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840409d170 con 0x5633faa083c0 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 -- 172.21.15.7:0/481408333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 msgr2=0x5633faa03cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 0x5633faa03cd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f84040ce730 tx=0x7f84040d39d0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 -- 172.21.15.7:0/481408333 shutdown_connections 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa135a0 0x5633faa2b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa0ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 --2- 172.21.15.7:0/481408333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa083c0 0x5633faa03cd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.200+0000 7f841dfe7740 1 -- 172.21.15.7:0/481408333 >> 172.21.15.7:0/481408333 conn(0x5633faa048d0 msgr2=0x5633faa10e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.201+0000 7f841dfe7740 1 -- 172.21.15.7:0/481408333 shutdown_connections 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.201+0000 7f841dfe7740 1 -- 172.21.15.7:0/481408333 wait complete. 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.201+0000 7f841dfe7740 1 -- start start 2024-04-23T14:51:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.201+0000 7f841dfe7740 1 Processor -- start 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa083c0 0x5633faa1b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa18510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa18a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b6bb0 con 0x5633faa135a0 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b64e0 con 0x5633faa083c0 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b3720 con 0x5633faa08ce0 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f841dfe7740 10 client.0 _ll_register_callbacks cb 0x7f83fc009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa18a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa18a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38624/0 (socket says 172.21.15.7:38624) 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 -- 172.21.15.7:0/3380296342 learned_addr learned my addr 172.21.15.7:0/3380296342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8413e00640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa083c0 0x5633faa1b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f840b400640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa18510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 -- 172.21.15.7:0/3380296342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 msgr2=0x5633faa18510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa18510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 -- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa083c0 msgr2=0x5633faa1b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa083c0 0x5633faa1b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.202+0000 7f8419000640 1 -- 172.21.15.7:0/3380296342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633faa18f90 con 0x5633faa135a0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f8419000640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa18a50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b597cb112d29dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f8402000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f8402000640 1 -- 172.21.15.7:0/3380296342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c035050 con 0x5633faa135a0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f8402000640 1 -- 172.21.15.7:0/3380296342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f840c005250 con 0x5633faa135a0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84040a12c0 con 0x5633faa135a0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f8402000640 1 -- 172.21.15.7:0/3380296342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f840c05b050 con 0x5633faa135a0 2024-04-23T14:51:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f841dfe7740 10 client.15672 fetch_fsmap learned FSMap version 28 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.203+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5633faa8a620 con 0x5633faa135a0 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f8402000640 1 -- 172.21.15.7:0/3380296342 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84040a12c0 con 0x5633faa135a0 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f8402000640 1 -- 172.21.15.7:0/3380296342 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f840c0035f0 con 0x5633faa135a0 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f841dfe7740 10 client.15672 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f841dfe7740 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f841dfe7740 20 client.15672 populate_metadata read hostname 'smithi007' 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f841dfe7740 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa8add0 0x5633faa8d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f841dfe7740 4 client.15672 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:51:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.204+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633fa976190 con 0x5633faa8add0 2024-04-23T14:51:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.205+0000 7f8413e00640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa8add0 0x5633faa8d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.206+0000 7f8413e00640 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa8add0 0x5633faa8d1f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a911779ecf6a15b server_cookie=5bdd544cd01f2a16 in_seq=0 out_seq=0 2024-04-23T14:51:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.206+0000 7f8402000640 10 client.15672 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f8402000640 1 -- 172.21.15.7:0/3380296342 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633fa976190 con 0x5633faa8add0 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f8402000640 10 client.15672 handle_command_reply: tid=0 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 client.15672 shutdown 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 msgr2=0x5633faa18a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa18a50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a410 comp rx=0 tx=0).stop 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 shutdown_connections 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633faa8add0 0x5633faa8d1f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f8402000640 0 client.15672 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633faa135a0 0x5633faa18a50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633faa08ce0 0x5633faa18510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 --2- 172.21.15.7:0/3380296342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633faa083c0 0x5633faa1b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 >> 172.21.15.7:0/3380296342 conn(0x5633faa048d0 msgr2=0x5633faa11de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 shutdown_connections 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.216+0000 7f841dfe7740 1 -- 172.21.15.7:0/3380296342 wait complete. 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f841dfe7740 20 client.15672 trim_cache size 0 max 16384 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:51:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:51:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83f80a3d40 msgr2=0x7f83f80a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83f80a3d40 0x7f83f80a6200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f840c005ab0 tx=0x7f840c005a20 comp rx=0 tx=0).stop 2024-04-23T14:51:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 msgr2=0x7f84141a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 0x7f84141a48b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f840400eab0 tx=0x7f840400ef70 comp rx=0 tx=0).stop 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 shutdown_connections 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83f80a3d40 0x7f83f80a6200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8414076e50 0x7f84141a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8414112cd0 0x7f841419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 --2- 172.21.15.7:0/820511927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8414076530 0x7f84141a48b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.217+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 >> 172.21.15.7:0/820511927 conn(0x7f84140ffae0 msgr2=0x7f8414101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.218+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 shutdown_connections 2024-04-23T14:51:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:51:50.218+0000 7f8419a00640 1 -- 172.21.15.7:0/820511927 wait complete. 2024-04-23T14:51:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:51 smithi186 ceph-mon[31814]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-23T14:51:51.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:51 smithi137 ceph-mon[31694]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-23T14:51:51.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:51 smithi007 ceph-mon[27906]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-23T14:51:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:53 smithi186 ceph-mon[31814]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2024-04-23T14:51:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:53 smithi137 ceph-mon[31694]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2024-04-23T14:51:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:53 smithi007 ceph-mon[27906]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2024-04-23T14:51:55.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:55 smithi186 ceph-mon[31814]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:51:55.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:55 smithi137 ceph-mon[31694]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:51:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:55 smithi007 ceph-mon[27906]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:51:57.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:57 smithi137 ceph-mon[31694]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:51:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:57 smithi007 ceph-mon[27906]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:51:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:57 smithi186 ceph-mon[31814]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:51:59.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:51:59 smithi137 ceph-mon[31694]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:51:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:51:59 smithi007 ceph-mon[27906]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:51:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:51:59 smithi186 ceph-mon[31814]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:01.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:52:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:52:00.604+0000 7fe9a4000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:52:01.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:52:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:52:00.604+0000 7fe9a4000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:52:01.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:52:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:52:00.604+0000 7fe9a4000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:52:01.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:52:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:52:00.604+0000 7fe9a4000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:52:01.086 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 14:52:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T14:52:00.604+0000 7fe9a4000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T14:52:01.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:01 smithi186 ceph-mon[31814]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:01.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:01 smithi137 ceph-mon[31694]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:01 smithi007 ceph-mon[27906]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 -- 172.21.15.7:0/3129714109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 msgr2=0x7f48f0105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 --2- 172.21.15.7:0/3129714109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f0105e60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009900 tx=0x7f48dc02a510 comp rx=0 tx=0).stop 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 -- 172.21.15.7:0/3129714109 shutdown_connections 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 --2- 172.21.15.7:0/3129714109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48f01063a0 0x7f48f0106830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 --2- 172.21.15.7:0/3129714109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f0105e60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 --2- 172.21.15.7:0/3129714109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48f0101080 0x7f48f0101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 -- 172.21.15.7:0/3129714109 >> 172.21.15.7:0/3129714109 conn(0x7f48f0078080 msgr2=0x7f48f0078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 -- 172.21.15.7:0/3129714109 shutdown_connections 2024-04-23T14:52:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.366+0000 7f48f8000640 1 -- 172.21.15.7:0/3129714109 wait complete. 2024-04-23T14:52:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.367+0000 7f48f8000640 1 Processor -- start 2024-04-23T14:52:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.367+0000 7f48f8000640 1 -- start start 2024-04-23T14:52:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f8000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48f0101080 0x7f48f019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f8000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f8000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48f01063a0 0x7f48f01a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f8000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01188d0 con 0x7f48f01019a0 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f8000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0118750 con 0x7f48f01063a0 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f8000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0118a50 con 0x7f48f0101080 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f019f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53968/0 (socket says 172.21.15.7:53968) 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f4c00640 1 -- 172.21.15.7:0/1378732766 learned_addr learned my addr 172.21.15.7:0/1378732766 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f5600640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48f0101080 0x7f48f019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.368+0000 7f48f6000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48f01063a0 0x7f48f01a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f4c00640 1 -- 172.21.15.7:0/1378732766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48f0101080 msgr2=0x7f48f019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f4c00640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48f0101080 0x7f48f019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f4c00640 1 -- 172.21.15.7:0/1378732766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48f01063a0 msgr2=0x7f48f01a35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f4c00640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48f01063a0 0x7f48f01a35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f4c00640 1 -- 172.21.15.7:0/1378732766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f01a3d10 con 0x7f48f01019a0 2024-04-23T14:52:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f4c00640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f019f2b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48dc005ab0 tx=0x7f48dc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48ee000640 1 -- 172.21.15.7:0/1378732766 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc03f070 con 0x7f48f01019a0 2024-04-23T14:52:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48ee000640 1 -- 172.21.15.7:0/1378732766 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48dc031d60 con 0x7f48f01019a0 2024-04-23T14:52:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f01a3fa0 con 0x7f48f01019a0 2024-04-23T14:52:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.369+0000 7f48ee000640 1 -- 172.21.15.7:0/1378732766 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc035030 con 0x7f48f01019a0 2024-04-23T14:52:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.370+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f01ab890 con 0x7f48f01019a0 2024-04-23T14:52:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.373+0000 7f48fae27740 1 Processor -- start 2024-04-23T14:52:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.373+0000 7f48fae27740 1 -- start start 2024-04-23T14:52:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.373+0000 7f48ee000640 1 -- 172.21.15.7:0/1378732766 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138929+0+0 (secure 0 0 0) 0x7f48dc042070 con 0x7f48f01019a0 2024-04-23T14:52:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48fae27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 0x55e89849f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48fae27740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48fae27740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984ac780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48fae27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e898405900 con 0x55e89849f1b0 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48fae27740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e8983abf20 con 0x55e8984aa390 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48fae27740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e8984018c0 con 0x55e89849fad0 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 0x55e89849f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 0x55e89849f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53970/0 (socket says 172.21.15.7:53970) 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.374+0000 7f48f6000640 1 -- 172.21.15.7:0/2345855652 learned_addr learned my addr 172.21.15.7:0/2345855652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f4c00640 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f5600640 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f6000640 1 -- 172.21.15.7:0/2345855652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 msgr2=0x55e8984a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f6000640 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f6000640 1 -- 172.21.15.7:0/2345855652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 msgr2=0x55e8984ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f6000640 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f6000640 1 -- 172.21.15.7:0/2345855652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8983d0e10 con 0x55e89849f1b0 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48f6000640 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 0x55e89849f590 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007dd0 tx=0x7f48e800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61133ce167b867db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.375+0000 7f48e2600640 1 -- 172.21.15.7:0/2345855652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8014070 con 0x55e89849f1b0 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48ee000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48d80a3f70 0x7f48d80a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48e2600640 1 -- 172.21.15.7:0/2345855652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e8004d20 con 0x55e89849f1b0 2024-04-23T14:52:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48e2600640 1 -- 172.21.15.7:0/2345855652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80107b0 con 0x55e89849f1b0 2024-04-23T14:52:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48ee000640 1 -- 172.21.15.7:0/1378732766 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f48dc0f17e0 con 0x7f48f01019a0 2024-04-23T14:52:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48f5600640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48d80a3f70 0x7f48d80a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48fae27740 1 -- 172.21.15.7:0/2345855652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 msgr2=0x55e89849f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.376+0000 7f48fae27740 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 0x55e89849f590 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007dd0 tx=0x7f48e800e720 comp rx=0 tx=0).stop 2024-04-23T14:52:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 -- 172.21.15.7:0/2345855652 shutdown_connections 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 --2- 172.21.15.7:0/2345855652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849f1b0 0x55e89849f590 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 -- 172.21.15.7:0/2345855652 >> 172.21.15.7:0/2345855652 conn(0x55e89849b6c0 msgr2=0x55e89849baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 -- 172.21.15.7:0/2345855652 shutdown_connections 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48f5600640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48d80a3f70 0x7f48d80a6430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48e4005fd0 tx=0x7f48e400b650 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 -- 172.21.15.7:0/2345855652 wait complete. 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 -- start start 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.377+0000 7f48fae27740 1 Processor -- start 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984a7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8984acfc0 con 0x55e8984aa390 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e8983bf2c0 con 0x55e89849f1b0 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e8984ad140 con 0x55e89849fad0 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48fae27740 10 client.0 _ll_register_callbacks cb 0x55e898117a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984a7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53982/0 (socket says 172.21.15.7:53982) 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48f6000640 1 -- 172.21.15.7:0/1608108549 learned_addr learned my addr 172.21.15.7:0/1608108549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.378+0000 7f48f5600640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f4c00640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f6000640 1 -- 172.21.15.7:0/1608108549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 msgr2=0x55e8984a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f6000640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f6000640 1 -- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 msgr2=0x55e8984a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f6000640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984a7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f6000640 1 -- 172.21.15.7:0/1608108549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8983cffd0 con 0x55e8984aa390 2024-04-23T14:52:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f4c00640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48f6000640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984a7d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000f80 tx=0x7f48e8005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d77b4de46298a4a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48d6a00640 1 -- 172.21.15.7:0/1608108549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8027060 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e8004d20 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.379+0000 7f48d6a00640 1 -- 172.21.15.7:0/1608108549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f48e8010550 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48d6a00640 1 -- 172.21.15.7:0/1608108549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48e802e050 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e898118210 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48d6a00640 1 -- 172.21.15.7:0/1608108549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e8004d20 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48d6a00640 1 -- 172.21.15.7:0/1608108549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48e8018780 con 0x55e8984aa390 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 20 client.15690 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8984ba3f0 0x55e8984bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 4 client.15690 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:52:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.380+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e898413320 con 0x55e8984ba3f0 2024-04-23T14:52:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.381+0000 7f48f5600640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8984ba3f0 0x55e8984bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.382+0000 7f48f5600640 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8984ba3f0 0x55e8984bc7e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f0685c74e77f1 server_cookie=be45131c58c1aa8 in_seq=0 out_seq=0 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.382+0000 7f48d6a00640 10 client.15690 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.384+0000 7f48d6a00640 1 -- 172.21.15.7:0/1608108549 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e898413320 con 0x55e8984ba3f0 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.384+0000 7f48d6a00640 10 client.15690 handle_command_reply: tid=0 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.384+0000 7f48fae27740 1 client.15690 shutdown 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 msgr2=0x55e8984a7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984a7d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000f80 tx=0x7f48e8005720 comp rx=0 tx=0).stop 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 shutdown_connections 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8984ba3f0 0x55e8984bc7e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984a7d90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 --2- 172.21.15.7:0/1608108549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984a7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 >> 172.21.15.7:0/1608108549 conn(0x55e89849b6c0 msgr2=0x55e8984a13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48d6a00640 0 client.15690 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 shutdown_connections 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 1 -- 172.21.15.7:0/1608108549 wait complete. 2024-04-23T14:52:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.385+0000 7f48fae27740 20 client.15690 trim_cache size 0 max 16384 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 Processor -- start 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 -- start start 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01b58b0 con 0x55e8984aa390 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01b73f0 con 0x55e89849f1b0 2024-04-23T14:52:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.402+0000 7f48fae27740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01b5f80 con 0x55e89849fad0 2024-04-23T14:52:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53984/0 (socket says 172.21.15.7:53984) 2024-04-23T14:52:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 -- 172.21.15.7:0/2056543183 learned_addr learned my addr 172.21.15.7:0/2056543183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f5600640 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f4c00640 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 -- 172.21.15.7:0/2056543183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 msgr2=0x55e8984a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 -- 172.21.15.7:0/2056543183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 msgr2=0x55e8984b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.403+0000 7f48f6000640 1 -- 172.21.15.7:0/2056543183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8981e4620 con 0x55e8984aa390 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.404+0000 7f48f6000640 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984c1db0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f48e8005c00 tx=0x7f48e80052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6967883872a3fe32 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.404+0000 7f48e1c00640 1 -- 172.21.15.7:0/2056543183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8037070 con 0x55e8984aa390 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.404+0000 7f48e1c00640 1 -- 172.21.15.7:0/2056543183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e8003e20 con 0x55e8984aa390 2024-04-23T14:52:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.404+0000 7f48e1c00640 1 -- 172.21.15.7:0/2056543183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8027070 con 0x55e8984aa390 2024-04-23T14:52:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 -- 172.21.15.7:0/2056543183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 msgr2=0x55e8984c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984c1db0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f48e8005c00 tx=0x7f48e80052b0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 -- 172.21.15.7:0/2056543183 shutdown_connections 2024-04-23T14:52:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8984aa390 0x55e8984c1db0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849fad0 0x55e8984a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 --2- 172.21.15.7:0/2056543183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e89849f1b0 0x55e8984b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 -- 172.21.15.7:0/2056543183 >> 172.21.15.7:0/2056543183 conn(0x55e89849b6c0 msgr2=0x55e8984a6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 -- 172.21.15.7:0/2056543183 shutdown_connections 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 -- 172.21.15.7:0/2056543183 wait complete. 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.405+0000 7f48fae27740 1 -- start start 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 Processor -- start 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849f1b0 0x55e8984a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 0x55e8984a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01b6d20 con 0x55e89849fad0 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01b6650 con 0x55e8984aa390 2024-04-23T14:52:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01b3890 con 0x55e89849f1b0 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48fae27740 10 client.0 _ll_register_callbacks cb 0x7f48e8007c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 0x55e8984a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 0x55e8984a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53992/0 (socket says 172.21.15.7:53992) 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.406+0000 7f48f4c00640 1 -- 172.21.15.7:0/283249257 learned_addr learned my addr 172.21.15.7:0/283249257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f6000640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f5600640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849f1b0 0x55e8984a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f4c00640 1 -- 172.21.15.7:0/283249257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849f1b0 msgr2=0x55e8984a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f4c00640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849f1b0 0x55e8984a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f4c00640 1 -- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 msgr2=0x55e8984a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f4c00640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f4c00640 1 -- 172.21.15.7:0/283249257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89851f6d0 con 0x55e89849fad0 2024-04-23T14:52:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f5600640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849f1b0 0x55e8984a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48f4c00640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 0x55e8984a4590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0b9bb0 tx=0x7f48dc02a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca7625e8fba8283 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48d6a00640 1 -- 172.21.15.7:0/283249257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc049040 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48d6a00640 1 -- 172.21.15.7:0/283249257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f48dc0f1420 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.407+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e8003e20 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48d6a00640 1 -- 172.21.15.7:0/283249257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48dc0f1620 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 10 client.15696 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8985209c0 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48d6a00640 1 -- 172.21.15.7:0/283249257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e8003e20 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48d6a00640 1 -- 172.21.15.7:0/283249257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48dc0c1160 con 0x55e89849fad0 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 10 client.15696 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 20 client.15696 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e898521090 0x55e898523480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 4 client.15696 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:52:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.408+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e89840d190 con 0x55e898521090 2024-04-23T14:52:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.409+0000 7f48f5600640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e898521090 0x55e898523480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.410+0000 7f48f5600640 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e898521090 0x55e898523480 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d44f0bbbd26a07 server_cookie=ced0b8bc16e0fef9 in_seq=0 out_seq=0 2024-04-23T14:52:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.410+0000 7f48d6a00640 10 client.15696 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48d6a00640 1 -- 172.21.15.7:0/283249257 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e89840d190 con 0x55e898521090 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48d6a00640 10 client.15696 handle_command_reply: tid=0 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 client.15696 shutdown 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 msgr2=0x55e8984a4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 0x55e8984a4590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0b9bb0 tx=0x7f48dc02a510 comp rx=0 tx=0).stop 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 shutdown_connections 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e898521090 0x55e898523480 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8984aa390 0x55e8984a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e89849fad0 0x55e8984a4590 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 --2- 172.21.15.7:0/283249257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89849f1b0 0x55e8984a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 >> 172.21.15.7:0/283249257 conn(0x55e89849b6c0 msgr2=0x55e8984a0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48d6a00640 0 client.15696 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 shutdown_connections 2024-04-23T14:52:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 1 -- 172.21.15.7:0/283249257 wait complete. 2024-04-23T14:52:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.426+0000 7f48fae27740 20 client.15696 trim_cache size 0 max 16384 2024-04-23T14:52:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:52:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:52:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:52:03.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48d80a3f70 msgr2=0x7f48d80a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48d80a3f70 0x7f48d80a6430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48e4005fd0 tx=0x7f48e400b650 comp rx=0 tx=0).stop 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 msgr2=0x7f48f019f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f019f2b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48dc005ab0 tx=0x7f48dc003cd0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 shutdown_connections 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48d80a3f70 0x7f48d80a6430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48f01063a0 0x7f48f01a35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48f01019a0 0x7f48f019f2b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 --2- 172.21.15.7:0/1378732766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48f0101080 0x7f48f019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.427+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 >> 172.21.15.7:0/1378732766 conn(0x7f48f0078080 msgr2=0x7f48f0103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.428+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 shutdown_connections 2024-04-23T14:52:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:03.428+0000 7f48f8000640 1 -- 172.21.15.7:0/1378732766 wait complete. 2024-04-23T14:52:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:03 smithi137 ceph-mon[31694]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-23T14:52:03.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:03 smithi137 ceph-mon[31694]: mgrmap e25: x(active, since 42s), standbys: z, y 2024-04-23T14:52:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:03 smithi007 ceph-mon[27906]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-23T14:52:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:03 smithi007 ceph-mon[27906]: mgrmap e25: x(active, since 42s), standbys: z, y 2024-04-23T14:52:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:03 smithi186 ceph-mon[31814]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-23T14:52:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:03 smithi186 ceph-mon[31814]: mgrmap e25: x(active, since 42s), standbys: z, y 2024-04-23T14:52:05.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:05 smithi137 ceph-mon[31694]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-23T14:52:05.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:05 smithi007 ceph-mon[27906]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-23T14:52:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:05 smithi186 ceph-mon[31814]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-23T14:52:07.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:07 smithi137 ceph-mon[31694]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T14:52:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:07 smithi007 ceph-mon[27906]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T14:52:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:07 smithi186 ceph-mon[31814]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T14:52:09.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:09 smithi137 ceph-mon[31694]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-23T14:52:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:09 smithi007 ceph-mon[27906]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-23T14:52:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:09 smithi186 ceph-mon[31814]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-23T14:52:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:11 smithi007 ceph-mon[27906]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-23T14:52:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:11 smithi186 ceph-mon[31814]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-23T14:52:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:11 smithi137 ceph-mon[31694]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-23T14:52:13.720 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:13 smithi137 ceph-mon[31694]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-23T14:52:13.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:13 smithi007 ceph-mon[27906]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-23T14:52:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:13 smithi186 ceph-mon[31814]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-23T14:52:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:15 smithi007 ceph-mon[27906]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-23T14:52:15.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:15 smithi186 ceph-mon[31814]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-23T14:52:15.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:15 smithi137 ceph-mon[31694]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-23T14:52:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.573+0000 7f49ab200640 1 -- 172.21.15.7:0/2542274681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 msgr2=0x7f49ac102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.573+0000 7f49ab200640 1 --2- 172.21.15.7:0/2542274681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac102460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f499c009900 tx=0x7f499c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.573+0000 7f49ab200640 1 -- 172.21.15.7:0/2542274681 shutdown_connections 2024-04-23T14:52:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.573+0000 7f49ab200640 1 --2- 172.21.15.7:0/2542274681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49ac107150 0x7f49ac10ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.574+0000 7f49ab200640 1 --2- 172.21.15.7:0/2542274681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49ac102a30 0x7f49ac106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.574+0000 7f49ab200640 1 --2- 172.21.15.7:0/2542274681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac102460 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.574+0000 7f49ab200640 1 -- 172.21.15.7:0/2542274681 >> 172.21.15.7:0/2542274681 conn(0x7f49ac0fd940 msgr2=0x7f49ac0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.574+0000 7f49ab200640 1 -- 172.21.15.7:0/2542274681 shutdown_connections 2024-04-23T14:52:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.574+0000 7f49ab200640 1 -- 172.21.15.7:0/2542274681 wait complete. 2024-04-23T14:52:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 Processor -- start 2024-04-23T14:52:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 -- start start 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49ac107150 0x7f49ac198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49ac19cf70 0x7f49ac19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1120b0 con 0x7f49ac102080 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac111f30 con 0x7f49ac107150 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49ab200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac112230 con 0x7f49ac19cf70 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.575+0000 7f49a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac1986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41794/0 (socket says 172.21.15.7:41794) 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 -- 172.21.15.7:0/4153382998 learned_addr learned my addr 172.21.15.7:0/4153382998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 -- 172.21.15.7:0/4153382998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49ac19cf70 msgr2=0x7f49ac19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a1400640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49ac107150 0x7f49ac198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49ac19cf70 0x7f49ac19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 -- 172.21.15.7:0/4153382998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49ac107150 msgr2=0x7f49ac198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49ac107150 0x7f49ac198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 -- 172.21.15.7:0/4153382998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac19da60 con 0x7f49ac102080 2024-04-23T14:52:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.576+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac1986b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f499c006010 tx=0x7f499c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.577+0000 7f49a3400640 1 -- 172.21.15.7:0/4153382998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c03f030 con 0x7f49ac102080 2024-04-23T14:52:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.577+0000 7f49a3400640 1 -- 172.21.15.7:0/4153382998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f499c0035f0 con 0x7f49ac102080 2024-04-23T14:52:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.577+0000 7f49a3400640 1 -- 172.21.15.7:0/4153382998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c035070 con 0x7f49ac102080 2024-04-23T14:52:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.577+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ac19dcf0 con 0x7f49ac102080 2024-04-23T14:52:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.577+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ac1a5510 con 0x7f49ac102080 2024-04-23T14:52:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.580+0000 7f49a3400640 1 -- 172.21.15.7:0/4153382998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138929+0+0 (secure 0 0 0) 0x7f499c003b10 con 0x7f49ac102080 2024-04-23T14:52:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.580+0000 7f49b37bd740 1 Processor -- start 2024-04-23T14:52:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 -- start start 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0de7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 0x55f99f0e9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0e95a0 0x55f99f0eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f99f044900 con 0x55f99f0dece0 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f99efeaf20 con 0x55f99f0de3c0 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49b37bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f99f0408c0 con 0x55f99f0e95a0 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.581+0000 7f49a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 0x55f99f0e9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 0x55f99f0e9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41808/0 (socket says 172.21.15.7:41808) 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 -- 172.21.15.7:0/2783101321 learned_addr learned my addr 172.21.15.7:0/2783101321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49aa800640 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0de7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a1400640 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0e95a0 0x55f99f0eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 -- 172.21.15.7:0/2783101321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0e95a0 msgr2=0x55f99f0eb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0e95a0 0x55f99f0eb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 -- 172.21.15.7:0/2783101321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 msgr2=0x55f99f0de7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0de7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a9e00640 1 -- 172.21.15.7:0/2783101321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99f00fe10 con 0x55f99f0dece0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.582+0000 7f49a3400640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f49900a3f40 0x7f49900a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.583+0000 7f49a3400640 1 -- 172.21.15.7:0/4153382998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f499c0f1a90 con 0x7f49ac102080 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.583+0000 7f49aa800640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f49900a3f40 0x7f49900a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.583+0000 7f49a9e00640 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 0x55f99f0e9060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f499c0ee9a0 tx=0x7f499c0f5cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2341808cb80bef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.583+0000 7f499b000640 1 -- 172.21.15.7:0/2783101321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c049020 con 0x55f99f0dece0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.584+0000 7f49aa800640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f49900a3f40 0x7f49900a6400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49a400aca0 tx=0x7f49a400a2b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.584+0000 7f499b000640 1 -- 172.21.15.7:0/2783101321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f499c0fb040 con 0x55f99f0dece0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.584+0000 7f499b000640 1 -- 172.21.15.7:0/2783101321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c0bcf70 con 0x55f99f0dece0 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.584+0000 7f49b37bd740 1 -- 172.21.15.7:0/2783101321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 msgr2=0x55f99f0e9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.584+0000 7f49b37bd740 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 0x55f99f0e9060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f499c0ee9a0 tx=0x7f499c0f5cc0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 -- 172.21.15.7:0/2783101321 shutdown_connections 2024-04-23T14:52:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0e95a0 0x55f99f0eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0dece0 0x55f99f0e9060 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 --2- 172.21.15.7:0/2783101321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0de7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 -- 172.21.15.7:0/2783101321 >> 172.21.15.7:0/2783101321 conn(0x55f99f0da8d0 msgr2=0x55f99f0dacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 -- 172.21.15.7:0/2783101321 shutdown_connections 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 -- 172.21.15.7:0/2783101321 wait complete. 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.585+0000 7f49b37bd740 1 -- start start 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 Processor -- start 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f0e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f99f0ebf90 con 0x55f99f0e95a0 2024-04-23T14:52:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f99effe2c0 con 0x55f99f0de3c0 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f99f0ec110 con 0x55f99f0dece0 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.586+0000 7f49b37bd740 10 client.0 _ll_register_callbacks cb 0x55f99ed56a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f0e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f0e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41824/0 (socket says 172.21.15.7:41824) 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 -- 172.21.15.7:0/3816407192 learned_addr learned my addr 172.21.15.7:0/3816407192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49a1400640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49a9e00640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 -- 172.21.15.7:0/3816407192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 msgr2=0x55f99f0e6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 -- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 msgr2=0x55f99f0e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0e6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 -- 172.21.15.7:0/3816407192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99f00efd0 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f49aa800640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f0e6fb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f49a400aa40 tx=0x7f49a4005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce9bbce16ac6b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.587+0000 7f498f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f498f400640 1 -- 172.21.15.7:0/3816407192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4010b60 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499c0fb040 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f498f400640 1 -- 172.21.15.7:0/3816407192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f49a4010d00 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f498f400640 1 -- 172.21.15.7:0/3816407192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f49a4032050 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f49b37bd740 10 client.15708 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f99ed57210 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.588+0000 7f498f400640 1 -- 172.21.15.7:0/3816407192 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f499c0fb040 con 0x55f99f0e95a0 2024-04-23T14:52:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f498f400640 1 -- 172.21.15.7:0/3816407192 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f49a40297e0 con 0x55f99f0e95a0 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49b37bd740 10 client.15708 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49b37bd740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49b37bd740 20 client.15708 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49b37bd740 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f0f9470 0x55f99f0fb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49b37bd740 4 client.15708 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f99f052320 con 0x55f99f0f9470 2024-04-23T14:52:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.589+0000 7f49a9e00640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f0f9470 0x55f99f0fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.590+0000 7f49a9e00640 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f0f9470 0x55f99f0fb880 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3926c1aada4f3a5a server_cookie=594a97d77b448cfb in_seq=0 out_seq=0 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.590+0000 7f498f400640 10 client.15708 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f498f400640 1 -- 172.21.15.7:0/3816407192 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f99f052320 con 0x55f99f0f9470 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f498f400640 10 client.15708 handle_command_reply: tid=0 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 client.15708 shutdown 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 msgr2=0x55f99f0e6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f0e6fb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f49a400aa40 tx=0x7f49a4005bf0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 shutdown_connections 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f0f9470 0x55f99f0fb880 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f0e6fb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 --2- 172.21.15.7:0/3816407192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0de3c0 0x55f99f0e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f498f400640 0 client.15708 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 >> 172.21.15.7:0/3816407192 conn(0x55f99f0da8d0 msgr2=0x55f99f0e0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.592+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 shutdown_connections 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.593+0000 7f49b37bd740 1 -- 172.21.15.7:0/3816407192 wait complete. 2024-04-23T14:52:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.593+0000 7f49b37bd740 20 client.15708 trim_cache size 0 max 16384 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 Processor -- start 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 -- start start 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 0x55f99f0da210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0e95a0 0x55f99f101190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1ad030 con 0x55f99f0de3c0 2024-04-23T14:52:16.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1aeb70 con 0x55f99f0e95a0 2024-04-23T14:52:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.609+0000 7f49b37bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1ad700 con 0x55f99f0dece0 2024-04-23T14:52:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 0x55f99f0da210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 0x55f99f0da210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41838/0 (socket says 172.21.15.7:41838) 2024-04-23T14:52:16.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 -- 172.21.15.7:0/1394500256 learned_addr learned my addr 172.21.15.7:0/1394500256 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a1400640 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 -- 172.21.15.7:0/1394500256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 msgr2=0x55f99f0e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49aa800640 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0e95a0 0x55f99f101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 -- 172.21.15.7:0/1394500256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0e95a0 msgr2=0x55f99f101190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0e95a0 0x55f99f101190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 -- 172.21.15.7:0/1394500256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99f0ebd00 con 0x55f99f0de3c0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.610+0000 7f49a9e00640 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 0x55f99f0da210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f499c0b9b70 tx=0x7f499c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbf50395f5cfa10 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.611+0000 7f499a600640 1 -- 172.21.15.7:0/1394500256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c0d5070 con 0x55f99f0de3c0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.611+0000 7f499a600640 1 -- 172.21.15.7:0/1394500256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f499c0bd8a0 con 0x55f99f0de3c0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.611+0000 7f499a600640 1 -- 172.21.15.7:0/1394500256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c049040 con 0x55f99f0de3c0 2024-04-23T14:52:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 -- 172.21.15.7:0/1394500256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 msgr2=0x55f99f0da210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 0x55f99f0da210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f499c0b9b70 tx=0x7f499c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 -- 172.21.15.7:0/1394500256 shutdown_connections 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0e95a0 0x55f99f101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0dece0 0x55f99f0e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 --2- 172.21.15.7:0/1394500256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0de3c0 0x55f99f0da210 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 -- 172.21.15.7:0/1394500256 >> 172.21.15.7:0/1394500256 conn(0x55f99f0da8d0 msgr2=0x55f99f0e7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 -- 172.21.15.7:0/1394500256 shutdown_connections 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 -- 172.21.15.7:0/1394500256 wait complete. 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 -- start start 2024-04-23T14:52:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.612+0000 7f49b37bd740 1 Processor -- start 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0de3c0 0x55f99f0ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0dece0 0x55f99f0ed600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1ae4a0 con 0x55f99f0e95a0 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1addd0 con 0x55f99f0dece0 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac1ab010 con 0x55f99f0de3c0 2024-04-23T14:52:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49b37bd740 10 client.0 _ll_register_callbacks cb 0x7f49a4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49aa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f15ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41852/0 (socket says 172.21.15.7:41852) 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.613+0000 7f49aa800640 1 -- 172.21.15.7:0/4132355057 learned_addr learned my addr 172.21.15.7:0/4132355057 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0de3c0 0x55f99f0ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49a1400640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0dece0 0x55f99f0ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49aa800640 1 -- 172.21.15.7:0/4132355057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0de3c0 msgr2=0x55f99f0ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49aa800640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0de3c0 0x55f99f0ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49aa800640 1 -- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0dece0 msgr2=0x55f99f0ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49aa800640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0dece0 0x55f99f0ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49aa800640 1 -- 172.21.15.7:0/4132355057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99ee23620 con 0x55f99f0e95a0 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49a1400640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0dece0 0x55f99f0ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:52:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0de3c0 0x55f99f0ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49aa800640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f15ea00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f49a4029bb0 tx=0x7f49a400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed463e0f8813a480 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f498f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f498f400640 1 -- 172.21.15.7:0/4132355057 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4010d70 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499c0bd8a0 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.614+0000 7f498f400640 1 -- 172.21.15.7:0/4132355057 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f49a4029470 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f498f400640 1 -- 172.21.15.7:0/4132355057 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f49a4029690 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 10 client.15714 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f99f15fec0 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f498f400640 1 -- 172.21.15.7:0/4132355057 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f499c0bd8a0 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f498f400640 1 -- 172.21.15.7:0/4132355057 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f49a403e410 con 0x55f99f0e95a0 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 10 client.15714 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 20 client.15714 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f1605d0 0x55f99f1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 4 client.15714 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:52:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.615+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f99f04c190 con 0x55f99f1605d0 2024-04-23T14:52:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.616+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f1605d0 0x55f99f1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.617+0000 7f498f400640 10 client.15714 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.617+0000 7f49a9e00640 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f1605d0 0x55f99f1629f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b40b0e45b3f8af server_cookie=2e336c78ab5fb705 in_seq=0 out_seq=0 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f498f400640 1 -- 172.21.15.7:0/4132355057 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f99f04c190 con 0x55f99f1605d0 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f498f400640 10 client.15714 handle_command_reply: tid=0 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 client.15714 shutdown 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 msgr2=0x55f99f15ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f15ea00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f49a4029bb0 tx=0x7f49a400a950 comp rx=0 tx=0).stop 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 shutdown_connections 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f99f1605d0 0x55f99f1629f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f99f0dece0 0x55f99f0ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f99f0e95a0 0x55f99f15ea00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 --2- 172.21.15.7:0/4132355057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f99f0de3c0 0x55f99f0ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f498f400640 0 client.15714 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.626+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 >> 172.21.15.7:0/4132355057 conn(0x55f99f0da8d0 msgr2=0x55f99f0e85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 shutdown_connections 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49b37bd740 1 -- 172.21.15.7:0/4132355057 wait complete. 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49b37bd740 20 client.15714 trim_cache size 0 max 16384 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:52:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f49900a3f40 msgr2=0x7f49900a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49ab200640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f49900a3f40 0x7f49900a6400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49a400aca0 tx=0x7f49a400a2b0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 msgr2=0x7f49ac1986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.627+0000 7f49ab200640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac1986b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f499c006010 tx=0x7f499c004270 comp rx=0 tx=0).stop 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 shutdown_connections 2024-04-23T14:52:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f49900a3f40 0x7f49900a6400 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49ac107150 0x7f49ac198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49ac19cf70 0x7f49ac19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 --2- 172.21.15.7:0/4153382998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ac102080 0x7f49ac1986b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 >> 172.21.15.7:0/4153382998 conn(0x7f49ac0fd940 msgr2=0x7f49ac0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 shutdown_connections 2024-04-23T14:52:16.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:16.628+0000 7f49ab200640 1 -- 172.21.15.7:0/4153382998 wait complete. 2024-04-23T14:52:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:17 smithi007 ceph-mon[27906]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-23T14:52:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:17 smithi186 ceph-mon[31814]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-23T14:52:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:17 smithi137 ceph-mon[31694]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-23T14:52:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:19 smithi007 ceph-mon[27906]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T14:52:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:19 smithi186 ceph-mon[31814]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T14:52:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:19 smithi137 ceph-mon[31694]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T14:52:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:21 smithi007 ceph-mon[27906]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T14:52:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:21 smithi186 ceph-mon[31814]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T14:52:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:21 smithi137 ceph-mon[31694]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T14:52:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:23 smithi007 ceph-mon[27906]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:23 smithi186 ceph-mon[31814]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:23 smithi137 ceph-mon[31694]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:25 smithi007 ceph-mon[27906]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:25 smithi186 ceph-mon[31814]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:25 smithi137 ceph-mon[31694]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:27 smithi007 ceph-mon[27906]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-23T14:52:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:27 smithi186 ceph-mon[31814]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-23T14:52:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:27 smithi137 ceph-mon[31694]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-23T14:52:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 -- 172.21.15.7:0/1853019250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 msgr2=0x7fbb68101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 --2- 172.21.15.7:0/1853019250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb68101190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009900 tx=0x7fbb5802a490 comp rx=0 tx=0).stop 2024-04-23T14:52:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 -- 172.21.15.7:0/1853019250 shutdown_connections 2024-04-23T14:52:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 --2- 172.21.15.7:0/1853019250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681016d0 0x7fbb68105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 --2- 172.21.15.7:0/1853019250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb681061b0 0x7fbb68106640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 --2- 172.21.15.7:0/1853019250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb68101190 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 -- 172.21.15.7:0/1853019250 >> 172.21.15.7:0/1853019250 conn(0x7fbb680fc820 msgr2=0x7fbb680fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 -- 172.21.15.7:0/1853019250 shutdown_connections 2024-04-23T14:52:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.815+0000 7fbb67200640 1 -- 172.21.15.7:0/1853019250 wait complete. 2024-04-23T14:52:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.816+0000 7fbb67200640 1 Processor -- start 2024-04-23T14:52:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 -- start start 2024-04-23T14:52:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb681a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb681016d0 0x7fbb681a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681061b0 0x7fbb6819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681186b0 con 0x7fbb68100db0 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68118530 con 0x7fbb681061b0 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.817+0000 7fbb67200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68118830 con 0x7fbb681016d0 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb681a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb681a48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44340/0 (socket says 172.21.15.7:44340) 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 -- 172.21.15.7:0/1828312419 learned_addr learned my addr 172.21.15.7:0/1828312419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65400640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb681016d0 0x7fbb681a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb66800640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681061b0 0x7fbb6819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 -- 172.21.15.7:0/1828312419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb681016d0 msgr2=0x7fbb681a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb681016d0 0x7fbb681a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 -- 172.21.15.7:0/1828312419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681061b0 msgr2=0x7fbb6819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681061b0 0x7fbb6819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb65e00640 1 -- 172.21.15.7:0/1828312419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6819f1d0 con 0x7fbb68100db0 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.818+0000 7fbb66800640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681061b0 0x7fbb6819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.819+0000 7fbb65e00640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb681a48a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbb58006010 tx=0x7fbb58031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.819+0000 7fbb5ea00640 1 -- 172.21.15.7:0/1828312419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58040030 con 0x7fbb68100db0 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.819+0000 7fbb5ea00640 1 -- 172.21.15.7:0/1828312419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb5803c8f0 con 0x7fbb68100db0 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.820+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6819f460 con 0x7fbb68100db0 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.820+0000 7fbb5ea00640 1 -- 172.21.15.7:0/1828312419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58044a60 con 0x7fbb68100db0 2024-04-23T14:52:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.820+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb681ab760 con 0x7fbb68100db0 2024-04-23T14:52:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.824+0000 7fbb6fe09740 1 Processor -- start 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 -- start start 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a0243c0 0x55ca1a0247a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a024ce0 0x55ca1a02f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a02f5a0 0x55ca1a031990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ca19f8a900 con 0x55ca1a024ce0 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ca19f30f20 con 0x55ca1a02f5a0 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.825+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ca19f868c0 con 0x55ca1a0243c0 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a02f5a0 0x55ca1a031990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a0243c0 0x55ca1a0247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a02f5a0 0x55ca1a031990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45048/0 (socket says 172.21.15.7:45048) 2024-04-23T14:52:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb65400640 1 -- 172.21.15.7:0/2796664455 learned_addr learned my addr 172.21.15.7:0/2796664455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb5ea00640 1 -- 172.21.15.7:0/1828312419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138929+0+0 (secure 0 0 0) 0x7fbb58043030 con 0x7fbb68100db0 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb66800640 1 -- 172.21.15.7:0/2796664455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a02f5a0 msgr2=0x55ca1a031990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb66800640 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a02f5a0 0x55ca1a031990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.826+0000 7fbb66800640 1 -- 172.21.15.7:0/2796664455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a024ce0 msgr2=0x55ca1a02f060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.827+0000 7fbb65e00640 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a024ce0 0x55ca1a02f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.827+0000 7fbb66800640 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a024ce0 0x55ca1a02f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.827+0000 7fbb66800640 1 -- 172.21.15.7:0/2796664455 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca19f55e10 con 0x55ca1a0243c0 2024-04-23T14:52:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.827+0000 7fbb66800640 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a0243c0 0x55ca1a0247a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e60 tx=0x7fbb60010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c70d68bd668fd7a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.828+0000 7fbb53400640 1 -- 172.21.15.7:0/2796664455 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60016070 con 0x55ca1a0243c0 2024-04-23T14:52:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.828+0000 7fbb53400640 1 -- 172.21.15.7:0/2796664455 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb60012900 con 0x55ca1a0243c0 2024-04-23T14:52:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.828+0000 7fbb53400640 1 -- 172.21.15.7:0/2796664455 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60011930 con 0x55ca1a0243c0 2024-04-23T14:52:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.828+0000 7fbb5ea00640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb4c0a3f40 0x7fbb4c0a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.829+0000 7fbb5ea00640 1 -- 172.21.15.7:0/1828312419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fbb580f11a0 con 0x7fbb68100db0 2024-04-23T14:52:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.829+0000 7fbb65e00640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb4c0a3f40 0x7fbb4c0a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.829+0000 7fbb6fe09740 1 -- 172.21.15.7:0/2796664455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a0243c0 msgr2=0x55ca1a0247a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.829+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a0243c0 0x55ca1a0247a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e60 tx=0x7fbb60010740 comp rx=0 tx=0).stop 2024-04-23T14:52:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 -- 172.21.15.7:0/2796664455 shutdown_connections 2024-04-23T14:52:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a02f5a0 0x55ca1a031990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a024ce0 0x55ca1a02f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/2796664455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a0243c0 0x55ca1a0247a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 -- 172.21.15.7:0/2796664455 >> 172.21.15.7:0/2796664455 conn(0x55ca1a0208d0 msgr2=0x55ca1a020cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 -- 172.21.15.7:0/2796664455 shutdown_connections 2024-04-23T14:52:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb65e00640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb4c0a3f40 0x7fbb4c0a6400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb580ee3b0 tx=0x7fbb5804b000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.830+0000 7fbb6fe09740 1 -- 172.21.15.7:0/2796664455 wait complete. 2024-04-23T14:52:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.831+0000 7fbb6fe09740 1 -- start start 2024-04-23T14:52:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.831+0000 7fbb6fe09740 1 Processor -- start 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 0x55ca1a02c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a024ce0 0x55ca1a02cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a02f5a0 0x55ca1a02d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ca1a0431e0 con 0x55ca1a0243c0 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ca19f442c0 con 0x55ca1a024ce0 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ca1a043360 con 0x55ca1a02f5a0 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb6fe09740 10 client.0 _ll_register_callbacks cb 0x55ca19c9ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 0x55ca1a02c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 0x55ca1a02c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44364/0 (socket says 172.21.15.7:44364) 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb66800640 1 -- 172.21.15.7:0/430395499 learned_addr learned my addr 172.21.15.7:0/430395499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.832+0000 7fbb65400640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a024ce0 0x55ca1a02cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.833+0000 7fbb66800640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a02f5a0 0x55ca1a02d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.833+0000 7fbb66800640 1 -- 172.21.15.7:0/430395499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a02f5a0 msgr2=0x55ca1a02d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.833+0000 7fbb66800640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a02f5a0 0x55ca1a02d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.833+0000 7fbb66800640 1 -- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a024ce0 msgr2=0x55ca1a02cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.833+0000 7fbb66800640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a024ce0 0x55ca1a02cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.833+0000 7fbb66800640 1 -- 172.21.15.7:0/430395499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca19f54fd0 con 0x55ca1a0243c0 2024-04-23T14:52:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.834+0000 7fbb66800640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 0x55ca1a02c5d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbb60011610 tx=0x7fbb600094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeed51c9817787f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:29 smithi007 ceph-mon[27906]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-23T14:52:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.834+0000 7fbb47e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.834+0000 7fbb47e00640 1 -- 172.21.15.7:0/430395499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60016050 con 0x55ca1a0243c0 2024-04-23T14:52:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.834+0000 7fbb47e00640 1 -- 172.21.15.7:0/430395499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fbb60004c40 con 0x55ca1a0243c0 2024-04-23T14:52:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.834+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb60012900 con 0x55ca1a0243c0 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.835+0000 7fbb47e00640 1 -- 172.21.15.7:0/430395499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb60033050 con 0x55ca1a0243c0 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.835+0000 7fbb6fe09740 10 client.15723 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.835+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca19c9d210 con 0x55ca1a0243c0 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.835+0000 7fbb47e00640 1 -- 172.21.15.7:0/430395499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb60012900 con 0x55ca1a0243c0 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb47e00640 1 -- 172.21.15.7:0/430395499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb60028020 con 0x55ca1a0243c0 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb6fe09740 10 client.15723 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb6fe09740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb6fe09740 20 client.15723 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0506b0 0x55ca1a052aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb6fe09740 4 client.15723 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:52:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.836+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca19f98320 con 0x55ca1a0506b0 2024-04-23T14:52:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.837+0000 7fbb65400640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0506b0 0x55ca1a052aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.838+0000 7fbb65400640 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0506b0 0x55ca1a052aa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a30d2ff8e521aa server_cookie=f43bf239c64b7f6d in_seq=0 out_seq=0 2024-04-23T14:52:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.838+0000 7fbb47e00640 10 client.15723 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.840+0000 7fbb47e00640 1 -- 172.21.15.7:0/430395499 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ca19f98320 con 0x55ca1a0506b0 2024-04-23T14:52:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.840+0000 7fbb47e00640 10 client.15723 handle_command_reply: tid=0 2024-04-23T14:52:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.840+0000 7fbb6fe09740 1 client.15723 shutdown 2024-04-23T14:52:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.840+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 msgr2=0x55ca1a02c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.840+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 0x55ca1a02c5d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbb60011610 tx=0x7fbb600094c0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 shutdown_connections 2024-04-23T14:52:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0506b0 0x55ca1a052aa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a024ce0 0x55ca1a02cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a02f5a0 0x55ca1a02d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/430395499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a0243c0 0x55ca1a02c5d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 >> 172.21.15.7:0/430395499 conn(0x55ca1a0208d0 msgr2=0x55ca1a026650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb47e00640 0 client.15723 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 shutdown_connections 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 1 -- 172.21.15.7:0/430395499 wait complete. 2024-04-23T14:52:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.841+0000 7fbb6fe09740 20 client.15723 trim_cache size 0 max 16384 2024-04-23T14:52:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:29 smithi186 ceph-mon[31814]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-23T14:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.872+0000 7fbb6fe09740 1 Processor -- start 2024-04-23T14:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 -- start start 2024-04-23T14:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a026d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a02ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681acfa0 con 0x55ca1a02f5a0 2024-04-23T14:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681aeae0 con 0x55ca1a0243c0 2024-04-23T14:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681ad670 con 0x55ca1a024ce0 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.873+0000 7fbb66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a055ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44374/0 (socket says 172.21.15.7:44374) 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 -- 172.21.15.7:0/1965292193 learned_addr learned my addr 172.21.15.7:0/1965292193 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb65400640 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a02ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a026d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 -- 172.21.15.7:0/1965292193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 msgr2=0x55ca1a02ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a02ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 -- 172.21.15.7:0/1965292193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 msgr2=0x55ca1a026d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a026d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 -- 172.21.15.7:0/1965292193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca19d69620 con 0x55ca1a02f5a0 2024-04-23T14:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.874+0000 7fbb66800640 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a055ac0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbb60005d70 tx=0x7fbb6002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843ce51ae2d91c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.875+0000 7fbb52a00640 1 -- 172.21.15.7:0/1965292193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60016070 con 0x55ca1a02f5a0 2024-04-23T14:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.875+0000 7fbb52a00640 1 -- 172.21.15.7:0/1965292193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb6001f030 con 0x55ca1a02f5a0 2024-04-23T14:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.875+0000 7fbb52a00640 1 -- 172.21.15.7:0/1965292193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60030040 con 0x55ca1a02f5a0 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 -- 172.21.15.7:0/1965292193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 msgr2=0x55ca1a055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a055ac0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbb60005d70 tx=0x7fbb6002c040 comp rx=0 tx=0).stop 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 -- 172.21.15.7:0/1965292193 shutdown_connections 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a055ac0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a02ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/1965292193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a026d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 -- 172.21.15.7:0/1965292193 >> 172.21.15.7:0/1965292193 conn(0x55ca1a0208d0 msgr2=0x55ca1a04be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 -- 172.21.15.7:0/1965292193 shutdown_connections 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.876+0000 7fbb6fe09740 1 -- 172.21.15.7:0/1965292193 wait complete. 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.877+0000 7fbb6fe09740 1 -- start start 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.877+0000 7fbb6fe09740 1 Processor -- start 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a055950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a055e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a052ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681ae410 con 0x55ca1a02f5a0 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681add40 con 0x55ca1a0243c0 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680505e0 con 0x55ca1a024ce0 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb6fe09740 10 client.0 _ll_register_callbacks cb 0x7fbb5400b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.878+0000 7fbb66800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a055950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb65400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a055e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a055950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45072/0 (socket says 172.21.15.7:45072) 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 -- 172.21.15.7:0/355443961 learned_addr learned my addr 172.21.15.7:0/355443961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a052ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 -- 172.21.15.7:0/355443961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 msgr2=0x55ca1a055e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a055e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 -- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 msgr2=0x55ca1a055950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a055950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.879+0000 7fbb66800640 1 -- 172.21.15.7:0/355443961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca1a0536b0 con 0x55ca1a02f5a0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.880+0000 7fbb66800640 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a052ed0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009db0 tx=0x7fbb60000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7c819c1c53ae5c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.880+0000 7fbb47e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.880+0000 7fbb47e00640 1 -- 172.21.15.7:0/355443961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60016040 con 0x55ca1a02f5a0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.880+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb6001f030 con 0x55ca1a02f5a0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.880+0000 7fbb47e00640 1 -- 172.21.15.7:0/355443961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fbb600115f0 con 0x55ca1a02f5a0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb47e00640 1 -- 172.21.15.7:0/355443961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb600117f0 con 0x55ca1a02f5a0 2024-04-23T14:52:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca1a0b6410 con 0x55ca1a02f5a0 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb47e00640 1 -- 172.21.15.7:0/355443961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb6001f030 con 0x55ca1a02f5a0 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb47e00640 1 -- 172.21.15.7:0/355443961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb60044020 con 0x55ca1a02f5a0 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 20 client.15729 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0b6a50 0x55ca1a0b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 4 client.15729 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:52:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.881+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca19f92190 con 0x55ca1a0b6a50 2024-04-23T14:52:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.882+0000 7fbb65400640 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0b6a50 0x55ca1a0b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.883+0000 7fbb65400640 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0b6a50 0x55ca1a0b8e70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd0b0ea3cdb3fd1a server_cookie=8182ef037029f041 in_seq=0 out_seq=0 2024-04-23T14:52:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.883+0000 7fbb47e00640 10 client.15729 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.892+0000 7fbb47e00640 1 -- 172.21.15.7:0/355443961 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca19f92190 con 0x55ca1a0b6a50 2024-04-23T14:52:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.892+0000 7fbb47e00640 10 client.15729 handle_command_reply: tid=0 2024-04-23T14:52:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.892+0000 7fbb6fe09740 1 client.15729 shutdown 2024-04-23T14:52:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 msgr2=0x55ca1a052ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a052ed0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009db0 tx=0x7fbb60000f40 comp rx=0 tx=0).stop 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 shutdown_connections 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ca1a0b6a50 0x55ca1a0b8e70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca1a02f5a0 0x55ca1a052ed0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1a024ce0 0x55ca1a055e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 --2- 172.21.15.7:0/355443961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1a0243c0 0x55ca1a055950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 >> 172.21.15.7:0/355443961 conn(0x55ca1a0208d0 msgr2=0x55ca1a01f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb47e00640 0 client.15729 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 shutdown_connections 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 1 -- 172.21.15.7:0/355443961 wait complete. 2024-04-23T14:52:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.893+0000 7fbb6fe09740 20 client.15729 trim_cache size 0 max 16384 2024-04-23T14:52:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:52:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:52:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:52:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:52:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb4c0a3f40 msgr2=0x7fbb4c0a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb4c0a3f40 0x7fbb4c0a6400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb580ee3b0 tx=0x7fbb5804b000 comp rx=0 tx=0).stop 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 msgr2=0x7fbb681a48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb681a48a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbb58006010 tx=0x7fbb58031ba0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 shutdown_connections 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb4c0a3f40 0x7fbb4c0a6400 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb681061b0 0x7fbb6819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb681016d0 0x7fbb681a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 --2- 172.21.15.7:0/1828312419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb68100db0 0x7fbb681a48a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.894+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 >> 172.21.15.7:0/1828312419 conn(0x7fbb680fc820 msgr2=0x7fbb680fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.895+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 shutdown_connections 2024-04-23T14:52:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:29.895+0000 7fbb67200640 1 -- 172.21.15.7:0/1828312419 wait complete. 2024-04-23T14:52:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:29 smithi137 ceph-mon[31694]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-23T14:52:30.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:30.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:31.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:31 smithi186 ceph-mon[31814]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:31.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:31 smithi007 ceph-mon[27906]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:31 smithi137 ceph-mon[31694]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:32.682 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:32 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:32.682 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:32 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:52:32.683 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:32 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:52:32.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:32 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:32.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:32 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:52:32.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:32 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:52:32.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:32 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:32.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:32 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:52:32.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:32 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:52:33.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:33 smithi007 ceph-mon[27906]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-23T14:52:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:33 smithi186 ceph-mon[31814]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-23T14:52:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:33 smithi137 ceph-mon[31694]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-23T14:52:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:35 smithi007 ceph-mon[27906]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:35 smithi186 ceph-mon[31814]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:35 smithi137 ceph-mon[31694]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:37.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:37 smithi007 ceph-mon[27906]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-23T14:52:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:37 smithi186 ceph-mon[31814]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-23T14:52:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:37 smithi137 ceph-mon[31694]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-23T14:52:39.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:39 smithi007 ceph-mon[27906]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-23T14:52:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:39 smithi186 ceph-mon[31814]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-23T14:52:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:39 smithi137 ceph-mon[31694]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-04-23T14:52:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:41 smithi007 ceph-mon[27906]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:41 smithi186 ceph-mon[31814]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:41 smithi137 ceph-mon[31694]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.089+0000 7f9669c00640 1 -- 172.21.15.7:0/3578535721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96641038e0 msgr2=0x7f966410bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.089+0000 7f9669c00640 1 --2- 172.21.15.7:0/3578535721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96641038e0 0x7f966410bdc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9650009900 tx=0x7f965002a480 comp rx=0 tx=0).stop 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 -- 172.21.15.7:0/3578535721 shutdown_connections 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 --2- 172.21.15.7:0/3578535721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f966410c3e0 0x7f966410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 --2- 172.21.15.7:0/3578535721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96641038e0 0x7f966410bdc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 --2- 172.21.15.7:0/3578535721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9664102fc0 0x7f96641033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 -- 172.21.15.7:0/3578535721 >> 172.21.15.7:0/3578535721 conn(0x7f96640fc820 msgr2=0x7f96640fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 -- 172.21.15.7:0/3578535721 shutdown_connections 2024-04-23T14:52:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.090+0000 7f9669c00640 1 -- 172.21.15.7:0/3578535721 wait complete. 2024-04-23T14:52:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.091+0000 7f9669c00640 1 Processor -- start 2024-04-23T14:52:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.091+0000 7f9669c00640 1 -- start start 2024-04-23T14:52:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.092+0000 7f9669c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 0x7f9664100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.092+0000 7f9669c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96641038e0 0x7f9664101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.092+0000 7f9669c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966410c3e0 0x7f9664101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.092+0000 7f9669c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96641120c0 con 0x7f9664102fc0 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.092+0000 7f9669c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9664111f40 con 0x7f96641038e0 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.092+0000 7f9669c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9664112240 con 0x7f966410c3e0 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 0x7f9664100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 0x7f9664100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59126/0 (socket says 172.21.15.7:59126) 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 -- 172.21.15.7:0/1877257251 learned_addr learned my addr 172.21.15.7:0/1877257251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663400640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96641038e0 0x7f9664101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9669200640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966410c3e0 0x7f9664101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 -- 172.21.15.7:0/1877257251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966410c3e0 msgr2=0x7f9664101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966410c3e0 0x7f9664101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 -- 172.21.15.7:0/1877257251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96641038e0 msgr2=0x7f9664101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96641038e0 0x7f9664101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9663e00640 1 -- 172.21.15.7:0/1877257251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96641a6ba0 con 0x7f9664102fc0 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.093+0000 7f9669200640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966410c3e0 0x7f9664101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.094+0000 7f9663e00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 0x7f9664100c10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f965400e9f0 tx=0x7f965400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.094+0000 7f9660c00640 1 -- 172.21.15.7:0/1877257251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965400cd80 con 0x7f9664102fc0 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.094+0000 7f9660c00640 1 -- 172.21.15.7:0/1877257251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96540054d0 con 0x7f9664102fc0 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.094+0000 7f9660c00640 1 -- 172.21.15.7:0/1877257251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654010490 con 0x7f9664102fc0 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.094+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96641a6e90 con 0x7f9664102fc0 2024-04-23T14:52:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.095+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96641a7300 con 0x7f9664102fc0 2024-04-23T14:52:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.098+0000 7f9660c00640 1 -- 172.21.15.7:0/1877257251 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138929+0+0 (secure 0 0 0) 0x7f9654005020 con 0x7f9664102fc0 2024-04-23T14:52:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.099+0000 7f966e020740 1 Processor -- start 2024-04-23T14:52:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.099+0000 7f966e020740 1 -- start start 2024-04-23T14:52:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.100+0000 7f966e020740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd36186fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.100+0000 7f9660c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f96480a3f40 0x7f96480a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.100+0000 7f9660c00640 1 -- 172.21.15.7:0/1877257251 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f96540d11d0 con 0x7f9664102fc0 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.100+0000 7f9669200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd36186fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f9663e00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f96480a3f40 0x7f96480a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f966e020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd36191870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f966e020740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd361941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f966e020740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cd360e4900 con 0x55cd36186bd0 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f9669200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd36186fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59140/0 (socket says 172.21.15.7:59140) 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f9669200640 1 -- 172.21.15.7:0/2010364477 learned_addr learned my addr 172.21.15.7:0/2010364477 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd3608af20 con 0x55cd361874f0 2024-04-23T14:52:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cd360e08c0 con 0x55cd36191db0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f9663400640 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd36191870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.101+0000 7f9663e00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f96480a3f40 0x7f96480a6400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96540ce3e0 tx=0x7f965400cf90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.102+0000 7f9669200640 1 -- 172.21.15.7:0/2010364477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 msgr2=0x55cd361941a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.102+0000 7f9669200640 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd361941a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.102+0000 7f9669200640 1 -- 172.21.15.7:0/2010364477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 msgr2=0x55cd36191870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.102+0000 7f9669200640 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd36191870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.102+0000 7f9669200640 1 -- 172.21.15.7:0/2010364477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd360afe10 con 0x55cd36186bd0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.102+0000 7f9669200640 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd36186fb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f965c009f70 tx=0x7f965c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e064250e1c10c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.103+0000 7f9659600640 1 -- 172.21.15.7:0/2010364477 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c015070 con 0x55cd36186bd0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.103+0000 7f9659600640 1 -- 172.21.15.7:0/2010364477 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f965c01ab10 con 0x55cd36186bd0 2024-04-23T14:52:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.103+0000 7f9659600640 1 -- 172.21.15.7:0/2010364477 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c011c10 con 0x55cd36186bd0 2024-04-23T14:52:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.103+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 msgr2=0x55cd36186fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.103+0000 7f966e020740 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd36186fb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f965c009f70 tx=0x7f965c00f7f0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 shutdown_connections 2024-04-23T14:52:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd36191870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd361941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 --2- 172.21.15.7:0/2010364477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd36186fb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 >> 172.21.15.7:0/2010364477 conn(0x55cd361830e0 msgr2=0x55cd361834c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 shutdown_connections 2024-04-23T14:52:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 -- 172.21.15.7:0/2010364477 wait complete. 2024-04-23T14:52:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.104+0000 7f966e020740 1 -- start start 2024-04-23T14:52:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 Processor -- start 2024-04-23T14:52:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd3618eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd3618f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cd361949e0 con 0x55cd36186bd0 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd3609e2c0 con 0x55cd361874f0 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.105+0000 7f966e020740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cd36194b60 con 0x55cd36191db0 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.106+0000 7f9669200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd3618eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.106+0000 7f966e020740 10 client.0 _ll_register_callbacks cb 0x55cd35df6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.106+0000 7f9669200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd3618eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59144/0 (socket says 172.21.15.7:59144) 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.106+0000 7f9669200640 1 -- 172.21.15.7:0/131803795 learned_addr learned my addr 172.21.15.7:0/131803795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.106+0000 7f9663400640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd3618f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.106+0000 7f9669200640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f9669200640 1 -- 172.21.15.7:0/131803795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 msgr2=0x55cd3618f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f9669200640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f9669200640 1 -- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 msgr2=0x55cd3618f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f9669200640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd3618f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f9669200640 1 -- 172.21.15.7:0/131803795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd360aefd0 con 0x55cd36186bd0 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f9669200640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd3618eda0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f965c0095d0 tx=0x7f965c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a668406bf31c9b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f964e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f964e000640 1 -- 172.21.15.7:0/131803795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c015070 con 0x55cd36186bd0 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f964e000640 1 -- 172.21.15.7:0/131803795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f965c011d60 con 0x55cd36186bd0 2024-04-23T14:52:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.107+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f965c01ab10 con 0x55cd36186bd0 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.108+0000 7f964e000640 1 -- 172.21.15.7:0/131803795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f965c030050 con 0x55cd36186bd0 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.108+0000 7f966e020740 10 client.15741 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.108+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd35df7210 con 0x55cd36186bd0 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.108+0000 7f964e000640 1 -- 172.21.15.7:0/131803795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f965c01ab10 con 0x55cd36186bd0 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.108+0000 7f964e000640 1 -- 172.21.15.7:0/131803795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f965c0055d0 con 0x55cd36186bd0 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f966e020740 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f966e020740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f966e020740 20 client.15741 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f966e020740 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd361a1e70 0x55cd361a4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f966e020740 4 client.15741 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:52:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd360f2320 con 0x55cd361a1e70 2024-04-23T14:52:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.109+0000 7f9663400640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd361a1e70 0x55cd361a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.110+0000 7f9663400640 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd361a1e70 0x55cd361a4260 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697e9fd5ca6628ab server_cookie=b01685d7ed02fa40 in_seq=0 out_seq=0 2024-04-23T14:52:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.110+0000 7f964e000640 10 client.15741 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f964e000640 1 -- 172.21.15.7:0/131803795 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd360f2320 con 0x55cd361a1e70 2024-04-23T14:52:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f964e000640 10 client.15741 handle_command_reply: tid=0 2024-04-23T14:52:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 client.15741 shutdown 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 msgr2=0x55cd3618eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd3618eda0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f965c0095d0 tx=0x7f965c009560 comp rx=0 tx=0).stop 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 shutdown_connections 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd361a1e70 0x55cd361a4260 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd3618f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 --2- 172.21.15.7:0/131803795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd3618eda0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 >> 172.21.15.7:0/131803795 conn(0x55cd361830e0 msgr2=0x55cd36179a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.113+0000 7f964e000640 0 client.15741 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.114+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 shutdown_connections 2024-04-23T14:52:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.114+0000 7f966e020740 1 -- 172.21.15.7:0/131803795 wait complete. 2024-04-23T14:52:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.114+0000 7f966e020740 20 client.15741 trim_cache size 0 max 16384 2024-04-23T14:52:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 Processor -- start 2024-04-23T14:52:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 -- start start 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd361a7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd361a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ad050 con 0x55cd36186bd0 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96641aeb90 con 0x55cd361874f0 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f966e020740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ad720 con 0x55cd36191db0 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f9669200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd361a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.130+0000 7f9669200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd361a7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59146/0 (socket says 172.21.15.7:59146) 2024-04-23T14:52:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 -- 172.21.15.7:0/1499514514 learned_addr learned my addr 172.21.15.7:0/1499514514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9663400640 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd361a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 -- 172.21.15.7:0/1499514514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 msgr2=0x55cd3618c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 -- 172.21.15.7:0/1499514514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 msgr2=0x55cd361a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd361a77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 -- 172.21.15.7:0/1499514514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd35ec3620 con 0x55cd36186bd0 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.131+0000 7f9669200640 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd361a7280 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f965c011640 tx=0x7f965c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badbade76d808847 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.132+0000 7f9658c00640 1 -- 172.21.15.7:0/1499514514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c015040 con 0x55cd36186bd0 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.132+0000 7f9658c00640 1 -- 172.21.15.7:0/1499514514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f965c039070 con 0x55cd36186bd0 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.132+0000 7f9658c00640 1 -- 172.21.15.7:0/1499514514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c011b60 con 0x55cd36186bd0 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 -- 172.21.15.7:0/1499514514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 msgr2=0x55cd361a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd361a7280 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f965c011640 tx=0x7f965c004ab0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 -- 172.21.15.7:0/1499514514 shutdown_connections 2024-04-23T14:52:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd361874f0 0x55cd361a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd3618c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 --2- 172.21.15.7:0/1499514514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd36186bd0 0x55cd361a7280 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 -- 172.21.15.7:0/1499514514 >> 172.21.15.7:0/1499514514 conn(0x55cd361830e0 msgr2=0x55cd36179a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 -- 172.21.15.7:0/1499514514 shutdown_connections 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 -- 172.21.15.7:0/1499514514 wait complete. 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.133+0000 7f966e020740 1 -- start start 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 Processor -- start 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd36186bd0 0x55cd361a5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 0x55cd361a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd36201090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ae4c0 con 0x55cd361874f0 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96641addf0 con 0x55cd36186bd0 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ab030 con 0x55cd36191db0 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.134+0000 7f966e020740 10 client.0 _ll_register_callbacks cb 0x7f965c009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 0x55cd361a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 0x55cd361a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59148/0 (socket says 172.21.15.7:59148) 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 -- 172.21.15.7:0/376754799 learned_addr learned my addr 172.21.15.7:0/376754799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9669200640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd36186bd0 0x55cd361a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9669200640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd36201090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 -- 172.21.15.7:0/376754799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 msgr2=0x55cd36201090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd36201090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 -- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd36186bd0 msgr2=0x55cd361a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd36186bd0 0x55cd361a5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.135+0000 7f9663400640 1 -- 172.21.15.7:0/376754799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd362016d0 con 0x55cd361874f0 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.136+0000 7f9663400640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 0x55cd361a5a70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f965002aa40 tx=0x7f9650005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353429f6128dbcfb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.136+0000 7f964e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.136+0000 7f964e000640 1 -- 172.21.15.7:0/376754799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650035040 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.136+0000 7f964e000640 1 -- 172.21.15.7:0/376754799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f9650005020 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.136+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f965c039070 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.137+0000 7f964e000640 1 -- 172.21.15.7:0/376754799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9650052050 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.137+0000 7f966e020740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.137+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd36208b20 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.137+0000 7f964e000640 1 -- 172.21.15.7:0/376754799 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96500442c0 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.137+0000 7f964e000640 1 -- 172.21.15.7:0/376754799 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9650004770 con 0x55cd361874f0 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f966e020740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f966e020740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f966e020740 20 client.15747 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f966e020740 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd362092a0 0x55cd3620b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f966e020740 4 client.15747 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:52:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f965c039070 con 0x55cd362092a0 2024-04-23T14:52:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.138+0000 7f9669200640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd362092a0 0x55cd3620b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.139+0000 7f9669200640 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd362092a0 0x55cd3620b6c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee5dc052e09e271 server_cookie=9a58d9d9952baf3c in_seq=0 out_seq=0 2024-04-23T14:52:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.139+0000 7f964e000640 10 client.15747 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.148+0000 7f964e000640 1 -- 172.21.15.7:0/376754799 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f965c039070 con 0x55cd362092a0 2024-04-23T14:52:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.148+0000 7f964e000640 10 client.15747 handle_command_reply: tid=0 2024-04-23T14:52:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.148+0000 7f966e020740 1 client.15747 shutdown 2024-04-23T14:52:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 msgr2=0x55cd361a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 0x55cd361a5a70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f965002aa40 tx=0x7f9650005e70 comp rx=0 tx=0).stop 2024-04-23T14:52:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 shutdown_connections 2024-04-23T14:52:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cd362092a0 0x55cd3620b6c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cd36191db0 0x55cd36201090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd361874f0 0x55cd361a5a70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 --2- 172.21.15.7:0/376754799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd36186bd0 0x55cd361a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 >> 172.21.15.7:0/376754799 conn(0x55cd361830e0 msgr2=0x55cd36179a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f964e000640 0 client.15747 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 shutdown_connections 2024-04-23T14:52:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 1 -- 172.21.15.7:0/376754799 wait complete. 2024-04-23T14:52:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.149+0000 7f966e020740 20 client.15747 trim_cache size 0 max 16384 2024-04-23T14:52:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:52:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:52:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:52:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:52:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f96480a3f40 msgr2=0x7f96480a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f96480a3f40 0x7f96480a6400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96540ce3e0 tx=0x7f965400cf90 comp rx=0 tx=0).stop 2024-04-23T14:52:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 msgr2=0x7f9664100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 0x7f9664100c10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f965400e9f0 tx=0x7f965400edf0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 shutdown_connections 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f96480a3f40 0x7f96480a6400 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96641038e0 0x7f9664101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966410c3e0 0x7f9664101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 --2- 172.21.15.7:0/1877257251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9664102fc0 0x7f9664100c10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 >> 172.21.15.7:0/1877257251 conn(0x7f96640fc820 msgr2=0x7f96640fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 shutdown_connections 2024-04-23T14:52:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:43.150+0000 7f9669c00640 1 -- 172.21.15.7:0/1877257251 wait complete. 2024-04-23T14:52:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:43 smithi007 ceph-mon[27906]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:43 smithi186 ceph-mon[31814]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:43 smithi137 ceph-mon[31694]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:45.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:45 smithi007 ceph-mon[27906]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T14:52:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:45 smithi186 ceph-mon[31814]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T14:52:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:45 smithi137 ceph-mon[31694]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T14:52:47.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:47 smithi007 ceph-mon[27906]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:47 smithi186 ceph-mon[31814]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:47.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:47 smithi137 ceph-mon[31694]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-23T14:52:49.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:49 smithi007 ceph-mon[27906]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:49 smithi186 ceph-mon[31814]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-23T14:52:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:49 smithi137 ceph-mon[31694]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-23T14:52:51.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:51 smithi007 ceph-mon[27906]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:51 smithi186 ceph-mon[31814]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:51 smithi137 ceph-mon[31694]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-23T14:52:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:53 smithi007 ceph-mon[27906]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-23T14:52:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:53 smithi007 ceph-mon[27906]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-23T14:52:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:53 smithi186 ceph-mon[31814]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-23T14:52:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:53 smithi186 ceph-mon[31814]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-23T14:52:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:53 smithi137 ceph-mon[31694]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-23T14:52:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:53 smithi137 ceph-mon[31694]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-23T14:52:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:55 smithi007 ceph-mon[27906]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-23T14:52:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:55 smithi186 ceph-mon[31814]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-23T14:52:55.863 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 58% (7152/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 95% (11664/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-23T14:52:55.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:55 smithi137 ceph-mon[31694]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-23T14:52:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 -- 172.21.15.7:0/1271721610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e01038e0 msgr2=0x7f08e010bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 --2- 172.21.15.7:0/1271721610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e01038e0 0x7f08e010bdc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009900 tx=0x7f08d002a480 comp rx=0 tx=0).stop 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 -- 172.21.15.7:0/1271721610 shutdown_connections 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 --2- 172.21.15.7:0/1271721610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e010c3e0 0x7f08e010e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 --2- 172.21.15.7:0/1271721610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e01038e0 0x7f08e010bdc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 --2- 172.21.15.7:0/1271721610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e0102fc0 0x7f08e01033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 -- 172.21.15.7:0/1271721610 >> 172.21.15.7:0/1271721610 conn(0x7f08e00fc820 msgr2=0x7f08e00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 -- 172.21.15.7:0/1271721610 shutdown_connections 2024-04-23T14:52:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.296+0000 7f08e7200640 1 -- 172.21.15.7:0/1271721610 wait complete. 2024-04-23T14:52:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.297+0000 7f08e7200640 1 Processor -- start 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.297+0000 7f08e7200640 1 -- start start 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 0x7f08e01986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e01038e0 0x7f08e0198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e010c3e0 0x7f08e019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01120c0 con 0x7f08e0102fc0 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0111f40 con 0x7f08e010c3e0 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0112240 con 0x7f08e01038e0 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 0x7f08e01986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 0x7f08e01986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33642/0 (socket says 172.21.15.7:33642) 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 -- 172.21.15.7:0/2385491566 learned_addr learned my addr 172.21.15.7:0/2385491566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e6800640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e010c3e0 0x7f08e019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5400640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e01038e0 0x7f08e0198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 -- 172.21.15.7:0/2385491566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e01038e0 msgr2=0x7f08e0198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e01038e0 0x7f08e0198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 -- 172.21.15.7:0/2385491566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e010c3e0 msgr2=0x7f08e019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e010c3e0 0x7f08e019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5e00640 1 -- 172.21.15.7:0/2385491566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e019d640 con 0x7f08e0102fc0 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.298+0000 7f08e5400640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e01038e0 0x7f08e0198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08e6800640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e010c3e0 0x7f08e019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08e5e00640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 0x7f08e01986a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f08d400d950 tx=0x7f08d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08daa00640 1 -- 172.21.15.7:0/2385491566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4017070 con 0x7f08e0102fc0 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08daa00640 1 -- 172.21.15.7:0/2385491566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08d4009c30 con 0x7f08e0102fc0 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08daa00640 1 -- 172.21.15.7:0/2385491566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d400f620 con 0x7f08e0102fc0 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e019d930 con 0x7f08e0102fc0 2024-04-23T14:52:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.299+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e01a51c0 con 0x7f08e0102fc0 2024-04-23T14:52:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.302+0000 7f08eb5da740 1 Processor -- start 2024-04-23T14:52:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 -- start start 2024-04-23T14:52:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861300 0x5594688616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468870470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 0x559468872da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594687c7900 con 0x5594688709b0 2024-04-23T14:52:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55946876df20 con 0x559468861c20 2024-04-23T14:52:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08eb5da740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5594687c38c0 con 0x559468861300 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08e5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 0x559468872da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08e5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 0x559468872da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33654/0 (socket says 172.21.15.7:33654) 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.303+0000 7f08e5400640 1 -- 172.21.15.7:0/1958788878 learned_addr learned my addr 172.21.15.7:0/1958788878 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e6800640 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861300 0x5594688616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e5400640 1 -- 172.21.15.7:0/1958788878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861300 msgr2=0x5594688616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e5400640 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861300 0x5594688616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e5400640 1 -- 172.21.15.7:0/1958788878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 msgr2=0x559468870470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e5400640 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468870470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e5400640 1 -- 172.21.15.7:0/1958788878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559468792e10 con 0x5594688709b0 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08daa00640 1 -- 172.21.15.7:0/2385491566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f08d40109a0 con 0x7f08e0102fc0 2024-04-23T14:52:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08e5400640 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 0x559468872da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f08d002a9a0 tx=0x7f08d0004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0bb1211506d0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.304+0000 7f08cf000640 1 -- 172.21.15.7:0/1958788878 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d003f070 con 0x5594688709b0 2024-04-23T14:52:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08cf000640 1 -- 172.21.15.7:0/1958788878 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08d00054f0 con 0x5594688709b0 2024-04-23T14:52:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08cf000640 1 -- 172.21.15.7:0/1958788878 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0035030 con 0x5594688709b0 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 -- 172.21.15.7:0/1958788878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 msgr2=0x559468872da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 0x559468872da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f08d002a9a0 tx=0x7f08d0004170 comp rx=0 tx=0).stop 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 -- 172.21.15.7:0/1958788878 shutdown_connections 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468870470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594688709b0 0x559468872da0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 --2- 172.21.15.7:0/1958788878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861300 0x5594688616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 -- 172.21.15.7:0/1958788878 >> 172.21.15.7:0/1958788878 conn(0x55946885d8d0 msgr2=0x55946885dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.305+0000 7f08eb5da740 1 -- 172.21.15.7:0/1958788878 shutdown_connections 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.306+0000 7f08eb5da740 1 -- 172.21.15.7:0/1958788878 wait complete. 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.306+0000 7f08daa00640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08c80a3ca0 0x7f08c80a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.306+0000 7f08eb5da740 1 -- start start 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.306+0000 7f08daa00640 1 -- 172.21.15.7:0/2385491566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f08d40d0820 con 0x7f08e0102fc0 2024-04-23T14:52:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.306+0000 7f08e6800640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08c80a3ca0 0x7f08c80a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.306+0000 7f08eb5da740 1 Processor -- start 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861c20 0x55946886df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5594688709b0 0x55946886e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559468873520 con 0x559468861300 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5594687812c0 con 0x5594688709b0 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5594688736a0 con 0x559468861c20 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08eb5da740 10 client.0 _ll_register_callbacks cb 0x5594684d9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e6800640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08c80a3ca0 0x7f08c80a6160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc009530 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33670/0 (socket says 172.21.15.7:33670) 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 -- 172.21.15.7:0/2113124733 learned_addr learned my addr 172.21.15.7:0/2113124733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 -- 172.21.15.7:0/2113124733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861c20 msgr2=0x55946886df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861c20 0x55946886df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 -- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5594688709b0 msgr2=0x55946886e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5594688709b0 0x55946886e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.307+0000 7f08e5e00640 1 -- 172.21.15.7:0/2113124733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559468791fd0 con 0x559468861300 2024-04-23T14:52:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08e5e00640 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886d9d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f08d40a4b40 tx=0x7f08d409be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e596bbd27fc952 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08c3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08c3400640 1 -- 172.21.15.7:0/2113124733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4020070 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08c3400640 1 -- 172.21.15.7:0/2113124733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f08d40d0400 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d00054f0 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08c3400640 1 -- 172.21.15.7:0/2113124733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08d40a07b0 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08eb5da740 10 client.15759 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.308+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594684da210 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08c3400640 1 -- 172.21.15.7:0/2113124733 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08d00054f0 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08c3400640 1 -- 172.21.15.7:0/2113124733 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08d40b5b80 con 0x559468861300 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08eb5da740 10 client.15759 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08eb5da740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08eb5da740 20 client.15759 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08eb5da740 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688654a0 0x559468867930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08eb5da740 4 client.15759 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:52:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.309+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594687d5320 con 0x5594688654a0 2024-04-23T14:52:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.310+0000 7f08e5400640 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688654a0 0x559468867930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.311+0000 7f08e5400640 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688654a0 0x559468867930 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=359e9d7faab3e5 server_cookie=22bf957694dd7eb2 in_seq=0 out_seq=0 2024-04-23T14:52:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.311+0000 7f08c3400640 10 client.15759 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08c3400640 1 -- 172.21.15.7:0/2113124733 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5594687d5320 con 0x5594688654a0 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08c3400640 10 client.15759 handle_command_reply: tid=0 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 client.15759 shutdown 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 msgr2=0x55946886d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886d9d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f08d40a4b40 tx=0x7f08d409be60 comp rx=0 tx=0).stop 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 shutdown_connections 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688654a0 0x559468867930 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5594688709b0 0x55946886e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559468861c20 0x55946886df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08c3400640 0 client.15759 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 --2- 172.21.15.7:0/2113124733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886d9d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 >> 172.21.15.7:0/2113124733 conn(0x55946885d8d0 msgr2=0x559468863650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 shutdown_connections 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 1 -- 172.21.15.7:0/2113124733 wait complete. 2024-04-23T14:52:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.313+0000 7f08eb5da740 20 client.15759 trim_cache size 0 max 16384 2024-04-23T14:52:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.329+0000 7f08eb5da740 1 Processor -- start 2024-04-23T14:52:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.329+0000 7f08eb5da740 1 -- start start 2024-04-23T14:52:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946887c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468863460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946888cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08eb5da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01ad000 con 0x559468861300 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08eb5da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01aeb40 con 0x559468861c20 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08eb5da740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01ad6d0 con 0x5594688709b0 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946887c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946887c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33676/0 (socket says 172.21.15.7:33676) 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08e5e00640 1 -- 172.21.15.7:0/821796320 learned_addr learned my addr 172.21.15.7:0/821796320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08e5400640 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468863460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.330+0000 7f08e6800640 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946888cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08e5e00640 1 -- 172.21.15.7:0/821796320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 msgr2=0x55946888cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08e5e00640 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946888cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08e5e00640 1 -- 172.21.15.7:0/821796320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 msgr2=0x559468863460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08e5e00640 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468863460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08e5e00640 1 -- 172.21.15.7:0/821796320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594685a6620 con 0x559468861300 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08e5e00640 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946887c450 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f08d409c100 tx=0x7f08d40ce0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23b9ac2856f07bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08ce600640 1 -- 172.21.15.7:0/821796320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4020030 con 0x559468861300 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08ce600640 1 -- 172.21.15.7:0/821796320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08d4015020 con 0x559468861300 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.331+0000 7f08ce600640 1 -- 172.21.15.7:0/821796320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d40d0400 con 0x559468861300 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 -- 172.21.15.7:0/821796320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 msgr2=0x55946887c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946887c450 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f08d409c100 tx=0x7f08d40ce0f0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 -- 172.21.15.7:0/821796320 shutdown_connections 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x559468863460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946888cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 --2- 172.21.15.7:0/821796320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946887c450 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 -- 172.21.15.7:0/821796320 >> 172.21.15.7:0/821796320 conn(0x55946885d8d0 msgr2=0x559468862d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 -- 172.21.15.7:0/821796320 shutdown_connections 2024-04-23T14:52:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 -- 172.21.15.7:0/821796320 wait complete. 2024-04-23T14:52:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.332+0000 7f08eb5da740 1 -- start start 2024-04-23T14:52:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 Processor -- start 2024-04-23T14:52:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x55946886abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946886b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01ae470 con 0x559468861300 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01adda0 con 0x559468861c20 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01aafe0 con 0x5594688709b0 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08eb5da740 10 client.0 _ll_register_callbacks cb 0x7f08d400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33680/0 (socket says 172.21.15.7:33680) 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.333+0000 7f08e5e00640 1 -- 172.21.15.7:0/4000880955 learned_addr learned my addr 172.21.15.7:0/4000880955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08e5e00640 1 -- 172.21.15.7:0/4000880955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 msgr2=0x55946886b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08e5e00640 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946886b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08e5e00640 1 -- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 msgr2=0x55946886abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08e5e00640 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x55946886abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08e5e00640 1 -- 172.21.15.7:0/4000880955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594688ea810 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08e5e00640 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886a670 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f08d4098dd0 tx=0x7f08d400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0b895b56a1507c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08c3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08c3400640 1 -- 172.21.15.7:0/4000880955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4020030 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08c3400640 1 -- 172.21.15.7:0/4000880955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f08d40bb2c0 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d4015020 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08c3400640 1 -- 172.21.15.7:0/4000880955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08d40ac050 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08eb5da740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.334+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594688ebaf0 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08c3400640 1 -- 172.21.15.7:0/4000880955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08d4015020 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08c3400640 1 -- 172.21.15.7:0/4000880955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08d4098150 con 0x559468861300 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08eb5da740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08eb5da740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08eb5da740 20 client.15765 populate_metadata read hostname 'smithi007' 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08eb5da740 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688ec070 0x5594688ee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08eb5da740 4 client.15765 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:52:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.335+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594687cf190 con 0x5594688ec070 2024-04-23T14:52:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.336+0000 7f08e5400640 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688ec070 0x5594688ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.336+0000 7f08e5400640 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688ec070 0x5594688ee490 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57201fd31f938bf5 server_cookie=2f8009383fbb0635 in_seq=0 out_seq=0 2024-04-23T14:52:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.336+0000 7f08c3400640 10 client.15765 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08c3400640 1 -- 172.21.15.7:0/4000880955 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594687cf190 con 0x5594688ec070 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08c3400640 10 client.15765 handle_command_reply: tid=0 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 client.15765 shutdown 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 msgr2=0x55946886a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886a670 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f08d4098dd0 tx=0x7f08d400bf60 comp rx=0 tx=0).stop 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 shutdown_connections 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5594688ec070 0x5594688ee490 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559468861c20 0x55946886abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5594688709b0 0x55946886b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 --2- 172.21.15.7:0/4000880955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559468861300 0x55946886a670 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 >> 172.21.15.7:0/4000880955 conn(0x55946885d8d0 msgr2=0x5594688635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08c3400640 0 client.15765 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 shutdown_connections 2024-04-23T14:52:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 1 -- 172.21.15.7:0/4000880955 wait complete. 2024-04-23T14:52:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.351+0000 7f08eb5da740 20 client.15765 trim_cache size 0 max 16384 2024-04-23T14:52:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:52:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:52:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:52:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08c80a3ca0 msgr2=0x7f08c80a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08c80a3ca0 0x7f08c80a6160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc009530 comp rx=0 tx=0).stop 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 msgr2=0x7f08e01986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 0x7f08e01986a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f08d400d950 tx=0x7f08d400de10 comp rx=0 tx=0).stop 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 shutdown_connections 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08c80a3ca0 0x7f08c80a6160 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08e010c3e0 0x7f08e019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e01038e0 0x7f08e0198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 --2- 172.21.15.7:0/2385491566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e0102fc0 0x7f08e01986a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 >> 172.21.15.7:0/2385491566 conn(0x7f08e00fc820 msgr2=0x7f08e00fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 shutdown_connections 2024-04-23T14:52:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:52:56.352+0000 7f08e7200640 1 -- 172.21.15.7:0/2385491566 wait complete. 2024-04-23T14:52:56.875 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'. 2024-04-23T14:52:56.875 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.875 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T14:52:56.875 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-04-23T14:52:56.876 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at d44fddd910b DNM: trigger builds again 2024-04-23T14:52:56.889 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T14:52:56.994 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T14:52:57.002 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T14:52:57.002 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T14:52:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:57 smithi007 ceph-mon[27906]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-04-23T14:52:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:57 smithi186 ceph-mon[31814]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-04-23T14:52:57.884 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T14:52:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:57 smithi137 ceph-mon[31694]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-04-23T14:52:58.055 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T14:52:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T14:52:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T14:52:58.157 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T14:52:58.245 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T14:52:58.256 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T14:52:58.256 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T14:52:58.313 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-04-23T14:52:58.315 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-04-23T14:52:58.315 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d44fddd910b5e94da0f2357af4be37d7bd495ae0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-23T14:52:58.411 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-23T14:52:58.415 INFO:tasks.workunit.client.0.smithi007.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-04-23T14:52:58.415 INFO:tasks.workunit.client.0.smithi007.stderr:+ trap -- retry EXIT 2024-04-23T14:52:58.415 INFO:tasks.workunit.client.0.smithi007.stderr:+ rm -rf ffsb 2024-04-23T14:52:58.420 INFO:tasks.workunit.client.0.smithi007.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-04-23T14:52:58.438 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into 'ffsb'... 2024-04-23T14:52:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:52:59 smithi007 ceph-mon[27906]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T14:52:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:52:59 smithi186 ceph-mon[31814]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T14:52:59.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:52:59 smithi137 ceph-mon[31694]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T14:53:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:01 smithi007 ceph-mon[27906]: pgmap v53: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T14:53:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:01 smithi186 ceph-mon[31814]: pgmap v53: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T14:53:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:01 smithi137 ceph-mon[31694]: pgmap v53: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T14:53:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:03 smithi007 ceph-mon[27906]: pgmap v54: 129 pgs: 129 active+clean; 2.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 92 KiB/s wr, 37 op/s 2024-04-23T14:53:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:03 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:53:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:03 smithi186 ceph-mon[31814]: pgmap v54: 129 pgs: 129 active+clean; 2.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 92 KiB/s wr, 37 op/s 2024-04-23T14:53:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:03 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:53:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:03 smithi137 ceph-mon[31694]: pgmap v54: 129 pgs: 129 active+clean; 2.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 92 KiB/s wr, 37 op/s 2024-04-23T14:53:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:03 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:53:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:05 smithi186 ceph-mon[31814]: pgmap v55: 129 pgs: 129 active+clean; 2.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 91 KiB/s wr, 32 op/s 2024-04-23T14:53:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:05 smithi137 ceph-mon[31694]: pgmap v55: 129 pgs: 129 active+clean; 2.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 91 KiB/s wr, 32 op/s 2024-04-23T14:53:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:05 smithi007 ceph-mon[27906]: pgmap v55: 129 pgs: 129 active+clean; 2.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 91 KiB/s wr, 32 op/s 2024-04-23T14:53:06.589 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-04-23T14:53:06.905 INFO:tasks.workunit.client.0.smithi007.stderr:+ trap - EXIT 2024-04-23T14:53:06.906 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd ffsb 2024-04-23T14:53:06.911 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./configure 2024-04-23T14:53:07.446 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-23T14:53:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:07 smithi186 ceph-mon[31814]: pgmap v56: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 258 KiB/s wr, 56 op/s 2024-04-23T14:53:07.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:07 smithi007 ceph-mon[27906]: pgmap v56: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 258 KiB/s wr, 56 op/s 2024-04-23T14:53:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:07 smithi137 ceph-mon[31694]: pgmap v56: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 258 KiB/s wr, 56 op/s 2024-04-23T14:53:08.483 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether build environment is sane... yes 2024-04-23T14:53:08.551 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-23T14:53:08.554 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gawk... gawk 2024-04-23T14:53:08.637 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether make sets $(MAKE)... yes 2024-04-23T14:53:08.802 INFO:tasks.workunit.client.0.smithi007.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-23T14:53:08.802 INFO:tasks.workunit.client.0.smithi007.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-23T14:53:08.865 INFO:tasks.workunit.client.0.smithi007.stdout:checking for style of include used by make... GNU 2024-04-23T14:53:08.887 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... gcc 2024-04-23T14:53:09.225 INFO:tasks.workunit.client.0.smithi007.stdout:checking for C compiler default output file name... a.out 2024-04-23T14:53:09.242 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether the C compiler works... yes 2024-04-23T14:53:09.258 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are cross compiling... no 2024-04-23T14:53:09.442 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of executables... 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 -- 172.21.15.7:0/1228966251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 msgr2=0x7ff2d81128d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 --2- 172.21.15.7:0/1228966251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81128d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009900 tx=0x7ff2c402a480 comp rx=0 tx=0).stop 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 -- 172.21.15.7:0/1228966251 shutdown_connections 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 --2- 172.21.15.7:0/1228966251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 0x7ff2d8115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 --2- 172.21.15.7:0/1228966251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81128d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 --2- 172.21.15.7:0/1228966251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2d80743a0 0x7ff2d8074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 -- 172.21.15.7:0/1228966251 >> 172.21.15.7:0/1228966251 conn(0x7ff2d80fd950 msgr2=0x7ff2d80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 -- 172.21.15.7:0/1228966251 shutdown_connections 2024-04-23T14:53:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.509+0000 7ff2dd600640 1 -- 172.21.15.7:0/1228966251 wait complete. 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.510+0000 7ff2dd600640 1 Processor -- start 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 -- start start 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2d80743a0 0x7ff2d81a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 0x7ff2d819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81186b0 con 0x7ff2d8074cc0 2024-04-23T14:53:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8118530 con 0x7ff2d8112e10 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2dd600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8118830 con 0x7ff2d80743a0 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81a4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34426/0 (socket says 172.21.15.7:34426) 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.511+0000 7ff2d7400640 1 -- 172.21.15.7:0/3167973391 learned_addr learned my addr 172.21.15.7:0/3167973391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2d80743a0 0x7ff2d81a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 0x7ff2d819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7400640 1 -- 172.21.15.7:0/3167973391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2d80743a0 msgr2=0x7ff2d81a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7400640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2d80743a0 0x7ff2d81a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7400640 1 -- 172.21.15.7:0/3167973391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 msgr2=0x7ff2d819ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7400640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 0x7ff2d819ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7400640 1 -- 172.21.15.7:0/3167973391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d819f250 con 0x7ff2d8074cc0 2024-04-23T14:53:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 0x7ff2d819ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:53:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.512+0000 7ff2d7400640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81a4e10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4005940 tx=0x7ff2c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.513+0000 7ff2d4c00640 1 -- 172.21.15.7:0/3167973391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c403f030 con 0x7ff2d8074cc0 2024-04-23T14:53:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.513+0000 7ff2d4c00640 1 -- 172.21.15.7:0/3167973391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2c4003aa0 con 0x7ff2d8074cc0 2024-04-23T14:53:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.513+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d819f4e0 con 0x7ff2d8074cc0 2024-04-23T14:53:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.513+0000 7ff2d4c00640 1 -- 172.21.15.7:0/3167973391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4035070 con 0x7ff2d8074cc0 2024-04-23T14:53:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.513+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d81ab790 con 0x7ff2d8074cc0 2024-04-23T14:53:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.517+0000 7ff2e1ba8740 1 Processor -- start 2024-04-23T14:53:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.517+0000 7ff2e1ba8740 1 -- start start 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.517+0000 7ff2d4c00640 1 -- 172.21.15.7:0/3167973391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff2c4042030 con 0x7ff2d8074cc0 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9ee77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619a9e4d900 con 0x5619a9ee7ce0 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5619a9df3f20 con 0x5619a9ee73c0 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5619a9e498c0 con 0x5619a9ef25a0 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34428/0 (socket says 172.21.15.7:34428) 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2d7e00640 1 -- 172.21.15.7:0/229681353 learned_addr learned my addr 172.21.15.7:0/229681353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9ee77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.518+0000 7ff2d7400640 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d7e00640 1 -- 172.21.15.7:0/229681353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 msgr2=0x5619a9ef4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d7e00640 1 -- 172.21.15.7:0/229681353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 msgr2=0x5619a9ee77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9ee77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d7e00640 1 -- 172.21.15.7:0/229681353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a9e18e10 con 0x5619a9ee7ce0 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef2060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8004650 tx=0x7ff2c800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc809c84ed83279 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2d4c00640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff2bc0a3d90 0x7ff2bc0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2cd200640 1 -- 172.21.15.7:0/229681353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8003bd0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2cd200640 1 -- 172.21.15.7:0/229681353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2c8015070 con 0x5619a9ee7ce0 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.519+0000 7ff2cd200640 1 -- 172.21.15.7:0/229681353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8004cd0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.520+0000 7ff2d4c00640 1 -- 172.21.15.7:0/3167973391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7ff2c40f1260 con 0x7ff2d8074cc0 2024-04-23T14:53:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.520+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff2bc0a3d90 0x7ff2bc0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.520+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/229681353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 msgr2=0x5619a9ef2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.520+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef2060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8004650 tx=0x7ff2c800bba0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff2bc0a3d90 0x7ff2bc0a6250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2d806b480 tx=0x7ff2d0009780 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/229681353 shutdown_connections 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef2060 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/229681353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9ee77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/229681353 >> 172.21.15.7:0/229681353 conn(0x5619a9ee38d0 msgr2=0x5619a9ee3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/229681353 shutdown_connections 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/229681353 wait complete. 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 -- start start 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.521+0000 7ff2e1ba8740 1 Processor -- start 2024-04-23T14:53:09.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 0x5619a9eef490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee7ce0 0x5619a9eef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ef25a0 0x5619a9eeff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619a9ef5140 con 0x5619a9ee73c0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5619a9e072c0 con 0x5619a9ef25a0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5619a9ef52c0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2e1ba8740 10 client.0 _ll_register_callbacks cb 0x5619a9b5fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 0x5619a9eef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 0x5619a9eef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34442/0 (socket says 172.21.15.7:34442) 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.522+0000 7ff2d7e00640 1 -- 172.21.15.7:0/4204192206 learned_addr learned my addr 172.21.15.7:0/4204192206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7400640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee7ce0 0x5619a9eef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ef25a0 0x5619a9eeff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7e00640 1 -- 172.21.15.7:0/4204192206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee7ce0 msgr2=0x5619a9eef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee7ce0 0x5619a9eef9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7e00640 1 -- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ef25a0 msgr2=0x5619a9eeff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ef25a0 0x5619a9eeff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7e00640 1 -- 172.21.15.7:0/4204192206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a9e17fd0 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 0x5619a9eef490 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005880 tx=0x7ff2c8004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4d8529ef8e4ffb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2c1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.523+0000 7ff2c1600640 1 -- 172.21.15.7:0/4204192206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c802a060 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2c1600640 1 -- 172.21.15.7:0/4204192206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7ff2c8003f20 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2c8015070 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2c1600640 1 -- 172.21.15.7:0/4204192206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff2c8031050 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2e1ba8740 10 client.15777 fetch_fsmap learned FSMap version 29 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5619a9b60210 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2c1600640 1 -- 172.21.15.7:0/4204192206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2c8015070 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.524+0000 7ff2c1600640 1 -- 172.21.15.7:0/4204192206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7ff2c80195e0 con 0x5619a9ee73c0 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2e1ba8740 10 client.15777 fetch_fsmap finished waiting for FSMap version 29 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2e1ba8740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:09.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2e1ba8740 20 client.15777 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2e1ba8740 4 client.15777 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:53:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619a9e5b320 con 0x5619a9f02600 2024-04-23T14:53:09.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.525+0000 7ff2d7400640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.526+0000 7ff2d7400640 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f049f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfb5ec50a286e651 server_cookie=255d4d6c8b97907d in_seq=0 out_seq=0 2024-04-23T14:53:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.526+0000 7ff2c1600640 10 client.15777 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2c1600640 1 -- 172.21.15.7:0/4204192206 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5619a9e5b320 con 0x5619a9f02600 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2c1600640 10 client.15777 handle_command_reply: tid=0 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 client.15777 shutdown 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 msgr2=0x5619a9eef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 0x5619a9eef490 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005880 tx=0x7ff2c8004440 comp rx=0 tx=0).stop 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 shutdown_connections 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f049f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ef25a0 0x5619a9eeff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee7ce0 0x5619a9eef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2c1600640 0 client.15777 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/4204192206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee73c0 0x5619a9eef490 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.528+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 >> 172.21.15.7:0/4204192206 conn(0x5619a9ee38d0 msgr2=0x5619a9ee9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.529+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 shutdown_connections 2024-04-23T14:53:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.529+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/4204192206 wait complete. 2024-04-23T14:53:09.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.529+0000 7ff2e1ba8740 20 client.15777 trim_cache size 0 max 16384 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.546+0000 7ff2e1ba8740 1 Processor -- start 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.546+0000 7ff2e1ba8740 1 -- start start 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee73c0 0x5619a9ef1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee7ce0 0x5619a9efe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 0x5619a9ee2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81b56c0 con 0x5619a9ef25a0 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81b7290 con 0x5619a9ee7ce0 2024-04-23T14:53:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81b5d90 con 0x5619a9ee73c0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2dcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 0x5619a9ee2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2dcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 0x5619a9ee2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34452/0 (socket says 172.21.15.7:34452) 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2dcc00640 1 -- 172.21.15.7:0/156377536 learned_addr learned my addr 172.21.15.7:0/156377536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.547+0000 7ff2d7400640 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee7ce0 0x5619a9efe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee73c0 0x5619a9ef1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2dcc00640 1 -- 172.21.15.7:0/156377536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee73c0 msgr2=0x5619a9ef1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee73c0 0x5619a9ef1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2dcc00640 1 -- 172.21.15.7:0/156377536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee7ce0 msgr2=0x5619a9efe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee7ce0 0x5619a9efe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2dcc00640 1 -- 172.21.15.7:0/156377536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a9c2c620 con 0x5619a9ef25a0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2d7400640 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee7ce0 0x5619a9efe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 0x5619a9ee2910 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0011630 tx=0x7ff2d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28010f6b1b32e243 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.548+0000 7ff2c3e00640 1 -- 172.21.15.7:0/156377536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0004d20 con 0x5619a9ef25a0 2024-04-23T14:53:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2c3e00640 1 -- 172.21.15.7:0/156377536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2d00054d0 con 0x5619a9ef25a0 2024-04-23T14:53:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2c3e00640 1 -- 172.21.15.7:0/156377536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0020980 con 0x5619a9ef25a0 2024-04-23T14:53:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/156377536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 msgr2=0x5619a9ee2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 0x5619a9ee2910 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0011630 tx=0x7ff2d0016000 comp rx=0 tx=0).stop 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/156377536 shutdown_connections 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee7ce0 0x5619a9efe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ef25a0 0x5619a9ee2910 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/156377536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ee73c0 0x5619a9ef1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.549+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/156377536 >> 172.21.15.7:0/156377536 conn(0x5619a9ee38d0 msgr2=0x5619a9ee2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.550+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/156377536 shutdown_connections 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.550+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/156377536 wait complete. 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.550+0000 7ff2e1ba8740 1 -- start start 2024-04-23T14:53:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 Processor -- start 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9efabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81b6b30 con 0x5619a9ee7ce0 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81b6460 con 0x5619a9ee73c0 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81b36a0 con 0x5619a9ef25a0 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.551+0000 7ff2e1ba8740 10 client.0 _ll_register_callbacks cb 0x7ff2d0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34460/0 (socket says 172.21.15.7:34460) 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 -- 172.21.15.7:0/2402328504 learned_addr learned my addr 172.21.15.7:0/2402328504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9efabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2dcc00640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 -- 172.21.15.7:0/2402328504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 msgr2=0x5619a9ef6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 -- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 msgr2=0x5619a9efabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9efabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 -- 172.21.15.7:0/2402328504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a9f67ab0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2d7400640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef5f50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40bce30 tx=0x7ff2c40bcd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dd5d061a9a4e1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2c1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.552+0000 7ff2c1600640 1 -- 172.21.15.7:0/2402328504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4049040 con 0x5619a9ee7ce0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2c1600640 1 -- 172.21.15.7:0/2402328504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7ff2c40bb1a0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d00054d0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2c1600640 1 -- 172.21.15.7:0/2402328504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff2c403b460 con 0x5619a9ee7ce0 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 10 client.15783 fetch_fsmap learned FSMap version 29 2024-04-23T14:53:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5619a9f68c80 con 0x5619a9ee7ce0 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2c1600640 1 -- 172.21.15.7:0/2402328504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2d00054d0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2c1600640 1 -- 172.21.15.7:0/2402328504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7ff2c40ee8d0 con 0x5619a9ee7ce0 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 20 client.15783 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f6b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 4 client.15783 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.553+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619a9e55190 con 0x5619a9f02600 2024-04-23T14:53:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.554+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f6b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.555+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f6b500 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5589a4af291085ec server_cookie=e19e4bb63883be2c in_seq=0 out_seq=0 2024-04-23T14:53:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.555+0000 7ff2c1600640 10 client.15783 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:09.643 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of object files... o 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2c1600640 1 -- 172.21.15.7:0/2402328504 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619a9e55190 con 0x5619a9f02600 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2c1600640 10 client.15783 handle_command_reply: tid=0 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 client.15783 shutdown 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 msgr2=0x5619a9ef5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef5f50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40bce30 tx=0x7ff2c40bcd30 comp rx=0 tx=0).stop 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 shutdown_connections 2024-04-23T14:53:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5619a9f02600 0x5619a9f6b500 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5619a9ef25a0 0x5619a9ef6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619a9ee7ce0 0x5619a9ef5f50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 --2- 172.21.15.7:0/2402328504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619a9ee73c0 0x5619a9efabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 >> 172.21.15.7:0/2402328504 conn(0x5619a9ee38d0 msgr2=0x5619a9ee2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.727+0000 7ff2c1600640 0 client.15783 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.728+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 shutdown_connections 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.728+0000 7ff2e1ba8740 1 -- 172.21.15.7:0/2402328504 wait complete. 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.728+0000 7ff2e1ba8740 20 client.15783 trim_cache size 0 max 16384 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:53:09.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:53:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:53:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:53:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff2bc0a3d90 msgr2=0x7ff2bc0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff2bc0a3d90 0x7ff2bc0a6250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2d806b480 tx=0x7ff2d0009780 comp rx=0 tx=0).stop 2024-04-23T14:53:09.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 msgr2=0x7ff2d81a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81a4e10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4005940 tx=0x7ff2c4004270 comp rx=0 tx=0).stop 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 shutdown_connections 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff2bc0a3d90 0x7ff2bc0a6250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d8112e10 0x7ff2d819ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d8074cc0 0x7ff2d81a4e10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 --2- 172.21.15.7:0/3167973391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2d80743a0 0x7ff2d81a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 >> 172.21.15.7:0/3167973391 conn(0x7ff2d80fd950 msgr2=0x7ff2d80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 shutdown_connections 2024-04-23T14:53:09.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:09.729+0000 7ff2dd600640 1 -- 172.21.15.7:0/3167973391 wait complete. 2024-04-23T14:53:09.776 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... yes 2024-04-23T14:53:09.888 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... yes 2024-04-23T14:53:09.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:09 smithi137 ceph-mon[31694]: pgmap v57: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 257 KiB/s wr, 52 op/s 2024-04-23T14:53:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:09 smithi007 ceph-mon[27906]: pgmap v57: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 257 KiB/s wr, 52 op/s 2024-04-23T14:53:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:09 smithi186 ceph-mon[31814]: pgmap v57: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 257 KiB/s wr, 52 op/s 2024-04-23T14:53:10.135 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-23T14:53:10.779 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... gcc3 2024-04-23T14:53:11.055 INFO:tasks.workunit.client.0.smithi007.stdout:checking how to run the C preprocessor... gcc -E 2024-04-23T14:53:11.274 INFO:tasks.workunit.client.0.smithi007.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-23T14:53:11.280 INFO:tasks.workunit.client.0.smithi007.stdout:checking for egrep... /usr/bin/grep -E 2024-04-23T14:53:11.329 INFO:tasks.workunit.client.0.smithi007.stdout:checking for AIX... no 2024-04-23T14:53:11.404 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... (cached) gcc 2024-04-23T14:53:11.466 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-23T14:53:11.471 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-23T14:53:11.474 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-23T14:53:11.476 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-23T14:53:11.759 INFO:tasks.workunit.client.0.smithi007.stdout:checking for main in -lm... yes 2024-04-23T14:53:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:11 smithi137 ceph-mon[31694]: pgmap v58: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 257 KiB/s wr, 52 op/s 2024-04-23T14:53:12.035 INFO:tasks.workunit.client.0.smithi007.stdout:checking for main in -lpthread... yes 2024-04-23T14:53:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:11 smithi007 ceph-mon[27906]: pgmap v58: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 257 KiB/s wr, 52 op/s 2024-04-23T14:53:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:11 smithi186 ceph-mon[31814]: pgmap v58: 129 pgs: 129 active+clean; 3.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 257 KiB/s wr, 52 op/s 2024-04-23T14:53:12.771 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ANSI C header files... yes 2024-04-23T14:53:12.983 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-23T14:53:13.198 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/types.h... yes 2024-04-23T14:53:13.664 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/stat.h... yes 2024-04-23T14:53:13.900 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdlib.h... yes 2024-04-23T14:53:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:13 smithi137 ceph-mon[31694]: pgmap v59: 129 pgs: 129 active+clean; 4.9 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 366 KiB/s wr, 143 op/s 2024-04-23T14:53:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:13 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:53:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:13 smithi007 ceph-mon[27906]: pgmap v59: 129 pgs: 129 active+clean; 4.9 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 366 KiB/s wr, 143 op/s 2024-04-23T14:53:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:13 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:53:14.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:13 smithi186 ceph-mon[31814]: pgmap v59: 129 pgs: 129 active+clean; 4.9 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 366 KiB/s wr, 143 op/s 2024-04-23T14:53:14.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:13 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:53:14.148 INFO:tasks.workunit.client.0.smithi007.stdout:checking for string.h... yes 2024-04-23T14:53:14.387 INFO:tasks.workunit.client.0.smithi007.stdout:checking for memory.h... yes 2024-04-23T14:53:14.636 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strings.h... yes 2024-04-23T14:53:14.887 INFO:tasks.workunit.client.0.smithi007.stdout:checking for inttypes.h... yes 2024-04-23T14:53:15.145 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... yes 2024-04-23T14:53:15.376 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... yes 2024-04-23T14:53:15.654 INFO:tasks.workunit.client.0.smithi007.stdout:checking pthread.h usability... yes 2024-04-23T14:53:15.782 INFO:tasks.workunit.client.0.smithi007.stdout:checking pthread.h presence... yes 2024-04-23T14:53:15.786 INFO:tasks.workunit.client.0.smithi007.stdout:checking for pthread.h... yes 2024-04-23T14:53:15.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:15 smithi137 ceph-mon[31694]: pgmap v60: 129 pgs: 129 active+clean; 4.9 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 275 KiB/s wr, 115 op/s 2024-04-23T14:53:16.042 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h usability... yes 2024-04-23T14:53:16.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:15 smithi007 ceph-mon[27906]: pgmap v60: 129 pgs: 129 active+clean; 4.9 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 275 KiB/s wr, 115 op/s 2024-04-23T14:53:16.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:15 smithi186 ceph-mon[31814]: pgmap v60: 129 pgs: 129 active+clean; 4.9 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 275 KiB/s wr, 115 op/s 2024-04-23T14:53:16.153 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h presence... yes 2024-04-23T14:53:16.157 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fcntl.h... yes 2024-04-23T14:53:16.413 INFO:tasks.workunit.client.0.smithi007.stdout:checking limits.h usability... yes 2024-04-23T14:53:16.524 INFO:tasks.workunit.client.0.smithi007.stdout:checking limits.h presence... yes 2024-04-23T14:53:16.528 INFO:tasks.workunit.client.0.smithi007.stdout:checking for limits.h... yes 2024-04-23T14:53:16.609 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... (cached) yes 2024-04-23T14:53:16.814 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h usability... yes 2024-04-23T14:53:16.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:16 smithi137 ceph-mon[31694]: pgmap v61: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 404 KiB/s wr, 144 op/s 2024-04-23T14:53:16.925 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h presence... yes 2024-04-23T14:53:16.930 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/time.h... yes 2024-04-23T14:53:17.004 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... (cached) yes 2024-04-23T14:53:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:16 smithi007 ceph-mon[27906]: pgmap v61: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 404 KiB/s wr, 144 op/s 2024-04-23T14:53:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:16 smithi186 ceph-mon[31814]: pgmap v61: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 404 KiB/s wr, 144 op/s 2024-04-23T14:53:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/vfs.h usability... yes 2024-04-23T14:53:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/vfs.h presence... yes 2024-04-23T14:53:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/vfs.h... yes 2024-04-23T14:53:17.578 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/limits.h usability... no 2024-04-23T14:53:17.698 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/limits.h presence... no 2024-04-23T14:53:17.703 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/limits.h... no 2024-04-23T14:53:17.865 INFO:tasks.workunit.client.0.smithi007.stdout:checking for an ANSI C-conforming const... yes 2024-04-23T14:53:18.024 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-23T14:53:18.035 INFO:tasks.workunit.client.0.smithi007.stdout:checking for function prototypes... yes 2024-04-23T14:53:18.193 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether setvbuf arguments are reversed... no 2024-04-23T14:53:18.582 INFO:tasks.workunit.client.0.smithi007.stdout:checking for system... yes 2024-04-23T14:53:18.906 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gettimeofday... yes 2024-04-23T14:53:19.230 INFO:tasks.workunit.client.0.smithi007.stdout:checking for mkdir... yes 2024-04-23T14:53:19.561 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strerror... yes 2024-04-23T14:53:19.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:19 smithi007 ceph-mon[27906]: pgmap v62: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 237 KiB/s wr, 120 op/s 2024-04-23T14:53:19.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:19 smithi186 ceph-mon[31814]: pgmap v62: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 237 KiB/s wr, 120 op/s 2024-04-23T14:53:19.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:19 smithi137 ceph-mon[31694]: pgmap v62: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 237 KiB/s wr, 120 op/s 2024-04-23T14:53:19.887 INFO:tasks.workunit.client.0.smithi007.stdout:checking for open64... yes 2024-04-23T14:53:20.226 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stat64... yes 2024-04-23T14:53:20.572 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fseeko64... yes 2024-04-23T14:53:20.907 INFO:tasks.workunit.client.0.smithi007.stdout:checking for lrand48_r... yes 2024-04-23T14:53:21.228 INFO:tasks.workunit.client.0.smithi007.stdout:checking for srand48_r... yes 2024-04-23T14:53:21.340 INFO:tasks.workunit.client.0.smithi007.stdout:configure: creating ./config.status 2024-04-23T14:53:21.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:21 smithi186 ceph-mon[31814]: pgmap v63: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 237 KiB/s wr, 120 op/s 2024-04-23T14:53:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:21 smithi137 ceph-mon[31694]: pgmap v63: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 237 KiB/s wr, 120 op/s 2024-04-23T14:53:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:21 smithi007 ceph-mon[27906]: pgmap v63: 129 pgs: 129 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 237 KiB/s wr, 120 op/s 2024-04-23T14:53:21.856 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating Makefile 2024-04-23T14:53:21.932 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating config.h 2024-04-23T14:53:22.050 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing depfiles commands 2024-04-23T14:53:22.379 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing default commands 2024-04-23T14:53:22.637 INFO:tasks.workunit.client.0.smithi007.stderr:+ make 2024-04-23T14:53:22.794 INFO:tasks.workunit.client.0.smithi007.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-04-23T14:53:22.824 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-04-23T14:53:22.828 INFO:tasks.workunit.client.0.smithi007.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-04-23T14:53:22.828 INFO:tasks.workunit.client.0.smithi007.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-04-23T14:53:22.828 INFO:tasks.workunit.client.0.smithi007.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-04-23T14:53:22.828 INFO:tasks.workunit.client.0.smithi007.stderr: any GNU archive site. 2024-04-23T14:53:22.845 INFO:tasks.workunit.client.0.smithi007.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-04-23T14:53:22.862 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-04-23T14:53:22.864 INFO:tasks.workunit.client.0.smithi007.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-04-23T14:53:22.865 INFO:tasks.workunit.client.0.smithi007.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-04-23T14:53:22.865 INFO:tasks.workunit.client.0.smithi007.stderr: You might want to install the `Automake' and `Perl' packages. 2024-04-23T14:53:22.865 INFO:tasks.workunit.client.0.smithi007.stderr: Grab them from any GNU archive site. 2024-04-23T14:53:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.884+0000 7fb163e00640 1 -- 172.21.15.7:0/847302521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 msgr2=0x7fb15c1154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.884+0000 7fb163e00640 1 --2- 172.21.15.7:0/847302521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c1154b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb154009ca0 tx=0x7fb15402a950 comp rx=0 tx=0).stop 2024-04-23T14:53:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 -- 172.21.15.7:0/847302521 shutdown_connections 2024-04-23T14:53:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 --2- 172.21.15.7:0/847302521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074c20 0x7fb15c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 --2- 172.21.15.7:0/847302521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c1154b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 --2- 172.21.15.7:0/847302521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15c074300 0x7fb15c0746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 -- 172.21.15.7:0/847302521 >> 172.21.15.7:0/847302521 conn(0x7fb15c079490 msgr2=0x7fb15c0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 -- 172.21.15.7:0/847302521 shutdown_connections 2024-04-23T14:53:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.885+0000 7fb163e00640 1 -- 172.21.15.7:0/847302521 wait complete. 2024-04-23T14:53:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 Processor -- start 2024-04-23T14:53:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 -- start start 2024-04-23T14:53:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074300 0x7fb15c1a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15c074c20 0x7fb15c1a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c118910 con 0x7fb15c1130c0 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c118790 con 0x7fb15c074300 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.886+0000 7fb163e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c118a90 con 0x7fb15c074c20 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57850/0 (socket says 172.21.15.7:57850) 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 -- 172.21.15.7:0/1714538915 learned_addr learned my addr 172.21.15.7:0/1714538915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb160a00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15c074c20 0x7fb15c1a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161400640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074300 0x7fb15c1a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 -- 172.21.15.7:0/1714538915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15c074c20 msgr2=0x7fb15c1a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15c074c20 0x7fb15c1a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 -- 172.21.15.7:0/1714538915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074300 msgr2=0x7fb15c1a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074300 0x7fb15c1a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161e00640 1 -- 172.21.15.7:0/1714538915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c19f290 con 0x7fb15c1130c0 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.887+0000 7fb161400640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074300 0x7fb15c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.888+0000 7fb161e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c19eb10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb154004af0 tx=0x7fb154003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.888+0000 7fb15a000640 1 -- 172.21.15.7:0/1714538915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154034040 con 0x7fb15c1130c0 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.888+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c19f520 con 0x7fb15c1130c0 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.888+0000 7fb15a000640 1 -- 172.21.15.7:0/1714538915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb15402fd70 con 0x7fb15c1130c0 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.888+0000 7fb15a000640 1 -- 172.21.15.7:0/1714538915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154004590 con 0x7fb15c1130c0 2024-04-23T14:53:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.888+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c1ab7d0 con 0x7fb15c1130c0 2024-04-23T14:53:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.891+0000 7fb166bba740 1 Processor -- start 2024-04-23T14:53:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb15a000640 1 -- 172.21.15.7:0/1714538915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb154037020 con 0x7fb15c1130c0 2024-04-23T14:53:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 -- start start 2024-04-23T14:53:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbfae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5592ebb56900 con 0x5592ebbfb390 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5592ebafcf20 con 0x5592ebbf01b0 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.892+0000 7fb166bba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5592ebb528c0 con 0x5592ebbf0ad0 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57862/0 (socket says 172.21.15.7:57862) 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 -- 172.21.15.7:0/2997209273 learned_addr learned my addr 172.21.15.7:0/2997209273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb161400640 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbfae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 -- 172.21.15.7:0/2997209273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 msgr2=0x5592ebbfae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbfae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 -- 172.21.15.7:0/2997209273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 msgr2=0x5592ebbf0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.893+0000 7fb160a00640 1 -- 172.21.15.7:0/2997209273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592ebb21e10 con 0x5592ebbfb390 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb15a000640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1440a3dc0 0x7fb1440a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb160a00640 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfd780 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb14800ef60 tx=0x7fb14800e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464eafcc96b5c554 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb15a000640 1 -- 172.21.15.7:0/1714538915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fb1540f1a50 con 0x7fb15c1130c0 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb161400640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1440a3dc0 0x7fb1440a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb14e600640 1 -- 172.21.15.7:0/2997209273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148018070 con 0x5592ebbfb390 2024-04-23T14:53:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb14e600640 1 -- 172.21.15.7:0/2997209273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb148004220 con 0x5592ebbfb390 2024-04-23T14:53:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.894+0000 7fb14e600640 1 -- 172.21.15.7:0/2997209273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1480038c0 con 0x5592ebbfb390 2024-04-23T14:53:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 -- 172.21.15.7:0/2997209273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 msgr2=0x5592ebbfd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb161400640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1440a3dc0 0x7fb1440a6280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb150005fd0 tx=0x7fb1500094c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfd780 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb14800ef60 tx=0x7fb14800e430 comp rx=0 tx=0).stop 2024-04-23T14:53:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 -- 172.21.15.7:0/2997209273 shutdown_connections 2024-04-23T14:53:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfd780 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbfae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 --2- 172.21.15.7:0/2997209273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 -- 172.21.15.7:0/2997209273 >> 172.21.15.7:0/2997209273 conn(0x5592ebbec6c0 msgr2=0x5592ebbecaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 -- 172.21.15.7:0/2997209273 shutdown_connections 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.895+0000 7fb166bba740 1 -- 172.21.15.7:0/2997209273 wait complete. 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.896+0000 7fb166bba740 1 -- start start 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.896+0000 7fb166bba740 1 Processor -- start 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.896+0000 7fb166bba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf01b0 0x5592ebbf8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.896+0000 7fb166bba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.896+0000 7fb166bba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbf8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.896+0000 7fb166bba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5592ebbfdfc0 con 0x5592ebbfb390 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb166bba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5592ebb102c0 con 0x5592ebbf0ad0 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb166bba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5592ebbfe140 con 0x5592ebbf01b0 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb166bba740 10 client.0 _ll_register_callbacks cb 0x5592eb868a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbf8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbf8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57866/0 (socket says 172.21.15.7:57866) 2024-04-23T14:53:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 -- 172.21.15.7:0/2982178366 learned_addr learned my addr 172.21.15.7:0/2982178366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161400640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf01b0 0x5592ebbf8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb160a00640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 -- 172.21.15.7:0/2982178366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf01b0 msgr2=0x5592ebbf8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf01b0 0x5592ebbf8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 -- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf0ad0 msgr2=0x5592ebbf8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.897+0000 7fb161e00640 1 -- 172.21.15.7:0/2982178366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ebb20fd0 con 0x5592ebbfb390 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb161e00640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbf8dd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb15402af10 tx=0x7fb1540bd610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72214b18070eba40 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb142a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb142a00640 1 -- 172.21.15.7:0/2982178366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15402c040 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb142a00640 1 -- 172.21.15.7:0/2982178366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fb154004750 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb148004220 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb142a00640 1 -- 172.21.15.7:0/2982178366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb1540db050 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb166bba740 10 client.15795 fetch_fsmap learned FSMap version 30 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5592eb869210 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.898+0000 7fb142a00640 1 -- 172.21.15.7:0/2982178366 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb148004220 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb142a00640 1 -- 172.21.15.7:0/2982178366 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb1540bd9a0 con 0x5592ebbfb390 2024-04-23T14:53:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb166bba740 10 client.15795 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb166bba740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb166bba740 20 client.15795 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb166bba740 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc0b500 0x5592ebc0d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb166bba740 4 client.15795 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592ebb64320 con 0x5592ebc0b500 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.899+0000 7fb161400640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc0b500 0x5592ebc0d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.901+0000 7fb161400640 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc0b500 0x5592ebc0d940 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d007630fec8e2c server_cookie=f79325b15cd689e5 in_seq=0 out_seq=0 2024-04-23T14:53:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.901+0000 7fb142a00640 10 client.15795 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.905+0000 7fb142a00640 1 -- 172.21.15.7:0/2982178366 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5592ebb64320 con 0x5592ebc0b500 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.905+0000 7fb142a00640 10 client.15795 handle_command_reply: tid=0 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.905+0000 7fb166bba740 1 client.15795 shutdown 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.905+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 msgr2=0x5592ebbf8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.905+0000 7fb166bba740 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbf8dd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb15402af10 tx=0x7fb1540bd610 comp rx=0 tx=0).stop 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.905+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 shutdown_connections 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc0b500 0x5592ebc0d940 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbf8dd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 --2- 172.21.15.7:0/2982178366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf01b0 0x5592ebbf8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb142a00640 0 client.15795 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 >> 172.21.15.7:0/2982178366 conn(0x5592ebbec6c0 msgr2=0x5592ebbf23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 shutdown_connections 2024-04-23T14:53:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 1 -- 172.21.15.7:0/2982178366 wait complete. 2024-04-23T14:53:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.906+0000 7fb166bba740 20 client.15795 trim_cache size 0 max 16384 2024-04-23T14:53:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.924+0000 7fb166bba740 1 Processor -- start 2024-04-23T14:53:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.924+0000 7fb166bba740 1 -- start start 2024-04-23T14:53:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.924+0000 7fb166bba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebc06e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.924+0000 7fb166bba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb166bba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb166bba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b5730 con 0x5592ebbfb390 2024-04-23T14:53:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb166bba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b7330 con 0x5592ebbf01b0 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb166bba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b5e00 con 0x5592ebbf0ad0 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57878/0 (socket says 172.21.15.7:57878) 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 -- 172.21.15.7:0/1707787376 learned_addr learned my addr 172.21.15.7:0/1707787376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb160a00640 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 -- 172.21.15.7:0/1707787376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 msgr2=0x5592ebbebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 -- 172.21.15.7:0/1707787376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 msgr2=0x5592ebc06e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebc06e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.925+0000 7fb161e00640 1 -- 172.21.15.7:0/1707787376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592eb935620 con 0x5592ebbfb390 2024-04-23T14:53:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.926+0000 7fb161e00640 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfa290 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb1540bd6d0 tx=0x7fb1540b9320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdb89b644f04b9c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.926+0000 7fb14dc00640 1 -- 172.21.15.7:0/1707787376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15402c040 con 0x5592ebbfb390 2024-04-23T14:53:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.926+0000 7fb14dc00640 1 -- 172.21.15.7:0/1707787376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1540c63b0 con 0x5592ebbfb390 2024-04-23T14:53:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.926+0000 7fb14dc00640 1 -- 172.21.15.7:0/1707787376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540bd9a0 con 0x5592ebbfb390 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 -- 172.21.15.7:0/1707787376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 msgr2=0x5592ebbfa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfa290 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb1540bd6d0 tx=0x7fb1540b9320 comp rx=0 tx=0).stop 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 -- 172.21.15.7:0/1707787376 shutdown_connections 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebbfa290 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 --2- 172.21.15.7:0/1707787376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebc06e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 -- 172.21.15.7:0/1707787376 >> 172.21.15.7:0/1707787376 conn(0x5592ebbec6c0 msgr2=0x5592ebbf9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 -- 172.21.15.7:0/1707787376 shutdown_connections 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 -- 172.21.15.7:0/1707787376 wait complete. 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.927+0000 7fb166bba740 1 -- start start 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 Processor -- start 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebc70ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b6ba0 con 0x5592ebbfb390 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b64d0 con 0x5592ebbf01b0 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b3710 con 0x5592ebbf0ad0 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb166bba740 10 client.0 _ll_register_callbacks cb 0x7fb154005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.928+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebc70ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebc70ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57884/0 (socket says 172.21.15.7:57884) 2024-04-23T14:53:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 -- 172.21.15.7:0/4234579435 learned_addr learned my addr 172.21.15.7:0/4234579435 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161400640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb160a00640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 -- 172.21.15.7:0/4234579435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 msgr2=0x5592ebbf5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 -- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 msgr2=0x5592ebbf56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 -- 172.21.15.7:0/4234579435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ebc71000 con 0x5592ebbfb390 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb161e00640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebc70ac0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb154032000 tx=0x7fb1540095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c4135ec8999fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb142a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb142a00640 1 -- 172.21.15.7:0/4234579435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154087070 con 0x5592ebbfb390 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb142a00640 1 -- 172.21.15.7:0/4234579435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fb15402f8c0 con 0x5592ebbfb390 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.929+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1540c63b0 con 0x5592ebbfb390 2024-04-23T14:53:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb142a00640 1 -- 172.21.15.7:0/4234579435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb1540a4050 con 0x5592ebbfb390 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 10 client.15801 fetch_fsmap learned FSMap version 30 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5592ebc71000 con 0x5592ebbfb390 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb142a00640 1 -- 172.21.15.7:0/4234579435 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1540c63b0 con 0x5592ebbfb390 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb142a00640 1 -- 172.21.15.7:0/4234579435 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb1540b9490 con 0x5592ebbfb390 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 10 client.15801 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 20 client.15801 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc72590 0x5592ebc749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 4 client.15801 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.930+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592ebb5e190 con 0x5592ebc72590 2024-04-23T14:53:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.931+0000 7fb161400640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc72590 0x5592ebc749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.932+0000 7fb161400640 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc72590 0x5592ebc749b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=558a380874a1ea4c server_cookie=409c4d3a28b449a3 in_seq=0 out_seq=0 2024-04-23T14:53:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:22.932+0000 7fb142a00640 10 client.15801 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb142a00640 1 -- 172.21.15.7:0/4234579435 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592ebb5e190 con 0x5592ebc72590 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb142a00640 10 client.15801 handle_command_reply: tid=0 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 client.15801 shutdown 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 msgr2=0x5592ebc70ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebc70ac0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb154032000 tx=0x7fb1540095c0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 shutdown_connections 2024-04-23T14:53:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5592ebc72590 0x5592ebc749b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592ebbfb390 0x5592ebc70ac0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592ebbf0ad0 0x5592ebbf5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 --2- 172.21.15.7:0/4234579435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5592ebbf01b0 0x5592ebbf56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb142a00640 0 client.15801 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.008+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 >> 172.21.15.7:0/4234579435 conn(0x5592ebbec6c0 msgr2=0x5592ebbf8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.009+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 shutdown_connections 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.009+0000 7fb166bba740 1 -- 172.21.15.7:0/4234579435 wait complete. 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.009+0000 7fb166bba740 20 client.15801 trim_cache size 0 max 16384 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:53:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:53:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:53:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1440a3dc0 msgr2=0x7fb1440a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1440a3dc0 0x7fb1440a6280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb150005fd0 tx=0x7fb1500094c0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 msgr2=0x7fb15c19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c19eb10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb154004af0 tx=0x7fb154003c10 comp rx=0 tx=0).stop 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 shutdown_connections 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1440a3dc0 0x7fb1440a6280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb15c1130c0 0x7fb15c19eb10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15c074c20 0x7fb15c1a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 --2- 172.21.15.7:0/1714538915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb15c074300 0x7fb15c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 >> 172.21.15.7:0/1714538915 conn(0x7fb15c079490 msgr2=0x7fb15c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 shutdown_connections 2024-04-23T14:53:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:23.010+0000 7fb163e00640 1 -- 172.21.15.7:0/1714538915 wait complete. 2024-04-23T14:53:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:23 smithi186 ceph-mon[31814]: pgmap v64: 129 pgs: 129 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 351 KiB/s wr, 153 op/s 2024-04-23T14:53:23.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:23 smithi137 ceph-mon[31694]: pgmap v64: 129 pgs: 129 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 351 KiB/s wr, 153 op/s 2024-04-23T14:53:23.824 INFO:tasks.workunit.client.0.smithi007.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-04-23T14:53:23.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:23 smithi007 ceph-mon[27906]: pgmap v64: 129 pgs: 129 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 351 KiB/s wr, 153 op/s 2024-04-23T14:53:24.518 INFO:tasks.workunit.client.0.smithi007.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-04-23T14:53:24.518 INFO:tasks.workunit.client.0.smithi007.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-04-23T14:53:24.518 INFO:tasks.workunit.client.0.smithi007.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-04-23T14:53:24.518 INFO:tasks.workunit.client.0.smithi007.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-04-23T14:53:24.895 INFO:tasks.workunit.client.0.smithi007.stdout:/bin/sh ./config.status --recheck 2024-04-23T14:53:25.170 INFO:tasks.workunit.client.0.smithi007.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-04-23T14:53:25.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:25 smithi186 ceph-mon[31814]: pgmap v65: 129 pgs: 129 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 242 KiB/s wr, 62 op/s 2024-04-23T14:53:25.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:25 smithi137 ceph-mon[31694]: pgmap v65: 129 pgs: 129 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 242 KiB/s wr, 62 op/s 2024-04-23T14:53:25.773 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-23T14:53:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:25 smithi007 ceph-mon[27906]: pgmap v65: 129 pgs: 129 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 242 KiB/s wr, 62 op/s 2024-04-23T14:53:26.810 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether build environment is sane... yes 2024-04-23T14:53:26.844 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-23T14:53:26.847 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gawk... gawk 2024-04-23T14:53:26.926 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether make sets $(MAKE)... yes 2024-04-23T14:53:27.089 INFO:tasks.workunit.client.0.smithi007.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-23T14:53:27.090 INFO:tasks.workunit.client.0.smithi007.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-23T14:53:27.152 INFO:tasks.workunit.client.0.smithi007.stdout:checking for style of include used by make... GNU 2024-04-23T14:53:27.175 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... gcc 2024-04-23T14:53:27.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:27 smithi186 ceph-mon[31814]: pgmap v66: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 350 KiB/s wr, 98 op/s 2024-04-23T14:53:27.641 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether the C compiler works... yes 2024-04-23T14:53:27.643 INFO:tasks.workunit.client.0.smithi007.stdout:checking for C compiler default output file name... a.out 2024-04-23T14:53:27.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:27 smithi137 ceph-mon[31694]: pgmap v66: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 350 KiB/s wr, 98 op/s 2024-04-23T14:53:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:27 smithi007 ceph-mon[27906]: pgmap v66: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 350 KiB/s wr, 98 op/s 2024-04-23T14:53:27.858 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of executables... 2024-04-23T14:53:28.063 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are cross compiling... no 2024-04-23T14:53:28.242 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of object files... o 2024-04-23T14:53:28.362 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... yes 2024-04-23T14:53:28.488 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... yes 2024-04-23T14:53:28.632 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-23T14:53:29.508 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... gcc3 2024-04-23T14:53:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:29 smithi186 ceph-mon[31814]: pgmap v67: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 221 KiB/s wr, 69 op/s 2024-04-23T14:53:29.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:29 smithi137 ceph-mon[31694]: pgmap v67: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 221 KiB/s wr, 69 op/s 2024-04-23T14:53:29.779 INFO:tasks.workunit.client.0.smithi007.stdout:checking how to run the C preprocessor... gcc -E 2024-04-23T14:53:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:29 smithi007 ceph-mon[27906]: pgmap v67: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 221 KiB/s wr, 69 op/s 2024-04-23T14:53:30.033 INFO:tasks.workunit.client.0.smithi007.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-23T14:53:30.040 INFO:tasks.workunit.client.0.smithi007.stdout:checking for egrep... /usr/bin/grep -E 2024-04-23T14:53:30.637 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ANSI C header files... yes 2024-04-23T14:53:30.807 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/types.h... yes 2024-04-23T14:53:30.994 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/stat.h... yes 2024-04-23T14:53:31.192 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdlib.h... yes 2024-04-23T14:53:31.388 INFO:tasks.workunit.client.0.smithi007.stdout:checking for string.h... yes 2024-04-23T14:53:31.592 INFO:tasks.workunit.client.0.smithi007.stdout:checking for memory.h... yes 2024-04-23T14:53:31.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:31 smithi137 ceph-mon[31694]: pgmap v68: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 221 KiB/s wr, 69 op/s 2024-04-23T14:53:31.805 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strings.h... yes 2024-04-23T14:53:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:31 smithi007 ceph-mon[27906]: pgmap v68: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 221 KiB/s wr, 69 op/s 2024-04-23T14:53:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:31 smithi186 ceph-mon[31814]: pgmap v68: 129 pgs: 129 active+clean; 4.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 221 KiB/s wr, 69 op/s 2024-04-23T14:53:31.997 INFO:tasks.workunit.client.0.smithi007.stdout:checking for inttypes.h... yes 2024-04-23T14:53:32.180 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... yes 2024-04-23T14:53:32.315 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... yes 2024-04-23T14:53:32.460 INFO:tasks.workunit.client.0.smithi007.stdout:checking minix/config.h usability... no 2024-04-23T14:53:32.603 INFO:tasks.workunit.client.0.smithi007.stdout:checking minix/config.h presence... no 2024-04-23T14:53:32.605 INFO:tasks.workunit.client.0.smithi007.stdout:checking for minix/config.h... no 2024-04-23T14:53:32.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:32 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:32.740 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-04-23T14:53:32.758 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... (cached) gcc 2024-04-23T14:53:32.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:32 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:32.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:32 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:32.898 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-23T14:53:32.898 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-23T14:53:32.899 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-23T14:53:32.900 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-23T14:53:33.068 INFO:tasks.workunit.client.0.smithi007.stdout:checking for main in -lm... yes 2024-04-23T14:53:33.279 INFO:tasks.workunit.client.0.smithi007.stdout:checking for main in -lpthread... yes 2024-04-23T14:53:33.294 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ANSI C header files... (cached) yes 2024-04-23T14:53:33.423 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-23T14:53:33.584 INFO:tasks.workunit.client.0.smithi007.stdout:checking pthread.h usability... yes 2024-04-23T14:53:33.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:33 smithi137 ceph-mon[31694]: pgmap v69: 129 pgs: 129 active+clean; 4.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 315 KiB/s wr, 94 op/s 2024-04-23T14:53:33.671 INFO:tasks.workunit.client.0.smithi007.stdout:checking pthread.h presence... yes 2024-04-23T14:53:33.672 INFO:tasks.workunit.client.0.smithi007.stdout:checking for pthread.h... yes 2024-04-23T14:53:33.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:33 smithi007 ceph-mon[27906]: pgmap v69: 129 pgs: 129 active+clean; 4.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 315 KiB/s wr, 94 op/s 2024-04-23T14:53:33.856 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h usability... yes 2024-04-23T14:53:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:33 smithi186 ceph-mon[31814]: pgmap v69: 129 pgs: 129 active+clean; 4.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 315 KiB/s wr, 94 op/s 2024-04-23T14:53:33.935 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h presence... yes 2024-04-23T14:53:33.937 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fcntl.h... yes 2024-04-23T14:53:34.201 INFO:tasks.workunit.client.0.smithi007.stdout:checking limits.h usability... yes 2024-04-23T14:53:34.298 INFO:tasks.workunit.client.0.smithi007.stdout:checking limits.h presence... yes 2024-04-23T14:53:34.300 INFO:tasks.workunit.client.0.smithi007.stdout:checking for limits.h... yes 2024-04-23T14:53:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... (cached) yes 2024-04-23T14:53:34.590 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h usability... yes 2024-04-23T14:53:34.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:34 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:34.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:34 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:53:34.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:34 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:53:34.688 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h presence... yes 2024-04-23T14:53:34.690 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/time.h... yes 2024-04-23T14:53:34.793 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... (cached) yes 2024-04-23T14:53:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:34 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:34 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:53:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:34 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:53:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:34 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:34 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:53:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:34 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:53:34.947 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/vfs.h usability... yes 2024-04-23T14:53:35.033 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/vfs.h presence... yes 2024-04-23T14:53:35.035 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/vfs.h... yes 2024-04-23T14:53:35.300 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/limits.h usability... no 2024-04-23T14:53:35.465 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/limits.h presence... no 2024-04-23T14:53:35.467 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/limits.h... no 2024-04-23T14:53:35.595 INFO:tasks.workunit.client.0.smithi007.stdout:checking for an ANSI C-conforming const... yes 2024-04-23T14:53:35.738 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-23T14:53:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:35 smithi007 ceph-mon[27906]: pgmap v70: 129 pgs: 129 active+clean; 4.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 201 KiB/s wr, 61 op/s 2024-04-23T14:53:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:35 smithi186 ceph-mon[31814]: pgmap v70: 129 pgs: 129 active+clean; 4.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 201 KiB/s wr, 61 op/s 2024-04-23T14:53:35.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:35 smithi137 ceph-mon[31694]: pgmap v70: 129 pgs: 129 active+clean; 4.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 201 KiB/s wr, 61 op/s 2024-04-23T14:53:36.052 INFO:tasks.workunit.client.0.smithi007.stdout:checking for system... yes 2024-04-23T14:53:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 -- 172.21.15.7:0/520219616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 msgr2=0x7fe2dc104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 --2- 172.21.15.7:0/520219616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc104680 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009900 tx=0x7fe2d002a3f0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 -- 172.21.15.7:0/520219616 shutdown_connections 2024-04-23T14:53:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 --2- 172.21.15.7:0/520219616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc109370 0x7fe2dc110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 --2- 172.21.15.7:0/520219616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2dc104c50 0x7fe2dc108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 --2- 172.21.15.7:0/520219616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc104680 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 -- 172.21.15.7:0/520219616 >> 172.21.15.7:0/520219616 conn(0x7fe2dc0ffae0 msgr2=0x7fe2dc101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.162+0000 7fe2e3200640 1 -- 172.21.15.7:0/520219616 shutdown_connections 2024-04-23T14:53:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.163+0000 7fe2e3200640 1 -- 172.21.15.7:0/520219616 wait complete. 2024-04-23T14:53:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.163+0000 7fe2e3200640 1 Processor -- start 2024-04-23T14:53:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 -- start start 2024-04-23T14:53:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2dc109370 0x7fe2dc19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc19eff0 0x7fe2dc19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc114300 con 0x7fe2dc1042a0 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc114180 con 0x7fe2dc19eff0 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc114480 con 0x7fe2dc109370 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc19a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42600/0 (socket says 172.21.15.7:42600) 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.164+0000 7fe2e1e00640 1 -- 172.21.15.7:0/2680484628 learned_addr learned my addr 172.21.15.7:0/2680484628 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1400640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2dc109370 0x7fe2dc19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e2800640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc19eff0 0x7fe2dc19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1e00640 1 -- 172.21.15.7:0/2680484628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2dc109370 msgr2=0x7fe2dc19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2dc109370 0x7fe2dc19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1e00640 1 -- 172.21.15.7:0/2680484628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc19eff0 msgr2=0x7fe2dc19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc19eff0 0x7fe2dc19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1e00640 1 -- 172.21.15.7:0/2680484628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc19fae0 con 0x7fe2dc1042a0 2024-04-23T14:53:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e2800640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc19eff0 0x7fe2dc19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:53:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc19a780 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0005ab0 tx=0x7fe2d0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2d6a00640 1 -- 172.21.15.7:0/2680484628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d003f070 con 0x7fe2dc1042a0 2024-04-23T14:53:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2dc19fd70 con 0x7fe2dc1042a0 2024-04-23T14:53:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.165+0000 7fe2d6a00640 1 -- 172.21.15.7:0/2680484628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2d0031d60 con 0x7fe2dc1042a0 2024-04-23T14:53:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.166+0000 7fe2d6a00640 1 -- 172.21.15.7:0/2680484628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0035030 con 0x7fe2dc1042a0 2024-04-23T14:53:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.166+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2dc1a7590 con 0x7fe2dc1042a0 2024-04-23T14:53:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.169+0000 7fe2d6a00640 1 -- 172.21.15.7:0/2680484628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe2d0042070 con 0x7fe2dc1042a0 2024-04-23T14:53:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.169+0000 7fe2e75ae740 1 Processor -- start 2024-04-23T14:53:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 -- start start 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed818157a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed81820060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 0x55ed81822990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ed8177b900 con 0x55ed818205a0 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed81721f20 con 0x55ed81815ce0 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.170+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ed817778c0 con 0x55ed818153c0 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 0x55ed81822990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 0x55ed81822990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42614/0 (socket says 172.21.15.7:42614) 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 -- 172.21.15.7:0/120593312 learned_addr learned my addr 172.21.15.7:0/120593312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed81820060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e2800640 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed818157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 -- 172.21.15.7:0/120593312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 msgr2=0x55ed818157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2d6a00640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe2c40a3d90 0x7fe2c40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed818157a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 -- 172.21.15.7:0/120593312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 msgr2=0x55ed81820060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed81820060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e1400640 1 -- 172.21.15.7:0/120593312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed81746e10 con 0x55ed818205a0 2024-04-23T14:53:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2d6a00640 1 -- 172.21.15.7:0/2680484628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fe2d00f1620 con 0x7fe2dc1042a0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.171+0000 7fe2e2800640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe2c40a3d90 0x7fe2c40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.172+0000 7fe2e1400640 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 0x55ed81822990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00cc00 tx=0x7fe2cc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8efce180bcb9c02 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.172+0000 7fe2cb000640 1 -- 172.21.15.7:0/120593312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc005220 con 0x55ed818205a0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.172+0000 7fe2cb000640 1 -- 172.21.15.7:0/120593312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2cc004c50 con 0x55ed818205a0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.172+0000 7fe2cb000640 1 -- 172.21.15.7:0/120593312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc010790 con 0x55ed818205a0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 -- 172.21.15.7:0/120593312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 msgr2=0x55ed81822990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e2800640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe2c40a3d90 0x7fe2c40a6250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8005cc0 tx=0x7fe2d8004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 0x55ed81822990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00cc00 tx=0x7fe2cc00e720 comp rx=0 tx=0).stop 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 -- 172.21.15.7:0/120593312 shutdown_connections 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed81820060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818205a0 0x55ed81822990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/120593312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed818157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 -- 172.21.15.7:0/120593312 >> 172.21.15.7:0/120593312 conn(0x55ed818118d0 msgr2=0x55ed81811cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 -- 172.21.15.7:0/120593312 shutdown_connections 2024-04-23T14:53:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.173+0000 7fe2e75ae740 1 -- 172.21.15.7:0/120593312 wait complete. 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 -- start start 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 Processor -- start 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed8181d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed8181dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818205a0 0x55ed8181e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ed818230e0 con 0x55ed818153c0 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed817352c0 con 0x55ed81815ce0 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ed81823260 con 0x55ed818205a0 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.174+0000 7fe2e75ae740 10 client.0 _ll_register_callbacks cb 0x55ed8148da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed8181d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed8181d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42624/0 (socket says 172.21.15.7:42624) 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 -- 172.21.15.7:0/1629187859 learned_addr learned my addr 172.21.15.7:0/1629187859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e2800640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818205a0 0x55ed8181e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1400640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed8181dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 -- 172.21.15.7:0/1629187859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818205a0 msgr2=0x55ed8181e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818205a0 0x55ed8181e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 -- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 msgr2=0x55ed8181dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed8181dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.175+0000 7fe2e1e00640 1 -- 172.21.15.7:0/1629187859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed81745fd0 con 0x55ed818153c0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed8181d580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00bcf00 tx=0x7fe2d00bcfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fd7adab923f09e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2bf400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2bf400640 1 -- 172.21.15.7:0/1629187859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0049070 con 0x55ed818153c0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2bf400640 1 -- 172.21.15.7:0/1629187859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fe2d00eec30 con 0x55ed818153c0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2cc004c50 con 0x55ed818153c0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2bf400640 1 -- 172.21.15.7:0/1629187859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe2d00eee30 con 0x55ed818153c0 2024-04-23T14:53:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2e75ae740 10 client.15813 fetch_fsmap learned FSMap version 30 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.176+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ed8148e210 con 0x55ed818153c0 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2bf400640 1 -- 172.21.15.7:0/1629187859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2cc004c50 con 0x55ed818153c0 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2bf400640 1 -- 172.21.15.7:0/1629187859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fe2d00f1200 con 0x55ed818153c0 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2e75ae740 10 client.15813 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2e75ae740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2e75ae740 20 client.15813 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818306b0 0x55ed81832b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2e75ae740 4 client.15813 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.177+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed81789320 con 0x55ed818306b0 2024-04-23T14:53:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.178+0000 7fe2e1400640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818306b0 0x55ed81832b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.179+0000 7fe2e1400640 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818306b0 0x55ed81832b70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8da24f96ffd1703 server_cookie=6f17b87c4044820a in_seq=0 out_seq=0 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.179+0000 7fe2bf400640 10 client.15813 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2bf400640 1 -- 172.21.15.7:0/1629187859 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ed81789320 con 0x55ed818306b0 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2bf400640 10 client.15813 handle_command_reply: tid=0 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 client.15813 shutdown 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 msgr2=0x55ed8181d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed8181d580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00bcf00 tx=0x7fe2d00bcfd0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 shutdown_connections 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818306b0 0x55ed81832b70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed81815ce0 0x55ed8181dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818205a0 0x55ed8181e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2bf400640 0 client.15813 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/1629187859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed8181d580 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 >> 172.21.15.7:0/1629187859 conn(0x55ed818118d0 msgr2=0x55ed81817600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 shutdown_connections 2024-04-23T14:53:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 1 -- 172.21.15.7:0/1629187859 wait complete. 2024-04-23T14:53:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.181+0000 7fe2e75ae740 20 client.15813 trim_cache size 0 max 16384 2024-04-23T14:53:36.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 Processor -- start 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 -- start start 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed8182c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 0x55ed81838480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b1270 con 0x55ed81815ce0 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b2e70 con 0x55ed818205a0 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b1940 con 0x55ed818153c0 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.199+0000 7fe2e1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 0x55ed81838480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 0x55ed81838480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42634/0 (socket says 172.21.15.7:42634) 2024-04-23T14:53:36.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 -- 172.21.15.7:0/3826497030 learned_addr learned my addr 172.21.15.7:0/3826497030 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e2800640 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 -- 172.21.15.7:0/3826497030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 msgr2=0x55ed8182c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed8182c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 -- 172.21.15.7:0/3826497030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 msgr2=0x55ed818389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 -- 172.21.15.7:0/3826497030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed8155a620 con 0x55ed81815ce0 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e2800640 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.200+0000 7fe2e1400640 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 0x55ed81838480 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00ec20 tx=0x7fe2cc00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e621d14dd3e4e718 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.201+0000 7fe2ca600640 1 -- 172.21.15.7:0/3826497030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02a320 con 0x55ed81815ce0 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.201+0000 7fe2ca600640 1 -- 172.21.15.7:0/3826497030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2cc027470 con 0x55ed81815ce0 2024-04-23T14:53:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.201+0000 7fe2ca600640 1 -- 172.21.15.7:0/3826497030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc01a6c0 con 0x55ed81815ce0 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3826497030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 msgr2=0x55ed81838480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 0x55ed81838480 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00ec20 tx=0x7fe2cc00cf00 comp rx=0 tx=0).stop 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3826497030 shutdown_connections 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed81815ce0 0x55ed81838480 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3826497030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed818153c0 0x55ed8182c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3826497030 >> 172.21.15.7:0/3826497030 conn(0x55ed818118d0 msgr2=0x55ed8181f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3826497030 shutdown_connections 2024-04-23T14:53:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3826497030 wait complete. 2024-04-23T14:53:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.202+0000 7fe2e75ae740 1 -- start start 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 Processor -- start 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed818285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed81815ce0 0x55ed81828ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818255d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b26e0 con 0x55ed818153c0 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b2010 con 0x55ed818205a0 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1af250 con 0x55ed81815ce0 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.203+0000 7fe2e75ae740 10 client.0 _ll_register_callbacks cb 0x7fe2d0009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed818285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed818285a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42642/0 (socket says 172.21.15.7:42642) 2024-04-23T14:53:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 -- 172.21.15.7:0/3646117554 learned_addr learned my addr 172.21.15.7:0/3646117554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1400640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed81815ce0 0x55ed81828ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e2800640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818255d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 -- 172.21.15.7:0/3646117554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed81815ce0 msgr2=0x55ed81828ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed81815ce0 0x55ed81828ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 -- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 msgr2=0x55ed818255d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818255d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.204+0000 7fe2e1e00640 1 -- 172.21.15.7:0/3646117554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed81825e00 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.205+0000 7fe2e1e00640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed818285a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00c5ec0 tx=0x7fe2d00c5da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117cbda9631ce316 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.205+0000 7fe2bf400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.205+0000 7fe2bf400640 1 -- 172.21.15.7:0/3646117554 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00bcd40 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.205+0000 7fe2bf400640 1 -- 172.21.15.7:0/3646117554 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fe2d00c5ae0 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.205+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2cc027470 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2bf400640 1 -- 172.21.15.7:0/3646117554 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe2d00d8080 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 10 client.15819 fetch_fsmap learned FSMap version 30 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ed81825e00 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2bf400640 1 -- 172.21.15.7:0/3646117554 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2cc027470 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2bf400640 1 -- 172.21.15.7:0/3646117554 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fe2d00c1110 con 0x55ed818153c0 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 10 client.15819 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:53:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 20 client.15819 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818a0430 0x55ed818a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 4 client.15819 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.206+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ed81783190 con 0x55ed818a0430 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.207+0000 7fe2e1400640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818a0430 0x55ed818a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.209+0000 7fe2e1400640 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818a0430 0x55ed818a2850 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8501ef8cf026b9bc server_cookie=816f1583c220d2d2 in_seq=0 out_seq=0 2024-04-23T14:53:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.209+0000 7fe2bf400640 10 client.15819 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.280+0000 7fe2bf400640 1 -- 172.21.15.7:0/3646117554 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ed81783190 con 0x55ed818a0430 2024-04-23T14:53:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.280+0000 7fe2bf400640 10 client.15819 handle_command_reply: tid=0 2024-04-23T14:53:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.280+0000 7fe2e75ae740 1 client.15819 shutdown 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 msgr2=0x55ed818285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed818285a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00c5ec0 tx=0x7fe2d00c5da0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 shutdown_connections 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed818a0430 0x55ed818a2850 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed818205a0 0x55ed818255d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed81815ce0 0x55ed81828ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2bf400640 0 client.15819 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 --2- 172.21.15.7:0/3646117554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed818153c0 0x55ed818285a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 >> 172.21.15.7:0/3646117554 conn(0x55ed818118d0 msgr2=0x55ed8181d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 shutdown_connections 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 1 -- 172.21.15.7:0/3646117554 wait complete. 2024-04-23T14:53:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.281+0000 7fe2e75ae740 20 client.15819 trim_cache size 0 max 16384 2024-04-23T14:53:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:53:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:53:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:53:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe2c40a3d90 msgr2=0x7fe2c40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe2c40a3d90 0x7fe2c40a6250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8005cc0 tx=0x7fe2d8004a40 comp rx=0 tx=0).stop 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 msgr2=0x7fe2dc19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc19a780 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0005ab0 tx=0x7fe2d0003d50 comp rx=0 tx=0).stop 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 shutdown_connections 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe2c40a3d90 0x7fe2c40a6250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2dc19eff0 0x7fe2dc19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2dc109370 0x7fe2dc19acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 --2- 172.21.15.7:0/2680484628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2dc1042a0 0x7fe2dc19a780 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 >> 172.21.15.7:0/2680484628 conn(0x7fe2dc0ffae0 msgr2=0x7fe2dc101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 shutdown_connections 2024-04-23T14:53:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:36.282+0000 7fe2e3200640 1 -- 172.21.15.7:0/2680484628 wait complete. 2024-04-23T14:53:36.292 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gettimeofday... yes 2024-04-23T14:53:36.536 INFO:tasks.workunit.client.0.smithi007.stdout:checking for mkdir... yes 2024-04-23T14:53:36.823 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strerror... yes 2024-04-23T14:53:37.105 INFO:tasks.workunit.client.0.smithi007.stdout:checking for open64... yes 2024-04-23T14:53:37.384 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stat64... yes 2024-04-23T14:53:37.673 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fseeko64... yes 2024-04-23T14:53:37.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:37 smithi007 ceph-mon[27906]: pgmap v71: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 334 KiB/s wr, 99 op/s 2024-04-23T14:53:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:37 smithi186 ceph-mon[31814]: pgmap v71: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 334 KiB/s wr, 99 op/s 2024-04-23T14:53:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:37 smithi137 ceph-mon[31694]: pgmap v71: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 334 KiB/s wr, 99 op/s 2024-04-23T14:53:37.979 INFO:tasks.workunit.client.0.smithi007.stdout:checking for lrand48_r... yes 2024-04-23T14:53:38.298 INFO:tasks.workunit.client.0.smithi007.stdout:checking for srand48_r... yes 2024-04-23T14:53:38.391 INFO:tasks.workunit.client.0.smithi007.stdout:configure: creating ./config.status 2024-04-23T14:53:38.800 INFO:tasks.workunit.client.0.smithi007.stdout: /bin/sh ./config.status 2024-04-23T14:53:39.070 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating Makefile 2024-04-23T14:53:39.136 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating config.h 2024-04-23T14:53:39.230 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing depfiles commands 2024-04-23T14:53:39.385 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing default commands 2024-04-23T14:53:39.636 INFO:tasks.workunit.client.0.smithi007.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-04-23T14:53:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:39 smithi007 ceph-mon[27906]: pgmap v72: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 226 KiB/s wr, 63 op/s 2024-04-23T14:53:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:39 smithi186 ceph-mon[31814]: pgmap v72: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 226 KiB/s wr, 63 op/s 2024-04-23T14:53:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:39 smithi137 ceph-mon[31694]: pgmap v72: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 226 KiB/s wr, 63 op/s 2024-04-23T14:53:40.095 INFO:tasks.workunit.client.0.smithi007.stdout:rm -f stamp-h1 2024-04-23T14:53:40.109 INFO:tasks.workunit.client.0.smithi007.stdout:touch config.h.in 2024-04-23T14:53:40.118 INFO:tasks.workunit.client.0.smithi007.stdout:cd . && /bin/sh ./config.status config.h 2024-04-23T14:53:40.344 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating config.h 2024-04-23T14:53:40.511 INFO:tasks.workunit.client.0.smithi007.stdout:make all-am 2024-04-23T14:53:40.661 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-23T14:53:40.662 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-04-23T14:53:41.138 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-04-23T14:53:41.189 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-04-23T14:53:41.499 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-04-23T14:53:41.548 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-04-23T14:53:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:41 smithi007 ceph-mon[27906]: pgmap v73: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 226 KiB/s wr, 63 op/s 2024-04-23T14:53:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:41 smithi186 ceph-mon[31814]: pgmap v73: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 226 KiB/s wr, 63 op/s 2024-04-23T14:53:41.896 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-04-23T14:53:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:41 smithi137 ceph-mon[31694]: pgmap v73: 129 pgs: 129 active+clean; 6.1 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 226 KiB/s wr, 63 op/s 2024-04-23T14:53:41.945 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-04-23T14:53:42.311 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-04-23T14:53:42.360 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-04-23T14:53:42.805 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-04-23T14:53:42.854 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-04-23T14:53:43.162 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-04-23T14:53:43.213 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-04-23T14:53:43.410 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-04-23T14:53:43.459 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-04-23T14:53:43.740 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-04-23T14:53:43.785 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-04-23T14:53:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:43 smithi007 ceph-mon[27906]: pgmap v74: 129 pgs: 129 active+clean; 6.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 326 KiB/s wr, 106 op/s 2024-04-23T14:53:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:43 smithi186 ceph-mon[31814]: pgmap v74: 129 pgs: 129 active+clean; 6.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 326 KiB/s wr, 106 op/s 2024-04-23T14:53:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:43 smithi137 ceph-mon[31694]: pgmap v74: 129 pgs: 129 active+clean; 6.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 326 KiB/s wr, 106 op/s 2024-04-23T14:53:44.224 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-04-23T14:53:44.277 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-04-23T14:53:44.695 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-04-23T14:53:44.743 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-04-23T14:53:45.230 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-04-23T14:53:45.283 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-04-23T14:53:45.593 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-04-23T14:53:45.649 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-04-23T14:53:45.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:45 smithi007 ceph-mon[27906]: pgmap v75: 129 pgs: 129 active+clean; 6.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 232 KiB/s wr, 81 op/s 2024-04-23T14:53:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:45 smithi186 ceph-mon[31814]: pgmap v75: 129 pgs: 129 active+clean; 6.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 232 KiB/s wr, 81 op/s 2024-04-23T14:53:45.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:45 smithi137 ceph-mon[31694]: pgmap v75: 129 pgs: 129 active+clean; 6.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 232 KiB/s wr, 81 op/s 2024-04-23T14:53:46.004 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-04-23T14:53:46.060 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-04-23T14:53:46.499 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-04-23T14:53:46.556 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-04-23T14:53:46.752 INFO:tasks.workunit.client.0.smithi007.stderr:In file included from parser.h:22, 2024-04-23T14:53:46.752 INFO:tasks.workunit.client.0.smithi007.stderr: from parser.c:25: 2024-04-23T14:53:46.752 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function ‘init_filesys’: 2024-04-23T14:53:46.758 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.759 INFO:tasks.workunit.client.0.smithi007.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-23T14:53:46.760 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.760 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.760 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.760 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.760 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.760 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.761 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.762 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-23T14:53:46.763 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.764 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function ‘init_tg_stats’: 2024-04-23T14:53:46.764 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.764 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.764 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.764 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.765 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-23T14:53:46.766 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.767 INFO:tasks.workunit.client.0.smithi007.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-23T14:53:46.768 INFO:tasks.workunit.client.0.smithi007.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-23T14:53:46.769 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function ‘get_optstr’: 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:200:14: note: source object declared here 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr: 200 | char temp[BUFSIZE]; 2024-04-23T14:53:46.853 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~ 2024-04-23T14:53:46.861 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function ‘size64_convert’: 2024-04-23T14:53:46.862 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-04-23T14:53:46.862 INFO:tasks.workunit.client.0.smithi007.stderr: 119 | memcpy(unit, "\0", 3); 2024-04-23T14:53:46.862 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-23T14:53:47.314 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-04-23T14:53:47.362 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-04-23T14:53:47.696 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-04-23T14:53:47.746 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-04-23T14:53:47.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:47 smithi007 ceph-mon[27906]: pgmap v76: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 303 KiB/s wr, 101 op/s 2024-04-23T14:53:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:47 smithi186 ceph-mon[31814]: pgmap v76: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 303 KiB/s wr, 101 op/s 2024-04-23T14:53:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:47 smithi137 ceph-mon[31694]: pgmap v76: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 303 KiB/s wr, 101 op/s 2024-04-23T14:53:48.058 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-04-23T14:53:48.107 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-04-23T14:53:48.268 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-04-23T14:53:48.329 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-04-23T14:53:48.980 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-23T14:53:48.984 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd .. 2024-04-23T14:53:48.992 INFO:tasks.workunit.client.0.smithi007.stderr:+ mkdir tmp 2024-04-23T14:53:49.002 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd tmp 2024-04-23T14:53:49.009 INFO:tasks.workunit.client.0.smithi007.stderr:+ for f in $mydir/*.ffsb 2024-04-23T14:53:49.009 INFO:tasks.workunit.client.0.smithi007.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-04-23T14:53:49.014 INFO:tasks.workunit.client.0.smithi007.stdout:FFSB version 6.0-RC2 started 2024-04-23T14:53:49.014 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.023 INFO:tasks.workunit.client.0.smithi007.stdout:benchmark time = 300 2024-04-23T14:53:49.023 INFO:tasks.workunit.client.0.smithi007.stdout:ThreadGroup 0 2024-04-23T14:53:49.023 INFO:tasks.workunit.client.0.smithi007.stdout:================ 2024-04-23T14:53:49.024 INFO:tasks.workunit.client.0.smithi007.stdout: num_threads = 32 2024-04-23T14:53:49.024 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.024 INFO:tasks.workunit.client.0.smithi007.stdout: read_random = off 2024-04-23T14:53:49.024 INFO:tasks.workunit.client.0.smithi007.stdout: read_size = 0 (0B) 2024-04-23T14:53:49.024 INFO:tasks.workunit.client.0.smithi007.stdout: read_blocksize = 0 (0B) 2024-04-23T14:53:49.024 INFO:tasks.workunit.client.0.smithi007.stdout: read_skip = off 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: read_skipsize = 0 (0B) 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: write_random = on 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: write_size = 5242880 (5MB) 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: fsync_file = 0 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: write_blocksize = 4096 (4KB) 2024-04-23T14:53:49.025 INFO:tasks.workunit.client.0.smithi007.stdout: wait time = 0 2024-04-23T14:53:49.026 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.026 INFO:tasks.workunit.client.0.smithi007.stdout: op weights 2024-04-23T14:53:49.026 INFO:tasks.workunit.client.0.smithi007.stdout: read = 0 (0.00%) 2024-04-23T14:53:49.026 INFO:tasks.workunit.client.0.smithi007.stdout: readall = 0 (0.00%) 2024-04-23T14:53:49.026 INFO:tasks.workunit.client.0.smithi007.stdout: write = 1 (100.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: create = 0 (0.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: append = 0 (0.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: delete = 0 (0.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: metaop = 0 (0.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: createdir = 0 (0.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: stat = 0 (0.00%) 2024-04-23T14:53:49.027 INFO:tasks.workunit.client.0.smithi007.stdout: writeall = 0 (0.00%) 2024-04-23T14:53:49.028 INFO:tasks.workunit.client.0.smithi007.stdout: writeall_fsync = 0 (0.00%) 2024-04-23T14:53:49.028 INFO:tasks.workunit.client.0.smithi007.stdout: open_close = 0 (0.00%) 2024-04-23T14:53:49.028 INFO:tasks.workunit.client.0.smithi007.stdout: write_fsync = 0 (0.00%) 2024-04-23T14:53:49.028 INFO:tasks.workunit.client.0.smithi007.stdout: create_fsync = 0 (0.00%) 2024-04-23T14:53:49.028 INFO:tasks.workunit.client.0.smithi007.stdout: append_fsync = 0 (0.00%) 2024-04-23T14:53:49.028 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.029 INFO:tasks.workunit.client.0.smithi007.stdout:FileSystem . 2024-04-23T14:53:49.029 INFO:tasks.workunit.client.0.smithi007.stdout:========== 2024-04-23T14:53:49.029 INFO:tasks.workunit.client.0.smithi007.stdout: num_dirs = 0 2024-04-23T14:53:49.029 INFO:tasks.workunit.client.0.smithi007.stdout: starting files = 128 2024-04-23T14:53:49.030 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.030 INFO:tasks.workunit.client.0.smithi007.stdout: min file size = 104857600 (100MB) 2024-04-23T14:53:49.030 INFO:tasks.workunit.client.0.smithi007.stdout: max file size = 104857600 (100MB) 2024-04-23T14:53:49.030 INFO:tasks.workunit.client.0.smithi007.stdout: directio = off 2024-04-23T14:53:49.030 INFO:tasks.workunit.client.0.smithi007.stdout: alignedio = on 2024-04-23T14:53:49.030 INFO:tasks.workunit.client.0.smithi007.stdout: bufferedio = off 2024-04-23T14:53:49.031 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.031 INFO:tasks.workunit.client.0.smithi007.stdout: aging is off 2024-04-23T14:53:49.032 INFO:tasks.workunit.client.0.smithi007.stdout: current utilization = 0.04% 2024-04-23T14:53:49.032 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T14:53:49.032 INFO:tasks.workunit.client.0.smithi007.stdout:checking existing fs: . 2024-04-23T14:53:49.032 INFO:tasks.workunit.client.0.smithi007.stdout:recreating new fileset 2024-04-23T14:53:49.033 INFO:tasks.workunit.client.0.smithi007.stderr:opendir: No such file or directory 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 -- 172.21.15.7:0/283947908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e74104c50 msgr2=0x7f1e74108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 --2- 172.21.15.7:0/283947908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e74104c50 0x7f1e74108c90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009900 tx=0x7f1e5c02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 -- 172.21.15.7:0/283947908 shutdown_connections 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 --2- 172.21.15.7:0/283947908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 0x7f1e74110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 --2- 172.21.15.7:0/283947908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e74104c50 0x7f1e74108c90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 --2- 172.21.15.7:0/283947908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e741042a0 0x7f1e74104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 -- 172.21.15.7:0/283947908 >> 172.21.15.7:0/283947908 conn(0x7f1e740ffae0 msgr2=0x7f1e74101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 -- 172.21.15.7:0/283947908 shutdown_connections 2024-04-23T14:53:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.438+0000 7f1e73200640 1 -- 172.21.15.7:0/283947908 wait complete. 2024-04-23T14:53:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.439+0000 7f1e73200640 1 Processor -- start 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.439+0000 7f1e73200640 1 -- start start 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e73200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 0x7f1e741a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e73200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 0x7f1e741a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e73200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e7419a6c0 0x7f1e7419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e73200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74114300 con 0x7f1e741042a0 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e73200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74114180 con 0x7f1e7419a6c0 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e73200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74114480 con 0x7f1e74109370 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 0x7f1e741a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 0x7f1e741a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56366/0 (socket says 172.21.15.7:56366) 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e71e00640 1 -- 172.21.15.7:0/1573931659 learned_addr learned my addr 172.21.15.7:0/1573931659 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.440+0000 7f1e72800640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e7419a6c0 0x7f1e7419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e6be00640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 0x7f1e741a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e71e00640 1 -- 172.21.15.7:0/1573931659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 msgr2=0x7f1e741a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e71e00640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 0x7f1e741a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e71e00640 1 -- 172.21.15.7:0/1573931659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e7419a6c0 msgr2=0x7f1e7419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e71e00640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e7419a6c0 0x7f1e7419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e71e00640 1 -- 172.21.15.7:0/1573931659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7419b2c0 con 0x7f1e741042a0 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e6be00640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 0x7f1e741a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.441+0000 7f1e71e00640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 0x7f1e741a05b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400d950 tx=0x7f1e6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.442+0000 7f1e6aa00640 1 -- 172.21.15.7:0/1573931659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64017070 con 0x7f1e741042a0 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.442+0000 7f1e6aa00640 1 -- 172.21.15.7:0/1573931659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e64009c30 con 0x7f1e741042a0 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.442+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e741a7350 con 0x7f1e741042a0 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.442+0000 7f1e6aa00640 1 -- 172.21.15.7:0/1573931659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400f620 con 0x7f1e741042a0 2024-04-23T14:53:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.442+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e741a7750 con 0x7f1e741042a0 2024-04-23T14:53:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.445+0000 7f1e7bbcf740 1 Processor -- start 2024-04-23T14:53:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 -- start start 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 0x55f766e3d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f766d98900 con 0x55f766e32ce0 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f766d3ef20 con 0x55f766e323c0 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f766d948c0 con 0x55f766e3d5a0 2024-04-23T14:53:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e6aa00640 1 -- 172.21.15.7:0/1573931659 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1e640109a0 con 0x7f1e741042a0 2024-04-23T14:53:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.446+0000 7f1e71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 0x55f766e3d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 0x55f766e3d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56368/0 (socket says 172.21.15.7:56368) 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 -- 172.21.15.7:0/86651229 learned_addr learned my addr 172.21.15.7:0/86651229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e72800640 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e6be00640 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 -- 172.21.15.7:0/86651229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 msgr2=0x55f766e3f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 -- 172.21.15.7:0/86651229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 msgr2=0x55f766e327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.447+0000 7f1e71e00640 1 -- 172.21.15.7:0/86651229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f766d63e10 con 0x55f766e32ce0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.448+0000 7f1e71e00640 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 0x55f766e3d060 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1e640cda40 tx=0x7f1e640d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a816d85447503de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.448+0000 7f1e63400640 1 -- 172.21.15.7:0/86651229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e640df070 con 0x55f766e32ce0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.448+0000 7f1e63400640 1 -- 172.21.15.7:0/86651229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e640d0d60 con 0x55f766e32ce0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.448+0000 7f1e63400640 1 -- 172.21.15.7:0/86651229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e640db680 con 0x55f766e32ce0 2024-04-23T14:53:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.448+0000 7f1e6aa00640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1e580a3d90 0x7f1e580a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.448+0000 7f1e6aa00640 1 -- 172.21.15.7:0/1573931659 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f1e640d0770 con 0x7f1e741042a0 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e72800640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1e580a3d90 0x7f1e580a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/86651229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 msgr2=0x55f766e3d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 0x55f766e3d060 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1e640cda40 tx=0x7f1e640d8670 comp rx=0 tx=0).stop 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/86651229 shutdown_connections 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e32ce0 0x55f766e3d060 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/86651229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/86651229 >> 172.21.15.7:0/86651229 conn(0x55f766e2e8d0 msgr2=0x55f766e2ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/86651229 shutdown_connections 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e72800640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1e580a3d90 0x7f1e580a6250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c005fd0 tx=0x7f1e6c009600 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.449+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/86651229 wait complete. 2024-04-23T14:53:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.450+0000 7f1e7bbcf740 1 -- start start 2024-04-23T14:53:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.450+0000 7f1e7bbcf740 1 Processor -- start 2024-04-23T14:53:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.450+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 0x55f766e3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.450+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e3aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f766e40140 con 0x55f766e323c0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f766d522c0 con 0x55f766e32ce0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f766e402c0 con 0x55f766e3d5a0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e7bbcf740 10 client.0 _ll_register_callbacks cb 0x55f766aaaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 0x55f766e3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 0x55f766e3a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56382/0 (socket says 172.21.15.7:56382) 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 -- 172.21.15.7:0/2210005492 learned_addr learned my addr 172.21.15.7:0/2210005492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e6be00640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e3aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e72800640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 -- 172.21.15.7:0/2210005492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 msgr2=0x55f766e3b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 -- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 msgr2=0x55f766e3aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e3aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.451+0000 7f1e71e00640 1 -- 172.21.15.7:0/2210005492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f766d62fd0 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e71e00640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 0x55f766e3a580 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1e6409c2e0 tx=0x7f1e64010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf1f4702e079ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e57e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e57e00640 1 -- 172.21.15.7:0/2210005492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64020030 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e57e00640 1 -- 172.21.15.7:0/2210005492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f1e640d29e0 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e640d0d60 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e57e00640 1 -- 172.21.15.7:0/2210005492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1e640df070 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e7bbcf740 10 client.15831 fetch_fsmap learned FSMap version 30 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.452+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f766aab210 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e57e00640 1 -- 172.21.15.7:0/2210005492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e640d0d60 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e57e00640 1 -- 172.21.15.7:0/2210005492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1e640989c0 con 0x55f766e323c0 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e7bbcf740 10 client.15831 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e7bbcf740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e7bbcf740 20 client.15831 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766e4d600 0x55f766e4f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e7bbcf740 4 client.15831 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:53:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.453+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f766da6320 con 0x55f766e4d600 2024-04-23T14:53:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.454+0000 7f1e6be00640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766e4d600 0x55f766e4f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.455+0000 7f1e6be00640 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766e4d600 0x55f766e4f9f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ace4edeb21608f server_cookie=3eedff2cfa608ddb in_seq=0 out_seq=0 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.455+0000 7f1e57e00640 10 client.15831 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e57e00640 1 -- 172.21.15.7:0/2210005492 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f766da6320 con 0x55f766e4d600 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e57e00640 10 client.15831 handle_command_reply: tid=0 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 client.15831 shutdown 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 msgr2=0x55f766e3a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 0x55f766e3a580 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1e6409c2e0 tx=0x7f1e64010c90 comp rx=0 tx=0).stop 2024-04-23T14:53:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 shutdown_connections 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766e4d600 0x55f766e4f9f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e3aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e3d5a0 0x55f766e3b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/2210005492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e323c0 0x55f766e3a580 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 >> 172.21.15.7:0/2210005492 conn(0x55f766e2e8d0 msgr2=0x55f766e34650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e57e00640 0 client.15831 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 shutdown_connections 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.457+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/2210005492 wait complete. 2024-04-23T14:53:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.458+0000 7f1e7bbcf740 20 client.15831 trim_cache size 0 max 16384 2024-04-23T14:53:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.476+0000 7f1e7bbcf740 1 Processor -- start 2024-04-23T14:53:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.476+0000 7f1e7bbcf740 1 -- start start 2024-04-23T14:53:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e3ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e32ce0 0x55f766e48e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741b1410 con 0x55f766e3d5a0 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741b3010 con 0x55f766e323c0 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741b1ae0 con 0x55f766e32ce0 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e52a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56388/0 (socket says 172.21.15.7:56388) 2024-04-23T14:53:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e72800640 1 -- 172.21.15.7:0/3224174178 learned_addr learned my addr 172.21.15.7:0/3224174178 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.477+0000 7f1e71e00640 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e3ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e6be00640 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e32ce0 0x55f766e48e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e72800640 1 -- 172.21.15.7:0/3224174178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e32ce0 msgr2=0x55f766e48e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e72800640 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e32ce0 0x55f766e48e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e72800640 1 -- 172.21.15.7:0/3224174178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 msgr2=0x55f766e3ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e72800640 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e3ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e72800640 1 -- 172.21.15.7:0/3224174178 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f766e39530 con 0x55f766e3d5a0 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.478+0000 7f1e72800640 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e52a10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0117f0 tx=0x7f1e6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bd23446fbbae1c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.479+0000 7f1e62a00640 1 -- 172.21.15.7:0/3224174178 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c02c070 con 0x55f766e3d5a0 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.479+0000 7f1e62a00640 1 -- 172.21.15.7:0/3224174178 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e6c01edb0 con 0x55f766e3d5a0 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.479+0000 7f1e62a00640 1 -- 172.21.15.7:0/3224174178 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c01cc30 con 0x55f766e3d5a0 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/3224174178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 msgr2=0x55f766e52a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e52a10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0117f0 tx=0x7f1e6c016000 comp rx=0 tx=0).stop 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/3224174178 shutdown_connections 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e52a10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e32ce0 0x55f766e48e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/3224174178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e323c0 0x55f766e3ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/3224174178 >> 172.21.15.7:0/3224174178 conn(0x55f766e2e8d0 msgr2=0x55f766e2ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/3224174178 shutdown_connections 2024-04-23T14:53:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/3224174178 wait complete. 2024-04-23T14:53:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.480+0000 7f1e7bbcf740 1 -- start start 2024-04-23T14:53:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 Processor -- start 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e323c0 0x55f766e52ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e51080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741b2880 con 0x55f766e3d5a0 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741b21b0 con 0x55f766e32ce0 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741af3f0 con 0x55f766e323c0 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e7bbcf740 10 client.0 _ll_register_callbacks cb 0x7f1e6c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.481+0000 7f1e72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56398/0 (socket says 172.21.15.7:56398) 2024-04-23T14:53:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 -- 172.21.15.7:0/52706099 learned_addr learned my addr 172.21.15.7:0/52706099 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e71e00640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e323c0 0x55f766e52ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e6be00640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 -- 172.21.15.7:0/52706099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e323c0 msgr2=0x55f766e52ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e323c0 0x55f766e52ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 -- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 msgr2=0x55f766e51080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e51080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 -- 172.21.15.7:0/52706099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f766e35370 con 0x55f766e3d5a0 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e72800640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e515c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c02a040 tx=0x7f1e6c01ffe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63fd4f678710e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.482+0000 7f1e57e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:53:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.483+0000 7f1e57e00640 1 -- 172.21.15.7:0/52706099 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c02c040 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.483+0000 7f1e57e00640 1 -- 172.21.15.7:0/52706099 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f1e6c004a40 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.483+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6c01edb0 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.483+0000 7f1e57e00640 1 -- 172.21.15.7:0/52706099 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1e6c03e050 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.483+0000 7f1e7bbcf740 10 client.15837 fetch_fsmap learned FSMap version 30 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.483+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f766b77620 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e57e00640 1 -- 172.21.15.7:0/52706099 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e6c01edb0 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e57e00640 1 -- 172.21.15.7:0/52706099 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1e6c01a040 con 0x55f766e3d5a0 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e7bbcf740 10 client.15837 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e7bbcf740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e7bbcf740 20 client.15837 populate_metadata read hostname 'smithi007' 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766eb4ab0 0x55f766eb6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e7bbcf740 4 client.15837 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:53:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.484+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f766da0190 con 0x55f766eb4ab0 2024-04-23T14:53:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.485+0000 7f1e71e00640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766eb4ab0 0x55f766eb6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.486+0000 7f1e71e00640 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766eb4ab0 0x55f766eb6ed0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6979ce59d43dca server_cookie=989f02997c4db4f7 in_seq=0 out_seq=0 2024-04-23T14:53:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:49.486+0000 7f1e57e00640 10 client.15837 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:49.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:49 smithi007 ceph-mon[27906]: pgmap v77: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 170 KiB/s wr, 63 op/s 2024-04-23T14:53:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:49 smithi186 ceph-mon[31814]: pgmap v77: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 170 KiB/s wr, 63 op/s 2024-04-23T14:53:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:49 smithi137 ceph-mon[31694]: pgmap v77: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 170 KiB/s wr, 63 op/s 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e57e00640 1 -- 172.21.15.7:0/52706099 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f766da0190 con 0x55f766eb4ab0 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e57e00640 10 client.15837 handle_command_reply: tid=0 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 client.15837 shutdown 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 msgr2=0x55f766e515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e515c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c02a040 tx=0x7f1e6c01ffe0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 shutdown_connections 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f766eb4ab0 0x55f766eb6ed0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f766e32ce0 0x55f766e51080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f766e3d5a0 0x55f766e515c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 --2- 172.21.15.7:0/52706099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f766e323c0 0x55f766e52ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e57e00640 0 client.15837 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.082+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 >> 172.21.15.7:0/52706099 conn(0x55f766e2e8d0 msgr2=0x55f766e2da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.083+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 shutdown_connections 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.083+0000 7f1e7bbcf740 1 -- 172.21.15.7:0/52706099 wait complete. 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.083+0000 7f1e7bbcf740 20 client.15837 trim_cache size 0 max 16384 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:53:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:53:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:53:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1e580a3d90 msgr2=0x7f1e580a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1e580a3d90 0x7f1e580a6250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c005fd0 tx=0x7f1e6c009600 comp rx=0 tx=0).stop 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 msgr2=0x7f1e741a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 0x7f1e741a05b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400d950 tx=0x7f1e6400de10 comp rx=0 tx=0).stop 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 shutdown_connections 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1e580a3d90 0x7f1e580a6250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e7419a6c0 0x7f1e7419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e74109370 0x7f1e741a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 --2- 172.21.15.7:0/1573931659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e741042a0 0x7f1e741a05b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 >> 172.21.15.7:0/1573931659 conn(0x7f1e740ffae0 msgr2=0x7f1e74100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 shutdown_connections 2024-04-23T14:53:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:53:50.084+0000 7f1e73200640 1 -- 172.21.15.7:0/1573931659 wait complete. 2024-04-23T14:53:51.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:51 smithi007 ceph-mon[27906]: pgmap v78: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 170 KiB/s wr, 63 op/s 2024-04-23T14:53:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:51 smithi186 ceph-mon[31814]: pgmap v78: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 170 KiB/s wr, 63 op/s 2024-04-23T14:53:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:51 smithi137 ceph-mon[31694]: pgmap v78: 129 pgs: 129 active+clean; 7.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 170 KiB/s wr, 63 op/s 2024-04-23T14:53:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:53 smithi007 ceph-mon[27906]: pgmap v79: 129 pgs: 129 active+clean; 8.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 592 KiB/s wr, 91 op/s 2024-04-23T14:53:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:53 smithi186 ceph-mon[31814]: pgmap v79: 129 pgs: 129 active+clean; 8.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 592 KiB/s wr, 91 op/s 2024-04-23T14:53:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:53 smithi137 ceph-mon[31694]: pgmap v79: 129 pgs: 129 active+clean; 8.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 592 KiB/s wr, 91 op/s 2024-04-23T14:53:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:55 smithi007 ceph-mon[27906]: pgmap v80: 129 pgs: 129 active+clean; 8.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 493 KiB/s wr, 49 op/s 2024-04-23T14:53:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:55 smithi186 ceph-mon[31814]: pgmap v80: 129 pgs: 129 active+clean; 8.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 493 KiB/s wr, 49 op/s 2024-04-23T14:53:55.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:55 smithi137 ceph-mon[31694]: pgmap v80: 129 pgs: 129 active+clean; 8.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 493 KiB/s wr, 49 op/s 2024-04-23T14:53:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:57 smithi007 ceph-mon[27906]: pgmap v81: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.5 MiB/s wr, 55 op/s 2024-04-23T14:53:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:57 smithi186 ceph-mon[31814]: pgmap v81: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.5 MiB/s wr, 55 op/s 2024-04-23T14:53:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:57 smithi137 ceph-mon[31694]: pgmap v81: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.5 MiB/s wr, 55 op/s 2024-04-23T14:53:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:53:59 smithi007 ceph-mon[27906]: pgmap v82: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.4 MiB/s wr, 35 op/s 2024-04-23T14:53:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:53:59 smithi186 ceph-mon[31814]: pgmap v82: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.4 MiB/s wr, 35 op/s 2024-04-23T14:53:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:53:59 smithi137 ceph-mon[31694]: pgmap v82: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.4 MiB/s wr, 35 op/s 2024-04-23T14:54:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:01 smithi007 ceph-mon[27906]: pgmap v83: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.4 MiB/s wr, 35 op/s 2024-04-23T14:54:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:01 smithi186 ceph-mon[31814]: pgmap v83: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.4 MiB/s wr, 35 op/s 2024-04-23T14:54:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:01 smithi137 ceph-mon[31694]: pgmap v83: 129 pgs: 129 active+clean; 33 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.4 MiB/s wr, 35 op/s 2024-04-23T14:54:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 -- 172.21.15.7:0/3491602912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce98102a40 msgr2=0x7fce98106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 --2- 172.21.15.7:0/3491602912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce98102a40 0x7fce98106a80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce84009900 tx=0x7fce8402a3f0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 -- 172.21.15.7:0/3491602912 shutdown_connections 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 --2- 172.21.15.7:0/3491602912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce98107160 0x7fce9810ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 --2- 172.21.15.7:0/3491602912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce98102a40 0x7fce98106a80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 --2- 172.21.15.7:0/3491602912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce98102090 0x7fce98102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 -- 172.21.15.7:0/3491602912 >> 172.21.15.7:0/3491602912 conn(0x7fce980fd950 msgr2=0x7fce980ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 -- 172.21.15.7:0/3491602912 shutdown_connections 2024-04-23T14:54:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.241+0000 7fce97200640 1 -- 172.21.15.7:0/3491602912 wait complete. 2024-04-23T14:54:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.242+0000 7fce97200640 1 Processor -- start 2024-04-23T14:54:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.242+0000 7fce97200640 1 -- start start 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce97200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce98102090 0x7fce981a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce97200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce98107160 0x7fce981a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce97200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 0x7fce9819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce97200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce981120f0 con 0x7fce9819a600 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce97200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce98111f70 con 0x7fce98102090 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce97200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fce98112270 con 0x7fce98107160 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce96800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 0x7fce9819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce96800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 0x7fce9819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54354/0 (socket says 172.21.15.7:54354) 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.243+0000 7fce96800640 1 -- 172.21.15.7:0/2120033881 learned_addr learned my addr 172.21.15.7:0/2120033881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce95e00640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce98102090 0x7fce981a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce95400640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce98107160 0x7fce981a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce96800640 1 -- 172.21.15.7:0/2120033881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce98107160 msgr2=0x7fce981a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce96800640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce98107160 0x7fce981a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce96800640 1 -- 172.21.15.7:0/2120033881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce98102090 msgr2=0x7fce981a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce96800640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce98102090 0x7fce981a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce96800640 1 -- 172.21.15.7:0/2120033881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9819b120 con 0x7fce9819a600 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.244+0000 7fce96800640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 0x7fce9819aab0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fce9000eaa0 tx=0x7fce9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.245+0000 7fce8ea00640 1 -- 172.21.15.7:0/2120033881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9000cdb0 con 0x7fce9819a600 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.245+0000 7fce8ea00640 1 -- 172.21.15.7:0/2120033881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce90005020 con 0x7fce9819a600 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.245+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9819b410 con 0x7fce9819a600 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.245+0000 7fce8ea00640 1 -- 172.21.15.7:0/2120033881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce900116d0 con 0x7fce9819a600 2024-04-23T14:54:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.245+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce981a7660 con 0x7fce9819a600 2024-04-23T14:54:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.248+0000 7fce9fc6b740 1 Processor -- start 2024-04-23T14:54:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.248+0000 7fce8ea00640 1 -- 172.21.15.7:0/2120033881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fce900051d0 con 0x7fce9819a600 2024-04-23T14:54:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 -- start start 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a3c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a3cce0 0x557e35a47060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a475a0 0x557e35a49990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e359a2900 con 0x557e35a3c3c0 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e35948f20 con 0x557e35a475a0 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557e3599e8c0 con 0x557e35a3cce0 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.249+0000 7fce95400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a3c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a3c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54364/0 (socket says 172.21.15.7:54364) 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 -- 172.21.15.7:0/1685415277 learned_addr learned my addr 172.21.15.7:0/1685415277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95e00640 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a3cce0 0x557e35a47060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a475a0 0x557e35a49990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 -- 172.21.15.7:0/1685415277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a3cce0 msgr2=0x557e35a47060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a3cce0 0x557e35a47060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 -- 172.21.15.7:0/1685415277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a475a0 msgr2=0x557e35a49990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a475a0 0x557e35a49990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.250+0000 7fce95400640 1 -- 172.21.15.7:0/1685415277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3596de10 con 0x557e35a3c3c0 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce8ea00640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fce7c0a3d10 0x7fce7c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce95400640 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a3c7a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fce840096c0 tx=0x7fce84009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1ecd74d80da6bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce8ea00640 1 -- 172.21.15.7:0/2120033881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fce900d0db0 con 0x7fce9819a600 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce95e00640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fce7c0a3d10 0x7fce7c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce83400640 1 -- 172.21.15.7:0/1685415277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84043020 con 0x557e35a3c3c0 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce83400640 1 -- 172.21.15.7:0/1685415277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce840046c0 con 0x557e35a3c3c0 2024-04-23T14:54:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.251+0000 7fce83400640 1 -- 172.21.15.7:0/1685415277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84035070 con 0x557e35a3c3c0 2024-04-23T14:54:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1685415277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 msgr2=0x557e35a3c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a3c7a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fce840096c0 tx=0x7fce84009560 comp rx=0 tx=0).stop 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce95e00640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fce7c0a3d10 0x7fce7c0a61d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x557e35a3d960 tx=0x7fce8800c4b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1685415277 shutdown_connections 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a475a0 0x557e35a49990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a3cce0 0x557e35a47060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1685415277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a3c7a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1685415277 >> 172.21.15.7:0/1685415277 conn(0x557e35a388d0 msgr2=0x557e35a38cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1685415277 shutdown_connections 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.252+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1685415277 wait complete. 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.253+0000 7fce9fc6b740 1 -- start start 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.253+0000 7fce9fc6b740 1 Processor -- start 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.253+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a44560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a44aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a44fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e35a4a110 con 0x557e35a3c3c0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e3595c2c0 con 0x557e35a3cce0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557e35a4a290 con 0x557e35a475a0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce9fc6b740 10 client.0 _ll_register_callbacks cb 0x557e356b4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a44560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a44560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54366/0 (socket says 172.21.15.7:54366) 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 -- 172.21.15.7:0/4077653836 learned_addr learned my addr 172.21.15.7:0/4077653836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95400640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a44aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 -- 172.21.15.7:0/4077653836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 msgr2=0x557e35a44fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a44fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 -- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 msgr2=0x557e35a44aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a44aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95e00640 1 -- 172.21.15.7:0/4077653836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3596cfd0 con 0x557e35a3c3c0 2024-04-23T14:54:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.254+0000 7fce95400640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a44aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.255+0000 7fce95e00640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a44560 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fce880119c0 tx=0x7fce880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a43a1c13354299f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.255+0000 7fce77e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.255+0000 7fce77e00640 1 -- 172.21.15.7:0/4077653836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88003ea0 con 0x557e35a3c3c0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.255+0000 7fce77e00640 1 -- 172.21.15.7:0/4077653836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fce8801cb10 con 0x557e35a3c3c0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.255+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce840046c0 con 0x557e35a3c3c0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce77e00640 1 -- 172.21.15.7:0/4077653836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce8802f050 con 0x557e35a3c3c0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 10 client.15849 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557e356b5210 con 0x557e35a3c3c0 2024-04-23T14:54:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce77e00640 1 -- 172.21.15.7:0/4077653836 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce840046c0 con 0x557e35a3c3c0 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce77e00640 1 -- 172.21.15.7:0/4077653836 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fce88018040 con 0x557e35a3c3c0 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 10 client.15849 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 20 client.15849 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35a57880 0x557e35a59d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 4 client.15849 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.256+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e359b0320 con 0x557e35a57880 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.257+0000 7fce95400640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35a57880 0x557e35a59d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.258+0000 7fce95400640 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35a57880 0x557e35a59d20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281f04e5f879c8f0 server_cookie=2617f678c60d92b4 in_seq=0 out_seq=0 2024-04-23T14:54:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.258+0000 7fce77e00640 10 client.15849 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce77e00640 1 -- 172.21.15.7:0/4077653836 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557e359b0320 con 0x557e35a57880 2024-04-23T14:54:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce77e00640 10 client.15849 handle_command_reply: tid=0 2024-04-23T14:54:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 client.15849 shutdown 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 msgr2=0x557e35a44560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a44560 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fce880119c0 tx=0x7fce880046c0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 shutdown_connections 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35a57880 0x557e35a59d20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a44aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a44fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/4077653836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a44560 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 >> 172.21.15.7:0/4077653836 conn(0x557e35a388d0 msgr2=0x557e35a3e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.260+0000 7fce77e00640 0 client.15849 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.261+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 shutdown_connections 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.261+0000 7fce9fc6b740 1 -- 172.21.15.7:0/4077653836 wait complete. 2024-04-23T14:54:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.261+0000 7fce9fc6b740 20 client.15849 trim_cache size 0 max 16384 2024-04-23T14:54:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.280+0000 7fce9fc6b740 1 Processor -- start 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.280+0000 7fce9fc6b740 1 -- start start 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.280+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a53020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.280+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a5f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.280+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a5fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce981b11d0 con 0x557e35a3c3c0 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce981b2dd0 con 0x557e35a3cce0 2024-04-23T14:54:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fce981b18a0 con 0x557e35a475a0 2024-04-23T14:54:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a53020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a53020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54368/0 (socket says 172.21.15.7:54368) 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 -- 172.21.15.7:0/2660591883 learned_addr learned my addr 172.21.15.7:0/2660591883 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce96800640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a5fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95400640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a5f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 -- 172.21.15.7:0/2660591883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 msgr2=0x557e35a5fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a5fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 -- 172.21.15.7:0/2660591883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 msgr2=0x557e35a5f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a5f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95e00640 1 -- 172.21.15.7:0/2660591883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e35781620 con 0x557e35a3c3c0 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce96800640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a5fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.281+0000 7fce95400640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a5f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.282+0000 7fce95e00640 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a53020 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fce88024490 tx=0x7fce8801c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cef7c91e9f91789 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.282+0000 7fce82a00640 1 -- 172.21.15.7:0/2660591883 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88003df0 con 0x557e35a3c3c0 2024-04-23T14:54:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.282+0000 7fce82a00640 1 -- 172.21.15.7:0/2660591883 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce88038070 con 0x557e35a3c3c0 2024-04-23T14:54:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.282+0000 7fce82a00640 1 -- 172.21.15.7:0/2660591883 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8801a460 con 0x557e35a3c3c0 2024-04-23T14:54:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 -- 172.21.15.7:0/2660591883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 msgr2=0x557e35a53020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a53020 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fce88024490 tx=0x7fce8801c7d0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 -- 172.21.15.7:0/2660591883 shutdown_connections 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a5f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a5fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/2660591883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a53020 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 -- 172.21.15.7:0/2660591883 >> 172.21.15.7:0/2660591883 conn(0x557e35a388d0 msgr2=0x557e35a3f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 -- 172.21.15.7:0/2660591883 shutdown_connections 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.283+0000 7fce9fc6b740 1 -- 172.21.15.7:0/2660591883 wait complete. 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.284+0000 7fce9fc6b740 1 -- start start 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.284+0000 7fce9fc6b740 1 Processor -- start 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a4f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a4fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a40d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce981b2640 con 0x557e35a3c3c0 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce981b1f70 con 0x557e35a3cce0 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fce981af1b0 con 0x557e35a475a0 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce9fc6b740 10 client.0 _ll_register_callbacks cb 0x7fce880042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a4f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a4f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54378/0 (socket says 172.21.15.7:54378) 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 -- 172.21.15.7:0/1395059742 learned_addr learned my addr 172.21.15.7:0/1395059742 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95400640 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a4fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 -- 172.21.15.7:0/1395059742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 msgr2=0x557e35a40d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a40d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 -- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 msgr2=0x557e35a4fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a4fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.285+0000 7fce95e00640 1 -- 172.21.15.7:0/1395059742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e35a415c0 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.286+0000 7fce95e00640 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a4f530 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fce88000c00 tx=0x7fce88025e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aafee3fbdc808b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.286+0000 7fce77e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.286+0000 7fce77e00640 1 -- 172.21.15.7:0/1395059742 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88024890 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.286+0000 7fce77e00640 1 -- 172.21.15.7:0/1395059742 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fce8801cb10 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.286+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce88038070 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce77e00640 1 -- 172.21.15.7:0/1395059742 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce8804c050 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 10 client.15855 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557e35ac6210 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce77e00640 1 -- 172.21.15.7:0/1395059742 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce88038070 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce77e00640 1 -- 172.21.15.7:0/1395059742 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fce88018040 con 0x557e35a3c3c0 2024-04-23T14:54:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 10 client.15855 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 20 client.15855 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35ac6920 0x557e35ac8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 4 client.15855 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.287+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e359aa190 con 0x557e35ac6920 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.288+0000 7fce95400640 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35ac6920 0x557e35ac8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.289+0000 7fce95400640 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35ac6920 0x557e35ac8d40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990831fe6df61795 server_cookie=c18cb185f185f81c in_seq=0 out_seq=0 2024-04-23T14:54:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.289+0000 7fce77e00640 10 client.15855 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.329+0000 7fce77e00640 1 -- 172.21.15.7:0/1395059742 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e359aa190 con 0x557e35ac6920 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.329+0000 7fce77e00640 10 client.15855 handle_command_reply: tid=0 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.329+0000 7fce9fc6b740 1 client.15855 shutdown 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 msgr2=0x557e35a4f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a4f530 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fce88000c00 tx=0x7fce88025e50 comp rx=0 tx=0).stop 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 shutdown_connections 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e35ac6920 0x557e35ac8d40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e35a3cce0 0x557e35a4fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e35a475a0 0x557e35a40d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 --2- 172.21.15.7:0/1395059742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e35a3c3c0 0x557e35a4f530 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 >> 172.21.15.7:0/1395059742 conn(0x557e35a388d0 msgr2=0x557e35a37200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:03.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce77e00640 0 client.15855 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 shutdown_connections 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 1 -- 172.21.15.7:0/1395059742 wait complete. 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.330+0000 7fce9fc6b740 20 client.15855 trim_cache size 0 max 16384 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:54:03.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:54:03.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fce7c0a3d10 msgr2=0x7fce7c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fce7c0a3d10 0x7fce7c0a61d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x557e35a3d960 tx=0x7fce8800c4b0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 msgr2=0x7fce9819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:03.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 0x7fce9819aab0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fce9000eaa0 tx=0x7fce9000ef60 comp rx=0 tx=0).stop 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 shutdown_connections 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fce7c0a3d10 0x7fce7c0a61d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce9819a600 0x7fce9819aab0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce98107160 0x7fce981a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 --2- 172.21.15.7:0/2120033881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce98102090 0x7fce981a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.331+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 >> 172.21.15.7:0/2120033881 conn(0x7fce980fd950 msgr2=0x7fce980fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.332+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 shutdown_connections 2024-04-23T14:54:03.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:03.332+0000 7fce97200640 1 -- 172.21.15.7:0/2120033881 wait complete. 2024-04-23T14:54:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:03 smithi007 ceph-mon[27906]: pgmap v84: 129 pgs: 129 active+clean; 57 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.5 MiB/s wr, 55 op/s 2024-04-23T14:54:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:03 smithi186 ceph-mon[31814]: pgmap v84: 129 pgs: 129 active+clean; 57 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.5 MiB/s wr, 55 op/s 2024-04-23T14:54:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:03 smithi137 ceph-mon[31694]: pgmap v84: 129 pgs: 129 active+clean; 57 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.5 MiB/s wr, 55 op/s 2024-04-23T14:54:05.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:05 smithi007 ceph-mon[27906]: pgmap v85: 129 pgs: 129 active+clean; 57 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 27 op/s 2024-04-23T14:54:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:05 smithi186 ceph-mon[31814]: pgmap v85: 129 pgs: 129 active+clean; 57 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 27 op/s 2024-04-23T14:54:05.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:05 smithi137 ceph-mon[31694]: pgmap v85: 129 pgs: 129 active+clean; 57 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 27 op/s 2024-04-23T14:54:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:07 smithi007 ceph-mon[27906]: pgmap v86: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T14:54:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:07 smithi186 ceph-mon[31814]: pgmap v86: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T14:54:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:07 smithi137 ceph-mon[31694]: pgmap v86: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T14:54:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:09 smithi186 ceph-mon[31814]: pgmap v87: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 28 op/s 2024-04-23T14:54:09.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:09 smithi137 ceph-mon[31694]: pgmap v87: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 28 op/s 2024-04-23T14:54:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:09 smithi007 ceph-mon[27906]: pgmap v87: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 28 op/s 2024-04-23T14:54:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:11 smithi186 ceph-mon[31814]: pgmap v88: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 28 op/s 2024-04-23T14:54:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:11 smithi137 ceph-mon[31694]: pgmap v88: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 28 op/s 2024-04-23T14:54:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:11 smithi007 ceph-mon[27906]: pgmap v88: 129 pgs: 129 active+clean; 77 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 28 op/s 2024-04-23T14:54:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:13 smithi186 ceph-mon[31814]: pgmap v89: 129 pgs: 129 active+clean; 105 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T14:54:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:13 smithi137 ceph-mon[31694]: pgmap v89: 129 pgs: 129 active+clean; 105 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T14:54:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:13 smithi007 ceph-mon[27906]: pgmap v89: 129 pgs: 129 active+clean; 105 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T14:54:15.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:15 smithi186 ceph-mon[31814]: pgmap v90: 129 pgs: 129 active+clean; 105 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 13 op/s 2024-04-23T14:54:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:15 smithi137 ceph-mon[31694]: pgmap v90: 129 pgs: 129 active+clean; 105 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 13 op/s 2024-04-23T14:54:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:15 smithi007 ceph-mon[27906]: pgmap v90: 129 pgs: 129 active+clean; 105 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 13 op/s 2024-04-23T14:54:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 -- 172.21.15.7:0/509584798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c10e4d0 msgr2=0x7f398c10e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 --2- 172.21.15.7:0/509584798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c10e4d0 0x7f398c10e8b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f397c009930 tx=0x7f397c02a420 comp rx=0 tx=0).stop 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 -- 172.21.15.7:0/509584798 shutdown_connections 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 --2- 172.21.15.7:0/509584798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f398c108ec0 0x7f398c115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 --2- 172.21.15.7:0/509584798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f398c108540 0x7f398c108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 --2- 172.21.15.7:0/509584798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c10e4d0 0x7f398c10e8b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 -- 172.21.15.7:0/509584798 >> 172.21.15.7:0/509584798 conn(0x7f398c077de0 msgr2=0x7f398c106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 -- 172.21.15.7:0/509584798 shutdown_connections 2024-04-23T14:54:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.494+0000 7f3990a00640 1 -- 172.21.15.7:0/509584798 wait complete. 2024-04-23T14:54:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.495+0000 7f3990a00640 1 Processor -- start 2024-04-23T14:54:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 -- start start 2024-04-23T14:54:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f398c108540 0x7f398c1a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 0x7f398c1a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f398c10e4d0 0x7f398c19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1186f0 con 0x7f398c108ec0 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f398c118570 con 0x7f398c108540 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3990a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f398c118870 con 0x7f398c10e4d0 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 0x7f398c1a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 0x7f398c1a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39240/0 (socket says 172.21.15.7:39240) 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.496+0000 7f3989e00640 1 -- 172.21.15.7:0/1980898411 learned_addr learned my addr 172.21.15.7:0/1980898411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f398a800640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f398c108540 0x7f398c1a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f398b200640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f398c10e4d0 0x7f398c19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3989e00640 1 -- 172.21.15.7:0/1980898411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f398c10e4d0 msgr2=0x7f398c19ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3989e00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f398c10e4d0 0x7f398c19ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3989e00640 1 -- 172.21.15.7:0/1980898411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f398c108540 msgr2=0x7f398c1a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3989e00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f398c108540 0x7f398c1a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3989e00640 1 -- 172.21.15.7:0/1980898411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c19f210 con 0x7f398c108ec0 2024-04-23T14:54:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3989e00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 0x7f398c1a4e20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f397800e9f0 tx=0x7f397800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.497+0000 7f3983400640 1 -- 172.21.15.7:0/1980898411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397800cd80 con 0x7f398c108ec0 2024-04-23T14:54:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.498+0000 7f3983400640 1 -- 172.21.15.7:0/1980898411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39780054d0 con 0x7f398c108ec0 2024-04-23T14:54:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.498+0000 7f3983400640 1 -- 172.21.15.7:0/1980898411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978010490 con 0x7f398c108ec0 2024-04-23T14:54:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.498+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c19f500 con 0x7f398c108ec0 2024-04-23T14:54:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.498+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c1ab7a0 con 0x7f398c108ec0 2024-04-23T14:54:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.502+0000 7f3994257740 1 Processor -- start 2024-04-23T14:54:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.502+0000 7f3994257740 1 -- start start 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3994257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3994257740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3994257740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3994257740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5602cb446900 con 0x5602cb4eb5a0 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3994257740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602cb3ecf20 con 0x5602cb4e0ce0 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3994257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5602cb4428c0 con 0x5602cb4e03c0 2024-04-23T14:54:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3983400640 1 -- 172.21.15.7:0/1980898411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3978005020 con 0x7f398c108ec0 2024-04-23T14:54:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39242/0 (socket says 172.21.15.7:39242) 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f3989e00640 1 -- 172.21.15.7:0/1036667168 learned_addr learned my addr 172.21.15.7:0/1036667168 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.503+0000 7f398a800640 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f398b200640 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f3989e00640 1 -- 172.21.15.7:0/1036667168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 msgr2=0x5602cb4e07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f3989e00640 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4e07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f3989e00640 1 -- 172.21.15.7:0/1036667168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e0ce0 msgr2=0x5602cb4eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f3989e00640 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f3989e00640 1 -- 172.21.15.7:0/1036667168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602cb411e10 con 0x5602cb4eb5a0 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f398b200640 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.504+0000 7f3989e00640 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ed990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f39780ce360 tx=0x7f39780d91a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a684ea20263cc53f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.505+0000 7f3977400640 1 -- 172.21.15.7:0/1036667168 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780e4070 con 0x5602cb4eb5a0 2024-04-23T14:54:16.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.505+0000 7f3977400640 1 -- 172.21.15.7:0/1036667168 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39780d32e0 con 0x5602cb4eb5a0 2024-04-23T14:54:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.505+0000 7f3977400640 1 -- 172.21.15.7:0/1036667168 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780df400 con 0x5602cb4eb5a0 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.505+0000 7f3983400640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39700a3d10 0x7f39700a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.505+0000 7f3983400640 1 -- 172.21.15.7:0/1980898411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f39780d1090 con 0x7f398c108ec0 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.505+0000 7f398b200640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39700a3d10 0x7f39700a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 -- 172.21.15.7:0/1036667168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 msgr2=0x5602cb4ed990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ed990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f39780ce360 tx=0x7f39780d91a0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 -- 172.21.15.7:0/1036667168 shutdown_connections 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ed990 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 --2- 172.21.15.7:0/1036667168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 -- 172.21.15.7:0/1036667168 >> 172.21.15.7:0/1036667168 conn(0x5602cb4dc8d0 msgr2=0x5602cb4dccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 -- 172.21.15.7:0/1036667168 shutdown_connections 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f398b200640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39700a3d10 0x7f39700a61d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3984005fd0 tx=0x7f3984009500 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.506+0000 7f3994257740 1 -- 172.21.15.7:0/1036667168 wait complete. 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.507+0000 7f3994257740 1 -- start start 2024-04-23T14:54:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.507+0000 7f3994257740 1 Processor -- start 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.507+0000 7f3994257740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 0x5602cb4e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.507+0000 7f3994257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.507+0000 7f3994257740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4e9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.507+0000 7f3994257740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5602cb4ee0e0 con 0x5602cb4e03c0 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f3994257740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602cb4002c0 con 0x5602cb4eb5a0 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f3994257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5602cb4ee260 con 0x5602cb4e0ce0 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f3994257740 10 client.0 _ll_register_callbacks cb 0x5602cb158a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 0x5602cb4e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 0x5602cb4e85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39248/0 (socket says 172.21.15.7:39248) 2024-04-23T14:54:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 -- 172.21.15.7:0/4044967435 learned_addr learned my addr 172.21.15.7:0/4044967435 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f3989e00640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398b200640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 -- 172.21.15.7:0/4044967435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e0ce0 msgr2=0x5602cb4e8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 -- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 msgr2=0x5602cb4e9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4e9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.508+0000 7f398a800640 1 -- 172.21.15.7:0/4044967435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602cb410fd0 con 0x5602cb4e03c0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.509+0000 7f398a800640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 0x5602cb4e85b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f397c006010 tx=0x7f397c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f135ae3731ae4a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.509+0000 7f396be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.509+0000 7f396be00640 1 -- 172.21.15.7:0/4044967435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c035030 con 0x5602cb4e03c0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.509+0000 7f396be00640 1 -- 172.21.15.7:0/4044967435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f397c0048c0 con 0x5602cb4e03c0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.509+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5602cb454320 con 0x5602cb4e03c0 2024-04-23T14:54:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f396be00640 1 -- 172.21.15.7:0/4044967435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f397c04d050 con 0x5602cb4e03c0 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 10 client.15867 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5602cb159210 con 0x5602cb4e03c0 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f396be00640 1 -- 172.21.15.7:0/4044967435 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5602cb454320 con 0x5602cb4e03c0 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f396be00640 1 -- 172.21.15.7:0/4044967435 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f397c003a80 con 0x5602cb4e03c0 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 10 client.15867 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 20 client.15867 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb4fb700 0x5602cb4fdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 4 client.15867 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:54:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.510+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602cb44e190 con 0x5602cb4fb700 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.511+0000 7f3989e00640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb4fb700 0x5602cb4fdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.512+0000 7f3989e00640 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb4fb700 0x5602cb4fdb50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1894afcd3128b8e server_cookie=3cc4e1225020cc0 in_seq=0 out_seq=0 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.512+0000 7f396be00640 10 client.15867 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f396be00640 1 -- 172.21.15.7:0/4044967435 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5602cb44e190 con 0x5602cb4fb700 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f396be00640 10 client.15867 handle_command_reply: tid=0 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 client.15867 shutdown 2024-04-23T14:54:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 msgr2=0x5602cb4e85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 0x5602cb4e85b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f397c006010 tx=0x7f397c005270 comp rx=0 tx=0).stop 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 shutdown_connections 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb4fb700 0x5602cb4fdb50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 --2- 172.21.15.7:0/4044967435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e03c0 0x5602cb4e85b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 >> 172.21.15.7:0/4044967435 conn(0x5602cb4dc8d0 msgr2=0x5602cb4dba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f396be00640 0 client.15867 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.514+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 shutdown_connections 2024-04-23T14:54:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.515+0000 7f3994257740 1 -- 172.21.15.7:0/4044967435 wait complete. 2024-04-23T14:54:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.515+0000 7f3994257740 20 client.15867 trim_cache size 0 max 16384 2024-04-23T14:54:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 Processor -- start 2024-04-23T14:54:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 -- start start 2024-04-23T14:54:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e03c0 0x5602cb4f7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4eb5a0 0x5602cb503460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1b57b0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1b73b0 con 0x5602cb4e03c0 2024-04-23T14:54:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.536+0000 7f3994257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1b5e80 con 0x5602cb4eb5a0 2024-04-23T14:54:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39258/0 (socket says 172.21.15.7:39258) 2024-04-23T14:54:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 -- 172.21.15.7:0/3655779243 learned_addr learned my addr 172.21.15.7:0/3655779243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f398a800640 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e03c0 0x5602cb4f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f398b200640 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4eb5a0 0x5602cb503460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 -- 172.21.15.7:0/3655779243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4eb5a0 msgr2=0x5602cb503460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4eb5a0 0x5602cb503460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 -- 172.21.15.7:0/3655779243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e03c0 msgr2=0x5602cb4f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e03c0 0x5602cb4f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.537+0000 7f3989e00640 1 -- 172.21.15.7:0/3655779243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602cb4e0b10 con 0x5602cb4e0ce0 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.538+0000 7f3989e00640 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e2d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f39780990d0 tx=0x7f39780d9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850f8e88ec71a2a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.538+0000 7f3976a00640 1 -- 172.21.15.7:0/3655779243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978098f10 con 0x5602cb4e0ce0 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.538+0000 7f3976a00640 1 -- 172.21.15.7:0/3655779243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3978005310 con 0x5602cb4e0ce0 2024-04-23T14:54:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.538+0000 7f3976a00640 1 -- 172.21.15.7:0/3655779243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780d4c30 con 0x5602cb4e0ce0 2024-04-23T14:54:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 -- 172.21.15.7:0/3655779243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 msgr2=0x5602cb4e2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e2d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f39780990d0 tx=0x7f39780d9f60 comp rx=0 tx=0).stop 2024-04-23T14:54:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 -- 172.21.15.7:0/3655779243 shutdown_connections 2024-04-23T14:54:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4eb5a0 0x5602cb503460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4e2d80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 --2- 172.21.15.7:0/3655779243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4e03c0 0x5602cb4f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 -- 172.21.15.7:0/3655779243 >> 172.21.15.7:0/3655779243 conn(0x5602cb4dc8d0 msgr2=0x5602cb4dba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 -- 172.21.15.7:0/3655779243 shutdown_connections 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.539+0000 7f3994257740 1 -- 172.21.15.7:0/3655779243 wait complete. 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 -- start start 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 Processor -- start 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1b6c20 con 0x5602cb4e0ce0 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1b6550 con 0x5602cb4eb5a0 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1b3790 con 0x5602cb4e03c0 2024-04-23T14:54:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.540+0000 7f3994257740 10 client.0 _ll_register_callbacks cb 0x7f39840093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39264/0 (socket says 172.21.15.7:39264) 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 -- 172.21.15.7:0/3776368002 learned_addr learned my addr 172.21.15.7:0/3776368002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f398a800640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 -- 172.21.15.7:0/3776368002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 msgr2=0x5602cb4f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f398b200640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 -- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 msgr2=0x5602cb4ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ef3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 -- 172.21.15.7:0/3776368002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602cb225620 con 0x5602cb4e0ce0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f398a800640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f3989e00640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eeda0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f39780e2040 tx=0x7f39780d91a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f88a196884463e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.541+0000 7f396be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f396be00640 1 -- 172.21.15.7:0/3776368002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397809c5d0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f396be00640 1 -- 172.21.15.7:0/3776368002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f397809af70 con 0x5602cb4e0ce0 2024-04-23T14:54:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5602cb3ca4b0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f396be00640 1 -- 172.21.15.7:0/3776368002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f397809c7b0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f3994257740 10 client.15873 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5602cb561bd0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.542+0000 7f396be00640 1 -- 172.21.15.7:0/3776368002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5602cb3ca4b0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f396be00640 1 -- 172.21.15.7:0/3776368002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f39780992e0 con 0x5602cb4e0ce0 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f3994257740 10 client.15873 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f3994257740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f3994257740 20 client.15873 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f3994257740 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb561bd0 0x5602cb563fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f3994257740 4 client.15873 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602cb417310 con 0x5602cb561bd0 2024-04-23T14:54:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.543+0000 7f398a800640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb561bd0 0x5602cb563fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.544+0000 7f398a800640 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb561bd0 0x5602cb563fc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=108b4d2d90c2ea46 server_cookie=3ebac97337151988 in_seq=0 out_seq=0 2024-04-23T14:54:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.544+0000 7f396be00640 10 client.15873 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.583+0000 7f396be00640 1 -- 172.21.15.7:0/3776368002 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602cb417310 con 0x5602cb561bd0 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.583+0000 7f396be00640 10 client.15873 handle_command_reply: tid=0 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.583+0000 7f3994257740 1 client.15873 shutdown 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 msgr2=0x5602cb4eeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eeda0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f39780e2040 tx=0x7f39780d91a0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 shutdown_connections 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5602cb561bd0 0x5602cb563fc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602cb4eb5a0 0x5602cb4ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5602cb4e0ce0 0x5602cb4eeda0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 --2- 172.21.15.7:0/3776368002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5602cb4e03c0 0x5602cb4f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f396be00640 0 client.15873 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 >> 172.21.15.7:0/3776368002 conn(0x5602cb4dc8d0 msgr2=0x5602cb4e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 shutdown_connections 2024-04-23T14:54:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 1 -- 172.21.15.7:0/3776368002 wait complete. 2024-04-23T14:54:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.584+0000 7f3994257740 20 client.15873 trim_cache size 0 max 16384 2024-04-23T14:54:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:54:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:54:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:54:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39700a3d10 msgr2=0x7f39700a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39700a3d10 0x7f39700a61d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3984005fd0 tx=0x7f3984009500 comp rx=0 tx=0).stop 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 msgr2=0x7f398c1a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 0x7f398c1a4e20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f397800e9f0 tx=0x7f397800edf0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 shutdown_connections 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39700a3d10 0x7f39700a61d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f398c10e4d0 0x7f398c19ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f398c108ec0 0x7f398c1a4e20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 --2- 172.21.15.7:0/1980898411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f398c108540 0x7f398c1a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 >> 172.21.15.7:0/1980898411 conn(0x7f398c077de0 msgr2=0x7f398c078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 shutdown_connections 2024-04-23T14:54:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:16.585+0000 7f3990a00640 1 -- 172.21.15.7:0/1980898411 wait complete. 2024-04-23T14:54:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:17 smithi137 ceph-mon[31694]: pgmap v91: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.3 MiB/s wr, 19 op/s 2024-04-23T14:54:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:17 smithi007 ceph-mon[27906]: pgmap v91: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.3 MiB/s wr, 19 op/s 2024-04-23T14:54:18.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:17 smithi186 ceph-mon[31814]: pgmap v91: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.3 MiB/s wr, 19 op/s 2024-04-23T14:54:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:19 smithi137 ceph-mon[31694]: pgmap v92: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:54:20.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:19 smithi007 ceph-mon[27906]: pgmap v92: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:54:20.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:19 smithi186 ceph-mon[31814]: pgmap v92: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:54:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:21 smithi137 ceph-mon[31694]: pgmap v93: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:54:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:21 smithi007 ceph-mon[27906]: pgmap v93: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:54:22.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:21 smithi186 ceph-mon[31814]: pgmap v93: 129 pgs: 129 active+clean; 121 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:54:23.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:23 smithi137 ceph-mon[31694]: pgmap v94: 129 pgs: 129 active+clean; 145 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T14:54:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:23 smithi007 ceph-mon[27906]: pgmap v94: 129 pgs: 129 active+clean; 145 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T14:54:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:23 smithi186 ceph-mon[31814]: pgmap v94: 129 pgs: 129 active+clean; 145 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T14:54:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:25 smithi137 ceph-mon[31694]: pgmap v95: 129 pgs: 129 active+clean; 145 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-04-23T14:54:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:25 smithi007 ceph-mon[27906]: pgmap v95: 129 pgs: 129 active+clean; 145 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-04-23T14:54:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:25 smithi186 ceph-mon[31814]: pgmap v95: 129 pgs: 129 active+clean; 145 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 14 op/s 2024-04-23T14:54:27.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:27 smithi137 ceph-mon[31694]: pgmap v96: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 19 op/s 2024-04-23T14:54:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:27 smithi007 ceph-mon[27906]: pgmap v96: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 19 op/s 2024-04-23T14:54:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:27 smithi186 ceph-mon[31814]: pgmap v96: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 19 op/s 2024-04-23T14:54:29.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 -- 172.21.15.7:0/2637601234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 msgr2=0x7f413810e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 --2- 172.21.15.7:0/2637601234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f413810e210 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4128009900 tx=0x7f412802a410 comp rx=0 tx=0).stop 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 -- 172.21.15.7:0/2637601234 shutdown_connections 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 --2- 172.21.15.7:0/2637601234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f413810e750 0x7f4138110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 --2- 172.21.15.7:0/2637601234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f413810e210 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 --2- 172.21.15.7:0/2637601234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4138100ba0 0x7f4138100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 -- 172.21.15.7:0/2637601234 >> 172.21.15.7:0/2637601234 conn(0x7f41380fc820 msgr2=0x7f41380fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 -- 172.21.15.7:0/2637601234 shutdown_connections 2024-04-23T14:54:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.769+0000 7f413f200640 1 -- 172.21.15.7:0/2637601234 wait complete. 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.770+0000 7f413f200640 1 Processor -- start 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.770+0000 7f413f200640 1 -- start start 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.770+0000 7f413f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4138100ba0 0x7f41381a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f41381a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f413810e750 0x7f413819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4138114280 con 0x7f4138101550 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4138114100 con 0x7f413810e750 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4138114400 con 0x7f4138100ba0 2024-04-23T14:54:29.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f41381a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f41381a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33526/0 (socket says 172.21.15.7:33526) 2024-04-23T14:54:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413d400640 1 -- 172.21.15.7:0/4186197201 learned_addr learned my addr 172.21.15.7:0/4186197201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413e800640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f413810e750 0x7f413819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413de00640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4138100ba0 0x7f41381a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413d400640 1 -- 172.21.15.7:0/4186197201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4138100ba0 msgr2=0x7f41381a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.771+0000 7f413d400640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4138100ba0 0x7f41381a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f413d400640 1 -- 172.21.15.7:0/4186197201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f413810e750 msgr2=0x7f413819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f413d400640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f413810e750 0x7f413819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f413d400640 1 -- 172.21.15.7:0/4186197201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413819afa0 con 0x7f4138101550 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f413d400640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f41381a0b10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4128005940 tx=0x7f4128004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f4132a00640 1 -- 172.21.15.7:0/4186197201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412803f030 con 0x7f4138101550 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f4132a00640 1 -- 172.21.15.7:0/4186197201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4128003aa0 con 0x7f4138101550 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f4132a00640 1 -- 172.21.15.7:0/4186197201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128035070 con 0x7f4138101550 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413819b230 con 0x7f4138101550 2024-04-23T14:54:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.772+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41381a7370 con 0x7f4138101550 2024-04-23T14:54:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.776+0000 7f4143633740 1 Processor -- start 2024-04-23T14:54:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4132a00640 1 -- 172.21.15.7:0/4186197201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4128042030 con 0x7f4138101550 2024-04-23T14:54:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 -- start start 2024-04-23T14:54:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x5643062296e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x56430623c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x56430623f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56430618f900 con 0x56430623cdb0 2024-04-23T14:54:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564306135f20 con 0x564306229c20 2024-04-23T14:54:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.777+0000 7f4143633740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56430618b8c0 con 0x564306229300 2024-04-23T14:54:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x56430623f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x56430623f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33534/0 (socket says 172.21.15.7:33534) 2024-04-23T14:54:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 -- 172.21.15.7:0/3496098159 learned_addr learned my addr 172.21.15.7:0/3496098159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413de00640 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x56430623c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413e800640 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x5643062296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 -- 172.21.15.7:0/3496098159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 msgr2=0x5643062296e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x5643062296e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 -- 172.21.15.7:0/3496098159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 msgr2=0x56430623c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x56430623c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f413d400640 1 -- 172.21.15.7:0/3496098159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430615ae10 con 0x56430623cdb0 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.778+0000 7f4132a00640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41200a3d90 0x7f41200a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.779+0000 7f413d400640 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x56430623f1a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f41280ee430 tx=0x7f41280f9600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e96fddf5baaf50 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.779+0000 7f4132a00640 1 -- 172.21.15.7:0/4186197201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f41280f1160 con 0x7f4138101550 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.779+0000 7f413e800640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41200a3d90 0x7f41200a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.779+0000 7f4127000640 1 -- 172.21.15.7:0/3496098159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280b8fe0 con 0x56430623cdb0 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.779+0000 7f4127000640 1 -- 172.21.15.7:0/3496098159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4128085e50 con 0x56430623cdb0 2024-04-23T14:54:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.779+0000 7f4127000640 1 -- 172.21.15.7:0/3496098159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280bc6a0 con 0x56430623cdb0 2024-04-23T14:54:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 -- 172.21.15.7:0/3496098159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 msgr2=0x56430623f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x56430623f1a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f41280ee430 tx=0x7f41280f9600 comp rx=0 tx=0).stop 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f413e800640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41200a3d90 0x7f41200a6250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4138102d80 tx=0x7f41340096e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 -- 172.21.15.7:0/3496098159 shutdown_connections 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x56430623c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x56430623f1a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 --2- 172.21.15.7:0/3496098159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x5643062296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 -- 172.21.15.7:0/3496098159 >> 172.21.15.7:0/3496098159 conn(0x5643062258d0 msgr2=0x564306225cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.780+0000 7f4143633740 1 -- 172.21.15.7:0/3496098159 shutdown_connections 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.781+0000 7f4143633740 1 -- 172.21.15.7:0/3496098159 wait complete. 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.781+0000 7f4143633740 1 -- start start 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.781+0000 7f4143633740 1 Processor -- start 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306239d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x56430623a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x56430623a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56430623f740 con 0x564306229c20 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5643061492c0 con 0x564306229300 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56430623f8c0 con 0x56430623cdb0 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f4143633740 10 client.0 _ll_register_callbacks cb 0x564305ea1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.782+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x56430623a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x56430623a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33542/0 (socket says 172.21.15.7:33542) 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 -- 172.21.15.7:0/1218525712 learned_addr learned my addr 172.21.15.7:0/1218525712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413de00640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306239d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413e800640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x56430623a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 -- 172.21.15.7:0/1218525712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 msgr2=0x56430623a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x56430623a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 -- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 msgr2=0x564306239d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306239d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 -- 172.21.15.7:0/1218525712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564306159fd0 con 0x564306229c20 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413de00640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306239d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f413d400640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x56430623a270 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4128032ad0 tx=0x7f4128003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e48d9ec08936495 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.783+0000 7f411b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f411b400640 1 -- 172.21.15.7:0/1218525712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128049070 con 0x564306229c20 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f411b400640 1 -- 172.21.15.7:0/1218525712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f41280ee770 con 0x564306229c20 2024-04-23T14:54:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4128085e50 con 0x564306229c20 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f411b400640 1 -- 172.21.15.7:0/1218525712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f41280bc880 con 0x564306229c20 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f4143633740 10 client.15885 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564305ea2210 con 0x564306229c20 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.784+0000 7f411b400640 1 -- 172.21.15.7:0/1218525712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4128085e50 con 0x564306229c20 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f411b400640 1 -- 172.21.15.7:0/1218525712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f41280bcfa0 con 0x564306229c20 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f4143633740 10 client.15885 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f4143633740 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f4143633740 20 client.15885 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f4143633740 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56430624cb00 0x56430624eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f4143633740 4 client.15885 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.785+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56430619d320 con 0x56430624cb00 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.786+0000 7f413de00640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56430624cb00 0x56430624eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.787+0000 7f413de00640 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56430624cb00 0x56430624eef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb3c37eb90090d88 server_cookie=4d5ca49745022e99 in_seq=0 out_seq=0 2024-04-23T14:54:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.787+0000 7f411b400640 10 client.15885 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.788+0000 7f411b400640 1 -- 172.21.15.7:0/1218525712 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56430619d320 con 0x56430624cb00 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.788+0000 7f411b400640 10 client.15885 handle_command_reply: tid=0 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.788+0000 7f4143633740 1 client.15885 shutdown 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 msgr2=0x56430623a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x56430623a270 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4128032ad0 tx=0x7f4128003e80 comp rx=0 tx=0).stop 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 shutdown_connections 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56430624cb00 0x56430624eef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x56430623a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x56430623a270 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 --2- 172.21.15.7:0/1218525712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306239d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 >> 172.21.15.7:0/1218525712 conn(0x5643062258d0 msgr2=0x56430622b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f411b400640 0 client.15885 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 shutdown_connections 2024-04-23T14:54:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 1 -- 172.21.15.7:0/1218525712 wait complete. 2024-04-23T14:54:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.789+0000 7f4143633740 20 client.15885 trim_cache size 0 max 16384 2024-04-23T14:54:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 Processor -- start 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 -- start start 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x564306248600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x5643062546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x564306254c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41381ad020 con 0x56430623cdb0 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41381aec20 con 0x564306229c20 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.809+0000 7f4143633740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41381ad6f0 con 0x564306229300 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x564306254c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x564306254c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33544/0 (socket says 172.21.15.7:33544) 2024-04-23T14:54:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413e800640 1 -- 172.21.15.7:0/3618639520 learned_addr learned my addr 172.21.15.7:0/3618639520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413d400640 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x5643062546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413de00640 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x564306248600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413e800640 1 -- 172.21.15.7:0/3618639520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 msgr2=0x564306248600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413e800640 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x564306248600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.810+0000 7f413e800640 1 -- 172.21.15.7:0/3618639520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 msgr2=0x5643062546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f413e800640 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x5643062546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f413e800640 1 -- 172.21.15.7:0/3618639520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564305f6e620 con 0x56430623cdb0 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f413d400640 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x5643062546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f413e800640 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x564306254c30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f413401f490 tx=0x7f4134015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609b8170003165b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f4126600640 1 -- 172.21.15.7:0/3618639520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41340206c0 con 0x56430623cdb0 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f4126600640 1 -- 172.21.15.7:0/3618639520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4134024070 con 0x56430623cdb0 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.811+0000 7f4126600640 1 -- 172.21.15.7:0/3618639520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4134029c30 con 0x56430623cdb0 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 -- 172.21.15.7:0/3618639520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 msgr2=0x564306254c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x564306254c30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f413401f490 tx=0x7f4134015000 comp rx=0 tx=0).stop 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 -- 172.21.15.7:0/3618639520 shutdown_connections 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229c20 0x5643062546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56430623cdb0 0x564306254c30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 --2- 172.21.15.7:0/3618639520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564306229300 0x564306248600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.812+0000 7f4143633740 1 -- 172.21.15.7:0/3618639520 >> 172.21.15.7:0/3618639520 conn(0x5643062258d0 msgr2=0x56430623a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.813+0000 7f4143633740 1 -- 172.21.15.7:0/3618639520 shutdown_connections 2024-04-23T14:54:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.813+0000 7f4143633740 1 -- 172.21.15.7:0/3618639520 wait complete. 2024-04-23T14:54:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.813+0000 7f4143633740 1 -- start start 2024-04-23T14:54:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.813+0000 7f4143633740 1 Processor -- start 2024-04-23T14:54:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306244fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x564306236750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x564306236cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41381ae490 con 0x564306229c20 2024-04-23T14:54:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41381addc0 con 0x564306229300 2024-04-23T14:54:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41381ab000 con 0x56430623cdb0 2024-04-23T14:54:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f4143633740 10 client.0 _ll_register_callbacks cb 0x7f412c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x564306236750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f413d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x564306236750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33552/0 (socket says 172.21.15.7:33552) 2024-04-23T14:54:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f413d400640 1 -- 172.21.15.7:0/2374304822 learned_addr learned my addr 172.21.15.7:0/2374304822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.814+0000 7f413de00640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306244fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413e800640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x564306236cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413d400640 1 -- 172.21.15.7:0/2374304822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 msgr2=0x564306236cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413d400640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x564306236cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413d400640 1 -- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 msgr2=0x564306244fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413d400640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306244fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413d400640 1 -- 172.21.15.7:0/2374304822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564306237520 con 0x564306229c20 2024-04-23T14:54:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f413d400640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x564306236750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f41280bd3a0 tx=0x7f4128005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ada1fb0c1799af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f411b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f411b400640 1 -- 172.21.15.7:0/2374304822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128049070 con 0x564306229c20 2024-04-23T14:54:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f411b400640 1 -- 172.21.15.7:0/2374304822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f41280c5520 con 0x564306229c20 2024-04-23T14:54:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.815+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4134024070 con 0x564306229c20 2024-04-23T14:54:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f411b400640 1 -- 172.21.15.7:0/2374304822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f41280bcb10 con 0x564306229c20 2024-04-23T14:54:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 10 client.15891 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564306237520 con 0x564306229c20 2024-04-23T14:54:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f411b400640 1 -- 172.21.15.7:0/2374304822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4134024070 con 0x564306229c20 2024-04-23T14:54:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f411b400640 1 -- 172.21.15.7:0/2374304822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f41280035f0 con 0x564306229c20 2024-04-23T14:54:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 10 client.15891 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 20 client.15891 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643062b33c0 0x5643062b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 4 client.15891 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:54:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.816+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564306197190 con 0x5643062b33c0 2024-04-23T14:54:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.817+0000 7f413de00640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643062b33c0 0x5643062b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.818+0000 7f413de00640 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643062b33c0 0x5643062b57e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821d4d571b0e3128 server_cookie=15f1d00e955de7da in_seq=0 out_seq=0 2024-04-23T14:54:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.818+0000 7f411b400640 10 client.15891 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.852+0000 7f411b400640 1 -- 172.21.15.7:0/2374304822 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564306197190 con 0x5643062b33c0 2024-04-23T14:54:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f411b400640 10 client.15891 handle_command_reply: tid=0 2024-04-23T14:54:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 client.15891 shutdown 2024-04-23T14:54:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 msgr2=0x564306236750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x564306236750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f41280bd3a0 tx=0x7f4128005b50 comp rx=0 tx=0).stop 2024-04-23T14:54:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 shutdown_connections 2024-04-23T14:54:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643062b33c0 0x5643062b57e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56430623cdb0 0x564306236cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564306229c20 0x564306236750 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 --2- 172.21.15.7:0/2374304822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564306229300 0x564306244fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f411b400640 0 client.15891 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 >> 172.21.15.7:0/2374304822 conn(0x5643062258d0 msgr2=0x564306224200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 shutdown_connections 2024-04-23T14:54:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 1 -- 172.21.15.7:0/2374304822 wait complete. 2024-04-23T14:54:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.853+0000 7f4143633740 20 client.15891 trim_cache size 0 max 16384 2024-04-23T14:54:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:54:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:54:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:54:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:54:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.854+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41200a3d90 msgr2=0x7f41200a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.854+0000 7f413f200640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41200a3d90 0x7f41200a6250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4138102d80 tx=0x7f41340096e0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.854+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 msgr2=0x7f41381a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.854+0000 7f413f200640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f41381a0b10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4128005940 tx=0x7f4128004270 comp rx=0 tx=0).stop 2024-04-23T14:54:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 shutdown_connections 2024-04-23T14:54:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41200a3d90 0x7f41200a6250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f413810e750 0x7f413819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4138101550 0x7f41381a0b10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 --2- 172.21.15.7:0/4186197201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4138100ba0 0x7f41381a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 >> 172.21.15.7:0/4186197201 conn(0x7f41380fc820 msgr2=0x7f41380fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 shutdown_connections 2024-04-23T14:54:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:29.855+0000 7f413f200640 1 -- 172.21.15.7:0/4186197201 wait complete. 2024-04-23T14:54:29.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:29 smithi137 ceph-mon[31694]: pgmap v97: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:29 smithi007 ceph-mon[27906]: pgmap v97: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:30.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:29 smithi186 ceph-mon[31814]: pgmap v97: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:30.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:30 smithi137 ceph-mon[31694]: pgmap v98: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:31.015 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:30 smithi186 ceph-mon[31814]: pgmap v98: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:30 smithi007 ceph-mon[27906]: pgmap v98: 129 pgs: 129 active+clean; 169 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:33.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:33 smithi137 ceph-mon[31694]: pgmap v99: 129 pgs: 129 active+clean; 189 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T14:54:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:33 smithi007 ceph-mon[27906]: pgmap v99: 129 pgs: 129 active+clean; 189 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T14:54:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:33 smithi186 ceph-mon[31814]: pgmap v99: 129 pgs: 129 active+clean; 189 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T14:54:34.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:34 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:34 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:34.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:34 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:35.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:35 smithi137 ceph-mon[31694]: pgmap v100: 129 pgs: 129 active+clean; 189 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T14:54:35.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:35 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:35.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:35 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:35.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:35 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:54:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:35 smithi007 ceph-mon[27906]: pgmap v100: 129 pgs: 129 active+clean; 189 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T14:54:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:35 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:35 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:35 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:54:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:35 smithi186 ceph-mon[31814]: pgmap v100: 129 pgs: 129 active+clean; 189 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T14:54:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:35 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:35 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:35 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:54:37.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:37 smithi007 ceph-mon[27906]: pgmap v101: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:37.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:37 smithi137 ceph-mon[31694]: pgmap v101: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:37 smithi186 ceph-mon[31814]: pgmap v101: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:39.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:39 smithi137 ceph-mon[31694]: pgmap v102: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:39 smithi007 ceph-mon[27906]: pgmap v102: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:39.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:39 smithi186 ceph-mon[31814]: pgmap v102: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:41.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:41 smithi137 ceph-mon[31694]: pgmap v103: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:41 smithi007 ceph-mon[27906]: pgmap v103: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:41 smithi186 ceph-mon[31814]: pgmap v103: 129 pgs: 129 active+clean; 217 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.022+0000 7f6a0ee00640 1 -- 172.21.15.7:0/3276825403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08102070 msgr2=0x7f6a08102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.022+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/3276825403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08102070 0x7f6a08102450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009900 tx=0x7f69fc02a3f0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 -- 172.21.15.7:0/3276825403 shutdown_connections 2024-04-23T14:54:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/3276825403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 0x7f6a0810ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/3276825403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a08102a20 0x7f6a08106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/3276825403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08102070 0x7f6a08102450 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 -- 172.21.15.7:0/3276825403 >> 172.21.15.7:0/3276825403 conn(0x7f6a080fd950 msgr2=0x7f6a080ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 -- 172.21.15.7:0/3276825403 shutdown_connections 2024-04-23T14:54:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.023+0000 7f6a0ee00640 1 -- 172.21.15.7:0/3276825403 wait complete. 2024-04-23T14:54:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.024+0000 7f6a0ee00640 1 Processor -- start 2024-04-23T14:54:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.024+0000 7f6a0ee00640 1 -- start start 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0ee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a08102070 0x7f6a081a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 0x7f6a081a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 0x7f6a0819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081120f0 con 0x7f6a0819a670 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08111f70 con 0x7f6a08107140 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0ee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08112270 con 0x7f6a08102070 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 0x7f6a0819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 0x7f6a0819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50122/0 (socket says 172.21.15.7:50122) 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0e400640 1 -- 172.21.15.7:0/737490422 learned_addr learned my addr 172.21.15.7:0/737490422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0d000640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 0x7f6a081a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.025+0000 7f6a0da00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a08102070 0x7f6a081a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0e400640 1 -- 172.21.15.7:0/737490422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a08102070 msgr2=0x7f6a081a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0e400640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a08102070 0x7f6a081a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0e400640 1 -- 172.21.15.7:0/737490422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 msgr2=0x7f6a081a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0e400640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 0x7f6a081a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0e400640 1 -- 172.21.15.7:0/737490422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0819b270 con 0x7f6a0819a670 2024-04-23T14:54:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0d000640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 0x7f6a081a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0e400640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 0x7f6a0819aaf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009fd0 tx=0x7f6a0000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a06000640 1 -- 172.21.15.7:0/737490422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00017070 con 0x7f6a0819a670 2024-04-23T14:54:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a06000640 1 -- 172.21.15.7:0/737490422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a00003e20 con 0x7f6a0819a670 2024-04-23T14:54:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a06000640 1 -- 172.21.15.7:0/737490422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00010460 con 0x7f6a0819a670 2024-04-23T14:54:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.026+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a081a7350 con 0x7f6a0819a670 2024-04-23T14:54:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.027+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a081a7700 con 0x7f6a0819a670 2024-04-23T14:54:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 Processor -- start 2024-04-23T14:54:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a06000640 1 -- 172.21.15.7:0/737490422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6a00003970 con 0x7f6a0819a670 2024-04-23T14:54:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 -- start start 2024-04-23T14:54:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae486fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae491870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae491db0 0x558cae4941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558cae3e4900 con 0x558cae4874f0 2024-04-23T14:54:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558cae38af20 con 0x558cae486bd0 2024-04-23T14:54:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.031+0000 7f6a131c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558cae3e08c0 con 0x558cae491db0 2024-04-23T14:54:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.032+0000 7f6a0da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae491870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.032+0000 7f6a0da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae491870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50126/0 (socket says 172.21.15.7:50126) 2024-04-23T14:54:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.032+0000 7f6a0da00640 1 -- 172.21.15.7:0/4280167367 learned_addr learned my addr 172.21.15.7:0/4280167367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.032+0000 7f6a0d000640 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae486fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.032+0000 7f6a0d000640 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae491db0 0x558cae4941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.032+0000 7f6a0da00640 1 -- 172.21.15.7:0/4280167367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae491db0 msgr2=0x558cae4941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae491db0 0x558cae4941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0da00640 1 -- 172.21.15.7:0/4280167367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 msgr2=0x558cae486fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae486fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0da00640 1 -- 172.21.15.7:0/4280167367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cae3afe10 con 0x558cae4874f0 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0d000640 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae491db0 0x558cae4941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a06000640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f69f00a3d90 0x7f69f00a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a06000640 1 -- 172.21.15.7:0/737490422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6a000d0990 con 0x7f6a0819a670 2024-04-23T14:54:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae491870 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009900 tx=0x7f69fc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8869fe73abdaff5b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f6a0d000640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f69f00a3d90 0x7f69f00a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.033+0000 7f69faa00640 1 -- 172.21.15.7:0/4280167367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc035030 con 0x558cae4874f0 2024-04-23T14:54:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.034+0000 7f69faa00640 1 -- 172.21.15.7:0/4280167367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69fc0044b0 con 0x558cae4874f0 2024-04-23T14:54:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.034+0000 7f69faa00640 1 -- 172.21.15.7:0/4280167367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0035f0 con 0x558cae4874f0 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 -- 172.21.15.7:0/4280167367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 msgr2=0x558cae491870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae491870 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009900 tx=0x7f69fc0040c0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a0d000640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f69f00a3d90 0x7f69f00a6250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x558cae484500 tx=0x7f69f4014040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 -- 172.21.15.7:0/4280167367 shutdown_connections 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae491db0 0x558cae4941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae491870 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4280167367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae486fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 -- 172.21.15.7:0/4280167367 >> 172.21.15.7:0/4280167367 conn(0x558cae4830e0 msgr2=0x558cae4834c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 -- 172.21.15.7:0/4280167367 shutdown_connections 2024-04-23T14:54:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.035+0000 7f6a131c4740 1 -- 172.21.15.7:0/4280167367 wait complete. 2024-04-23T14:54:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.036+0000 7f6a131c4740 1 -- start start 2024-04-23T14:54:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.036+0000 7f6a131c4740 1 Processor -- start 2024-04-23T14:54:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.036+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 0x558cae48ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.036+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.036+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae48f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.036+0000 7f6a131c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558cae494980 con 0x558cae486bd0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a131c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558cae39e2c0 con 0x558cae491db0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a131c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558cae494b00 con 0x558cae4874f0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a131c4740 10 client.0 _ll_register_callbacks cb 0x558cae0f6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 0x558cae48ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 0x558cae48ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50142/0 (socket says 172.21.15.7:50142) 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 -- 172.21.15.7:0/646428820 learned_addr learned my addr 172.21.15.7:0/646428820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0d000640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0e400640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae48f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 -- 172.21.15.7:0/646428820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 msgr2=0x558cae48f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 -- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 msgr2=0x558cae48f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae48f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.037+0000 7f6a0da00640 1 -- 172.21.15.7:0/646428820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cae3aefd0 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f6a0da00640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 0x558cae48ed30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69fc02a9e0 tx=0x7f69fc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae28a0bea202b266 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f69ef400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f69ef400640 1 -- 172.21.15.7:0/646428820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc035070 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f69ef400640 1 -- 172.21.15.7:0/646428820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f69fc003e20 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69fc0044b0 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f69ef400640 1 -- 172.21.15.7:0/646428820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69fc058050 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f6a131c4740 10 client.15903 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.038+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558cae0f7210 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f69ef400640 1 -- 172.21.15.7:0/646428820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69fc0044b0 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f69ef400640 1 -- 172.21.15.7:0/646428820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f69fc0317a0 con 0x558cae486bd0 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f6a131c4740 10 client.15903 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f6a131c4740 10 client.15903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f6a131c4740 20 client.15903 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f6a131c4740 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae4a1d80 0x558cae4a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f6a131c4740 4 client.15903 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:54:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.039+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cae3f2320 con 0x558cae4a1d80 2024-04-23T14:54:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.040+0000 7f6a0d000640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae4a1d80 0x558cae4a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.041+0000 7f6a0d000640 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae4a1d80 0x558cae4a4170 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56bfb4a92d18080 server_cookie=7d114a187febbd1d in_seq=0 out_seq=0 2024-04-23T14:54:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.041+0000 7f69ef400640 10 client.15903 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f69ef400640 1 -- 172.21.15.7:0/646428820 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558cae3f2320 con 0x558cae4a1d80 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f69ef400640 10 client.15903 handle_command_reply: tid=0 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 client.15903 shutdown 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 msgr2=0x558cae48ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 0x558cae48ed30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69fc02a9e0 tx=0x7f69fc003820 comp rx=0 tx=0).stop 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 shutdown_connections 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae4a1d80 0x558cae4a4170 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae48f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 --2- 172.21.15.7:0/646428820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae486bd0 0x558cae48ed30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 >> 172.21.15.7:0/646428820 conn(0x558cae4830e0 msgr2=0x558cae479a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.043+0000 7f69ef400640 0 client.15903 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.044+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 shutdown_connections 2024-04-23T14:54:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.044+0000 7f6a131c4740 1 -- 172.21.15.7:0/646428820 wait complete. 2024-04-23T14:54:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.044+0000 7f6a131c4740 20 client.15903 trim_cache size 0 max 16384 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.060+0000 7f6a131c4740 1 Processor -- start 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.060+0000 7f6a131c4740 1 -- start start 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.060+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae486bd0 0x558cae49d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae479910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae4a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a131c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081acf10 con 0x558cae4874f0 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a131c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081aeb10 con 0x558cae491db0 2024-04-23T14:54:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a131c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081ad5e0 con 0x558cae486bd0 2024-04-23T14:54:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a0d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae479910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a0d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae479910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50154/0 (socket says 172.21.15.7:50154) 2024-04-23T14:54:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a0d000640 1 -- 172.21.15.7:0/1123172359 learned_addr learned my addr 172.21.15.7:0/1123172359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a0e400640 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae4a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.061+0000 7f6a0da00640 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae486bd0 0x558cae49d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.062+0000 7f6a0d000640 1 -- 172.21.15.7:0/1123172359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae486bd0 msgr2=0x558cae49d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.062+0000 7f6a0d000640 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae486bd0 0x558cae49d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.062+0000 7f6a0d000640 1 -- 172.21.15.7:0/1123172359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 msgr2=0x558cae4a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.062+0000 7f6a0d000640 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae4a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.062+0000 7f6a0d000640 1 -- 172.21.15.7:0/1123172359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cae1c3620 con 0x558cae4874f0 2024-04-23T14:54:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.062+0000 7f6a0d000640 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae479910 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x558cae484270 tx=0x7f69f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a5eab7dd1685f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.063+0000 7f69fa000640 1 -- 172.21.15.7:0/1123172359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4018030 con 0x558cae4874f0 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.063+0000 7f69fa000640 1 -- 172.21.15.7:0/1123172359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69f401a050 con 0x558cae4874f0 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.063+0000 7f69fa000640 1 -- 172.21.15.7:0/1123172359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40054e0 con 0x558cae4874f0 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 -- 172.21.15.7:0/1123172359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 msgr2=0x558cae479910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae479910 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x558cae484270 tx=0x7f69f40046c0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 -- 172.21.15.7:0/1123172359 shutdown_connections 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae491db0 0x558cae4a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae4874f0 0x558cae479910 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 --2- 172.21.15.7:0/1123172359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae486bd0 0x558cae49d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 -- 172.21.15.7:0/1123172359 >> 172.21.15.7:0/1123172359 conn(0x558cae4830e0 msgr2=0x558cae479200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 -- 172.21.15.7:0/1123172359 shutdown_connections 2024-04-23T14:54:43.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 -- 172.21.15.7:0/1123172359 wait complete. 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.064+0000 7f6a131c4740 1 -- start start 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 Processor -- start 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae49a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 0x558cae48bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081ae380 con 0x558cae491db0 2024-04-23T14:54:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081adcb0 con 0x558cae486bd0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081aaef0 con 0x558cae4874f0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a131c4740 10 client.0 _ll_register_callbacks cb 0x7f69fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a0e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 0x558cae48bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a0e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 0x558cae48bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50170/0 (socket says 172.21.15.7:50170) 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.065+0000 7f6a0e400640 1 -- 172.21.15.7:0/4109238464 learned_addr learned my addr 172.21.15.7:0/4109238464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae49a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0d000640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0e400640 1 -- 172.21.15.7:0/4109238464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 msgr2=0x558cae48b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0e400640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0e400640 1 -- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 msgr2=0x558cae49a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0e400640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae49a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0e400640 1 -- 172.21.15.7:0/4109238464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cae48c440 con 0x558cae491db0 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae49a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a0e400640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 0x558cae48bc10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6a000989d0 tx=0x7f6a0009bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6084f5a6f024e0e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f69ef400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f69ef400640 1 -- 172.21.15.7:0/4109238464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00020040 con 0x558cae491db0 2024-04-23T14:54:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f69ef400640 1 -- 172.21.15.7:0/4109238464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6a00098be0 con 0x558cae491db0 2024-04-23T14:54:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.066+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69f401a050 con 0x558cae491db0 2024-04-23T14:54:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f69ef400640 1 -- 172.21.15.7:0/4109238464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6a000a0920 con 0x558cae491db0 2024-04-23T14:54:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 10 client.15909 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558cae508150 con 0x558cae491db0 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f69ef400640 1 -- 172.21.15.7:0/4109238464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69f401a050 con 0x558cae491db0 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f69ef400640 1 -- 172.21.15.7:0/4109238464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6a00004b20 con 0x558cae491db0 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 10 client.15909 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 20 client.15909 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae508960 0x558cae50ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 4 client.15909 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.067+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558cae3ec190 con 0x558cae508960 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.068+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae508960 0x558cae50ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.069+0000 7f6a0da00640 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae508960 0x558cae50ad80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b14d4b45cde26b2 server_cookie=993f640e3c88c06e in_seq=0 out_seq=0 2024-04-23T14:54:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.069+0000 7f69ef400640 10 client.15909 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f69ef400640 1 -- 172.21.15.7:0/4109238464 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558cae3ec190 con 0x558cae508960 2024-04-23T14:54:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f69ef400640 10 client.15909 handle_command_reply: tid=0 2024-04-23T14:54:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 client.15909 shutdown 2024-04-23T14:54:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 msgr2=0x558cae48bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 0x558cae48bc10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6a000989d0 tx=0x7f6a0009bf90 comp rx=0 tx=0).stop 2024-04-23T14:54:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 shutdown_connections 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558cae508960 0x558cae50ad80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558cae491db0 0x558cae48bc10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f69ef400640 0 client.15909 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cae4874f0 0x558cae48b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 --2- 172.21.15.7:0/4109238464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558cae486bd0 0x558cae49a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.102+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 >> 172.21.15.7:0/4109238464 conn(0x558cae4830e0 msgr2=0x558cae479a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.103+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 shutdown_connections 2024-04-23T14:54:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.103+0000 7f6a131c4740 1 -- 172.21.15.7:0/4109238464 wait complete. 2024-04-23T14:54:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.103+0000 7f6a131c4740 20 client.15909 trim_cache size 0 max 16384 2024-04-23T14:54:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:54:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:54:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:54:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f69f00a3d90 msgr2=0x7f69f00a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f69f00a3d90 0x7f69f00a6250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x558cae484500 tx=0x7f69f4014040 comp rx=0 tx=0).stop 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 msgr2=0x7f6a0819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 0x7f6a0819aaf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009fd0 tx=0x7f6a0000b260 comp rx=0 tx=0).stop 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 shutdown_connections 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f69f00a3d90 0x7f69f00a6250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a08107140 0x7f6a081a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0819a670 0x7f6a0819aaf0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 --2- 172.21.15.7:0/737490422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a08102070 0x7f6a081a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 >> 172.21.15.7:0/737490422 conn(0x7f6a080fd950 msgr2=0x7f6a080ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 shutdown_connections 2024-04-23T14:54:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:43.104+0000 7f6a0ee00640 1 -- 172.21.15.7:0/737490422 wait complete. 2024-04-23T14:54:43.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:43 smithi137 ceph-mon[31694]: pgmap v104: 129 pgs: 129 active+clean; 237 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:54:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:43 smithi007 ceph-mon[27906]: pgmap v104: 129 pgs: 129 active+clean; 237 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:54:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:43 smithi186 ceph-mon[31814]: pgmap v104: 129 pgs: 129 active+clean; 237 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:54:45.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:45 smithi137 ceph-mon[31694]: pgmap v105: 129 pgs: 129 active+clean; 237 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:54:45.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:45 smithi007 ceph-mon[27906]: pgmap v105: 129 pgs: 129 active+clean; 237 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:54:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:45 smithi186 ceph-mon[31814]: pgmap v105: 129 pgs: 129 active+clean; 237 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:54:47.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:47 smithi007 ceph-mon[27906]: pgmap v106: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:47 smithi186 ceph-mon[31814]: pgmap v106: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:47 smithi137 ceph-mon[31694]: pgmap v106: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:49.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:49 smithi007 ceph-mon[27906]: pgmap v107: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:54:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:49 smithi186 ceph-mon[31814]: pgmap v107: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:54:49.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:49 smithi137 ceph-mon[31694]: pgmap v107: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:54:51.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:51 smithi007 ceph-mon[27906]: pgmap v108: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:54:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:51 smithi186 ceph-mon[31814]: pgmap v108: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:54:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:51 smithi137 ceph-mon[31694]: pgmap v108: 129 pgs: 129 active+clean; 261 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:54:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:53 smithi007 ceph-mon[27906]: pgmap v109: 129 pgs: 129 active+clean; 285 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:54:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:53 smithi186 ceph-mon[31814]: pgmap v109: 129 pgs: 129 active+clean; 285 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:54:53.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:53 smithi137 ceph-mon[31694]: pgmap v109: 129 pgs: 129 active+clean; 285 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:54:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:55 smithi007 ceph-mon[27906]: pgmap v110: 129 pgs: 129 active+clean; 285 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:55 smithi186 ceph-mon[31814]: pgmap v110: 129 pgs: 129 active+clean; 285 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:55.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:55 smithi137 ceph-mon[31694]: pgmap v110: 129 pgs: 129 active+clean; 285 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:54:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 -- 172.21.15.7:0/909471042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 msgr2=0x7efe2410eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 --2- 172.21.15.7:0/909471042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe2410eef0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009ca0 tx=0x7efe1c02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 -- 172.21.15.7:0/909471042 shutdown_connections 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 --2- 172.21.15.7:0/909471042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe24102c00 0x7efe24106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 --2- 172.21.15.7:0/909471042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe2410eef0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 --2- 172.21.15.7:0/909471042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe24102250 0x7efe24102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 -- 172.21.15.7:0/909471042 >> 172.21.15.7:0/909471042 conn(0x7efe24079490 msgr2=0x7efe240798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 -- 172.21.15.7:0/909471042 shutdown_connections 2024-04-23T14:54:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.264+0000 7efe2b200640 1 -- 172.21.15.7:0/909471042 wait complete. 2024-04-23T14:54:56.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.265+0000 7efe2b200640 1 Processor -- start 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 -- start start 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe24102250 0x7efe24074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe24074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe24074d80 0x7efe241a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe24112270 con 0x7efe24107320 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe241120f0 con 0x7efe24074d80 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.266+0000 7efe2b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efe241123f0 con 0x7efe24102250 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe24074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe24074840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45540/0 (socket says 172.21.15.7:45540) 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 -- 172.21.15.7:0/2445958294 learned_addr learned my addr 172.21.15.7:0/2445958294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:56.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe23e00640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe24102250 0x7efe24074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe29200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe24074d80 0x7efe241a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 -- 172.21.15.7:0/2445958294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe24102250 msgr2=0x7efe24074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe24102250 0x7efe24074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 -- 172.21.15.7:0/2445958294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe24074d80 msgr2=0x7efe241a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe24074d80 0x7efe241a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.267+0000 7efe1be00640 1 -- 172.21.15.7:0/2445958294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe241a6fe0 con 0x7efe24107320 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.268+0000 7efe1be00640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe24074840 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e9c0 tx=0x7efe0c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.268+0000 7efe21600640 1 -- 172.21.15.7:0/2445958294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00cd80 con 0x7efe24107320 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.268+0000 7efe21600640 1 -- 172.21.15.7:0/2445958294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe0c0054d0 con 0x7efe24107320 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.268+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe241a72d0 con 0x7efe24107320 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.268+0000 7efe21600640 1 -- 172.21.15.7:0/2445958294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c010430 con 0x7efe24107320 2024-04-23T14:54:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.268+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241a7820 con 0x7efe24107320 2024-04-23T14:54:56.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.272+0000 7efe2e1de740 1 Processor -- start 2024-04-23T14:54:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.272+0000 7efe2e1de740 1 -- start start 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca3351b0 0x55d0ca335590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca342780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe2e1de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0ca29b900 con 0x55d0ca335ad0 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe2e1de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d0ca241f20 con 0x55d0ca3351b0 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe2e1de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d0ca2978c0 con 0x55d0ca340390 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45552/0 (socket says 172.21.15.7:45552) 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe23e00640 1 -- 172.21.15.7:0/1603874085 learned_addr learned my addr 172.21.15.7:0/1603874085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe21600640 1 -- 172.21.15.7:0/2445958294 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7efe0c004fd0 con 0x7efe24107320 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.273+0000 7efe29200640 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca3351b0 0x55d0ca335590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.274+0000 7efe23e00640 1 -- 172.21.15.7:0/1603874085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 msgr2=0x55d0ca342780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.274+0000 7efe23e00640 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca342780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.274+0000 7efe23e00640 1 -- 172.21.15.7:0/1603874085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca3351b0 msgr2=0x55d0ca335590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.274+0000 7efe23e00640 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca3351b0 0x55d0ca335590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.274+0000 7efe23e00640 1 -- 172.21.15.7:0/1603874085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ca266e10 con 0x55d0ca335ad0 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.274+0000 7efe23e00640 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33fe50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efe14009cf0 tx=0x7efe14011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eb2253e08bfe09 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.275+0000 7efe19600640 1 -- 172.21.15.7:0/1603874085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14004230 con 0x55d0ca335ad0 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.275+0000 7efe19600640 1 -- 172.21.15.7:0/1603874085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe140043d0 con 0x55d0ca335ad0 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.275+0000 7efe19600640 1 -- 172.21.15.7:0/1603874085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140197a0 con 0x55d0ca335ad0 2024-04-23T14:54:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.275+0000 7efe21600640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efe080a3dc0 0x7efe080a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.275+0000 7efe21600640 1 -- 172.21.15.7:0/2445958294 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7efe0c0d0fa0 con 0x7efe24107320 2024-04-23T14:54:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe29200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efe080a3dc0 0x7efe080a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 -- 172.21.15.7:0/1603874085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 msgr2=0x55d0ca33fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33fe50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efe14009cf0 tx=0x7efe14011810 comp rx=0 tx=0).stop 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 -- 172.21.15.7:0/1603874085 shutdown_connections 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca342780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33fe50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 --2- 172.21.15.7:0/1603874085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca3351b0 0x55d0ca335590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 -- 172.21.15.7:0/1603874085 >> 172.21.15.7:0/1603874085 conn(0x55d0ca3316c0 msgr2=0x55d0ca331aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 -- 172.21.15.7:0/1603874085 shutdown_connections 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.276+0000 7efe2e1de740 1 -- 172.21.15.7:0/1603874085 wait complete. 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.277+0000 7efe29200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efe080a3dc0 0x7efe080a6280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe1c031040 tx=0x7efe1c009360 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.277+0000 7efe2e1de740 1 -- start start 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.277+0000 7efe2e1de740 1 Processor -- start 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca3351b0 0x55d0ca33d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d0ca342fc0 con 0x55d0ca335ad0 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d0ca2552c0 con 0x55d0ca340390 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d0ca343140 con 0x55d0ca3351b0 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe2e1de740 10 client.0 _ll_register_callbacks cb 0x55d0c9fada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45566/0 (socket says 172.21.15.7:45566) 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe1be00640 1 -- 172.21.15.7:0/3055030168 learned_addr learned my addr 172.21.15.7:0/3055030168 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe29200640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe23e00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca3351b0 0x55d0ca33d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe1be00640 1 -- 172.21.15.7:0/3055030168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca3351b0 msgr2=0x55d0ca33d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe1be00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca3351b0 0x55d0ca33d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.278+0000 7efe1be00640 1 -- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 msgr2=0x55d0ca33dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe1be00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe1be00640 1 -- 172.21.15.7:0/3055030168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ca265fd0 con 0x55d0ca335ad0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe23e00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca3351b0 0x55d0ca33d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe1be00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33d850 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0ce990 tx=0x7efe0c09ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4588e6ca27ad6250 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe12000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe12000640 1 -- 172.21.15.7:0/3055030168 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c09cbe0 con 0x55d0ca335ad0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe12000640 1 -- 172.21.15.7:0/3055030168 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7efe0c0bd0c0 con 0x55d0ca335ad0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.279+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe140043d0 con 0x55d0ca335ad0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe12000640 1 -- 172.21.15.7:0/3055030168 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efe0c0a0f90 con 0x55d0ca335ad0 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 10 client.15921 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0c9fae210 con 0x55d0ca335ad0 2024-04-23T14:54:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe12000640 1 -- 172.21.15.7:0/3055030168 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe140043d0 con 0x55d0ca335ad0 2024-04-23T14:54:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe12000640 1 -- 172.21.15.7:0/3055030168 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7efe0c0a53c0 con 0x55d0ca335ad0 2024-04-23T14:54:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 10 client.15921 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 20 client.15921 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca350560 0x55d0ca3529b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 4 client.15921 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:54:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.280+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0ca2a9320 con 0x55d0ca350560 2024-04-23T14:54:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.281+0000 7efe23e00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca350560 0x55d0ca3529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.282+0000 7efe23e00640 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca350560 0x55d0ca3529b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb2db0c85caf76d4 server_cookie=de8e0b5904e14780 in_seq=0 out_seq=0 2024-04-23T14:54:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.282+0000 7efe12000640 10 client.15921 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe12000640 1 -- 172.21.15.7:0/3055030168 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0ca2a9320 con 0x55d0ca350560 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe12000640 10 client.15921 handle_command_reply: tid=0 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 client.15921 shutdown 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 msgr2=0x55d0ca33d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33d850 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0ce990 tx=0x7efe0c09ca70 comp rx=0 tx=0).stop 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 shutdown_connections 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca350560 0x55d0ca3529b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.285 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca335ad0 0x55d0ca33d850 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 --2- 172.21.15.7:0/3055030168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca3351b0 0x55d0ca33d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 >> 172.21.15.7:0/3055030168 conn(0x55d0ca3316c0 msgr2=0x55d0ca337440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.284+0000 7efe12000640 0 client.15921 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.285+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 shutdown_connections 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.285+0000 7efe2e1de740 1 -- 172.21.15.7:0/3055030168 wait complete. 2024-04-23T14:54:56.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.285+0000 7efe2e1de740 20 client.15921 trim_cache size 0 max 16384 2024-04-23T14:54:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 Processor -- start 2024-04-23T14:54:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 -- start start 2024-04-23T14:54:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 0x55d0ca34be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca335ad0 0x55d0ca337b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b1400 con 0x55d0ca3351b0 2024-04-23T14:54:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b3000 con 0x55d0ca340390 2024-04-23T14:54:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.302+0000 7efe2e1de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b1ad0 con 0x55d0ca335ad0 2024-04-23T14:54:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 0x55d0ca34be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 0x55d0ca34be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45578/0 (socket says 172.21.15.7:45578) 2024-04-23T14:54:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 -- 172.21.15.7:0/908360617 learned_addr learned my addr 172.21.15.7:0/908360617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe29200640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe1be00640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca335ad0 0x55d0ca337b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 -- 172.21.15.7:0/908360617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca335ad0 msgr2=0x55d0ca337b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca335ad0 0x55d0ca337b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 -- 172.21.15.7:0/908360617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 msgr2=0x55d0ca33d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe23e00640 1 -- 172.21.15.7:0/908360617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ca07a620 con 0x55d0ca3351b0 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe1be00640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca335ad0 0x55d0ca337b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.303+0000 7efe29200640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.304+0000 7efe23e00640 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 0x55d0ca34be80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efe14009cf0 tx=0x7efe14004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849423b6a11b09ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.304+0000 7efe18c00640 1 -- 172.21.15.7:0/908360617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14005270 con 0x55d0ca3351b0 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.304+0000 7efe18c00640 1 -- 172.21.15.7:0/908360617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe14005410 con 0x55d0ca3351b0 2024-04-23T14:54:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.304+0000 7efe18c00640 1 -- 172.21.15.7:0/908360617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14025680 con 0x55d0ca3351b0 2024-04-23T14:54:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 -- 172.21.15.7:0/908360617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 msgr2=0x55d0ca34be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 0x55d0ca34be80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efe14009cf0 tx=0x7efe14004120 comp rx=0 tx=0).stop 2024-04-23T14:54:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 -- 172.21.15.7:0/908360617 shutdown_connections 2024-04-23T14:54:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca340390 0x55d0ca33d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca335ad0 0x55d0ca337b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 --2- 172.21.15.7:0/908360617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca3351b0 0x55d0ca34be80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.305+0000 7efe2e1de740 1 -- 172.21.15.7:0/908360617 >> 172.21.15.7:0/908360617 conn(0x55d0ca3316c0 msgr2=0x55d0ca33d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.306+0000 7efe2e1de740 1 -- 172.21.15.7:0/908360617 shutdown_connections 2024-04-23T14:54:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.306+0000 7efe2e1de740 1 -- 172.21.15.7:0/908360617 wait complete. 2024-04-23T14:54:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.306+0000 7efe2e1de740 1 -- start start 2024-04-23T14:54:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.306+0000 7efe2e1de740 1 Processor -- start 2024-04-23T14:54:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca335ad0 0x55d0ca348720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca3439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 0x55d0ca3443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b2870 con 0x55d0ca343f30 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b21a0 con 0x55d0ca335ad0 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efe241af3e0 con 0x55d0ca340390 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe2e1de740 10 client.0 _ll_register_callbacks cb 0x7efe0c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe29200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 0x55d0ca3443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe29200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 0x55d0ca3443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45588/0 (socket says 172.21.15.7:45588) 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe29200640 1 -- 172.21.15.7:0/4031076511 learned_addr learned my addr 172.21.15.7:0/4031076511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe23e00640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca335ad0 0x55d0ca348720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.307+0000 7efe1be00640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca3439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe29200640 1 -- 172.21.15.7:0/4031076511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 msgr2=0x55d0ca3439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe29200640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca3439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe29200640 1 -- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca335ad0 msgr2=0x55d0ca348720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:54:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe29200640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca335ad0 0x55d0ca348720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe29200640 1 -- 172.21.15.7:0/4031076511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ca3b5bc0 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe1be00640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca3439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe23e00640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca335ad0 0x55d0ca348720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe29200640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 0x55d0ca3443b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efe1c031730 tx=0x7efe1c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5a5ee17caf8d9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe12000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe12000640 1 -- 172.21.15.7:0/4031076511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c057060 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe14005410 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.308+0000 7efe12000640 1 -- 172.21.15.7:0/4031076511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7efe1c0043c0 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe12000640 1 -- 172.21.15.7:0/4031076511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efe1c031820 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 10 client.15927 fetch_fsmap learned FSMap version 30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0ca3b6ed0 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe12000640 1 -- 172.21.15.7:0/4031076511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe14005410 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe12000640 1 -- 172.21.15.7:0/4031076511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7efe1c044040 con 0x55d0ca343f30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 10 client.15927 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:54:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:54:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 20 client.15927 populate_metadata read hostname 'smithi007' 2024-04-23T14:54:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca3b7740 0x55d0ca3b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 4 client.15927 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:54:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.309+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0ca2a3190 con 0x55d0ca3b7740 2024-04-23T14:54:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.310+0000 7efe23e00640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca3b7740 0x55d0ca3b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.311+0000 7efe23e00640 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca3b7740 0x55d0ca3b9b60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b69a424bbc0c7b server_cookie=de66aecb55241df1 in_seq=0 out_seq=0 2024-04-23T14:54:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.311+0000 7efe12000640 10 client.15927 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe12000640 1 -- 172.21.15.7:0/4031076511 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0ca2a3190 con 0x55d0ca3b7740 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe12000640 10 client.15927 handle_command_reply: tid=0 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 client.15927 shutdown 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 msgr2=0x55d0ca3443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 0x55d0ca3443b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efe1c031730 tx=0x7efe1c03f040 comp rx=0 tx=0).stop 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 shutdown_connections 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d0ca3b7740 0x55d0ca3b9b60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d0ca343f30 0x55d0ca3443b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0ca340390 0x55d0ca3439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe12000640 0 client.15927 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 --2- 172.21.15.7:0/4031076511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0ca335ad0 0x55d0ca348720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.340+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 >> 172.21.15.7:0/4031076511 conn(0x55d0ca3316c0 msgr2=0x55d0ca33db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.341+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 shutdown_connections 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.341+0000 7efe2e1de740 1 -- 172.21.15.7:0/4031076511 wait complete. 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.341+0000 7efe2e1de740 20 client.15927 trim_cache size 0 max 16384 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:54:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:54:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efe080a3dc0 msgr2=0x7efe080a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efe080a3dc0 0x7efe080a6280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe1c031040 tx=0x7efe1c009360 comp rx=0 tx=0).stop 2024-04-23T14:54:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 msgr2=0x7efe24074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe24074840 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e9c0 tx=0x7efe0c00ee80 comp rx=0 tx=0).stop 2024-04-23T14:54:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 shutdown_connections 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efe080a3dc0 0x7efe080a6280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe24074d80 0x7efe241a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe24107320 0x7efe24074840 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 --2- 172.21.15.7:0/2445958294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe24102250 0x7efe24074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 >> 172.21.15.7:0/2445958294 conn(0x7efe24079490 msgr2=0x7efe240ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 shutdown_connections 2024-04-23T14:54:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:54:56.342+0000 7efe2b200640 1 -- 172.21.15.7:0/2445958294 wait complete. 2024-04-23T14:54:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:57 smithi007 ceph-mon[27906]: pgmap v111: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:57 smithi186 ceph-mon[31814]: pgmap v111: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:57 smithi137 ceph-mon[31694]: pgmap v111: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:54:59.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:54:59 smithi007 ceph-mon[27906]: pgmap v112: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:54:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:54:59 smithi186 ceph-mon[31814]: pgmap v112: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:54:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:54:59 smithi137 ceph-mon[31694]: pgmap v112: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:55:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:01 smithi007 ceph-mon[27906]: pgmap v113: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:55:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:01 smithi186 ceph-mon[31814]: pgmap v113: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:55:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:01 smithi137 ceph-mon[31694]: pgmap v113: 129 pgs: 129 active+clean; 309 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:55:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:03 smithi007 ceph-mon[27906]: pgmap v114: 129 pgs: 129 active+clean; 337 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 33 op/s 2024-04-23T14:55:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:03 smithi186 ceph-mon[31814]: pgmap v114: 129 pgs: 129 active+clean; 337 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 33 op/s 2024-04-23T14:55:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:03 smithi137 ceph-mon[31694]: pgmap v114: 129 pgs: 129 active+clean; 337 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.3 MiB/s wr, 33 op/s 2024-04-23T14:55:05.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:05 smithi007 ceph-mon[27906]: pgmap v115: 129 pgs: 129 active+clean; 337 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 28 op/s 2024-04-23T14:55:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:05 smithi186 ceph-mon[31814]: pgmap v115: 129 pgs: 129 active+clean; 337 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 28 op/s 2024-04-23T14:55:05.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:05 smithi137 ceph-mon[31694]: pgmap v115: 129 pgs: 129 active+clean; 337 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 28 op/s 2024-04-23T14:55:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:07 smithi007 ceph-mon[27906]: pgmap v116: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:55:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:07 smithi186 ceph-mon[31814]: pgmap v116: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:55:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:07 smithi137 ceph-mon[31694]: pgmap v116: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:55:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 -- 172.21.15.7:0/4052116236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 msgr2=0x7f2704106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 --2- 172.21.15.7:0/4052116236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f2704106640 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009ca0 tx=0x7f26fc02a940 comp rx=0 tx=0).stop 2024-04-23T14:55:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 -- 172.21.15.7:0/4052116236 shutdown_connections 2024-04-23T14:55:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 --2- 172.21.15.7:0/4052116236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f2704106640 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 --2- 172.21.15.7:0/4052116236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27041016d0 0x7f2704105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 --2- 172.21.15.7:0/4052116236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 0x7f2704101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.499+0000 7f2703200640 1 -- 172.21.15.7:0/4052116236 >> 172.21.15.7:0/4052116236 conn(0x7f27040fc820 msgr2=0x7f27040fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.500+0000 7f2703200640 1 -- 172.21.15.7:0/4052116236 shutdown_connections 2024-04-23T14:55:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.500+0000 7f2703200640 1 -- 172.21.15.7:0/4052116236 wait complete. 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.501+0000 7f2703200640 1 Processor -- start 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.501+0000 7f2703200640 1 -- start start 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2703200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 0x7f27041a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2703200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27041016d0 0x7f27041a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2703200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f270419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2703200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27041186b0 con 0x7f27041061b0 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2703200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2704118530 con 0x7f2704100db0 2024-04-23T14:55:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2703200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2704118830 con 0x7f27041016d0 2024-04-23T14:55:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2702800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f270419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2702800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f270419e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47980/0 (socket says 172.21.15.7:47980) 2024-04-23T14:55:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2702800640 1 -- 172.21.15.7:0/1824922537 learned_addr learned my addr 172.21.15.7:0/1824922537 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f2701e00640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 0x7f27041a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.502+0000 7f26fbe00640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27041016d0 0x7f27041a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2702800640 1 -- 172.21.15.7:0/1824922537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27041016d0 msgr2=0x7f27041a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2702800640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27041016d0 0x7f27041a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2702800640 1 -- 172.21.15.7:0/1824922537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 msgr2=0x7f27041a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2702800640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 0x7f27041a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2702800640 1 -- 172.21.15.7:0/1824922537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270419f150 con 0x7f27041061b0 2024-04-23T14:55:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2701e00640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 0x7f27041a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2702800640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f270419e9d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f26fc004af0 tx=0x7f26fc0308e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f26faa00640 1 -- 172.21.15.7:0/1824922537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc034040 con 0x7f27041061b0 2024-04-23T14:55:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f26faa00640 1 -- 172.21.15.7:0/1824922537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26fc02fd10 con 0x7f27041061b0 2024-04-23T14:55:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f26faa00640 1 -- 172.21.15.7:0/1824922537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc004500 con 0x7f27041061b0 2024-04-23T14:55:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.503+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270419f3e0 con 0x7f27041061b0 2024-04-23T14:55:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.504+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27041ab6e0 con 0x7f27041061b0 2024-04-23T14:55:09.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.507+0000 7f270c06f740 1 Processor -- start 2024-04-23T14:55:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f26faa00640 1 -- 172.21.15.7:0/1824922537 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f26fc037020 con 0x7f27041061b0 2024-04-23T14:55:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 -- start start 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff503060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff505990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5586ff45e900 con 0x5586ff5035a0 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5586ff404f20 con 0x5586ff4f8ce0 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.508+0000 7f270c06f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5586ff45a8c0 con 0x5586ff4f83c0 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.509+0000 7f26fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff505990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.509+0000 7f26fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff505990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47982/0 (socket says 172.21.15.7:47982) 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.509+0000 7f26fbe00640 1 -- 172.21.15.7:0/2621444140 learned_addr learned my addr 172.21.15.7:0/2621444140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.509+0000 7f2701e00640 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff503060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.509+0000 7f26fbe00640 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26fbe00640 1 -- 172.21.15.7:0/2621444140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 msgr2=0x5586ff4f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26fbe00640 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26fbe00640 1 -- 172.21.15.7:0/2621444140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 msgr2=0x5586ff503060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26fbe00640 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff503060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26fbe00640 1 -- 172.21.15.7:0/2621444140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ff429e10 con 0x5586ff5035a0 2024-04-23T14:55:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26faa00640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26e80a3d10 0x7f26e80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26fbe00640 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff505990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0126c0 tx=0x7f26ec009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f17cdc8cb31114d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26faa00640 1 -- 172.21.15.7:0/1824922537 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f26fc0f19c0 con 0x7f27041061b0 2024-04-23T14:55:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f2701e00640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26e80a3d10 0x7f26e80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.510+0000 7f26f3400640 1 -- 172.21.15.7:0/2621444140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec012c40 con 0x5586ff5035a0 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.511+0000 7f26f3400640 1 -- 172.21.15.7:0/2621444140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26ec012de0 con 0x5586ff5035a0 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.511+0000 7f26f3400640 1 -- 172.21.15.7:0/2621444140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0035f0 con 0x5586ff5035a0 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.511+0000 7f270c06f740 1 -- 172.21.15.7:0/2621444140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 msgr2=0x5586ff505990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.511+0000 7f270c06f740 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff505990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0126c0 tx=0x7f26ec009700 comp rx=0 tx=0).stop 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.511+0000 7f2701e00640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26e80a3d10 0x7f26e80a61d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5586ff4f9960 tx=0x7f26f4005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 -- 172.21.15.7:0/2621444140 shutdown_connections 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff503060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff505990 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 --2- 172.21.15.7:0/2621444140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 -- 172.21.15.7:0/2621444140 >> 172.21.15.7:0/2621444140 conn(0x5586ff4f48d0 msgr2=0x5586ff4f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 -- 172.21.15.7:0/2621444140 shutdown_connections 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 -- 172.21.15.7:0/2621444140 wait complete. 2024-04-23T14:55:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 -- start start 2024-04-23T14:55:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.512+0000 7f270c06f740 1 Processor -- start 2024-04-23T14:55:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 0x5586ff500690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff500bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff5035a0 0x5586ff501110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5586ff5060e0 con 0x5586ff4f83c0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5586ff4182c0 con 0x5586ff5035a0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5586ff506260 con 0x5586ff4f8ce0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f270c06f740 10 client.0 _ll_register_callbacks cb 0x5586ff170a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f2701e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 0x5586ff500690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f2701e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 0x5586ff500690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47986/0 (socket says 172.21.15.7:47986) 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.513+0000 7f2701e00640 1 -- 172.21.15.7:0/1094725203 learned_addr learned my addr 172.21.15.7:0/1094725203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f26fbe00640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff500bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2702800640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff5035a0 0x5586ff501110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2701e00640 1 -- 172.21.15.7:0/1094725203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 msgr2=0x5586ff500bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2701e00640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff500bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2701e00640 1 -- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff5035a0 msgr2=0x5586ff501110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2701e00640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff5035a0 0x5586ff501110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2701e00640 1 -- 172.21.15.7:0/1094725203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ff428fd0 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2702800640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff5035a0 0x5586ff501110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f2701e00640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 0x5586ff500690 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f26f4013010 tx=0x7f26f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6159276742f0c4df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.514+0000 7f26e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f26e7e00640 1 -- 172.21.15.7:0/1094725203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f401d620 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26ec012de0 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f26e7e00640 1 -- 172.21.15.7:0/1094725203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f26f401d7c0 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f26e7e00640 1 -- 172.21.15.7:0/1094725203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f26f401d9c0 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f270c06f740 10 client.15939 fetch_fsmap learned FSMap version 30 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586ff171210 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.515+0000 7f26e7e00640 1 -- 172.21.15.7:0/1094725203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26ec012de0 con 0x5586ff4f83c0 2024-04-23T14:55:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f26e7e00640 1 -- 172.21.15.7:0/1094725203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f26f4029cb0 con 0x5586ff4f83c0 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f270c06f740 10 client.15939 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f270c06f740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f270c06f740 20 client.15939 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f270c06f740 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff5139f0 0x5586ff515e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f270c06f740 4 client.15939 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586ff46c320 con 0x5586ff5139f0 2024-04-23T14:55:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.516+0000 7f26fbe00640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff5139f0 0x5586ff515e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.517+0000 7f26fbe00640 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff5139f0 0x5586ff515e50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29dbefe42555b224 server_cookie=d195eaf44c946fa6 in_seq=0 out_seq=0 2024-04-23T14:55:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.517+0000 7f26e7e00640 10 client.15939 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.519+0000 7f26e7e00640 1 -- 172.21.15.7:0/1094725203 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5586ff46c320 con 0x5586ff5139f0 2024-04-23T14:55:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.519+0000 7f26e7e00640 10 client.15939 handle_command_reply: tid=0 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.519+0000 7f270c06f740 1 client.15939 shutdown 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.519+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 msgr2=0x5586ff500690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.519+0000 7f270c06f740 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 0x5586ff500690 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f26f4013010 tx=0x7f26f4004730 comp rx=0 tx=0).stop 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 shutdown_connections 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff5139f0 0x5586ff515e50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff5035a0 0x5586ff501110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff500bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f26e7e00640 0 client.15939 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 --2- 172.21.15.7:0/1094725203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff4f83c0 0x5586ff500690 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 >> 172.21.15.7:0/1094725203 conn(0x5586ff4f48d0 msgr2=0x5586ff4fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 shutdown_connections 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 1 -- 172.21.15.7:0/1094725203 wait complete. 2024-04-23T14:55:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.520+0000 7f270c06f740 20 client.15939 trim_cache size 0 max 16384 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.540+0000 7f270c06f740 1 Processor -- start 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.540+0000 7f270c06f740 1 -- start start 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f270c06f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f83c0 0x5586ff50f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f270c06f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f270c06f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff51b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f270c06f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27041b5670 con 0x5586ff5035a0 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f270c06f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27041b7270 con 0x5586ff4f83c0 2024-04-23T14:55:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f270c06f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f27041b5d40 con 0x5586ff4f8ce0 2024-04-23T14:55:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f2702800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff51b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f2702800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff51b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47988/0 (socket says 172.21.15.7:47988) 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f2702800640 1 -- 172.21.15.7:0/4068035328 learned_addr learned my addr 172.21.15.7:0/4068035328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.541+0000 7f26fbe00640 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2701e00640 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f83c0 0x5586ff50f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2702800640 1 -- 172.21.15.7:0/4068035328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 msgr2=0x5586ff4fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2702800640 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2702800640 1 -- 172.21.15.7:0/4068035328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f83c0 msgr2=0x5586ff50f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2702800640 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f83c0 0x5586ff50f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2702800640 1 -- 172.21.15.7:0/4068035328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ff23d620 con 0x5586ff5035a0 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2701e00640 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f83c0 0x5586ff50f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f2702800640 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff51b720 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0bd410 tx=0x7f26fc0bd310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6f47d133ebb960 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f26f2a00640 1 -- 172.21.15.7:0/4068035328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0c1ac0 con 0x5586ff5035a0 2024-04-23T14:55:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f26f2a00640 1 -- 172.21.15.7:0/4068035328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26fc0c6380 con 0x5586ff5035a0 2024-04-23T14:55:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.542+0000 7f26f2a00640 1 -- 172.21.15.7:0/4068035328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0046a0 con 0x5586ff5035a0 2024-04-23T14:55:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 -- 172.21.15.7:0/4068035328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 msgr2=0x5586ff51b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff51b720 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0bd410 tx=0x7f26fc0bd310 comp rx=0 tx=0).stop 2024-04-23T14:55:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 -- 172.21.15.7:0/4068035328 shutdown_connections 2024-04-23T14:55:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff51b720 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 --2- 172.21.15.7:0/4068035328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f83c0 0x5586ff50f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.543+0000 7f270c06f740 1 -- 172.21.15.7:0/4068035328 >> 172.21.15.7:0/4068035328 conn(0x5586ff4f48d0 msgr2=0x5586ff501db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.544+0000 7f270c06f740 1 -- 172.21.15.7:0/4068035328 shutdown_connections 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.544+0000 7f270c06f740 1 -- 172.21.15.7:0/4068035328 wait complete. 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.544+0000 7f270c06f740 1 -- start start 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.544+0000 7f270c06f740 1 Processor -- start 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff4fde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27041b6ae0 con 0x5586ff5035a0 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27041b6410 con 0x5586ff4f8ce0 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f27041b3650 con 0x5586ff4f83c0 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f270c06f740 10 client.0 _ll_register_callbacks cb 0x7f26f4009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff4fde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff4fde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47992/0 (socket says 172.21.15.7:47992) 2024-04-23T14:55:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 -- 172.21.15.7:0/3108271510 learned_addr learned my addr 172.21.15.7:0/3108271510 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f26fbe00640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2701e00640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 -- 172.21.15.7:0/3108271510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 msgr2=0x5586ff4fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 -- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 msgr2=0x5586ff4fd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.545+0000 7f2702800640 1 -- 172.21.15.7:0/3108271510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ff578fe0 con 0x5586ff5035a0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f26fbe00640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f2702800640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff4fde20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0bd6a0 tx=0x7f26fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bff62bf878039 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f26e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f26e7e00640 1 -- 172.21.15.7:0/3108271510 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0ef030 con 0x5586ff5035a0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f26e7e00640 1 -- 172.21.15.7:0/3108271510 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f26fc0c5ef0 con 0x5586ff5035a0 2024-04-23T14:55:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26fc0c6380 con 0x5586ff5035a0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f26e7e00640 1 -- 172.21.15.7:0/3108271510 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f26fc0ef1d0 con 0x5586ff5035a0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f270c06f740 10 client.15945 fetch_fsmap learned FSMap version 30 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.546+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586ff57a240 con 0x5586ff5035a0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f26e7e00640 1 -- 172.21.15.7:0/3108271510 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26fc0c6380 con 0x5586ff5035a0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f26e7e00640 1 -- 172.21.15.7:0/3108271510 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f26fc02f070 con 0x5586ff5035a0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f270c06f740 10 client.15945 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f270c06f740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f270c06f740 20 client.15945 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f270c06f740 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff57a930 0x5586ff57cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f270c06f740 4 client.15945 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.547+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586ff466190 con 0x5586ff57a930 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.548+0000 7f2701e00640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff57a930 0x5586ff57cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.548+0000 7f2701e00640 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff57a930 0x5586ff57cd50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f10658e0eb549d68 server_cookie=88ab7f10439a425b in_seq=0 out_seq=0 2024-04-23T14:55:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.548+0000 7f26e7e00640 10 client.15945 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f26e7e00640 1 -- 172.21.15.7:0/3108271510 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586ff466190 con 0x5586ff57a930 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f26e7e00640 10 client.15945 handle_command_reply: tid=0 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 client.15945 shutdown 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 msgr2=0x5586ff4fde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff4fde20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0bd6a0 tx=0x7f26fc004040 comp rx=0 tx=0).stop 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 shutdown_connections 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586ff57a930 0x5586ff57cd50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586ff4f8ce0 0x5586ff4fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5586ff5035a0 0x5586ff4fde20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 --2- 172.21.15.7:0/3108271510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586ff4f83c0 0x5586ff4fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 >> 172.21.15.7:0/3108271510 conn(0x5586ff4f48d0 msgr2=0x5586ff50e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.580+0000 7f26e7e00640 0 client.15945 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.581+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 shutdown_connections 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.581+0000 7f270c06f740 1 -- 172.21.15.7:0/3108271510 wait complete. 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.581+0000 7f270c06f740 20 client.15945 trim_cache size 0 max 16384 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:55:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:55:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:55:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26e80a3d10 msgr2=0x7f26e80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26e80a3d10 0x7f26e80a61d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5586ff4f9960 tx=0x7f26f4005f90 comp rx=0 tx=0).stop 2024-04-23T14:55:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 msgr2=0x7f270419e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f270419e9d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f26fc004af0 tx=0x7f26fc0308e0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 shutdown_connections 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26e80a3d10 0x7f26e80a61d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27041061b0 0x7f270419e9d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27041016d0 0x7f27041a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 --2- 172.21.15.7:0/1824922537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2704100db0 0x7f27041a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 >> 172.21.15.7:0/1824922537 conn(0x7f27040fc820 msgr2=0x7f27040fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 shutdown_connections 2024-04-23T14:55:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:09.582+0000 7f2703200640 1 -- 172.21.15.7:0/1824922537 wait complete. 2024-04-23T14:55:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:09 smithi007 ceph-mon[27906]: pgmap v117: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 28 op/s 2024-04-23T14:55:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:09 smithi186 ceph-mon[31814]: pgmap v117: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 28 op/s 2024-04-23T14:55:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:09 smithi137 ceph-mon[31694]: pgmap v117: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 28 op/s 2024-04-23T14:55:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:11 smithi007 ceph-mon[27906]: pgmap v118: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 28 op/s 2024-04-23T14:55:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:11 smithi186 ceph-mon[31814]: pgmap v118: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 28 op/s 2024-04-23T14:55:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:11 smithi137 ceph-mon[31694]: pgmap v118: 129 pgs: 129 active+clean; 357 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 28 op/s 2024-04-23T14:55:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:13 smithi007 ceph-mon[27906]: pgmap v119: 129 pgs: 129 active+clean; 381 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 36 op/s 2024-04-23T14:55:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:13 smithi186 ceph-mon[31814]: pgmap v119: 129 pgs: 129 active+clean; 381 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 36 op/s 2024-04-23T14:55:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:13 smithi137 ceph-mon[31694]: pgmap v119: 129 pgs: 129 active+clean; 381 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 36 op/s 2024-04-23T14:55:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:15 smithi007 ceph-mon[27906]: pgmap v120: 129 pgs: 129 active+clean; 381 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:15.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:15 smithi186 ceph-mon[31814]: pgmap v120: 129 pgs: 129 active+clean; 381 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:15 smithi137 ceph-mon[31694]: pgmap v120: 129 pgs: 129 active+clean; 381 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:17 smithi007 ceph-mon[27906]: pgmap v121: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:17 smithi186 ceph-mon[31814]: pgmap v121: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:17 smithi137 ceph-mon[31694]: pgmap v121: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:19 smithi007 ceph-mon[27906]: pgmap v122: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:19 smithi186 ceph-mon[31814]: pgmap v122: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:19 smithi137 ceph-mon[31694]: pgmap v122: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:21 smithi007 ceph-mon[27906]: pgmap v123: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:21 smithi186 ceph-mon[31814]: pgmap v123: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:21.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:21 smithi137 ceph-mon[31694]: pgmap v123: 129 pgs: 129 active+clean; 405 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 -- 172.21.15.7:0/1230137627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 msgr2=0x7f5be0110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/1230137627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be0110ad0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009ca0 tx=0x7f5bd802a950 comp rx=0 tx=0).stop 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 -- 172.21.15.7:0/1230137627 shutdown_connections 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/1230137627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be0110ad0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/1230137627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5be0074cf0 0x7f5be010e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/1230137627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 0x7f5be00747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 -- 172.21.15.7:0/1230137627 >> 172.21.15.7:0/1230137627 conn(0x7f5be00fd950 msgr2=0x7f5be00ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 -- 172.21.15.7:0/1230137627 shutdown_connections 2024-04-23T14:55:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.741+0000 7f5bdfe00640 1 -- 172.21.15.7:0/1230137627 wait complete. 2024-04-23T14:55:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.743+0000 7f5bdfe00640 1 Processor -- start 2024-04-23T14:55:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.743+0000 7f5bdfe00640 1 -- start start 2024-04-23T14:55:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 0x7f5be01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5be0074cf0 0x7f5be01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0114300 con 0x7f5be010e6c0 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdfe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0114180 con 0x7f5be00743d0 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdfe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0114480 con 0x7f5be0074cf0 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33720/0 (socket says 172.21.15.7:33720) 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdf400640 1 -- 172.21.15.7:0/3038891439 learned_addr learned my addr 172.21.15.7:0/3038891439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.744+0000 7f5bdea00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 0x7f5be01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5be0074cf0 0x7f5be01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdf400640 1 -- 172.21.15.7:0/3038891439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5be0074cf0 msgr2=0x7f5be01a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdf400640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5be0074cf0 0x7f5be01a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdf400640 1 -- 172.21.15.7:0/3038891439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 msgr2=0x7f5be01a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdf400640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 0x7f5be01a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdf400640 1 -- 172.21.15.7:0/3038891439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be019af00 con 0x7f5be010e6c0 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdea00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 0x7f5be01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.745+0000 7f5bdf400640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be019a640 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005e30 tx=0x7f5bd8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.746+0000 7f5bd7400640 1 -- 172.21.15.7:0/3038891439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8034040 con 0x7f5be010e6c0 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.746+0000 7f5bd7400640 1 -- 172.21.15.7:0/3038891439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bd8030850 con 0x7f5be010e6c0 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.746+0000 7f5bd7400640 1 -- 172.21.15.7:0/3038891439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80046c0 con 0x7f5be010e6c0 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.746+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be019b190 con 0x7f5be010e6c0 2024-04-23T14:55:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.746+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01a7500 con 0x7f5be010e6c0 2024-04-23T14:55:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.749+0000 7f5be8593740 1 Processor -- start 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5bd7400640 1 -- 172.21.15.7:0/3038891439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5bd8037020 con 0x7f5be010e6c0 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 -- start start 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd013ce0 0x559bfd01e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 0x559bfd020990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559bfcf79900 con 0x559bfd01e5a0 2024-04-23T14:55:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559bfcf1ff20 con 0x559bfd013ce0 2024-04-23T14:55:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.750+0000 7f5be8593740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559bfcf758c0 con 0x559bfd0133c0 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 0x559bfd020990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 0x559bfd020990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33734/0 (socket says 172.21.15.7:33734) 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 -- 172.21.15.7:0/1163184402 learned_addr learned my addr 172.21.15.7:0/1163184402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bdea00640 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd013ce0 0x559bfd01e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 -- 172.21.15.7:0/1163184402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 msgr2=0x559bfd0137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 -- 172.21.15.7:0/1163184402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd013ce0 msgr2=0x559bfd01e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd013ce0 0x559bfd01e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.751+0000 7f5bd7e00640 1 -- 172.21.15.7:0/1163184402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bfcf44e10 con 0x559bfd01e5a0 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 0x559bfd020990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800cf90 tx=0x7f5bc800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542decb8d56a756c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bd7400640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5bc40a3d90 0x7f5bc40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bd7400640 1 -- 172.21.15.7:0/3038891439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f5bd80f1a70 con 0x7f5be010e6c0 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bcfe00640 1 -- 172.21.15.7:0/1163184402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8011500 con 0x559bfd01e5a0 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bdea00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5bc40a3d90 0x7f5bc40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bcfe00640 1 -- 172.21.15.7:0/1163184402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc8011b50 con 0x559bfd01e5a0 2024-04-23T14:55:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.752+0000 7f5bcfe00640 1 -- 172.21.15.7:0/1163184402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8010a00 con 0x559bfd01e5a0 2024-04-23T14:55:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 -- 172.21.15.7:0/1163184402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 msgr2=0x559bfd020990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 0x559bfd020990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800cf90 tx=0x7f5bc800c450 comp rx=0 tx=0).stop 2024-04-23T14:55:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5bdea00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5bc40a3d90 0x7f5bc40a6250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x559bfd014960 tx=0x7f5bd000b710 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 -- 172.21.15.7:0/1163184402 shutdown_connections 2024-04-23T14:55:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd013ce0 0x559bfd01e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd01e5a0 0x559bfd020990 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 --2- 172.21.15.7:0/1163184402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 -- 172.21.15.7:0/1163184402 >> 172.21.15.7:0/1163184402 conn(0x559bfd00f8d0 msgr2=0x559bfd00fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 -- 172.21.15.7:0/1163184402 shutdown_connections 2024-04-23T14:55:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.753+0000 7f5be8593740 1 -- 172.21.15.7:0/1163184402 wait complete. 2024-04-23T14:55:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.754+0000 7f5be8593740 1 -- start start 2024-04-23T14:55:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.754+0000 7f5be8593740 1 Processor -- start 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd0133c0 0x559bfd01b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd01bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd01e5a0 0x559bfd01c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559bfd0210e0 con 0x559bfd013ce0 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559bfcf332c0 con 0x559bfd0133c0 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559bfd021260 con 0x559bfd01e5a0 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5be8593740 10 client.0 _ll_register_callbacks cb 0x559bfcc8ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd01bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd01bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33746/0 (socket says 172.21.15.7:33746) 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.755+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2865250869 learned_addr learned my addr 172.21.15.7:0/2865250869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bdea00640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd0133c0 0x559bfd01b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bdf400640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd01e5a0 0x559bfd01c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2865250869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd01e5a0 msgr2=0x559bfd01c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd01e5a0 0x559bfd01c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd0133c0 msgr2=0x559bfd01b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd0133c0 0x559bfd01b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2865250869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bfcf43fd0 con 0x559bfd013ce0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd01bac0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8010630 tx=0x7f5bc8010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314ff052a916653a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.756+0000 7f5bccc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5bccc00640 1 -- 172.21.15.7:0/2865250869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8011710 con 0x559bfd013ce0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5bccc00640 1 -- 172.21.15.7:0/2865250869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f5bc8024030 con 0x559bfd013ce0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc8011b50 con 0x559bfd013ce0 2024-04-23T14:55:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5bccc00640 1 -- 172.21.15.7:0/2865250869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5bc8032050 con 0x559bfd013ce0 2024-04-23T14:55:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5be8593740 10 client.15957 fetch_fsmap learned FSMap version 30 2024-04-23T14:55:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559bfcc8c210 con 0x559bfd013ce0 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.757+0000 7f5bccc00640 1 -- 172.21.15.7:0/2865250869 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc8011b50 con 0x559bfd013ce0 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5bccc00640 1 -- 172.21.15.7:0/2865250869 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5bc8027480 con 0x559bfd013ce0 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5be8593740 10 client.15957 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5be8593740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5be8593740 20 client.15957 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5be8593740 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd02e6a0 0x559bfd030a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5be8593740 4 client.15957 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.758+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bfcf87320 con 0x559bfd02e6a0 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.759+0000 7f5bdea00640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd02e6a0 0x559bfd030a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.760+0000 7f5bdea00640 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd02e6a0 0x559bfd030a90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2477a142c21a4d6d server_cookie=20f50e93ed4c563d in_seq=0 out_seq=0 2024-04-23T14:55:22.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.760+0000 7f5bccc00640 10 client.15957 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.761+0000 7f5bccc00640 1 -- 172.21.15.7:0/2865250869 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559bfcf87320 con 0x559bfd02e6a0 2024-04-23T14:55:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.761+0000 7f5bccc00640 10 client.15957 handle_command_reply: tid=0 2024-04-23T14:55:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 client.15957 shutdown 2024-04-23T14:55:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 msgr2=0x559bfd01bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd01bac0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8010630 tx=0x7f5bc8010660 comp rx=0 tx=0).stop 2024-04-23T14:55:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 shutdown_connections 2024-04-23T14:55:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd02e6a0 0x559bfd030a90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd01e5a0 0x559bfd01c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd01bac0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 --2- 172.21.15.7:0/2865250869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd0133c0 0x559bfd01b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 >> 172.21.15.7:0/2865250869 conn(0x559bfd00f8d0 msgr2=0x559bfd015600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5bccc00640 0 client.15957 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 shutdown_connections 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 1 -- 172.21.15.7:0/2865250869 wait complete. 2024-04-23T14:55:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.762+0000 7f5be8593740 20 client.15957 trim_cache size 0 max 16384 2024-04-23T14:55:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.779+0000 7f5be8593740 1 Processor -- start 2024-04-23T14:55:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 -- start start 2024-04-23T14:55:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd01dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd00f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd015d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b1310 con 0x559bfd013ce0 2024-04-23T14:55:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b2f10 con 0x559bfd01e5a0 2024-04-23T14:55:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5be8593740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b19e0 con 0x559bfd0133c0 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd00f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd00f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33758/0 (socket says 172.21.15.7:33758) 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.780+0000 7f5bd7e00640 1 -- 172.21.15.7:0/3808622340 learned_addr learned my addr 172.21.15.7:0/3808622340 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bdea00640 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd01dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bdf400640 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd015d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bd7e00640 1 -- 172.21.15.7:0/3808622340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 msgr2=0x559bfd01dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd01dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bd7e00640 1 -- 172.21.15.7:0/3808622340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 msgr2=0x559bfd015d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd015d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bd7e00640 1 -- 172.21.15.7:0/3808622340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bfcd58620 con 0x559bfd013ce0 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bdf400640 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd015d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:55:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.781+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd00f210 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80058c0 tx=0x7f5bc800c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eed4a9addeece4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.782+0000 7f5bcf400640 1 -- 172.21.15.7:0/3808622340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800ce70 con 0x559bfd013ce0 2024-04-23T14:55:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.782+0000 7f5bcf400640 1 -- 172.21.15.7:0/3808622340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc8027a90 con 0x559bfd013ce0 2024-04-23T14:55:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.782+0000 7f5bcf400640 1 -- 172.21.15.7:0/3808622340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc80051c0 con 0x559bfd013ce0 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.782+0000 7f5be8593740 1 -- 172.21.15.7:0/3808622340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 msgr2=0x559bfd00f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.782+0000 7f5be8593740 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd00f210 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80058c0 tx=0x7f5bc800c6c0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 -- 172.21.15.7:0/3808622340 shutdown_connections 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd015d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd00f210 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 --2- 172.21.15.7:0/3808622340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd01dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 -- 172.21.15.7:0/3808622340 >> 172.21.15.7:0/3808622340 conn(0x559bfd00f8d0 msgr2=0x559bfd01b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 -- 172.21.15.7:0/3808622340 shutdown_connections 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 -- 172.21.15.7:0/3808622340 wait complete. 2024-04-23T14:55:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 -- start start 2024-04-23T14:55:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.783+0000 7f5be8593740 1 Processor -- start 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0265f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd026b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd017c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b2780 con 0x559bfd013ce0 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b20b0 con 0x559bfd01e5a0 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01af2f0 con 0x559bfd0133c0 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5be8593740 10 client.0 _ll_register_callbacks cb 0x7f5bc8013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd026b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd026b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33770/0 (socket says 172.21.15.7:33770) 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.784+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2674081504 learned_addr learned my addr 172.21.15.7:0/2674081504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bdf400640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd017c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bdea00640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2674081504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 msgr2=0x559bfd0265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0265f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 msgr2=0x559bfd017c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd017c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bd7e00640 1 -- 172.21.15.7:0/2674081504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bfd018450 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bd7e00640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd026b30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c610 tx=0x7f5bc8027620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1807dd7efb0c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.785+0000 7f5bccc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5bccc00640 1 -- 172.21.15.7:0/2674081504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8044030 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc8027a90 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5bccc00640 1 -- 172.21.15.7:0/2674081504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f5bc803b040 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5bccc00640 1 -- 172.21.15.7:0/2674081504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5bc804e050 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5be8593740 10 client.15963 fetch_fsmap learned FSMap version 30 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559bfd094510 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5bccc00640 1 -- 172.21.15.7:0/2674081504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc8027a90 con 0x559bfd013ce0 2024-04-23T14:55:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.786+0000 7f5bccc00640 1 -- 172.21.15.7:0/2674081504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5bc803f050 con 0x559bfd013ce0 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5be8593740 10 client.15963 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5be8593740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5be8593740 20 client.15963 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5be8593740 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd094c00 0x559bfd097020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5be8593740 4 client.15963 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559bfcf81190 con 0x559bfd094c00 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.787+0000 7f5bdea00640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd094c00 0x559bfd097020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.788+0000 7f5bdea00640 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd094c00 0x559bfd097020 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d6c32dedf5037e3 server_cookie=a93b7aba5b02693 in_seq=0 out_seq=0 2024-04-23T14:55:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.788+0000 7f5bccc00640 10 client.15963 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5bccc00640 1 -- 172.21.15.7:0/2674081504 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559bfcf81190 con 0x559bfd094c00 2024-04-23T14:55:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5bccc00640 10 client.15963 handle_command_reply: tid=0 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 client.15963 shutdown 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 msgr2=0x559bfd026b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd026b30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c610 tx=0x7f5bc8027620 comp rx=0 tx=0).stop 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 shutdown_connections 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559bfd094c00 0x559bfd097020 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bfd01e5a0 0x559bfd017c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bfd013ce0 0x559bfd026b30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 --2- 172.21.15.7:0/2674081504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559bfd0133c0 0x559bfd0265f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 >> 172.21.15.7:0/2674081504 conn(0x559bfd00f8d0 msgr2=0x559bfd01bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5bccc00640 0 client.15963 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 shutdown_connections 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.814+0000 7f5be8593740 1 -- 172.21.15.7:0/2674081504 wait complete. 2024-04-23T14:55:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.815+0000 7f5be8593740 20 client.15963 trim_cache size 0 max 16384 2024-04-23T14:55:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:55:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:55:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:55:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.815+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5bc40a3d90 msgr2=0x7f5bc40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.815+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5bc40a3d90 0x7f5bc40a6250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x559bfd014960 tx=0x7f5bd000b710 comp rx=0 tx=0).stop 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.815+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 msgr2=0x7f5be019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.815+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be019a640 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005e30 tx=0x7f5bd8003f10 comp rx=0 tx=0).stop 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 shutdown_connections 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5bc40a3d90 0x7f5bc40a6250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be010e6c0 0x7f5be019a640 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5be0074cf0 0x7f5be01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 --2- 172.21.15.7:0/3038891439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5be00743d0 0x7f5be01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 >> 172.21.15.7:0/3038891439 conn(0x7f5be00fd950 msgr2=0x7f5be00fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 shutdown_connections 2024-04-23T14:55:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:22.816+0000 7f5bdfe00640 1 -- 172.21.15.7:0/3038891439 wait complete. 2024-04-23T14:55:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:23 smithi007 ceph-mon[27906]: pgmap v124: 129 pgs: 129 active+clean; 426 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:23 smithi186 ceph-mon[31814]: pgmap v124: 129 pgs: 129 active+clean; 426 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:23 smithi137 ceph-mon[31694]: pgmap v124: 129 pgs: 129 active+clean; 426 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:25 smithi007 ceph-mon[27906]: pgmap v125: 129 pgs: 129 active+clean; 426 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:55:25.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:25 smithi186 ceph-mon[31814]: pgmap v125: 129 pgs: 129 active+clean; 426 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:55:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:25 smithi137 ceph-mon[31694]: pgmap v125: 129 pgs: 129 active+clean; 426 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:55:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:27 smithi007 ceph-mon[27906]: pgmap v126: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:27 smithi186 ceph-mon[31814]: pgmap v126: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:27 smithi137 ceph-mon[31694]: pgmap v126: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:29 smithi007 ceph-mon[27906]: pgmap v127: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:29 smithi186 ceph-mon[31814]: pgmap v127: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:29 smithi137 ceph-mon[31694]: pgmap v127: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:31 smithi007 ceph-mon[27906]: pgmap v128: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:31 smithi186 ceph-mon[31814]: pgmap v128: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:31.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:31 smithi137 ceph-mon[31694]: pgmap v128: 129 pgs: 129 active+clean; 450 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:33 smithi007 ceph-mon[27906]: pgmap v129: 129 pgs: 129 active+clean; 474 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:33 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:55:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:33 smithi186 ceph-mon[31814]: pgmap v129: 129 pgs: 129 active+clean; 474 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:33 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:55:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:33 smithi137 ceph-mon[31694]: pgmap v129: 129 pgs: 129 active+clean; 474 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:33.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:33 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:55:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:35 smithi007 ceph-mon[27906]: pgmap v130: 129 pgs: 129 active+clean; 474 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:55:35.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:35 smithi186 ceph-mon[31814]: pgmap v130: 129 pgs: 129 active+clean; 474 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:55:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:35 smithi137 ceph-mon[31694]: pgmap v130: 129 pgs: 129 active+clean; 474 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.978+0000 7eff3f600640 1 -- 172.21.15.7:0/2055135770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff38104e00 msgr2=0x7eff38108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.978+0000 7eff3f600640 1 --2- 172.21.15.7:0/2055135770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff38104e00 0x7eff38108e40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7eff24009900 tx=0x7eff2402a410 comp rx=0 tx=0).stop 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 -- 172.21.15.7:0/2055135770 shutdown_connections 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 --2- 172.21.15.7:0/2055135770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff38109520 0x7eff381110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 --2- 172.21.15.7:0/2055135770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff38104e00 0x7eff38108e40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 --2- 172.21.15.7:0/2055135770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff38104450 0x7eff38104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 -- 172.21.15.7:0/2055135770 >> 172.21.15.7:0/2055135770 conn(0x7eff380ffcf0 msgr2=0x7eff38102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 -- 172.21.15.7:0/2055135770 shutdown_connections 2024-04-23T14:55:35.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.979+0000 7eff3f600640 1 -- 172.21.15.7:0/2055135770 wait complete. 2024-04-23T14:55:35.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.980+0000 7eff3f600640 1 Processor -- start 2024-04-23T14:55:35.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.980+0000 7eff3f600640 1 -- start start 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.980+0000 7eff3f600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff38104450 0x7eff381a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff38109520 0x7eff381a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 0x7eff3819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3f600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff38114440 con 0x7eff3819a780 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff381142c0 con 0x7eff38109520 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3f600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7eff381145c0 con 0x7eff38104450 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 0x7eff3819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff37e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff38109520 0x7eff381a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff38104450 0x7eff381a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 0x7eff3819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53610/0 (socket says 172.21.15.7:53610) 2024-04-23T14:55:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3d600640 1 -- 172.21.15.7:0/239993690 learned_addr learned my addr 172.21.15.7:0/239993690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3d600640 1 -- 172.21.15.7:0/239993690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff38104450 msgr2=0x7eff381a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.981+0000 7eff3d600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff38104450 0x7eff381a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff3d600640 1 -- 172.21.15.7:0/239993690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff38109520 msgr2=0x7eff381a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff3d600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff38109520 0x7eff381a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff3d600640 1 -- 172.21.15.7:0/239993690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3819b310 con 0x7eff3819a780 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff3d600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 0x7eff3819ac30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7eff3000eaa0 tx=0x7eff3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff35600640 1 -- 172.21.15.7:0/239993690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3000cdb0 con 0x7eff3819a780 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff35600640 1 -- 172.21.15.7:0/239993690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff30005020 con 0x7eff3819a780 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff35600640 1 -- 172.21.15.7:0/239993690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300116d0 con 0x7eff3819a780 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.982+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3819b600 con 0x7eff3819a780 2024-04-23T14:55:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.983+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff381a7760 con 0x7eff3819a780 2024-04-23T14:55:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.987+0000 7eff425e4740 1 Processor -- start 2024-04-23T14:55:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.987+0000 7eff35600640 1 -- 172.21.15.7:0/239993690 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7eff300051d0 con 0x7eff3819a780 2024-04-23T14:55:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.987+0000 7eff425e4740 1 -- start start 2024-04-23T14:55:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.987+0000 7eff425e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b22511b0 0x5654b2251590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.987+0000 7eff425e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b225be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff425e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b225c390 0x5654b225e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff425e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5654b21b7900 con 0x5654b2251ad0 2024-04-23T14:55:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff425e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5654b215df20 con 0x5654b22511b0 2024-04-23T14:55:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff425e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5654b21b38c0 con 0x5654b225c390 2024-04-23T14:55:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b225be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b225be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53614/0 (socket says 172.21.15.7:53614) 2024-04-23T14:55:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff3cc00640 1 -- 172.21.15.7:0/3354748928 learned_addr learned my addr 172.21.15.7:0/3354748928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff37e00640 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b22511b0 0x5654b2251590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff37e00640 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b225c390 0x5654b225e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff3cc00640 1 -- 172.21.15.7:0/3354748928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b225c390 msgr2=0x5654b225e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.988+0000 7eff3cc00640 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b225c390 0x5654b225e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff3cc00640 1 -- 172.21.15.7:0/3354748928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b22511b0 msgr2=0x5654b2251590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff3cc00640 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b22511b0 0x5654b2251590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff3cc00640 1 -- 172.21.15.7:0/3354748928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654b2182e10 con 0x5654b2251ad0 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff37e00640 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b22511b0 0x5654b2251590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff35600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7eff200a3dc0 0x7eff200a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff3cc00640 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b225be50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd10 tx=0x7eff2c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac933f8abc16fbbe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff35600640 1 -- 172.21.15.7:0/239993690 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7eff300d0c30 con 0x7eff3819a780 2024-04-23T14:55:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.989+0000 7eff37e00640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7eff200a3dc0 0x7eff200a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.990+0000 7eff29c00640 1 -- 172.21.15.7:0/3354748928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c004030 con 0x5654b2251ad0 2024-04-23T14:55:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.990+0000 7eff29c00640 1 -- 172.21.15.7:0/3354748928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff2c0035f0 con 0x5654b2251ad0 2024-04-23T14:55:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.990+0000 7eff29c00640 1 -- 172.21.15.7:0/3354748928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0117b0 con 0x5654b2251ad0 2024-04-23T14:55:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 -- 172.21.15.7:0/3354748928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 msgr2=0x5654b225be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff37e00640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7eff200a3dc0 0x7eff200a6280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff24009230 tx=0x7eff24031400 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b225be50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd10 tx=0x7eff2c0107a0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 -- 172.21.15.7:0/3354748928 shutdown_connections 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b225c390 0x5654b225e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b225be50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 --2- 172.21.15.7:0/3354748928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b22511b0 0x5654b2251590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 -- 172.21.15.7:0/3354748928 >> 172.21.15.7:0/3354748928 conn(0x5654b224d6c0 msgr2=0x5654b224daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 -- 172.21.15.7:0/3354748928 shutdown_connections 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 -- 172.21.15.7:0/3354748928 wait complete. 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.991+0000 7eff425e4740 1 -- start start 2024-04-23T14:55:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 Processor -- start 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b22592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b2259830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2259d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5654b225efc0 con 0x5654b2251ad0 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5654b21712c0 con 0x5654b225c390 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5654b225f140 con 0x5654b22511b0 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.992+0000 7eff425e4740 10 client.0 _ll_register_callbacks cb 0x5654b1ec9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b2259830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b2259830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53628/0 (socket says 172.21.15.7:53628) 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 -- 172.21.15.7:0/624493609 learned_addr learned my addr 172.21.15.7:0/624493609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff3cc00640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b22592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff3d600640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2259d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 -- 172.21.15.7:0/624493609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 msgr2=0x5654b22592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b22592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 -- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 msgr2=0x5654b2259d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2259d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff37e00640 1 -- 172.21.15.7:0/624493609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654b2181fd0 con 0x5654b2251ad0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.993+0000 7eff3d600640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2259d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff37e00640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b2259830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff24032fd0 tx=0x7eff240058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fb475be62a8205 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff1e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff1e000640 1 -- 172.21.15.7:0/624493609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2404e070 con 0x5654b2251ad0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff2c0035f0 con 0x5654b2251ad0 2024-04-23T14:55:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff1e000640 1 -- 172.21.15.7:0/624493609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7eff24005040 con 0x5654b2251ad0 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff1e000640 1 -- 172.21.15.7:0/624493609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7eff2405a050 con 0x5654b2251ad0 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.994+0000 7eff425e4740 10 client.15975 fetch_fsmap learned FSMap version 31 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5654b1eca210 con 0x5654b2251ad0 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff1e000640 1 -- 172.21.15.7:0/624493609 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff2c0035f0 con 0x5654b2251ad0 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff1e000640 1 -- 172.21.15.7:0/624493609 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7eff240035f0 con 0x5654b2251ad0 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 10 client.15975 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 10 client.15975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 20 client.15975 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b226c4e0 0x5654b226e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 4 client.15975 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:55:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.995+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654b21c5320 con 0x5654b226c4e0 2024-04-23T14:55:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.996+0000 7eff3cc00640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b226c4e0 0x5654b226e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.997+0000 7eff3cc00640 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b226c4e0 0x5654b226e910 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304974198ba550b3 server_cookie=14ddcea108da7498 in_seq=0 out_seq=0 2024-04-23T14:55:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.997+0000 7eff1e000640 10 client.15975 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff1e000640 1 -- 172.21.15.7:0/624493609 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5654b21c5320 con 0x5654b226c4e0 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff1e000640 10 client.15975 handle_command_reply: tid=0 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 client.15975 shutdown 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 msgr2=0x5654b2259830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b2259830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff24032fd0 tx=0x7eff240058d0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 shutdown_connections 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b226c4e0 0x5654b226e910 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2259d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b2259830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 --2- 172.21.15.7:0/624493609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b22592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.998+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 >> 172.21.15.7:0/624493609 conn(0x5654b224d6c0 msgr2=0x5654b2253440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.999+0000 7eff1e000640 0 client.15975 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.999+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 shutdown_connections 2024-04-23T14:55:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.999+0000 7eff425e4740 1 -- 172.21.15.7:0/624493609 wait complete. 2024-04-23T14:55:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:35.999+0000 7eff425e4740 20 client.15975 trim_cache size 0 max 16384 2024-04-23T14:55:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.018+0000 7eff425e4740 1 Processor -- start 2024-04-23T14:55:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 -- start start 2024-04-23T14:55:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b2267e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b22599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2274220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff381b14b0 con 0x5654b2251ad0 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff381b3020 con 0x5654b225c390 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff425e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7eff381b1b80 con 0x5654b22511b0 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.019+0000 7eff37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b22599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b2267e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b2267e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59936/0 (socket says 172.21.15.7:59936) 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff3cc00640 1 -- 172.21.15.7:0/2121812131 learned_addr learned my addr 172.21.15.7:0/2121812131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff3d600640 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2274220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff37e00640 1 -- 172.21.15.7:0/2121812131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 msgr2=0x5654b2267e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff37e00640 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b2267e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff37e00640 1 -- 172.21.15.7:0/2121812131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 msgr2=0x5654b2274220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff37e00640 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2274220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff37e00640 1 -- 172.21.15.7:0/2121812131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654b1f96620 con 0x5654b2251ad0 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.020+0000 7eff37e00640 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b22599c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7eff24005940 tx=0x7eff24031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab05e14671fcee7f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.021+0000 7eff29200640 1 -- 172.21.15.7:0/2121812131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2404e040 con 0x5654b2251ad0 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.021+0000 7eff29200640 1 -- 172.21.15.7:0/2121812131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff240054f0 con 0x5654b2251ad0 2024-04-23T14:55:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.021+0000 7eff29200640 1 -- 172.21.15.7:0/2121812131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24035040 con 0x5654b2251ad0 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 -- 172.21.15.7:0/2121812131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 msgr2=0x5654b22599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b22599c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7eff24005940 tx=0x7eff24031530 comp rx=0 tx=0).stop 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 -- 172.21.15.7:0/2121812131 shutdown_connections 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b2274220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b2251ad0 0x5654b22599c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 --2- 172.21.15.7:0/2121812131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b22511b0 0x5654b2267e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 -- 172.21.15.7:0/2121812131 >> 172.21.15.7:0/2121812131 conn(0x5654b224d6c0 msgr2=0x5654b22592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 -- 172.21.15.7:0/2121812131 shutdown_connections 2024-04-23T14:55:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.022+0000 7eff425e4740 1 -- 172.21.15.7:0/2121812131 wait complete. 2024-04-23T14:55:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.023+0000 7eff425e4740 1 -- start start 2024-04-23T14:55:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.023+0000 7eff425e4740 1 Processor -- start 2024-04-23T14:55:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 0x5654b2260650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b2251ad0 0x5654b2260b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b22cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff381b2920 con 0x5654b22511b0 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff381b2250 con 0x5654b225c390 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7eff381af490 con 0x5654b2251ad0 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff425e4740 10 client.0 _ll_register_callbacks cb 0x7eff24032c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 0x5654b2260650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 0x5654b2260650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53650/0 (socket says 172.21.15.7:53650) 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff3cc00640 1 -- 172.21.15.7:0/3419540854 learned_addr learned my addr 172.21.15.7:0/3419540854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff37e00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b2251ad0 0x5654b2260b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff3d600640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b22cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.024+0000 7eff3cc00640 1 -- 172.21.15.7:0/3419540854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b2251ad0 msgr2=0x5654b2260b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff3cc00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b2251ad0 0x5654b2260b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff3cc00640 1 -- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 msgr2=0x5654b22cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff3cc00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b22cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff3cc00640 1 -- 172.21.15.7:0/3419540854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654b22cc090 con 0x5654b22511b0 2024-04-23T14:55:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff37e00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b2251ad0 0x5654b2260b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff3d600640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b22cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:55:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff3cc00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 0x5654b2260650 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd10 tx=0x7eff2c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7ed7b3250da075 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff1e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff1e000640 1 -- 172.21.15.7:0/3419540854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c003a00 con 0x5654b22511b0 2024-04-23T14:55:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff1e000640 1 -- 172.21.15.7:0/3419540854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7eff2c005040 con 0x5654b22511b0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.025+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff240054f0 con 0x5654b22511b0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff1e000640 1 -- 172.21.15.7:0/3419540854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7eff2c03a050 con 0x5654b22511b0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff425e4740 10 client.15981 fetch_fsmap learned FSMap version 31 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5654b22d3450 con 0x5654b22511b0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff1e000640 1 -- 172.21.15.7:0/3419540854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff240054f0 con 0x5654b22511b0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff1e000640 1 -- 172.21.15.7:0/3419540854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7eff2c0296f0 con 0x5654b22511b0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff425e4740 10 client.15981 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff425e4740 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff425e4740 20 client.15981 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.026+0000 7eff425e4740 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b22d38f0 0x5654b22d5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.027+0000 7eff425e4740 4 client.15981 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.027+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654b21bf190 con 0x5654b22d38f0 2024-04-23T14:55:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.027+0000 7eff37e00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b22d38f0 0x5654b22d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.028+0000 7eff37e00640 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b22d38f0 0x5654b22d5ce0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d55871f9f1a7eb server_cookie=255fd11b55b3ec70 in_seq=0 out_seq=0 2024-04-23T14:55:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.028+0000 7eff1e000640 10 client.15981 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff1e000640 1 -- 172.21.15.7:0/3419540854 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654b21bf190 con 0x5654b22d38f0 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff1e000640 10 client.15981 handle_command_reply: tid=0 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 client.15981 shutdown 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 msgr2=0x5654b2260650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 0x5654b2260650 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd10 tx=0x7eff2c00beb0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 shutdown_connections 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5654b22d38f0 0x5654b22d5ce0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5654b225c390 0x5654b22cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b2251ad0 0x5654b2260b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 --2- 172.21.15.7:0/3419540854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5654b22511b0 0x5654b2260650 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff1e000640 0 client.15981 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 >> 172.21.15.7:0/3419540854 conn(0x5654b224d6c0 msgr2=0x5654b22533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 shutdown_connections 2024-04-23T14:55:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.046+0000 7eff425e4740 1 -- 172.21.15.7:0/3419540854 wait complete. 2024-04-23T14:55:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.047+0000 7eff425e4740 20 client.15981 trim_cache size 0 max 16384 2024-04-23T14:55:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:55:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:55:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:55:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:55:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.047+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7eff200a3dc0 msgr2=0x7eff200a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.047+0000 7eff3f600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7eff200a3dc0 0x7eff200a6280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff24009230 tx=0x7eff24031400 comp rx=0 tx=0).stop 2024-04-23T14:55:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.047+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 msgr2=0x7eff3819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.047+0000 7eff3f600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 0x7eff3819ac30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7eff3000eaa0 tx=0x7eff3000ef60 comp rx=0 tx=0).stop 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 shutdown_connections 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7eff200a3dc0 0x7eff200a6280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff38109520 0x7eff381a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff3819a780 0x7eff3819ac30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 --2- 172.21.15.7:0/239993690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff38104450 0x7eff381a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 >> 172.21.15.7:0/239993690 conn(0x7eff380ffcf0 msgr2=0x7eff38102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 shutdown_connections 2024-04-23T14:55:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:36.048+0000 7eff3f600640 1 -- 172.21.15.7:0/239993690 wait complete. 2024-04-23T14:55:36.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:36 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:36.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:36 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:36 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:37 smithi186 ceph-mon[31814]: pgmap v131: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T14:55:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:37 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:37 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:37 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:55:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:37 smithi137 ceph-mon[31694]: pgmap v131: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T14:55:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:37 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:37 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:37.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:37 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:55:37.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:37 smithi007 ceph-mon[27906]: pgmap v131: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T14:55:37.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:37 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:37.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:37 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:37.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:37 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:55:39.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:39 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:55:39.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:39 smithi007 ceph-mon[27906]: pgmap v132: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:39 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:55:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:39 smithi186 ceph-mon[31814]: pgmap v132: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:39.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:39 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T14:55:39.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:39 smithi137 ceph-mon[31694]: pgmap v132: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:41.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:41 smithi137 ceph-mon[31694]: pgmap v133: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:41 smithi007 ceph-mon[27906]: pgmap v133: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:41 smithi186 ceph-mon[31814]: pgmap v133: 129 pgs: 129 active+clean; 498 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:55:43.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:43 smithi137 ceph-mon[31694]: pgmap v134: 129 pgs: 129 active+clean; 530 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:55:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:43 smithi007 ceph-mon[27906]: pgmap v134: 129 pgs: 129 active+clean; 530 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:55:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:43 smithi186 ceph-mon[31814]: pgmap v134: 129 pgs: 129 active+clean; 530 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:55:45.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:45 smithi137 ceph-mon[31694]: pgmap v135: 129 pgs: 129 active+clean; 530 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T14:55:45.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:45 smithi007 ceph-mon[27906]: pgmap v135: 129 pgs: 129 active+clean; 530 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T14:55:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:45 smithi186 ceph-mon[31814]: pgmap v135: 129 pgs: 129 active+clean; 530 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T14:55:47.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:47 smithi007 ceph-mon[27906]: pgmap v136: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 18 op/s 2024-04-23T14:55:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:47 smithi186 ceph-mon[31814]: pgmap v136: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 18 op/s 2024-04-23T14:55:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:47 smithi137 ceph-mon[31694]: pgmap v136: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 18 op/s 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.197+0000 7fe384a00640 1 -- 172.21.15.7:0/2336262912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe380109370 msgr2=0x7fe380110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.197+0000 7fe384a00640 1 --2- 172.21.15.7:0/2336262912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe380109370 0x7fe380110f40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe378009ca0 tx=0x7fe37802a8c0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 -- 172.21.15.7:0/2336262912 shutdown_connections 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 --2- 172.21.15.7:0/2336262912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe380109370 0x7fe380110f40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 --2- 172.21.15.7:0/2336262912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe380104c50 0x7fe380108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 --2- 172.21.15.7:0/2336262912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3801042a0 0x7fe380104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 -- 172.21.15.7:0/2336262912 >> 172.21.15.7:0/2336262912 conn(0x7fe3800ffae0 msgr2=0x7fe380101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:49.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 -- 172.21.15.7:0/2336262912 shutdown_connections 2024-04-23T14:55:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.198+0000 7fe384a00640 1 -- 172.21.15.7:0/2336262912 wait complete. 2024-04-23T14:55:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.199+0000 7fe384a00640 1 Processor -- start 2024-04-23T14:55:49.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.199+0000 7fe384a00640 1 -- start start 2024-04-23T14:55:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe384a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3801042a0 0x7fe3801a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe384a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe380109370 0x7fe3801a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe384a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 0x7fe38019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe384a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe380114310 con 0x7fe38019a710 2024-04-23T14:55:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe384a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe380114190 con 0x7fe380109370 2024-04-23T14:55:49.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe384a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe380114490 con 0x7fe3801042a0 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe37f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 0x7fe38019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe37f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 0x7fe38019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59298/0 (socket says 172.21.15.7:59298) 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe37f200640 1 -- 172.21.15.7:0/2286703529 learned_addr learned my addr 172.21.15.7:0/2286703529 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe37de00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe380109370 0x7fe3801a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.200+0000 7fe37e800640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3801042a0 0x7fe3801a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37f200640 1 -- 172.21.15.7:0/2286703529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3801042a0 msgr2=0x7fe3801a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37f200640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3801042a0 0x7fe3801a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37f200640 1 -- 172.21.15.7:0/2286703529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe380109370 msgr2=0x7fe3801a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37f200640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe380109370 0x7fe3801a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37f200640 1 -- 172.21.15.7:0/2286703529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38019b310 con 0x7fe38019a710 2024-04-23T14:55:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37e800640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3801042a0 0x7fe3801a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37de00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe380109370 0x7fe3801a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:49.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.201+0000 7fe37f200640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 0x7fe38019ab90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe378031040 tx=0x7fe378003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.202+0000 7fe377400640 1 -- 172.21.15.7:0/2286703529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378003ce0 con 0x7fe38019a710 2024-04-23T14:55:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.202+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38019b5a0 con 0x7fe38019a710 2024-04-23T14:55:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.202+0000 7fe377400640 1 -- 172.21.15.7:0/2286703529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3780044f0 con 0x7fe38019a710 2024-04-23T14:55:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.202+0000 7fe377400640 1 -- 172.21.15.7:0/2286703529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378030c90 con 0x7fe38019a710 2024-04-23T14:55:49.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.202+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3801a7740 con 0x7fe38019a710 2024-04-23T14:55:49.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.205+0000 7fe3881d0740 1 Processor -- start 2024-04-23T14:55:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.206+0000 7fe377400640 1 -- 172.21.15.7:0/2286703529 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe3780046a0 con 0x7fe38019a710 2024-04-23T14:55:49.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.206+0000 7fe3881d0740 1 -- start start 2024-04-23T14:55:49.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb528947a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe3881d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb527fa900 con 0x55fb52894ce0 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe3881d0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fb527a0f20 con 0x55fb528943c0 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe3881d0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fb527f68c0 con 0x55fb5289f5a0 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe37e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe37e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59300/0 (socket says 172.21.15.7:59300) 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe37e800640 1 -- 172.21.15.7:0/3241134475 learned_addr learned my addr 172.21.15.7:0/3241134475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.207+0000 7fe37de00640 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb528947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37de00640 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37e800640 1 -- 172.21.15.7:0/3241134475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 msgr2=0x55fb528a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37e800640 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37e800640 1 -- 172.21.15.7:0/3241134475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 msgr2=0x55fb528947a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37e800640 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb528947a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37e800640 1 -- 172.21.15.7:0/3241134475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb527c5e10 con 0x55fb52894ce0 2024-04-23T14:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37de00640 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe377400640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe3640a3d90 0x7fe3640a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe37e800640 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289f060 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe37000bd40 tx=0x7fe37000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed04c6d4f5243dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.208+0000 7fe377400640 1 -- 172.21.15.7:0/2286703529 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fe3780f20e0 con 0x7fe38019a710 2024-04-23T14:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.209+0000 7fe37de00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe3640a3d90 0x7fe3640a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.209+0000 7fe36b400640 1 -- 172.21.15.7:0/3241134475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370015070 con 0x55fb52894ce0 2024-04-23T14:55:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.209+0000 7fe36b400640 1 -- 172.21.15.7:0/3241134475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe37000be30 con 0x55fb52894ce0 2024-04-23T14:55:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.209+0000 7fe36b400640 1 -- 172.21.15.7:0/3241134475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370011990 con 0x55fb52894ce0 2024-04-23T14:55:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 -- 172.21.15.7:0/3241134475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 msgr2=0x55fb5289f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289f060 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe37000bd40 tx=0x7fe37000f730 comp rx=0 tx=0).stop 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe37de00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe3640a3d90 0x7fe3640a6250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00d010 tx=0x7fe36c016040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 -- 172.21.15.7:0/3241134475 shutdown_connections 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289f060 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 --2- 172.21.15.7:0/3241134475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb528947a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 -- 172.21.15.7:0/3241134475 >> 172.21.15.7:0/3241134475 conn(0x55fb528908d0 msgr2=0x55fb52890cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 -- 172.21.15.7:0/3241134475 shutdown_connections 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.210+0000 7fe3881d0740 1 -- 172.21.15.7:0/3241134475 wait complete. 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.211+0000 7fe3881d0740 1 -- start start 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.211+0000 7fe3881d0740 1 Processor -- start 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.211+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb5289c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.211+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.211+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb5289cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe3881d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb528a2140 con 0x55fb52894ce0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe3881d0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fb527b42c0 con 0x55fb528943c0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe3881d0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fb528a22c0 con 0x55fb5289f5a0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe3881d0740 10 client.0 _ll_register_callbacks cb 0x55fb5250ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59314/0 (socket says 172.21.15.7:59314) 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 -- 172.21.15.7:0/2512812956 learned_addr learned my addr 172.21.15.7:0/2512812956 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37e800640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb5289c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37f200640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb5289cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 -- 172.21.15.7:0/2512812956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 msgr2=0x55fb5289cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb5289cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 -- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 msgr2=0x55fb5289c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb5289c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.212+0000 7fe37de00640 1 -- 172.21.15.7:0/2512812956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb527c4fd0 con 0x55fb52894ce0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.213+0000 7fe37de00640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289ca60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe36c014fd0 tx=0x7fe36c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2ecd7324abf7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.213+0000 7fe35fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.213+0000 7fe35fe00640 1 -- 172.21.15.7:0/2512812956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c025030 con 0x55fb52894ce0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.213+0000 7fe35fe00640 1 -- 172.21.15.7:0/2512812956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fe36c00fd30 con 0x55fb52894ce0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.213+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe37000be30 con 0x55fb52894ce0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe35fe00640 1 -- 172.21.15.7:0/2512812956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe36c032050 con 0x55fb52894ce0 2024-04-23T14:55:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 10 client.15993 fetch_fsmap learned FSMap version 32 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb5250d210 con 0x55fb52894ce0 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe35fe00640 1 -- 172.21.15.7:0/2512812956 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe37000be30 con 0x55fb52894ce0 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe35fe00640 1 -- 172.21.15.7:0/2512812956 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe36c02a410 con 0x55fb52894ce0 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 10 client.15993 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 10 client.15993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 20 client.15993 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb528af730 0x55fb528b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 4 client.15993 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.214+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb52808320 con 0x55fb528af730 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.215+0000 7fe37e800640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb528af730 0x55fb528b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.216+0000 7fe37e800640 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb528af730 0x55fb528b1ba0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eac45b6857b3a34 server_cookie=83689f8d85e5d9bd in_seq=0 out_seq=0 2024-04-23T14:55:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.216+0000 7fe35fe00640 10 client.15993 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe35fe00640 1 -- 172.21.15.7:0/2512812956 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fb52808320 con 0x55fb528af730 2024-04-23T14:55:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe35fe00640 10 client.15993 handle_command_reply: tid=0 2024-04-23T14:55:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 client.15993 shutdown 2024-04-23T14:55:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 msgr2=0x55fb5289ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289ca60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe36c014fd0 tx=0x7fe36c004730 comp rx=0 tx=0).stop 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 shutdown_connections 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb528af730 0x55fb528b1ba0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb5289cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb52894ce0 0x55fb5289ca60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 --2- 172.21.15.7:0/2512812956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb528943c0 0x55fb5289c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.218+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 >> 172.21.15.7:0/2512812956 conn(0x55fb528908d0 msgr2=0x55fb52896650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.219+0000 7fe35fe00640 0 client.15993 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.219+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 shutdown_connections 2024-04-23T14:55:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.219+0000 7fe3881d0740 1 -- 172.21.15.7:0/2512812956 wait complete. 2024-04-23T14:55:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.219+0000 7fe3881d0740 20 client.15993 trim_cache size 0 max 16384 2024-04-23T14:55:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.238+0000 7fe3881d0740 1 Processor -- start 2024-04-23T14:55:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.238+0000 7fe3881d0740 1 -- start start 2024-04-23T14:55:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.238+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb5289ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.238+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb52894ce0 0x55fb528ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5289f5a0 0x55fb528abb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe3881d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801b1390 con 0x55fb528943c0 2024-04-23T14:55:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe3881d0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801b2ed0 con 0x55fb5289f5a0 2024-04-23T14:55:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe3881d0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801b1a60 con 0x55fb52894ce0 2024-04-23T14:55:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb5289ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb5289ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59316/0 (socket says 172.21.15.7:59316) 2024-04-23T14:55:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 -- 172.21.15.7:0/1981215390 learned_addr learned my addr 172.21.15.7:0/1981215390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37f200640 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5289f5a0 0x55fb528abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37de00640 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb52894ce0 0x55fb528ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 -- 172.21.15.7:0/1981215390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb52894ce0 msgr2=0x55fb528ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb52894ce0 0x55fb528ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 -- 172.21.15.7:0/1981215390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5289f5a0 msgr2=0x55fb528abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5289f5a0 0x55fb528abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.239+0000 7fe37e800640 1 -- 172.21.15.7:0/1981215390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb52894b10 con 0x55fb528943c0 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.240+0000 7fe37e800640 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb5289ec50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe37000bd40 tx=0x7fe37000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d514793711f599f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.240+0000 7fe36aa00640 1 -- 172.21.15.7:0/1981215390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370015040 con 0x55fb528943c0 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.240+0000 7fe36aa00640 1 -- 172.21.15.7:0/1981215390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe37002d070 con 0x55fb528943c0 2024-04-23T14:55:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.240+0000 7fe36aa00640 1 -- 172.21.15.7:0/1981215390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370011ac0 con 0x55fb528943c0 2024-04-23T14:55:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 -- 172.21.15.7:0/1981215390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 msgr2=0x55fb5289ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb5289ec50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe37000bd40 tx=0x7fe37000b6f0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 -- 172.21.15.7:0/1981215390 shutdown_connections 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5289f5a0 0x55fb528abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb52894ce0 0x55fb528ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1981215390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb5289ec50 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 -- 172.21.15.7:0/1981215390 >> 172.21.15.7:0/1981215390 conn(0x55fb528908d0 msgr2=0x55fb52897820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 -- 172.21.15.7:0/1981215390 shutdown_connections 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.241+0000 7fe3881d0740 1 -- 172.21.15.7:0/1981215390 wait complete. 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 -- start start 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 Processor -- start 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb528a7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb52894ce0 0x55fb52898db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801b2800 con 0x55fb528943c0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801b2130 con 0x55fb52894ce0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.242+0000 7fe3881d0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801af370 con 0x55fb5289f5a0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe3881d0740 10 client.0 _ll_register_callbacks cb 0x7fe36c00cd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb528a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb528a7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59330/0 (socket says 172.21.15.7:59330) 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 -- 172.21.15.7:0/1786475432 learned_addr learned my addr 172.21.15.7:0/1786475432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37de00640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb52894ce0 0x55fb52898db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37f200640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 -- 172.21.15.7:0/1786475432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 msgr2=0x55fb528992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 -- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb52894ce0 msgr2=0x55fb52898db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb52894ce0 0x55fb52898db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37e800640 1 -- 172.21.15.7:0/1786475432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb525d9620 con 0x55fb528943c0 2024-04-23T14:55:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.243+0000 7fe37de00640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb52894ce0 0x55fb52898db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:55:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe37e800640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb528a7840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe370005bc0 tx=0x7fe37000ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4bb2877440c79f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:49.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe35fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:55:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe35fe00640 1 -- 172.21.15.7:0/1786475432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370015070 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe35fe00640 1 -- 172.21.15.7:0/1786475432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fe370004450 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe37002d070 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe35fe00640 1 -- 172.21.15.7:0/1786475432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe370005040 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe3881d0740 10 client.15999 fetch_fsmap learned FSMap version 32 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.244+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb52915870 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe35fe00640 1 -- 172.21.15.7:0/1786475432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe37002d070 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe35fe00640 1 -- 172.21.15.7:0/1786475432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe370028170 con 0x55fb528943c0 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe3881d0740 10 client.15999 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe3881d0740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe3881d0740 20 client.15999 populate_metadata read hostname 'smithi007' 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb52915d90 0x55fb52918180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe3881d0740 4 client.15999 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.245+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb52802190 con 0x55fb52915d90 2024-04-23T14:55:49.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.246+0000 7fe37de00640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb52915d90 0x55fb52918180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.247+0000 7fe35fe00640 10 client.15999 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:49.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.247+0000 7fe37de00640 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb52915d90 0x55fb52918180 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74606caefb7eb734 server_cookie=c2d6b697b183a6a3 in_seq=0 out_seq=0 2024-04-23T14:55:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.285+0000 7fe35fe00640 1 -- 172.21.15.7:0/1786475432 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb52802190 con 0x55fb52915d90 2024-04-23T14:55:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.285+0000 7fe35fe00640 10 client.15999 handle_command_reply: tid=0 2024-04-23T14:55:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.285+0000 7fe3881d0740 1 client.15999 shutdown 2024-04-23T14:55:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 msgr2=0x55fb528a7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb528a7840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe370005bc0 tx=0x7fe37000ba30 comp rx=0 tx=0).stop 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 shutdown_connections 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb52915d90 0x55fb52918180 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb52894ce0 0x55fb52898db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5289f5a0 0x55fb528992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 --2- 172.21.15.7:0/1786475432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb528943c0 0x55fb528a7840 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe35fe00640 0 client.15999 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 >> 172.21.15.7:0/1786475432 conn(0x55fb528908d0 msgr2=0x55fb5289c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 shutdown_connections 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 1 -- 172.21.15.7:0/1786475432 wait complete. 2024-04-23T14:55:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.286+0000 7fe3881d0740 20 client.15999 trim_cache size 0 max 16384 2024-04-23T14:55:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:55:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:55:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:55:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.287+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe3640a3d90 msgr2=0x7fe3640a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.287+0000 7fe384a00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe3640a3d90 0x7fe3640a6250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00d010 tx=0x7fe36c016040 comp rx=0 tx=0).stop 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.287+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 msgr2=0x7fe38019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.287+0000 7fe384a00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 0x7fe38019ab90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe378031040 tx=0x7fe378003970 comp rx=0 tx=0).stop 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 shutdown_connections 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe3640a3d90 0x7fe3640a6250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe380109370 0x7fe3801a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe38019a710 0x7fe38019ab90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 --2- 172.21.15.7:0/2286703529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3801042a0 0x7fe3801a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 >> 172.21.15.7:0/2286703529 conn(0x7fe3800ffae0 msgr2=0x7fe380100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 shutdown_connections 2024-04-23T14:55:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:55:49.288+0000 7fe384a00640 1 -- 172.21.15.7:0/2286703529 wait complete. 2024-04-23T14:55:49.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:49 smithi007 ceph-mon[27906]: pgmap v137: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T14:55:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:49 smithi186 ceph-mon[31814]: pgmap v137: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T14:55:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:49 smithi137 ceph-mon[31694]: pgmap v137: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T14:55:51.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:51 smithi007 ceph-mon[27906]: pgmap v138: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T14:55:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:51 smithi186 ceph-mon[31814]: pgmap v138: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T14:55:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:51 smithi137 ceph-mon[31694]: pgmap v138: 129 pgs: 129 active+clean; 550 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T14:55:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:53 smithi007 ceph-mon[27906]: pgmap v139: 129 pgs: 129 active+clean; 574 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 19 op/s 2024-04-23T14:55:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:53 smithi186 ceph-mon[31814]: pgmap v139: 129 pgs: 129 active+clean; 574 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 19 op/s 2024-04-23T14:55:53.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:53 smithi137 ceph-mon[31694]: pgmap v139: 129 pgs: 129 active+clean; 574 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 19 op/s 2024-04-23T14:55:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:55 smithi007 ceph-mon[27906]: pgmap v140: 129 pgs: 129 active+clean; 574 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:55 smithi186 ceph-mon[31814]: pgmap v140: 129 pgs: 129 active+clean; 574 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:55.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:55 smithi137 ceph-mon[31694]: pgmap v140: 129 pgs: 129 active+clean; 574 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:55:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:57 smithi007 ceph-mon[27906]: pgmap v141: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:57.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:57 smithi186 ceph-mon[31814]: pgmap v141: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:57 smithi137 ceph-mon[31694]: pgmap v141: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:55:59.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:55:59 smithi007 ceph-mon[27906]: pgmap v142: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:55:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:55:59 smithi186 ceph-mon[31814]: pgmap v142: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:55:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:55:59 smithi137 ceph-mon[31694]: pgmap v142: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:01 smithi007 ceph-mon[27906]: pgmap v143: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:01 smithi186 ceph-mon[31814]: pgmap v143: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:01 smithi137 ceph-mon[31694]: pgmap v143: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.450+0000 7f3f73e00640 1 -- 172.21.15.7:0/1771904646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 msgr2=0x7f3f74110b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.450+0000 7f3f73e00640 1 --2- 172.21.15.7:0/1771904646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f74110b60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009900 tx=0x7f3f6c02a410 comp rx=0 tx=0).stop 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.450+0000 7f3f73e00640 1 -- 172.21.15.7:0/1771904646 shutdown_connections 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.451+0000 7f3f73e00640 1 --2- 172.21.15.7:0/1771904646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f74110b60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.451+0000 7f3f73e00640 1 --2- 172.21.15.7:0/1771904646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f74101570 0x7f3f7410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.451+0000 7f3f73e00640 1 --2- 172.21.15.7:0/1771904646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f74100bc0 0x7f3f74100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.451+0000 7f3f73e00640 1 -- 172.21.15.7:0/1771904646 >> 172.21.15.7:0/1771904646 conn(0x7f3f740fc820 msgr2=0x7f3f740fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.451+0000 7f3f73e00640 1 -- 172.21.15.7:0/1771904646 shutdown_connections 2024-04-23T14:56:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.451+0000 7f3f73e00640 1 -- 172.21.15.7:0/1771904646 wait complete. 2024-04-23T14:56:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.452+0000 7f3f73e00640 1 Processor -- start 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.452+0000 7f3f73e00640 1 -- start start 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.452+0000 7f3f73e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f74100bc0 0x7f3f741a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.452+0000 7f3f73e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f74101570 0x7f3f741a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.452+0000 7f3f73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f7419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741142b0 con 0x7f3f7410e770 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f74114130 con 0x7f3f74101570 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3f74114430 con 0x7f3f74100bc0 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f7419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f7419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42880/0 (socket says 172.21.15.7:42880) 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 -- 172.21.15.7:0/2971372358 learned_addr learned my addr 172.21.15.7:0/2971372358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f74100bc0 0x7f3f741a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f72000640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f74101570 0x7f3f741a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 -- 172.21.15.7:0/2971372358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f74100bc0 msgr2=0x7f3f741a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f74100bc0 0x7f3f741a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 -- 172.21.15.7:0/2971372358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f74101570 msgr2=0x7f3f741a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f74101570 0x7f3f741a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.453+0000 7f3f73400640 1 -- 172.21.15.7:0/2971372358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7419ad90 con 0x7f3f7410e770 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.454+0000 7f3f73400640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f7419a610 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c02a930 tx=0x7f3f6c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.454+0000 7f3f78a00640 1 -- 172.21.15.7:0/2971372358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c03f070 con 0x7f3f7410e770 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.454+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7419b020 con 0x7f3f7410e770 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.454+0000 7f3f78a00640 1 -- 172.21.15.7:0/2971372358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f6c003e40 con 0x7f3f7410e770 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.454+0000 7f3f78a00640 1 -- 172.21.15.7:0/2971372358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c035030 con 0x7f3f7410e770 2024-04-23T14:56:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.454+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f741a7320 con 0x7f3f7410e770 2024-04-23T14:56:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.458+0000 7f3f7cc40740 1 Processor -- start 2024-04-23T14:56:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.458+0000 7f3f78a00640 1 -- 172.21.15.7:0/2971372358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3f6c042070 con 0x7f3f7410e770 2024-04-23T14:56:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 -- start start 2024-04-23T14:56:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379cfa3c0 0x562379cfa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d05060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 0x562379d07990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562379c60900 con 0x562379d055a0 2024-04-23T14:56:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562379c06f20 con 0x562379cface0 2024-04-23T14:56:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.459+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562379c5c8c0 con 0x562379cfa3c0 2024-04-23T14:56:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 0x562379d07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 0x562379d07990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42886/0 (socket says 172.21.15.7:42886) 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 -- 172.21.15.7:0/2782902437 learned_addr learned my addr 172.21.15.7:0/2782902437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379cfa3c0 0x562379cfa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d05060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 -- 172.21.15.7:0/2782902437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379cfa3c0 msgr2=0x562379cfa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379cfa3c0 0x562379cfa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 -- 172.21.15.7:0/2782902437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 msgr2=0x562379d05060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d05060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.460+0000 7f3f72000640 1 -- 172.21.15.7:0/2782902437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562379c2be10 con 0x562379d055a0 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f78a00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3f580a3d10 0x7f3f580a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f78a00640 1 -- 172.21.15.7:0/2971372358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f3f6c0f1420 con 0x7f3f7410e770 2024-04-23T14:56:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f72000640 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 0x562379d07990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0129a0 tx=0x7f3f5c0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ed71fc65f88219 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3f580a3d10 0x7f3f580a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f63e00640 1 -- 172.21.15.7:0/2782902437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c012070 con 0x562379d055a0 2024-04-23T14:56:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f63e00640 1 -- 172.21.15.7:0/2782902437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f5c003e20 con 0x562379d055a0 2024-04-23T14:56:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.461+0000 7f3f63e00640 1 -- 172.21.15.7:0/2782902437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c004050 con 0x562379d055a0 2024-04-23T14:56:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2782902437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 msgr2=0x562379d07990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3f580a3d10 0x7f3f580a61d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x562379cfb960 tx=0x7f3f6400b4d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 0x562379d07990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0129a0 tx=0x7f3f5c0096d0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2782902437 shutdown_connections 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d05060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379d055a0 0x562379d07990 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2782902437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379cfa3c0 0x562379cfa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.462+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2782902437 >> 172.21.15.7:0/2782902437 conn(0x562379cf68d0 msgr2=0x562379cf6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.463+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2782902437 shutdown_connections 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.463+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2782902437 wait complete. 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.463+0000 7f3f7cc40740 1 -- start start 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.463+0000 7f3f7cc40740 1 Processor -- start 2024-04-23T14:56:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d02600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d02b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d03080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562379d080e0 con 0x562379cface0 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562379c1a2c0 con 0x562379cfa3c0 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562379d08260 con 0x562379d055a0 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f7cc40740 10 client.0 _ll_register_callbacks cb 0x562379972a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f72000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d02b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f72000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d02b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42900/0 (socket says 172.21.15.7:42900) 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f72000640 1 -- 172.21.15.7:0/2748590506 learned_addr learned my addr 172.21.15.7:0/2748590506 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d02600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.464+0000 7f3f73400640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f72000640 1 -- 172.21.15.7:0/2748590506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 msgr2=0x562379d03080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f72000640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d03080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f72000640 1 -- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 msgr2=0x562379d02600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f72000640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d02600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f72000640 1 -- 172.21.15.7:0/2748590506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562379c2afd0 con 0x562379cface0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f72000640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d02b40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c006010 tx=0x7f3f5c0125c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d331e4b314771ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f60c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f60c00640 1 -- 172.21.15.7:0/2748590506 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c003970 con 0x562379cface0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f5c003e20 con 0x562379cface0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.465+0000 7f3f60c00640 1 -- 172.21.15.7:0/2748590506 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f3f5c003b10 con 0x562379cface0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f60c00640 1 -- 172.21.15.7:0/2748590506 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3f5c030050 con 0x562379cface0 2024-04-23T14:56:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f7cc40740 10 client.16011 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562379973210 con 0x562379cface0 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f60c00640 1 -- 172.21.15.7:0/2748590506 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f5c003e20 con 0x562379cface0 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f60c00640 1 -- 172.21.15.7:0/2748590506 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3f5c00c020 con 0x562379cface0 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f7cc40740 10 client.16011 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.466+0000 7f3f7cc40740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.467+0000 7f3f7cc40740 20 client.16011 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.467+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d15730 0x562379d17b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.467+0000 7f3f7cc40740 4 client.16011 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.467+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562379c6e320 con 0x562379d15730 2024-04-23T14:56:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.467+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d15730 0x562379d17b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.468+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d15730 0x562379d17b20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8ffb99c3605295 server_cookie=b7ca0fad86711a5d in_seq=0 out_seq=0 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.468+0000 7f3f60c00640 10 client.16011 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.470+0000 7f3f60c00640 1 -- 172.21.15.7:0/2748590506 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562379c6e320 con 0x562379d15730 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.470+0000 7f3f60c00640 10 client.16011 handle_command_reply: tid=0 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.470+0000 7f3f7cc40740 1 client.16011 shutdown 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 msgr2=0x562379d02b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d02b40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c006010 tx=0x7f3f5c0125c0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 shutdown_connections 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d15730 0x562379d17b20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d03080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d02b40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2748590506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d02600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f60c00640 0 client.16011 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 >> 172.21.15.7:0/2748590506 conn(0x562379cf68d0 msgr2=0x562379cf5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 shutdown_connections 2024-04-23T14:56:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2748590506 wait complete. 2024-04-23T14:56:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.471+0000 7f3f7cc40740 20 client.16011 trim_cache size 0 max 16384 2024-04-23T14:56:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 Processor -- start 2024-04-23T14:56:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 -- start start 2024-04-23T14:56:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 0x562379cf6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d02cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741b1240 con 0x562379cfa3c0 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741b2d80 con 0x562379cface0 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.494+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741b1910 con 0x562379d055a0 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 0x562379cf6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 0x562379cf6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42908/0 (socket says 172.21.15.7:42908) 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 -- 172.21.15.7:0/1243612417 learned_addr learned my addr 172.21.15.7:0/1243612417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f73400640 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d02cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72000640 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 -- 172.21.15.7:0/1243612417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 msgr2=0x562379d02cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d02cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 -- 172.21.15.7:0/1243612417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 msgr2=0x562379d110e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d110e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.495+0000 7f3f72a00640 1 -- 172.21.15.7:0/1243612417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562379a3f620 con 0x562379cfa3c0 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.496+0000 7f3f72a00640 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 0x562379cf6210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x562379d18180 tx=0x7f3f64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc211d5a139b3df3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.496+0000 7f3f63400640 1 -- 172.21.15.7:0/1243612417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64027540 con 0x562379cfa3c0 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.496+0000 7f3f63400640 1 -- 172.21.15.7:0/1243612417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f6402b030 con 0x562379cfa3c0 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.496+0000 7f3f63400640 1 -- 172.21.15.7:0/1243612417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6402f630 con 0x562379cfa3c0 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.497+0000 7f3f7cc40740 1 -- 172.21.15.7:0/1243612417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 msgr2=0x562379cf6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.497+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 0x562379cf6210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x562379d18180 tx=0x7f3f64018000 comp rx=0 tx=0).stop 2024-04-23T14:56:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.497+0000 7f3f7cc40740 1 -- 172.21.15.7:0/1243612417 shutdown_connections 2024-04-23T14:56:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.497+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cface0 0x562379d110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.497+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d02cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.498+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/1243612417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cfa3c0 0x562379cf6210 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.498+0000 7f3f7cc40740 1 -- 172.21.15.7:0/1243612417 >> 172.21.15.7:0/1243612417 conn(0x562379cf68d0 msgr2=0x562379d025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.498+0000 7f3f7cc40740 1 -- 172.21.15.7:0/1243612417 shutdown_connections 2024-04-23T14:56:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.498+0000 7f3f7cc40740 1 -- 172.21.15.7:0/1243612417 wait complete. 2024-04-23T14:56:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.498+0000 7f3f7cc40740 1 -- start start 2024-04-23T14:56:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.498+0000 7f3f7cc40740 1 Processor -- start 2024-04-23T14:56:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d09060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d09ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741b26b0 con 0x562379cface0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741b1fe0 con 0x562379cfa3c0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3f741af220 con 0x562379d055a0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.499+0000 7f3f7cc40740 10 client.0 _ll_register_callbacks cb 0x7f3f6400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42920/0 (socket says 172.21.15.7:42920) 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 -- 172.21.15.7:0/2598798452 learned_addr learned my addr 172.21.15.7:0/2598798452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d09060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f73400640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d09ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 -- 172.21.15.7:0/2598798452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 msgr2=0x562379d09ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d09ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 -- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 msgr2=0x562379d09060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d09060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.500+0000 7f3f72000640 1 -- 172.21.15.7:0/2598798452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562379d7aad0 con 0x562379cface0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.501+0000 7f3f72000640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d095a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x562379d01e60 tx=0x7f3f5c0096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264d991947c6b6d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.501+0000 7f3f60c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.501+0000 7f3f60c00640 1 -- 172.21.15.7:0/2598798452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c010980 con 0x562379cface0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.501+0000 7f3f60c00640 1 -- 172.21.15.7:0/2598798452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f3f5c012280 con 0x562379cface0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.501+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f6402b030 con 0x562379cface0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.502+0000 7f3f60c00640 1 -- 172.21.15.7:0/2598798452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3f5c003970 con 0x562379cface0 2024-04-23T14:56:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.502+0000 7f3f7cc40740 10 client.16017 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.502+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562379d7bde0 con 0x562379cface0 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.502+0000 7f3f60c00640 1 -- 172.21.15.7:0/2598798452 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f6402b030 con 0x562379cface0 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f60c00640 1 -- 172.21.15.7:0/2598798452 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3f5c00c040 con 0x562379cface0 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f7cc40740 10 client.16017 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f7cc40740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f7cc40740 20 client.16017 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d7c570 0x562379d7e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f7cc40740 4 client.16017 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:56:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.503+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562379c68190 con 0x562379d7c570 2024-04-23T14:56:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.505+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d7c570 0x562379d7e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.506+0000 7f3f72a00640 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d7c570 0x562379d7e990 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff524dcf6b9f8483 server_cookie=9f945648090a79b1 in_seq=0 out_seq=0 2024-04-23T14:56:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.506+0000 7f3f60c00640 10 client.16017 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.545+0000 7f3f60c00640 1 -- 172.21.15.7:0/2598798452 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562379c68190 con 0x562379d7c570 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.545+0000 7f3f60c00640 10 client.16017 handle_command_reply: tid=0 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.545+0000 7f3f7cc40740 1 client.16017 shutdown 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.545+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 msgr2=0x562379d095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.545+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d095a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x562379d01e60 tx=0x7f3f5c0096b0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 shutdown_connections 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562379d7c570 0x562379d7e990 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562379d055a0 0x562379d09ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562379cface0 0x562379d095a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 --2- 172.21.15.7:0/2598798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562379cfa3c0 0x562379d09060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f60c00640 0 client.16017 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 >> 172.21.15.7:0/2598798452 conn(0x562379cf68d0 msgr2=0x562379cfc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 shutdown_connections 2024-04-23T14:56:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 1 -- 172.21.15.7:0/2598798452 wait complete. 2024-04-23T14:56:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.546+0000 7f3f7cc40740 20 client.16017 trim_cache size 0 max 16384 2024-04-23T14:56:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:56:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:56:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:56:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3f580a3d10 msgr2=0x7f3f580a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3f580a3d10 0x7f3f580a61d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x562379cfb960 tx=0x7f3f6400b4d0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 msgr2=0x7f3f7419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f7419a610 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c02a930 tx=0x7f3f6c003cd0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 shutdown_connections 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3f580a3d10 0x7f3f580a61d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f74101570 0x7f3f741a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f7410e770 0x7f3f7419a610 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 --2- 172.21.15.7:0/2971372358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f74100bc0 0x7f3f741a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 >> 172.21.15.7:0/2971372358 conn(0x7f3f740fc820 msgr2=0x7f3f740fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 shutdown_connections 2024-04-23T14:56:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:02.547+0000 7f3f73e00640 1 -- 172.21.15.7:0/2971372358 wait complete. 2024-04-23T14:56:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:03 smithi007 ceph-mon[27906]: pgmap v144: 129 pgs: 129 active+clean; 625 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.3 MiB/s wr, 33 op/s 2024-04-23T14:56:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:03 smithi186 ceph-mon[31814]: pgmap v144: 129 pgs: 129 active+clean; 625 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.3 MiB/s wr, 33 op/s 2024-04-23T14:56:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:03 smithi137 ceph-mon[31694]: pgmap v144: 129 pgs: 129 active+clean; 625 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.3 MiB/s wr, 33 op/s 2024-04-23T14:56:05.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:05 smithi007 ceph-mon[27906]: pgmap v145: 129 pgs: 129 active+clean; 625 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 25 op/s 2024-04-23T14:56:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:05 smithi186 ceph-mon[31814]: pgmap v145: 129 pgs: 129 active+clean; 625 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 25 op/s 2024-04-23T14:56:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:05 smithi137 ceph-mon[31694]: pgmap v145: 129 pgs: 129 active+clean; 625 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 25 op/s 2024-04-23T14:56:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:07 smithi007 ceph-mon[27906]: pgmap v146: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:56:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:07 smithi186 ceph-mon[31814]: pgmap v146: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:56:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:07 smithi137 ceph-mon[31694]: pgmap v146: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:56:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:09 smithi007 ceph-mon[27906]: pgmap v147: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-04-23T14:56:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:09 smithi186 ceph-mon[31814]: pgmap v147: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-04-23T14:56:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:09 smithi137 ceph-mon[31694]: pgmap v147: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-04-23T14:56:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:11 smithi007 ceph-mon[27906]: pgmap v148: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-04-23T14:56:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:11 smithi186 ceph-mon[31814]: pgmap v148: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-04-23T14:56:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:11 smithi137 ceph-mon[31694]: pgmap v148: 129 pgs: 129 active+clean; 646 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 29 op/s 2024-04-23T14:56:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:13 smithi007 ceph-mon[27906]: pgmap v149: 129 pgs: 129 active+clean; 670 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:56:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:13 smithi186 ceph-mon[31814]: pgmap v149: 129 pgs: 129 active+clean; 670 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:56:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:13 smithi137 ceph-mon[31694]: pgmap v149: 129 pgs: 129 active+clean; 670 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 34 op/s 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 -- 172.21.15.7:0/2155270190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed8102fc0 msgr2=0x7fbed81033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 --2- 172.21.15.7:0/2155270190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed8102fc0 0x7fbed81033a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009900 tx=0x7fbecc02a480 comp rx=0 tx=0).stop 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 -- 172.21.15.7:0/2155270190 shutdown_connections 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 --2- 172.21.15.7:0/2155270190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed810c3e0 0x7fbed810e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 --2- 172.21.15.7:0/2155270190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed810bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 --2- 172.21.15.7:0/2155270190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed8102fc0 0x7fbed81033a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.706+0000 7fbedde00640 1 -- 172.21.15.7:0/2155270190 >> 172.21.15.7:0/2155270190 conn(0x7fbed80fc820 msgr2=0x7fbed80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.707+0000 7fbedde00640 1 -- 172.21.15.7:0/2155270190 shutdown_connections 2024-04-23T14:56:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.707+0000 7fbedde00640 1 -- 172.21.15.7:0/2155270190 wait complete. 2024-04-23T14:56:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.708+0000 7fbedde00640 1 Processor -- start 2024-04-23T14:56:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 -- start start 2024-04-23T14:56:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed8102fc0 0x7fbed81a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed81a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed810c3e0 0x7fbed819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81120a0 con 0x7fbed81038e0 2024-04-23T14:56:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8111f20 con 0x7fbed810c3e0 2024-04-23T14:56:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.709+0000 7fbedde00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8112220 con 0x7fbed8102fc0 2024-04-23T14:56:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed81a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed81a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42716/0 (socket says 172.21.15.7:42716) 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 -- 172.21.15.7:0/3766312605 learned_addr learned my addr 172.21.15.7:0/3766312605 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbedca00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed8102fc0 0x7fbed81a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbedd400640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed810c3e0 0x7fbed819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 -- 172.21.15.7:0/3766312605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed8102fc0 msgr2=0x7fbed81a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed8102fc0 0x7fbed81a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 -- 172.21.15.7:0/3766312605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed810c3e0 msgr2=0x7fbed819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed810c3e0 0x7fbed819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 -- 172.21.15.7:0/3766312605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed819af60 con 0x7fbed81038e0 2024-04-23T14:56:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbedca00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed8102fc0 0x7fbed81a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:56:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.710+0000 7fbed7e00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed81a0ad0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbec400e9f0 tx=0x7fbec400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.711+0000 7fbed5600640 1 -- 172.21.15.7:0/3766312605 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec400ccc0 con 0x7fbed81038e0 2024-04-23T14:56:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.711+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed819b250 con 0x7fbed81038e0 2024-04-23T14:56:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.711+0000 7fbed5600640 1 -- 172.21.15.7:0/3766312605 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbec40108e0 con 0x7fbed81038e0 2024-04-23T14:56:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.711+0000 7fbed5600640 1 -- 172.21.15.7:0/3766312605 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40187c0 con 0x7fbed81038e0 2024-04-23T14:56:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.711+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed81a7510 con 0x7fbed81038e0 2024-04-23T14:56:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 Processor -- start 2024-04-23T14:56:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbed5600640 1 -- 172.21.15.7:0/3766312605 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbec4010430 con 0x7fbed81038e0 2024-04-23T14:56:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 -- start start 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f227a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 0x557a08f2f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a08e88900 con 0x557a08f2d5a0 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557a08e2ef20 con 0x557a08f223c0 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.715+0000 7fbee218c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557a08e848c0 con 0x557a08f22ce0 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 0x557a08f2f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 0x557a08f2f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42724/0 (socket says 172.21.15.7:42724) 2024-04-23T14:56:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 -- 172.21.15.7:0/3981001979 learned_addr learned my addr 172.21.15.7:0/3981001979 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbedd400640 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbedca00640 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 -- 172.21.15.7:0/3981001979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 msgr2=0x557a08f2d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 -- 172.21.15.7:0/3981001979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 msgr2=0x557a08f227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbed7e00640 1 -- 172.21.15.7:0/3981001979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a08e53e10 con 0x557a08f2d5a0 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.716+0000 7fbedd400640 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.717+0000 7fbed7e00640 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 0x557a08f2f990 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbec40ce2c0 tx=0x7fbec40d9640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd845de4c452c6e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.717+0000 7fbec9c00640 1 -- 172.21.15.7:0/3981001979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40e4070 con 0x557a08f2d5a0 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.717+0000 7fbec9c00640 1 -- 172.21.15.7:0/3981001979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbec40d1ca0 con 0x557a08f2d5a0 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.717+0000 7fbec9c00640 1 -- 172.21.15.7:0/3981001979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40dfbf0 con 0x557a08f2d5a0 2024-04-23T14:56:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.718+0000 7fbed5600640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbec00a3d10 0x7fbec00a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.718+0000 7fbed5600640 1 -- 172.21.15.7:0/3766312605 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fbec40d0ff0 con 0x7fbed81038e0 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.718+0000 7fbedd400640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbec00a3d10 0x7fbec00a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.718+0000 7fbee218c740 1 -- 172.21.15.7:0/3981001979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 msgr2=0x557a08f2f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.718+0000 7fbee218c740 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 0x557a08f2f990 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbec40ce2c0 tx=0x7fbec40d9640 comp rx=0 tx=0).stop 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 -- 172.21.15.7:0/3981001979 shutdown_connections 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f2d5a0 0x557a08f2f990 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 --2- 172.21.15.7:0/3981001979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 -- 172.21.15.7:0/3981001979 >> 172.21.15.7:0/3981001979 conn(0x557a08f1e8d0 msgr2=0x557a08f1ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 -- 172.21.15.7:0/3981001979 shutdown_connections 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 -- 172.21.15.7:0/3981001979 wait complete. 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbedd400640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbec00a3d10 0x7fbec00a61d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005fd0 tx=0x7fbed0009500 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.719+0000 7fbee218c740 1 -- start start 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 Processor -- start 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f2a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f2d5a0 0x557a08f2afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a08f300e0 con 0x557a08f223c0 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557a08e422c0 con 0x557a08f2d5a0 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557a08f30260 con 0x557a08f22ce0 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.720+0000 7fbee218c740 10 client.0 _ll_register_callbacks cb 0x557a08b9aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f2a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f2a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42728/0 (socket says 172.21.15.7:42728) 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 -- 172.21.15.7:0/1004438177 learned_addr learned my addr 172.21.15.7:0/1004438177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbed7e00640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedd400640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f2d5a0 0x557a08f2afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 -- 172.21.15.7:0/1004438177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 msgr2=0x557a08f2aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 -- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f2d5a0 msgr2=0x557a08f2afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f2d5a0 0x557a08f2afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedca00640 1 -- 172.21.15.7:0/1004438177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a08e52fd0 con 0x557a08f223c0 2024-04-23T14:56:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.721+0000 7fbedd400640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f2d5a0 0x557a08f2afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbedca00640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f2a560 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009230 tx=0x7fbecc0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923685d8aa42db9a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbebe000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbebe000640 1 -- 172.21.15.7:0/1004438177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc035030 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbebe000640 1 -- 172.21.15.7:0/1004438177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fbecc0048c0 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbec40d1ca0 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbebe000640 1 -- 172.21.15.7:0/1004438177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbecc04d050 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbee218c740 10 client.16029 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.722+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557a08b9b210 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbebe000640 1 -- 172.21.15.7:0/1004438177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbec40d1ca0 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbebe000640 1 -- 172.21.15.7:0/1004438177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbecc003b20 con 0x557a08f223c0 2024-04-23T14:56:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbee218c740 10 client.16029 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbee218c740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbee218c740 20 client.16029 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbee218c740 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08f3d7a0 0x557a08f3fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbee218c740 4 client.16029 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.723+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a08e96320 con 0x557a08f3d7a0 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.724+0000 7fbed7e00640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08f3d7a0 0x557a08f3fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.725+0000 7fbed7e00640 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08f3d7a0 0x557a08f3fb90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3df3f828c08379b3 server_cookie=57a074b4701b7a28 in_seq=0 out_seq=0 2024-04-23T14:56:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.725+0000 7fbebe000640 10 client.16029 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.726+0000 7fbebe000640 1 -- 172.21.15.7:0/1004438177 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a08e96320 con 0x557a08f3d7a0 2024-04-23T14:56:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.726+0000 7fbebe000640 10 client.16029 handle_command_reply: tid=0 2024-04-23T14:56:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 client.16029 shutdown 2024-04-23T14:56:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 msgr2=0x557a08f2a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f2a560 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009230 tx=0x7fbecc0052f0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 shutdown_connections 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08f3d7a0 0x557a08f3fb90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f2d5a0 0x557a08f2afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f22ce0 0x557a08f2aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 --2- 172.21.15.7:0/1004438177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f2a560 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 >> 172.21.15.7:0/1004438177 conn(0x557a08f1e8d0 msgr2=0x557a08f1da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbebe000640 0 client.16029 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 shutdown_connections 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 1 -- 172.21.15.7:0/1004438177 wait complete. 2024-04-23T14:56:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.727+0000 7fbee218c740 20 client.16029 trim_cache size 0 max 16384 2024-04-23T14:56:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.747+0000 7fbee218c740 1 Processor -- start 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 -- start start 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f2cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 0x557a08f390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08f454a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81b1350 con 0x557a08f22ce0 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81b2e90 con 0x557a08f223c0 2024-04-23T14:56:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbee218c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81b1a20 con 0x557a08f2d5a0 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 0x557a08f390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 0x557a08f390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42740/0 (socket says 172.21.15.7:42740) 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.748+0000 7fbed7e00640 1 -- 172.21.15.7:0/2690505224 learned_addr learned my addr 172.21.15.7:0/2690505224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbedd400640 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08f454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbedca00640 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f2cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbed7e00640 1 -- 172.21.15.7:0/2690505224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 msgr2=0x557a08f454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbed7e00640 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08f454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbed7e00640 1 -- 172.21.15.7:0/2690505224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 msgr2=0x557a08f2cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbed7e00640 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f2cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbed7e00640 1 -- 172.21.15.7:0/2690505224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a08c67620 con 0x557a08f22ce0 2024-04-23T14:56:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.749+0000 7fbed7e00640 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 0x557a08f390e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbec40df470 tx=0x7fbec400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6a79b1f110a8b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.750+0000 7fbec9200640 1 -- 172.21.15.7:0/2690505224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4098e70 con 0x557a08f22ce0 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.750+0000 7fbec9200640 1 -- 172.21.15.7:0/2690505224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbec4010d90 con 0x557a08f22ce0 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.750+0000 7fbec9200640 1 -- 172.21.15.7:0/2690505224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec409c530 con 0x557a08f22ce0 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.750+0000 7fbee218c740 1 -- 172.21.15.7:0/2690505224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 msgr2=0x557a08f390e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.750+0000 7fbee218c740 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 0x557a08f390e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbec40df470 tx=0x7fbec400ce60 comp rx=0 tx=0).stop 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 -- 172.21.15.7:0/2690505224 shutdown_connections 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08f454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f22ce0 0x557a08f390e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 --2- 172.21.15.7:0/2690505224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f223c0 0x557a08f2cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 -- 172.21.15.7:0/2690505224 >> 172.21.15.7:0/2690505224 conn(0x557a08f1e8d0 msgr2=0x557a08f1ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 -- 172.21.15.7:0/2690505224 shutdown_connections 2024-04-23T14:56:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 -- 172.21.15.7:0/2690505224 wait complete. 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 -- start start 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.751+0000 7fbee218c740 1 Processor -- start 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f22ce0 0x557a08f30ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08fa1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81b27c0 con 0x557a08f223c0 2024-04-23T14:56:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81b20f0 con 0x557a08f22ce0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81af330 con 0x557a08f2d5a0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbee218c740 10 client.0 _ll_register_callbacks cb 0x7fbec4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbedca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbedca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42756/0 (socket says 172.21.15.7:42756) 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbedca00640 1 -- 172.21.15.7:0/2441107801 learned_addr learned my addr 172.21.15.7:0/2441107801 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbedca00640 1 -- 172.21.15.7:0/2441107801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 msgr2=0x557a08fa1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.752+0000 7fbedd400640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08fa1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbedca00640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08fa1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbedca00640 1 -- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f22ce0 msgr2=0x557a08f30ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbed7e00640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f22ce0 0x557a08f30ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbedca00640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f22ce0 0x557a08f30ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbedca00640 1 -- 172.21.15.7:0/2441107801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a08fa2290 con 0x557a08f223c0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbedd400640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08fa1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbedca00640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f307a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009900 tx=0x7fbecc005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dbcf27ac8e735c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbebe000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbebe000640 1 -- 172.21.15.7:0/2441107801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc056060 con 0x557a08f223c0 2024-04-23T14:56:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbebe000640 1 -- 172.21.15.7:0/2441107801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fbecc0317d0 con 0x557a08f223c0 2024-04-23T14:56:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.753+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a08e90190 con 0x557a08f223c0 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbebe000640 1 -- 172.21.15.7:0/2441107801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbecc05d050 con 0x557a08f223c0 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 10 client.16035 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557a08fa3600 con 0x557a08f223c0 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbebe000640 1 -- 172.21.15.7:0/2441107801 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x557a08e90190 con 0x557a08f223c0 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbebe000640 1 -- 172.21.15.7:0/2441107801 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbecc0046c0 con 0x557a08f223c0 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 10 client.16035 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 20 client.16035 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08fa3d80 0x557a08fa61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 4 client.16035 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:56:15.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.754+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a08e0c4b0 con 0x557a08fa3d80 2024-04-23T14:56:15.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.755+0000 7fbed7e00640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08fa3d80 0x557a08fa61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:15.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.756+0000 7fbed7e00640 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08fa3d80 0x557a08fa61a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9929db36b17e00d server_cookie=b61921f17fa52c49 in_seq=0 out_seq=0 2024-04-23T14:56:15.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.756+0000 7fbebe000640 10 client.16035 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.782+0000 7fbebe000640 1 -- 172.21.15.7:0/2441107801 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a08e0c4b0 con 0x557a08fa3d80 2024-04-23T14:56:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.782+0000 7fbebe000640 10 client.16035 handle_command_reply: tid=0 2024-04-23T14:56:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.782+0000 7fbee218c740 1 client.16035 shutdown 2024-04-23T14:56:15.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 msgr2=0x557a08f307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f307a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009900 tx=0x7fbecc005360 comp rx=0 tx=0).stop 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 shutdown_connections 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557a08fa3d80 0x557a08fa61a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557a08f22ce0 0x557a08f30ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557a08f2d5a0 0x557a08fa1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbebe000640 0 client.16035 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 --2- 172.21.15.7:0/2441107801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a08f223c0 0x557a08f307a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 >> 172.21.15.7:0/2441107801 conn(0x557a08f1e8d0 msgr2=0x557a08f28df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 shutdown_connections 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.783+0000 7fbee218c740 1 -- 172.21.15.7:0/2441107801 wait complete. 2024-04-23T14:56:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.784+0000 7fbee218c740 20 client.16035 trim_cache size 0 max 16384 2024-04-23T14:56:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:56:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:56:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:56:15.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbec00a3d10 msgr2=0x7fbec00a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbec00a3d10 0x7fbec00a61d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005fd0 tx=0x7fbed0009500 comp rx=0 tx=0).stop 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 msgr2=0x7fbed81a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed81a0ad0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbec400e9f0 tx=0x7fbec400eeb0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 shutdown_connections 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbec00a3d10 0x7fbec00a61d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed810c3e0 0x7fbed819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbed81038e0 0x7fbed81a0ad0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 --2- 172.21.15.7:0/3766312605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed8102fc0 0x7fbed81a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 >> 172.21.15.7:0/3766312605 conn(0x7fbed80fc820 msgr2=0x7fbed8101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 shutdown_connections 2024-04-23T14:56:15.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:15.785+0000 7fbedde00640 1 -- 172.21.15.7:0/3766312605 wait complete. 2024-04-23T14:56:15.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:15 smithi007 ceph-mon[27906]: pgmap v150: 129 pgs: 129 active+clean; 670 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:56:15.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:15 smithi186 ceph-mon[31814]: pgmap v150: 129 pgs: 129 active+clean; 670 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:56:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:15 smithi137 ceph-mon[31694]: pgmap v150: 129 pgs: 129 active+clean; 670 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:56:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:17 smithi007 ceph-mon[27906]: pgmap v151: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T14:56:17.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:17 smithi186 ceph-mon[31814]: pgmap v151: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T14:56:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:17 smithi137 ceph-mon[31694]: pgmap v151: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T14:56:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:19 smithi007 ceph-mon[27906]: pgmap v152: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:19 smithi186 ceph-mon[31814]: pgmap v152: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:19 smithi137 ceph-mon[31694]: pgmap v152: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:21 smithi007 ceph-mon[27906]: pgmap v153: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:21 smithi186 ceph-mon[31814]: pgmap v153: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:21 smithi137 ceph-mon[31694]: pgmap v153: 129 pgs: 129 active+clean; 694 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:23 smithi007 ceph-mon[27906]: pgmap v154: 129 pgs: 129 active+clean; 718 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:56:23.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:23 smithi186 ceph-mon[31814]: pgmap v154: 129 pgs: 129 active+clean; 718 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:56:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:23 smithi137 ceph-mon[31694]: pgmap v154: 129 pgs: 129 active+clean; 718 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:56:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:25 smithi007 ceph-mon[27906]: pgmap v155: 129 pgs: 129 active+clean; 718 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:25.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:25 smithi186 ceph-mon[31814]: pgmap v155: 129 pgs: 129 active+clean; 718 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:25 smithi137 ceph-mon[31694]: pgmap v155: 129 pgs: 129 active+clean; 718 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:56:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:27 smithi007 ceph-mon[27906]: pgmap v156: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:56:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:27 smithi186 ceph-mon[31814]: pgmap v156: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:56:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:27 smithi137 ceph-mon[31694]: pgmap v156: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:56:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.944+0000 7fddf3600640 1 -- 172.21.15.7:0/801559646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec074c20 msgr2=0x7fddec10e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.944+0000 7fddf3600640 1 --2- 172.21.15.7:0/801559646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec074c20 0x7fddec10e3b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009900 tx=0x7fddd802a490 comp rx=0 tx=0).stop 2024-04-23T14:56:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 -- 172.21.15.7:0/801559646 shutdown_connections 2024-04-23T14:56:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 --2- 172.21.15.7:0/801559646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddec10e8f0 0x7fddec110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 --2- 172.21.15.7:0/801559646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec074c20 0x7fddec10e3b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 --2- 172.21.15.7:0/801559646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddec074300 0x7fddec0746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 -- 172.21.15.7:0/801559646 >> 172.21.15.7:0/801559646 conn(0x7fddec079490 msgr2=0x7fddec0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 -- 172.21.15.7:0/801559646 shutdown_connections 2024-04-23T14:56:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.945+0000 7fddf3600640 1 -- 172.21.15.7:0/801559646 wait complete. 2024-04-23T14:56:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.946+0000 7fddf3600640 1 Processor -- start 2024-04-23T14:56:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.946+0000 7fddf3600640 1 -- start start 2024-04-23T14:56:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.946+0000 7fddf3600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddec074300 0x7fddec1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.946+0000 7fddf3600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddec074c20 0x7fddec1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.946+0000 7fddf3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 0x7fddec19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf3600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1144f0 con 0x7fddec10e8f0 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf3600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddec114370 con 0x7fddec074c20 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf3600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fddec114670 con 0x7fddec074300 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 0x7fddec19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 0x7fddec19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43194/0 (socket says 172.21.15.7:43194) 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 -- 172.21.15.7:0/3783340047 learned_addr learned my addr 172.21.15.7:0/3783340047 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf0c00640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddec074300 0x7fddec1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddebe00640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddec074c20 0x7fddec1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 -- 172.21.15.7:0/3783340047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddec074300 msgr2=0x7fddec1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddec074300 0x7fddec1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 -- 172.21.15.7:0/3783340047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddec074c20 msgr2=0x7fddec1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddec074c20 0x7fddec1a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.947+0000 7fddf1600640 1 -- 172.21.15.7:0/3783340047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddec19aff0 con 0x7fddec10e8f0 2024-04-23T14:56:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.948+0000 7fddf1600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 0x7fddec19a730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdde400ea60 tx=0x7fdde400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.948+0000 7fdde9600640 1 -- 172.21.15.7:0/3783340047 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde400ce40 con 0x7fddec10e8f0 2024-04-23T14:56:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.948+0000 7fdde9600640 1 -- 172.21.15.7:0/3783340047 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdde4005020 con 0x7fddec10e8f0 2024-04-23T14:56:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.948+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddec19b2e0 con 0x7fddec10e8f0 2024-04-23T14:56:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.948+0000 7fdde9600640 1 -- 172.21.15.7:0/3783340047 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4010670 con 0x7fddec10e8f0 2024-04-23T14:56:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.948+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddec1a75a0 con 0x7fddec10e8f0 2024-04-23T14:56:28.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.952+0000 7fddf637a740 1 Processor -- start 2024-04-23T14:56:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.953+0000 7fdde9600640 1 -- 172.21.15.7:0/3783340047 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdde40051d0 con 0x7fddec10e8f0 2024-04-23T14:56:28.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.953+0000 7fddf637a740 1 -- start start 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf637a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901e1b0 0x5609e901e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf637a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901ead0 0x5609e9028e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf637a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e902b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf637a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5609e8f84900 con 0x5609e9029390 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf637a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5609e8f2af20 con 0x5609e901ead0 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf637a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5609e8f808c0 con 0x5609e901e1b0 2024-04-23T14:56:28.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e902b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e902b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43202/0 (socket says 172.21.15.7:43202) 2024-04-23T14:56:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddebe00640 1 -- 172.21.15.7:0/2885039883 learned_addr learned my addr 172.21.15.7:0/2885039883 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddf0c00640 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901ead0 0x5609e9028e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.954+0000 7fddebe00640 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901e1b0 0x5609e901e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fdde9600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fddd40a3dc0 0x7fddd40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddf0c00640 1 -- 172.21.15.7:0/2885039883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901e1b0 msgr2=0x5609e901e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddf0c00640 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901e1b0 0x5609e901e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddf0c00640 1 -- 172.21.15.7:0/2885039883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 msgr2=0x5609e902b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddf0c00640 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e902b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddf0c00640 1 -- 172.21.15.7:0/2885039883 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e8f4fe10 con 0x5609e901ead0 2024-04-23T14:56:28.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fdde9600640 1 -- 172.21.15.7:0/3783340047 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fdde40d1130 con 0x7fddec10e8f0 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddebe00640 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e902b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.955+0000 7fddf1600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fddd40a3dc0 0x7fddd40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.956+0000 7fddf0c00640 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901ead0 0x5609e9028e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009b70 tx=0x7fdde00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6383a195231560 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.956+0000 7fddf1600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fddd40a3dc0 0x7fddd40a6280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009730 tx=0x7fdde40096c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.956+0000 7fddddc00640 1 -- 172.21.15.7:0/2885039883 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0009e60 con 0x5609e901ead0 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.956+0000 7fddddc00640 1 -- 172.21.15.7:0/2885039883 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdde0012900 con 0x5609e901ead0 2024-04-23T14:56:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.956+0000 7fddddc00640 1 -- 172.21.15.7:0/2885039883 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde000f960 con 0x5609e901ead0 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 -- 172.21.15.7:0/2885039883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901ead0 msgr2=0x5609e9028e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901ead0 0x5609e9028e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009b70 tx=0x7fdde00117b0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 -- 172.21.15.7:0/2885039883 shutdown_connections 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901ead0 0x5609e9028e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e902b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 --2- 172.21.15.7:0/2885039883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901e1b0 0x5609e901e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 -- 172.21.15.7:0/2885039883 >> 172.21.15.7:0/2885039883 conn(0x5609e901a6c0 msgr2=0x5609e901aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 -- 172.21.15.7:0/2885039883 shutdown_connections 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.957+0000 7fddf637a740 1 -- 172.21.15.7:0/2885039883 wait complete. 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.958+0000 7fddf637a740 1 -- start start 2024-04-23T14:56:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.958+0000 7fddf637a740 1 Processor -- start 2024-04-23T14:56:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.958+0000 7fddf637a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e90262a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf637a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 0x5609e90267e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf637a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e9029390 0x5609e9026d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf637a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5609e902bfc0 con 0x5609e901ead0 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf637a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5609e8f3e2c0 con 0x5609e901e1b0 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf637a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5609e902c140 con 0x5609e9029390 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf637a740 10 client.0 _ll_register_callbacks cb 0x5609e8c96a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 0x5609e90267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 0x5609e90267e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43208/0 (socket says 172.21.15.7:43208) 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 -- 172.21.15.7:0/108445159 learned_addr learned my addr 172.21.15.7:0/108445159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddebe00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e90262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddebe00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e9029390 0x5609e9026d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 -- 172.21.15.7:0/108445159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e9029390 msgr2=0x5609e9026d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e9029390 0x5609e9026d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 -- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 msgr2=0x5609e90262a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e90262a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddf0c00640 1 -- 172.21.15.7:0/108445159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e8f4efd0 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.959+0000 7fddebe00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e9029390 0x5609e9026d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.960+0000 7fddf0c00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 0x5609e90267e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdde00126e0 tx=0x7fdde0012710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f2754d601d4a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.960+0000 7fddd2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.960+0000 7fddd2000640 1 -- 172.21.15.7:0/108445159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0028070 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.960+0000 7fddd2000640 1 -- 172.21.15.7:0/108445159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fdde0005040 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.960+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdde0012900 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddd2000640 1 -- 172.21.15.7:0/108445159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdde0034050 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 10 client.16047 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5609e8c97210 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddd2000640 1 -- 172.21.15.7:0/108445159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdde0012900 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddd2000640 1 -- 172.21.15.7:0/108445159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdde0004b90 con 0x5609e901ead0 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 10 client.16047 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 20 client.16047 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90393a0 0x5609e903b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 4 client.16047 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:56:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.961+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609e8f92320 con 0x5609e90393a0 2024-04-23T14:56:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.962+0000 7fddebe00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90393a0 0x5609e903b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.963+0000 7fddebe00640 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90393a0 0x5609e903b790 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4570b5b2c33c88 server_cookie=de3562608cc98776 in_seq=0 out_seq=0 2024-04-23T14:56:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.963+0000 7fddd2000640 10 client.16047 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddd2000640 1 -- 172.21.15.7:0/108445159 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5609e8f92320 con 0x5609e90393a0 2024-04-23T14:56:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddd2000640 10 client.16047 handle_command_reply: tid=0 2024-04-23T14:56:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 client.16047 shutdown 2024-04-23T14:56:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 msgr2=0x5609e90267e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 0x5609e90267e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdde00126e0 tx=0x7fdde0012710 comp rx=0 tx=0).stop 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 shutdown_connections 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90393a0 0x5609e903b790 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e9029390 0x5609e9026d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901ead0 0x5609e90267e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 --2- 172.21.15.7:0/108445159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e90262a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddd2000640 0 client.16047 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 >> 172.21.15.7:0/108445159 conn(0x5609e901a6c0 msgr2=0x5609e90203f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 shutdown_connections 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.965+0000 7fddf637a740 1 -- 172.21.15.7:0/108445159 wait complete. 2024-04-23T14:56:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.966+0000 7fddf637a740 20 client.16047 trim_cache size 0 max 16384 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.983+0000 7fddf637a740 1 Processor -- start 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.983+0000 7fddf637a740 1 -- start start 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf637a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 0x5609e9034e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf637a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9026970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf637a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e9029390 0x5609e9040dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf637a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1b1570 con 0x5609e901e1b0 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf637a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1b30b0 con 0x5609e9029390 2024-04-23T14:56:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf637a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1b1c40 con 0x5609e901ead0 2024-04-23T14:56:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 0x5609e9034e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 0x5609e9034e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43218/0 (socket says 172.21.15.7:43218) 2024-04-23T14:56:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddebe00640 1 -- 172.21.15.7:0/1660122282 learned_addr learned my addr 172.21.15.7:0/1660122282 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddebe00640 1 -- 172.21.15.7:0/1660122282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 msgr2=0x5609e9026970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddf0c00640 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9026970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.984+0000 7fddebe00640 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9026970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fddebe00640 1 -- 172.21.15.7:0/1660122282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e9029390 msgr2=0x5609e9040dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fddebe00640 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e9029390 0x5609e9040dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fddebe00640 1 -- 172.21.15.7:0/1660122282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e8d63620 con 0x5609e901e1b0 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fddebe00640 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 0x5609e9034e80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fddd802a9b0 tx=0x7fddd8040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0550f59bf9b5b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fdddd200640 1 -- 172.21.15.7:0/1660122282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8035040 con 0x5609e901e1b0 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fdddd200640 1 -- 172.21.15.7:0/1660122282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddd804a890 con 0x5609e901e1b0 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.985+0000 7fdddd200640 1 -- 172.21.15.7:0/1660122282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8031700 con 0x5609e901e1b0 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 -- 172.21.15.7:0/1660122282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 msgr2=0x5609e9034e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 0x5609e9034e80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fddd802a9b0 tx=0x7fddd8040040 comp rx=0 tx=0).stop 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 -- 172.21.15.7:0/1660122282 shutdown_connections 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e9029390 0x5609e9040dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9026970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 --2- 172.21.15.7:0/1660122282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e901e1b0 0x5609e9034e80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 -- 172.21.15.7:0/1660122282 >> 172.21.15.7:0/1660122282 conn(0x5609e901a6c0 msgr2=0x5609e9026260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 -- 172.21.15.7:0/1660122282 shutdown_connections 2024-04-23T14:56:28.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.986+0000 7fddf637a740 1 -- 172.21.15.7:0/1660122282 wait complete. 2024-04-23T14:56:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.987+0000 7fddf637a740 1 -- start start 2024-04-23T14:56:28.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.987+0000 7fddf637a740 1 Processor -- start 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e9023130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9023670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e9023bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1b29e0 con 0x5609e9029390 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1b2310 con 0x5609e901e1b0 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fddec1af550 con 0x5609e901ead0 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf637a740 10 client.0 _ll_register_callbacks cb 0x7fdde0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e9023bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e9023bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43224/0 (socket says 172.21.15.7:43224) 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddebe00640 1 -- 172.21.15.7:0/187016900 learned_addr learned my addr 172.21.15.7:0/187016900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddebe00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e9023130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddf0c00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9023670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.988+0000 7fddebe00640 1 -- 172.21.15.7:0/187016900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 msgr2=0x5609e9023670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddebe00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9023670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddebe00640 1 -- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 msgr2=0x5609e9023130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddebe00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e9023130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddebe00640 1 -- 172.21.15.7:0/187016900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e909e830 con 0x5609e9029390 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddf0c00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9023670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddebe00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e9023bb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009a20 tx=0x7fddd804aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85564c40b3f96075 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddd2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddd2000640 1 -- 172.21.15.7:0/187016900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8035030 con 0x5609e9029390 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddd2000640 1 -- 172.21.15.7:0/187016900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fddd80037f0 con 0x5609e9029390 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.989+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd804a890 con 0x5609e9029390 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddd2000640 1 -- 172.21.15.7:0/187016900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fddd80039f0 con 0x5609e9029390 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 10 client.16053 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:28.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5609e909fb00 con 0x5609e9029390 2024-04-23T14:56:28.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddd2000640 1 -- 172.21.15.7:0/187016900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddd804a890 con 0x5609e9029390 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddd2000640 1 -- 172.21.15.7:0/187016900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fddd8047030 con 0x5609e9029390 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 10 client.16053 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 20 client.16053 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90a0150 0x5609e90a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 4 client.16053 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.990+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5609e8f8c190 con 0x5609e90a0150 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.991+0000 7fddf0c00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90a0150 0x5609e90a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.992+0000 7fddf0c00640 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90a0150 0x5609e90a2570 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b757fa7504a5d35 server_cookie=382dd6a532177944 in_seq=0 out_seq=0 2024-04-23T14:56:28.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:28.992+0000 7fddd2000640 10 client.16053 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddd2000640 1 -- 172.21.15.7:0/187016900 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5609e8f8c190 con 0x5609e90a0150 2024-04-23T14:56:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddd2000640 10 client.16053 handle_command_reply: tid=0 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 client.16053 shutdown 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 msgr2=0x5609e9023bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e9023bb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009a20 tx=0x7fddd804aa40 comp rx=0 tx=0).stop 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 shutdown_connections 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5609e90a0150 0x5609e90a2570 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5609e9029390 0x5609e9023bb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5609e901ead0 0x5609e9023670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 --2- 172.21.15.7:0/187016900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5609e901e1b0 0x5609e9023130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 >> 172.21.15.7:0/187016900 conn(0x5609e901a6c0 msgr2=0x5609e9026ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddd2000640 0 client.16053 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 shutdown_connections 2024-04-23T14:56:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.017+0000 7fddf637a740 1 -- 172.21.15.7:0/187016900 wait complete. 2024-04-23T14:56:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.018+0000 7fddf637a740 20 client.16053 trim_cache size 0 max 16384 2024-04-23T14:56:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:56:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:56:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:56:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fddd40a3dc0 msgr2=0x7fddd40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fddd40a3dc0 0x7fddd40a6280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009730 tx=0x7fdde40096c0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 msgr2=0x7fddec19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 0x7fddec19a730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdde400ea60 tx=0x7fdde400ef20 comp rx=0 tx=0).stop 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 shutdown_connections 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fddd40a3dc0 0x7fddd40a6280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddec074c20 0x7fddec1a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddec10e8f0 0x7fddec19a730 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 --2- 172.21.15.7:0/3783340047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddec074300 0x7fddec1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 >> 172.21.15.7:0/3783340047 conn(0x7fddec079490 msgr2=0x7fddec0feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 shutdown_connections 2024-04-23T14:56:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:29.019+0000 7fddf3600640 1 -- 172.21.15.7:0/3783340047 wait complete. 2024-04-23T14:56:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:29 smithi007 ceph-mon[27906]: pgmap v157: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:56:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:29 smithi186 ceph-mon[31814]: pgmap v157: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:56:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:29 smithi137 ceph-mon[31694]: pgmap v157: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:56:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:31 smithi007 ceph-mon[27906]: pgmap v158: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:56:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:31 smithi186 ceph-mon[31814]: pgmap v158: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:56:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:31 smithi137 ceph-mon[31694]: pgmap v158: 129 pgs: 129 active+clean; 738 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:56:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:33 smithi007 ceph-mon[27906]: pgmap v159: 129 pgs: 129 active+clean; 762 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:56:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:33 smithi186 ceph-mon[31814]: pgmap v159: 129 pgs: 129 active+clean; 762 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:56:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:33 smithi137 ceph-mon[31694]: pgmap v159: 129 pgs: 129 active+clean; 762 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:56:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:35 smithi007 ceph-mon[27906]: pgmap v160: 129 pgs: 129 active+clean; 762 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:56:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:35 smithi186 ceph-mon[31814]: pgmap v160: 129 pgs: 129 active+clean; 762 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:56:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:35 smithi137 ceph-mon[31694]: pgmap v160: 129 pgs: 129 active+clean; 762 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:56:37.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:37 smithi186 ceph-mon[31814]: pgmap v161: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T14:56:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:37 smithi137 ceph-mon[31694]: pgmap v161: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T14:56:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:37 smithi007 ceph-mon[27906]: pgmap v161: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T14:56:38.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:38.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:39 smithi186 ceph-mon[31814]: pgmap v162: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:39 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:39 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:39 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:56:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:39 smithi137 ceph-mon[31694]: pgmap v162: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:39.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:39 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:39.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:39 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:39.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:39 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:56:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:39 smithi007 ceph-mon[27906]: pgmap v162: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:39 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:39 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:39 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:56:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:41 smithi186 ceph-mon[31814]: pgmap v163: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:41 smithi137 ceph-mon[31694]: pgmap v163: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:41 smithi007 ceph-mon[27906]: pgmap v163: 129 pgs: 129 active+clean; 786 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:56:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 -- 172.21.15.7:0/53648567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5694102a40 msgr2=0x7f5694106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 --2- 172.21.15.7:0/53648567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5694102a40 0x7f5694106a80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c02a410 comp rx=0 tx=0).stop 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 -- 172.21.15.7:0/53648567 shutdown_connections 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 --2- 172.21.15.7:0/53648567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5694107160 0x7f569410ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 --2- 172.21.15.7:0/53648567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5694102a40 0x7f5694106a80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 --2- 172.21.15.7:0/53648567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694102090 0x7f5694102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 -- 172.21.15.7:0/53648567 >> 172.21.15.7:0/53648567 conn(0x7f56940fd950 msgr2=0x7f56940ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 -- 172.21.15.7:0/53648567 shutdown_connections 2024-04-23T14:56:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.173+0000 7f5693e00640 1 -- 172.21.15.7:0/53648567 wait complete. 2024-04-23T14:56:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.174+0000 7f5693e00640 1 Processor -- start 2024-04-23T14:56:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 -- start start 2024-04-23T14:56:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694102090 0x7f56941a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5694107160 0x7f56941a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 0x7f569419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5694112080 con 0x7f569419a760 2024-04-23T14:56:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5694111f00 con 0x7f5694102090 2024-04-23T14:56:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.175+0000 7f5693e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5694112200 con 0x7f5694107160 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 0x7f569419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 0x7f569419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53790/0 (socket says 172.21.15.7:53790) 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 -- 172.21.15.7:0/1998164047 learned_addr learned my addr 172.21.15.7:0/1998164047 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5692a00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694102090 0x7f56941a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f568be00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5694107160 0x7f56941a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 -- 172.21.15.7:0/1998164047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5694107160 msgr2=0x7f56941a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5694107160 0x7f56941a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 -- 172.21.15.7:0/1998164047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694102090 msgr2=0x7f56941a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694102090 0x7f56941a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.176+0000 7f5693400640 1 -- 172.21.15.7:0/1998164047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569419b360 con 0x7f569419a760 2024-04-23T14:56:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.177+0000 7f5693400640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 0x7f569419abe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f568c00eaa0 tx=0x7f568c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.177+0000 7f568b400640 1 -- 172.21.15.7:0/1998164047 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c00cdb0 con 0x7f569419a760 2024-04-23T14:56:42.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.177+0000 7f568b400640 1 -- 172.21.15.7:0/1998164047 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f568c005020 con 0x7f569419a760 2024-04-23T14:56:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.177+0000 7f568b400640 1 -- 172.21.15.7:0/1998164047 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c0116d0 con 0x7f569419a760 2024-04-23T14:56:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.177+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56941a73f0 con 0x7f569419a760 2024-04-23T14:56:42.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.177+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941a77a0 con 0x7f569419a760 2024-04-23T14:56:42.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.181+0000 7f568b400640 1 -- 172.21.15.7:0/1998164047 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f568c0051d0 con 0x7f569419a760 2024-04-23T14:56:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.182+0000 7f569cb9d740 1 Processor -- start 2024-04-23T14:56:42.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.182+0000 7f569cb9d740 1 -- start start 2024-04-23T14:56:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7662f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7663a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7663c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f569cb9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f76595900 con 0x564f7663a5a0 2024-04-23T14:56:42.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f569cb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564f7653bf20 con 0x564f7662fce0 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f569cb9d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564f765918c0 con 0x564f7662f3c0 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f568be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7663c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f568be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7663c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53792/0 (socket says 172.21.15.7:53792) 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f568be00640 1 -- 172.21.15.7:0/1133479976 learned_addr learned my addr 172.21.15.7:0/1133479976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f568b400640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f56780a3d10 0x7f56780a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f5692a00640 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7663a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.183+0000 7f568be00640 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7662f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568b400640 1 -- 172.21.15.7:0/1998164047 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f568c0d0cb0 con 0x7f569419a760 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f5693400640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f56780a3d10 0x7f56780a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568be00640 1 -- 172.21.15.7:0/1133479976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 msgr2=0x564f7662f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568be00640 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7662f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568be00640 1 -- 172.21.15.7:0/1133479976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 msgr2=0x564f7663a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568be00640 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7663a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568be00640 1 -- 172.21.15.7:0/1133479976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f76560e10 con 0x564f7663a5a0 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.184+0000 7f568be00640 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7663c990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec52a0229808f29 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.185+0000 7f5693400640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f56780a3d10 0x7f56780a61d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f568c099310 tx=0x7f568c00cf50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.185+0000 7f5683e00640 1 -- 172.21.15.7:0/1133479976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035070 con 0x564f7663a5a0 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.185+0000 7f5683e00640 1 -- 172.21.15.7:0/1133479976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f567c004030 con 0x564f7663a5a0 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.185+0000 7f5683e00640 1 -- 172.21.15.7:0/1133479976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0039f0 con 0x564f7663a5a0 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 -- 172.21.15.7:0/1133479976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 msgr2=0x564f7663c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7663c990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c005780 comp rx=0 tx=0).stop 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 -- 172.21.15.7:0/1133479976 shutdown_connections 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7663a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7663c990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1133479976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7662f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 -- 172.21.15.7:0/1133479976 >> 172.21.15.7:0/1133479976 conn(0x564f7662b8d0 msgr2=0x564f7662bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 -- 172.21.15.7:0/1133479976 shutdown_connections 2024-04-23T14:56:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 -- 172.21.15.7:0/1133479976 wait complete. 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.186+0000 7f569cb9d740 1 -- start start 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 Processor -- start 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76637660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662fce0 0x564f76637ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f766380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f7663d080 con 0x564f7663a5a0 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564f7654f2c0 con 0x564f7662f3c0 2024-04-23T14:56:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564f7663d200 con 0x564f7662fce0 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.187+0000 7f569cb9d740 10 client.0 _ll_register_callbacks cb 0x564f762a7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f766380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f766380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53798/0 (socket says 172.21.15.7:53798) 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 -- 172.21.15.7:0/381954179 learned_addr learned my addr 172.21.15.7:0/381954179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f5692a00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662fce0 0x564f76637ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76637660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 -- 172.21.15.7:0/381954179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662fce0 msgr2=0x564f76637ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662fce0 0x564f76637ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 -- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 msgr2=0x564f76637660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76637660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.188+0000 7f568be00640 1 -- 172.21.15.7:0/381954179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f7655ffd0 con 0x564f7663a5a0 2024-04-23T14:56:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f568be00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f766380e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f567c032c00 tx=0x7f567c041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6b97b67bbda2a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f5680c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f5680c00640 1 -- 172.21.15.7:0/381954179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c04e030 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f567c004030 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f5680c00640 1 -- 172.21.15.7:0/381954179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f567c0035f0 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f5680c00640 1 -- 172.21.15.7:0/381954179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f567c035070 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f569cb9d740 10 client.16065 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.189+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564f762a8210 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f5680c00640 1 -- 172.21.15.7:0/381954179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f567c004030 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f5680c00640 1 -- 172.21.15.7:0/381954179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f567c03d750 con 0x564f7663a5a0 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f569cb9d740 10 client.16065 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f569cb9d740 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f569cb9d740 20 client.16065 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f569cb9d740 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f7664a670 0x564f7664ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f569cb9d740 4 client.16065 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:56:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.190+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f765a3320 con 0x564f7664a670 2024-04-23T14:56:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.191+0000 7f5692a00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f7664a670 0x564f7664ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.192+0000 7f5680c00640 10 client.16065 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.192+0000 7f5692a00640 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f7664a670 0x564f7664ca60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e98813c0270f21 server_cookie=b68b4f800df6436f in_seq=0 out_seq=0 2024-04-23T14:56:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.193+0000 7f5680c00640 1 -- 172.21.15.7:0/381954179 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564f765a3320 con 0x564f7664a670 2024-04-23T14:56:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.193+0000 7f5680c00640 10 client.16065 handle_command_reply: tid=0 2024-04-23T14:56:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 client.16065 shutdown 2024-04-23T14:56:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 msgr2=0x564f766380e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f766380e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f567c032c00 tx=0x7f567c041040 comp rx=0 tx=0).stop 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 shutdown_connections 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f7664a670 0x564f7664ca60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f766380e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662fce0 0x564f76637ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 --2- 172.21.15.7:0/381954179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76637660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 >> 172.21.15.7:0/381954179 conn(0x564f7662b8d0 msgr2=0x564f7662aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f5680c00640 0 client.16065 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 shutdown_connections 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 1 -- 172.21.15.7:0/381954179 wait complete. 2024-04-23T14:56:42.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.194+0000 7f569cb9d740 20 client.16065 trim_cache size 0 max 16384 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 Processor -- start 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 -- start start 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76639d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 0x564f7662b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7663a5a0 0x564f76631d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56941b1350 con 0x564f7662fce0 2024-04-23T14:56:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56941b2e90 con 0x564f7662f3c0 2024-04-23T14:56:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f569cb9d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f56941b1a20 con 0x564f7663a5a0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.211+0000 7f5692a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 0x564f7662b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 0x564f7662b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53806/0 (socket says 172.21.15.7:53806) 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 -- 172.21.15.7:0/2643758418 learned_addr learned my addr 172.21.15.7:0/2643758418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f568be00640 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76639d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 -- 172.21.15.7:0/2643758418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7663a5a0 msgr2=0x564f76631d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7663a5a0 0x564f76631d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 -- 172.21.15.7:0/2643758418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 msgr2=0x564f76639d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76639d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 -- 172.21.15.7:0/2643758418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7663cd00 con 0x564f7662fce0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.212+0000 7f5692a00640 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 0x564f7662b210 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5684005d00 tx=0x7f5684005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29d010d38ef9eee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.213+0000 7f5683400640 1 -- 172.21.15.7:0/2643758418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684003d20 con 0x564f7662fce0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.213+0000 7f5683400640 1 -- 172.21.15.7:0/2643758418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5684020520 con 0x564f7662fce0 2024-04-23T14:56:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.213+0000 7f5683400640 1 -- 172.21.15.7:0/2643758418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684010b30 con 0x564f7662fce0 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 -- 172.21.15.7:0/2643758418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 msgr2=0x564f7662b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 0x564f7662b210 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5684005d00 tx=0x7f5684005f90 comp rx=0 tx=0).stop 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 -- 172.21.15.7:0/2643758418 shutdown_connections 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7663a5a0 0x564f76631d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7662fce0 0x564f7662b210 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 --2- 172.21.15.7:0/2643758418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662f3c0 0x564f76639d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 -- 172.21.15.7:0/2643758418 >> 172.21.15.7:0/2643758418 conn(0x564f7662b8d0 msgr2=0x564f76632920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 -- 172.21.15.7:0/2643758418 shutdown_connections 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 -- 172.21.15.7:0/2643758418 wait complete. 2024-04-23T14:56:42.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.214+0000 7f569cb9d740 1 -- start start 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 Processor -- start 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7664f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7664f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7664ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56941b27c0 con 0x564f7663a5a0 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56941b20f0 con 0x564f7662fce0 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f56941af330 con 0x564f7662f3c0 2024-04-23T14:56:42.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f569cb9d740 10 client.0 _ll_register_callbacks cb 0x7f567c032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f568be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7664ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f568be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7664ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53822/0 (socket says 172.21.15.7:53822) 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.215+0000 7f568be00640 1 -- 172.21.15.7:0/1942702829 learned_addr learned my addr 172.21.15.7:0/1942702829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7664f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f5692a00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7664f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 -- 172.21.15.7:0/1942702829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 msgr2=0x564f7664f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7664f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 -- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 msgr2=0x564f7664f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7664f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 -- 172.21.15.7:0/1942702829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f76374620 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f568be00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7664ca90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f567c004650 tx=0x7f567c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b99139ecf4b6d84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f5680c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f5680c00640 1 -- 172.21.15.7:0/1942702829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c04e040 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5684020520 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.216+0000 7f5680c00640 1 -- 172.21.15.7:0/1942702829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f567c0043f0 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f5680c00640 1 -- 172.21.15.7:0/1942702829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f567c009520 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 10 client.16071 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564f766b01c0 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f5680c00640 1 -- 172.21.15.7:0/1942702829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5684020520 con 0x564f7663a5a0 2024-04-23T14:56:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f5680c00640 1 -- 172.21.15.7:0/1942702829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f567c005030 con 0x564f7663a5a0 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 10 client.16071 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 20 client.16071 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f766b0930 0x564f766b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 4 client.16071 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.217+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f7659d190 con 0x564f766b0930 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.218+0000 7f5692a00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f766b0930 0x564f766b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:42.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.219+0000 7f5692a00640 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f766b0930 0x564f766b2d20 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=172bd05c9e49e9a8 server_cookie=f21aa6489ecef4ee in_seq=0 out_seq=0 2024-04-23T14:56:42.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.219+0000 7f5680c00640 10 client.16071 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f5680c00640 1 -- 172.21.15.7:0/1942702829 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f7659d190 con 0x564f766b0930 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f5680c00640 10 client.16071 handle_command_reply: tid=0 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 client.16071 shutdown 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 msgr2=0x564f7664ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7664ca90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f567c004650 tx=0x7f567c031400 comp rx=0 tx=0).stop 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 shutdown_connections 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564f766b0930 0x564f766b2d20 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564f7662fce0 0x564f7664f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f7663a5a0 0x564f7664ca90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 --2- 172.21.15.7:0/1942702829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564f7662f3c0 0x564f7664f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f5680c00640 0 client.16071 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.249+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 >> 172.21.15.7:0/1942702829 conn(0x564f7662b8d0 msgr2=0x564f76637620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.250+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 shutdown_connections 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.250+0000 7f569cb9d740 1 -- 172.21.15.7:0/1942702829 wait complete. 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.250+0000 7f569cb9d740 20 client.16071 trim_cache size 0 max 16384 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:56:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:56:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:56:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:56:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f56780a3d10 msgr2=0x7f56780a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f56780a3d10 0x7f56780a61d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f568c099310 tx=0x7f568c00cf50 comp rx=0 tx=0).stop 2024-04-23T14:56:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 msgr2=0x7f569419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 0x7f569419abe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f568c00eaa0 tx=0x7f568c00ef60 comp rx=0 tx=0).stop 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 shutdown_connections 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f56780a3d10 0x7f56780a61d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f569419a760 0x7f569419abe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5694107160 0x7f56941a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 --2- 172.21.15.7:0/1998164047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694102090 0x7f56941a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 >> 172.21.15.7:0/1998164047 conn(0x7f56940fd950 msgr2=0x7f56940fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 shutdown_connections 2024-04-23T14:56:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:42.251+0000 7f5693e00640 1 -- 172.21.15.7:0/1998164047 wait complete. 2024-04-23T14:56:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:43 smithi137 ceph-mon[31694]: pgmap v164: 129 pgs: 129 active+clean; 814 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T14:56:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:43 smithi007 ceph-mon[27906]: pgmap v164: 129 pgs: 129 active+clean; 814 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T14:56:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:43 smithi186 ceph-mon[31814]: pgmap v164: 129 pgs: 129 active+clean; 814 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T14:56:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:45 smithi137 ceph-mon[31694]: pgmap v165: 129 pgs: 129 active+clean; 814 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T14:56:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:45 smithi007 ceph-mon[27906]: pgmap v165: 129 pgs: 129 active+clean; 814 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T14:56:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:45 smithi186 ceph-mon[31814]: pgmap v165: 129 pgs: 129 active+clean; 814 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T14:56:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:47 smithi137 ceph-mon[31694]: pgmap v166: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 18 op/s 2024-04-23T14:56:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:47 smithi007 ceph-mon[27906]: pgmap v166: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 18 op/s 2024-04-23T14:56:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:47 smithi186 ceph-mon[31814]: pgmap v166: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 18 op/s 2024-04-23T14:56:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:49 smithi137 ceph-mon[31694]: pgmap v167: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:49 smithi007 ceph-mon[27906]: pgmap v167: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:50.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:49 smithi186 ceph-mon[31814]: pgmap v167: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:51 smithi137 ceph-mon[31694]: pgmap v168: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:51 smithi007 ceph-mon[27906]: pgmap v168: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:52.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:51 smithi186 ceph-mon[31814]: pgmap v168: 129 pgs: 129 active+clean; 839 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:53.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:53 smithi137 ceph-mon[31694]: pgmap v169: 129 pgs: 129 active+clean; 867 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:56:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:53 smithi007 ceph-mon[27906]: pgmap v169: 129 pgs: 129 active+clean; 867 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:56:54.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:53 smithi186 ceph-mon[31814]: pgmap v169: 129 pgs: 129 active+clean; 867 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 -- 172.21.15.7:0/2794986358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076e50 msgr2=0x7fc220112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 --2- 172.21.15.7:0/2794986358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076e50 0x7fc220112790 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc208009900 tx=0x7fc20802a3f0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 -- 172.21.15.7:0/2794986358 shutdown_connections 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 --2- 172.21.15.7:0/2794986358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220112cd0 0x7fc2201150c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 --2- 172.21.15.7:0/2794986358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076e50 0x7fc220112790 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 --2- 172.21.15.7:0/2794986358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220076530 0x7fc220076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 -- 172.21.15.7:0/2794986358 >> 172.21.15.7:0/2794986358 conn(0x7fc2200ffae0 msgr2=0x7fc220101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 -- 172.21.15.7:0/2794986358 shutdown_connections 2024-04-23T14:56:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.405+0000 7fc225a00640 1 -- 172.21.15.7:0/2794986358 wait complete. 2024-04-23T14:56:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.407+0000 7fc225a00640 1 Processor -- start 2024-04-23T14:56:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.407+0000 7fc225a00640 1 -- start start 2024-04-23T14:56:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 0x7fc2201a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220076e50 0x7fc2201a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220112cd0 0x7fc22019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201186e0 con 0x7fc220076530 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc220118560 con 0x7fc220112cd0 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc220118860 con 0x7fc220076e50 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 0x7fc2201a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 0x7fc2201a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37160/0 (socket says 172.21.15.7:37160) 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 -- 172.21.15.7:0/2648346965 learned_addr learned my addr 172.21.15.7:0/2648346965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc217e00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220076e50 0x7fc2201a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225000640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220112cd0 0x7fc22019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 -- 172.21.15.7:0/2648346965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220076e50 msgr2=0x7fc2201a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220076e50 0x7fc2201a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 -- 172.21.15.7:0/2648346965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220112cd0 msgr2=0x7fc22019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220112cd0 0x7fc22019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc21fe00640 1 -- 172.21.15.7:0/2648346965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22019f260 con 0x7fc220076530 2024-04-23T14:56:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc217e00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220076e50 0x7fc2201a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.408+0000 7fc225000640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220112cd0 0x7fc22019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.409+0000 7fc21fe00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 0x7fc2201a48e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc21000d950 tx=0x7fc21000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.409+0000 7fc21d600640 1 -- 172.21.15.7:0/2648346965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210017070 con 0x7fc220076530 2024-04-23T14:56:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.409+0000 7fc21d600640 1 -- 172.21.15.7:0/2648346965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc210009c30 con 0x7fc220076530 2024-04-23T14:56:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.409+0000 7fc21d600640 1 -- 172.21.15.7:0/2648346965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21000f620 con 0x7fc220076530 2024-04-23T14:56:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.409+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22019f550 con 0x7fc220076530 2024-04-23T14:56:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.409+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2201ab7a0 con 0x7fc220076530 2024-04-23T14:56:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.413+0000 7fc21d600640 1 -- 172.21.15.7:0/2648346965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc2100109a0 con 0x7fc220076530 2024-04-23T14:56:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 Processor -- start 2024-04-23T14:56:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 -- start start 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac82f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac83a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac83c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5561ac795900 con 0x5561ac83a5a0 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5561ac73bf20 con 0x5561ac82f3c0 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.414+0000 7fc229e63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5561ac7918c0 con 0x5561ac82fce0 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac83c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac83c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37166/0 (socket says 172.21.15.7:37166) 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 -- 172.21.15.7:0/290258135 learned_addr learned my addr 172.21.15.7:0/290258135 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc21fe00640 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac83a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc225000640 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac82f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc21d600640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2040a3d90 0x7fc2040a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 -- 172.21.15.7:0/290258135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 msgr2=0x5561ac83a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac83a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 -- 172.21.15.7:0/290258135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 msgr2=0x5561ac82f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac82f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc217e00640 1 -- 172.21.15.7:0/290258135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ac760e10 con 0x5561ac83a5a0 2024-04-23T14:56:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.415+0000 7fc21d600640 1 -- 172.21.15.7:0/2648346965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fc2100d0820 con 0x7fc220076530 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.416+0000 7fc225000640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2040a3d90 0x7fc2040a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.416+0000 7fc217e00640 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac83c990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc208006010 tx=0x7fc208032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86626b39358db51 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.416+0000 7fc215600640 1 -- 172.21.15.7:0/290258135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20803f070 con 0x5561ac83a5a0 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.416+0000 7fc215600640 1 -- 172.21.15.7:0/290258135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc208031630 con 0x5561ac83a5a0 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.416+0000 7fc215600640 1 -- 172.21.15.7:0/290258135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208035070 con 0x5561ac83a5a0 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 -- 172.21.15.7:0/290258135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 msgr2=0x5561ac83c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc225000640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2040a3d90 0x7fc2040a6250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc22006b1d0 tx=0x7fc218004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac83c990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc208006010 tx=0x7fc208032c70 comp rx=0 tx=0).stop 2024-04-23T14:56:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 -- 172.21.15.7:0/290258135 shutdown_connections 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac83c990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac83a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 --2- 172.21.15.7:0/290258135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac82f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.417+0000 7fc229e63740 1 -- 172.21.15.7:0/290258135 >> 172.21.15.7:0/290258135 conn(0x5561ac82b8d0 msgr2=0x5561ac82bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.418+0000 7fc229e63740 1 -- 172.21.15.7:0/290258135 shutdown_connections 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.418+0000 7fc229e63740 1 -- 172.21.15.7:0/290258135 wait complete. 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.418+0000 7fc229e63740 1 -- start start 2024-04-23T14:56:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.418+0000 7fc229e63740 1 Processor -- start 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac837640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac837b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac8380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5561ac83cfc0 con 0x5561ac83a5a0 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5561ac74f2c0 con 0x5561ac82f3c0 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5561ac83d140 con 0x5561ac82fce0 2024-04-23T14:56:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc229e63740 10 client.0 _ll_register_callbacks cb 0x5561ac4a7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc225000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac8380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc225000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac8380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37176/0 (socket says 172.21.15.7:37176) 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc225000640 1 -- 172.21.15.7:0/3272239033 learned_addr learned my addr 172.21.15.7:0/3272239033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc21fe00640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac837640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.419+0000 7fc217e00640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac837b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc225000640 1 -- 172.21.15.7:0/3272239033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 msgr2=0x5561ac837b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc225000640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac837b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc225000640 1 -- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 msgr2=0x5561ac837640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc225000640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac837640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc225000640 1 -- 172.21.15.7:0/3272239033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ac75ffd0 con 0x5561ac83a5a0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc225000640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac8380c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc2180128a0 tx=0x7fc218004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0edfdd2adb17d25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.420+0000 7fc20e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.421+0000 7fc20e000640 1 -- 172.21.15.7:0/3272239033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21801ccf0 con 0x5561ac83a5a0 2024-04-23T14:56:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.421+0000 7fc20e000640 1 -- 172.21.15.7:0/3272239033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fc21801d450 con 0x5561ac83a5a0 2024-04-23T14:56:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.421+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc208031630 con 0x5561ac83a5a0 2024-04-23T14:56:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.421+0000 7fc20e000640 1 -- 172.21.15.7:0/3272239033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc218030050 con 0x5561ac83a5a0 2024-04-23T14:56:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.421+0000 7fc229e63740 10 client.16083 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.421+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5561ac4a8210 con 0x5561ac83a5a0 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc20e000640 1 -- 172.21.15.7:0/3272239033 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc208031630 con 0x5561ac83a5a0 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc20e000640 1 -- 172.21.15.7:0/3272239033 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc21801a440 con 0x5561ac83a5a0 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc229e63740 10 client.16083 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc229e63740 10 client.16083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc229e63740 20 client.16083 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc229e63740 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac84a730 0x5561ac84cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc229e63740 4 client.16083 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.422+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561ac7a3320 con 0x5561ac84a730 2024-04-23T14:56:55.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.423+0000 7fc21fe00640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac84a730 0x5561ac84cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.424+0000 7fc21fe00640 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac84a730 0x5561ac84cb40 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c3b83fbbdbe89de server_cookie=cc54673bc13cabc7 in_seq=0 out_seq=0 2024-04-23T14:56:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.424+0000 7fc20e000640 10 client.16083 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.425+0000 7fc20e000640 1 -- 172.21.15.7:0/3272239033 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5561ac7a3320 con 0x5561ac84a730 2024-04-23T14:56:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.425+0000 7fc20e000640 10 client.16083 handle_command_reply: tid=0 2024-04-23T14:56:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 client.16083 shutdown 2024-04-23T14:56:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 msgr2=0x5561ac8380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac8380c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc2180128a0 tx=0x7fc218004ab0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 shutdown_connections 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac84a730 0x5561ac84cb40 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac83a5a0 0x5561ac8380c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac82fce0 0x5561ac837b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 --2- 172.21.15.7:0/3272239033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac837640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 >> 172.21.15.7:0/3272239033 conn(0x5561ac82b8d0 msgr2=0x5561ac82aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc20e000640 0 client.16083 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 shutdown_connections 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 1 -- 172.21.15.7:0/3272239033 wait complete. 2024-04-23T14:56:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.426+0000 7fc229e63740 20 client.16083 trim_cache size 0 max 16384 2024-04-23T14:56:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 Processor -- start 2024-04-23T14:56:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 -- start start 2024-04-23T14:56:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac845fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 0x5561ac830420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac831d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201b57d0 con 0x5561ac82fce0 2024-04-23T14:56:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201b7310 con 0x5561ac82f3c0 2024-04-23T14:56:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.446+0000 7fc229e63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201b5ea0 con 0x5561ac83a5a0 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 0x5561ac830420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 0x5561ac830420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37178/0 (socket says 172.21.15.7:37178) 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 -- 172.21.15.7:0/1207557970 learned_addr learned my addr 172.21.15.7:0/1207557970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc225000640 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac831d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc21fe00640 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac845fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 -- 172.21.15.7:0/1207557970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 msgr2=0x5561ac831d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac831d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 -- 172.21.15.7:0/1207557970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 msgr2=0x5561ac845fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac845fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.447+0000 7fc217e00640 1 -- 172.21.15.7:0/1207557970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561ac836610 con 0x5561ac82fce0 2024-04-23T14:56:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.448+0000 7fc217e00640 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 0x5561ac830420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5561ac82ca60 tx=0x7fc2080092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcdca58c008cd79 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.448+0000 7fc214c00640 1 -- 172.21.15.7:0/1207557970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20804d020 con 0x5561ac82fce0 2024-04-23T14:56:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.448+0000 7fc214c00640 1 -- 172.21.15.7:0/1207557970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2080054f0 con 0x5561ac82fce0 2024-04-23T14:56:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.448+0000 7fc214c00640 1 -- 172.21.15.7:0/1207557970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20803f040 con 0x5561ac82fce0 2024-04-23T14:56:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 -- 172.21.15.7:0/1207557970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 msgr2=0x5561ac830420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 0x5561ac830420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5561ac82ca60 tx=0x7fc2080092d0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 -- 172.21.15.7:0/1207557970 shutdown_connections 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac831d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82fce0 0x5561ac830420 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 --2- 172.21.15.7:0/1207557970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82f3c0 0x5561ac845fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 -- 172.21.15.7:0/1207557970 >> 172.21.15.7:0/1207557970 conn(0x5561ac82b8d0 msgr2=0x5561ac82aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 -- 172.21.15.7:0/1207557970 shutdown_connections 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.449+0000 7fc229e63740 1 -- 172.21.15.7:0/1207557970 wait complete. 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 -- start start 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 Processor -- start 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 0x5561ac8346d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82fce0 0x5561ac834c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac8afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201b6c40 con 0x5561ac82f3c0 2024-04-23T14:56:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201b6570 con 0x5561ac82fce0 2024-04-23T14:56:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201b37b0 con 0x5561ac83a5a0 2024-04-23T14:56:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.450+0000 7fc229e63740 10 client.0 _ll_register_callbacks cb 0x7fc21800df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:56:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 0x5561ac8346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 0x5561ac8346d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37192/0 (socket says 172.21.15.7:37192) 2024-04-23T14:56:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 -- 172.21.15.7:0/3177888444 learned_addr learned my addr 172.21.15.7:0/3177888444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc217e00640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82fce0 0x5561ac834c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc225000640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac8afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 -- 172.21.15.7:0/3177888444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 msgr2=0x5561ac8afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac8afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 -- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82fce0 msgr2=0x5561ac834c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82fce0 0x5561ac834c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.451+0000 7fc21fe00640 1 -- 172.21.15.7:0/3177888444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ac82fb10 con 0x5561ac82f3c0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc21fe00640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 0x5561ac8346d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc210098860 tx=0x7fc210005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7e85803ae72dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc20e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc20e000640 1 -- 172.21.15.7:0/3177888444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210020040 con 0x5561ac82f3c0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc20e000640 1 -- 172.21.15.7:0/3177888444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fc210098a70 con 0x5561ac82f3c0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2080054f0 con 0x5561ac82f3c0 2024-04-23T14:56:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc20e000640 1 -- 172.21.15.7:0/3177888444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc2100a5070 con 0x5561ac82f3c0 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc229e63740 10 client.16089 fetch_fsmap learned FSMap version 32 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5561ac574620 con 0x5561ac82f3c0 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.452+0000 7fc20e000640 1 -- 172.21.15.7:0/3177888444 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2080054f0 con 0x5561ac82f3c0 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc20e000640 1 -- 172.21.15.7:0/3177888444 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc210010460 con 0x5561ac82f3c0 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc229e63740 10 client.16089 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc229e63740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc229e63740 20 client.16089 populate_metadata read hostname 'smithi007' 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc229e63740 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac8b1770 0x5561ac8b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc229e63740 4 client.16089 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561ac79d190 con 0x5561ac8b1770 2024-04-23T14:56:55.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.453+0000 7fc217e00640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac8b1770 0x5561ac8b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.454+0000 7fc217e00640 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac8b1770 0x5561ac8b3b90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff0e46ca0864156 server_cookie=c26addaf6257f97f in_seq=0 out_seq=0 2024-04-23T14:56:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.454+0000 7fc20e000640 10 client.16089 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc20e000640 1 -- 172.21.15.7:0/3177888444 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561ac79d190 con 0x5561ac8b1770 2024-04-23T14:56:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc20e000640 10 client.16089 handle_command_reply: tid=0 2024-04-23T14:56:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 client.16089 shutdown 2024-04-23T14:56:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 msgr2=0x5561ac8346d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 0x5561ac8346d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc210098860 tx=0x7fc210005bd0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 shutdown_connections 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5561ac8b1770 0x5561ac8b3b90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5561ac82fce0 0x5561ac834c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5561ac83a5a0 0x5561ac8afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc20e000640 0 client.16089 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 --2- 172.21.15.7:0/3177888444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561ac82f3c0 0x5561ac8346d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.482+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 >> 172.21.15.7:0/3177888444 conn(0x5561ac82b8d0 msgr2=0x5561ac82aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.483+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 shutdown_connections 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.483+0000 7fc229e63740 1 -- 172.21.15.7:0/3177888444 wait complete. 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.483+0000 7fc229e63740 20 client.16089 trim_cache size 0 max 16384 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:56:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2040a3d90 msgr2=0x7fc2040a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2040a3d90 0x7fc2040a6250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc22006b1d0 tx=0x7fc218004a40 comp rx=0 tx=0).stop 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 msgr2=0x7fc2201a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 0x7fc2201a48e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc21000d950 tx=0x7fc21000de10 comp rx=0 tx=0).stop 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 shutdown_connections 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2040a3d90 0x7fc2040a6250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc220112cd0 0x7fc22019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc220076e50 0x7fc2201a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 --2- 172.21.15.7:0/2648346965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc220076530 0x7fc2201a48e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 >> 172.21.15.7:0/2648346965 conn(0x7fc2200ffae0 msgr2=0x7fc220101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 shutdown_connections 2024-04-23T14:56:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:56:55.484+0000 7fc225a00640 1 -- 172.21.15.7:0/2648346965 wait complete. 2024-04-23T14:56:55.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:55 smithi137 ceph-mon[31694]: pgmap v170: 129 pgs: 129 active+clean; 867 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:55 smithi007 ceph-mon[27906]: pgmap v170: 129 pgs: 129 active+clean; 867 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:55 smithi186 ceph-mon[31814]: pgmap v170: 129 pgs: 129 active+clean; 867 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:56:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:57 smithi137 ceph-mon[31694]: pgmap v171: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T14:56:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:57 smithi007 ceph-mon[27906]: pgmap v171: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T14:56:58.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:57 smithi186 ceph-mon[31814]: pgmap v171: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T14:57:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:56:59 smithi007 ceph-mon[27906]: pgmap v172: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:57:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:56:59 smithi186 ceph-mon[31814]: pgmap v172: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:57:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:56:59 smithi137 ceph-mon[31694]: pgmap v172: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:57:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:01 smithi007 ceph-mon[27906]: pgmap v173: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:57:02.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:01 smithi186 ceph-mon[31814]: pgmap v173: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:57:02.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:01 smithi137 ceph-mon[31694]: pgmap v173: 129 pgs: 129 active+clean; 887 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:57:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:03 smithi007 ceph-mon[27906]: pgmap v174: 129 pgs: 129 active+clean; 918 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 33 op/s 2024-04-23T14:57:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:03 smithi186 ceph-mon[31814]: pgmap v174: 129 pgs: 129 active+clean; 918 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 33 op/s 2024-04-23T14:57:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:03 smithi137 ceph-mon[31694]: pgmap v174: 129 pgs: 129 active+clean; 918 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 33 op/s 2024-04-23T14:57:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:04 smithi007 ceph-mon[27906]: pgmap v175: 129 pgs: 129 active+clean; 918 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.3 MiB/s wr, 28 op/s 2024-04-23T14:57:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:04 smithi186 ceph-mon[31814]: pgmap v175: 129 pgs: 129 active+clean; 918 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.3 MiB/s wr, 28 op/s 2024-04-23T14:57:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:04 smithi137 ceph-mon[31694]: pgmap v175: 129 pgs: 129 active+clean; 918 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.3 MiB/s wr, 28 op/s 2024-04-23T14:57:07.788 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:07 smithi007 ceph-mon[27906]: pgmap v176: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T14:57:07.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:07 smithi186 ceph-mon[31814]: pgmap v176: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T14:57:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:07 smithi137 ceph-mon[31694]: pgmap v176: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 -- 172.21.15.7:0/456916548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc4107160 msgr2=0x7fefc410ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 --2- 172.21.15.7:0/456916548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc4107160 0x7fefc410ed30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009ca0 tx=0x7fefbc02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 -- 172.21.15.7:0/456916548 shutdown_connections 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 --2- 172.21.15.7:0/456916548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc4107160 0x7fefc410ed30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 --2- 172.21.15.7:0/456916548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefc4102a40 0x7fefc4106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 --2- 172.21.15.7:0/456916548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc4102090 0x7fefc4102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.650+0000 7fefc9800640 1 -- 172.21.15.7:0/456916548 >> 172.21.15.7:0/456916548 conn(0x7fefc40fd950 msgr2=0x7fefc40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.651+0000 7fefc9800640 1 -- 172.21.15.7:0/456916548 shutdown_connections 2024-04-23T14:57:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.651+0000 7fefc9800640 1 -- 172.21.15.7:0/456916548 wait complete. 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 Processor -- start 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 -- start start 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc4102090 0x7fefc41a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefc4107160 0x7fefc41a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 0x7fefc419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41120d0 con 0x7fefc419a680 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4111f50 con 0x7fefc4102090 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.652+0000 7fefc9800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4112250 con 0x7fefc4107160 2024-04-23T14:57:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 0x7fefc419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 0x7fefc419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34624/0 (socket says 172.21.15.7:34624) 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 -- 172.21.15.7:0/1529388567 learned_addr learned my addr 172.21.15.7:0/1529388567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc3e00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc4102090 0x7fefc41a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc3400640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefc4107160 0x7fefc41a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 -- 172.21.15.7:0/1529388567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefc4107160 msgr2=0x7fefc41a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefc4107160 0x7fefc41a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 -- 172.21.15.7:0/1529388567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc4102090 msgr2=0x7fefc41a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc4102090 0x7fefc41a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.653+0000 7fefc8e00640 1 -- 172.21.15.7:0/1529388567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc419b280 con 0x7fefc419a680 2024-04-23T14:57:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.654+0000 7fefc8e00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 0x7fefc419ab00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009dc0 tx=0x7fefbc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.654+0000 7fefc0c00640 1 -- 172.21.15.7:0/1529388567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc003cf0 con 0x7fefc419a680 2024-04-23T14:57:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.654+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc419b510 con 0x7fefc419a680 2024-04-23T14:57:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.654+0000 7fefc0c00640 1 -- 172.21.15.7:0/1529388567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefbc0044f0 con 0x7fefc419a680 2024-04-23T14:57:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.654+0000 7fefc0c00640 1 -- 172.21.15.7:0/1529388567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc030bf0 con 0x7fefc419a680 2024-04-23T14:57:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.654+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc41a76b0 con 0x7fefc419a680 2024-04-23T14:57:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.658+0000 7fefcdc13740 1 Processor -- start 2024-04-23T14:57:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefc0c00640 1 -- 172.21.15.7:0/1529388567 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fefbc004040 con 0x7fefc419a680 2024-04-23T14:57:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 -- start start 2024-04-23T14:57:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x5601814847a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560181484ce0 0x56018148f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181491990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5601813ea900 con 0x56018148f5a0 2024-04-23T14:57:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560181390f20 con 0x560181484ce0 2024-04-23T14:57:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.659+0000 7fefcdc13740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5601813e68c0 con 0x5601814843c0 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181491990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181491990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34638/0 (socket says 172.21.15.7:34638) 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 -- 172.21.15.7:0/2853525750 learned_addr learned my addr 172.21.15.7:0/2853525750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x5601814847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3e00640 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560181484ce0 0x56018148f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 -- 172.21.15.7:0/2853525750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 msgr2=0x5601814847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x5601814847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc0c00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fefa80a3d10 0x7fefa80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 -- 172.21.15.7:0/2853525750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560181484ce0 msgr2=0x56018148f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560181484ce0 0x56018148f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.660+0000 7fefc3400640 1 -- 172.21.15.7:0/2853525750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601813b5e10 con 0x56018148f5a0 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.661+0000 7fefc0c00640 1 -- 172.21.15.7:0/1529388567 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fefbc0f21c0 con 0x7fefc419a680 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.661+0000 7fefc8e00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fefa80a3d10 0x7fefa80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.661+0000 7fefc3400640 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181491990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fefb0014910 tx=0x7fefb000c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccc7a9bd5dba110 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.661+0000 7fefb9600640 1 -- 172.21.15.7:0/2853525750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00142d0 con 0x56018148f5a0 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.661+0000 7fefb9600640 1 -- 172.21.15.7:0/2853525750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefb000fc10 con 0x56018148f5a0 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.661+0000 7fefb9600640 1 -- 172.21.15.7:0/2853525750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0012a30 con 0x56018148f5a0 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 -- 172.21.15.7:0/2853525750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 msgr2=0x560181491990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181491990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fefb0014910 tx=0x7fefb000c410 comp rx=0 tx=0).stop 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefc8e00640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fefa80a3d10 0x7fefa80a61d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0ef6c0 tx=0x7fefbc003e90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 -- 172.21.15.7:0/2853525750 shutdown_connections 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560181484ce0 0x56018148f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181491990 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 --2- 172.21.15.7:0/2853525750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x5601814847a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 -- 172.21.15.7:0/2853525750 >> 172.21.15.7:0/2853525750 conn(0x5601814808d0 msgr2=0x560181480cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.662+0000 7fefcdc13740 1 -- 172.21.15.7:0/2853525750 shutdown_connections 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.663+0000 7fefcdc13740 1 -- 172.21.15.7:0/2853525750 wait complete. 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.663+0000 7fefcdc13740 1 -- start start 2024-04-23T14:57:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.663+0000 7fefcdc13740 1 Processor -- start 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x56018148c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 0x56018148cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x56018148d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5601814920e0 con 0x560181484ce0 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5601813a42c0 con 0x56018148f5a0 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560181492260 con 0x5601814843c0 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefcdc13740 10 client.0 _ll_register_callbacks cb 0x5601810fca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 0x56018148cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 0x56018148cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34652/0 (socket says 172.21.15.7:34652) 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefc3e00640 1 -- 172.21.15.7:0/3598605478 learned_addr learned my addr 172.21.15.7:0/3598605478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.664+0000 7fefc3400640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x56018148c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3400640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x56018148d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3e00640 1 -- 172.21.15.7:0/3598605478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 msgr2=0x56018148c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3e00640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x56018148c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3e00640 1 -- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 msgr2=0x56018148d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3e00640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x56018148d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3e00640 1 -- 172.21.15.7:0/3598605478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601813b4fd0 con 0x560181484ce0 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3400640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x56018148d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefc3e00640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 0x56018148cb50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fefb400da10 tx=0x7fefb400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b13fe1f4ed25381 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefae000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefae000640 1 -- 172.21.15.7:0/3598605478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb401b640 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefae000640 1 -- 172.21.15.7:0/3598605478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fefb4011440 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.665+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb000fc10 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefae000640 1 -- 172.21.15.7:0/3598605478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fefb401b7e0 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefcdc13740 10 client.16101 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5601810fd210 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefae000640 1 -- 172.21.15.7:0/3598605478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefb000fc10 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefae000640 1 -- 172.21.15.7:0/3598605478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fefb4019020 con 0x560181484ce0 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefcdc13740 10 client.16101 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefcdc13740 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.666+0000 7fefcdc13740 20 client.16101 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.667+0000 7fefcdc13740 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601814a8070 0x5601814aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.667+0000 7fefcdc13740 4 client.16101 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.667+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601813f8320 con 0x5601814a8070 2024-04-23T14:57:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.667+0000 7fefc3400640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601814a8070 0x5601814aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.668+0000 7fefc3400640 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601814a8070 0x5601814aa4a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de1f019d92cdc601 server_cookie=e81dff26f2407681 in_seq=0 out_seq=0 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.668+0000 7fefae000640 10 client.16101 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefae000640 1 -- 172.21.15.7:0/3598605478 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5601813f8320 con 0x5601814a8070 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefae000640 10 client.16101 handle_command_reply: tid=0 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 client.16101 shutdown 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 msgr2=0x56018148cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 0x56018148cb50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fefb400da10 tx=0x7fefb400ded0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 shutdown_connections 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601814a8070 0x5601814aa4a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x56018148d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560181484ce0 0x56018148cb50 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 --2- 172.21.15.7:0/3598605478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601814843c0 0x56018148c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefae000640 0 client.16101 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.670+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 >> 172.21.15.7:0/3598605478 conn(0x5601814808d0 msgr2=0x560181486600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.671+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 shutdown_connections 2024-04-23T14:57:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.671+0000 7fefcdc13740 1 -- 172.21.15.7:0/3598605478 wait complete. 2024-04-23T14:57:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.671+0000 7fefcdc13740 20 client.16101 trim_cache size 0 max 16384 2024-04-23T14:57:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.687+0000 7fefcdc13740 1 Processor -- start 2024-04-23T14:57:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 -- start start 2024-04-23T14:57:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 0x56018149b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181486d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x5601814afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41acfd0 con 0x5601814843c0 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41aeb10 con 0x56018148f5a0 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefcdc13740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41ad6a0 con 0x560181484ce0 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 0x56018149b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 0x56018149b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34662/0 (socket says 172.21.15.7:34662) 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.688+0000 7fefc3400640 1 -- 172.21.15.7:0/1362750761 learned_addr learned my addr 172.21.15.7:0/1362750761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3e00640 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181486d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3400640 1 -- 172.21.15.7:0/1362750761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 msgr2=0x560181486d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3400640 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181486d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3400640 1 -- 172.21.15.7:0/1362750761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 msgr2=0x5601814afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3400640 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x5601814afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3400640 1 -- 172.21.15.7:0/1362750761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560181491d00 con 0x5601814843c0 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefc3400640 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 0x56018149b090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fefb000cc90 tx=0x7fefb000c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e12c2ce0b1cbe2a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefb8c00640 1 -- 172.21.15.7:0/1362750761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00142b0 con 0x5601814843c0 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.689+0000 7fefb8c00640 1 -- 172.21.15.7:0/1362750761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefb0027070 con 0x5601814843c0 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefb8c00640 1 -- 172.21.15.7:0/1362750761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb000fa20 con 0x5601814843c0 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 -- 172.21.15.7:0/1362750761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 msgr2=0x56018149b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 0x56018149b090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fefb000cc90 tx=0x7fefb000c410 comp rx=0 tx=0).stop 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 -- 172.21.15.7:0/1362750761 shutdown_connections 2024-04-23T14:57:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56018148f5a0 0x5601814afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181486d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1362750761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601814843c0 0x56018149b090 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.690+0000 7fefcdc13740 1 -- 172.21.15.7:0/1362750761 >> 172.21.15.7:0/1362750761 conn(0x5601814808d0 msgr2=0x56018147fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.691+0000 7fefcdc13740 1 -- 172.21.15.7:0/1362750761 shutdown_connections 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.691+0000 7fefcdc13740 1 -- 172.21.15.7:0/1362750761 wait complete. 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.691+0000 7fefcdc13740 1 -- start start 2024-04-23T14:57:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.691+0000 7fefcdc13740 1 Processor -- start 2024-04-23T14:57:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601814843c0 0x5601814891f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181489730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181489c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41ae440 con 0x56018148f5a0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41add70 con 0x5601814843c0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fefc41aaff0 con 0x560181484ce0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefcdc13740 10 client.0 _ll_register_callbacks cb 0x7fefb4004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181489c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181489c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34670/0 (socket says 172.21.15.7:34670) 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefc3400640 1 -- 172.21.15.7:0/1079866207 learned_addr learned my addr 172.21.15.7:0/1079866207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefc3e00640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181489730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.692+0000 7fefc3400640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601814843c0 0x5601814891f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefc3400640 1 -- 172.21.15.7:0/1079866207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 msgr2=0x560181489730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefc3400640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181489730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefc3400640 1 -- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601814843c0 msgr2=0x5601814891f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefc3400640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601814843c0 0x5601814891f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefc3400640 1 -- 172.21.15.7:0/1079866207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601811c9620 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefc3400640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181489c70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fefb0005c20 tx=0x7fefb0023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da33cc5d949a5c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefae000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefae000640 1 -- 172.21.15.7:0/1079866207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0014040 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb0027070 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.693+0000 7fefae000640 1 -- 172.21.15.7:0/1079866207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7fefb00141e0 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefae000640 1 -- 172.21.15.7:0/1079866207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fefb000f7a0 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 10 client.16107 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56018150e660 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefae000640 1 -- 172.21.15.7:0/1079866207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefb0027070 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefae000640 1 -- 172.21.15.7:0/1079866207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fefb0012730 con 0x56018148f5a0 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 10 client.16107 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 20 client.16107 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56018150ead0 0x560181510ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 4 client.16107 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.694+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601813f2190 con 0x56018150ead0 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.695+0000 7fefc3e00640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56018150ead0 0x560181510ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.696+0000 7fefc3e00640 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56018150ead0 0x560181510ec0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888f847cea4a9ac1 server_cookie=3112466e89539d13 in_seq=0 out_seq=0 2024-04-23T14:57:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.696+0000 7fefae000640 10 client.16107 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefae000640 1 -- 172.21.15.7:0/1079866207 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601813f2190 con 0x56018150ead0 2024-04-23T14:57:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefae000640 10 client.16107 handle_command_reply: tid=0 2024-04-23T14:57:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 client.16107 shutdown 2024-04-23T14:57:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 msgr2=0x560181489c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181489c70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fefb0005c20 tx=0x7fefb0023040 comp rx=0 tx=0).stop 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 shutdown_connections 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56018150ead0 0x560181510ec0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56018148f5a0 0x560181489c70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560181484ce0 0x560181489730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 --2- 172.21.15.7:0/1079866207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601814843c0 0x5601814891f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 >> 172.21.15.7:0/1079866207 conn(0x5601814808d0 msgr2=0x56018148c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefae000640 0 client.16107 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.729+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 shutdown_connections 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.730+0000 7fefcdc13740 1 -- 172.21.15.7:0/1079866207 wait complete. 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.730+0000 7fefcdc13740 20 client.16107 trim_cache size 0 max 16384 2024-04-23T14:57:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:57:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:57:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:57:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:57:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.730+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fefa80a3d10 msgr2=0x7fefa80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.730+0000 7fefc9800640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fefa80a3d10 0x7fefa80a61d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0ef6c0 tx=0x7fefbc003e90 comp rx=0 tx=0).stop 2024-04-23T14:57:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.730+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 msgr2=0x7fefc419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.730+0000 7fefc9800640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 0x7fefc419ab00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009dc0 tx=0x7fefbc032ff0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 shutdown_connections 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fefa80a3d10 0x7fefa80a61d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefc419a680 0x7fefc419ab00 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefc4107160 0x7fefc41a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 --2- 172.21.15.7:0/1529388567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefc4102090 0x7fefc41a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 >> 172.21.15.7:0/1529388567 conn(0x7fefc40fd950 msgr2=0x7fefc40ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 shutdown_connections 2024-04-23T14:57:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:08.731+0000 7fefc9800640 1 -- 172.21.15.7:0/1529388567 wait complete. 2024-04-23T14:57:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:09 smithi007 ceph-mon[27906]: pgmap v177: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 25 op/s 2024-04-23T14:57:09.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:09 smithi186 ceph-mon[31814]: pgmap v177: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 25 op/s 2024-04-23T14:57:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:09 smithi137 ceph-mon[31694]: pgmap v177: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 25 op/s 2024-04-23T14:57:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:11 smithi007 ceph-mon[27906]: pgmap v178: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 25 op/s 2024-04-23T14:57:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:11 smithi186 ceph-mon[31814]: pgmap v178: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 25 op/s 2024-04-23T14:57:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:11 smithi137 ceph-mon[31694]: pgmap v178: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 25 op/s 2024-04-23T14:57:13.720 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:13 smithi137 ceph-mon[31694]: pgmap v179: 129 pgs: 129 active+clean; 963 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 34 op/s 2024-04-23T14:57:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:13 smithi007 ceph-mon[27906]: pgmap v179: 129 pgs: 129 active+clean; 963 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 34 op/s 2024-04-23T14:57:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:13 smithi186 ceph-mon[31814]: pgmap v179: 129 pgs: 129 active+clean; 963 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 34 op/s 2024-04-23T14:57:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:15 smithi007 ceph-mon[27906]: pgmap v180: 129 pgs: 129 active+clean; 963 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:57:15.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:15 smithi186 ceph-mon[31814]: pgmap v180: 129 pgs: 129 active+clean; 963 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:57:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:15 smithi137 ceph-mon[31694]: pgmap v180: 129 pgs: 129 active+clean; 963 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:57:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:17 smithi007 ceph-mon[27906]: pgmap v181: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:57:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:17 smithi186 ceph-mon[31814]: pgmap v181: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:57:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:17 smithi137 ceph-mon[31694]: pgmap v181: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:57:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:19 smithi007 ceph-mon[27906]: pgmap v182: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:19.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:19 smithi186 ceph-mon[31814]: pgmap v182: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:19 smithi137 ceph-mon[31694]: pgmap v182: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:21 smithi007 ceph-mon[27906]: pgmap v183: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:21 smithi186 ceph-mon[31814]: pgmap v183: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:21.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 -- 172.21.15.7:0/2438464316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8103040 msgr2=0x7f59c8103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 --2- 172.21.15.7:0/2438464316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8103040 0x7f59c8103420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009900 tx=0x7f59b802a490 comp rx=0 tx=0).stop 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 -- 172.21.15.7:0/2438464316 shutdown_connections 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 --2- 172.21.15.7:0/2438464316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 0x7f59c810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 --2- 172.21.15.7:0/2438464316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59c810c410 0x7f59c810e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 --2- 172.21.15.7:0/2438464316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8103040 0x7f59c8103420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 -- 172.21.15.7:0/2438464316 >> 172.21.15.7:0/2438464316 conn(0x7f59c80fc820 msgr2=0x7f59c80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 -- 172.21.15.7:0/2438464316 shutdown_connections 2024-04-23T14:57:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.887+0000 7f59cda00640 1 -- 172.21.15.7:0/2438464316 wait complete. 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.888+0000 7f59cda00640 1 Processor -- start 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 -- start start 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59c8103040 0x7f59c81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 0x7f59c8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 0x7f59c819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8112050 con 0x7f59c810c410 2024-04-23T14:57:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8111ed0 con 0x7f59c8103960 2024-04-23T14:57:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cda00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81121d0 con 0x7f59c8103040 2024-04-23T14:57:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.889+0000 7f59cd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 0x7f59c819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 0x7f59c819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57928/0 (socket says 172.21.15.7:57928) 2024-04-23T14:57:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 -- 172.21.15.7:0/3476001622 learned_addr learned my addr 172.21.15.7:0/3476001622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59c7e00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59c8103040 0x7f59c81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59c7400640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 0x7f59c8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 -- 172.21.15.7:0/3476001622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59c8103040 msgr2=0x7f59c81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59c8103040 0x7f59c81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 -- 172.21.15.7:0/3476001622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 msgr2=0x7f59c8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 0x7f59c8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59cd000640 1 -- 172.21.15.7:0/3476001622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c819d5a0 con 0x7f59c810c410 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.890+0000 7f59c7400640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 0x7f59c8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.891+0000 7f59cd000640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 0x7f59c819ce70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f59c000cce0 tx=0x7f59c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.891+0000 7f59c4c00640 1 -- 172.21.15.7:0/3476001622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c000f450 con 0x7f59c810c410 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.891+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c819d890 con 0x7f59c810c410 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.891+0000 7f59c4c00640 1 -- 172.21.15.7:0/3476001622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59c000faa0 con 0x7f59c810c410 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.891+0000 7f59c4c00640 1 -- 172.21.15.7:0/3476001622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0018b70 con 0x7f59c810c410 2024-04-23T14:57:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.891+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c81a5120 con 0x7f59c810c410 2024-04-23T14:57:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.895+0000 7f59d1fbd740 1 Processor -- start 2024-04-23T14:57:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.895+0000 7f59c4c00640 1 -- 172.21.15.7:0/3476001622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f59c0018d10 con 0x7f59c810c410 2024-04-23T14:57:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.895+0000 7f59d1fbd740 1 -- start start 2024-04-23T14:57:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029ce2e0 0x558e029ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029dd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029dd9b0 0x558e029dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558e02934900 con 0x558e029cec00 2024-04-23T14:57:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558e028daf20 con 0x558e029ce2e0 2024-04-23T14:57:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558e029308c0 con 0x558e029dd9b0 2024-04-23T14:57:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029dd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57940/0 (socket says 172.21.15.7:57940) 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7e00640 1 -- 172.21.15.7:0/4210252583 learned_addr learned my addr 172.21.15.7:0/4210252583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7400640 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029ce2e0 0x558e029ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7400640 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029dd9b0 0x558e029dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7e00640 1 -- 172.21.15.7:0/4210252583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029dd9b0 msgr2=0x558e029dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.896+0000 7f59c7e00640 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029dd9b0 0x558e029dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c7e00640 1 -- 172.21.15.7:0/4210252583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029ce2e0 msgr2=0x558e029ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c7e00640 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029ce2e0 0x558e029ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c7e00640 1 -- 172.21.15.7:0/4210252583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e028ffe10 con 0x558e029cec00 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c7400640 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029dd9b0 0x558e029dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c4c00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f59ac0a3d90 0x7f59ac0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c7e00640 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029dd470 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009900 tx=0x7f59b8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0928e03290bebe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c4c00640 1 -- 172.21.15.7:0/3476001622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f59c00d0ed0 con 0x7f59c810c410 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59c7400640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f59ac0a3d90 0x7f59ac0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.897+0000 7f59bd600640 1 -- 172.21.15.7:0/4210252583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8040070 con 0x558e029cec00 2024-04-23T14:57:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.898+0000 7f59bd600640 1 -- 172.21.15.7:0/4210252583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59b80316a0 con 0x558e029cec00 2024-04-23T14:57:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.898+0000 7f59bd600640 1 -- 172.21.15.7:0/4210252583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8035040 con 0x558e029cec00 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.898+0000 7f59d1fbd740 1 -- 172.21.15.7:0/4210252583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 msgr2=0x558e029dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.898+0000 7f59c7400640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f59ac0a3d90 0x7f59ac0a6250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x558e029cba60 tx=0x7f59b400c510 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.898+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029dd470 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009900 tx=0x7f59b8032e40 comp rx=0 tx=0).stop 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 -- 172.21.15.7:0/4210252583 shutdown_connections 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029dd9b0 0x558e029dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029dd470 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/4210252583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029ce2e0 0x558e029ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 -- 172.21.15.7:0/4210252583 >> 172.21.15.7:0/4210252583 conn(0x558e029ca8d0 msgr2=0x558e029cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 -- 172.21.15.7:0/4210252583 shutdown_connections 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 -- 172.21.15.7:0/4210252583 wait complete. 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 -- start start 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.899+0000 7f59d1fbd740 1 Processor -- start 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 0x558e029da960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029cec00 0x558e029daea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029db3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558e029e0580 con 0x558e029ce2e0 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558e028ee2c0 con 0x558e029dd9b0 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558e029e0700 con 0x558e029cec00 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59d1fbd740 10 client.0 _ll_register_callbacks cb 0x558e02646a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 0x558e029da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 0x558e029da960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57952/0 (socket says 172.21.15.7:57952) 2024-04-23T14:57:21.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.900+0000 7f59c7e00640 1 -- 172.21.15.7:0/501158064 learned_addr learned my addr 172.21.15.7:0/501158064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59cd000640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029db3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7400640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029cec00 0x558e029daea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7e00640 1 -- 172.21.15.7:0/501158064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029cec00 msgr2=0x558e029daea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7e00640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029cec00 0x558e029daea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7e00640 1 -- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 msgr2=0x558e029db3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7e00640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029db3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7e00640 1 -- 172.21.15.7:0/501158064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e028fefd0 con 0x558e029ce2e0 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59c7e00640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 0x558e029da960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f59b8031a60 tx=0x7f59b802a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcc2556141e6eb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59b2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.901+0000 7f59b2000640 1 -- 172.21.15.7:0/501158064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8035040 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b80316a0 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59b2000640 1 -- 172.21.15.7:0/501158064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f59b8004230 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59b2000640 1 -- 172.21.15.7:0/501158064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f59b8040040 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59d1fbd740 10 client.16119 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558e02647210 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59b2000640 1 -- 172.21.15.7:0/501158064 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59b80316a0 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.902+0000 7f59b2000640 1 -- 172.21.15.7:0/501158064 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f59b80046c0 con 0x558e029ce2e0 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59d1fbd740 10 client.16119 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59d1fbd740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59d1fbd740 20 client.16119 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e029ed930 0x558e029efd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59d1fbd740 4 client.16119 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:57:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e02942320 con 0x558e029ed930 2024-04-23T14:57:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.903+0000 7f59c7400640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e029ed930 0x558e029efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.904+0000 7f59c7400640 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e029ed930 0x558e029efd20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51c099093026bd2 server_cookie=6f1dbddfd6c43cf9 in_seq=0 out_seq=0 2024-04-23T14:57:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.904+0000 7f59b2000640 10 client.16119 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.906+0000 7f59b2000640 1 -- 172.21.15.7:0/501158064 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558e02942320 con 0x558e029ed930 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.906+0000 7f59b2000640 10 client.16119 handle_command_reply: tid=0 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.906+0000 7f59d1fbd740 1 client.16119 shutdown 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 msgr2=0x558e029da960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 0x558e029da960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f59b8031a60 tx=0x7f59b802a490 comp rx=0 tx=0).stop 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 shutdown_connections 2024-04-23T14:57:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e029ed930 0x558e029efd20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029db3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029cec00 0x558e029daea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/501158064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029ce2e0 0x558e029da960 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 >> 172.21.15.7:0/501158064 conn(0x558e029ca8d0 msgr2=0x558e029d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59b2000640 0 client.16119 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 shutdown_connections 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 1 -- 172.21.15.7:0/501158064 wait complete. 2024-04-23T14:57:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.907+0000 7f59d1fbd740 20 client.16119 trim_cache size 0 max 16384 2024-04-23T14:57:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:21 smithi137 ceph-mon[31694]: pgmap v183: 129 pgs: 129 active+clean; 987 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.930+0000 7f59d1fbd740 1 Processor -- start 2024-04-23T14:57:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 -- start start 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029e9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81ace30 con 0x558e029cec00 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81ae970 con 0x558e029dd9b0 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81ad500 con 0x558e029ce2e0 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59c7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59c7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57968/0 (socket says 172.21.15.7:57968) 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.931+0000 7f59c7400640 1 -- 172.21.15.7:0/327583857 learned_addr learned my addr 172.21.15.7:0/327583857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7e00640 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7400640 1 -- 172.21.15.7:0/327583857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 msgr2=0x558e029e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59cd000640 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7400640 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029e9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7400640 1 -- 172.21.15.7:0/327583857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 msgr2=0x558e029f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7400640 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7400640 1 -- 172.21.15.7:0/327583857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e02713620 con 0x558e029cec00 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7e00640 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:57:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59c7400640 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029c9910 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f59b40058c0 tx=0x7f59b4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b1eaa1387f35aa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.932+0000 7f59bcc00640 1 -- 172.21.15.7:0/327583857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40293a0 con 0x558e029cec00 2024-04-23T14:57:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59bcc00640 1 -- 172.21.15.7:0/327583857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59b402f070 con 0x558e029cec00 2024-04-23T14:57:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59bcc00640 1 -- 172.21.15.7:0/327583857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4020c90 con 0x558e029cec00 2024-04-23T14:57:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 -- 172.21.15.7:0/327583857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 msgr2=0x558e029c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029c9910 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f59b40058c0 tx=0x7f59b4014040 comp rx=0 tx=0).stop 2024-04-23T14:57:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 -- 172.21.15.7:0/327583857 shutdown_connections 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029c9910 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/327583857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.933+0000 7f59d1fbd740 1 -- 172.21.15.7:0/327583857 >> 172.21.15.7:0/327583857 conn(0x558e029ca8d0 msgr2=0x558e029c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.934+0000 7f59d1fbd740 1 -- 172.21.15.7:0/327583857 shutdown_connections 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.934+0000 7f59d1fbd740 1 -- 172.21.15.7:0/327583857 wait complete. 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.934+0000 7f59d1fbd740 1 -- start start 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.934+0000 7f59d1fbd740 1 Processor -- start 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029d75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029d8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81ae2a0 con 0x558e029cec00 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81adbd0 con 0x558e029dd9b0 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81aae10 con 0x558e029ce2e0 2024-04-23T14:57:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59d1fbd740 10 client.0 _ll_register_callbacks cb 0x7f59b8032d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59c7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59c7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029d7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57974/0 (socket says 172.21.15.7:57974) 2024-04-23T14:57:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59c7400640 1 -- 172.21.15.7:0/554745428 learned_addr learned my addr 172.21.15.7:0/554745428 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59c7e00640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029d75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.935+0000 7f59cd000640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029d8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59c7400640 1 -- 172.21.15.7:0/554745428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 msgr2=0x558e029d75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59c7400640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029d75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59c7400640 1 -- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 msgr2=0x558e029d8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59c7400640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029d8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59c7400640 1 -- 172.21.15.7:0/554745428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e02a52b60 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59c7400640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029d7b30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c740 tx=0x7f59b4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73eb2346d542003 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59b2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59b2000640 1 -- 172.21.15.7:0/554745428 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004020 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59b2000640 1 -- 172.21.15.7:0/554745428 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f59b40041c0 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.936+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b402f070 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59b2000640 1 -- 172.21.15.7:0/554745428 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f59b4043050 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59d1fbd740 10 client.16125 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558e02a53dc0 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59b2000640 1 -- 172.21.15.7:0/554745428 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59b402f070 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59b2000640 1 -- 172.21.15.7:0/554745428 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f59b4020400 con 0x558e029cec00 2024-04-23T14:57:21.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59d1fbd740 10 client.16125 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59d1fbd740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59d1fbd740 20 client.16125 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.937+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e02a544b0 0x558e02a568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.938+0000 7f59d1fbd740 4 client.16125 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.938+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e0293c190 con 0x558e02a544b0 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.938+0000 7f59c7e00640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e02a544b0 0x558e02a568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.939+0000 7f59c7e00640 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e02a544b0 0x558e02a568d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e32ddd8c264dc6 server_cookie=2ca963f9972043bb in_seq=0 out_seq=0 2024-04-23T14:57:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.939+0000 7f59b2000640 10 client.16125 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59b2000640 1 -- 172.21.15.7:0/554745428 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558e0293c190 con 0x558e02a544b0 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59b2000640 10 client.16125 handle_command_reply: tid=0 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 client.16125 shutdown 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 msgr2=0x558e029d7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029d7b30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c740 tx=0x7f59b4011e70 comp rx=0 tx=0).stop 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 shutdown_connections 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558e02a544b0 0x558e02a568d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e029dd9b0 0x558e029d8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e029cec00 0x558e029d7b30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 --2- 172.21.15.7:0/554745428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558e029ce2e0 0x558e029d75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59b2000640 0 client.16125 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.972+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 >> 172.21.15.7:0/554745428 conn(0x558e029ca8d0 msgr2=0x558e029c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.973+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 shutdown_connections 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.973+0000 7f59d1fbd740 1 -- 172.21.15.7:0/554745428 wait complete. 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.973+0000 7f59d1fbd740 20 client.16125 trim_cache size 0 max 16384 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:57:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:57:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f59ac0a3d90 msgr2=0x7f59ac0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f59ac0a3d90 0x7f59ac0a6250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x558e029cba60 tx=0x7f59b400c510 comp rx=0 tx=0).stop 2024-04-23T14:57:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 msgr2=0x7f59c819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 0x7f59c819ce70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f59c000cce0 tx=0x7f59c000a620 comp rx=0 tx=0).stop 2024-04-23T14:57:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 shutdown_connections 2024-04-23T14:57:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f59ac0a3d90 0x7f59ac0a6250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59c8103960 0x7f59c8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c810c410 0x7f59c819ce70 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 --2- 172.21.15.7:0/3476001622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59c8103040 0x7f59c81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 >> 172.21.15.7:0/3476001622 conn(0x7f59c80fc820 msgr2=0x7f59c80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 shutdown_connections 2024-04-23T14:57:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:21.974+0000 7f59cda00640 1 -- 172.21.15.7:0/3476001622 wait complete. 2024-04-23T14:57:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:23 smithi007 ceph-mon[27906]: pgmap v184: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:23 smithi186 ceph-mon[31814]: pgmap v184: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:23 smithi137 ceph-mon[31694]: pgmap v184: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:25 smithi007 ceph-mon[27906]: pgmap v185: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:25 smithi186 ceph-mon[31814]: pgmap v185: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:25 smithi137 ceph-mon[31694]: pgmap v185: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:27 smithi007 ceph-mon[27906]: pgmap v186: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:27.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:27 smithi186 ceph-mon[31814]: pgmap v186: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:27 smithi137 ceph-mon[31694]: pgmap v186: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:29 smithi007 ceph-mon[27906]: pgmap v187: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:57:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:29 smithi186 ceph-mon[31814]: pgmap v187: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:57:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:29 smithi137 ceph-mon[31694]: pgmap v187: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:57:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:31 smithi007 ceph-mon[27906]: pgmap v188: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:57:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:31 smithi186 ceph-mon[31814]: pgmap v188: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:57:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:31 smithi137 ceph-mon[31694]: pgmap v188: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:57:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:33 smithi007 ceph-mon[27906]: pgmap v189: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:33 smithi186 ceph-mon[31814]: pgmap v189: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:33 smithi137 ceph-mon[31694]: pgmap v189: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 -- 172.21.15.7:0/3782360279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f44107330 msgr2=0x7f6f4410ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 --2- 172.21.15.7:0/3782360279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f44107330 0x7f6f4410ef00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009ca0 tx=0x7f6f3c02a8c0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 -- 172.21.15.7:0/3782360279 shutdown_connections 2024-04-23T14:57:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 --2- 172.21.15.7:0/3782360279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f44107330 0x7f6f4410ef00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 --2- 172.21.15.7:0/3782360279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f44102c10 0x7f6f44106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 --2- 172.21.15.7:0/3782360279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 0x7f6f44102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.121+0000 7f6f4b400640 1 -- 172.21.15.7:0/3782360279 >> 172.21.15.7:0/3782360279 conn(0x7f6f440fdac0 msgr2=0x7f6f440ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.122+0000 7f6f4b400640 1 -- 172.21.15.7:0/3782360279 shutdown_connections 2024-04-23T14:57:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.122+0000 7f6f4b400640 1 -- 172.21.15.7:0/3782360279 wait complete. 2024-04-23T14:57:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 Processor -- start 2024-04-23T14:57:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 -- start start 2024-04-23T14:57:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 0x7f6f44198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f44107330 0x7f6f44198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 0x7f6f4419d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441122f0 con 0x7f6f4419cfe0 2024-04-23T14:57:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f44112170 con 0x7f6f44102260 2024-04-23T14:57:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f4b400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6f44112470 con 0x7f6f44107330 2024-04-23T14:57:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.123+0000 7f6f49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 0x7f6f4419d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 0x7f6f4419d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57050/0 (socket says 172.21.15.7:57050) 2024-04-23T14:57:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 -- 172.21.15.7:0/2109373361 learned_addr learned my addr 172.21.15.7:0/2109373361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f43e00640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f44107330 0x7f6f44198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f48a00640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 0x7f6f44198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 -- 172.21.15.7:0/2109373361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f44107330 msgr2=0x7f6f44198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f44107330 0x7f6f44198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 -- 172.21.15.7:0/2109373361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 msgr2=0x7f6f44198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 0x7f6f44198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 -- 172.21.15.7:0/2109373361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4419dad0 con 0x7f6f4419cfe0 2024-04-23T14:57:35.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f48a00640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 0x7f6f44198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:57:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.124+0000 7f6f49400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 0x7f6f4419d490 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c031040 tx=0x7f6f3c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.125+0000 7f6f41600640 1 -- 172.21.15.7:0/2109373361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c003ce0 con 0x7f6f4419cfe0 2024-04-23T14:57:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.125+0000 7f6f41600640 1 -- 172.21.15.7:0/2109373361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f3c0044f0 con 0x7f6f4419cfe0 2024-04-23T14:57:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.125+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4419dd60 con 0x7f6f4419cfe0 2024-04-23T14:57:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.125+0000 7f6f41600640 1 -- 172.21.15.7:0/2109373361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c030c90 con 0x7f6f4419cfe0 2024-04-23T14:57:35.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.125+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f441a5580 con 0x7f6f4419cfe0 2024-04-23T14:57:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.128+0000 7f6f41600640 1 -- 172.21.15.7:0/2109373361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6f3c0046a0 con 0x7f6f4419cfe0 2024-04-23T14:57:35.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 Processor -- start 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 -- start start 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f41600640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6f2c0a3dc0 0x7f6f2c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f41600640 1 -- 172.21.15.7:0/2109373361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6f3c0f21e0 con 0x7f6f4419cfe0 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 0x5601696c1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696cc390 0x5601696ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560169627900 con 0x5601696c11b0 2024-04-23T14:57:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5601695cdf20 con 0x5601696cc390 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f4e210740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5601696238c0 con 0x5601696c1ad0 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.130+0000 7f6f43e00640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6f2c0a3dc0 0x7f6f2c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 0x5601696c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 0x5601696c1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57052/0 (socket says 172.21.15.7:57052) 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 -- 172.21.15.7:0/1095751174 learned_addr learned my addr 172.21.15.7:0/1095751174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f43e00640 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f49400640 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696cc390 0x5601696ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 -- 172.21.15.7:0/1095751174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 msgr2=0x5601696cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 -- 172.21.15.7:0/1095751174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696cc390 msgr2=0x5601696ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696cc390 0x5601696ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f48a00640 1 -- 172.21.15.7:0/1095751174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601695f2e10 con 0x5601696c11b0 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.131+0000 7f6f49400640 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696cc390 0x5601696ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.132+0000 7f6f43e00640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6f2c0a3dc0 0x7f6f2c0a6280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f30005fd0 tx=0x7f6f300138e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.132+0000 7f6f48a00640 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 0x5601696c1590 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009c50 tx=0x7f6f3800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c224475d2f048f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.132+0000 7f6f35c00640 1 -- 172.21.15.7:0/1095751174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38016070 con 0x5601696c11b0 2024-04-23T14:57:35.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.132+0000 7f6f35c00640 1 -- 172.21.15.7:0/1095751174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f380054d0 con 0x5601696c11b0 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.132+0000 7f6f35c00640 1 -- 172.21.15.7:0/1095751174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011470 con 0x5601696c11b0 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 -- 172.21.15.7:0/1095751174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 msgr2=0x5601696c1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 0x5601696c1590 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009c50 tx=0x7f6f3800e6c0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 -- 172.21.15.7:0/1095751174 shutdown_connections 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696cc390 0x5601696ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 --2- 172.21.15.7:0/1095751174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c11b0 0x5601696c1590 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 -- 172.21.15.7:0/1095751174 >> 172.21.15.7:0/1095751174 conn(0x5601696bd6c0 msgr2=0x5601696bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 -- 172.21.15.7:0/1095751174 shutdown_connections 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.133+0000 7f6f4e210740 1 -- 172.21.15.7:0/1095751174 wait complete. 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 -- start start 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 Processor -- start 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c11b0 0x5601696c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c1ad0 0x5601696c9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5601696d33d0 con 0x5601696cc390 2024-04-23T14:57:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5601695e12c0 con 0x5601696c1ad0 2024-04-23T14:57:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5601696d3550 con 0x5601696c11b0 2024-04-23T14:57:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.134+0000 7f6f4e210740 10 client.0 _ll_register_callbacks cb 0x560169339a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57064/0 (socket says 172.21.15.7:57064) 2024-04-23T14:57:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 -- 172.21.15.7:0/161937495 learned_addr learned my addr 172.21.15.7:0/161937495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f48a00640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c11b0 0x5601696c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f43e00640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c1ad0 0x5601696c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 -- 172.21.15.7:0/161937495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c11b0 msgr2=0x5601696c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c11b0 0x5601696c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 -- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c1ad0 msgr2=0x5601696c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c1ad0 0x5601696c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.135+0000 7f6f49400640 1 -- 172.21.15.7:0/161937495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601695f1fd0 con 0x5601696cc390 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f49400640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c9d90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0ef6e0 tx=0x7f6f3c0be710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d79fe541269323a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f2a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f2a000640 1 -- 172.21.15.7:0/161937495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0d7060 con 0x5601696cc390 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f380054d0 con 0x5601696cc390 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f2a000640 1 -- 172.21.15.7:0/161937495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6f3c0ba540 con 0x5601696cc390 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f2a000640 1 -- 172.21.15.7:0/161937495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6f3c0bded0 con 0x5601696cc390 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f4e210740 10 client.16137 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56016933a210 con 0x5601696cc390 2024-04-23T14:57:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.136+0000 7f6f2a000640 1 -- 172.21.15.7:0/161937495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f380054d0 con 0x5601696cc390 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f2a000640 1 -- 172.21.15.7:0/161937495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6f3c0d7200 con 0x5601696cc390 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f4e210740 10 client.16137 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f4e210740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f4e210740 20 client.16137 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f4e210740 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601696e0860 0x5601696e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f4e210740 4 client.16137 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.137+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560169635320 con 0x5601696e0860 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.138+0000 7f6f48a00640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601696e0860 0x5601696e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.139+0000 7f6f48a00640 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601696e0860 0x5601696e2cc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fef8db150c33968 server_cookie=f492aec741da692d in_seq=0 out_seq=0 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.139+0000 7f6f2a000640 10 client.16137 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.140+0000 7f6f2a000640 1 -- 172.21.15.7:0/161937495 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560169635320 con 0x5601696e0860 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.140+0000 7f6f2a000640 10 client.16137 handle_command_reply: tid=0 2024-04-23T14:57:35.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.140+0000 7f6f4e210740 1 client.16137 shutdown 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 msgr2=0x5601696c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c9d90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0ef6e0 tx=0x7f6f3c0be710 comp rx=0 tx=0).stop 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 shutdown_connections 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5601696e0860 0x5601696e2cc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c1ad0 0x5601696c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c9d90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 --2- 172.21.15.7:0/161937495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c11b0 0x5601696c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f2a000640 0 client.16137 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 >> 172.21.15.7:0/161937495 conn(0x5601696bd6c0 msgr2=0x5601696c33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 shutdown_connections 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 1 -- 172.21.15.7:0/161937495 wait complete. 2024-04-23T14:57:35.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.141+0000 7f6f4e210740 20 client.16137 trim_cache size 0 max 16384 2024-04-23T14:57:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 Processor -- start 2024-04-23T14:57:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 -- start start 2024-04-23T14:57:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696dc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 0x5601696c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696cc390 0x5601696bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441acf50 con 0x5601696c1ad0 2024-04-23T14:57:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441aea90 con 0x5601696c11b0 2024-04-23T14:57:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.161+0000 7f6f4e210740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441ad620 con 0x5601696cc390 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 0x5601696c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 0x5601696c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57076/0 (socket says 172.21.15.7:57076) 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 -- 172.21.15.7:0/3235091929 learned_addr learned my addr 172.21.15.7:0/3235091929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f48a00640 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f49400640 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696cc390 0x5601696bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 -- 172.21.15.7:0/3235091929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696cc390 msgr2=0x5601696bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696cc390 0x5601696bc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 -- 172.21.15.7:0/3235091929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 msgr2=0x5601696dc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696dc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f43e00640 1 -- 172.21.15.7:0/3235091929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560169406620 con 0x5601696c1ad0 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.162+0000 7f6f48a00640 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:57:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.163+0000 7f6f43e00640 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 0x5601696c3b70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000bb30 tx=0x7f6f30005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3b3818f4d5c329 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.163+0000 7f6f35200640 1 -- 172.21.15.7:0/3235091929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f30025070 con 0x5601696c1ad0 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.163+0000 7f6f35200640 1 -- 172.21.15.7:0/3235091929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f30021c30 con 0x5601696c1ad0 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.163+0000 7f6f35200640 1 -- 172.21.15.7:0/3235091929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3002acd0 con 0x5601696c1ad0 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 -- 172.21.15.7:0/3235091929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 msgr2=0x5601696c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 0x5601696c3b70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000bb30 tx=0x7f6f30005cf0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 -- 172.21.15.7:0/3235091929 shutdown_connections 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696cc390 0x5601696bc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696c1ad0 0x5601696c3b70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 --2- 172.21.15.7:0/3235091929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 -- 172.21.15.7:0/3235091929 >> 172.21.15.7:0/3235091929 conn(0x5601696bd6c0 msgr2=0x5601696bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 -- 172.21.15.7:0/3235091929 shutdown_connections 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.164+0000 7f6f4e210740 1 -- 172.21.15.7:0/3235091929 wait complete. 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.165+0000 7f6f4e210740 1 -- start start 2024-04-23T14:57:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.165+0000 7f6f4e210740 1 Processor -- start 2024-04-23T14:57:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696d8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441ae3c0 con 0x5601696cc390 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441adcf0 con 0x5601696c11b0 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6f441aaf30 con 0x5601696c1ad0 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f4e210740 10 client.0 _ll_register_callbacks cb 0x7f6f3c0ba170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57090/0 (socket says 172.21.15.7:57090) 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f49400640 1 -- 172.21.15.7:0/162737584 learned_addr learned my addr 172.21.15.7:0/162737584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f48a00640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.166+0000 7f6f43e00640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f49400640 1 -- 172.21.15.7:0/162737584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 msgr2=0x5601696c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f49400640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f49400640 1 -- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 msgr2=0x5601696d8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f49400640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696d8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f49400640 1 -- 172.21.15.7:0/162737584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601696c6a70 con 0x5601696cc390 2024-04-23T14:57:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f49400640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c6240 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c006010 tx=0x7f6f3c0042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d63375ac44106a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f2a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.167+0000 7f6f2a000640 1 -- 172.21.15.7:0/162737584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0bdca0 con 0x5601696cc390 2024-04-23T14:57:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.168+0000 7f6f2a000640 1 -- 172.21.15.7:0/162737584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6f3c0bd320 con 0x5601696cc390 2024-04-23T14:57:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.168+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f30021c30 con 0x5601696cc390 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.168+0000 7f6f2a000640 1 -- 172.21.15.7:0/162737584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6f3c0bda10 con 0x5601696cc390 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.168+0000 7f6f4e210740 10 client.16143 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.168+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560169746e50 con 0x5601696cc390 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.168+0000 7f6f2a000640 1 -- 172.21.15.7:0/162737584 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f30021c30 con 0x5601696cc390 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f2a000640 1 -- 172.21.15.7:0/162737584 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6f3c0b9c20 con 0x5601696cc390 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f4e210740 10 client.16143 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f4e210740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f4e210740 20 client.16143 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f4e210740 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560169747330 0x560169749720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f4e210740 4 client.16143 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:57:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.169+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56016962f190 con 0x560169747330 2024-04-23T14:57:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.170+0000 7f6f48a00640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560169747330 0x560169749720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.170+0000 7f6f48a00640 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560169747330 0x560169749720 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=992618d743bbdd6e server_cookie=2b1fded8c63fe39d in_seq=0 out_seq=0 2024-04-23T14:57:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.170+0000 7f6f2a000640 10 client.16143 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f2a000640 1 -- 172.21.15.7:0/162737584 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56016962f190 con 0x560169747330 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f2a000640 10 client.16143 handle_command_reply: tid=0 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 client.16143 shutdown 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 msgr2=0x5601696c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c6240 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c006010 tx=0x7f6f3c0042b0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 shutdown_connections 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560169747330 0x560169749720 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601696cc390 0x5601696c6240 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601696c1ad0 0x5601696c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 --2- 172.21.15.7:0/162737584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5601696c11b0 0x5601696d8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f2a000640 0 client.16143 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.198+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 >> 172.21.15.7:0/162737584 conn(0x5601696bd6c0 msgr2=0x5601696c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.199+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 shutdown_connections 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.199+0000 7f6f4e210740 1 -- 172.21.15.7:0/162737584 wait complete. 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.199+0000 7f6f4e210740 20 client.16143 trim_cache size 0 max 16384 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:57:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:57:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6f2c0a3dc0 msgr2=0x7f6f2c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6f2c0a3dc0 0x7f6f2c0a6280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f30005fd0 tx=0x7f6f300138e0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 msgr2=0x7f6f4419d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 0x7f6f4419d490 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c031040 tx=0x7f6f3c003970 comp rx=0 tx=0).stop 2024-04-23T14:57:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 shutdown_connections 2024-04-23T14:57:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6f2c0a3dc0 0x7f6f2c0a6280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f4419cfe0 0x7f6f4419d490 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f44107330 0x7f6f44198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 --2- 172.21.15.7:0/2109373361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f44102260 0x7f6f44198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 >> 172.21.15.7:0/2109373361 conn(0x7f6f440fdac0 msgr2=0x7f6f440fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 shutdown_connections 2024-04-23T14:57:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:35.200+0000 7f6f4b400640 1 -- 172.21.15.7:0/2109373361 wait complete. 2024-04-23T14:57:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:35 smithi007 ceph-mon[27906]: pgmap v190: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:35 smithi186 ceph-mon[31814]: pgmap v190: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:35 smithi137 ceph-mon[31694]: pgmap v190: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:57:37.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:37 smithi007 ceph-mon[27906]: pgmap v191: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 21 op/s 2024-04-23T14:57:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:37 smithi186 ceph-mon[31814]: pgmap v191: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 21 op/s 2024-04-23T14:57:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:37 smithi137 ceph-mon[31694]: pgmap v191: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 21 op/s 2024-04-23T14:57:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:39 smithi007 ceph-mon[27906]: pgmap v192: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T14:57:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:39 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:39.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:39 smithi186 ceph-mon[31814]: pgmap v192: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T14:57:39.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:39 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:39 smithi137 ceph-mon[31694]: pgmap v192: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T14:57:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:39 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:41 smithi007 ceph-mon[27906]: pgmap v193: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T14:57:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:41 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:41 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:41 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:57:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:41 smithi186 ceph-mon[31814]: pgmap v193: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T14:57:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:41 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:41 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:41 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:57:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:41 smithi137 ceph-mon[31694]: pgmap v193: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T14:57:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:41 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:41 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:41 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:57:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:43 smithi007 ceph-mon[27906]: pgmap v194: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 17 op/s 2024-04-23T14:57:43.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:43 smithi186 ceph-mon[31814]: pgmap v194: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 17 op/s 2024-04-23T14:57:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:43 smithi137 ceph-mon[31694]: pgmap v194: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 17 op/s 2024-04-23T14:57:45.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:45 smithi007 ceph-mon[27906]: pgmap v195: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T14:57:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:45 smithi186 ceph-mon[31814]: pgmap v195: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T14:57:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:45 smithi137 ceph-mon[31694]: pgmap v195: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T14:57:47.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:47 smithi007 ceph-mon[27906]: pgmap v196: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:47 smithi186 ceph-mon[31814]: pgmap v196: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:47 smithi137 ceph-mon[31694]: pgmap v196: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:57:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 -- 172.21.15.7:0/2494964773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103980 msgr2=0x7f6b4c10be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 --2- 172.21.15.7:0/2494964773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103980 0x7f6b4c10be60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b3802a480 comp rx=0 tx=0).stop 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 -- 172.21.15.7:0/2494964773 shutdown_connections 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 --2- 172.21.15.7:0/2494964773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b4c10c430 0x7f6b4c10e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 --2- 172.21.15.7:0/2494964773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103980 0x7f6b4c10be60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 --2- 172.21.15.7:0/2494964773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b4c103060 0x7f6b4c103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 -- 172.21.15.7:0/2494964773 >> 172.21.15.7:0/2494964773 conn(0x7f6b4c0fc820 msgr2=0x7f6b4c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 -- 172.21.15.7:0/2494964773 shutdown_connections 2024-04-23T14:57:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.357+0000 7f6b4b200640 1 -- 172.21.15.7:0/2494964773 wait complete. 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.358+0000 7f6b4b200640 1 Processor -- start 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 -- start start 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 0x7f6b4c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b4c103980 0x7f6b4c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b4c10c430 0x7f6b4c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1120a0 con 0x7f6b4c103060 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c111f20 con 0x7f6b4c103980 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b4b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c112220 con 0x7f6b4c10c430 2024-04-23T14:57:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b49e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 0x7f6b4c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b49e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 0x7f6b4c1a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53236/0 (socket says 172.21.15.7:53236) 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.359+0000 7f6b49e00640 1 -- 172.21.15.7:0/1484878166 learned_addr learned my addr 172.21.15.7:0/1484878166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49400640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b4c103980 0x7f6b4c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b4c10c430 0x7f6b4c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49e00640 1 -- 172.21.15.7:0/1484878166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b4c10c430 msgr2=0x7f6b4c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49e00640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b4c10c430 0x7f6b4c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49e00640 1 -- 172.21.15.7:0/1484878166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b4c103980 msgr2=0x7f6b4c1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49e00640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b4c103980 0x7f6b4c1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49e00640 1 -- 172.21.15.7:0/1484878166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c19af40 con 0x7f6b4c103060 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.360+0000 7f6b49e00640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 0x7f6b4c1a0570 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00d950 tx=0x7f6b3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.361+0000 7f6b42a00640 1 -- 172.21.15.7:0/1484878166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c017070 con 0x7f6b4c103060 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.361+0000 7f6b42a00640 1 -- 172.21.15.7:0/1484878166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b3c009c30 con 0x7f6b4c103060 2024-04-23T14:57:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.361+0000 7f6b42a00640 1 -- 172.21.15.7:0/1484878166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00f620 con 0x7f6b4c103060 2024-04-23T14:57:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.361+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c19b230 con 0x7f6b4c103060 2024-04-23T14:57:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.361+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1a74f0 con 0x7f6b4c103060 2024-04-23T14:57:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 Processor -- start 2024-04-23T14:57:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 -- start start 2024-04-23T14:57:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b42a00640 1 -- 172.21.15.7:0/1484878166 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6b3c0109a0 con 0x7f6b4c103060 2024-04-23T14:57:48.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7a4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555a7b6fd900 con 0x555a7b7973c0 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555a7b6a3f20 con 0x555a7b797ce0 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.365+0000 7f6b539d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555a7b6f98c0 con 0x555a7b7a25a0 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53242/0 (socket says 172.21.15.7:53242) 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 -- 172.21.15.7:0/2062467211 learned_addr learned my addr 172.21.15.7:0/2062467211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b49e00640 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b49400640 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 -- 172.21.15.7:0/2062467211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 msgr2=0x555a7b7a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 -- 172.21.15.7:0/2062467211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 msgr2=0x555a7b7a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.366+0000 7f6b4a800640 1 -- 172.21.15.7:0/2062467211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7b6c8e10 con 0x555a7b7973c0 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.367+0000 7f6b4a800640 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7977a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009e60 tx=0x7f6b44010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2171251290d71de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.367+0000 7f6b37000640 1 -- 172.21.15.7:0/2062467211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44016070 con 0x555a7b7973c0 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.367+0000 7f6b37000640 1 -- 172.21.15.7:0/2062467211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b44004d20 con 0x555a7b7973c0 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.367+0000 7f6b37000640 1 -- 172.21.15.7:0/2062467211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44012740 con 0x555a7b7973c0 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.367+0000 7f6b42a00640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6b300a3d10 0x7f6b300a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.368+0000 7f6b42a00640 1 -- 172.21.15.7:0/1484878166 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6b3c0d0830 con 0x7f6b4c103060 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.368+0000 7f6b49e00640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6b300a3d10 0x7f6b300a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.368+0000 7f6b539d7740 1 -- 172.21.15.7:0/2062467211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 msgr2=0x555a7b7977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.368+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7977a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009e60 tx=0x7f6b44010740 comp rx=0 tx=0).stop 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.368+0000 7f6b539d7740 1 -- 172.21.15.7:0/2062467211 shutdown_connections 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2062467211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7977a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 -- 172.21.15.7:0/2062467211 >> 172.21.15.7:0/2062467211 conn(0x555a7b7938d0 msgr2=0x555a7b793cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 -- 172.21.15.7:0/2062467211 shutdown_connections 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b49e00640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6b300a3d10 0x7f6b300a61d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0cdcd0 tx=0x7f6b3c098040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 -- 172.21.15.7:0/2062467211 wait complete. 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 -- start start 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.369+0000 7f6b539d7740 1 Processor -- start 2024-04-23T14:57:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b79f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 0x555a7b79fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b7a25a0 0x555a7b79ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555a7b7a5170 con 0x555a7b797ce0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555a7b6b72c0 con 0x555a7b7a25a0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555a7b7a52f0 con 0x555a7b7973c0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b539d7740 10 client.0 _ll_register_callbacks cb 0x555a7b40fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 0x555a7b79fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b49400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 0x555a7b79fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53244/0 (socket says 172.21.15.7:53244) 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.370+0000 7f6b49400640 1 -- 172.21.15.7:0/1993494813 learned_addr learned my addr 172.21.15.7:0/1993494813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b79f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b7a25a0 0x555a7b79ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b49400640 1 -- 172.21.15.7:0/1993494813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 msgr2=0x555a7b79f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b49400640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b79f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b49400640 1 -- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b7a25a0 msgr2=0x555a7b79ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b49400640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b7a25a0 0x555a7b79ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b49400640 1 -- 172.21.15.7:0/1993494813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7b6c7fd0 con 0x555a7b797ce0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b49400640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 0x555a7b79fa10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b38005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fade678453468d44 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.371+0000 7f6b2b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b2b400640 1 -- 172.21.15.7:0/1993494813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38035030 con 0x555a7b797ce0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b44004d20 con 0x555a7b797ce0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b2b400640 1 -- 172.21.15.7:0/1993494813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6b380048c0 con 0x555a7b797ce0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b2b400640 1 -- 172.21.15.7:0/1993494813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6b38005d50 con 0x555a7b797ce0 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b539d7740 10 client.16155 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555a7b410210 con 0x555a7b797ce0 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.372+0000 7f6b2b400640 1 -- 172.21.15.7:0/1993494813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b44004d20 con 0x555a7b797ce0 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b2b400640 1 -- 172.21.15.7:0/1993494813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6b380314a0 con 0x555a7b797ce0 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b539d7740 10 client.16155 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b539d7740 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b539d7740 20 client.16155 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b7b26a0 0x555a7b7b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b539d7740 4 client.16155 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.373+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a7b70b320 con 0x555a7b7b26a0 2024-04-23T14:57:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.374+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b7b26a0 0x555a7b7b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.374+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b7b26a0 0x555a7b7b4ab0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1c8baaf1b93de4 server_cookie=85c78a50c7778189 in_seq=0 out_seq=0 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.374+0000 7f6b2b400640 10 client.16155 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.376+0000 7f6b2b400640 1 -- 172.21.15.7:0/1993494813 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555a7b70b320 con 0x555a7b7b26a0 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.376+0000 7f6b2b400640 10 client.16155 handle_command_reply: tid=0 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.376+0000 7f6b539d7740 1 client.16155 shutdown 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 msgr2=0x555a7b79fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 0x555a7b79fa10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b38005250 comp rx=0 tx=0).stop 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 shutdown_connections 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b7b26a0 0x555a7b7b4ab0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b7a25a0 0x555a7b79ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b797ce0 0x555a7b79fa10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1993494813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b79f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 >> 172.21.15.7:0/1993494813 conn(0x555a7b7938d0 msgr2=0x555a7b799650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b2b400640 0 client.16155 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 shutdown_connections 2024-04-23T14:57:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 1 -- 172.21.15.7:0/1993494813 wait complete. 2024-04-23T14:57:48.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.377+0000 7f6b539d7740 20 client.16155 trim_cache size 0 max 16384 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 Processor -- start 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 -- start start 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b79fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1b13f0 con 0x555a7b7973c0 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1b2f30 con 0x555a7b797ce0 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b539d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1b1ac0 con 0x555a7b7a25a0 2024-04-23T14:57:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53258/0 (socket says 172.21.15.7:53258) 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.396+0000 7f6b4a800640 1 -- 172.21.15.7:0/2489650753 learned_addr learned my addr 172.21.15.7:0/2489650753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b49400640 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b79fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b4a800640 1 -- 172.21.15.7:0/2489650753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 msgr2=0x555a7b7ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b4a800640 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b4a800640 1 -- 172.21.15.7:0/2489650753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 msgr2=0x555a7b79fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b4a800640 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b79fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b4a800640 1 -- 172.21.15.7:0/2489650753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7b4dc620 con 0x555a7b7973c0 2024-04-23T14:57:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b49400640 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b79fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:57:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.397+0000 7f6b4a800640 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7ae030 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6b44005fd0 tx=0x7f6b44010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6579f7e83f1f1165 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.398+0000 7f6b36600640 1 -- 172.21.15.7:0/2489650753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4402d070 con 0x555a7b7973c0 2024-04-23T14:57:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.398+0000 7f6b36600640 1 -- 172.21.15.7:0/2489650753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b44028930 con 0x555a7b7973c0 2024-04-23T14:57:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.398+0000 7f6b36600640 1 -- 172.21.15.7:0/2489650753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44025040 con 0x555a7b7973c0 2024-04-23T14:57:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.398+0000 7f6b539d7740 1 -- 172.21.15.7:0/2489650753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 msgr2=0x555a7b7ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.398+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7ae030 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6b44005fd0 tx=0x7f6b44010740 comp rx=0 tx=0).stop 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 -- 172.21.15.7:0/2489650753 shutdown_connections 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b79fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7a25a0 0x555a7b7ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 --2- 172.21.15.7:0/2489650753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7973c0 0x555a7b7ae030 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 -- 172.21.15.7:0/2489650753 >> 172.21.15.7:0/2489650753 conn(0x555a7b7938d0 msgr2=0x555a7b79a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 -- 172.21.15.7:0/2489650753 shutdown_connections 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 -- 172.21.15.7:0/2489650753 wait complete. 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 -- start start 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.399+0000 7f6b539d7740 1 Processor -- start 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b7a5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 0x555a7b816c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1b2860 con 0x555a7b7a25a0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1b2190 con 0x555a7b797ce0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1af3d0 con 0x555a7b7973c0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b539d7740 10 client.0 _ll_register_callbacks cb 0x7f6b38009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 0x555a7b816c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 0x555a7b816c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53272/0 (socket says 172.21.15.7:53272) 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.400+0000 7f6b4a800640 1 -- 172.21.15.7:0/1707673793 learned_addr learned my addr 172.21.15.7:0/1707673793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b7a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b49400640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 -- 172.21.15.7:0/1707673793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 msgr2=0x555a7b7a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b7a5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 -- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 msgr2=0x555a7b7a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:57:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 -- 172.21.15.7:0/1707673793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7b817160 con 0x555a7b7a25a0 2024-04-23T14:57:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b4a800640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 0x555a7b816c20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6b44012c20 tx=0x7f6b4401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01e7d920315caa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.401+0000 7f6b2b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b2b400640 1 -- 172.21.15.7:0/1707673793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4403a060 con 0x555a7b7a25a0 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b2b400640 1 -- 172.21.15.7:0/1707673793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f6b44028480 con 0x555a7b7a25a0 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b44028930 con 0x555a7b7a25a0 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b2b400640 1 -- 172.21.15.7:0/1707673793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6b44041050 con 0x555a7b7a25a0 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b539d7740 10 client.16161 fetch_fsmap learned FSMap version 32 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555a7b8182f0 con 0x555a7b7a25a0 2024-04-23T14:57:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.402+0000 7f6b2b400640 1 -- 172.21.15.7:0/1707673793 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b44028930 con 0x555a7b7a25a0 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b2b400640 1 -- 172.21.15.7:0/1707673793 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6b4400f040 con 0x555a7b7a25a0 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b539d7740 10 client.16161 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b539d7740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b539d7740 20 client.16161 populate_metadata read hostname 'smithi007' 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b818720 0x555a7b81ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b539d7740 4 client.16161 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555a7b705190 con 0x555a7b818720 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.403+0000 7f6b49400640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b818720 0x555a7b81ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.404+0000 7f6b49400640 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b818720 0x555a7b81ab10 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954b465a2cc50a58 server_cookie=be3650dcc717472f in_seq=0 out_seq=0 2024-04-23T14:57:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.404+0000 7f6b2b400640 10 client.16161 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.442+0000 7f6b2b400640 1 -- 172.21.15.7:0/1707673793 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555a7b705190 con 0x555a7b818720 2024-04-23T14:57:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.442+0000 7f6b2b400640 10 client.16161 handle_command_reply: tid=0 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.442+0000 7f6b539d7740 1 client.16161 shutdown 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 msgr2=0x555a7b816c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 0x555a7b816c20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6b44012c20 tx=0x7f6b4401d040 comp rx=0 tx=0).stop 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 shutdown_connections 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555a7b818720 0x555a7b81ab10 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a7b797ce0 0x555a7b7a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555a7b7a25a0 0x555a7b816c20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 --2- 172.21.15.7:0/1707673793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555a7b7973c0 0x555a7b7a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 >> 172.21.15.7:0/1707673793 conn(0x555a7b7938d0 msgr2=0x555a7b798dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b2b400640 0 client.16161 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 shutdown_connections 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 1 -- 172.21.15.7:0/1707673793 wait complete. 2024-04-23T14:57:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.443+0000 7f6b539d7740 20 client.16161 trim_cache size 0 max 16384 2024-04-23T14:57:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:57:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:57:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:57:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.444+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6b300a3d10 msgr2=0x7f6b300a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.444+0000 7f6b4b200640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6b300a3d10 0x7f6b300a61d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0cdcd0 tx=0x7f6b3c098040 comp rx=0 tx=0).stop 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.444+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 msgr2=0x7f6b4c1a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.444+0000 7f6b4b200640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 0x7f6b4c1a0570 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00d950 tx=0x7f6b3c00de10 comp rx=0 tx=0).stop 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 shutdown_connections 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6b300a3d10 0x7f6b300a61d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b4c103980 0x7f6b4c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b4c10c430 0x7f6b4c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 --2- 172.21.15.7:0/1484878166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4c103060 0x7f6b4c1a0570 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 >> 172.21.15.7:0/1484878166 conn(0x7f6b4c0fc820 msgr2=0x7f6b4c101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 shutdown_connections 2024-04-23T14:57:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:57:48.445+0000 7f6b4b200640 1 -- 172.21.15.7:0/1484878166 wait complete. 2024-04-23T14:57:49.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:49 smithi007 ceph-mon[27906]: pgmap v197: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:49 smithi186 ceph-mon[31814]: pgmap v197: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:49 smithi137 ceph-mon[31694]: pgmap v197: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:51 smithi186 ceph-mon[31814]: pgmap v198: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:51.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:51 smithi137 ceph-mon[31694]: pgmap v198: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:51 smithi007 ceph-mon[27906]: pgmap v198: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:57:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:53 smithi186 ceph-mon[31814]: pgmap v199: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:57:53.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:53 smithi137 ceph-mon[31694]: pgmap v199: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:57:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:53 smithi007 ceph-mon[27906]: pgmap v199: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:57:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:55 smithi186 ceph-mon[31814]: pgmap v200: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:57:55.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:55 smithi137 ceph-mon[31694]: pgmap v200: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:57:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:55 smithi007 ceph-mon[27906]: pgmap v200: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:57:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:57 smithi186 ceph-mon[31814]: pgmap v201: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:57:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:57 smithi137 ceph-mon[31694]: pgmap v201: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:57:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:57 smithi007 ceph-mon[27906]: pgmap v201: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:57:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:57:59 smithi137 ceph-mon[31694]: pgmap v202: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:58:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:57:59 smithi007 ceph-mon[27906]: pgmap v202: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:58:00.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:57:59 smithi186 ceph-mon[31814]: pgmap v202: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:58:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 -- 172.21.15.7:0/3980959392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc10e650 msgr2=0x7f48fc110aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 --2- 172.21.15.7:0/3980959392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc10e650 0x7f48fc110aa0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009ca0 tx=0x7f48f402a950 comp rx=0 tx=0).stop 2024-04-23T14:58:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 -- 172.21.15.7:0/3980959392 shutdown_connections 2024-04-23T14:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 --2- 172.21.15.7:0/3980959392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc10e650 0x7f48fc110aa0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 --2- 172.21.15.7:0/3980959392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48fc074d50 0x7f48fc10e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 --2- 172.21.15.7:0/3980959392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc074430 0x7f48fc074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 -- 172.21.15.7:0/3980959392 >> 172.21.15.7:0/3980959392 conn(0x7f48fc0fd980 msgr2=0x7f48fc0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 -- 172.21.15.7:0/3980959392 shutdown_connections 2024-04-23T14:58:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.597+0000 7f4901a00640 1 -- 172.21.15.7:0/3980959392 wait complete. 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.598+0000 7f4901a00640 1 Processor -- start 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.598+0000 7f4901a00640 1 -- start start 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48fc074430 0x7f48fc1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 0x7f48fc1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc10e650 0x7f48fc19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1142d0 con 0x7f48fc074d50 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc114150 con 0x7f48fc10e650 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc114450 con 0x7f48fc074430 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 0x7f48fc1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 0x7f48fc1a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52812/0 (socket says 172.21.15.7:52812) 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 -- 172.21.15.7:0/1033906780 learned_addr learned my addr 172.21.15.7:0/1033906780 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fbe00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48fc074430 0x7f48fc1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901000640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc10e650 0x7f48fc19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 -- 172.21.15.7:0/1033906780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48fc074430 msgr2=0x7f48fc1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48fc074430 0x7f48fc1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 -- 172.21.15.7:0/1033906780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc10e650 msgr2=0x7f48fc19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc10e650 0x7f48fc19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f48fb400640 1 -- 172.21.15.7:0/1033906780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc19ad90 con 0x7f48fc074d50 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.599+0000 7f4901000640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc10e650 0x7f48fc19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.600+0000 7f48fb400640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 0x7f48fc1a09a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f48e800d770 tx=0x7f48e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.600+0000 7f48f8c00640 1 -- 172.21.15.7:0/1033906780 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8017070 con 0x7f48fc074d50 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.600+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc19b080 con 0x7f48fc074d50 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.600+0000 7f48f8c00640 1 -- 172.21.15.7:0/1033906780 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e80054d0 con 0x7f48fc074d50 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.600+0000 7f48f8c00640 1 -- 172.21.15.7:0/1033906780 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8004cf0 con 0x7f48fc074d50 2024-04-23T14:58:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.600+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc1a7320 con 0x7f48fc074d50 2024-04-23T14:58:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.604+0000 7f4905dfe740 1 Processor -- start 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 -- start start 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d6483f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d6484a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d6484c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561d647a5900 con 0x561d6484a5a0 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d6474bf20 con 0x561d6483fce0 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f4905dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561d647a18c0 con 0x561d6483f3c0 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f48f8c00640 1 -- 172.21.15.7:0/1033906780 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f48e8004e90 con 0x7f48fc074d50 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.605+0000 7f48fb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d6484c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d6484c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52828/0 (socket says 172.21.15.7:52828) 2024-04-23T14:58:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 -- 172.21.15.7:0/627690399 learned_addr learned my addr 172.21.15.7:0/627690399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f4901000640 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d6483f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fbe00640 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d6484a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 -- 172.21.15.7:0/627690399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 msgr2=0x561d6483f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d6483f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 -- 172.21.15.7:0/627690399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 msgr2=0x561d6484a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d6484a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.606+0000 7f48fb400640 1 -- 172.21.15.7:0/627690399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d64770e10 con 0x561d6484a5a0 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f48fb400640 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d6484c990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f48e80cd8f0 tx=0x7f48e80d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198fe9a288280c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f48f8c00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48e00a3d10 0x7f48e00a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f48f1600640 1 -- 172.21.15.7:0/627690399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80df070 con 0x561d6484a5a0 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f48f1600640 1 -- 172.21.15.7:0/627690399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e809c900 con 0x561d6484a5a0 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f48f1600640 1 -- 172.21.15.7:0/627690399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e809bb60 con 0x561d6484a5a0 2024-04-23T14:58:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f48f8c00640 1 -- 172.21.15.7:0/1033906780 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f48e80d0620 con 0x7f48fc074d50 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.607+0000 7f4901000640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48e00a3d10 0x7f48e00a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 -- 172.21.15.7:0/627690399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 msgr2=0x561d6484c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d6484c990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f48e80cd8f0 tx=0x7f48e80d8670 comp rx=0 tx=0).stop 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 -- 172.21.15.7:0/627690399 shutdown_connections 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d6484a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d6484c990 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 --2- 172.21.15.7:0/627690399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d6483f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 -- 172.21.15.7:0/627690399 >> 172.21.15.7:0/627690399 conn(0x561d6483b8d0 msgr2=0x561d6483bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 -- 172.21.15.7:0/627690399 shutdown_connections 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4901000640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48e00a3d10 0x7f48e00a61d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009a60 tx=0x7f48f403c040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.608+0000 7f4905dfe740 1 -- 172.21.15.7:0/627690399 wait complete. 2024-04-23T14:58:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.609+0000 7f4905dfe740 1 -- start start 2024-04-23T14:58:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.609+0000 7f4905dfe740 1 Processor -- start 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d64847590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64847ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d64848010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561d6484d0e0 con 0x561d6483f3c0 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d6475f2c0 con 0x561d6484a5a0 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561d6484d260 con 0x561d6483fce0 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4905dfe740 10 client.0 _ll_register_callbacks cb 0x561d644b7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f48fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d64847590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f48fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d64847590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52830/0 (socket says 172.21.15.7:52830) 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f48fbe00640 1 -- 172.21.15.7:0/3219230723 learned_addr learned my addr 172.21.15.7:0/3219230723 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.610+0000 7f4901000640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d64848010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fb400640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64847ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fbe00640 1 -- 172.21.15.7:0/3219230723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 msgr2=0x561d64847ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fbe00640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64847ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fbe00640 1 -- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 msgr2=0x561d64848010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fbe00640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d64848010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fbe00640 1 -- 172.21.15.7:0/3219230723 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d6476ffd0 con 0x561d6483f3c0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fb400640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64847ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48fbe00640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d64847590 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00be80 tx=0x7f48ec012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41748b558efe50f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48e6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48e6000640 1 -- 172.21.15.7:0/3219230723 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec01f060 con 0x561d6483f3c0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f48e6000640 1 -- 172.21.15.7:0/3219230723 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f48ec0107e0 con 0x561d6483f3c0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.611+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e809c900 con 0x561d6483f3c0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.612+0000 7f48e6000640 1 -- 172.21.15.7:0/3219230723 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f48ec026050 con 0x561d6483f3c0 2024-04-23T14:58:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.612+0000 7f4905dfe740 10 client.16173 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.612+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561d644b8210 con 0x561d6483f3c0 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.612+0000 7f48e6000640 1 -- 172.21.15.7:0/3219230723 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48e809c900 con 0x561d6483f3c0 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.612+0000 7f48e6000640 1 -- 172.21.15.7:0/3219230723 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f48ec019030 con 0x561d6483f3c0 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f4905dfe740 10 client.16173 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f4905dfe740 10 client.16173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f4905dfe740 20 client.16173 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f4905dfe740 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d6485a7c0 0x561d6485cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f4905dfe740 4 client.16173 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d647b3320 con 0x561d6485a7c0 2024-04-23T14:58:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.613+0000 7f48fb400640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d6485a7c0 0x561d6485cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.614+0000 7f48e6000640 10 client.16173 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.614+0000 7f48fb400640 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d6485a7c0 0x561d6485cc30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2cc2ca369dffa7a server_cookie=baf269e016434959 in_seq=0 out_seq=0 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.616+0000 7f48e6000640 1 -- 172.21.15.7:0/3219230723 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561d647b3320 con 0x561d6485a7c0 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.616+0000 7f48e6000640 10 client.16173 handle_command_reply: tid=0 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.616+0000 7f4905dfe740 1 client.16173 shutdown 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.616+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 msgr2=0x561d64847590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.616+0000 7f4905dfe740 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d64847590 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00be80 tx=0x7f48ec012820 comp rx=0 tx=0).stop 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 shutdown_connections 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d6485a7c0 0x561d6485cc30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d64848010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64847ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 --2- 172.21.15.7:0/3219230723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d64847590 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f48e6000640 0 client.16173 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 >> 172.21.15.7:0/3219230723 conn(0x561d6483b8d0 msgr2=0x561d6483aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 shutdown_connections 2024-04-23T14:58:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 1 -- 172.21.15.7:0/3219230723 wait complete. 2024-04-23T14:58:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.617+0000 7f4905dfe740 20 client.16173 trim_cache size 0 max 16384 2024-04-23T14:58:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 Processor -- start 2024-04-23T14:58:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 -- start start 2024-04-23T14:58:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d64849cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d64856090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d64862540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b13c0 con 0x561d6484a5a0 2024-04-23T14:58:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b2f00 con 0x561d6483fce0 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4905dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b1a90 con 0x561d6483f3c0 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.637+0000 7f4901000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d64862540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d64862540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52846/0 (socket says 172.21.15.7:52846) 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 -- 172.21.15.7:0/823189557 learned_addr learned my addr 172.21.15.7:0/823189557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f48fbe00640 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d64849cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f48fb400640 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d64856090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 -- 172.21.15.7:0/823189557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 msgr2=0x561d64849cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d64849cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 -- 172.21.15.7:0/823189557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 msgr2=0x561d64856090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d64856090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.638+0000 7f4901000640 1 -- 172.21.15.7:0/823189557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d64584620 con 0x561d6484a5a0 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.639+0000 7f4901000640 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d64862540 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f48f4003c90 tx=0x7f48f4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe70677d119a5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.639+0000 7f48f0c00640 1 -- 172.21.15.7:0/823189557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4034050 con 0x561d6484a5a0 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.639+0000 7f48f0c00640 1 -- 172.21.15.7:0/823189557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48f402fe30 con 0x561d6484a5a0 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.639+0000 7f48f0c00640 1 -- 172.21.15.7:0/823189557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f40306a0 con 0x561d6484a5a0 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 -- 172.21.15.7:0/823189557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 msgr2=0x561d64862540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d64862540 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f48f4003c90 tx=0x7f48f4040000 comp rx=0 tx=0).stop 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 -- 172.21.15.7:0/823189557 shutdown_connections 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6483fce0 0x561d64856090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6484a5a0 0x561d64862540 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 --2- 172.21.15.7:0/823189557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483f3c0 0x561d64849cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 -- 172.21.15.7:0/823189557 >> 172.21.15.7:0/823189557 conn(0x561d6483b8d0 msgr2=0x561d6483aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 -- 172.21.15.7:0/823189557 shutdown_connections 2024-04-23T14:58:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 -- 172.21.15.7:0/823189557 wait complete. 2024-04-23T14:58:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.640+0000 7f4905dfe740 1 -- start start 2024-04-23T14:58:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 Processor -- start 2024-04-23T14:58:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d648525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64852ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d6484f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b2830 con 0x561d6483f3c0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b2160 con 0x561d6484a5a0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1af3a0 con 0x561d6483fce0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.641+0000 7f4905dfe740 10 client.0 _ll_register_callbacks cb 0x7f48ec00b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d648525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d648525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52850/0 (socket says 172.21.15.7:52850) 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 -- 172.21.15.7:0/2529211120 learned_addr learned my addr 172.21.15.7:0/2529211120 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fb400640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64852ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f4901000640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d6484f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 -- 172.21.15.7:0/2529211120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 msgr2=0x561d64852ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64852ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 -- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 msgr2=0x561d6484f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d6484f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 -- 172.21.15.7:0/2529211120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d6484ff00 con 0x561d6483f3c0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48fbe00640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d648525a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f48ec01ac80 tx=0x7f48ec01a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9ab1706d843b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.642+0000 7f48e6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f48e6000640 1 -- 172.21.15.7:0/2529211120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec02e070 con 0x561d6483f3c0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f48e6000640 1 -- 172.21.15.7:0/2529211120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9379+0+0 (secure 0 0 0) 0x7f48ec004230 con 0x561d6483f3c0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f402fe30 con 0x561d6483f3c0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f48e6000640 1 -- 172.21.15.7:0/2529211120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f48ec012d20 con 0x561d6483f3c0 2024-04-23T14:58:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f4905dfe740 10 client.16179 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561d648c19d0 con 0x561d6483f3c0 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.643+0000 7f48e6000640 1 -- 172.21.15.7:0/2529211120 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48f402fe30 con 0x561d6483f3c0 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f48e6000640 1 -- 172.21.15.7:0/2529211120 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f48ec019050 con 0x561d6483f3c0 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f4905dfe740 10 client.16179 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f4905dfe740 10 client.16179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f4905dfe740 20 client.16179 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f4905dfe740 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d648c2150 0x561d648c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f4905dfe740 4 client.16179 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d647ad190 con 0x561d648c2150 2024-04-23T14:58:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.644+0000 7f48fb400640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d648c2150 0x561d648c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.645+0000 7f48fb400640 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d648c2150 0x561d648c4570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ce2edcad9811c3 server_cookie=463adb206b264788 in_seq=0 out_seq=0 2024-04-23T14:58:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.645+0000 7f48e6000640 10 client.16179 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f48e6000640 1 -- 172.21.15.7:0/2529211120 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d647ad190 con 0x561d648c2150 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f48e6000640 10 client.16179 handle_command_reply: tid=0 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 client.16179 shutdown 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 msgr2=0x561d648525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d648525a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f48ec01ac80 tx=0x7f48ec01a620 comp rx=0 tx=0).stop 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 shutdown_connections 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d648c2150 0x561d648c4570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d6484a5a0 0x561d6484f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d6483fce0 0x561d64852ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 --2- 172.21.15.7:0/2529211120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d6483f3c0 0x561d648525a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 >> 172.21.15.7:0/2529211120 conn(0x561d6483b8d0 msgr2=0x561d64840d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f48e6000640 0 client.16179 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 shutdown_connections 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.687+0000 7f4905dfe740 1 -- 172.21.15.7:0/2529211120 wait complete. 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.688+0000 7f4905dfe740 20 client.16179 trim_cache size 0 max 16384 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:58:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:58:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.688+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48e00a3d10 msgr2=0x7f48e00a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.688+0000 7f4901a00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48e00a3d10 0x7f48e00a61d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009a60 tx=0x7f48f403c040 comp rx=0 tx=0).stop 2024-04-23T14:58:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.688+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 msgr2=0x7f48fc1a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.688+0000 7f4901a00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 0x7f48fc1a09a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f48e800d770 tx=0x7f48e800dc30 comp rx=0 tx=0).stop 2024-04-23T14:58:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 shutdown_connections 2024-04-23T14:58:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48e00a3d10 0x7f48e00a61d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48fc10e650 0x7f48fc19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48fc074d50 0x7f48fc1a09a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 --2- 172.21.15.7:0/1033906780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48fc074430 0x7f48fc1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 >> 172.21.15.7:0/1033906780 conn(0x7f48fc0fd980 msgr2=0x7f48fc0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 shutdown_connections 2024-04-23T14:58:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:01.689+0000 7f4901a00640 1 -- 172.21.15.7:0/1033906780 wait complete. 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:01 smithi186 ceph-mon[31814]: pgmap v203: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:58:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:01 smithi137 ceph-mon[31694]: pgmap v203: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:58:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:01 smithi007 ceph-mon[27906]: pgmap v203: 129 pgs: 129 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T14:58:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:03 smithi137 ceph-mon[31694]: pgmap v204: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.9 MiB/s wr, 35 op/s 2024-04-23T14:58:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:03 smithi137 ceph-mon[31694]: osdmap e95: 12 total, 12 up, 12 in 2024-04-23T14:58:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:03 smithi007 ceph-mon[27906]: pgmap v204: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.9 MiB/s wr, 35 op/s 2024-04-23T14:58:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:03 smithi007 ceph-mon[27906]: osdmap e95: 12 total, 12 up, 12 in 2024-04-23T14:58:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:03 smithi186 ceph-mon[31814]: pgmap v204: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.9 MiB/s wr, 35 op/s 2024-04-23T14:58:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:03 smithi186 ceph-mon[31814]: osdmap e95: 12 total, 12 up, 12 in 2024-04-23T14:58:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:05 smithi137 ceph-mon[31694]: pgmap v206: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 32 op/s 2024-04-23T14:58:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:05 smithi007 ceph-mon[27906]: pgmap v206: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 32 op/s 2024-04-23T14:58:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:05 smithi186 ceph-mon[31814]: pgmap v206: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 32 op/s 2024-04-23T14:58:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:07 smithi137 ceph-mon[31694]: pgmap v207: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 37 op/s 2024-04-23T14:58:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:07 smithi007 ceph-mon[27906]: pgmap v207: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 37 op/s 2024-04-23T14:58:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:07 smithi186 ceph-mon[31814]: pgmap v207: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 37 op/s 2024-04-23T14:58:09.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:09 smithi137 ceph-mon[31694]: pgmap v208: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 37 op/s 2024-04-23T14:58:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:09 smithi007 ceph-mon[27906]: pgmap v208: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 37 op/s 2024-04-23T14:58:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:09 smithi186 ceph-mon[31814]: pgmap v208: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 37 op/s 2024-04-23T14:58:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:11 smithi007 ceph-mon[27906]: osdmap e96: 12 total, 12 up, 12 in 2024-04-23T14:58:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:11 smithi007 ceph-mon[27906]: pgmap v210: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-04-23T14:58:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:11 smithi186 ceph-mon[31814]: osdmap e96: 12 total, 12 up, 12 in 2024-04-23T14:58:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:11 smithi186 ceph-mon[31814]: pgmap v210: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-04-23T14:58:11.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:11 smithi137 ceph-mon[31694]: osdmap e96: 12 total, 12 up, 12 in 2024-04-23T14:58:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:11 smithi137 ceph-mon[31694]: pgmap v210: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.8 MiB/s wr, 13 op/s 2024-04-23T14:58:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:13 smithi007 ceph-mon[27906]: pgmap v211: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:58:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:13 smithi186 ceph-mon[31814]: pgmap v211: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:58:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:13 smithi137 ceph-mon[31694]: pgmap v211: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:58:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 -- 172.21.15.7:0/1079087459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 msgr2=0x7fc4f4110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/1079087459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f4110ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009ca0 tx=0x7fc4ec02a950 comp rx=0 tx=0).stop 2024-04-23T14:58:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 -- 172.21.15.7:0/1079087459 shutdown_connections 2024-04-23T14:58:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/1079087459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f4110ad0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/1079087459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f4074cd0 0x7fc4f410e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/1079087459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4f40743b0 0x7fc4f4074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 -- 172.21.15.7:0/1079087459 >> 172.21.15.7:0/1079087459 conn(0x7fc4f40fd950 msgr2=0x7fc4f40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 -- 172.21.15.7:0/1079087459 shutdown_connections 2024-04-23T14:58:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.841+0000 7fc4f8e00640 1 -- 172.21.15.7:0/1079087459 wait complete. 2024-04-23T14:58:14.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.842+0000 7fc4f8e00640 1 Processor -- start 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.842+0000 7fc4f8e00640 1 -- start start 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f40743b0 0x7fc4f41a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4f4074cd0 0x7fc4f41a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41142e0 con 0x7fc4f410e6e0 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f8e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4114160 con 0x7fc4f4074cd0 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f8e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4114460 con 0x7fc4f40743b0 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41402/0 (socket says 172.21.15.7:41402) 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f3e00640 1 -- 172.21.15.7:0/716973519 learned_addr learned my addr 172.21.15.7:0/716973519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f3400640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f40743b0 0x7fc4f41a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.843+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4f4074cd0 0x7fc4f41a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4f3e00640 1 -- 172.21.15.7:0/716973519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f40743b0 msgr2=0x7fc4f41a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f40743b0 0x7fc4f41a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4f3e00640 1 -- 172.21.15.7:0/716973519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4f4074cd0 msgr2=0x7fc4f41a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4f4074cd0 0x7fc4f41a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4f3e00640 1 -- 172.21.15.7:0/716973519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f419af60 con 0x7fc4f410e6e0 2024-04-23T14:58:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f419a6a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009dc0 tx=0x7fc4ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4ebe00640 1 -- 172.21.15.7:0/716973519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec034040 con 0x7fc4f410e6e0 2024-04-23T14:58:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.844+0000 7fc4ebe00640 1 -- 172.21.15.7:0/716973519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4ec030850 con 0x7fc4f410e6e0 2024-04-23T14:58:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.845+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f419b1f0 con 0x7fc4f410e6e0 2024-04-23T14:58:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.845+0000 7fc4ebe00640 1 -- 172.21.15.7:0/716973519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec004670 con 0x7fc4f410e6e0 2024-04-23T14:58:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.845+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41a7330 con 0x7fc4f410e6e0 2024-04-23T14:58:14.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.848+0000 7fc4ebe00640 1 -- 172.21.15.7:0/716973519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc4ec037020 con 0x7fc4f410e6e0 2024-04-23T14:58:14.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 Processor -- start 2024-04-23T14:58:14.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 -- start start 2024-04-23T14:58:14.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc11990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bb6cb6a900 con 0x55bb6cc04ce0 2024-04-23T14:58:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bb6cb10f20 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.849+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55bb6cb668c0 con 0x55bb6cc043c0 2024-04-23T14:58:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41408/0 (socket says 172.21.15.7:41408) 2024-04-23T14:58:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 -- 172.21.15.7:0/681106407 learned_addr learned my addr 172.21.15.7:0/681106407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc11990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 -- 172.21.15.7:0/681106407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 msgr2=0x55bb6cc047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 -- 172.21.15.7:0/681106407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 msgr2=0x55bb6cc11990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc11990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f3400640 1 -- 172.21.15.7:0/681106407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb6cb35e10 con 0x55bb6cc04ce0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.850+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc11990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4ebe00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc4d80a3d10 0x7fc4d80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4f3400640 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0f060 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009c80 tx=0x7fc4e40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b9490095ec0f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4ebe00640 1 -- 172.21.15.7:0/716973519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7fc4ec0f1a30 con 0x7fc4f410e6e0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc4d80a3d10 0x7fc4d80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4e8c00640 1 -- 172.21.15.7:0/681106407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4012450 con 0x55bb6cc04ce0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4e8c00640 1 -- 172.21.15.7:0/681106407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4e4012aa0 con 0x55bb6cc04ce0 2024-04-23T14:58:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.851+0000 7fc4e8c00640 1 -- 172.21.15.7:0/681106407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400fb90 con 0x55bb6cc04ce0 2024-04-23T14:58:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/681106407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 msgr2=0x55bb6cc0f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc4d80a3d10 0x7fc4d80a61d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55bb6cc01cf0 tx=0x7fc4e00046c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0f060 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009c80 tx=0x7fc4e40117b0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/681106407 shutdown_connections 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc11990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0f060 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/681106407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/681106407 >> 172.21.15.7:0/681106407 conn(0x55bb6cc008d0 msgr2=0x55bb6cc00cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.852+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/681106407 shutdown_connections 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.853+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/681106407 wait complete. 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.853+0000 7fc4fd1c6740 1 -- start start 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.853+0000 7fc4fd1c6740 1 Processor -- start 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 0x55bb6cc0c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc0cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bb6cc12140 con 0x55bb6cc043c0 2024-04-23T14:58:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bb6cb242c0 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55bb6cc122c0 con 0x55bb6cc04ce0 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4fd1c6740 10 client.0 _ll_register_callbacks cb 0x55bb6c87ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 0x55bb6cc0c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4f3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 0x55bb6cc0c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41414/0 (socket says 172.21.15.7:41414) 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.854+0000 7fc4f3400640 1 -- 172.21.15.7:0/1286612848 learned_addr learned my addr 172.21.15.7:0/1286612848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc0cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3400640 1 -- 172.21.15.7:0/1286612848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc04ce0 msgr2=0x55bb6cc0ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3400640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3400640 1 -- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 msgr2=0x55bb6cc0cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3400640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc0cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3400640 1 -- 172.21.15.7:0/1286612848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb6cb34fd0 con 0x55bb6cc043c0 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4f3400640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 0x55bb6cc0c540 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009f80 tx=0x7fc4e4009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9edbbf9e5ec102c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.855+0000 7fc4dd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4dd600640 1 -- 172.21.15.7:0/1286612848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4027020 con 0x55bb6cc043c0 2024-04-23T14:58:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4dd600640 1 -- 172.21.15.7:0/1286612848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7fc4e40127a0 con 0x55bb6cc043c0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e4012aa0 con 0x55bb6cc043c0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4dd600640 1 -- 172.21.15.7:0/1286612848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc4e4032050 con 0x55bb6cc043c0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4fd1c6740 10 client.16191 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bb6c87d210 con 0x55bb6cc043c0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.856+0000 7fc4dd600640 1 -- 172.21.15.7:0/1286612848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4e4012aa0 con 0x55bb6cc043c0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4dd600640 1 -- 172.21.15.7:0/1286612848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc4e40035f0 con 0x55bb6cc043c0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4fd1c6740 10 client.16191 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4fd1c6740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4fd1c6740 20 client.16191 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc1f5d0 0x55bb6cc219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4fd1c6740 4 client.16191 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.857+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb6cb78320 con 0x55bb6cc1f5d0 2024-04-23T14:58:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.858+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc1f5d0 0x55bb6cc219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.859+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc1f5d0 0x55bb6cc219c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54629ffd5c6254ef server_cookie=5dd9599159aabf6c in_seq=0 out_seq=0 2024-04-23T14:58:14.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.859+0000 7fc4dd600640 10 client.16191 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.860+0000 7fc4dd600640 1 -- 172.21.15.7:0/1286612848 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bb6cb78320 con 0x55bb6cc1f5d0 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.860+0000 7fc4dd600640 10 client.16191 handle_command_reply: tid=0 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.860+0000 7fc4fd1c6740 1 client.16191 shutdown 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 msgr2=0x55bb6cc0c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 0x55bb6cc0c540 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009f80 tx=0x7fc4e4009fb0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 shutdown_connections 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc1f5d0 0x55bb6cc219c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc0cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc0ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1286612848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc043c0 0x55bb6cc0c540 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 >> 172.21.15.7:0/1286612848 conn(0x55bb6cc008d0 msgr2=0x55bb6cbffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4dd600640 0 client.16191 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 shutdown_connections 2024-04-23T14:58:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1286612848 wait complete. 2024-04-23T14:58:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.861+0000 7fc4fd1c6740 20 client.16191 trim_cache size 0 max 16384 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.879+0000 7fc4fd1c6740 1 Processor -- start 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 -- start start 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc1b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc27020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc27560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41b1420 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41b2f60 con 0x55bb6cc04ce0 2024-04-23T14:58:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41b1af0 con 0x55bb6cc043c0 2024-04-23T14:58:14.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc27560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.880+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc27560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41426/0 (socket says 172.21.15.7:41426) 2024-04-23T14:58:14.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 -- 172.21.15.7:0/2666424731 learned_addr learned my addr 172.21.15.7:0/2666424731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc27020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3400640 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc1b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 -- 172.21.15.7:0/2666424731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 msgr2=0x55bb6cc1b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc1b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 -- 172.21.15.7:0/2666424731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 msgr2=0x55bb6cc27020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc27020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 -- 172.21.15.7:0/2666424731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb6cc11d00 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.881+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc27560 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0c5e10 tx=0x7fc4ec0bd570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64591fd79d1029f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.882+0000 7fc4dfe00640 1 -- 172.21.15.7:0/2666424731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0d3070 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.882+0000 7fc4dfe00640 1 -- 172.21.15.7:0/2666424731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4ec0d6e50 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.882+0000 7fc4dfe00640 1 -- 172.21.15.7:0/2666424731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec02c040 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/2666424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 msgr2=0x55bb6cc27560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc27560 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0c5e10 tx=0x7fc4ec0bd570 comp rx=0 tx=0).stop 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/2666424731 shutdown_connections 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc27020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc27560 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/2666424731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc1b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/2666424731 >> 172.21.15.7:0/2666424731 conn(0x55bb6cc008d0 msgr2=0x55bb6cbff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/2666424731 shutdown_connections 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/2666424731 wait complete. 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 -- start start 2024-04-23T14:58:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.883+0000 7fc4fd1c6740 1 Processor -- start 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc17b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc13f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc14680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41b2890 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41b21c0 con 0x55bb6cc04ce0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41af420 con 0x55bb6cc043c0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4fd1c6740 10 client.0 _ll_register_callbacks cb 0x7fc4e4009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.884+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc14680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc14680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41428/0 (socket says 172.21.15.7:41428) 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 -- 172.21.15.7:0/1951624422 learned_addr learned my addr 172.21.15.7:0/1951624422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f2a00640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc13f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3400640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc17b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 -- 172.21.15.7:0/1951624422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 msgr2=0x55bb6cc17b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc17b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 -- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 msgr2=0x55bb6cc13f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc13f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 -- 172.21.15.7:0/1951624422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb6c949620 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4f3e00640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc14680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005e30 tx=0x7fc4ec0bd130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac6056d7206f40b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.885+0000 7fc4dd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4dd600640 1 -- 172.21.15.7:0/1951624422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0da030 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4dd600640 1 -- 172.21.15.7:0/1951624422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7fc4ec0bb9d0 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ec0d6e50 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4dd600640 1 -- 172.21.15.7:0/1951624422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc4ec0d3070 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4fd1c6740 10 client.16197 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bb6cc86880 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4dd600640 1 -- 172.21.15.7:0/1951624422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4ec0d6e50 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.886+0000 7fc4dd600640 1 -- 172.21.15.7:0/1951624422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc4ec04d030 con 0x55bb6cc0f5a0 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4fd1c6740 10 client.16197 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4fd1c6740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4fd1c6740 20 client.16197 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc86e90 0x55bb6cc892b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4fd1c6740 4 client.16197 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb6cb72190 con 0x55bb6cc86e90 2024-04-23T14:58:14.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.887+0000 7fc4f3400640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc86e90 0x55bb6cc892b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:14.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.888+0000 7fc4f3400640 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc86e90 0x55bb6cc892b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e21c42d3d2785b server_cookie=ca358bdbda0ede4 in_seq=0 out_seq=0 2024-04-23T14:58:14.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.888+0000 7fc4dd600640 10 client.16197 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:14.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.926+0000 7fc4dd600640 1 -- 172.21.15.7:0/1951624422 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb6cb72190 con 0x55bb6cc86e90 2024-04-23T14:58:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.926+0000 7fc4dd600640 10 client.16197 handle_command_reply: tid=0 2024-04-23T14:58:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.926+0000 7fc4fd1c6740 1 client.16197 shutdown 2024-04-23T14:58:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 msgr2=0x55bb6cc14680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc14680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005e30 tx=0x7fc4ec0bd130 comp rx=0 tx=0).stop 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 shutdown_connections 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bb6cc86e90 0x55bb6cc892b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bb6cc04ce0 0x55bb6cc13f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bb6cc0f5a0 0x55bb6cc14680 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 --2- 172.21.15.7:0/1951624422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bb6cc043c0 0x55bb6cc17b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 >> 172.21.15.7:0/1951624422 conn(0x55bb6cc008d0 msgr2=0x55bb6cbffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4dd600640 0 client.16197 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 shutdown_connections 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 1 -- 172.21.15.7:0/1951624422 wait complete. 2024-04-23T14:58:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.927+0000 7fc4fd1c6740 20 client.16197 trim_cache size 0 max 16384 2024-04-23T14:58:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:58:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:58:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:58:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.928+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc4d80a3d10 msgr2=0x7fc4d80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.928+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc4d80a3d10 0x7fc4d80a61d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55bb6cc01cf0 tx=0x7fc4e00046c0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.928+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 msgr2=0x7fc4f419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.928+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f419a6a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009dc0 tx=0x7fc4ec003f10 comp rx=0 tx=0).stop 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 shutdown_connections 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc4d80a3d10 0x7fc4d80a61d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4f4074cd0 0x7fc4f41a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4f410e6e0 0x7fc4f419a6a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 --2- 172.21.15.7:0/716973519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f40743b0 0x7fc4f41a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 >> 172.21.15.7:0/716973519 conn(0x7fc4f40fd950 msgr2=0x7fc4f40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 shutdown_connections 2024-04-23T14:58:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:14.929+0000 7fc4f8e00640 1 -- 172.21.15.7:0/716973519 wait complete. 2024-04-23T14:58:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:15 smithi007 ceph-mon[27906]: pgmap v212: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T14:58:15.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:15 smithi186 ceph-mon[31814]: pgmap v212: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T14:58:15.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:15 smithi137 ceph-mon[31694]: pgmap v212: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T14:58:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:17 smithi007 ceph-mon[27906]: pgmap v213: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:58:17.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:17 smithi186 ceph-mon[31814]: pgmap v213: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:58:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:17 smithi137 ceph-mon[31694]: pgmap v213: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:58:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:19 smithi007 ceph-mon[27906]: pgmap v214: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:58:19.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:19 smithi186 ceph-mon[31814]: pgmap v214: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:58:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:19 smithi137 ceph-mon[31694]: pgmap v214: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:58:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:21 smithi007 ceph-mon[27906]: pgmap v215: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-04-23T14:58:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:21 smithi186 ceph-mon[31814]: pgmap v215: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-04-23T14:58:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:21 smithi137 ceph-mon[31694]: pgmap v215: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-04-23T14:58:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:23 smithi007 ceph-mon[27906]: pgmap v216: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:58:23.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:23 smithi186 ceph-mon[31814]: pgmap v216: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:58:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:23 smithi137 ceph-mon[31694]: pgmap v216: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T14:58:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:25 smithi007 ceph-mon[27906]: pgmap v217: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:58:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:25 smithi186 ceph-mon[31814]: pgmap v217: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:58:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:25 smithi137 ceph-mon[31694]: pgmap v217: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T14:58:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:27 smithi007 ceph-mon[27906]: pgmap v218: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:27.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:27 smithi186 ceph-mon[31814]: pgmap v218: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:27 smithi137 ceph-mon[31694]: pgmap v218: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.082+0000 7f4a9ee00640 1 -- 172.21.15.7:0/3300134068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a980743a0 msgr2=0x7f4a98074780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.082+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/3300134068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a980743a0 0x7f4a98074780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009900 tx=0x7f4a8c02a480 comp rx=0 tx=0).stop 2024-04-23T14:58:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 -- 172.21.15.7:0/3300134068 shutdown_connections 2024-04-23T14:58:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/3300134068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a98112e10 0x7f4a98115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/3300134068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a98074cc0 0x7f4a981128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/3300134068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a980743a0 0x7f4a98074780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 -- 172.21.15.7:0/3300134068 >> 172.21.15.7:0/3300134068 conn(0x7f4a980fd950 msgr2=0x7f4a980ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 -- 172.21.15.7:0/3300134068 shutdown_connections 2024-04-23T14:58:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.083+0000 7f4a9ee00640 1 -- 172.21.15.7:0/3300134068 wait complete. 2024-04-23T14:58:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.085+0000 7f4a9ee00640 1 Processor -- start 2024-04-23T14:58:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.085+0000 7f4a9ee00640 1 -- start start 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.085+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 0x7f4a981a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a98074cc0 0x7f4a981a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a98112e10 0x7f4a9819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981186b0 con 0x7f4a980743a0 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98118530 con 0x7f4a98112e10 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9ee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98118830 con 0x7f4a98074cc0 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 0x7f4a981a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 0x7f4a981a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48760/0 (socket says 172.21.15.7:48760) 2024-04-23T14:58:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 -- 172.21.15.7:0/963594036 learned_addr learned my addr 172.21.15.7:0/963594036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9d000640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a98074cc0 0x7f4a981a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9e400640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a98112e10 0x7f4a9819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 -- 172.21.15.7:0/963594036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a98074cc0 msgr2=0x7f4a981a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a98074cc0 0x7f4a981a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 -- 172.21.15.7:0/963594036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a98112e10 msgr2=0x7f4a9819eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a98112e10 0x7f4a9819eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.086+0000 7f4a9da00640 1 -- 172.21.15.7:0/963594036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9819f230 con 0x7f4a980743a0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a9e400640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a98112e10 0x7f4a9819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a9da00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 0x7f4a981a4900 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c031440 tx=0x7f4a8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a96000640 1 -- 172.21.15.7:0/963594036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c03f030 con 0x7f4a980743a0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9819f4c0 con 0x7f4a980743a0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a96000640 1 -- 172.21.15.7:0/963594036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a8c003aa0 con 0x7f4a980743a0 2024-04-23T14:58:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a96000640 1 -- 172.21.15.7:0/963594036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c035070 con 0x7f4a980743a0 2024-04-23T14:58:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.087+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a981ab7c0 con 0x7f4a980743a0 2024-04-23T14:58:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.092+0000 7f4aa3187740 1 Processor -- start 2024-04-23T14:58:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.092+0000 7f4aa3187740 1 -- start start 2024-04-23T14:58:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a957a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a95ce0 0x55e038aa0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038aa2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4aa3187740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e0389fb900 con 0x55e038a953c0 2024-04-23T14:58:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4aa3187740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e0389a1f20 con 0x55e038aa05a0 2024-04-23T14:58:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4aa3187740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e0389f78c0 con 0x55e038a95ce0 2024-04-23T14:58:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4a96000640 1 -- 172.21.15.7:0/963594036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4a8c042030 con 0x7f4a980743a0 2024-04-23T14:58:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4a9e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4a9e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48776/0 (socket says 172.21.15.7:48776) 2024-04-23T14:58:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4a9e400640 1 -- 172.21.15.7:0/2679848495 learned_addr learned my addr 172.21.15.7:0/2679848495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4a9d000640 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038aa2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.093+0000 7f4a9da00640 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a95ce0 0x55e038aa0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9e400640 1 -- 172.21.15.7:0/2679848495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a95ce0 msgr2=0x55e038aa0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a95ce0 0x55e038aa0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9e400640 1 -- 172.21.15.7:0/2679848495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 msgr2=0x55e038aa2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038aa2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9e400640 1 -- 172.21.15.7:0/2679848495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0389c6e10 con 0x55e038a953c0 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9d000640 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038aa2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.094+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a957a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009ee0 tx=0x7f4a9000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b05624d90f3016 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.095+0000 7f4a8aa00640 1 -- 172.21.15.7:0/2679848495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90011640 con 0x55e038a953c0 2024-04-23T14:58:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.095+0000 7f4a8aa00640 1 -- 172.21.15.7:0/2679848495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a90011c90 con 0x55e038a953c0 2024-04-23T14:58:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.095+0000 7f4a8aa00640 1 -- 172.21.15.7:0/2679848495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9001bcb0 con 0x55e038a953c0 2024-04-23T14:58:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.095+0000 7f4a96000640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4a800a3d10 0x7f4a800a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4a96000640 1 -- 172.21.15.7:0/963594036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f4a8c0f1300 con 0x7f4a980743a0 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4a9da00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4a800a3d10 0x7f4a800a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 -- 172.21.15.7:0/2679848495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 msgr2=0x55e038a957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a957a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009ee0 tx=0x7f4a9000f730 comp rx=0 tx=0).stop 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 -- 172.21.15.7:0/2679848495 shutdown_connections 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038aa2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a95ce0 0x55e038aa0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2679848495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a957a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.096+0000 7f4aa3187740 1 -- 172.21.15.7:0/2679848495 >> 172.21.15.7:0/2679848495 conn(0x55e038a918d0 msgr2=0x55e038a91cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.097+0000 7f4a9da00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4a800a3d10 0x7f4a800a61d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0ee750 tx=0x7f4a8c009260 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.097+0000 7f4aa3187740 1 -- 172.21.15.7:0/2679848495 shutdown_connections 2024-04-23T14:58:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.097+0000 7f4aa3187740 1 -- 172.21.15.7:0/2679848495 wait complete. 2024-04-23T14:58:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.097+0000 7f4aa3187740 1 -- start start 2024-04-23T14:58:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.097+0000 7f4aa3187740 1 Processor -- start 2024-04-23T14:58:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038a9d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a9db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e038aa30e0 con 0x55e038a95ce0 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e0389b52c0 con 0x55e038aa05a0 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e038aa3260 con 0x55e038a953c0 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4aa3187740 10 client.0 _ll_register_callbacks cb 0x55e03870da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4a9d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a9db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4a9d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a9db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48778/0 (socket says 172.21.15.7:48778) 2024-04-23T14:58:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.098+0000 7f4a9d000640 1 -- 172.21.15.7:0/400916615 learned_addr learned my addr 172.21.15.7:0/400916615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9e400640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038a9d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9e400640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9d000640 1 -- 172.21.15.7:0/400916615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 msgr2=0x55e038a9d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9d000640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038a9d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9d000640 1 -- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 msgr2=0x55e038a9e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9d000640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9d000640 1 -- 172.21.15.7:0/400916615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0389c5fd0 con 0x55e038a95ce0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9e400640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a9d000640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a9db70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400bea0 tx=0x7f4a8400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bb0594fbee47cb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.099+0000 7f4a7f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4a7f400640 1 -- 172.21.15.7:0/400916615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a84012650 con 0x55e038a95ce0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4a7f400640 1 -- 172.21.15.7:0/400916615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f4a840127f0 con 0x55e038a95ce0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a90011c90 con 0x55e038a95ce0 2024-04-23T14:58:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4a7f400640 1 -- 172.21.15.7:0/400916615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4a840129f0 con 0x55e038a95ce0 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4aa3187740 10 client.16209 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e03870e210 con 0x55e038a95ce0 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4a7f400640 1 -- 172.21.15.7:0/400916615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a90011c90 con 0x55e038a95ce0 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.100+0000 7f4a7f400640 1 -- 172.21.15.7:0/400916615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4a8401a3d0 con 0x55e038a95ce0 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4aa3187740 10 client.16209 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4aa3187740 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4aa3187740 20 client.16209 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4aa3187740 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038ab0860 0x55e038ab2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4aa3187740 4 client.16209 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:58:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e038a09320 con 0x55e038ab0860 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.101+0000 7f4a9e400640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038ab0860 0x55e038ab2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.102+0000 7f4a7f400640 10 client.16209 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.102+0000 7f4a9e400640 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038ab0860 0x55e038ab2c70 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf5b411f02e00c8 server_cookie=2a7c924606dcc91d in_seq=0 out_seq=0 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4a7f400640 1 -- 172.21.15.7:0/400916615 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e038a09320 con 0x55e038ab0860 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4a7f400640 10 client.16209 handle_command_reply: tid=0 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 client.16209 shutdown 2024-04-23T14:58:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 msgr2=0x55e038a9db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a9db70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400bea0 tx=0x7f4a8400bf90 comp rx=0 tx=0).stop 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 shutdown_connections 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038ab0860 0x55e038ab2c70 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a9db70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 --2- 172.21.15.7:0/400916615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038a9d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.104+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 >> 172.21.15.7:0/400916615 conn(0x55e038a918d0 msgr2=0x55e038a97600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.105+0000 7f4a7f400640 0 client.16209 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.105+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 shutdown_connections 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.105+0000 7f4aa3187740 1 -- 172.21.15.7:0/400916615 wait complete. 2024-04-23T14:58:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.105+0000 7f4aa3187740 20 client.16209 trim_cache size 0 max 16384 2024-04-23T14:58:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.123+0000 7f4aa3187740 1 Processor -- start 2024-04-23T14:58:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 -- start start 2024-04-23T14:58:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a9fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038a95ce0 0x55e038a91210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038aa05a0 0x55e038a97d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981b58c0 con 0x55e038a953c0 2024-04-23T14:58:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981b7400 con 0x55e038a95ce0 2024-04-23T14:58:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4aa3187740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981b5f90 con 0x55e038aa05a0 2024-04-23T14:58:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4a9e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a9fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4a9e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a9fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48788/0 (socket says 172.21.15.7:48788) 2024-04-23T14:58:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.124+0000 7f4a9e400640 1 -- 172.21.15.7:0/1157937040 learned_addr learned my addr 172.21.15.7:0/1157937040 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9d000640 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038a95ce0 0x55e038a91210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9e400640 1 -- 172.21.15.7:0/1157937040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038aa05a0 msgr2=0x55e038a97d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9e400640 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038aa05a0 0x55e038a97d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9e400640 1 -- 172.21.15.7:0/1157937040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038a95ce0 msgr2=0x55e038a91210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9e400640 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038a95ce0 0x55e038a91210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9e400640 1 -- 172.21.15.7:0/1157937040 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e038aa2d00 con 0x55e038a953c0 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a9e400640 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a9fd60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4a9001b900 tx=0x7f4a9000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997a61fffd88bcf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.125+0000 7f4a8a000640 1 -- 172.21.15.7:0/1157937040 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9001bba0 con 0x55e038a953c0 2024-04-23T14:58:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.126+0000 7f4a8a000640 1 -- 172.21.15.7:0/1157937040 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a90003e20 con 0x55e038a953c0 2024-04-23T14:58:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.126+0000 7f4a8a000640 1 -- 172.21.15.7:0/1157937040 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a900118a0 con 0x55e038a953c0 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.126+0000 7f4aa3187740 1 -- 172.21.15.7:0/1157937040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 msgr2=0x55e038a9fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.126+0000 7f4aa3187740 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a9fd60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4a9001b900 tx=0x7f4a9000f730 comp rx=0 tx=0).stop 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 -- 172.21.15.7:0/1157937040 shutdown_connections 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038a95ce0 0x55e038a91210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038aa05a0 0x55e038a97d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 --2- 172.21.15.7:0/1157937040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a953c0 0x55e038a9fd60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 -- 172.21.15.7:0/1157937040 >> 172.21.15.7:0/1157937040 conn(0x55e038a918d0 msgr2=0x55e038a9d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 -- 172.21.15.7:0/1157937040 shutdown_connections 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 -- 172.21.15.7:0/1157937040 wait complete. 2024-04-23T14:58:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 -- start start 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.127+0000 7f4aa3187740 1 Processor -- start 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038aa87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a99ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981b6d30 con 0x55e038a95ce0 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981b6660 con 0x55e038aa05a0 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4a981b38c0 con 0x55e038a953c0 2024-04-23T14:58:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4aa3187740 10 client.0 _ll_register_callbacks cb 0x7f4a8400b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4a9d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a99ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4a9d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a99ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48800/0 (socket says 172.21.15.7:48800) 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.128+0000 7f4a9d000640 1 -- 172.21.15.7:0/2937529773 learned_addr learned my addr 172.21.15.7:0/2937529773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038aa87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9d000640 1 -- 172.21.15.7:0/2937529773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 msgr2=0x55e038aa87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9d000640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038aa87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9d000640 1 -- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 msgr2=0x55e038a9a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9d000640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9d000640 1 -- 172.21.15.7:0/2937529773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0387da620 con 0x55e038a95ce0 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.129+0000 7f4a9d000640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a99ec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55e038a9ec00 tx=0x7f4a8400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729c11d47e3ea2bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4a7f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4a7f400640 1 -- 172.21.15.7:0/2937529773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8401a610 con 0x55e038a95ce0 2024-04-23T14:58:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4a7f400640 1 -- 172.21.15.7:0/2937529773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f4a84012450 con 0x55e038a95ce0 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a90003e20 con 0x55e038a95ce0 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4a7f400640 1 -- 172.21.15.7:0/2937529773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4a8403b050 con 0x55e038a95ce0 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4aa3187740 10 client.16215 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.130+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e038b16920 con 0x55e038a95ce0 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4a7f400640 1 -- 172.21.15.7:0/2937529773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a90003e20 con 0x55e038a95ce0 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4a7f400640 1 -- 172.21.15.7:0/2937529773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4a84005460 con 0x55e038a95ce0 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4aa3187740 10 client.16215 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4aa3187740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4aa3187740 20 client.16215 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038b17070 0x55e038b19490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4aa3187740 4 client.16215 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.131+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e038a03190 con 0x55e038b17070 2024-04-23T14:58:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.132+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038b17070 0x55e038b19490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.132+0000 7f4a9e400640 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038b17070 0x55e038b19490 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70ff4ac74d4be83 server_cookie=920cb7583981aa70 in_seq=0 out_seq=0 2024-04-23T14:58:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.132+0000 7f4a7f400640 10 client.16215 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:28.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.165+0000 7f4a7f400640 1 -- 172.21.15.7:0/2937529773 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e038a03190 con 0x55e038b17070 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.165+0000 7f4a7f400640 10 client.16215 handle_command_reply: tid=0 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 client.16215 shutdown 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 msgr2=0x55e038a99ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a99ec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55e038a9ec00 tx=0x7f4a8400b7e0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 shutdown_connections 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e038b17070 0x55e038b19490 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e038aa05a0 0x55e038a9a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e038a95ce0 0x55e038a99ec0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 --2- 172.21.15.7:0/2937529773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e038a953c0 0x55e038aa87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 >> 172.21.15.7:0/2937529773 conn(0x55e038a918d0 msgr2=0x55e038a9de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.166+0000 7f4a7f400640 0 client.16215 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.167+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 shutdown_connections 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.167+0000 7f4aa3187740 1 -- 172.21.15.7:0/2937529773 wait complete. 2024-04-23T14:58:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.167+0000 7f4aa3187740 20 client.16215 trim_cache size 0 max 16384 2024-04-23T14:58:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:58:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:58:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:58:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4a800a3d10 msgr2=0x7f4a800a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4a800a3d10 0x7f4a800a61d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0ee750 tx=0x7f4a8c009260 comp rx=0 tx=0).stop 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 msgr2=0x7f4a981a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 0x7f4a981a4900 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c031440 tx=0x7f4a8c004270 comp rx=0 tx=0).stop 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 shutdown_connections 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4a800a3d10 0x7f4a800a61d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a98112e10 0x7f4a9819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a98074cc0 0x7f4a981a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 --2- 172.21.15.7:0/963594036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a980743a0 0x7f4a981a4900 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 >> 172.21.15.7:0/963594036 conn(0x7f4a980fd950 msgr2=0x7f4a980ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 shutdown_connections 2024-04-23T14:58:28.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:28.168+0000 7f4a9ee00640 1 -- 172.21.15.7:0/963594036 wait complete. 2024-04-23T14:58:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:29 smithi007 ceph-mon[27906]: pgmap v219: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:58:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:29 smithi186 ceph-mon[31814]: pgmap v219: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:58:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:29 smithi137 ceph-mon[31694]: pgmap v219: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:58:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:31 smithi007 ceph-mon[27906]: pgmap v220: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:58:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:31 smithi186 ceph-mon[31814]: pgmap v220: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:58:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:31 smithi137 ceph-mon[31694]: pgmap v220: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T14:58:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:33 smithi007 ceph-mon[27906]: pgmap v221: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:33 smithi186 ceph-mon[31814]: pgmap v221: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:33 smithi137 ceph-mon[31694]: pgmap v221: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:35 smithi007 ceph-mon[27906]: pgmap v222: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:58:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:35 smithi186 ceph-mon[31814]: pgmap v222: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:58:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:35 smithi137 ceph-mon[31694]: pgmap v222: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:58:37.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:37 smithi007 ceph-mon[27906]: pgmap v223: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:58:37.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:37 smithi186 ceph-mon[31814]: pgmap v223: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:58:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:37 smithi137 ceph-mon[31694]: pgmap v223: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:58:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:39 smithi007 ceph-mon[27906]: pgmap v224: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:39.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:39 smithi186 ceph-mon[31814]: pgmap v224: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:39 smithi137 ceph-mon[31694]: pgmap v224: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 -- 172.21.15.7:0/886059539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 msgr2=0x7f74bc10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 --2- 172.21.15.7:0/886059539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 0x7f74bc10ef20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009ca0 tx=0x7f74b402a8c0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 -- 172.21.15.7:0/886059539 shutdown_connections 2024-04-23T14:58:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 --2- 172.21.15.7:0/886059539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 0x7f74bc10ef20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 --2- 172.21.15.7:0/886059539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc102c30 0x7f74bc106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 --2- 172.21.15.7:0/886059539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc102280 0x7f74bc102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.327+0000 7f74c0e00640 1 -- 172.21.15.7:0/886059539 >> 172.21.15.7:0/886059539 conn(0x7f74bc079490 msgr2=0x7f74bc0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.329+0000 7f74c0e00640 1 -- 172.21.15.7:0/886059539 shutdown_connections 2024-04-23T14:58:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.329+0000 7f74c0e00640 1 -- 172.21.15.7:0/886059539 wait complete. 2024-04-23T14:58:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.330+0000 7f74c0e00640 1 Processor -- start 2024-04-23T14:58:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 -- start start 2024-04-23T14:58:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc102280 0x7f74bc074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 0x7f74bc074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 0x7f74bc1a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc112310 con 0x7f74bc107350 2024-04-23T14:58:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc112190 con 0x7f74bc074d80 2024-04-23T14:58:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.331+0000 7f74c0e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc112490 con 0x7f74bc102280 2024-04-23T14:58:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.332+0000 7f74b9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 0x7f74bc074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.332+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc102280 0x7f74bc074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.333+0000 7f74ba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 0x7f74bc1a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.333+0000 7f74ba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 0x7f74bc1a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:50002/0 (socket says 172.21.15.7:50002) 2024-04-23T14:58:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.333+0000 7f74ba800640 1 -- 172.21.15.7:0/4019237064 learned_addr learned my addr 172.21.15.7:0/4019237064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.334+0000 7f74ba800640 1 -- 172.21.15.7:0/4019237064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc102280 msgr2=0x7f74bc074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.334+0000 7f74ba800640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc102280 0x7f74bc074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.334+0000 7f74ba800640 1 -- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 msgr2=0x7f74bc074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.334+0000 7f74ba800640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 0x7f74bc074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.334+0000 7f74ba800640 1 -- 172.21.15.7:0/4019237064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74bc1a6f80 con 0x7f74bc074d80 2024-04-23T14:58:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.334+0000 7f74ba800640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 0x7f74bc1a6880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74b4005e30 tx=0x7f74b40093d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.335+0000 7f74b2a00640 1 -- 172.21.15.7:0/4019237064 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4003c70 con 0x7f74bc074d80 2024-04-23T14:58:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.335+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74bc198400 con 0x7f74bc074d80 2024-04-23T14:58:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.335+0000 7f74b2a00640 1 -- 172.21.15.7:0/4019237064 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74b4003e10 con 0x7f74bc074d80 2024-04-23T14:58:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.335+0000 7f74b2a00640 1 -- 172.21.15.7:0/4019237064 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4030c10 con 0x7f74bc074d80 2024-04-23T14:58:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.335+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74bc1989a0 con 0x7f74bc074d80 2024-04-23T14:58:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.340+0000 7f74c3c18740 1 Processor -- start 2024-04-23T14:58:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.341+0000 7f74b2a00640 1 -- 172.21.15.7:0/4019237064 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f74b4004040 con 0x7f74bc074d80 2024-04-23T14:58:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.341+0000 7f74c3c18740 1 -- start start 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028383590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x563028390780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74c3c18740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5630282e9900 con 0x563028383ad0 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74c3c18740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56302828ff20 con 0x5630283831b0 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74c3c18740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5630282e58c0 con 0x56302838e390 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59886/0 (socket says 172.21.15.7:59886) 2024-04-23T14:58:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74b9e00640 1 -- 172.21.15.7:0/1073851547 learned_addr learned my addr 172.21.15.7:0/1073851547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.342+0000 7f74b9400640 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028383590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9400640 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x563028390780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b2a00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f74a00a3e70 0x7f74a00a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9e00640 1 -- 172.21.15.7:0/1073851547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 msgr2=0x563028390780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x563028390780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9e00640 1 -- 172.21.15.7:0/1073851547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 msgr2=0x563028383590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028383590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9e00640 1 -- 172.21.15.7:0/1073851547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630282b4e10 con 0x563028383ad0 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9400640 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028383590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:58:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b2a00640 1 -- 172.21.15.7:0/4019237064 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f74b40f1dc0 con 0x7f74bc074d80 2024-04-23T14:58:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74ba800640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f74a00a3e70 0x7f74a00a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838de50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007510 tx=0x7f74ac0079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebea1c30fe34535 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.343+0000 7f74a7400640 1 -- 172.21.15.7:0/1073851547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac005020 con 0x563028383ad0 2024-04-23T14:58:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.344+0000 7f74a7400640 1 -- 172.21.15.7:0/1073851547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74ac0047a0 con 0x563028383ad0 2024-04-23T14:58:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.344+0000 7f74a7400640 1 -- 172.21.15.7:0/1073851547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01b880 con 0x563028383ad0 2024-04-23T14:58:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.344+0000 7f74c3c18740 1 -- 172.21.15.7:0/1073851547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 msgr2=0x56302838de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.344+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838de50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007510 tx=0x7f74ac0079d0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.344+0000 7f74ba800640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f74a00a3e70 0x7f74a00a6330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74b4006010 tx=0x7f74b40306d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 -- 172.21.15.7:0/1073851547 shutdown_connections 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x563028390780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838de50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1073851547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028383590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 -- 172.21.15.7:0/1073851547 >> 172.21.15.7:0/1073851547 conn(0x56302837f6c0 msgr2=0x56302837faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 -- 172.21.15.7:0/1073851547 shutdown_connections 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 -- 172.21.15.7:0/1073851547 wait complete. 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 -- start start 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.345+0000 7f74c3c18740 1 Processor -- start 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x56302838b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x56302838bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563028390fc0 con 0x563028383ad0 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5630282a32c0 con 0x5630283831b0 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563028391140 con 0x56302838e390 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74c3c18740 10 client.0 _ll_register_callbacks cb 0x563027ffba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59896/0 (socket says 172.21.15.7:59896) 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.346+0000 7f74b9e00640 1 -- 172.21.15.7:0/1298189623 learned_addr learned my addr 172.21.15.7:0/1298189623 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9400640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x56302838b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9400640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x56302838bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9e00640 1 -- 172.21.15.7:0/1298189623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 msgr2=0x56302838bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x56302838bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9e00640 1 -- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 msgr2=0x56302838b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x56302838b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9e00640 1 -- 172.21.15.7:0/1298189623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630282b3fd0 con 0x563028383ad0 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9400640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x56302838b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838b860 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79132e21d05c8ef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f749be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.347+0000 7f749be00640 1 -- 172.21.15.7:0/1298189623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004030 con 0x563028383ad0 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.348+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74ac0047a0 con 0x563028383ad0 2024-04-23T14:58:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.348+0000 7f749be00640 1 -- 172.21.15.7:0/1298189623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f74ac0041d0 con 0x563028383ad0 2024-04-23T14:58:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f749be00640 1 -- 172.21.15.7:0/1298189623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f74ac0043d0 con 0x563028383ad0 2024-04-23T14:58:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f74c3c18740 10 client.16227 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563027ffc210 con 0x563028383ad0 2024-04-23T14:58:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f749be00640 1 -- 172.21.15.7:0/1298189623 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74ac0047a0 con 0x563028383ad0 2024-04-23T14:58:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f749be00640 1 -- 172.21.15.7:0/1298189623 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f74ac01b660 con 0x563028383ad0 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f74c3c18740 10 client.16227 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.349+0000 7f74c3c18740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.350+0000 7f74c3c18740 20 client.16227 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.350+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56302839e4b0 0x5630283a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.350+0000 7f74c3c18740 4 client.16227 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.350+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630282f7320 con 0x56302839e4b0 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.350+0000 7f74b9400640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56302839e4b0 0x5630283a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.351+0000 7f749be00640 10 client.16227 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.351+0000 7f74b9400640 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56302839e4b0 0x5630283a08a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd5f1b7ca8925cb2 server_cookie=57f35c5f749ef2eb in_seq=0 out_seq=0 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f749be00640 1 -- 172.21.15.7:0/1298189623 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5630282f7320 con 0x56302839e4b0 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f749be00640 10 client.16227 handle_command_reply: tid=0 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 client.16227 shutdown 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 msgr2=0x56302838b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838b860 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac005250 comp rx=0 tx=0).stop 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 shutdown_connections 2024-04-23T14:58:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56302839e4b0 0x5630283a08a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x56302838bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x56302838b860 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1298189623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x56302838b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 >> 172.21.15.7:0/1298189623 conn(0x56302837f6c0 msgr2=0x563028385440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.354+0000 7f749be00640 0 client.16227 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.355+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 shutdown_connections 2024-04-23T14:58:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.355+0000 7f74c3c18740 1 -- 172.21.15.7:0/1298189623 wait complete. 2024-04-23T14:58:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.355+0000 7f74c3c18740 20 client.16227 trim_cache size 0 max 16384 2024-04-23T14:58:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 Processor -- start 2024-04-23T14:58:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 -- start start 2024-04-23T14:58:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028399eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x5630283a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1ad140 con 0x563028383ad0 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1aec80 con 0x5630283831b0 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.376+0000 7f74c3c18740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1ad810 con 0x56302838e390 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59908/0 (socket says 172.21.15.7:59908) 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 -- 172.21.15.7:0/1672222349 learned_addr learned my addr 172.21.15.7:0/1672222349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9400640 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028399eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9400640 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x5630283a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 -- 172.21.15.7:0/1672222349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 msgr2=0x5630283a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x5630283a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 -- 172.21.15.7:0/1672222349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 msgr2=0x563028399eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028399eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9e00640 1 -- 172.21.15.7:0/1672222349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630280c8620 con 0x563028383ad0 2024-04-23T14:58:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.377+0000 7f74b9400640 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028399eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.378+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283a60b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f74ac001eb0 tx=0x7f74ac010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7365c8d9f1355ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.378+0000 7f74a6a00640 1 -- 172.21.15.7:0/1672222349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004780 con 0x563028383ad0 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.378+0000 7f74a6a00640 1 -- 172.21.15.7:0/1672222349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74ac004da0 con 0x563028383ad0 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.378+0000 7f74a6a00640 1 -- 172.21.15.7:0/1672222349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac003f60 con 0x563028383ad0 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 -- 172.21.15.7:0/1672222349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 msgr2=0x5630283a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283a60b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f74ac001eb0 tx=0x7f74ac010f20 comp rx=0 tx=0).stop 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 -- 172.21.15.7:0/1672222349 shutdown_connections 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56302838e390 0x5630283a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283a60b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1672222349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630283831b0 0x563028399eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 -- 172.21.15.7:0/1672222349 >> 172.21.15.7:0/1672222349 conn(0x56302837f6c0 msgr2=0x563028386610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 -- 172.21.15.7:0/1672222349 shutdown_connections 2024-04-23T14:58:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.379+0000 7f74c3c18740 1 -- 172.21.15.7:0/1672222349 wait complete. 2024-04-23T14:58:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.380+0000 7f74c3c18740 1 -- start start 2024-04-23T14:58:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.380+0000 7f74c3c18740 1 Processor -- start 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630283831b0 0x5630283fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283fd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56302838e390 0x5630283915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1ae5b0 con 0x563028383ad0 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1adee0 con 0x56302838e390 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1ab140 con 0x5630283831b0 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74c3c18740 10 client.0 _ll_register_callbacks cb 0x7f74ac0073e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59924/0 (socket says 172.21.15.7:59924) 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9e00640 1 -- 172.21.15.7:0/1044153278 learned_addr learned my addr 172.21.15.7:0/1044153278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9400640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630283831b0 0x5630283fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9400640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56302838e390 0x5630283915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9e00640 1 -- 172.21.15.7:0/1044153278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630283831b0 msgr2=0x5630283fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630283831b0 0x5630283fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.381+0000 7f74b9e00640 1 -- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56302838e390 msgr2=0x5630283915a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56302838e390 0x5630283915a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f74b9e00640 1 -- 172.21.15.7:0/1044153278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563028391c90 con 0x563028383ad0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f74b9e00640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283fd160 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f74ac004f70 tx=0x7f74ac01b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810023335c0f959b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f749be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f749be00640 1 -- 172.21.15.7:0/1044153278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004780 con 0x563028383ad0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f749be00640 1 -- 172.21.15.7:0/1044153278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f74ac025650 con 0x563028383ad0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.382+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74ac004da0 con 0x563028383ad0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f749be00640 1 -- 172.21.15.7:0/1044153278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f74ac005220 con 0x563028383ad0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 10 client.16233 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5630284043d0 con 0x563028383ad0 2024-04-23T14:58:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f749be00640 1 -- 172.21.15.7:0/1044153278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74ac004da0 con 0x563028383ad0 2024-04-23T14:58:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f749be00640 1 -- 172.21.15.7:0/1044153278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f74ac0375b0 con 0x563028383ad0 2024-04-23T14:58:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 10 client.16233 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 20 client.16233 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563028404710 0x563028406b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 4 client.16233 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.383+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630282f1190 con 0x563028404710 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.384+0000 7f74b9400640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563028404710 0x563028406b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.385+0000 7f74b9400640 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563028404710 0x563028406b00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3eda625def5de0 server_cookie=2b820aa01f07a22d in_seq=0 out_seq=0 2024-04-23T14:58:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.385+0000 7f749be00640 10 client.16233 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.403+0000 7f749be00640 1 -- 172.21.15.7:0/1044153278 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630282f1190 con 0x563028404710 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.403+0000 7f749be00640 10 client.16233 handle_command_reply: tid=0 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.403+0000 7f74c3c18740 1 client.16233 shutdown 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.403+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 msgr2=0x5630283fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.403+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283fd160 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f74ac004f70 tx=0x7f74ac01b810 comp rx=0 tx=0).stop 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 shutdown_connections 2024-04-23T14:58:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563028404710 0x563028406b00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56302838e390 0x5630283915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563028383ad0 0x5630283fd160 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 --2- 172.21.15.7:0/1044153278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630283831b0 0x5630283fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 >> 172.21.15.7:0/1044153278 conn(0x56302837f6c0 msgr2=0x563028384ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f749be00640 0 client.16233 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 shutdown_connections 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 1 -- 172.21.15.7:0/1044153278 wait complete. 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.404+0000 7f74c3c18740 20 client.16233 trim_cache size 0 max 16384 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:58:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:58:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:58:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:58:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f74a00a3e70 msgr2=0x7f74a00a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f74a00a3e70 0x7f74a00a6330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74b4006010 tx=0x7f74b40306d0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 msgr2=0x7f74bc1a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 0x7f74bc1a6880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74b4005e30 tx=0x7f74b40093d0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 shutdown_connections 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f74a00a3e70 0x7f74a00a6330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74bc074d80 0x7f74bc1a6880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74bc107350 0x7f74bc074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 --2- 172.21.15.7:0/4019237064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc102280 0x7f74bc074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 >> 172.21.15.7:0/4019237064 conn(0x7f74bc079490 msgr2=0x7f74bc0ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 shutdown_connections 2024-04-23T14:58:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:41.405+0000 7f74c0e00640 1 -- 172.21.15.7:0/4019237064 wait complete. 2024-04-23T14:58:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:41 smithi007 ceph-mon[27906]: pgmap v225: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:41 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:41.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:41 smithi186 ceph-mon[31814]: pgmap v225: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:41 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:41 smithi137 ceph-mon[31694]: pgmap v225: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:41.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:41 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:43 smithi007 ceph-mon[27906]: pgmap v226: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:58:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:58:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:43 smithi186 ceph-mon[31814]: pgmap v226: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:58:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:58:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:43 smithi137 ceph-mon[31694]: pgmap v226: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:58:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:43.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:43.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:58:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:45 smithi186 ceph-mon[31814]: pgmap v227: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T14:58:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:45 smithi137 ceph-mon[31694]: pgmap v227: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T14:58:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:45 smithi007 ceph-mon[27906]: pgmap v227: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T14:58:47.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:47 smithi186 ceph-mon[31814]: pgmap v228: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:47.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:47 smithi137 ceph-mon[31694]: pgmap v228: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:47 smithi007 ceph-mon[27906]: pgmap v228: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:49.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:49 smithi186 ceph-mon[31814]: pgmap v229: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:49 smithi137 ceph-mon[31694]: pgmap v229: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:49 smithi007 ceph-mon[27906]: pgmap v229: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:51.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:51 smithi186 ceph-mon[31814]: pgmap v230: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:51 smithi137 ceph-mon[31694]: pgmap v230: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:51 smithi007 ceph-mon[27906]: pgmap v230: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:58:53.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:53 smithi137 ceph-mon[31694]: pgmap v231: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:53 smithi007 ceph-mon[27906]: pgmap v231: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:53 smithi186 ceph-mon[31814]: pgmap v231: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:58:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 -- 172.21.15.7:0/1134677393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074c20 msgr2=0x7f83c410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 --2- 172.21.15.7:0/1134677393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074c20 0x7f83c410e3b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009900 tx=0x7f83b002a480 comp rx=0 tx=0).stop 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 -- 172.21.15.7:0/1134677393 shutdown_connections 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 --2- 172.21.15.7:0/1134677393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83c410e8f0 0x7f83c4110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 --2- 172.21.15.7:0/1134677393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074c20 0x7f83c410e3b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 --2- 172.21.15.7:0/1134677393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83c4074300 0x7f83c40746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 -- 172.21.15.7:0/1134677393 >> 172.21.15.7:0/1134677393 conn(0x7f83c4079490 msgr2=0x7f83c40798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 -- 172.21.15.7:0/1134677393 shutdown_connections 2024-04-23T14:58:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.558+0000 7f83cc000640 1 -- 172.21.15.7:0/1134677393 wait complete. 2024-04-23T14:58:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.559+0000 7f83cc000640 1 Processor -- start 2024-04-23T14:58:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.559+0000 7f83cc000640 1 -- start start 2024-04-23T14:58:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83cc000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 0x7f83c41a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83cc000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83c4074c20 0x7f83c41a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83cc000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83c410e8f0 0x7f83c419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83cc000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41144a0 con 0x7f83c4074300 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83cc000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4114320 con 0x7f83c410e8f0 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83cc000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4114620 con 0x7f83c4074c20 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83c9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 0x7f83c41a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83c9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 0x7f83c41a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60138/0 (socket says 172.21.15.7:60138) 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.560+0000 7f83c9600640 1 -- 172.21.15.7:0/793667046 learned_addr learned my addr 172.21.15.7:0/793667046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c8c00640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83c4074c20 0x7f83c41a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83ca000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83c410e8f0 0x7f83c419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c9600640 1 -- 172.21.15.7:0/793667046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83c4074c20 msgr2=0x7f83c41a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c9600640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83c4074c20 0x7f83c41a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c9600640 1 -- 172.21.15.7:0/793667046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83c410e8f0 msgr2=0x7f83c419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c9600640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83c410e8f0 0x7f83c419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c9600640 1 -- 172.21.15.7:0/793667046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c419afa0 con 0x7f83c4074300 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.561+0000 7f83c9600640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 0x7f83c41a0620 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f83b800d950 tx=0x7f83b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.562+0000 7f83c2000640 1 -- 172.21.15.7:0/793667046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8017070 con 0x7f83c4074300 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.562+0000 7f83c2000640 1 -- 172.21.15.7:0/793667046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83b8009c30 con 0x7f83c4074300 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.562+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c419b290 con 0x7f83c4074300 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.562+0000 7f83c2000640 1 -- 172.21.15.7:0/793667046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b800f620 con 0x7f83c4074300 2024-04-23T14:58:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.562+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c41a75a0 con 0x7f83c4074300 2024-04-23T14:58:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.565+0000 7f83cee6b740 1 Processor -- start 2024-04-23T14:58:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 -- start start 2024-04-23T14:58:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da091590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da091ad0 0x5599da09be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da09e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599d9ff7900 con 0x5599da091ad0 2024-04-23T14:58:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5599d9f9df20 con 0x5599da0911b0 2024-04-23T14:58:54.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.566+0000 7f83cee6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5599d9ff38c0 con 0x5599da09c390 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c2000640 1 -- 172.21.15.7:0/793667046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f83b80109a0 con 0x7f83c4074300 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83ca000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da091590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da09e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da09e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:54350/0 (socket says 172.21.15.7:54350) 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 -- 172.21.15.7:0/2670159895 learned_addr learned my addr 172.21.15.7:0/2670159895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83ca000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da091590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:46504/0 (socket says 172.21.15.7:46504) 2024-04-23T14:58:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c9600640 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da091ad0 0x5599da09be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 -- 172.21.15.7:0/2670159895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 msgr2=0x5599da091590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da091590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 -- 172.21.15.7:0/2670159895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da091ad0 msgr2=0x5599da09be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da091ad0 0x5599da09be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c8c00640 1 -- 172.21.15.7:0/2670159895 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d9fc2e10 con 0x5599da09c390 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.567+0000 7f83c9600640 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da091ad0 0x5599da09be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.568+0000 7f83c8c00640 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da09e780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009900 tx=0x7f83b0032c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6587c97f555dec19 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.568+0000 7f83b6600640 1 -- 172.21.15.7:0/2670159895 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b003f070 con 0x5599da09c390 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.569+0000 7f83b6600640 1 -- 172.21.15.7:0/2670159895 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83b00316a0 con 0x5599da09c390 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.569+0000 7f83b6600640 1 -- 172.21.15.7:0/2670159895 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0035070 con 0x5599da09c390 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.569+0000 7f83c2000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83ac0a3e40 0x7f83ac0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.569+0000 7f83c2000640 1 -- 172.21.15.7:0/793667046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f83b80d0820 con 0x7f83c4074300 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.569+0000 7f83ca000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83ac0a3e40 0x7f83ac0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 -- 172.21.15.7:0/2670159895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 msgr2=0x5599da09e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da09e780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009900 tx=0x7f83b0032c20 comp rx=0 tx=0).stop 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 -- 172.21.15.7:0/2670159895 shutdown_connections 2024-04-23T14:58:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da09e780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da091ad0 0x5599da09be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2670159895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 -- 172.21.15.7:0/2670159895 >> 172.21.15.7:0/2670159895 conn(0x5599da08d6c0 msgr2=0x5599da08daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83ca000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83ac0a3e40 0x7f83ac0a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83c4100f10 tx=0x7f83bc0096a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 -- 172.21.15.7:0/2670159895 shutdown_connections 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 -- 172.21.15.7:0/2670159895 wait complete. 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.570+0000 7f83cee6b740 1 -- start start 2024-04-23T14:58:54.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 Processor -- start 2024-04-23T14:58:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 0x5599da0992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da091ad0 0x5599da099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da099d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599da09ef60 con 0x5599da0911b0 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5599d9fb12c0 con 0x5599da091ad0 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5599da09f0e0 con 0x5599da09c390 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83cee6b740 10 client.0 _ll_register_callbacks cb 0x5599d9d09a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.571+0000 7f83c9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 0x5599da0992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 0x5599da0992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60160/0 (socket says 172.21.15.7:60160) 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 -- 172.21.15.7:0/419310320 learned_addr learned my addr 172.21.15.7:0/419310320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83ca000640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c8c00640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da091ad0 0x5599da099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 -- 172.21.15.7:0/419310320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 msgr2=0x5599da099d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da099d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 -- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da091ad0 msgr2=0x5599da099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da091ad0 0x5599da099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.572+0000 7f83c9600640 1 -- 172.21.15.7:0/419310320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d9fc1fd0 con 0x5599da0911b0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83c9600640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 0x5599da0992f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f83b809c110 tx=0x7f83b809c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0188d16974ea189 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83aaa00640 1 -- 172.21.15.7:0/419310320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b80d6020 con 0x5599da0911b0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83aaa00640 1 -- 172.21.15.7:0/419310320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f83b80cde40 con 0x5599da0911b0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b00316a0 con 0x5599da0911b0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83aaa00640 1 -- 172.21.15.7:0/419310320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83b80b5050 con 0x5599da0911b0 2024-04-23T14:58:54.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83cee6b740 10 client.16245 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5599d9d0a210 con 0x5599da0911b0 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.573+0000 7f83aaa00640 1 -- 172.21.15.7:0/419310320 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83b00316a0 con 0x5599da0911b0 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83aaa00640 1 -- 172.21.15.7:0/419310320 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f83b80d0410 con 0x5599da0911b0 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83cee6b740 10 client.16245 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83cee6b740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83cee6b740 20 client.16245 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83cee6b740 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da0ac3e0 0x5599da0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83cee6b740 4 client.16245 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.574+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599da005320 con 0x5599da0ac3e0 2024-04-23T14:58:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.575+0000 7f83c8c00640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da0ac3e0 0x5599da0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.576+0000 7f83c8c00640 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da0ac3e0 0x5599da0ae7d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c6d91c389823ee server_cookie=9a562518b1e4ee15 in_seq=0 out_seq=0 2024-04-23T14:58:54.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.576+0000 7f83aaa00640 10 client.16245 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83aaa00640 1 -- 172.21.15.7:0/419310320 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5599da005320 con 0x5599da0ac3e0 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83aaa00640 10 client.16245 handle_command_reply: tid=0 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 client.16245 shutdown 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 msgr2=0x5599da0992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 0x5599da0992f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f83b809c110 tx=0x7f83b809c2a0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 shutdown_connections 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da0ac3e0 0x5599da0ae7d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da091ad0 0x5599da099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da09c390 0x5599da099d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83aaa00640 0 client.16245 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 --2- 172.21.15.7:0/419310320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da0911b0 0x5599da0992f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 >> 172.21.15.7:0/419310320 conn(0x5599da08d6c0 msgr2=0x5599da093440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 shutdown_connections 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 1 -- 172.21.15.7:0/419310320 wait complete. 2024-04-23T14:58:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.578+0000 7f83cee6b740 20 client.16245 trim_cache size 0 max 16384 2024-04-23T14:58:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 Processor -- start 2024-04-23T14:58:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 -- start start 2024-04-23T14:58:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da08cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da093bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41b1520 con 0x5599da09c390 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41b3060 con 0x5599da0911b0 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.598+0000 7f83cee6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41b1bf0 con 0x5599da091ad0 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60162/0 (socket says 172.21.15.7:60162) 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 -- 172.21.15.7:0/4100986284 learned_addr learned my addr 172.21.15.7:0/4100986284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83c8c00640 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da093bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83c9600640 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da08cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 -- 172.21.15.7:0/4100986284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 msgr2=0x5599da093bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da093bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 -- 172.21.15.7:0/4100986284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 msgr2=0x5599da08cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da08cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.599+0000 7f83ca000640 1 -- 172.21.15.7:0/4100986284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d9dd6620 con 0x5599da09c390 2024-04-23T14:58:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.600+0000 7f83ca000640 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da0b4050 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f83bc01f490 tx=0x7f83bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafd2dd3bba5da57 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.600+0000 7f83b5c00640 1 -- 172.21.15.7:0/4100986284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc029630 con 0x5599da09c390 2024-04-23T14:58:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.600+0000 7f83b5c00640 1 -- 172.21.15.7:0/4100986284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83bc0208b0 con 0x5599da09c390 2024-04-23T14:58:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.600+0000 7f83b5c00640 1 -- 172.21.15.7:0/4100986284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc028990 con 0x5599da09c390 2024-04-23T14:58:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 -- 172.21.15.7:0/4100986284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 msgr2=0x5599da0b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da0b4050 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f83bc01f490 tx=0x7f83bc015000 comp rx=0 tx=0).stop 2024-04-23T14:58:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 -- 172.21.15.7:0/4100986284 shutdown_connections 2024-04-23T14:58:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da0b4050 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da093bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 --2- 172.21.15.7:0/4100986284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da08cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 -- 172.21.15.7:0/4100986284 >> 172.21.15.7:0/4100986284 conn(0x5599da08d6c0 msgr2=0x5599da099b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 -- 172.21.15.7:0/4100986284 shutdown_connections 2024-04-23T14:58:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.601+0000 7f83cee6b740 1 -- 172.21.15.7:0/4100986284 wait complete. 2024-04-23T14:58:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.602+0000 7f83cee6b740 1 -- start start 2024-04-23T14:58:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.602+0000 7f83cee6b740 1 Processor -- start 2024-04-23T14:58:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.602+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da096200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da096740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83cee6b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da096c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83cee6b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41b2990 con 0x5599da09c390 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83cee6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41b22c0 con 0x5599da0911b0 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83cee6b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41af520 con 0x5599da091ad0 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83cee6b740 10 client.0 _ll_register_callbacks cb 0x7f83b800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da096c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da096c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60174/0 (socket says 172.21.15.7:60174) 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 -- 172.21.15.7:0/2517744356 learned_addr learned my addr 172.21.15.7:0/2517744356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83c9600640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da096200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83c8c00640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da096740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 -- 172.21.15.7:0/2517744356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 msgr2=0x5599da096740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da096740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 -- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 msgr2=0x5599da096200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.603+0000 7f83ca000640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da096200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83ca000640 1 -- 172.21.15.7:0/2517744356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599da111b10 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83c9600640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da096200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83ca000640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da096c80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f83bc020010 tx=0x7f83bc020480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5b6efd7c3a2c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83aaa00640 1 -- 172.21.15.7:0/2517744356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc036020 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83aaa00640 1 -- 172.21.15.7:0/2517744356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9467+0+0 (secure 0 0 0) 0x7f83bc020a60 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.604+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83bc0208b0 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83aaa00640 1 -- 172.21.15.7:0/2517744356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83bc041050 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 10 client.16251 fetch_fsmap learned FSMap version 32 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5599da112e00 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83aaa00640 1 -- 172.21.15.7:0/2517744356 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83bc0208b0 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83aaa00640 1 -- 172.21.15.7:0/2517744356 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f83bc00f040 con 0x5599da09c390 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 10 client.16251 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:58:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 10 client.16251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 20 client.16251 populate_metadata read hostname 'smithi007' 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da113540 0x5599da115960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 4 client.16251 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.605+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5599d9fff190 con 0x5599da113540 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.606+0000 7f83c9600640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da113540 0x5599da115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.607+0000 7f83c9600640 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da113540 0x5599da115960 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=760c50d36ced58f8 server_cookie=dff22e8a29d5c9bd in_seq=0 out_seq=0 2024-04-23T14:58:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.607+0000 7f83aaa00640 10 client.16251 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.639+0000 7f83aaa00640 1 -- 172.21.15.7:0/2517744356 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5599d9fff190 con 0x5599da113540 2024-04-23T14:58:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.639+0000 7f83aaa00640 10 client.16251 handle_command_reply: tid=0 2024-04-23T14:58:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.639+0000 7f83cee6b740 1 client.16251 shutdown 2024-04-23T14:58:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 msgr2=0x5599da096c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da096c80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f83bc020010 tx=0x7f83bc020480 comp rx=0 tx=0).stop 2024-04-23T14:58:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 shutdown_connections 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599da113540 0x5599da115960 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599da09c390 0x5599da096c80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83aaa00640 0 client.16251 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599da091ad0 0x5599da096740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 --2- 172.21.15.7:0/2517744356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599da0911b0 0x5599da096200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 >> 172.21.15.7:0/2517744356 conn(0x5599da08d6c0 msgr2=0x5599da09ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 shutdown_connections 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 1 -- 172.21.15.7:0/2517744356 wait complete. 2024-04-23T14:58:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.640+0000 7f83cee6b740 20 client.16251 trim_cache size 0 max 16384 2024-04-23T14:58:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:58:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:58:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:58:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:58:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83ac0a3e40 msgr2=0x7f83ac0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83ac0a3e40 0x7f83ac0a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83c4100f10 tx=0x7f83bc0096a0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 msgr2=0x7f83c41a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 0x7f83c41a0620 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f83b800d950 tx=0x7f83b800de10 comp rx=0 tx=0).stop 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 shutdown_connections 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f83ac0a3e40 0x7f83ac0a6300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83c410e8f0 0x7f83c419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83c4074c20 0x7f83c41a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 --2- 172.21.15.7:0/793667046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c4074300 0x7f83c41a0620 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 >> 172.21.15.7:0/793667046 conn(0x7f83c4079490 msgr2=0x7f83c40fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 shutdown_connections 2024-04-23T14:58:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:58:54.641+0000 7f83cc000640 1 -- 172.21.15.7:0/793667046 wait complete. 2024-04-23T14:58:55.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:55 smithi137 ceph-mon[31694]: pgmap v232: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:58:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:55 smithi007 ceph-mon[27906]: pgmap v232: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:58:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:55 smithi186 ceph-mon[31814]: pgmap v232: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T14:58:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:57 smithi137 ceph-mon[31694]: pgmap v233: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-23T14:58:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:57 smithi007 ceph-mon[27906]: pgmap v233: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-23T14:58:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:57 smithi186 ceph-mon[31814]: pgmap v233: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-23T14:58:59.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:58:59 smithi137 ceph-mon[31694]: pgmap v234: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:59:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:58:59 smithi007 ceph-mon[27906]: pgmap v234: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:59:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:58:59 smithi186 ceph-mon[31814]: pgmap v234: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:59:01.916 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:01 smithi186 ceph-mon[31814]: pgmap v235: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:59:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:01 smithi137 ceph-mon[31694]: pgmap v235: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:59:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:01 smithi007 ceph-mon[27906]: pgmap v235: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T14:59:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:03 smithi137 ceph-mon[31694]: pgmap v236: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.2 MiB/s wr, 35 op/s 2024-04-23T14:59:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:03 smithi007 ceph-mon[27906]: pgmap v236: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.2 MiB/s wr, 35 op/s 2024-04-23T14:59:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:03 smithi186 ceph-mon[31814]: pgmap v236: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.2 MiB/s wr, 35 op/s 2024-04-23T14:59:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:05 smithi137 ceph-mon[31694]: pgmap v237: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T14:59:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:05 smithi007 ceph-mon[27906]: pgmap v237: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T14:59:06.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:05 smithi186 ceph-mon[31814]: pgmap v237: 129 pgs: 129 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 -- 172.21.15.7:0/3262001650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce4074cf0 msgr2=0x7f8ce410e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 --2- 172.21.15.7:0/3262001650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce4074cf0 0x7f8ce410e180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009900 tx=0x7f8cd002a480 comp rx=0 tx=0).stop 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 -- 172.21.15.7:0/3262001650 shutdown_connections 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 --2- 172.21.15.7:0/3262001650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce410e6c0 0x7f8ce4110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 --2- 172.21.15.7:0/3262001650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce4074cf0 0x7f8ce410e180 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 --2- 172.21.15.7:0/3262001650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce40743d0 0x7f8ce40747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.821+0000 7f8cea000640 1 -- 172.21.15.7:0/3262001650 >> 172.21.15.7:0/3262001650 conn(0x7f8ce40fd950 msgr2=0x7f8ce40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.822+0000 7f8cea000640 1 -- 172.21.15.7:0/3262001650 shutdown_connections 2024-04-23T14:59:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.822+0000 7f8cea000640 1 -- 172.21.15.7:0/3262001650 wait complete. 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 Processor -- start 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 -- start start 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 0x7f8ce41a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce4074cf0 0x7f8ce41a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce410e6c0 0x7f8ce419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41142f0 con 0x7f8ce40743d0 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4114170 con 0x7f8ce410e6c0 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.823+0000 7f8cea000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4114470 con 0x7f8ce4074cf0 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 0x7f8ce41a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 0x7f8ce41a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58954/0 (socket says 172.21.15.7:58954) 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 -- 172.21.15.7:0/414307122 learned_addr learned my addr 172.21.15.7:0/414307122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce4074cf0 0x7f8ce41a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce9600640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce410e6c0 0x7f8ce419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 -- 172.21.15.7:0/414307122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce4074cf0 msgr2=0x7f8ce41a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce4074cf0 0x7f8ce41a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 -- 172.21.15.7:0/414307122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce410e6c0 msgr2=0x7f8ce419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce410e6c0 0x7f8ce419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce8c00640 1 -- 172.21.15.7:0/414307122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce419af90 con 0x7f8ce40743d0 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.824+0000 7f8ce9600640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce410e6c0 0x7f8ce419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.825+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 0x7f8ce41a0610 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800d950 tx=0x7f8cd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.825+0000 7f8ce1600640 1 -- 172.21.15.7:0/414307122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8017070 con 0x7f8ce40743d0 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.825+0000 7f8ce1600640 1 -- 172.21.15.7:0/414307122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cd8009c30 con 0x7f8ce40743d0 2024-04-23T14:59:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.825+0000 7f8ce1600640 1 -- 172.21.15.7:0/414307122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800f620 con 0x7f8ce40743d0 2024-04-23T14:59:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.825+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce419b280 con 0x7f8ce40743d0 2024-04-23T14:59:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.825+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce41a7590 con 0x7f8ce40743d0 2024-04-23T14:59:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 Processor -- start 2024-04-23T14:59:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 -- start start 2024-04-23T14:59:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce298c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce298e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ce28e7900 con 0x556ce298c5a0 2024-04-23T14:59:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556ce288df20 con 0x556ce2981ce0 2024-04-23T14:59:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.829+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556ce28e38c0 con 0x556ce29813c0 2024-04-23T14:59:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce1600640 1 -- 172.21.15.7:0/414307122 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8cd80109a0 con 0x7f8ce40743d0 2024-04-23T14:59:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce298e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce298e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58962/0 (socket says 172.21.15.7:58962) 2024-04-23T14:59:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 -- 172.21.15.7:0/2563199112 learned_addr learned my addr 172.21.15.7:0/2563199112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 -- 172.21.15.7:0/2563199112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 msgr2=0x556ce29817a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce298c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 -- 172.21.15.7:0/2563199112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 msgr2=0x556ce298c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce298c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.830+0000 7f8ce3e00640 1 -- 172.21.15.7:0/2563199112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ce28b2e10 con 0x556ce298c5a0 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.831+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce298c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.831+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce298e990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0006010 tx=0x7f8cd0032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1af62437c1eb9c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.831+0000 7f8cd5c00640 1 -- 172.21.15.7:0/2563199112 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd003f070 con 0x556ce298c5a0 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.831+0000 7f8cd5c00640 1 -- 172.21.15.7:0/2563199112 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cd00316a0 con 0x556ce298c5a0 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.831+0000 7f8cd5c00640 1 -- 172.21.15.7:0/2563199112 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0035070 con 0x556ce298c5a0 2024-04-23T14:59:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8ce1600640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3d90 0x7f8ccc0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8ce1600640 1 -- 172.21.15.7:0/414307122 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9555+0+0 (secure 0 0 0) 0x7f8cd80d08d0 con 0x7f8ce40743d0 2024-04-23T14:59:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8ce9600640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3d90 0x7f8ccc0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2563199112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 msgr2=0x556ce298e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce298e990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0006010 tx=0x7f8cd0032c30 comp rx=0 tx=0).stop 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2563199112 shutdown_connections 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce298c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce298e990 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2563199112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29817a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.832+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2563199112 >> 172.21.15.7:0/2563199112 conn(0x556ce297d8d0 msgr2=0x556ce297dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.833+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2563199112 shutdown_connections 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.833+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2563199112 wait complete. 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.833+0000 7f8ce9600640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3d90 0x7f8ccc0a6250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0092f0 tx=0x7f8cdc0093c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.833+0000 7f8cee5b1740 1 -- start start 2024-04-23T14:59:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 Processor -- start 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 0x556ce2989560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce2981ce0 0x556ce2989aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce298c5a0 0x556ce2989fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ce298f110 con 0x556ce29813c0 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556ce28a12c0 con 0x556ce298c5a0 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556ce298f290 con 0x556ce2981ce0 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8cee5b1740 10 client.0 _ll_register_callbacks cb 0x556ce25f9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8ce8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 0x556ce2989560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8ce8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 0x556ce2989560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58970/0 (socket says 172.21.15.7:58970) 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.834+0000 7f8ce8c00640 1 -- 172.21.15.7:0/1205005733 learned_addr learned my addr 172.21.15.7:0/1205005733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce9600640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce298c5a0 0x556ce2989fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce2981ce0 0x556ce2989aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce8c00640 1 -- 172.21.15.7:0/1205005733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce2981ce0 msgr2=0x556ce2989aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce2981ce0 0x556ce2989aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce8c00640 1 -- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce298c5a0 msgr2=0x556ce2989fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce298c5a0 0x556ce2989fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce8c00640 1 -- 172.21.15.7:0/1205005733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ce28b1fd0 con 0x556ce29813c0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 0x556ce2989560 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8000c00 tx=0x7f8cd8009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d71769c1280cbc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8cca000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.835+0000 7f8cca000640 1 -- 172.21.15.7:0/1205005733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8020070 con 0x556ce29813c0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.836+0000 7f8cca000640 1 -- 172.21.15.7:0/1205005733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9555+0+0 (secure 0 0 0) 0x7f8cd80cde30 con 0x556ce29813c0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.836+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd00316a0 con 0x556ce29813c0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.836+0000 7f8cca000640 1 -- 172.21.15.7:0/1205005733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8cd80ce030 con 0x556ce29813c0 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.836+0000 7f8cee5b1740 10 client.16263 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.836+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556ce25fa210 con 0x556ce29813c0 2024-04-23T14:59:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.836+0000 7f8cca000640 1 -- 172.21.15.7:0/1205005733 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cd00316a0 con 0x556ce29813c0 2024-04-23T14:59:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cca000640 1 -- 172.21.15.7:0/1205005733 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8cd80b5b80 con 0x556ce29813c0 2024-04-23T14:59:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cee5b1740 10 client.16263 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cee5b1740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cee5b1740 20 client.16263 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce29a4ec0 0x556ce29a7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cee5b1740 4 client.16263 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:59:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.837+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ce28f5320 con 0x556ce29a4ec0 2024-04-23T14:59:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.838+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce29a4ec0 0x556ce29a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.839+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce29a4ec0 0x556ce29a7310 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd4171d5d263a08 server_cookie=cd5d5f31a4b73bf3 in_seq=0 out_seq=0 2024-04-23T14:59:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.839+0000 7f8cca000640 10 client.16263 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.840+0000 7f8cca000640 1 -- 172.21.15.7:0/1205005733 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556ce28f5320 con 0x556ce29a4ec0 2024-04-23T14:59:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.840+0000 7f8cca000640 10 client.16263 handle_command_reply: tid=0 2024-04-23T14:59:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.840+0000 7f8cee5b1740 1 client.16263 shutdown 2024-04-23T14:59:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 msgr2=0x556ce2989560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 0x556ce2989560 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8000c00 tx=0x7f8cd8009de0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 shutdown_connections 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce29a4ec0 0x556ce29a7310 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce298c5a0 0x556ce2989fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce2981ce0 0x556ce2989aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1205005733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce29813c0 0x556ce2989560 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 >> 172.21.15.7:0/1205005733 conn(0x556ce297d8d0 msgr2=0x556ce2983600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cca000640 0 client.16263 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 shutdown_connections 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.841+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1205005733 wait complete. 2024-04-23T14:59:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.842+0000 7f8cee5b1740 20 client.16263 trim_cache size 0 max 16384 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 Processor -- start 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 -- start start 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29a0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce2983d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce297c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41ad290 con 0x556ce298c5a0 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41aedd0 con 0x556ce2981ce0 2024-04-23T14:59:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.862+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41ad960 con 0x556ce29813c0 2024-04-23T14:59:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce297c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce297c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58974/0 (socket says 172.21.15.7:58974) 2024-04-23T14:59:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 -- 172.21.15.7:0/2099153836 learned_addr learned my addr 172.21.15.7:0/2099153836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce2983d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 -- 172.21.15.7:0/2099153836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 msgr2=0x556ce29a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 -- 172.21.15.7:0/2099153836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 msgr2=0x556ce2983d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce2983d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.863+0000 7f8ce9600640 1 -- 172.21.15.7:0/2099153836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ce26c6620 con 0x556ce298c5a0 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.864+0000 7f8ce9600640 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce297c910 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc011540 tx=0x7f8cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da035c40bd543f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.864+0000 7f8cd5200640 1 -- 172.21.15.7:0/2099153836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc009570 con 0x556ce298c5a0 2024-04-23T14:59:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.864+0000 7f8cd5200640 1 -- 172.21.15.7:0/2099153836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cdc01fba0 con 0x556ce298c5a0 2024-04-23T14:59:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.864+0000 7f8cd5200640 1 -- 172.21.15.7:0/2099153836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc027cd0 con 0x556ce298c5a0 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2099153836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 msgr2=0x556ce297c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce297c910 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc011540 tx=0x7f8cdc004a40 comp rx=0 tx=0).stop 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2099153836 shutdown_connections 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce2981ce0 0x556ce2983d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce298c5a0 0x556ce297c910 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/2099153836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce29813c0 0x556ce29a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2099153836 >> 172.21.15.7:0/2099153836 conn(0x556ce297d8d0 msgr2=0x556ce297c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2099153836 shutdown_connections 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.865+0000 7f8cee5b1740 1 -- 172.21.15.7:0/2099153836 wait complete. 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 -- start start 2024-04-23T14:59:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 Processor -- start 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce29813c0 0x556ce2986090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 0x556ce29865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce298c5a0 0x556ce2986b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41ae700 con 0x556ce2981ce0 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41ae030 con 0x556ce29813c0 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.866+0000 7f8cee5b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce41ab290 con 0x556ce298c5a0 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8cee5b1740 10 client.0 _ll_register_callbacks cb 0x7f8cd800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 0x556ce29865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 0x556ce29865d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58980/0 (socket says 172.21.15.7:58980) 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 -- 172.21.15.7:0/1940232483 learned_addr learned my addr 172.21.15.7:0/1940232483 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce29813c0 0x556ce2986090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce9600640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce298c5a0 0x556ce2986b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 -- 172.21.15.7:0/1940232483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce298c5a0 msgr2=0x556ce2986b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce298c5a0 0x556ce2986b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 -- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce29813c0 msgr2=0x556ce2986090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce29813c0 0x556ce2986090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce3e00640 1 -- 172.21.15.7:0/1940232483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ce2a0a490 con 0x556ce2981ce0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce9600640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce298c5a0 0x556ce2986b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.867+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce29813c0 0x556ce2986090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8ce3e00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 0x556ce29865d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000c00 tx=0x7f8cd0009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628eac63ff76ae3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cca000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cca000640 1 -- 172.21.15.7:0/1940232483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0035030 con 0x556ce2981ce0 2024-04-23T14:59:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cca000640 1 -- 172.21.15.7:0/1940232483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9555+0+0 (secure 0 0 0) 0x7f8cd0004030 con 0x556ce2981ce0 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cdc01fba0 con 0x556ce2981ce0 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cca000640 1 -- 172.21.15.7:0/1940232483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8cd005a050 con 0x556ce2981ce0 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cee5b1740 10 client.16269 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.868+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556ce2a0b6c0 con 0x556ce2981ce0 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cca000640 1 -- 172.21.15.7:0/1940232483 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cdc01fba0 con 0x556ce2981ce0 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cca000640 1 -- 172.21.15.7:0/1940232483 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8cd004c330 con 0x556ce2981ce0 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cee5b1740 10 client.16269 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cee5b1740 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cee5b1740 20 client.16269 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce2a0bac0 0x556ce2a0deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cee5b1740 4 client.16269 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:59:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.869+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ce28ef190 con 0x556ce2a0bac0 2024-04-23T14:59:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.870+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce2a0bac0 0x556ce2a0deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.871+0000 7f8ce8c00640 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce2a0bac0 0x556ce2a0deb0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e22d5d989947e9 server_cookie=6b408b690800bd9c in_seq=0 out_seq=0 2024-04-23T14:59:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.871+0000 7f8cca000640 10 client.16269 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.896+0000 7f8cca000640 1 -- 172.21.15.7:0/1940232483 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ce28ef190 con 0x556ce2a0bac0 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.896+0000 7f8cca000640 10 client.16269 handle_command_reply: tid=0 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.896+0000 7f8cee5b1740 1 client.16269 shutdown 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 msgr2=0x556ce29865d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 0x556ce29865d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000c00 tx=0x7f8cd0009290 comp rx=0 tx=0).stop 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 shutdown_connections 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556ce2a0bac0 0x556ce2a0deb0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556ce298c5a0 0x556ce2986b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ce2981ce0 0x556ce29865d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 --2- 172.21.15.7:0/1940232483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ce29813c0 0x556ce2986090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cca000640 0 client.16269 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 >> 172.21.15.7:0/1940232483 conn(0x556ce297d8d0 msgr2=0x556ce2989db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 shutdown_connections 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 1 -- 172.21.15.7:0/1940232483 wait complete. 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.897+0000 7f8cee5b1740 20 client.16269 trim_cache size 0 max 16384 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:59:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3d90 msgr2=0x7f8ccc0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3d90 0x7f8ccc0a6250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0092f0 tx=0x7f8cdc0093c0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 msgr2=0x7f8ce41a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 0x7f8ce41a0610 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800d950 tx=0x7f8cd800de10 comp rx=0 tx=0).stop 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 shutdown_connections 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3d90 0x7f8ccc0a6250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce410e6c0 0x7f8ce419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce4074cf0 0x7f8ce41a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 --2- 172.21.15.7:0/414307122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce40743d0 0x7f8ce41a0610 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 >> 172.21.15.7:0/414307122 conn(0x7f8ce40fd950 msgr2=0x7f8ce40fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 shutdown_connections 2024-04-23T14:59:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:07.898+0000 7f8cea000640 1 -- 172.21.15.7:0/414307122 wait complete. 2024-04-23T14:59:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:07 smithi007 ceph-mon[27906]: pgmap v238: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T14:59:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:07 smithi186 ceph-mon[31814]: pgmap v238: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T14:59:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:07 smithi137 ceph-mon[31694]: pgmap v238: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T14:59:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:08 smithi007 ceph-mon[27906]: osdmap e97: 12 total, 12 up, 12 in 2024-04-23T14:59:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:08 smithi186 ceph-mon[31814]: osdmap e97: 12 total, 12 up, 12 in 2024-04-23T14:59:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:08 smithi137 ceph-mon[31694]: osdmap e97: 12 total, 12 up, 12 in 2024-04-23T14:59:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:09 smithi007 ceph-mon[27906]: pgmap v240: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T14:59:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:09 smithi186 ceph-mon[31814]: pgmap v240: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T14:59:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:09 smithi137 ceph-mon[31694]: pgmap v240: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T14:59:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:11 smithi007 ceph-mon[27906]: pgmap v241: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T14:59:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:11 smithi186 ceph-mon[31814]: pgmap v241: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T14:59:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:11 smithi137 ceph-mon[31694]: pgmap v241: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T14:59:13.970 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:13 smithi137 ceph-mon[31694]: pgmap v242: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T14:59:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:13 smithi007 ceph-mon[27906]: pgmap v242: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T14:59:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:13 smithi186 ceph-mon[31814]: pgmap v242: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T14:59:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:14 smithi007 ceph-mon[27906]: pgmap v243: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T14:59:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:14 smithi186 ceph-mon[31814]: pgmap v243: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T14:59:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:14 smithi137 ceph-mon[31694]: pgmap v243: 129 pgs: 129 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T14:59:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:16 smithi007 ceph-mon[27906]: osdmap e98: 12 total, 12 up, 12 in 2024-04-23T14:59:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:16 smithi186 ceph-mon[31814]: osdmap e98: 12 total, 12 up, 12 in 2024-04-23T14:59:16.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:16 smithi137 ceph-mon[31694]: osdmap e98: 12 total, 12 up, 12 in 2024-04-23T14:59:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:17 smithi007 ceph-mon[27906]: pgmap v245: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 18 op/s 2024-04-23T14:59:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:17 smithi186 ceph-mon[31814]: pgmap v245: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 18 op/s 2024-04-23T14:59:17.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:17 smithi137 ceph-mon[31694]: pgmap v245: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 18 op/s 2024-04-23T14:59:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:19 smithi007 ceph-mon[27906]: pgmap v246: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:59:19.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:19 smithi186 ceph-mon[31814]: pgmap v246: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:59:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:19 smithi137 ceph-mon[31694]: pgmap v246: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 -- 172.21.15.7:0/645071400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 msgr2=0x7f82480747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 --2- 172.21.15.7:0/645071400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82480747b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f823c009900 tx=0x7f823c02a480 comp rx=0 tx=0).stop 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 -- 172.21.15.7:0/645071400 shutdown_connections 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 --2- 172.21.15.7:0/645071400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f824810e6b0 0x7f8248110ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 --2- 172.21.15.7:0/645071400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8248074cf0 0x7f824810e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 --2- 172.21.15.7:0/645071400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82480747b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 -- 172.21.15.7:0/645071400 >> 172.21.15.7:0/645071400 conn(0x7f82480fd940 msgr2=0x7f82480ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.051+0000 7f824e200640 1 -- 172.21.15.7:0/645071400 shutdown_connections 2024-04-23T14:59:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.052+0000 7f824e200640 1 -- 172.21.15.7:0/645071400 wait complete. 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 Processor -- start 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 -- start start 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82481a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8248074cf0 0x7f82481a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f824810e6b0 0x7f824819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82481142d0 con 0x7f82480743d0 2024-04-23T14:59:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8248114150 con 0x7f8248074cf0 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.053+0000 7f824e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8248114450 con 0x7f824810e6b0 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82481a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82481a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51776/0 (socket says 172.21.15.7:51776) 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 -- 172.21.15.7:0/1555084433 learned_addr learned my addr 172.21.15.7:0/1555084433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f8247e00640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8248074cf0 0x7f82481a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 -- 172.21.15.7:0/1555084433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f824810e6b0 msgr2=0x7f824819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824d800640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f824810e6b0 0x7f824819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f824810e6b0 0x7f824819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 -- 172.21.15.7:0/1555084433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8248074cf0 msgr2=0x7f82481a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8248074cf0 0x7f82481a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824ce00640 1 -- 172.21.15.7:0/1555084433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824819add0 con 0x7f82480743d0 2024-04-23T14:59:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f8247e00640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8248074cf0 0x7f82481a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.054+0000 7f824d800640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f824810e6b0 0x7f824819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.055+0000 7f824ce00640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82481a0450 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f823c005940 tx=0x7f823c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.055+0000 7f8245600640 1 -- 172.21.15.7:0/1555084433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c03f030 con 0x7f82480743d0 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.055+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824819b060 con 0x7f82480743d0 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.055+0000 7f8245600640 1 -- 172.21.15.7:0/1555084433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f823c003aa0 con 0x7f82480743d0 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.055+0000 7f8245600640 1 -- 172.21.15.7:0/1555084433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c035070 con 0x7f82480743d0 2024-04-23T14:59:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.055+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82481a7310 con 0x7f82480743d0 2024-04-23T14:59:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.059+0000 7f8245600640 1 -- 172.21.15.7:0/1555084433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f823c042030 con 0x7f82480743d0 2024-04-23T14:59:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.059+0000 7f8252681740 1 Processor -- start 2024-04-23T14:59:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.059+0000 7f8252681740 1 -- start start 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8252681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b47797a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8252681740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4779ce0 0x55e5b4784060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8252681740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b4786990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8252681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5b46df900 con 0x55e5b47793c0 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8252681740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e5b4685f20 con 0x55e5b47845a0 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8252681740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e5b46db8c0 con 0x55e5b4779ce0 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f824d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b47797a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f824d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b47797a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51778/0 (socket says 172.21.15.7:51778) 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f824d800640 1 -- 172.21.15.7:0/2803505335 learned_addr learned my addr 172.21.15.7:0/2803505335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f8247e00640 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b4786990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.060+0000 7f824ce00640 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4779ce0 0x55e5b4784060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 -- 172.21.15.7:0/2803505335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4779ce0 msgr2=0x55e5b4784060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4779ce0 0x55e5b4784060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 -- 172.21.15.7:0/2803505335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 msgr2=0x55e5b4786990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b4786990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 -- 172.21.15.7:0/2803505335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5b46aae10 con 0x55e5b47793c0 2024-04-23T14:59:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f8245600640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f82300a3d90 0x7f82300a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f8245600640 1 -- 172.21.15.7:0/1555084433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f823c0f13d0 con 0x7f82480743d0 2024-04-23T14:59:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f82300a3d90 0x7f82300a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.061+0000 7f824d800640 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b47797a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8240008d70 tx=0x7f824000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e62959c7b101e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.062+0000 7f823a000640 1 -- 172.21.15.7:0/2803505335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824001f070 con 0x55e5b47793c0 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.062+0000 7f823a000640 1 -- 172.21.15.7:0/2803505335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8240019db0 con 0x55e5b47793c0 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.062+0000 7f823a000640 1 -- 172.21.15.7:0/2803505335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824000ecb0 con 0x55e5b47793c0 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 -- 172.21.15.7:0/2803505335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 msgr2=0x55e5b47797a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f824d800640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f82300a3d90 0x7f82300a6250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f824001c000 tx=0x7f824001f000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b47797a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8240008d70 tx=0x7f824000d710 comp rx=0 tx=0).stop 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 -- 172.21.15.7:0/2803505335 shutdown_connections 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b4786990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4779ce0 0x55e5b4784060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 --2- 172.21.15.7:0/2803505335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b47797a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 -- 172.21.15.7:0/2803505335 >> 172.21.15.7:0/2803505335 conn(0x55e5b47758d0 msgr2=0x55e5b4775cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 -- 172.21.15.7:0/2803505335 shutdown_connections 2024-04-23T14:59:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.063+0000 7f8252681740 1 -- 172.21.15.7:0/2803505335 wait complete. 2024-04-23T14:59:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.064+0000 7f8252681740 1 -- start start 2024-04-23T14:59:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.064+0000 7f8252681740 1 Processor -- start 2024-04-23T14:59:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.064+0000 7f8252681740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4781550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.064+0000 7f8252681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4781a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.064+0000 7f8252681740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b4781fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8252681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5b4787140 con 0x55e5b4779ce0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8252681740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e5b46992c0 con 0x55e5b47793c0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8252681740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e5b47872c0 con 0x55e5b47845a0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8252681740 10 client.0 _ll_register_callbacks cb 0x55e5b43f1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4781a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4781a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51792/0 (socket says 172.21.15.7:51792) 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 -- 172.21.15.7:0/847263109 learned_addr learned my addr 172.21.15.7:0/847263109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f824ce00640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4781550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f824d800640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b4781fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 -- 172.21.15.7:0/847263109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 msgr2=0x55e5b4781fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b4781fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 -- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 msgr2=0x55e5b4781550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4781550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.065+0000 7f8247e00640 1 -- 172.21.15.7:0/847263109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5b46a9fd0 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.066+0000 7f8247e00640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4781a90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8248110bc0 tx=0x7f8234010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a5a953a58cbf78 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.066+0000 7f822ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.066+0000 7f822ea00640 1 -- 172.21.15.7:0/847263109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234004220 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.066+0000 7f822ea00640 1 -- 172.21.15.7:0/847263109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f82340043c0 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.066+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8240019db0 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f822ea00640 1 -- 172.21.15.7:0/847263109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8234023050 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 10 client.16281 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e5b43f2210 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f822ea00640 1 -- 172.21.15.7:0/847263109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8240019db0 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f822ea00640 1 -- 172.21.15.7:0/847263109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f823400f040 con 0x55e5b4779ce0 2024-04-23T14:59:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 10 client.16281 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 20 client.16281 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47947d0 0x55e5b4796c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 4 client.16281 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:59:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.067+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5b46ed320 con 0x55e5b47947d0 2024-04-23T14:59:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.068+0000 7f824ce00640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47947d0 0x55e5b4796c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.069+0000 7f824ce00640 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47947d0 0x55e5b4796c40 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28950fe40271ded server_cookie=d24537c6338fd968 in_seq=0 out_seq=0 2024-04-23T14:59:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.069+0000 7f822ea00640 10 client.16281 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.071+0000 7f822ea00640 1 -- 172.21.15.7:0/847263109 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e5b46ed320 con 0x55e5b47947d0 2024-04-23T14:59:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.071+0000 7f822ea00640 10 client.16281 handle_command_reply: tid=0 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.071+0000 7f8252681740 1 client.16281 shutdown 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.071+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 msgr2=0x55e5b4781a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.071+0000 7f8252681740 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4781a90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8248110bc0 tx=0x7f8234010b00 comp rx=0 tx=0).stop 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 shutdown_connections 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47947d0 0x55e5b4796c40 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b4781fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4781a90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 --2- 172.21.15.7:0/847263109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4781550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f822ea00640 0 client.16281 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 >> 172.21.15.7:0/847263109 conn(0x55e5b47758d0 msgr2=0x55e5b4774a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 shutdown_connections 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 1 -- 172.21.15.7:0/847263109 wait complete. 2024-04-23T14:59:21.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.072+0000 7f8252681740 20 client.16281 trim_cache size 0 max 16384 2024-04-23T14:59:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 Processor -- start 2024-04-23T14:59:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 -- start start 2024-04-23T14:59:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4790110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4774910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b479c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82481b1360 con 0x55e5b4779ce0 2024-04-23T14:59:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82481b2ea0 con 0x55e5b47793c0 2024-04-23T14:59:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.092+0000 7f8252681740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f82481b1a30 con 0x55e5b47845a0 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4774910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4774910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51798/0 (socket says 172.21.15.7:51798) 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 -- 172.21.15.7:0/3659967627 learned_addr learned my addr 172.21.15.7:0/3659967627 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f824d800640 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b479c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f824ce00640 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4790110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 -- 172.21.15.7:0/3659967627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 msgr2=0x55e5b479c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b479c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 -- 172.21.15.7:0/3659967627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 msgr2=0x55e5b4790110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4790110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f8247e00640 1 -- 172.21.15.7:0/3659967627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5b44be620 con 0x55e5b4779ce0 2024-04-23T14:59:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.093+0000 7f824ce00640 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4790110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:59:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.094+0000 7f8247e00640 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4774910 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8234003cb0 tx=0x7f8234009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2d12b6159ce5f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.094+0000 7f8239600640 1 -- 172.21.15.7:0/3659967627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340038b0 con 0x55e5b4779ce0 2024-04-23T14:59:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.094+0000 7f8239600640 1 -- 172.21.15.7:0/3659967627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f823402c070 con 0x55e5b4779ce0 2024-04-23T14:59:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.094+0000 7f8239600640 1 -- 172.21.15.7:0/3659967627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340054c0 con 0x55e5b4779ce0 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 -- 172.21.15.7:0/3659967627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 msgr2=0x55e5b4774910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4774910 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8234003cb0 tx=0x7f8234009f10 comp rx=0 tx=0).stop 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 -- 172.21.15.7:0/3659967627 shutdown_connections 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b47845a0 0x55e5b479c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b4779ce0 0x55e5b4774910 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 --2- 172.21.15.7:0/3659967627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47793c0 0x55e5b4790110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 -- 172.21.15.7:0/3659967627 >> 172.21.15.7:0/3659967627 conn(0x55e5b47758d0 msgr2=0x55e5b4774200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 -- 172.21.15.7:0/3659967627 shutdown_connections 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.095+0000 7f8252681740 1 -- 172.21.15.7:0/3659967627 wait complete. 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 -- start start 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 Processor -- start 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b478c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b47895f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4789b30 0x55e5b4789fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82481b27d0 con 0x55e5b47793c0 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82481b2100 con 0x55e5b47845a0 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f82481af360 con 0x55e5b4789b30 2024-04-23T14:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.096+0000 7f8252681740 10 client.0 _ll_register_callbacks cb 0x7f8234009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b478c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b478c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51814/0 (socket says 172.21.15.7:51814) 2024-04-23T14:59:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 -- 172.21.15.7:0/1575155499 learned_addr learned my addr 172.21.15.7:0/1575155499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824d800640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4789b30 0x55e5b4789fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 -- 172.21.15.7:0/1575155499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4789b30 msgr2=0x55e5b4789fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f8247e00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b47895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4789b30 0x55e5b4789fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 -- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 msgr2=0x55e5b47895f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b47895f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 -- 172.21.15.7:0/1575155499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5b478ced0 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f8247e00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b47895f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f824ce00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b478c810 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f823c0ee770 tx=0x7f823c0043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f37113773e5f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.097+0000 7f822ea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f822ea00640 1 -- 172.21.15.7:0/1575155499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c0eee60 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f822ea00640 1 -- 172.21.15.7:0/1575155499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f823c0bb260 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f823402c070 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f822ea00640 1 -- 172.21.15.7:0/1575155499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f823c049040 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f8252681740 10 client.16287 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e5b47fbec0 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.098+0000 7f822ea00640 1 -- 172.21.15.7:0/1575155499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f823402c070 con 0x55e5b47793c0 2024-04-23T14:59:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f822ea00640 1 -- 172.21.15.7:0/1575155499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f823c0ee990 con 0x55e5b47793c0 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8252681740 10 client.16287 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8252681740 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8252681740 20 client.16287 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8252681740 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47fc5e0 0x55e5b47fea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8252681740 4 client.16287 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e5b46e7190 con 0x55e5b47fc5e0 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.099+0000 7f8247e00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47fc5e0 0x55e5b47fea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.100+0000 7f822ea00640 10 client.16287 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.100+0000 7f8247e00640 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47fc5e0 0x55e5b47fea00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d7600d9c68de804 server_cookie=5f2753d0a143959e in_seq=0 out_seq=0 2024-04-23T14:59:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.128+0000 7f822ea00640 1 -- 172.21.15.7:0/1575155499 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e5b46e7190 con 0x55e5b47fc5e0 2024-04-23T14:59:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.128+0000 7f822ea00640 10 client.16287 handle_command_reply: tid=0 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.128+0000 7f8252681740 1 client.16287 shutdown 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.128+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 msgr2=0x55e5b478c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.128+0000 7f8252681740 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b478c810 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f823c0ee770 tx=0x7f823c0043e0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 shutdown_connections 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e5b47fc5e0 0x55e5b47fea00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5b47845a0 0x55e5b47895f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5b4789b30 0x55e5b4789fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 --2- 172.21.15.7:0/1575155499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5b47793c0 0x55e5b478c810 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 >> 172.21.15.7:0/1575155499 conn(0x55e5b47758d0 msgr2=0x55e5b4774a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f822ea00640 0 client.16287 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 shutdown_connections 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 1 -- 172.21.15.7:0/1575155499 wait complete. 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.129+0000 7f8252681740 20 client.16287 trim_cache size 0 max 16384 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:59:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.130+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f82300a3d90 msgr2=0x7f82300a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.130+0000 7f824e200640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f82300a3d90 0x7f82300a6250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f824001c000 tx=0x7f824001f000 comp rx=0 tx=0).stop 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.130+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 msgr2=0x7f82481a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.130+0000 7f824e200640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82481a0450 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f823c005940 tx=0x7f823c004270 comp rx=0 tx=0).stop 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 shutdown_connections 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f82300a3d90 0x7f82300a6250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8248074cf0 0x7f82481a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f824810e6b0 0x7f824819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 --2- 172.21.15.7:0/1555084433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82480743d0 0x7f82481a0450 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 >> 172.21.15.7:0/1555084433 conn(0x7f82480fd940 msgr2=0x7f82480fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 shutdown_connections 2024-04-23T14:59:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:21.131+0000 7f824e200640 1 -- 172.21.15.7:0/1555084433 wait complete. 2024-04-23T14:59:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:21 smithi007 ceph-mon[27906]: pgmap v247: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:59:21.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:21 smithi186 ceph-mon[31814]: pgmap v247: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:59:21.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:21 smithi137 ceph-mon[31694]: pgmap v247: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T14:59:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:23 smithi007 ceph-mon[27906]: pgmap v248: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:59:23.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:23 smithi186 ceph-mon[31814]: pgmap v248: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:59:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:23 smithi137 ceph-mon[31694]: pgmap v248: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:59:25.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:25 smithi007 ceph-mon[27906]: pgmap v249: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:59:25.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:25 smithi186 ceph-mon[31814]: pgmap v249: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:59:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:25 smithi137 ceph-mon[31694]: pgmap v249: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T14:59:27.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:27 smithi007 ceph-mon[27906]: pgmap v250: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T14:59:27.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:27 smithi186 ceph-mon[31814]: pgmap v250: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T14:59:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:27 smithi137 ceph-mon[31694]: pgmap v250: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T14:59:29.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:29 smithi007 ceph-mon[27906]: pgmap v251: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:29 smithi186 ceph-mon[31814]: pgmap v251: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:29 smithi137 ceph-mon[31694]: pgmap v251: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:31.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:31 smithi007 ceph-mon[27906]: pgmap v252: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:31 smithi186 ceph-mon[31814]: pgmap v252: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:31 smithi137 ceph-mon[31694]: pgmap v252: 129 pgs: 129 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:33.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:33 smithi007 ceph-mon[27906]: pgmap v253: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:59:33.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:33 smithi186 ceph-mon[31814]: pgmap v253: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:59:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:33 smithi137 ceph-mon[31694]: pgmap v253: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T14:59:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 -- 172.21.15.7:0/3199750792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 msgr2=0x7fdae8110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 --2- 172.21.15.7:0/3199750792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae8110ad0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009ca0 tx=0x7fdae002a950 comp rx=0 tx=0).stop 2024-04-23T14:59:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 -- 172.21.15.7:0/3199750792 shutdown_connections 2024-04-23T14:59:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 --2- 172.21.15.7:0/3199750792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae8110ad0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 --2- 172.21.15.7:0/3199750792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae8074cf0 0x7fdae810e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 --2- 172.21.15.7:0/3199750792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdae80743d0 0x7fdae80747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 -- 172.21.15.7:0/3199750792 >> 172.21.15.7:0/3199750792 conn(0x7fdae80fd950 msgr2=0x7fdae80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 -- 172.21.15.7:0/3199750792 shutdown_connections 2024-04-23T14:59:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.291+0000 7fdae7200640 1 -- 172.21.15.7:0/3199750792 wait complete. 2024-04-23T14:59:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.292+0000 7fdae7200640 1 Processor -- start 2024-04-23T14:59:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.292+0000 7fdae7200640 1 -- start start 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdae80743d0 0x7fdae81a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae8074cf0 0x7fdae81a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81142e0 con 0x7fdae810e6c0 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdae8114160 con 0x7fdae80743d0 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdae8114460 con 0x7fdae8074cf0 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56646/0 (socket says 172.21.15.7:56646) 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.293+0000 7fdae6800640 1 -- 172.21.15.7:0/3959391833 learned_addr learned my addr 172.21.15.7:0/3959391833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae5e00640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdae80743d0 0x7fdae81a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdadfe00640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae8074cf0 0x7fdae81a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae6800640 1 -- 172.21.15.7:0/3959391833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae8074cf0 msgr2=0x7fdae81a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae6800640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae8074cf0 0x7fdae81a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae6800640 1 -- 172.21.15.7:0/3959391833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdae80743d0 msgr2=0x7fdae81a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae6800640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdae80743d0 0x7fdae81a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae6800640 1 -- 172.21.15.7:0/3959391833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae819ada0 con 0x7fdae810e6c0 2024-04-23T14:59:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdae6800640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae819a620 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdae0005e30 tx=0x7fdae0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.294+0000 7fdadea00640 1 -- 172.21.15.7:0/3959391833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0034040 con 0x7fdae810e6c0 2024-04-23T14:59:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.295+0000 7fdadea00640 1 -- 172.21.15.7:0/3959391833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdae0030850 con 0x7fdae810e6c0 2024-04-23T14:59:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.295+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae819b030 con 0x7fdae810e6c0 2024-04-23T14:59:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.295+0000 7fdadea00640 1 -- 172.21.15.7:0/3959391833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae00046c0 con 0x7fdae810e6c0 2024-04-23T14:59:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.295+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae81a7330 con 0x7fdae810e6c0 2024-04-23T14:59:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.298+0000 7fdaefdf4740 1 Processor -- start 2024-04-23T14:59:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.299+0000 7fdadea00640 1 -- 172.21.15.7:0/3959391833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdae0037020 con 0x7fdae810e6c0 2024-04-23T14:59:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.299+0000 7fdaefdf4740 1 -- start start 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd72f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 0x5622fd73a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd73c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5622fd695900 con 0x5622fd72fce0 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622fd63bf20 con 0x5622fd72f3c0 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5622fd6918c0 con 0x5622fd73a5a0 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdae5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 0x5622fd73a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdae5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 0x5622fd73a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56652/0 (socket says 172.21.15.7:56652) 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdae5e00640 1 -- 172.21.15.7:0/2616127916 learned_addr learned my addr 172.21.15.7:0/2616127916 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.300+0000 7fdadfe00640 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd72f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdadfe00640 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd73c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdae5e00640 1 -- 172.21.15.7:0/2616127916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 msgr2=0x5622fd73c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd73c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdae5e00640 1 -- 172.21.15.7:0/2616127916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 msgr2=0x5622fd72f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd72f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdae5e00640 1 -- 172.21.15.7:0/2616127916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622fd660e10 con 0x5622fd72fce0 2024-04-23T14:59:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdadea00640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdacc0a3d10 0x7fdacc0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 0x5622fd73a060 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdad800dcb0 tx=0x7fdad800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deaf144bf6121d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdadea00640 1 -- 172.21.15.7:0/3959391833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fdae00f1b20 con 0x7fdae810e6c0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.301+0000 7fdadfe00640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdacc0a3d10 0x7fdacc0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.302+0000 7fdad7400640 1 -- 172.21.15.7:0/2616127916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8011440 con 0x5622fd72fce0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.302+0000 7fdad7400640 1 -- 172.21.15.7:0/2616127916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdad8011a90 con 0x5622fd72fce0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.302+0000 7fdad7400640 1 -- 172.21.15.7:0/2616127916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad801ba70 con 0x5622fd72fce0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2616127916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 msgr2=0x5622fd73a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 0x5622fd73a060 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdad800dcb0 tx=0x7fdad800f730 comp rx=0 tx=0).stop 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdadfe00640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdacc0a3d10 0x7fdacc0a61d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5622fd72ccf0 tx=0x7fdad0004730 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2616127916 shutdown_connections 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd73c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72fce0 0x5622fd73a060 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2616127916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd72f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2616127916 >> 172.21.15.7:0/2616127916 conn(0x5622fd72b8d0 msgr2=0x5622fd72bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2616127916 shutdown_connections 2024-04-23T14:59:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2616127916 wait complete. 2024-04-23T14:59:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.303+0000 7fdaefdf4740 1 -- start start 2024-04-23T14:59:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 Processor -- start 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd737520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd737a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 0x5622fd737fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5622fd73d140 con 0x5622fd73a5a0 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622fd64f2c0 con 0x5622fd72f3c0 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5622fd73d2c0 con 0x5622fd72fce0 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.304+0000 7fdaefdf4740 10 client.0 _ll_register_callbacks cb 0x5622fd3a7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 0x5622fd737fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 0x5622fd737fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56666/0 (socket says 172.21.15.7:56666) 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 -- 172.21.15.7:0/2923563150 learned_addr learned my addr 172.21.15.7:0/2923563150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd737520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdadfe00640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd737a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 -- 172.21.15.7:0/2923563150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 msgr2=0x5622fd737a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd737a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 -- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 msgr2=0x5622fd737520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd737520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 -- 172.21.15.7:0/2923563150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622fd65ffd0 con 0x5622fd73a5a0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdae6800640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 0x5622fd737fa0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdae00c5f00 tx=0x7fdae0004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabbb760691c1fb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.305+0000 7fdacbe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdacbe00640 1 -- 172.21.15.7:0/2923563150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae00bdec0 con 0x5622fd73a5a0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdacbe00640 1 -- 172.21.15.7:0/2923563150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fdae00443e0 con 0x5622fd73a5a0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad8011a90 con 0x5622fd73a5a0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdacbe00640 1 -- 172.21.15.7:0/2923563150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdae00445e0 con 0x5622fd73a5a0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdaefdf4740 10 client.16299 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5622fd3a8210 con 0x5622fd73a5a0 2024-04-23T14:59:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.306+0000 7fdacbe00640 1 -- 172.21.15.7:0/2923563150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdad8011a90 con 0x5622fd73a5a0 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdacbe00640 1 -- 172.21.15.7:0/2923563150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdae00d4020 con 0x5622fd73a5a0 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdaefdf4740 10 client.16299 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdaefdf4740 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdaefdf4740 20 client.16299 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd74a770 0x5622fd74cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdaefdf4740 4 client.16299 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622fd6a3320 con 0x5622fd74a770 2024-04-23T14:59:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.307+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd74a770 0x5622fd74cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.308+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd74a770 0x5622fd74cbd0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b11b93e74eaafa47 server_cookie=2862db70c2deacbe in_seq=0 out_seq=0 2024-04-23T14:59:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.308+0000 7fdacbe00640 10 client.16299 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.310+0000 7fdacbe00640 1 -- 172.21.15.7:0/2923563150 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5622fd6a3320 con 0x5622fd74a770 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.310+0000 7fdacbe00640 10 client.16299 handle_command_reply: tid=0 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.310+0000 7fdaefdf4740 1 client.16299 shutdown 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.310+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 msgr2=0x5622fd737fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.310+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 0x5622fd737fa0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdae00c5f00 tx=0x7fdae0004920 comp rx=0 tx=0).stop 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 shutdown_connections 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd74a770 0x5622fd74cbd0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd73a5a0 0x5622fd737fa0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd737a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2923563150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72f3c0 0x5622fd737520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 >> 172.21.15.7:0/2923563150 conn(0x5622fd72b8d0 msgr2=0x5622fd731650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdacbe00640 0 client.16299 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:34.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 shutdown_connections 2024-04-23T14:59:34.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2923563150 wait complete. 2024-04-23T14:59:34.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.311+0000 7fdaefdf4740 20 client.16299 trim_cache size 0 max 16384 2024-04-23T14:59:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.331+0000 7fdaefdf4740 1 Processor -- start 2024-04-23T14:59:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.331+0000 7fdaefdf4740 1 -- start start 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.331+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd739c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.331+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72fce0 0x5622fd7524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.331+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd7529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81b1410 con 0x5622fd72f3c0 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81b2f50 con 0x5622fd72fce0 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81b1ae0 con 0x5622fd73a5a0 2024-04-23T14:59:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd739c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd739c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56682/0 (socket says 172.21.15.7:56682) 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 -- 172.21.15.7:0/2962763638 learned_addr learned my addr 172.21.15.7:0/2962763638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdadfe00640 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72fce0 0x5622fd7524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae6800640 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd7529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 -- 172.21.15.7:0/2962763638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 msgr2=0x5622fd7529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd7529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 -- 172.21.15.7:0/2962763638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72fce0 msgr2=0x5622fd7524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72fce0 0x5622fd7524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdae5e00640 1 -- 172.21.15.7:0/2962763638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622fd72fb10 con 0x5622fd72f3c0 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.332+0000 7fdadfe00640 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72fce0 0x5622fd7524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.333+0000 7fdae5e00640 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd739c50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdad800dbd0 tx=0x7fdad800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ce9f54f145595a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.333+0000 7fdad6a00640 1 -- 172.21.15.7:0/2962763638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad802e070 con 0x5622fd72f3c0 2024-04-23T14:59:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.333+0000 7fdad6a00640 1 -- 172.21.15.7:0/2962763638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdad80054f0 con 0x5622fd72f3c0 2024-04-23T14:59:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.333+0000 7fdad6a00640 1 -- 172.21.15.7:0/2962763638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad80116a0 con 0x5622fd72f3c0 2024-04-23T14:59:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2962763638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 msgr2=0x5622fd739c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd739c50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdad800dbd0 tx=0x7fdad800d950 comp rx=0 tx=0).stop 2024-04-23T14:59:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2962763638 shutdown_connections 2024-04-23T14:59:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd72fce0 0x5622fd7524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd73a5a0 0x5622fd7529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/2962763638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd739c50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2962763638 >> 172.21.15.7:0/2962763638 conn(0x5622fd72b8d0 msgr2=0x5622fd72bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2962763638 shutdown_connections 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.334+0000 7fdaefdf4740 1 -- 172.21.15.7:0/2962763638 wait complete. 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.335+0000 7fdaefdf4740 1 -- start start 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.335+0000 7fdaefdf4740 1 Processor -- start 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.335+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd7428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd733d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdaefdf4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd73a5a0 0x5622fd7342d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81b2880 con 0x5622fd72f3c0 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81b21b0 con 0x5622fd73a5a0 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdaefdf4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdae81af410 con 0x5622fd72fce0 2024-04-23T14:59:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdaefdf4740 10 client.0 _ll_register_callbacks cb 0x7fdae0005f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd7428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd7428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56696/0 (socket says 172.21.15.7:56696) 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 -- 172.21.15.7:0/405946642 learned_addr learned my addr 172.21.15.7:0/405946642 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdadfe00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd733d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 -- 172.21.15.7:0/405946642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 msgr2=0x5622fd733d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae6800640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd73a5a0 0x5622fd7342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd733d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 -- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd73a5a0 msgr2=0x5622fd7342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd73a5a0 0x5622fd7342d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdae5e00640 1 -- 172.21.15.7:0/405946642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622fd474620 con 0x5622fd72f3c0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.336+0000 7fdadfe00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd733d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.337+0000 7fdae5e00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd7428b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdad800da40 tx=0x7fdad80056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de36da5c4db6d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.337+0000 7fdacbe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.337+0000 7fdacbe00640 1 -- 172.21.15.7:0/405946642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad802e040 con 0x5622fd72f3c0 2024-04-23T14:59:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.337+0000 7fdacbe00640 1 -- 172.21.15.7:0/405946642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7fdad8004040 con 0x5622fd72f3c0 2024-04-23T14:59:34.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.337+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad80054f0 con 0x5622fd72f3c0 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdacbe00640 1 -- 172.21.15.7:0/405946642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdad800d760 con 0x5622fd72f3c0 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 10 client.16305 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5622fd7b0950 con 0x5622fd72f3c0 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdacbe00640 1 -- 172.21.15.7:0/405946642 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdad80054f0 con 0x5622fd72f3c0 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdacbe00640 1 -- 172.21.15.7:0/405946642 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdad8031070 con 0x5622fd72f3c0 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 10 client.16305 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 20 client.16305 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd7b0e10 0x5622fd7b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 4 client.16305 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.338+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5622fd69d190 con 0x5622fd7b0e10 2024-04-23T14:59:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.339+0000 7fdadfe00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd7b0e10 0x5622fd7b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.340+0000 7fdadfe00640 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd7b0e10 0x5622fd7b3200 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d98cb31be26b90f server_cookie=5d3ffff8b47dcf3a in_seq=0 out_seq=0 2024-04-23T14:59:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.340+0000 7fdacbe00640 10 client.16305 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdacbe00640 1 -- 172.21.15.7:0/405946642 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622fd69d190 con 0x5622fd7b0e10 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdacbe00640 10 client.16305 handle_command_reply: tid=0 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 client.16305 shutdown 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 msgr2=0x5622fd7428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd7428b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdad800da40 tx=0x7fdad80056a0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 shutdown_connections 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5622fd7b0e10 0x5622fd7b3200 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622fd73a5a0 0x5622fd7342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5622fd72fce0 0x5622fd733d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdacbe00640 0 client.16305 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 --2- 172.21.15.7:0/405946642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5622fd72f3c0 0x5622fd7428b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.368+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 >> 172.21.15.7:0/405946642 conn(0x5622fd72b8d0 msgr2=0x5622fd732820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.369+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 shutdown_connections 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.369+0000 7fdaefdf4740 1 -- 172.21.15.7:0/405946642 wait complete. 2024-04-23T14:59:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.369+0000 7fdaefdf4740 20 client.16305 trim_cache size 0 max 16384 2024-04-23T14:59:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:59:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:59:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:59:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdacc0a3d10 msgr2=0x7fdacc0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdacc0a3d10 0x7fdacc0a61d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5622fd72ccf0 tx=0x7fdad0004730 comp rx=0 tx=0).stop 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 msgr2=0x7fdae819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae819a620 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdae0005e30 tx=0x7fdae0003f10 comp rx=0 tx=0).stop 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 shutdown_connections 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdacc0a3d10 0x7fdacc0a61d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdae810e6c0 0x7fdae819a620 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae8074cf0 0x7fdae81a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 --2- 172.21.15.7:0/3959391833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdae80743d0 0x7fdae81a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 >> 172.21.15.7:0/3959391833 conn(0x7fdae80fd950 msgr2=0x7fdae80fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 shutdown_connections 2024-04-23T14:59:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:34.370+0000 7fdae7200640 1 -- 172.21.15.7:0/3959391833 wait complete. 2024-04-23T14:59:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:35 smithi007 ceph-mon[27906]: pgmap v254: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:59:35.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:35 smithi186 ceph-mon[31814]: pgmap v254: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:59:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:35 smithi137 ceph-mon[31694]: pgmap v254: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T14:59:37.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:37 smithi007 ceph-mon[27906]: pgmap v255: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T14:59:37.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:37 smithi186 ceph-mon[31814]: pgmap v255: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T14:59:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:37 smithi137 ceph-mon[31694]: pgmap v255: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T14:59:39.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:39 smithi007 ceph-mon[27906]: pgmap v256: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T14:59:39.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:39 smithi186 ceph-mon[31814]: pgmap v256: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T14:59:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:39 smithi137 ceph-mon[31694]: pgmap v256: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T14:59:41.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:41 smithi186 ceph-mon[31814]: pgmap v257: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T14:59:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:41 smithi137 ceph-mon[31694]: pgmap v257: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T14:59:42.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:41 smithi007 ceph-mon[27906]: pgmap v257: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T14:59:43.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:43 smithi186 ceph-mon[31814]: pgmap v258: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:59:43.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:43 smithi137 ceph-mon[31694]: pgmap v258: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:59:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:44.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:43 smithi007 ceph-mon[27906]: pgmap v258: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T14:59:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:45 smithi007 ceph-mon[27906]: pgmap v259: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T14:59:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:45 smithi186 ceph-mon[31814]: pgmap v259: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T14:59:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:45 smithi137 ceph-mon[31694]: pgmap v259: 129 pgs: 129 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T14:59:46.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:46 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:46 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:46.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:46 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:46.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:46 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:46.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:46 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:46.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:46 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:46.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:46 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:46.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:46 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:46.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:46 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T14:59:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:47 smithi137 ceph-mon[31694]: pgmap v260: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T14:59:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 -- 172.21.15.7:0/314622939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c109530 msgr2=0x7f3a0c111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 --2- 172.21.15.7:0/314622939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c109530 0x7f3a0c111100 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009ca0 tx=0x7f3a0402a8b0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 -- 172.21.15.7:0/314622939 shutdown_connections 2024-04-23T14:59:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 --2- 172.21.15.7:0/314622939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c109530 0x7f3a0c111100 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 --2- 172.21.15.7:0/314622939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a0c104e10 0x7f3a0c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 --2- 172.21.15.7:0/314622939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a0c104460 0x7f3a0c104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 -- 172.21.15.7:0/314622939 >> 172.21.15.7:0/314622939 conn(0x7f3a0c0ffd00 msgr2=0x7f3a0c102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 -- 172.21.15.7:0/314622939 shutdown_connections 2024-04-23T14:59:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.516+0000 7f3a13c00640 1 -- 172.21.15.7:0/314622939 wait complete. 2024-04-23T14:59:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.517+0000 7f3a13c00640 1 Processor -- start 2024-04-23T14:59:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.517+0000 7f3a13c00640 1 -- start start 2024-04-23T14:59:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a13c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a0c104460 0x7f3a0c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a13c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a0c109530 0x7f3a0c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a13c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 0x7f3a0c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a13c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1144d0 con 0x7f3a0c19a630 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a13c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c114350 con 0x7f3a0c104460 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a13c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c114650 con 0x7f3a0c109530 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a11c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 0x7f3a0c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a11c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 0x7f3a0c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49172/0 (socket says 172.21.15.7:49172) 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a11c00640 1 -- 172.21.15.7:0/3038725175 learned_addr learned my addr 172.21.15.7:0/3038725175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a0be00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a0c109530 0x7f3a0c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.518+0000 7f3a11200640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a0c104460 0x7f3a0c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a11c00640 1 -- 172.21.15.7:0/3038725175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a0c109530 msgr2=0x7f3a0c1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a11c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a0c109530 0x7f3a0c1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a11c00640 1 -- 172.21.15.7:0/3038725175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a0c104460 msgr2=0x7f3a0c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a11c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a0c104460 0x7f3a0c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a11c00640 1 -- 172.21.15.7:0/3038725175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c19b230 con 0x7f3a0c19a630 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a11c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 0x7f3a0c19aab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3a04003bd0 tx=0x7f3a04003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a09600640 1 -- 172.21.15.7:0/3038725175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04004450 con 0x7f3a0c19a630 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a09600640 1 -- 172.21.15.7:0/3038725175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a04040070 con 0x7f3a0c19a630 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0c19b4c0 con 0x7f3a0c19a630 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a09600640 1 -- 172.21.15.7:0/3038725175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04045de0 con 0x7f3a0c19a630 2024-04-23T14:59:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.519+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0c1a7660 con 0x7f3a0c19a630 2024-04-23T14:59:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.523+0000 7f3a16b64740 1 Processor -- start 2024-04-23T14:59:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.523+0000 7f3a09600640 1 -- 172.21.15.7:0/3038725175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3a040045f0 con 0x7f3a0c19a630 2024-04-23T14:59:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 -- start start 2024-04-23T14:59:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f30590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8b6e96900 con 0x55e8b6f3b390 2024-04-23T14:59:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e8b6e3cf20 con 0x55e8b6f301b0 2024-04-23T14:59:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a16b64740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e8b6e928c0 con 0x55e8b6f30ad0 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.524+0000 7f3a0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49174/0 (socket says 172.21.15.7:49174) 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 -- 172.21.15.7:0/2411722843 learned_addr learned my addr 172.21.15.7:0/2411722843 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f30590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a11200640 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a09600640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39f40a3dc0 0x7f39f40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 -- 172.21.15.7:0/2411722843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 msgr2=0x55e8b6f3ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 -- 172.21.15.7:0/2411722843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 msgr2=0x55e8b6f30590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f30590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a0be00640 1 -- 172.21.15.7:0/2411722843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8b6e61e10 con 0x55e8b6f3b390 2024-04-23T14:59:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.525+0000 7f3a11c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39f40a3dc0 0x7f39f40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.526+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3d780 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f39f8013910 tx=0x7f39f800e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944e3dede8511477 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.526+0000 7f3a09600640 1 -- 172.21.15.7:0/3038725175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f3a040f1fa0 con 0x7f3a0c19a630 2024-04-23T14:59:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.526+0000 7f39fe000640 1 -- 172.21.15.7:0/2411722843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8004020 con 0x55e8b6f3b390 2024-04-23T14:59:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.526+0000 7f39fe000640 1 -- 172.21.15.7:0/2411722843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39f800bdc0 con 0x55e8b6f3b390 2024-04-23T14:59:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.526+0000 7f39fe000640 1 -- 172.21.15.7:0/2411722843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8003850 con 0x55e8b6f3b390 2024-04-23T14:59:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 -- 172.21.15.7:0/2411722843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 msgr2=0x55e8b6f3d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a11c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39f40a3dc0 0x7f39f40a6280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3a04030800 tx=0x7f3a04042b10 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3d780 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f39f8013910 tx=0x7f39f800e430 comp rx=0 tx=0).stop 2024-04-23T14:59:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 -- 172.21.15.7:0/2411722843 shutdown_connections 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3d780 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2411722843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f30590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 -- 172.21.15.7:0/2411722843 >> 172.21.15.7:0/2411722843 conn(0x55e8b6f2c6c0 msgr2=0x55e8b6f2caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 -- 172.21.15.7:0/2411722843 shutdown_connections 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.527+0000 7f3a16b64740 1 -- 172.21.15.7:0/2411722843 wait complete. 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.528+0000 7f3a16b64740 1 -- start start 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.528+0000 7f3a16b64740 1 Processor -- start 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.528+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.528+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f38930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.528+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 0x55e8b6f38e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.528+0000 7f3a16b64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8b6f3dfc0 con 0x55e8b6f30ad0 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a16b64740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e8b6e502c0 con 0x55e8b6f3b390 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a16b64740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e8b6f3e140 con 0x55e8b6f301b0 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a16b64740 10 client.0 _ll_register_callbacks cb 0x55e8b6ba8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f38930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f38930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49190/0 (socket says 172.21.15.7:49190) 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 -- 172.21.15.7:0/2169369500 learned_addr learned my addr 172.21.15.7:0/2169369500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 -- 172.21.15.7:0/2169369500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 msgr2=0x55e8b6f383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 -- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 msgr2=0x55e8b6f38e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 0x55e8b6f38e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a11200640 1 -- 172.21.15.7:0/2169369500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8b6e60fd0 con 0x55e8b6f30ad0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.529+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f3a11200640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f38930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000ce00 tx=0x7f3a000039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a319cc17d8e7b9c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f39f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f39f2a00640 1 -- 172.21.15.7:0/2169369500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00011970 con 0x55e8b6f30ad0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f39f2a00640 1 -- 172.21.15.7:0/2169369500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f3a00011b10 con 0x55e8b6f30ad0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39f800bdc0 con 0x55e8b6f30ad0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f39f2a00640 1 -- 172.21.15.7:0/2169369500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a00011d10 con 0x55e8b6f30ad0 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f3a16b64740 10 client.16317 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.530+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e8b6ba9210 con 0x55e8b6f30ad0 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f39f2a00640 1 -- 172.21.15.7:0/2169369500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39f800bdc0 con 0x55e8b6f30ad0 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f39f2a00640 1 -- 172.21.15.7:0/2169369500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3a00018070 con 0x55e8b6f30ad0 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f3a16b64740 10 client.16317 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f3a16b64740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f3a16b64740 20 client.16317 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6f4b6d0 0x55e8b6f4db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f3a16b64740 4 client.16317 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.531+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8b6ea4320 con 0x55e8b6f4b6d0 2024-04-23T14:59:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.532+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6f4b6d0 0x55e8b6f4db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.533+0000 7f39f2a00640 10 client.16317 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.533+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6f4b6d0 0x55e8b6f4db20 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2c24bce795fa9 server_cookie=2e1f6f2a6af99465 in_seq=0 out_seq=0 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f39f2a00640 1 -- 172.21.15.7:0/2169369500 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e8b6ea4320 con 0x55e8b6f4b6d0 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f39f2a00640 10 client.16317 handle_command_reply: tid=0 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 client.16317 shutdown 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 msgr2=0x55e8b6f38930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f38930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000ce00 tx=0x7f3a000039c0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 shutdown_connections 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6f4b6d0 0x55e8b6f4db20 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 0x55e8b6f38e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f38930 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2169369500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 >> 172.21.15.7:0/2169369500 conn(0x55e8b6f2c6c0 msgr2=0x55e8b6f323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.535+0000 7f39f2a00640 0 client.16317 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.536+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 shutdown_connections 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.536+0000 7f3a16b64740 1 -- 172.21.15.7:0/2169369500 wait complete. 2024-04-23T14:59:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.536+0000 7f3a16b64740 20 client.16317 trim_cache size 0 max 16384 2024-04-23T14:59:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.557+0000 7f3a16b64740 1 Processor -- start 2024-04-23T14:59:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.557+0000 7f3a16b64740 1 -- start start 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f2bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f32b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 0x55e8b6f38ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a16b64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1b1440 con 0x55e8b6f30ad0 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a16b64740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1b2f80 con 0x55e8b6f3b390 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a16b64740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1b1b10 con 0x55e8b6f301b0 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f32b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f32b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49194/0 (socket says 172.21.15.7:49194) 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 -- 172.21.15.7:0/3165275371 learned_addr learned my addr 172.21.15.7:0/3165275371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a0be00640 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f2bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 -- 172.21.15.7:0/3165275371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 msgr2=0x55e8b6f2bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f2bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 -- 172.21.15.7:0/3165275371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 msgr2=0x55e8b6f38ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 0x55e8b6f38ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.558+0000 7f3a11200640 1 -- 172.21.15.7:0/3165275371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8b6f3daf0 con 0x55e8b6f30ad0 2024-04-23T14:59:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.559+0000 7f3a0be00640 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f2bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.559+0000 7f3a11200640 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f32b70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a00019570 tx=0x7f3a000198f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1828cb3bddb4dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.559+0000 7f39fd600640 1 -- 172.21.15.7:0/3165275371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00019d30 con 0x55e8b6f30ad0 2024-04-23T14:59:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.559+0000 7f39fd600640 1 -- 172.21.15.7:0/3165275371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a00003f70 con 0x55e8b6f30ad0 2024-04-23T14:59:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.559+0000 7f39fd600640 1 -- 172.21.15.7:0/3165275371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00005610 con 0x55e8b6f30ad0 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 -- 172.21.15.7:0/3165275371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 msgr2=0x55e8b6f32b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f32b70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a00019570 tx=0x7f3a000198f0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 -- 172.21.15.7:0/3165275371 shutdown_connections 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f3b390 0x55e8b6f38ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f32b70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 --2- 172.21.15.7:0/3165275371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f301b0 0x55e8b6f2bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 -- 172.21.15.7:0/3165275371 >> 172.21.15.7:0/3165275371 conn(0x55e8b6f2c6c0 msgr2=0x55e8b6f383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 -- 172.21.15.7:0/3165275371 shutdown_connections 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.560+0000 7f3a16b64740 1 -- 172.21.15.7:0/3165275371 wait complete. 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.561+0000 7f3a16b64740 1 -- start start 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.561+0000 7f3a16b64740 1 Processor -- start 2024-04-23T14:59:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f43680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1b28b0 con 0x55e8b6f3b390 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1b21e0 con 0x55e8b6f301b0 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1af440 con 0x55e8b6f30ad0 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a16b64740 10 client.0 _ll_register_callbacks cb 0x7f3a00004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49196/0 (socket says 172.21.15.7:49196) 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a0be00640 1 -- 172.21.15.7:0/2686976817 learned_addr learned my addr 172.21.15.7:0/2686976817 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a11200640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f43680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a0be00640 1 -- 172.21.15.7:0/2686976817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 msgr2=0x55e8b6f3e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.562+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f3a0be00640 1 -- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 msgr2=0x55e8b6f43680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f43680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f3a0be00640 1 -- 172.21.15.7:0/2686976817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8b6c75620 con 0x55e8b6f3b390 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f3a0be00640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3ef30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f39f800b6d0 tx=0x7f39f8023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd4619ba158d676 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f39f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f39f2a00640 1 -- 172.21.15.7:0/2686976817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f80130d0 con 0x55e8b6f3b390 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f39f2a00640 1 -- 172.21.15.7:0/2686976817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f39f800b910 con 0x55e8b6f3b390 2024-04-23T14:59:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.563+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a00003f70 con 0x55e8b6f3b390 2024-04-23T14:59:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f39f2a00640 1 -- 172.21.15.7:0/2686976817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f39f8036050 con 0x55e8b6f3b390 2024-04-23T14:59:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 10 client.16323 fetch_fsmap learned FSMap version 32 2024-04-23T14:59:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e8b6fb1980 con 0x55e8b6f3b390 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f39f2a00640 1 -- 172.21.15.7:0/2686976817 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a00003f70 con 0x55e8b6f3b390 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f39f2a00640 1 -- 172.21.15.7:0/2686976817 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f39f80218d0 con 0x55e8b6f3b390 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 10 client.16323 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 20 client.16323 populate_metadata read hostname 'smithi007' 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6fb1dd0 0x55e8b6fb41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 4 client.16323 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.564+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8b6e9e190 con 0x55e8b6fb1dd0 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.565+0000 7f3a11200640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6fb1dd0 0x55e8b6fb41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.566+0000 7f3a11200640 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6fb1dd0 0x55e8b6fb41c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74eb2f532534e72a server_cookie=5254a9cc1f5dd404 in_seq=0 out_seq=0 2024-04-23T14:59:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.566+0000 7f39f2a00640 10 client.16323 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:47.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:47 smithi007 ceph-mon[27906]: pgmap v260: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T14:59:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f39f2a00640 1 -- 172.21.15.7:0/2686976817 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8b6e9e190 con 0x55e8b6fb1dd0 2024-04-23T14:59:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f39f2a00640 10 client.16323 handle_command_reply: tid=0 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 client.16323 shutdown 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 msgr2=0x55e8b6f3ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3ef30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f39f800b6d0 tx=0x7f39f8023040 comp rx=0 tx=0).stop 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 shutdown_connections 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8b6fb1dd0 0x55e8b6fb41c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8b6f3b390 0x55e8b6f3ef30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8b6f30ad0 0x55e8b6f3e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 --2- 172.21.15.7:0/2686976817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8b6f301b0 0x55e8b6f43680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f39f2a00640 0 client.16323 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 >> 172.21.15.7:0/2686976817 conn(0x55e8b6f2c6c0 msgr2=0x55e8b6f38ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 shutdown_connections 2024-04-23T14:59:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.595+0000 7f3a16b64740 1 -- 172.21.15.7:0/2686976817 wait complete. 2024-04-23T14:59:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.596+0000 7f3a16b64740 20 client.16323 trim_cache size 0 max 16384 2024-04-23T14:59:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T14:59:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T14:59:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T14:59:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.596+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39f40a3dc0 msgr2=0x7f39f40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.596+0000 7f3a13c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39f40a3dc0 0x7f39f40a6280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3a04030800 tx=0x7f3a04042b10 comp rx=0 tx=0).stop 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.596+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 msgr2=0x7f3a0c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.596+0000 7f3a13c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 0x7f3a0c19aab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3a04003bd0 tx=0x7f3a04003c00 comp rx=0 tx=0).stop 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 shutdown_connections 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f39f40a3dc0 0x7f39f40a6280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c19a630 0x7f3a0c19aab0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a0c109530 0x7f3a0c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 --2- 172.21.15.7:0/3038725175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a0c104460 0x7f3a0c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 >> 172.21.15.7:0/3038725175 conn(0x7f3a0c0ffd00 msgr2=0x7f3a0c100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 shutdown_connections 2024-04-23T14:59:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T14:59:47.597+0000 7f3a13c00640 1 -- 172.21.15.7:0/3038725175 wait complete. 2024-04-23T14:59:47.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:47 smithi186 ceph-mon[31814]: pgmap v260: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T14:59:49.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:49 smithi007 ceph-mon[27906]: pgmap v261: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T14:59:49.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:49 smithi186 ceph-mon[31814]: pgmap v261: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T14:59:49.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:49 smithi137 ceph-mon[31694]: pgmap v261: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T14:59:51.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:51 smithi007 ceph-mon[27906]: pgmap v262: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T14:59:51.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:51 smithi186 ceph-mon[31814]: pgmap v262: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T14:59:51.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:51 smithi137 ceph-mon[31694]: pgmap v262: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T14:59:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:53 smithi007 ceph-mon[27906]: pgmap v263: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:59:53.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:53 smithi186 ceph-mon[31814]: pgmap v263: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:59:53.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:53 smithi137 ceph-mon[31694]: pgmap v263: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T14:59:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:55 smithi007 ceph-mon[27906]: pgmap v264: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T14:59:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:55 smithi186 ceph-mon[31814]: pgmap v264: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T14:59:55.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:55 smithi137 ceph-mon[31694]: pgmap v264: 129 pgs: 129 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T14:59:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:57 smithi007 ceph-mon[27906]: pgmap v265: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T14:59:57.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:57 smithi186 ceph-mon[31814]: pgmap v265: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T14:59:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:57 smithi137 ceph-mon[31694]: pgmap v265: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T14:59:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 14:59:59 smithi007 ceph-mon[27906]: pgmap v266: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:59.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 14:59:59 smithi186 ceph-mon[31814]: pgmap v266: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T14:59:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 14:59:59 smithi137 ceph-mon[31694]: pgmap v266: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 -- 172.21.15.7:0/1322667888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 msgr2=0x7f852c10e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 --2- 172.21.15.7:0/1322667888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10e3b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8518009900 tx=0x7f851802a480 comp rx=0 tx=0).stop 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 -- 172.21.15.7:0/1322667888 shutdown_connections 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 --2- 172.21.15.7:0/1322667888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f852c10e8f0 0x7f852c110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 --2- 172.21.15.7:0/1322667888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10e3b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 --2- 172.21.15.7:0/1322667888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 0x7f852c0746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 -- 172.21.15.7:0/1322667888 >> 172.21.15.7:0/1322667888 conn(0x7f852c079490 msgr2=0x7f852c0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.767+0000 7f8531400640 1 -- 172.21.15.7:0/1322667888 shutdown_connections 2024-04-23T15:00:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.768+0000 7f8531400640 1 -- 172.21.15.7:0/1322667888 wait complete. 2024-04-23T15:00:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 Processor -- start 2024-04-23T15:00:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 -- start start 2024-04-23T15:00:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 0x7f852c10e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f852c10e8f0 0x7f852c10b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1144d0 con 0x7f852c074c20 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f852c114350 con 0x7f852c074300 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.769+0000 7f8531400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f852c114650 con 0x7f852c10e8f0 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35662/0 (socket says 172.21.15.7:35662) 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 -- 172.21.15.7:0/2486900922 learned_addr learned my addr 172.21.15.7:0/2486900922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f852a800640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 0x7f852c10e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f852b200640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f852c10e8f0 0x7f852c10b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 -- 172.21.15.7:0/2486900922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f852c10e8f0 msgr2=0x7f852c10b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f852c10e8f0 0x7f852c10b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 -- 172.21.15.7:0/2486900922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 msgr2=0x7f852c10e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 0x7f852c10e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f8529e00640 1 -- 172.21.15.7:0/2486900922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c10c030 con 0x7f852c074c20 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.770+0000 7f852a800640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 0x7f852c10e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.771+0000 7f8529e00640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10b250 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8518005ab0 tx=0x7f8518003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.771+0000 7f8523400640 1 -- 172.21.15.7:0/2486900922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851803f070 con 0x7f852c074c20 2024-04-23T15:00:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.771+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c1ab210 con 0x7f852c074c20 2024-04-23T15:00:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.771+0000 7f8523400640 1 -- 172.21.15.7:0/2486900922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8518031d60 con 0x7f852c074c20 2024-04-23T15:00:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.771+0000 7f8523400640 1 -- 172.21.15.7:0/2486900922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518035030 con 0x7f852c074c20 2024-04-23T15:00:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.771+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c1ab750 con 0x7f852c074c20 2024-04-23T15:00:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.775+0000 7f8534260740 1 Processor -- start 2024-04-23T15:00:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.775+0000 7f8523400640 1 -- 172.21.15.7:0/2486900922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8518042070 con 0x7f852c074c20 2024-04-23T15:00:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 -- start start 2024-04-23T15:00:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69ae7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69af1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e69a4d900 con 0x563e69af2390 2024-04-23T15:00:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e699f3f20 con 0x563e69ae71b0 2024-04-23T15:00:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.776+0000 7f8534260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563e69a498c0 con 0x563e69ae7ad0 2024-04-23T15:00:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.777+0000 7f852b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69ae7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.777+0000 7f852b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69ae7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:37830/0 (socket says 172.21.15.7:37830) 2024-04-23T15:00:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.777+0000 7f852b200640 1 -- 172.21.15.7:0/1839542705 learned_addr learned my addr 172.21.15.7:0/1839542705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.777+0000 7f852a800640 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69af1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.777+0000 7f8529e00640 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.777+0000 7f8523400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f85100a3dc0 0x7f85100a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f8523400640 1 -- 172.21.15.7:0/2486900922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f85180f1530 con 0x7f852c074c20 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f852b200640 1 -- 172.21.15.7:0/1839542705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 msgr2=0x563e69af1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f852b200640 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69af1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f852b200640 1 -- 172.21.15.7:0/1839542705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 msgr2=0x563e69af4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f852b200640 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f852b200640 1 -- 172.21.15.7:0/1839542705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e69a18e10 con 0x563e69ae71b0 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.778+0000 7f8529e00640 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:00:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.779+0000 7f852b200640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f85100a3dc0 0x7f85100a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.779+0000 7f852b200640 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69ae7590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8524007f00 tx=0x7f852400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d885f25f21dab95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.780+0000 7f852b200640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f85100a3dc0 0x7f85100a6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f852401f000 tx=0x7f8524020000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.780+0000 7f8517400640 1 -- 172.21.15.7:0/1839542705 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524022070 con 0x563e69ae71b0 2024-04-23T15:00:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.780+0000 7f8517400640 1 -- 172.21.15.7:0/1839542705 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8524011b70 con 0x563e69ae71b0 2024-04-23T15:00:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.780+0000 7f8517400640 1 -- 172.21.15.7:0/1839542705 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852401a400 con 0x563e69ae71b0 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 -- 172.21.15.7:0/1839542705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 msgr2=0x563e69ae7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69ae7590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8524007f00 tx=0x7f852400e720 comp rx=0 tx=0).stop 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 -- 172.21.15.7:0/1839542705 shutdown_connections 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69af1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 --2- 172.21.15.7:0/1839542705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69ae7590 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 -- 172.21.15.7:0/1839542705 >> 172.21.15.7:0/1839542705 conn(0x563e69ae36c0 msgr2=0x563e69ae3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 -- 172.21.15.7:0/1839542705 shutdown_connections 2024-04-23T15:00:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.781+0000 7f8534260740 1 -- 172.21.15.7:0/1839542705 wait complete. 2024-04-23T15:00:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.782+0000 7f8534260740 1 -- start start 2024-04-23T15:00:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.782+0000 7f8534260740 1 Processor -- start 2024-04-23T15:00:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.782+0000 7f8534260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69aef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.782+0000 7f8534260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 0x563e69aef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8534260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69af2390 0x563e69aefdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8534260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563e69af4fc0 con 0x563e69ae7ad0 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8534260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e69a072c0 con 0x563e69ae71b0 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8534260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563e69af5140 con 0x563e69af2390 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8534260740 10 client.0 _ll_register_callbacks cb 0x563e6975fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8529e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 0x563e69aef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8529e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 0x563e69aef880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35674/0 (socket says 172.21.15.7:35674) 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f8529e00640 1 -- 172.21.15.7:0/4276476209 learned_addr learned my addr 172.21.15.7:0/4276476209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f852a800640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69aef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.783+0000 7f852b200640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69af2390 0x563e69aefdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f8529e00640 1 -- 172.21.15.7:0/4276476209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69af2390 msgr2=0x563e69aefdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f8529e00640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69af2390 0x563e69aefdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f8529e00640 1 -- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 msgr2=0x563e69aef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f8529e00640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69aef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f8529e00640 1 -- 172.21.15.7:0/4276476209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e69a17fd0 con 0x563e69ae7ad0 2024-04-23T15:00:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f8529e00640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 0x563e69aef880 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f85180b9a90 tx=0x7f8518009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb1b027828495cf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.784+0000 7f850be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.785+0000 7f850be00640 1 -- 172.21.15.7:0/4276476209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518049040 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.785+0000 7f850be00640 1 -- 172.21.15.7:0/4276476209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f85180f1170 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.785+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8524011b70 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.786+0000 7f850be00640 1 -- 172.21.15.7:0/4276476209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f85180bd7c0 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.786+0000 7f8534260740 10 client.16335 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.786+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563e69760210 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.786+0000 7f850be00640 1 -- 172.21.15.7:0/4276476209 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8524011b70 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.786+0000 7f850be00640 1 -- 172.21.15.7:0/4276476209 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f851803b5d0 con 0x563e69ae7ad0 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f8534260740 10 client.16335 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f8534260740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f8534260740 20 client.16335 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f8534260740 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b02560 0x563e69b04970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f8534260740 4 client.16335 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:00:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e69a5b320 con 0x563e69b02560 2024-04-23T15:00:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.787+0000 7f852a800640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b02560 0x563e69b04970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.789+0000 7f852a800640 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b02560 0x563e69b04970 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0b3debb7efc0d53 server_cookie=4c51fb2e833cbbd3 in_seq=0 out_seq=0 2024-04-23T15:00:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.789+0000 7f850be00640 10 client.16335 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.790+0000 7f850be00640 1 -- 172.21.15.7:0/4276476209 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563e69a5b320 con 0x563e69b02560 2024-04-23T15:00:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.790+0000 7f850be00640 10 client.16335 handle_command_reply: tid=0 2024-04-23T15:00:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.790+0000 7f8534260740 1 client.16335 shutdown 2024-04-23T15:00:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 msgr2=0x563e69aef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 0x563e69aef880 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f85180b9a90 tx=0x7f8518009260 comp rx=0 tx=0).stop 2024-04-23T15:00:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 shutdown_connections 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b02560 0x563e69b04970 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69af2390 0x563e69aefdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69ae7ad0 0x563e69aef880 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 --2- 172.21.15.7:0/4276476209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69aef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 >> 172.21.15.7:0/4276476209 conn(0x563e69ae36c0 msgr2=0x563e69ae93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f850be00640 0 client.16335 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 shutdown_connections 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 1 -- 172.21.15.7:0/4276476209 wait complete. 2024-04-23T15:00:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.791+0000 7f8534260740 20 client.16335 trim_cache size 0 max 16384 2024-04-23T15:00:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 Processor -- start 2024-04-23T15:00:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 -- start start 2024-04-23T15:00:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69b0a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69b0a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69aec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1b5930 con 0x563e69af2390 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1b7470 con 0x563e69ae71b0 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.816+0000 7f8534260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1b6000 con 0x563e69ae7ad0 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69aec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69aec5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35690/0 (socket says 172.21.15.7:35690) 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 -- 172.21.15.7:0/1060906941 learned_addr learned my addr 172.21.15.7:0/1060906941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f8529e00640 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69b0a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852a800640 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69b0a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 -- 172.21.15.7:0/1060906941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 msgr2=0x563e69b0a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69b0a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 -- 172.21.15.7:0/1060906941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 msgr2=0x563e69b0a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69b0a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f852b200640 1 -- 172.21.15.7:0/1060906941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6982c620 con 0x563e69af2390 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.817+0000 7f8529e00640 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69b0a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:00:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.818+0000 7f852b200640 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69aec5c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f852400ef10 tx=0x7f852400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7481870d758eb227 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.818+0000 7f8516a00640 1 -- 172.21.15.7:0/1060906941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524035070 con 0x563e69af2390 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.818+0000 7f8516a00640 1 -- 172.21.15.7:0/1060906941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8524026470 con 0x563e69af2390 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.818+0000 7f8516a00640 1 -- 172.21.15.7:0/1060906941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524022040 con 0x563e69af2390 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 -- 172.21.15.7:0/1060906941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 msgr2=0x563e69aec5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69aec5c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f852400ef10 tx=0x7f852400ef40 comp rx=0 tx=0).stop 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 -- 172.21.15.7:0/1060906941 shutdown_connections 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69aec5c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae7ad0 0x563e69b0a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 --2- 172.21.15.7:0/1060906941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae71b0 0x563e69b0a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 -- 172.21.15.7:0/1060906941 >> 172.21.15.7:0/1060906941 conn(0x563e69ae36c0 msgr2=0x563e69ae2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 -- 172.21.15.7:0/1060906941 shutdown_connections 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.819+0000 7f8534260740 1 -- 172.21.15.7:0/1060906941 wait complete. 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.820+0000 7f8534260740 1 -- start start 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.820+0000 7f8534260740 1 Processor -- start 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.820+0000 7f8534260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae71b0 0x563e69afa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.820+0000 7f8534260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae7ad0 0x563e69afa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f8534260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f8534260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1b6da0 con 0x563e69af2390 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f8534260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1b66d0 con 0x563e69ae7ad0 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f8534260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f852c1b3930 con 0x563e69ae71b0 2024-04-23T15:00:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f8534260740 10 client.0 _ll_register_callbacks cb 0x7f851803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35696/0 (socket says 172.21.15.7:35696) 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 -- 172.21.15.7:0/895927791 learned_addr learned my addr 172.21.15.7:0/895927791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f8529e00640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae7ad0 0x563e69afa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852a800640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae71b0 0x563e69afa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 -- 172.21.15.7:0/895927791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae71b0 msgr2=0x563e69afa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae71b0 0x563e69afa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 -- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae7ad0 msgr2=0x563e69afa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae7ad0 0x563e69afa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.821+0000 7f852b200640 1 -- 172.21.15.7:0/895927791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e69af7a20 con 0x563e69af2390 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.822+0000 7f852b200640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af7360 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8524033040 tx=0x7f8524011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ab116c37610bf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.822+0000 7f850be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.822+0000 7f850be00640 1 -- 172.21.15.7:0/895927791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524040060 con 0x563e69af2390 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.822+0000 7f850be00640 1 -- 172.21.15.7:0/895927791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9467+0+0 (secure 0 0 0) 0x7f852401c670 con 0x563e69af2390 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.822+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8524026470 con 0x563e69af2390 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f850be00640 1 -- 172.21.15.7:0/895927791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8524047050 con 0x563e69af2390 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 10 client.16341 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563e69b694d0 con 0x563e69af2390 2024-04-23T15:00:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f850be00640 1 -- 172.21.15.7:0/895927791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8524026470 con 0x563e69af2390 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f850be00640 1 -- 172.21.15.7:0/895927791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f852402f070 con 0x563e69af2390 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 10 client.16341 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 20 client.16341 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b69940 0x563e69b6bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 4 client.16341 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.823+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e69a55190 con 0x563e69b69940 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.824+0000 7f852a800640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b69940 0x563e69b6bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:00.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.825+0000 7f852a800640 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b69940 0x563e69b6bd30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e1d53b776883a1 server_cookie=7b22ec5c770d6eca in_seq=0 out_seq=0 2024-04-23T15:00:00.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.825+0000 7f850be00640 10 client.16341 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:00.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T15:00:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.854+0000 7f850be00640 1 -- 172.21.15.7:0/895927791 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e69a55190 con 0x563e69b69940 2024-04-23T15:00:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.854+0000 7f850be00640 10 client.16341 handle_command_reply: tid=0 2024-04-23T15:00:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.854+0000 7f8534260740 1 client.16341 shutdown 2024-04-23T15:00:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 msgr2=0x563e69af7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af7360 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8524033040 tx=0x7f8524011ba0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 shutdown_connections 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563e69b69940 0x563e69b6bd30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e69ae7ad0 0x563e69afa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563e69af2390 0x563e69af7360 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 --2- 172.21.15.7:0/895927791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e69ae71b0 0x563e69afa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f850be00640 0 client.16341 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 >> 172.21.15.7:0/895927791 conn(0x563e69ae36c0 msgr2=0x563e69ae8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 shutdown_connections 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 1 -- 172.21.15.7:0/895927791 wait complete. 2024-04-23T15:00:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.855+0000 7f8534260740 20 client.16341 trim_cache size 0 max 16384 2024-04-23T15:00:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:00:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:00:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:00:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:00:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f85100a3dc0 msgr2=0x7f85100a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f85100a3dc0 0x7f85100a6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f852401f000 tx=0x7f8524020000 comp rx=0 tx=0).stop 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 msgr2=0x7f852c10b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10b250 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8518005ab0 tx=0x7f8518003cd0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 shutdown_connections 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f85100a3dc0 0x7f85100a6280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f852c10e8f0 0x7f852c10b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c074c20 0x7f852c10b250 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 --2- 172.21.15.7:0/2486900922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c074300 0x7f852c10e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.856+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 >> 172.21.15.7:0/2486900922 conn(0x7f852c079490 msgr2=0x7f852c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.857+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 shutdown_connections 2024-04-23T15:00:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:00.857+0000 7f8531400640 1 -- 172.21.15.7:0/2486900922 wait complete. 2024-04-23T15:00:00.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T15:00:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T15:00:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:01 smithi186 ceph-mon[31814]: pgmap v267: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:00:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:01 smithi137 ceph-mon[31694]: pgmap v267: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:00:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:01 smithi007 ceph-mon[27906]: pgmap v267: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:00:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:03 smithi186 ceph-mon[31814]: pgmap v268: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.0 MiB/s wr, 38 op/s 2024-04-23T15:00:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:03 smithi186 ceph-mon[31814]: osdmap e99: 12 total, 12 up, 12 in 2024-04-23T15:00:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:03 smithi137 ceph-mon[31694]: pgmap v268: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.0 MiB/s wr, 38 op/s 2024-04-23T15:00:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:03 smithi137 ceph-mon[31694]: osdmap e99: 12 total, 12 up, 12 in 2024-04-23T15:00:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:03 smithi007 ceph-mon[27906]: pgmap v268: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.0 MiB/s wr, 38 op/s 2024-04-23T15:00:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:03 smithi007 ceph-mon[27906]: osdmap e99: 12 total, 12 up, 12 in 2024-04-23T15:00:05.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:05 smithi186 ceph-mon[31814]: pgmap v270: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 36 op/s 2024-04-23T15:00:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:05 smithi137 ceph-mon[31694]: pgmap v270: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 36 op/s 2024-04-23T15:00:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:05 smithi007 ceph-mon[27906]: pgmap v270: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 36 op/s 2024-04-23T15:00:07.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:07 smithi007 ceph-mon[27906]: pgmap v271: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:00:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:07 smithi137 ceph-mon[31694]: pgmap v271: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:00:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:07 smithi186 ceph-mon[31814]: pgmap v271: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:00:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:09 smithi137 ceph-mon[31694]: pgmap v272: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:00:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:09 smithi007 ceph-mon[27906]: pgmap v272: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:00:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:09 smithi186 ceph-mon[31814]: pgmap v272: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:00:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:11 smithi007 ceph-mon[27906]: osdmap e100: 12 total, 12 up, 12 in 2024-04-23T15:00:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:11 smithi007 ceph-mon[27906]: pgmap v274: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 8 op/s 2024-04-23T15:00:11.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:11 smithi186 ceph-mon[31814]: osdmap e100: 12 total, 12 up, 12 in 2024-04-23T15:00:11.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:11 smithi186 ceph-mon[31814]: pgmap v274: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 8 op/s 2024-04-23T15:00:11.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:11 smithi137 ceph-mon[31694]: osdmap e100: 12 total, 12 up, 12 in 2024-04-23T15:00:11.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:11 smithi137 ceph-mon[31694]: pgmap v274: 129 pgs: 129 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 8 op/s 2024-04-23T15:00:13.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:13 smithi007 ceph-mon[27906]: pgmap v275: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-04-23T15:00:13.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:13 smithi186 ceph-mon[31814]: pgmap v275: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-04-23T15:00:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:13 smithi137 ceph-mon[31694]: pgmap v275: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 -- 172.21.15.7:0/1411485428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f251810c3e0 msgr2=0x7f251810e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 --2- 172.21.15.7:0/1411485428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f251810c3e0 0x7f251810e880 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2510009ca0 tx=0x7f251002a950 comp rx=0 tx=0).stop 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 -- 172.21.15.7:0/1411485428 shutdown_connections 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 --2- 172.21.15.7:0/1411485428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25181038e0 0x7f251810bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 --2- 172.21.15.7:0/1411485428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f251810c3e0 0x7f251810e880 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 --2- 172.21.15.7:0/1411485428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2518102fc0 0x7f25181033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 -- 172.21.15.7:0/1411485428 >> 172.21.15.7:0/1411485428 conn(0x7f25180fc820 msgr2=0x7f25180fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 -- 172.21.15.7:0/1411485428 shutdown_connections 2024-04-23T15:00:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.008+0000 7f251e400640 1 -- 172.21.15.7:0/1411485428 wait complete. 2024-04-23T15:00:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.009+0000 7f251e400640 1 Processor -- start 2024-04-23T15:00:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.009+0000 7f251e400640 1 -- start start 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2518102fc0 0x7f25181a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 0x7f25181a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f251810c3e0 0x7f251819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251e400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25181120a0 con 0x7f25181038e0 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2518111f20 con 0x7f2518102fc0 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2518112220 con 0x7f251810c3e0 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f2517e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 0x7f25181a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f2517e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 0x7f25181a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58002/0 (socket says 172.21.15.7:58002) 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f2517e00640 1 -- 172.21.15.7:0/137229456 learned_addr learned my addr 172.21.15.7:0/137229456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.010+0000 7f251d000640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2518102fc0 0x7f25181a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f251da00640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f251810c3e0 0x7f251819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f2517e00640 1 -- 172.21.15.7:0/137229456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f251810c3e0 msgr2=0x7f251819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f2517e00640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f251810c3e0 0x7f251819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f2517e00640 1 -- 172.21.15.7:0/137229456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2518102fc0 msgr2=0x7f25181a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f2517e00640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2518102fc0 0x7f25181a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f2517e00640 1 -- 172.21.15.7:0/137229456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251819afc0 con 0x7f25181038e0 2024-04-23T15:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f251d000640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2518102fc0 0x7f25181a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:00:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.011+0000 7f2517e00640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 0x7f25181a0a90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f250800d740 tx=0x7f250800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.012+0000 7f2515600640 1 -- 172.21.15.7:0/137229456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508017070 con 0x7f25181038e0 2024-04-23T15:00:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.012+0000 7f2515600640 1 -- 172.21.15.7:0/137229456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f250800de50 con 0x7f25181038e0 2024-04-23T15:00:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.012+0000 7f2515600640 1 -- 172.21.15.7:0/137229456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250800f620 con 0x7f25181038e0 2024-04-23T15:00:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.012+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251819b2b0 con 0x7f25181038e0 2024-04-23T15:00:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.012+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25181a74d0 con 0x7f25181038e0 2024-04-23T15:00:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.016+0000 7f2515600640 1 -- 172.21.15.7:0/137229456 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2508009c30 con 0x7f25181038e0 2024-04-23T15:00:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.016+0000 7f252277d740 1 Processor -- start 2024-04-23T15:00:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.016+0000 7f252277d740 1 -- start start 2024-04-23T15:00:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f252277d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f252277d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f252277d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f252277d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556219234900 con 0x5562192e1db0 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f252277d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562191daf20 con 0x5562192d74f0 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f252277d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5562192308c0 con 0x5562192d6bd0 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f2517e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f2517e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58014/0 (socket says 172.21.15.7:58014) 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.017+0000 7f2517e00640 1 -- 172.21.15.7:0/3657410629 learned_addr learned my addr 172.21.15.7:0/3657410629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f251da00640 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f251d000640 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2517e00640 1 -- 172.21.15.7:0/3657410629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 msgr2=0x5562192d6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2517e00640 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192d6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2515600640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25000a3d90 0x7f25000a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2517e00640 1 -- 172.21.15.7:0/3657410629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 msgr2=0x5562192e1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2517e00640 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2517e00640 1 -- 172.21.15.7:0/3657410629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562191ffe10 con 0x5562192e1db0 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f251da00640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25000a3d90 0x7f25000a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.018+0000 7f2515600640 1 -- 172.21.15.7:0/137229456 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f25080d0760 con 0x7f25181038e0 2024-04-23T15:00:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.019+0000 7f2517e00640 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192e41a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f25080cd9e0 tx=0x7f25080d6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536b97ec2bd90a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.019+0000 7f2506000640 1 -- 172.21.15.7:0/3657410629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508020070 con 0x5562192e1db0 2024-04-23T15:00:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.019+0000 7f2506000640 1 -- 172.21.15.7:0/3657410629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25080be1c0 con 0x5562192e1db0 2024-04-23T15:00:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.019+0000 7f2506000640 1 -- 172.21.15.7:0/3657410629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508096e60 con 0x5562192e1db0 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 -- 172.21.15.7:0/3657410629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 msgr2=0x5562192e41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192e41a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f25080cd9e0 tx=0x7f25080d6f40 comp rx=0 tx=0).stop 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f251da00640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25000a3d90 0x7f25000a6250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2510005fa0 tx=0x7f2510004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 -- 172.21.15.7:0/3657410629 shutdown_connections 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192e41a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 --2- 172.21.15.7:0/3657410629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 -- 172.21.15.7:0/3657410629 >> 172.21.15.7:0/3657410629 conn(0x5562192d30e0 msgr2=0x5562192d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 -- 172.21.15.7:0/3657410629 shutdown_connections 2024-04-23T15:00:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.020+0000 7f252277d740 1 -- 172.21.15.7:0/3657410629 wait complete. 2024-04-23T15:00:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.021+0000 7f252277d740 1 -- start start 2024-04-23T15:00:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.021+0000 7f252277d740 1 Processor -- start 2024-04-23T15:00:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.021+0000 7f252277d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f252277d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192df280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f252277d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192df7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f252277d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562192e49e0 con 0x5562192e1db0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f252277d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562191ee2c0 con 0x5562192d74f0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f252277d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5562192e4b60 con 0x5562192d6bd0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f252277d740 10 client.0 _ll_register_callbacks cb 0x556218f46a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192df7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192df7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58022/0 (socket says 172.21.15.7:58022) 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 -- 172.21.15.7:0/4086072115 learned_addr learned my addr 172.21.15.7:0/4086072115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251d000640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f2517e00640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 -- 172.21.15.7:0/4086072115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 msgr2=0x5562192ded40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192ded40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 -- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 msgr2=0x5562192df280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.022+0000 7f251da00640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192df280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f251da00640 1 -- 172.21.15.7:0/4086072115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562191fefd0 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f2517e00640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192df280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f251da00640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192df7c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2510035000 tx=0x7f251002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb41def2b62a74a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f24faa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f24faa00640 1 -- 172.21.15.7:0/4086072115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510034040 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f24faa00640 1 -- 172.21.15.7:0/4086072115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f2510003fe0 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.023+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556219242320 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f24faa00640 1 -- 172.21.15.7:0/4086072115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2510004220 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f252277d740 10 client.16353 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556218f47210 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f24faa00640 1 -- 172.21.15.7:0/4086072115 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x556219242320 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f24faa00640 1 -- 172.21.15.7:0/4086072115 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2510052a80 con 0x5562192e1db0 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f252277d740 10 client.16353 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f252277d740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f252277d740 20 client.16353 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.024+0000 7f252277d740 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5562192f2030 0x5562192f4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.025+0000 7f252277d740 4 client.16353 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:00:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.025+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55621923c190 con 0x5562192f2030 2024-04-23T15:00:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.025+0000 7f251d000640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5562192f2030 0x5562192f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.026+0000 7f251d000640 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5562192f2030 0x5562192f4420 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61106ceb76a5ab9 server_cookie=cc5e13fe3770238a in_seq=0 out_seq=0 2024-04-23T15:00:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.026+0000 7f24faa00640 10 client.16353 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f24faa00640 1 -- 172.21.15.7:0/4086072115 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55621923c190 con 0x5562192f2030 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f24faa00640 10 client.16353 handle_command_reply: tid=0 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 client.16353 shutdown 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 msgr2=0x5562192df7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192df7c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2510035000 tx=0x7f251002a950 comp rx=0 tx=0).stop 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 shutdown_connections 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5562192f2030 0x5562192f4420 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192df280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x5562192df7c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 --2- 172.21.15.7:0/4086072115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192ded40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 >> 172.21.15.7:0/4086072115 conn(0x5562192d30e0 msgr2=0x5562192c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f24faa00640 0 client.16353 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 shutdown_connections 2024-04-23T15:00:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.028+0000 7f252277d740 1 -- 172.21.15.7:0/4086072115 wait complete. 2024-04-23T15:00:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.029+0000 7f252277d740 20 client.16353 trim_cache size 0 max 16384 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 Processor -- start 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 -- start start 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 0x5562192ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d74f0 0x5562192d9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192e1db0 0x5562192c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25181ad110 con 0x5562192d6bd0 2024-04-23T15:00:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25181aec50 con 0x5562192e1db0 2024-04-23T15:00:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.048+0000 7f252277d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25181ad7e0 con 0x5562192d74f0 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 0x5562192ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 0x5562192ed8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58028/0 (socket says 172.21.15.7:58028) 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 -- 172.21.15.7:0/2027857153 learned_addr learned my addr 172.21.15.7:0/2027857153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251da00640 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192e1db0 0x5562192c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f2517e00640 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d74f0 0x5562192d9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 -- 172.21.15.7:0/2027857153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d74f0 msgr2=0x5562192d9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d74f0 0x5562192d9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 -- 172.21.15.7:0/2027857153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192e1db0 msgr2=0x5562192c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192e1db0 0x5562192c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 -- 172.21.15.7:0/2027857153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556219013620 con 0x5562192d6bd0 2024-04-23T15:00:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.049+0000 7f251d000640 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 0x5562192ed8a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x5562192f4c90 tx=0x7f250c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5068339490853f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.050+0000 7f2505600640 1 -- 172.21.15.7:0/2027857153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c004020 con 0x5562192d6bd0 2024-04-23T15:00:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.050+0000 7f2505600640 1 -- 172.21.15.7:0/2027857153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f250c01d8e0 con 0x5562192d6bd0 2024-04-23T15:00:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.050+0000 7f2505600640 1 -- 172.21.15.7:0/2027857153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c003be0 con 0x5562192d6bd0 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 -- 172.21.15.7:0/2027857153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 msgr2=0x5562192ed8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 0x5562192ed8a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x5562192f4c90 tx=0x7f250c013830 comp rx=0 tx=0).stop 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 -- 172.21.15.7:0/2027857153 shutdown_connections 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192e1db0 0x5562192c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d74f0 0x5562192d9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 --2- 172.21.15.7:0/2027857153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192d6bd0 0x5562192ed8a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 -- 172.21.15.7:0/2027857153 >> 172.21.15.7:0/2027857153 conn(0x5562192d30e0 msgr2=0x5562192c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 -- 172.21.15.7:0/2027857153 shutdown_connections 2024-04-23T15:00:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 -- 172.21.15.7:0/2027857153 wait complete. 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.051+0000 7f252277d740 1 -- start start 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 Processor -- start 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x556219356550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25181ae580 con 0x5562192e1db0 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25181adeb0 con 0x5562192d74f0 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25181ab130 con 0x5562192d6bd0 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.052+0000 7f252277d740 10 client.0 _ll_register_callbacks cb 0x7f2510003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x556219356550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x556219356550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58032/0 (socket says 172.21.15.7:58032) 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 -- 172.21.15.7:0/1508526679 learned_addr learned my addr 172.21.15.7:0/1508526679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251d000640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f2517e00640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 -- 172.21.15.7:0/1508526679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 msgr2=0x5562192e4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192e4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 -- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 msgr2=0x5562192e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 -- 172.21.15.7:0/1508526679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556219356a90 con 0x5562192e1db0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f2517e00640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f251da00640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x556219356550 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2510052ef0 tx=0x7f2510009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0faa50a0af0cda server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.053+0000 7f24faa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f24faa00640 1 -- 172.21.15.7:0/1508526679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510034070 con 0x5562192e1db0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f250c01d8e0 con 0x5562192e1db0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f24faa00640 1 -- 172.21.15.7:0/1508526679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f25100045d0 con 0x5562192e1db0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f24faa00640 1 -- 172.21.15.7:0/1508526679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2510066050 con 0x5562192e1db0 2024-04-23T15:00:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f252277d740 10 client.16359 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:14.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556219357da0 con 0x5562192e1db0 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.054+0000 7f24faa00640 1 -- 172.21.15.7:0/1508526679 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f250c01d8e0 con 0x5562192e1db0 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f24faa00640 1 -- 172.21.15.7:0/1508526679 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f25100527e0 con 0x5562192e1db0 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f252277d740 10 client.16359 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f252277d740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f252277d740 20 client.16359 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f252277d740 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556219358460 0x55621935a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f252277d740 4 client.16359 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:00:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5562191b84b0 con 0x556219358460 2024-04-23T15:00:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.055+0000 7f251d000640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556219358460 0x55621935a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.056+0000 7f251d000640 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556219358460 0x55621935a880 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b853e0cc344a6ae1 server_cookie=9588aa25a894c444 in_seq=0 out_seq=0 2024-04-23T15:00:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.056+0000 7f24faa00640 10 client.16359 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f24faa00640 1 -- 172.21.15.7:0/1508526679 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5562191b84b0 con 0x556219358460 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f24faa00640 10 client.16359 handle_command_reply: tid=0 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 client.16359 shutdown 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 msgr2=0x556219356550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x556219356550 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2510052ef0 tx=0x7f2510009540 comp rx=0 tx=0).stop 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 shutdown_connections 2024-04-23T15:00:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556219358460 0x55621935a880 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562192d74f0 0x5562192e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f24faa00640 0 client.16359 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562192e1db0 0x556219356550 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 --2- 172.21.15.7:0/1508526679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562192d6bd0 0x5562192e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 >> 172.21.15.7:0/1508526679 conn(0x5562192d30e0 msgr2=0x5562192dd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 shutdown_connections 2024-04-23T15:00:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.084+0000 7f252277d740 1 -- 172.21.15.7:0/1508526679 wait complete. 2024-04-23T15:00:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.085+0000 7f252277d740 20 client.16359 trim_cache size 0 max 16384 2024-04-23T15:00:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:00:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:00:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:00:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.085+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25000a3d90 msgr2=0x7f25000a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.085+0000 7f251e400640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25000a3d90 0x7f25000a6250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2510005fa0 tx=0x7f2510004a40 comp rx=0 tx=0).stop 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.085+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 msgr2=0x7f25181a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.085+0000 7f251e400640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 0x7f25181a0a90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f250800d740 tx=0x7f250800dc00 comp rx=0 tx=0).stop 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 shutdown_connections 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25000a3d90 0x7f25000a6250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f251810c3e0 0x7f251819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25181038e0 0x7f25181a0a90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 --2- 172.21.15.7:0/137229456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2518102fc0 0x7f25181a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 >> 172.21.15.7:0/137229456 conn(0x7f25180fc820 msgr2=0x7f2518101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 shutdown_connections 2024-04-23T15:00:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:14.086+0000 7f251e400640 1 -- 172.21.15.7:0/137229456 wait complete. 2024-04-23T15:00:15.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:15 smithi007 ceph-mon[27906]: pgmap v276: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-04-23T15:00:15.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:15 smithi186 ceph-mon[31814]: pgmap v276: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-04-23T15:00:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:15 smithi137 ceph-mon[31694]: pgmap v276: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.5 MiB/s wr, 13 op/s 2024-04-23T15:00:17.828 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:17 smithi137 ceph-mon[31694]: pgmap v277: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:00:17.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:17 smithi007 ceph-mon[27906]: pgmap v277: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:00:17.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:17 smithi186 ceph-mon[31814]: pgmap v277: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:00:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:19 smithi007 ceph-mon[27906]: pgmap v278: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:00:19.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:19 smithi186 ceph-mon[31814]: pgmap v278: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:00:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:19 smithi137 ceph-mon[31694]: pgmap v278: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:00:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:21 smithi007 ceph-mon[27906]: pgmap v279: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:00:21.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:21 smithi186 ceph-mon[31814]: pgmap v279: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:00:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:21 smithi137 ceph-mon[31694]: pgmap v279: 129 pgs: 129 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:00:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:23 smithi007 ceph-mon[27906]: pgmap v280: 129 pgs: 129 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:23.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:23 smithi186 ceph-mon[31814]: pgmap v280: 129 pgs: 129 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:23 smithi137 ceph-mon[31694]: pgmap v280: 129 pgs: 129 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:25.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:25 smithi186 ceph-mon[31814]: pgmap v281: 129 pgs: 129 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:25 smithi137 ceph-mon[31694]: pgmap v281: 129 pgs: 129 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:25 smithi007 ceph-mon[27906]: pgmap v281: 129 pgs: 129 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.252+0000 7fa06a400640 1 -- 172.21.15.7:0/3397535577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa064102fc0 msgr2=0x7fa0641033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.252+0000 7fa06a400640 1 --2- 172.21.15.7:0/3397535577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa064102fc0 0x7fa0641033a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa058009900 tx=0x7fa05802a480 comp rx=0 tx=0).stop 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.252+0000 7fa06a400640 1 -- 172.21.15.7:0/3397535577 shutdown_connections 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.252+0000 7fa06a400640 1 --2- 172.21.15.7:0/3397535577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa06410c3e0 0x7fa06410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.252+0000 7fa06a400640 1 --2- 172.21.15.7:0/3397535577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0641038e0 0x7fa06410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.252+0000 7fa06a400640 1 --2- 172.21.15.7:0/3397535577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa064102fc0 0x7fa0641033a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.253+0000 7fa06a400640 1 -- 172.21.15.7:0/3397535577 >> 172.21.15.7:0/3397535577 conn(0x7fa0640fc820 msgr2=0x7fa0640fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.253+0000 7fa06a400640 1 -- 172.21.15.7:0/3397535577 shutdown_connections 2024-04-23T15:00:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.253+0000 7fa06a400640 1 -- 172.21.15.7:0/3397535577 wait complete. 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 Processor -- start 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 -- start start 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa064102fc0 0x7fa0641a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0641038e0 0x7fa0641a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 0x7fa06419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641120a0 con 0x7fa06410c3e0 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa064111f20 con 0x7fa064102fc0 2024-04-23T15:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.254+0000 7fa06a400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa064112220 con 0x7fa0641038e0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 0x7fa06419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 0x7fa06419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46156/0 (socket says 172.21.15.7:46156) 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 -- 172.21.15.7:0/608447712 learned_addr learned my addr 172.21.15.7:0/608447712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa063e00640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0641038e0 0x7fa0641a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069000640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa064102fc0 0x7fa0641a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 -- 172.21.15.7:0/608447712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0641038e0 msgr2=0x7fa0641a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0641038e0 0x7fa0641a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 -- 172.21.15.7:0/608447712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa064102fc0 msgr2=0x7fa0641a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa064102fc0 0x7fa0641a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.255+0000 7fa069a00640 1 -- 172.21.15.7:0/608447712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06419afc0 con 0x7fa06410c3e0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.256+0000 7fa069a00640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 0x7fa06419a700 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00eaa0 tx=0x7fa05c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.256+0000 7fa061600640 1 -- 172.21.15.7:0/608447712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00cdb0 con 0x7fa06410c3e0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.256+0000 7fa061600640 1 -- 172.21.15.7:0/608447712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa05c005020 con 0x7fa06410c3e0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.256+0000 7fa061600640 1 -- 172.21.15.7:0/608447712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0116d0 con 0x7fa06410c3e0 2024-04-23T15:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.256+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06419b2b0 con 0x7fa06410c3e0 2024-04-23T15:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.256+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0641a7570 con 0x7fa06410c3e0 2024-04-23T15:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.260+0000 7fa06e79c740 1 Processor -- start 2024-04-23T15:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa061600640 1 -- 172.21.15.7:0/608447712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa05c0051d0 con 0x7fa06410c3e0 2024-04-23T15:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 -- start start 2024-04-23T15:00:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f53c0 0x55c0005f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c000600060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000602990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c00055b900 con 0x55c0005f5ce0 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c000501f20 con 0x55c0005f53c0 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.261+0000 7fa06e79c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c0005578c0 con 0x55c0006005a0 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c000600060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c000600060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46168/0 (socket says 172.21.15.7:46168) 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 -- 172.21.15.7:0/1592486466 learned_addr learned my addr 172.21.15.7:0/1592486466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa063e00640 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f53c0 0x55c0005f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa063e00640 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000602990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 -- 172.21.15.7:0/1592486466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 msgr2=0x55c000602990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000602990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 -- 172.21.15.7:0/1592486466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f53c0 msgr2=0x55c0005f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f53c0 0x55c0005f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa069000640 1 -- 172.21.15.7:0/1592486466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c000526e10 con 0x55c0005f5ce0 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.262+0000 7fa063e00640 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000602990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa069000640 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c000600060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa058009230 tx=0x7fa058004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78dee5d5000c32cc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa061600640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa04c0a3d90 0x7fa04c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa056000640 1 -- 172.21.15.7:0/1592486466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058035030 con 0x55c0005f5ce0 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa061600640 1 -- 172.21.15.7:0/608447712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7fa05c0d0d40 con 0x7fa06410c3e0 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa056000640 1 -- 172.21.15.7:0/1592486466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0580046c0 con 0x55c0005f5ce0 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa056000640 1 -- 172.21.15.7:0/1592486466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058003850 con 0x55c0005f5ce0 2024-04-23T15:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.263+0000 7fa063e00640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa04c0a3d90 0x7fa04c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 -- 172.21.15.7:0/1592486466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 msgr2=0x55c000600060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c000600060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa058009230 tx=0x7fa058004390 comp rx=0 tx=0).stop 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa063e00640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa04c0a3d90 0x7fa04c0a6250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa050005fd0 tx=0x7fa05000b420 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 -- 172.21.15.7:0/1592486466 shutdown_connections 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000602990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c000600060 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1592486466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f53c0 0x55c0005f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 -- 172.21.15.7:0/1592486466 >> 172.21.15.7:0/1592486466 conn(0x55c0005f18d0 msgr2=0x55c0005f1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 -- 172.21.15.7:0/1592486466 shutdown_connections 2024-04-23T15:00:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.264+0000 7fa06e79c740 1 -- 172.21.15.7:0/1592486466 wait complete. 2024-04-23T15:00:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.265+0000 7fa06e79c740 1 -- start start 2024-04-23T15:00:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.265+0000 7fa06e79c740 1 Processor -- start 2024-04-23T15:00:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005fd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c0005fdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 0x55c0005fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c0006030e0 con 0x55c0006005a0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c0005152c0 con 0x55c0005f5ce0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c000603260 con 0x55c0005f53c0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa06e79c740 10 client.0 _ll_register_callbacks cb 0x55c00026da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa069a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 0x55c0005fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa069a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 0x55c0005fe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46170/0 (socket says 172.21.15.7:46170) 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa069a00640 1 -- 172.21.15.7:0/1454075370 learned_addr learned my addr 172.21.15.7:0/1454075370 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa063e00640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c0005fdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.266+0000 7fa069000640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa069a00640 1 -- 172.21.15.7:0/1454075370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 msgr2=0x55c0005fd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa069a00640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005fd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa069a00640 1 -- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 msgr2=0x55c0005fdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa069a00640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c0005fdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa069a00640 1 -- 172.21.15.7:0/1454075370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c000525fd0 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa069a00640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 0x55c0005fe010 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa05c098d90 tx=0x7fa05c09c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dc05bc548b8133 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa04aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa04aa00640 1 -- 172.21.15.7:0/1454075370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01f040 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0580046c0 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.267+0000 7fa04aa00640 1 -- 172.21.15.7:0/1454075370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7fa05c0870c0 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa04aa00640 1 -- 172.21.15.7:0/1454075370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa05c0872c0 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 10 client.16371 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c00026e210 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa04aa00640 1 -- 172.21.15.7:0/1454075370 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0580046c0 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa04aa00640 1 -- 172.21.15.7:0/1454075370 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa05c00f040 con 0x55c0006005a0 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 10 client.16371 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 10 client.16371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 20 client.16371 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0006106b0 0x55c000612aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 4 client.16371 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:00:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.268+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c000569320 con 0x55c0006106b0 2024-04-23T15:00:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.269+0000 7fa069000640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0006106b0 0x55c000612aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.270+0000 7fa069000640 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0006106b0 0x55c000612aa0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7422a0a3ca381ac7 server_cookie=8777dbac7e111bdd in_seq=0 out_seq=0 2024-04-23T15:00:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.270+0000 7fa04aa00640 10 client.16371 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa04aa00640 1 -- 172.21.15.7:0/1454075370 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c000569320 con 0x55c0006106b0 2024-04-23T15:00:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa04aa00640 10 client.16371 handle_command_reply: tid=0 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 client.16371 shutdown 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 msgr2=0x55c0005fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 0x55c0005fe010 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa05c098d90 tx=0x7fa05c09c9f0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 shutdown_connections 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0006106b0 0x55c000612aa0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c0005fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0006005a0 0x55c0005fe010 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 --2- 172.21.15.7:0/1454075370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 >> 172.21.15.7:0/1454075370 conn(0x55c0005f18d0 msgr2=0x55c0005f7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.272+0000 7fa04aa00640 0 client.16371 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.273+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 shutdown_connections 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.273+0000 7fa06e79c740 1 -- 172.21.15.7:0/1454075370 wait complete. 2024-04-23T15:00:27.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.273+0000 7fa06e79c740 20 client.16371 trim_cache size 0 max 16384 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.293+0000 7fa06e79c740 1 Processor -- start 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 -- start start 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c0006183b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0006005a0 0x55c0006188f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641b13f0 con 0x55c0005f5ce0 2024-04-23T15:00:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641b2f30 con 0x55c0006005a0 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa06e79c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641b1ac0 con 0x55c0005f53c0 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.294+0000 7fa063e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c0006183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c0006183b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46172/0 (socket says 172.21.15.7:46172) 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 -- 172.21.15.7:0/3531030608 learned_addr learned my addr 172.21.15.7:0/3531030608 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa069a00640 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0006005a0 0x55c0006188f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa069000640 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 -- 172.21.15.7:0/3531030608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 msgr2=0x55c0005ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 -- 172.21.15.7:0/3531030608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0006005a0 msgr2=0x55c0006188f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0006005a0 0x55c0006188f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.295+0000 7fa063e00640 1 -- 172.21.15.7:0/3531030608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0005fc540 con 0x55c0005f5ce0 2024-04-23T15:00:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.296+0000 7fa063e00640 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c0006183b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55c0005f2a60 tx=0x7fa050013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5fef396b274a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.296+0000 7fa055600640 1 -- 172.21.15.7:0/3531030608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05001a660 con 0x55c0005f5ce0 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.296+0000 7fa055600640 1 -- 172.21.15.7:0/3531030608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa05001acb0 con 0x55c0005f5ce0 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.296+0000 7fa055600640 1 -- 172.21.15.7:0/3531030608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05001be00 con 0x55c0005f5ce0 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 -- 172.21.15.7:0/3531030608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 msgr2=0x55c0006183b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c0006183b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55c0005f2a60 tx=0x7fa050013040 comp rx=0 tx=0).stop 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 -- 172.21.15.7:0/3531030608 shutdown_connections 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0006005a0 0x55c0006188f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f5ce0 0x55c0006183b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 --2- 172.21.15.7:0/3531030608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0005f53c0 0x55c0005ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 -- 172.21.15.7:0/3531030608 >> 172.21.15.7:0/3531030608 conn(0x55c0005f18d0 msgr2=0x55c0005f1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 -- 172.21.15.7:0/3531030608 shutdown_connections 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.297+0000 7fa06e79c740 1 -- 172.21.15.7:0/3531030608 wait complete. 2024-04-23T15:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 -- start start 2024-04-23T15:00:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 Processor -- start 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 0x55c000604050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c000604590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000604ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641b2860 con 0x55c0005f53c0 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641b2190 con 0x55c0005f5ce0 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa0641af3f0 con 0x55c0006005a0 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.298+0000 7fa06e79c740 10 client.0 _ll_register_callbacks cb 0x7fa05c098bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 0x55c000604050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 0x55c000604050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46188/0 (socket says 172.21.15.7:46188) 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 -- 172.21.15.7:0/537866646 learned_addr learned my addr 172.21.15.7:0/537866646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa063e00640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c000604590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069a00640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000604ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 -- 172.21.15.7:0/537866646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 msgr2=0x55c000604ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000604ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 -- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 msgr2=0x55c000604590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c000604590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 -- 172.21.15.7:0/537866646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c000602d00 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069a00640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000604ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa069000640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 0x55c000604050 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa058009230 tx=0x7fa058009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb301651d755ca9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.299+0000 7fa04aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa04aa00640 1 -- 172.21.15.7:0/537866646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058035040 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa04aa00640 1 -- 172.21.15.7:0/537866646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7fa058005450 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05001acb0 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa04aa00640 1 -- 172.21.15.7:0/537866646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa05805b050 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa06e79c740 10 client.16377 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c00033a620 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.300+0000 7fa04aa00640 1 -- 172.21.15.7:0/537866646 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa05001acb0 con 0x55c0005f53c0 2024-04-23T15:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa04aa00640 1 -- 172.21.15.7:0/537866646 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa058004950 con 0x55c0005f53c0 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa06e79c740 10 client.16377 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa06e79c740 10 client.16377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa06e79c740 20 client.16377 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa06e79c740 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c000676ea0 0x55c000679290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa06e79c740 4 client.16377 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c000563190 con 0x55c000676ea0 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.301+0000 7fa063e00640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c000676ea0 0x55c000679290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.303+0000 7fa04aa00640 10 client.16377 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.303+0000 7fa063e00640 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c000676ea0 0x55c000679290 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d590c74cd36146 server_cookie=cd5fc138dd9168a1 in_seq=0 out_seq=0 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa04aa00640 1 -- 172.21.15.7:0/537866646 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c000563190 con 0x55c000676ea0 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa04aa00640 10 client.16377 handle_command_reply: tid=0 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 client.16377 shutdown 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 msgr2=0x55c000604050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 0x55c000604050 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa058009230 tx=0x7fa058009260 comp rx=0 tx=0).stop 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 shutdown_connections 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c000676ea0 0x55c000679290 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0005f5ce0 0x55c000604590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0006005a0 0x55c000604ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 --2- 172.21.15.7:0/537866646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0005f53c0 0x55c000604050 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 >> 172.21.15.7:0/537866646 conn(0x55c0005f18d0 msgr2=0x55c0005f0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa04aa00640 0 client.16377 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 shutdown_connections 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.339+0000 7fa06e79c740 1 -- 172.21.15.7:0/537866646 wait complete. 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.340+0000 7fa06e79c740 20 client.16377 trim_cache size 0 max 16384 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:00:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa04c0a3d90 msgr2=0x7fa04c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa04c0a3d90 0x7fa04c0a6250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa050005fd0 tx=0x7fa05000b420 comp rx=0 tx=0).stop 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 msgr2=0x7fa06419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 0x7fa06419a700 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00eaa0 tx=0x7fa05c00ef60 comp rx=0 tx=0).stop 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 shutdown_connections 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa04c0a3d90 0x7fa04c0a6250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa06410c3e0 0x7fa06419a700 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0641038e0 0x7fa0641a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 --2- 172.21.15.7:0/608447712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa064102fc0 0x7fa0641a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 >> 172.21.15.7:0/608447712 conn(0x7fa0640fc820 msgr2=0x7fa064101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 shutdown_connections 2024-04-23T15:00:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:27.341+0000 7fa06a400640 1 -- 172.21.15.7:0/608447712 wait complete. 2024-04-23T15:00:27.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:27 smithi186 ceph-mon[31814]: pgmap v282: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:27 smithi137 ceph-mon[31694]: pgmap v282: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:27 smithi007 ceph-mon[27906]: pgmap v282: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:29.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:29 smithi186 ceph-mon[31814]: pgmap v283: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:00:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:29 smithi137 ceph-mon[31694]: pgmap v283: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:00:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:29 smithi007 ceph-mon[27906]: pgmap v283: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:00:31.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:31 smithi186 ceph-mon[31814]: pgmap v284: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:00:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:31 smithi137 ceph-mon[31694]: pgmap v284: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:00:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:31 smithi007 ceph-mon[27906]: pgmap v284: 129 pgs: 129 active+clean; 1.9 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:00:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:33 smithi137 ceph-mon[31694]: pgmap v285: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:33 smithi007 ceph-mon[27906]: pgmap v285: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:33 smithi186 ceph-mon[31814]: pgmap v285: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:00:35.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:35 smithi137 ceph-mon[31694]: pgmap v286: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:35 smithi007 ceph-mon[27906]: pgmap v286: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:36.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:35 smithi186 ceph-mon[31814]: pgmap v286: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:37.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:37 smithi007 ceph-mon[27906]: pgmap v287: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:37.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:37 smithi137 ceph-mon[31694]: pgmap v287: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:38.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:37 smithi186 ceph-mon[31814]: pgmap v287: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:39.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:39 smithi137 ceph-mon[31694]: pgmap v288: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:39 smithi007 ceph-mon[27906]: pgmap v288: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:40.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:39 smithi186 ceph-mon[31814]: pgmap v288: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 -- 172.21.15.7:0/747416748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 msgr2=0x7f51e00746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 --2- 172.21.15.7:0/747416748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e00746e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009ca0 tx=0x7f51d402a950 comp rx=0 tx=0).stop 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 -- 172.21.15.7:0/747416748 shutdown_connections 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 --2- 172.21.15.7:0/747416748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51e0074c20 0x7f51e010e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 --2- 172.21.15.7:0/747416748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51e010e8f0 0x7f51e0110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 --2- 172.21.15.7:0/747416748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e00746e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 -- 172.21.15.7:0/747416748 >> 172.21.15.7:0/747416748 conn(0x7f51e0079490 msgr2=0x7f51e00798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 -- 172.21.15.7:0/747416748 shutdown_connections 2024-04-23T15:00:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.502+0000 7f51e8400640 1 -- 172.21.15.7:0/747416748 wait complete. 2024-04-23T15:00:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 Processor -- start 2024-04-23T15:00:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 -- start start 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e01a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51e0074c20 0x7f51e01a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51e010e8f0 0x7f51e019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01144f0 con 0x7f51e0074300 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0114370 con 0x7f51e0074c20 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.504+0000 7f51e8400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0114670 con 0x7f51e010e8f0 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e01a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e01a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40628/0 (socket says 172.21.15.7:40628) 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 -- 172.21.15.7:0/328290184 learned_addr learned my addr 172.21.15.7:0/328290184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e6400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51e010e8f0 0x7f51e019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5000640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51e0074c20 0x7f51e01a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 -- 172.21.15.7:0/328290184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51e010e8f0 msgr2=0x7f51e019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51e010e8f0 0x7f51e019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 -- 172.21.15.7:0/328290184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51e0074c20 msgr2=0x7f51e01a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51e0074c20 0x7f51e01a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.505+0000 7f51e5a00640 1 -- 172.21.15.7:0/328290184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e019b030 con 0x7f51e0074300 2024-04-23T15:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.506+0000 7f51e5a00640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e01a06b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f51d4005e30 tx=0x7f51d4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.506+0000 7f51de000640 1 -- 172.21.15.7:0/328290184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4034040 con 0x7f51e0074300 2024-04-23T15:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.506+0000 7f51de000640 1 -- 172.21.15.7:0/328290184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51d40308d0 con 0x7f51e0074300 2024-04-23T15:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.506+0000 7f51de000640 1 -- 172.21.15.7:0/328290184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4004830 con 0x7f51e0074300 2024-04-23T15:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.506+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e019b2c0 con 0x7f51e0074300 2024-04-23T15:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.506+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e01a7450 con 0x7f51e0074300 2024-04-23T15:00:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 Processor -- start 2024-04-23T15:00:40.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 -- start start 2024-04-23T15:00:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bc2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51de000640 1 -- 172.21.15.7:0/328290184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f51d4037020 con 0x7f51e0074300 2024-04-23T15:00:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bcce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 0x556de2bcf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556de2b28900 con 0x556de2bcd390 2024-04-23T15:00:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556de2acef20 con 0x556de2bc2ad0 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.510+0000 7f51eb21b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556de2b248c0 con 0x556de2bc21b0 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 0x556de2bcf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 0x556de2bcf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40640/0 (socket says 172.21.15.7:40640) 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 -- 172.21.15.7:0/1097359056 learned_addr learned my addr 172.21.15.7:0/1097359056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e6400640 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bc2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5a00640 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bcce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 -- 172.21.15.7:0/1097359056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 msgr2=0x556de2bc2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bc2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 -- 172.21.15.7:0/1097359056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 msgr2=0x556de2bcce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bcce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5000640 1 -- 172.21.15.7:0/1097359056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de2af3e10 con 0x556de2bcd390 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.511+0000 7f51e5a00640 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bcce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:00:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.512+0000 7f51e5000640 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 0x556de2bcf780 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00cc40 tx=0x7f51cc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76454282a10fc2c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.512+0000 7f51d2a00640 1 -- 172.21.15.7:0/1097359056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc014070 con 0x556de2bcd390 2024-04-23T15:00:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.512+0000 7f51d2a00640 1 -- 172.21.15.7:0/1097359056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51cc0047a0 con 0x556de2bcd390 2024-04-23T15:00:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.512+0000 7f51de000640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f51c80a3dc0 0x7f51c80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.512+0000 7f51de000640 1 -- 172.21.15.7:0/328290184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f51d40f1b30 con 0x7f51e0074300 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.512+0000 7f51d2a00640 1 -- 172.21.15.7:0/1097359056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc010630 con 0x556de2bcd390 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51e6400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f51c80a3dc0 0x7f51c80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 -- 172.21.15.7:0/1097359056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 msgr2=0x556de2bcf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 0x556de2bcf780 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00cc40 tx=0x7f51cc00e720 comp rx=0 tx=0).stop 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 -- 172.21.15.7:0/1097359056 shutdown_connections 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bcce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bcd390 0x556de2bcf780 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 --2- 172.21.15.7:0/1097359056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bc2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51eb21b740 1 -- 172.21.15.7:0/1097359056 >> 172.21.15.7:0/1097359056 conn(0x556de2bbe6c0 msgr2=0x556de2bbeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.513+0000 7f51e6400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f51c80a3dc0 0x7f51c80a6280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51d8005fd0 tx=0x7f51d800b420 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.514+0000 7f51eb21b740 1 -- 172.21.15.7:0/1097359056 shutdown_connections 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.514+0000 7f51eb21b740 1 -- 172.21.15.7:0/1097359056 wait complete. 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.514+0000 7f51eb21b740 1 -- start start 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.514+0000 7f51eb21b740 1 Processor -- start 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 0x556de2bca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2bcad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556de2bcffc0 con 0x556de2bc2ad0 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556de2ae22c0 con 0x556de2bcd390 2024-04-23T15:00:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556de2bd0140 con 0x556de2bc21b0 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51eb21b740 10 client.0 _ll_register_callbacks cb 0x556de283aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51e5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 0x556de2bca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51e5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 0x556de2bca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40654/0 (socket says 172.21.15.7:40654) 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.515+0000 7f51e5000640 1 -- 172.21.15.7:0/3733266495 learned_addr learned my addr 172.21.15.7:0/3733266495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e6400640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2bcad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5000640 1 -- 172.21.15.7:0/3733266495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 msgr2=0x556de2bca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5000640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5000640 1 -- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 msgr2=0x556de2bcad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5000640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2bcad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5000640 1 -- 172.21.15.7:0/3733266495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de2af2fd0 con 0x556de2bc2ad0 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51e5000640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 0x556de2bca850 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00cb60 tx=0x7f51cc010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c4b5d673ebb8ac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.516+0000 7f51c7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51c7400640 1 -- 172.21.15.7:0/3733266495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc027060 con 0x556de2bc2ad0 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51c7400640 1 -- 172.21.15.7:0/3733266495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f51cc022410 con 0x556de2bc2ad0 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51cc0047a0 con 0x556de2bc2ad0 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51c7400640 1 -- 172.21.15.7:0/3733266495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f51cc02e050 con 0x556de2bc2ad0 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51eb21b740 10 client.16389 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556de283b210 con 0x556de2bc2ad0 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.517+0000 7f51c7400640 1 -- 172.21.15.7:0/3733266495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51cc0047a0 con 0x556de2bc2ad0 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51c7400640 1 -- 172.21.15.7:0/3733266495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f51cc018410 con 0x556de2bc2ad0 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51eb21b740 10 client.16389 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51eb21b740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51eb21b740 20 client.16389 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2bdd430 0x556de2bdf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51eb21b740 4 client.16389 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:00:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.518+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556de2b36320 con 0x556de2bdd430 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.519+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2bdd430 0x556de2bdf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.520+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2bdd430 0x556de2bdf820 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc466acab504321e server_cookie=6a80fab5c9950e74 in_seq=0 out_seq=0 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.520+0000 7f51c7400640 10 client.16389 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.521+0000 7f51c7400640 1 -- 172.21.15.7:0/3733266495 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556de2b36320 con 0x556de2bdd430 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.521+0000 7f51c7400640 10 client.16389 handle_command_reply: tid=0 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 client.16389 shutdown 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 msgr2=0x556de2bca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 0x556de2bca850 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00cb60 tx=0x7f51cc010bd0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 shutdown_connections 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2bdd430 0x556de2bdf820 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2bcad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc2ad0 0x556de2bca850 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3733266495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc21b0 0x556de2bca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 >> 172.21.15.7:0/3733266495 conn(0x556de2bbe6c0 msgr2=0x556de2bc43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51c7400640 0 client.16389 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 shutdown_connections 2024-04-23T15:00:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 1 -- 172.21.15.7:0/3733266495 wait complete. 2024-04-23T15:00:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.522+0000 7f51eb21b740 20 client.16389 trim_cache size 0 max 16384 2024-04-23T15:00:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.541+0000 7f51eb21b740 1 Processor -- start 2024-04-23T15:00:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 -- start start 2024-04-23T15:00:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc2ad0 0x556de2bbdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2be4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01b14a0 con 0x556de2bc21b0 2024-04-23T15:00:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01b2fe0 con 0x556de2bcd390 2024-04-23T15:00:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51eb21b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01b1b70 con 0x556de2bc2ad0 2024-04-23T15:00:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40658/0 (socket says 172.21.15.7:40658) 2024-04-23T15:00:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.542+0000 7f51e5a00640 1 -- 172.21.15.7:0/3708991029 learned_addr learned my addr 172.21.15.7:0/3708991029 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5000640 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc2ad0 0x556de2bbdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5a00640 1 -- 172.21.15.7:0/3708991029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc2ad0 msgr2=0x556de2bbdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc2ad0 0x556de2bbdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5a00640 1 -- 172.21.15.7:0/3708991029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 msgr2=0x556de2be4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2be4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5a00640 1 -- 172.21.15.7:0/3708991029 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de2bb9ea0 con 0x556de2bc21b0 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.543+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd8e80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f51d4000f80 tx=0x7f51d402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39452274eedc1e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51d2000640 1 -- 172.21.15.7:0/3708991029 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d402c040 con 0x556de2bc21b0 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51d2000640 1 -- 172.21.15.7:0/3708991029 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51d40f7070 con 0x556de2bc21b0 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51d2000640 1 -- 172.21.15.7:0/3708991029 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40a80b0 con 0x556de2bc21b0 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51eb21b740 1 -- 172.21.15.7:0/3708991029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 msgr2=0x556de2bd8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd8e80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f51d4000f80 tx=0x7f51d402a950 comp rx=0 tx=0).stop 2024-04-23T15:00:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51eb21b740 1 -- 172.21.15.7:0/3708991029 shutdown_connections 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bcd390 0x556de2be4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bc2ad0 0x556de2bbdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.544+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3708991029 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd8e80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.545+0000 7f51eb21b740 1 -- 172.21.15.7:0/3708991029 >> 172.21.15.7:0/3708991029 conn(0x556de2bbe6c0 msgr2=0x556de2bc5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.545+0000 7f51eb21b740 1 -- 172.21.15.7:0/3708991029 shutdown_connections 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.545+0000 7f51eb21b740 1 -- 172.21.15.7:0/3708991029 wait complete. 2024-04-23T15:00:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.545+0000 7f51eb21b740 1 -- start start 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.545+0000 7f51eb21b740 1 Processor -- start 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bc6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bcd390 0x556de2bc70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01b2910 con 0x556de2bc21b0 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01b2240 con 0x556de2bc2ad0 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01af4a0 con 0x556de2bcd390 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51eb21b740 10 client.0 _ll_register_callbacks cb 0x7f51e006b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40666/0 (socket says 172.21.15.7:40666) 2024-04-23T15:00:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.546+0000 7f51e5a00640 1 -- 172.21.15.7:0/3143081850 learned_addr learned my addr 172.21.15.7:0/3143081850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e6400640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bcd390 0x556de2bc70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5000640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bc6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5a00640 1 -- 172.21.15.7:0/3143081850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bcd390 msgr2=0x556de2bc70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bcd390 0x556de2bc70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5a00640 1 -- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 msgr2=0x556de2bc6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bc6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5a00640 1 -- 172.21.15.7:0/3143081850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de2907620 con 0x556de2bc21b0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51e5a00640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd5580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f51d40049d0 tx=0x7f51d40bd6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83e02645d299d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51c7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51c7400640 1 -- 172.21.15.7:0/3143081850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40db060 con 0x556de2bc21b0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51c7400640 1 -- 172.21.15.7:0/3143081850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f51d4004040 con 0x556de2bc21b0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.547+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d40f7070 con 0x556de2bc21b0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51c7400640 1 -- 172.21.15.7:0/3143081850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f51d402c040 con 0x556de2bc21b0 2024-04-23T15:00:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 10 client.16395 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556de2c431f0 con 0x556de2bc21b0 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51c7400640 1 -- 172.21.15.7:0/3143081850 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51d40f7070 con 0x556de2bc21b0 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51c7400640 1 -- 172.21.15.7:0/3143081850 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f51d404d030 con 0x556de2bc21b0 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 10 client.16395 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 20 client.16395 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2c43740 0x556de2c45b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 4 client.16395 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.548+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556de2b30190 con 0x556de2c43740 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.549+0000 7f51e5000640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2c43740 0x556de2c45b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.550+0000 7f51e5000640 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2c43740 0x556de2c45b60 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ded0fa7d589ce80 server_cookie=b9c9b6356c8ed7ba in_seq=0 out_seq=0 2024-04-23T15:00:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.550+0000 7f51c7400640 10 client.16395 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.577+0000 7f51c7400640 1 -- 172.21.15.7:0/3143081850 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556de2b30190 con 0x556de2c43740 2024-04-23T15:00:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.577+0000 7f51c7400640 10 client.16395 handle_command_reply: tid=0 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.577+0000 7f51eb21b740 1 client.16395 shutdown 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.577+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 msgr2=0x556de2bd5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.577+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd5580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f51d40049d0 tx=0x7f51d40bd6b0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 shutdown_connections 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556de2c43740 0x556de2c45b60 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556de2bc2ad0 0x556de2bc6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556de2bcd390 0x556de2bc70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 --2- 172.21.15.7:0/3143081850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556de2bc21b0 0x556de2bd5580 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 >> 172.21.15.7:0/3143081850 conn(0x556de2bbe6c0 msgr2=0x556de2bc3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51c7400640 0 client.16395 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 shutdown_connections 2024-04-23T15:00:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 1 -- 172.21.15.7:0/3143081850 wait complete. 2024-04-23T15:00:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.578+0000 7f51eb21b740 20 client.16395 trim_cache size 0 max 16384 2024-04-23T15:00:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:00:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:00:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:00:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f51c80a3dc0 msgr2=0x7f51c80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f51c80a3dc0 0x7f51c80a6280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51d8005fd0 tx=0x7f51d800b420 comp rx=0 tx=0).stop 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 msgr2=0x7f51e01a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e01a06b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f51d4005e30 tx=0x7f51d4003f90 comp rx=0 tx=0).stop 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 shutdown_connections 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f51c80a3dc0 0x7f51c80a6280 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51e0074c20 0x7f51e01a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51e010e8f0 0x7f51e019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 --2- 172.21.15.7:0/328290184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51e0074300 0x7f51e01a06b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 >> 172.21.15.7:0/328290184 conn(0x7f51e0079490 msgr2=0x7f51e00fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 shutdown_connections 2024-04-23T15:00:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:40.579+0000 7f51e8400640 1 -- 172.21.15.7:0/328290184 wait complete. 2024-04-23T15:00:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:41 smithi137 ceph-mon[31694]: pgmap v289: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:41 smithi007 ceph-mon[27906]: pgmap v289: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:42.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:41 smithi186 ceph-mon[31814]: pgmap v289: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:00:43.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:43 smithi137 ceph-mon[31694]: pgmap v290: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:00:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:43 smithi007 ceph-mon[27906]: pgmap v290: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:00:44.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:43 smithi186 ceph-mon[31814]: pgmap v290: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:00:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:45 smithi137 ceph-mon[31694]: pgmap v291: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:00:46.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:45 smithi007 ceph-mon[27906]: pgmap v291: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:00:46.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:45 smithi186 ceph-mon[31814]: pgmap v291: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:00:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:46 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:47.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:46 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:47.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:46 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:47 smithi007 ceph-mon[27906]: pgmap v292: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:00:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:47 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:47 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:47 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:00:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:47 smithi186 ceph-mon[31814]: pgmap v292: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:00:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:47 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:47 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:48.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:47 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:00:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:47 smithi137 ceph-mon[31694]: pgmap v292: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:00:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:47 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:48.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:47 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:48.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:47 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:00:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:49 smithi007 ceph-mon[27906]: pgmap v293: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:50.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:49 smithi186 ceph-mon[31814]: pgmap v293: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:49 smithi137 ceph-mon[31694]: pgmap v293: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:51 smithi007 ceph-mon[27906]: pgmap v294: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:52.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:51 smithi186 ceph-mon[31814]: pgmap v294: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:51 smithi137 ceph-mon[31694]: pgmap v294: 129 pgs: 129 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 -- 172.21.15.7:0/781325762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102a30 msgr2=0x7f2c8c106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 --2- 172.21.15.7:0/781325762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102a30 0x7f2c8c106a70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009900 tx=0x7f2c7802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 -- 172.21.15.7:0/781325762 shutdown_connections 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 --2- 172.21.15.7:0/781325762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c107150 0x7f2c8c10ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 --2- 172.21.15.7:0/781325762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102a30 0x7f2c8c106a70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 --2- 172.21.15.7:0/781325762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c102080 0x7f2c8c102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.743+0000 7f2c91200640 1 -- 172.21.15.7:0/781325762 >> 172.21.15.7:0/781325762 conn(0x7f2c8c0fd940 msgr2=0x7f2c8c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.744+0000 7f2c91200640 1 -- 172.21.15.7:0/781325762 shutdown_connections 2024-04-23T15:00:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.744+0000 7f2c91200640 1 -- 172.21.15.7:0/781325762 wait complete. 2024-04-23T15:00:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.745+0000 7f2c91200640 1 Processor -- start 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.745+0000 7f2c91200640 1 -- start start 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.745+0000 7f2c91200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 0x7f2c8c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.745+0000 7f2c91200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c107150 0x7f2c8c1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c91200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c19a6b0 0x7f2c8c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c91200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c112090 con 0x7f2c8c102080 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c91200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c111f10 con 0x7f2c8c19a6b0 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c91200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c112210 con 0x7f2c8c107150 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 0x7f2c8c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 0x7f2c8c1a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40042/0 (socket says 172.21.15.7:40042) 2024-04-23T15:00:53.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 -- 172.21.15.7:0/3439534194 learned_addr learned my addr 172.21.15.7:0/3439534194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c107150 0x7f2c8c1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 -- 172.21.15.7:0/3439534194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c107150 msgr2=0x7f2c8c1a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c107150 0x7f2c8c1a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 -- 172.21.15.7:0/3439534194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c19a6b0 msgr2=0x7f2c8c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8be00640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c19a6b0 0x7f2c8c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c19a6b0 0x7f2c8c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8b400640 1 -- 172.21.15.7:0/3439534194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c19b2b0 con 0x7f2c8c102080 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.746+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c107150 0x7f2c8c1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.747+0000 7f2c8b400640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 0x7f2c8c1a05f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00ea80 tx=0x7f2c7c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.747+0000 7f2c83e00640 1 -- 172.21.15.7:0/3439534194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00ce40 con 0x7f2c8c102080 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.747+0000 7f2c83e00640 1 -- 172.21.15.7:0/3439534194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c7c005020 con 0x7f2c8c102080 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.747+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c1a7390 con 0x7f2c8c102080 2024-04-23T15:00:53.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.747+0000 7f2c83e00640 1 -- 172.21.15.7:0/3439534194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0116d0 con 0x7f2c8c102080 2024-04-23T15:00:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.747+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c1a7740 con 0x7f2c8c102080 2024-04-23T15:00:53.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.751+0000 7f2c83e00640 1 -- 172.21.15.7:0/3439534194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2c7c0051d0 con 0x7f2c8c102080 2024-04-23T15:00:53.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.751+0000 7f2c957c1740 1 Processor -- start 2024-04-23T15:00:53.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.751+0000 7f2c957c1740 1 -- start start 2024-04-23T15:00:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba7867a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba791060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba793990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c957c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557fba6ec900 con 0x557fba7915a0 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c957c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557fba692f20 con 0x557fba7863c0 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c957c1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557fba6e88c0 con 0x557fba786ce0 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c8aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba793990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c8aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba793990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40052/0 (socket says 172.21.15.7:40052) 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.752+0000 7f2c8aa00640 1 -- 172.21.15.7:0/210611212 learned_addr learned my addr 172.21.15.7:0/210611212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8b400640 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba791060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8be00640 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba7867a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8aa00640 1 -- 172.21.15.7:0/210611212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 msgr2=0x557fba791060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba791060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8aa00640 1 -- 172.21.15.7:0/210611212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 msgr2=0x557fba7867a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba7867a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8aa00640 1 -- 172.21.15.7:0/210611212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fba6b7e10 con 0x557fba7915a0 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c83e00640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2c700a3d10 0x7f2c700a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba793990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2c78006010 tx=0x7f2c78032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdabb5da51b4c41e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.753+0000 7f2c83e00640 1 -- 172.21.15.7:0/3439534194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f2c7c0d0fb0 con 0x7f2c8c102080 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.754+0000 7f2c8be00640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2c700a3d10 0x7f2c700a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.754+0000 7f2c80c00640 1 -- 172.21.15.7:0/210611212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7803f070 con 0x557fba7915a0 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.754+0000 7f2c80c00640 1 -- 172.21.15.7:0/210611212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c780316a0 con 0x557fba7915a0 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.754+0000 7f2c80c00640 1 -- 172.21.15.7:0/210611212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78035070 con 0x557fba7915a0 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 -- 172.21.15.7:0/210611212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 msgr2=0x557fba793990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c8be00640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2c700a3d10 0x7f2c700a61d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c84005e00 tx=0x7f2c84005c70 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba793990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2c78006010 tx=0x7f2c78032cc0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 -- 172.21.15.7:0/210611212 shutdown_connections 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba793990 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba791060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 --2- 172.21.15.7:0/210611212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba7867a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 -- 172.21.15.7:0/210611212 >> 172.21.15.7:0/210611212 conn(0x557fba7828d0 msgr2=0x557fba782cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 -- 172.21.15.7:0/210611212 shutdown_connections 2024-04-23T15:00:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.755+0000 7f2c957c1740 1 -- 172.21.15.7:0/210611212 wait complete. 2024-04-23T15:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 -- start start 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 Processor -- start 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba78e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7915a0 0x557fba78f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557fba794020 con 0x557fba7863c0 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557fba6a62c0 con 0x557fba7915a0 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557fba7941a0 con 0x557fba786ce0 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.756+0000 7f2c957c1740 10 client.0 _ll_register_callbacks cb 0x557fba3fea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba78e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba78e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40068/0 (socket says 172.21.15.7:40068) 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 -- 172.21.15.7:0/2555367694 learned_addr learned my addr 172.21.15.7:0/2555367694 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8be00640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7915a0 0x557fba78f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 -- 172.21.15.7:0/2555367694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 msgr2=0x557fba78eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 -- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7915a0 msgr2=0x557fba78f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7915a0 0x557fba78f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8b400640 1 -- 172.21.15.7:0/2555367694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fba6b6fd0 con 0x557fba7863c0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.757+0000 7f2c8be00640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7915a0 0x557fba78f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c8b400640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba78e5b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c098fa0 tx=0x7f2c7c09c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e9c718c2787007 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c75600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c75600640 1 -- 172.21.15.7:0/2555367694 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c01f040 con 0x557fba7863c0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c75600640 1 -- 172.21.15.7:0/2555367694 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f2c7c0ce570 con 0x557fba7863c0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c780316a0 con 0x557fba7863c0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c75600640 1 -- 172.21.15.7:0/2555367694 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2c7c0ce770 con 0x557fba7863c0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c957c1740 10 client.16407 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557fba3ff210 con 0x557fba7863c0 2024-04-23T15:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.758+0000 7f2c75600640 1 -- 172.21.15.7:0/2555367694 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c780316a0 con 0x557fba7863c0 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c75600640 1 -- 172.21.15.7:0/2555367694 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2c7c00f040 con 0x557fba7863c0 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c957c1740 10 client.16407 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c957c1740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c957c1740 20 client.16407 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba7a17e0 0x557fba7a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c957c1740 4 client.16407 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fba6fa320 con 0x557fba7a17e0 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.759+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba7a17e0 0x557fba7a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.761+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba7a17e0 0x557fba7a3bd0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ebbe10ba6a1693 server_cookie=a1e67aa93d66a31c in_seq=0 out_seq=0 2024-04-23T15:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.761+0000 7f2c75600640 10 client.16407 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c75600640 1 -- 172.21.15.7:0/2555367694 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557fba6fa320 con 0x557fba7a17e0 2024-04-23T15:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c75600640 10 client.16407 handle_command_reply: tid=0 2024-04-23T15:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 client.16407 shutdown 2024-04-23T15:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 msgr2=0x557fba78e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba78e5b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c098fa0 tx=0x7f2c7c09c4a0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 shutdown_connections 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba7a17e0 0x557fba7a3bd0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7915a0 0x557fba78f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2555367694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba78e5b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c75600640 0 client.16407 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 >> 172.21.15.7:0/2555367694 conn(0x557fba7828d0 msgr2=0x557fba788600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 shutdown_connections 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.766+0000 7f2c957c1740 1 -- 172.21.15.7:0/2555367694 wait complete. 2024-04-23T15:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.767+0000 7f2c957c1740 20 client.16407 trim_cache size 0 max 16384 2024-04-23T15:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.786+0000 7f2c957c1740 1 Processor -- start 2024-04-23T15:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.786+0000 7f2c957c1740 1 -- start start 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.786+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba79d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba786ce0 0x557fba788d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba7915a0 0x557fba781910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c957c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b1490 con 0x557fba7863c0 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c957c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b2fd0 con 0x557fba786ce0 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c957c1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b1b60 con 0x557fba7915a0 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba79d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba79d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40074/0 (socket says 172.21.15.7:40074) 2024-04-23T15:00:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c8b400640 1 -- 172.21.15.7:0/371889556 learned_addr learned my addr 172.21.15.7:0/371889556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba786ce0 0x557fba788d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.787+0000 7f2c8be00640 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba7915a0 0x557fba781910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8b400640 1 -- 172.21.15.7:0/371889556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba7915a0 msgr2=0x557fba781910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8b400640 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba7915a0 0x557fba781910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8b400640 1 -- 172.21.15.7:0/371889556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba786ce0 msgr2=0x557fba788d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8b400640 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba786ce0 0x557fba788d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8b400640 1 -- 172.21.15.7:0/371889556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fba4cb620 con 0x557fba7863c0 2024-04-23T15:00:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8be00640 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba7915a0 0x557fba781910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c8b400640 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba79d080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00efd0 tx=0x7f2c7c09ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6556ba142c4bb5f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c77e00640 1 -- 172.21.15.7:0/371889556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0d4070 con 0x557fba7863c0 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c77e00640 1 -- 172.21.15.7:0/371889556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c7c0a0ef0 con 0x557fba7863c0 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.788+0000 7f2c77e00640 1 -- 172.21.15.7:0/371889556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c098ba0 con 0x557fba7863c0 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 -- 172.21.15.7:0/371889556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 msgr2=0x557fba79d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba79d080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00efd0 tx=0x7f2c7c09ccc0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 -- 172.21.15.7:0/371889556 shutdown_connections 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba786ce0 0x557fba788d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba7915a0 0x557fba781910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 --2- 172.21.15.7:0/371889556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7863c0 0x557fba79d080 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.789+0000 7f2c957c1740 1 -- 172.21.15.7:0/371889556 >> 172.21.15.7:0/371889556 conn(0x557fba7828d0 msgr2=0x557fba781200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.790+0000 7f2c957c1740 1 -- 172.21.15.7:0/371889556 shutdown_connections 2024-04-23T15:00:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.790+0000 7f2c957c1740 1 -- 172.21.15.7:0/371889556 wait complete. 2024-04-23T15:00:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.790+0000 7f2c957c1740 1 -- start start 2024-04-23T15:00:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.790+0000 7f2c957c1740 1 Processor -- start 2024-04-23T15:00:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba78b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba78bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b2900 con 0x557fba7915a0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b2230 con 0x557fba7863c0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1af490 con 0x557fba786ce0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c957c1740 10 client.0 _ll_register_callbacks cb 0x7f2c7c09c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c8be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba78bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c8be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba78bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40086/0 (socket says 172.21.15.7:40086) 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.791+0000 7f2c8be00640 1 -- 172.21.15.7:0/2108614101 learned_addr learned my addr 172.21.15.7:0/2108614101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8b400640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba78b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8aa00640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8be00640 1 -- 172.21.15.7:0/2108614101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 msgr2=0x557fba78ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8be00640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8be00640 1 -- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 msgr2=0x557fba78b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:00:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8be00640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba78b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8be00640 1 -- 172.21.15.7:0/2108614101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fba806f00 con 0x557fba7915a0 2024-04-23T15:00:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c8be00640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba78bf50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2c84012780 tx=0x7f2c84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a728e680bfc91b4c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.792+0000 7f2c75600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c75600640 1 -- 172.21.15.7:0/2108614101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8402c060 con 0x557fba7915a0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c7c0a0ef0 con 0x557fba7915a0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c75600640 1 -- 172.21.15.7:0/2108614101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7f2c8401fac0 con 0x557fba7915a0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c75600640 1 -- 172.21.15.7:0/2108614101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2c84033050 con 0x557fba7915a0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c957c1740 10 client.16413 fetch_fsmap learned FSMap version 32 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557fba808230 con 0x557fba7915a0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.793+0000 7f2c75600640 1 -- 172.21.15.7:0/2108614101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c7c0a0ef0 con 0x557fba7915a0 2024-04-23T15:00:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c75600640 1 -- 172.21.15.7:0/2108614101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2c84026030 con 0x557fba7915a0 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c957c1740 10 client.16413 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c957c1740 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c957c1740 20 client.16413 populate_metadata read hostname 'smithi007' 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba8089b0 0x557fba80add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c957c1740 4 client.16413 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.794+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557fba6f4190 con 0x557fba8089b0 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.795+0000 7f2c8b400640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba8089b0 0x557fba80add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.795+0000 7f2c8b400640 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba8089b0 0x557fba80add0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e32d176dbe22aae server_cookie=62ca66c8211bbb64 in_seq=0 out_seq=0 2024-04-23T15:00:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.795+0000 7f2c75600640 10 client.16413 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.822+0000 7f2c75600640 1 -- 172.21.15.7:0/2108614101 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557fba6f4190 con 0x557fba8089b0 2024-04-23T15:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.822+0000 7f2c75600640 10 client.16413 handle_command_reply: tid=0 2024-04-23T15:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.822+0000 7f2c957c1740 1 client.16413 shutdown 2024-04-23T15:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 msgr2=0x557fba78bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba78bf50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2c84012780 tx=0x7f2c84004730 comp rx=0 tx=0).stop 2024-04-23T15:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 shutdown_connections 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fba8089b0 0x557fba80add0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fba7915a0 0x557fba78bf50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fba786ce0 0x557fba78ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 --2- 172.21.15.7:0/2108614101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fba7863c0 0x557fba78b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 >> 172.21.15.7:0/2108614101 conn(0x557fba7828d0 msgr2=0x557fba78e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c75600640 0 client.16413 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 shutdown_connections 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 1 -- 172.21.15.7:0/2108614101 wait complete. 2024-04-23T15:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.823+0000 7f2c957c1740 20 client.16413 trim_cache size 0 max 16384 2024-04-23T15:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.824+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2c700a3d10 msgr2=0x7f2c700a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.824+0000 7f2c91200640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2c700a3d10 0x7f2c700a61d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c84005e00 tx=0x7f2c84005c70 comp rx=0 tx=0).stop 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.824+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 msgr2=0x7f2c8c1a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.824+0000 7f2c91200640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 0x7f2c8c1a05f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00ea80 tx=0x7f2c7c00ef40 comp rx=0 tx=0).stop 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 shutdown_connections 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2c700a3d10 0x7f2c700a61d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c19a6b0 0x7f2c8c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c8c107150 0x7f2c8c1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 --2- 172.21.15.7:0/3439534194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c8c102080 0x7f2c8c1a05f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 >> 172.21.15.7:0/3439534194 conn(0x7f2c8c0fd940 msgr2=0x7f2c8c0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 shutdown_connections 2024-04-23T15:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:00:53.825+0000 7f2c91200640 1 -- 172.21.15.7:0/3439534194 wait complete. 2024-04-23T15:00:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:53 smithi007 ceph-mon[27906]: pgmap v295: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:53 smithi186 ceph-mon[31814]: pgmap v295: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:53 smithi137 ceph-mon[31694]: pgmap v295: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:55 smithi007 ceph-mon[27906]: pgmap v296: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:00:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:55 smithi186 ceph-mon[31814]: pgmap v296: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:00:56.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:55 smithi137 ceph-mon[31694]: pgmap v296: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:00:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:57 smithi007 ceph-mon[27906]: pgmap v297: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:57 smithi186 ceph-mon[31814]: pgmap v297: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:00:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:57 smithi137 ceph-mon[31694]: pgmap v297: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:00:59 smithi007 ceph-mon[27906]: pgmap v298: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:01:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:00:59 smithi186 ceph-mon[31814]: pgmap v298: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:01:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:00:59 smithi137 ceph-mon[31694]: pgmap v298: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:01:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:01 smithi137 ceph-mon[31694]: pgmap v299: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:01:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:01 smithi007 ceph-mon[27906]: pgmap v299: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:01:02.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:01 smithi186 ceph-mon[31814]: pgmap v299: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:01:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:02 smithi007 ceph-mon[27906]: pgmap v300: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-04-23T15:01:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:02 smithi186 ceph-mon[31814]: pgmap v300: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-04-23T15:01:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:02 smithi137 ceph-mon[31694]: pgmap v300: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-04-23T15:01:05.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:05 smithi007 ceph-mon[27906]: pgmap v301: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 30 op/s 2024-04-23T15:01:05.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:05 smithi186 ceph-mon[31814]: pgmap v301: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 30 op/s 2024-04-23T15:01:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:05 smithi137 ceph-mon[31694]: pgmap v301: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 30 op/s 2024-04-23T15:01:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 -- 172.21.15.7:0/2514995431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102a30 msgr2=0x7fbcdc106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 --2- 172.21.15.7:0/2514995431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102a30 0x7fbcdc106a70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009900 tx=0x7fbcc802a410 comp rx=0 tx=0).stop 2024-04-23T15:01:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 -- 172.21.15.7:0/2514995431 shutdown_connections 2024-04-23T15:01:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 --2- 172.21.15.7:0/2514995431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcdc107150 0x7fbcdc10ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 --2- 172.21.15.7:0/2514995431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102a30 0x7fbcdc106a70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 --2- 172.21.15.7:0/2514995431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc102080 0x7fbcdc102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 -- 172.21.15.7:0/2514995431 >> 172.21.15.7:0/2514995431 conn(0x7fbcdc0fd940 msgr2=0x7fbcdc0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 -- 172.21.15.7:0/2514995431 shutdown_connections 2024-04-23T15:01:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.984+0000 7fbce1c00640 1 -- 172.21.15.7:0/2514995431 wait complete. 2024-04-23T15:01:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.985+0000 7fbce1c00640 1 Processor -- start 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.985+0000 7fbce1c00640 1 -- start start 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.985+0000 7fbce1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 0x7fbcdc1a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbce1c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcdc107150 0x7fbcdc1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbce1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc19a620 0x7fbcdc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbce1c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1120c0 con 0x7fbcdc102080 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbce1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc111f40 con 0x7fbcdc19a620 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbce1c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc112240 con 0x7fbcdc107150 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 0x7fbcdc1a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 0x7fbcdc1a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41898/0 (socket says 172.21.15.7:41898) 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 -- 172.21.15.7:0/1868539065 learned_addr learned my addr 172.21.15.7:0/1868539065 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbce1200640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc19a620 0x7fbcdc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdb400640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcdc107150 0x7fbcdc1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 -- 172.21.15.7:0/1868539065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcdc107150 msgr2=0x7fbcdc1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcdc107150 0x7fbcdc1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 -- 172.21.15.7:0/1868539065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc19a620 msgr2=0x7fbcdc19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc19a620 0x7fbcdc19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.986+0000 7fbcdbe00640 1 -- 172.21.15.7:0/1868539065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc19b140 con 0x7fbcdc102080 2024-04-23T15:01:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.987+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 0x7fbcdc1a0470 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00d950 tx=0x7fbccc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.987+0000 7fbcd8c00640 1 -- 172.21.15.7:0/1868539065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc017070 con 0x7fbcdc102080 2024-04-23T15:01:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.987+0000 7fbcd8c00640 1 -- 172.21.15.7:0/1868539065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbccc009c30 con 0x7fbcdc102080 2024-04-23T15:01:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.987+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc19b430 con 0x7fbcdc102080 2024-04-23T15:01:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.987+0000 7fbcd8c00640 1 -- 172.21.15.7:0/1868539065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00f620 con 0x7fbcdc102080 2024-04-23T15:01:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.987+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc1a7680 con 0x7fbcdc102080 2024-04-23T15:01:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.992+0000 7fbce61cb740 1 Processor -- start 2024-04-23T15:01:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.992+0000 7fbce61cb740 1 -- start start 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.992+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c33c0 0x5617b50c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50c3ce0 0x5617b50ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 0x5617b50d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbce61cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617b5029900 con 0x5617b50ce5a0 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbce61cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5617b4fcff20 con 0x5617b50c3ce0 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbce61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5617b50258c0 con 0x5617b50c33c0 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbcd8c00640 1 -- 172.21.15.7:0/1868539065 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbccc0109a0 con 0x7fbcdc102080 2024-04-23T15:01:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbcdb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 0x5617b50d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbcdb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 0x5617b50d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41912/0 (socket says 172.21.15.7:41912) 2024-04-23T15:01:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbcdb400640 1 -- 172.21.15.7:0/3492380640 learned_addr learned my addr 172.21.15.7:0/3492380640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbce1200640 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c33c0 0x5617b50c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50c3ce0 0x5617b50ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.993+0000 7fbcdb400640 1 -- 172.21.15.7:0/3492380640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c33c0 msgr2=0x5617b50c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcdb400640 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c33c0 0x5617b50c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcdb400640 1 -- 172.21.15.7:0/3492380640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50c3ce0 msgr2=0x5617b50ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcdb400640 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50c3ce0 0x5617b50ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcdb400640 1 -- 172.21.15.7:0/3492380640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b4ff4e10 con 0x5617b50ce5a0 2024-04-23T15:01:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50c3ce0 0x5617b50ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcdb400640 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 0x5617b50d0990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8031440 tx=0x7fbcc8004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4fbf4b91f190b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcd1600640 1 -- 172.21.15.7:0/3492380640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8035030 con 0x5617b50ce5a0 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcd1600640 1 -- 172.21.15.7:0/3492380640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc80054f0 con 0x5617b50ce5a0 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.994+0000 7fbcd1600640 1 -- 172.21.15.7:0/3492380640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80035f0 con 0x5617b50ce5a0 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.995+0000 7fbcd8c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbcc00a3d10 0x7fbcc00a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.995+0000 7fbcd8c00640 1 -- 172.21.15.7:0/1868539065 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7fbccc0d0900 con 0x7fbcdc102080 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.995+0000 7fbce1200640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbcc00a3d10 0x7fbcc00a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.995+0000 7fbce61cb740 1 -- 172.21.15.7:0/3492380640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 msgr2=0x5617b50d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.995+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 0x5617b50d0990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8031440 tx=0x7fbcc8004160 comp rx=0 tx=0).stop 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 -- 172.21.15.7:0/3492380640 shutdown_connections 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50c3ce0 0x5617b50ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50ce5a0 0x5617b50d0990 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3492380640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c33c0 0x5617b50c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 -- 172.21.15.7:0/3492380640 >> 172.21.15.7:0/3492380640 conn(0x5617b50bf8d0 msgr2=0x5617b50bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 -- 172.21.15.7:0/3492380640 shutdown_connections 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce61cb740 1 -- 172.21.15.7:0/3492380640 wait complete. 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.996+0000 7fbce1200640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbcc00a3d10 0x7fbcc00a61d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005ee0 tx=0x7fbcd4009280 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 -- start start 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 Processor -- start 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617b50d1020 con 0x5617b50c33c0 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.997+0000 7fbce61cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5617b4fe32c0 con 0x5617b50ce5a0 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbce61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5617b50d11a0 con 0x5617b50c3ce0 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbce61cb740 10 client.0 _ll_register_callbacks cb 0x5617b4d3ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41924/0 (socket says 172.21.15.7:41924) 2024-04-23T15:01:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 -- 172.21.15.7:0/4222472071 learned_addr learned my addr 172.21.15.7:0/4222472071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbce1200640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdb400640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 -- 172.21.15.7:0/4222472071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 msgr2=0x5617b50cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 -- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 msgr2=0x5617b50cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.998+0000 7fbcdbe00640 1 -- 172.21.15.7:0/4222472071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b4ff3fd0 con 0x5617b50c33c0 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50cb5a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbccc09c190 tx=0x7fbccc09bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b56ffd46c111537 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbcc6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbcc6000640 1 -- 172.21.15.7:0/4222472071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc020070 con 0x5617b50c33c0 2024-04-23T15:01:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbcc6000640 1 -- 172.21.15.7:0/4222472071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7fbccc09b8e0 con 0x5617b50c33c0 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc80054f0 con 0x5617b50c33c0 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbcc6000640 1 -- 172.21.15.7:0/4222472071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbccc0ce0c0 con 0x5617b50c33c0 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbce61cb740 10 client.16425 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:06.999+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5617b4d3c210 con 0x5617b50c33c0 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbcc6000640 1 -- 172.21.15.7:0/4222472071 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc80054f0 con 0x5617b50c33c0 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbcc6000640 1 -- 172.21.15.7:0/4222472071 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbccc010460 con 0x5617b50c33c0 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbce61cb740 10 client.16425 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbce61cb740 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbce61cb740 20 client.16425 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbce61cb740 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b50de650 0x5617b50e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbce61cb740 4 client.16425 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.000+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617b5037320 con 0x5617b50de650 2024-04-23T15:01:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.001+0000 7fbcdb400640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b50de650 0x5617b50e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.002+0000 7fbcdb400640 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b50de650 0x5617b50e0aa0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb75c41813784b9 server_cookie=c5a75a07c57537e6 in_seq=0 out_seq=0 2024-04-23T15:01:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.002+0000 7fbcc6000640 10 client.16425 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbcc6000640 1 -- 172.21.15.7:0/4222472071 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617b5037320 con 0x5617b50de650 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbcc6000640 10 client.16425 handle_command_reply: tid=0 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 client.16425 shutdown 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 msgr2=0x5617b50cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50cb5a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbccc09c190 tx=0x7fbccc09bef0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 shutdown_connections 2024-04-23T15:01:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b50de650 0x5617b50e0aa0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 --2- 172.21.15.7:0/4222472071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50cb5a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 >> 172.21.15.7:0/4222472071 conn(0x5617b50bf8d0 msgr2=0x5617b50bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbcc6000640 0 client.16425 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 shutdown_connections 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.004+0000 7fbce61cb740 1 -- 172.21.15.7:0/4222472071 wait complete. 2024-04-23T15:01:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.005+0000 7fbce61cb740 20 client.16425 trim_cache size 0 max 16384 2024-04-23T15:01:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 Processor -- start 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 -- start start 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50da030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50be910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50e6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1b1410 con 0x5617b50c33c0 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1b2f50 con 0x5617b50ce5a0 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.021+0000 7fbce61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1b1ae0 con 0x5617b50c3ce0 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50da030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41926/0 (socket says 172.21.15.7:41926) 2024-04-23T15:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 -- 172.21.15.7:0/715980463 learned_addr learned my addr 172.21.15.7:0/715980463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdb400640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbce1200640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 -- 172.21.15.7:0/715980463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 msgr2=0x5617b50be910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50be910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 -- 172.21.15.7:0/715980463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 msgr2=0x5617b50e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50e6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdbe00640 1 -- 172.21.15.7:0/715980463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b50c3b10 con 0x5617b50c33c0 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbce1200640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.022+0000 7fbcdb400640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50be910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.023+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50da030 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0d0cc0 tx=0x7fbccc09ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9732c5f9affe8ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.023+0000 7fbcd0c00640 1 -- 172.21.15.7:0/715980463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc09c490 con 0x5617b50c33c0 2024-04-23T15:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.023+0000 7fbcd0c00640 1 -- 172.21.15.7:0/715980463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbccc0ba020 con 0x5617b50c33c0 2024-04-23T15:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.023+0000 7fbcd0c00640 1 -- 172.21.15.7:0/715980463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0bb270 con 0x5617b50c33c0 2024-04-23T15:01:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 -- 172.21.15.7:0/715980463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 msgr2=0x5617b50da030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50da030 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0d0cc0 tx=0x7fbccc09ccd0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 -- 172.21.15.7:0/715980463 shutdown_connections 2024-04-23T15:01:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50be910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 --2- 172.21.15.7:0/715980463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50da030 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 -- 172.21.15.7:0/715980463 >> 172.21.15.7:0/715980463 conn(0x5617b50bf8d0 msgr2=0x5617b50be200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 -- 172.21.15.7:0/715980463 shutdown_connections 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 -- 172.21.15.7:0/715980463 wait complete. 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.024+0000 7fbce61cb740 1 -- start start 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 Processor -- start 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1b2880 con 0x5617b50c33c0 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1b21b0 con 0x5617b50ce5a0 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1af410 con 0x5617b50c3ce0 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbce61cb740 10 client.0 _ll_register_callbacks cb 0x7fbccc00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbcdbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50d6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41932/0 (socket says 172.21.15.7:41932) 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.025+0000 7fbcdbe00640 1 -- 172.21.15.7:0/3596731772 learned_addr learned my addr 172.21.15.7:0/3596731772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdb400640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbce1200640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdbe00640 1 -- 172.21.15.7:0/3596731772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 msgr2=0x5617b50d6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50d6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdbe00640 1 -- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 msgr2=0x5617b50c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdbe00640 1 -- 172.21.15.7:0/3596731772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b4e08620 con 0x5617b50c33c0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbce1200640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcdbe00640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50d6540 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bfa0 tx=0x7fbccc0106f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b50c126b8313522 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcc6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.026+0000 7fbcc6000640 1 -- 172.21.15.7:0/3596731772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc066060 con 0x5617b50c33c0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbcc6000640 1 -- 172.21.15.7:0/3596731772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9467+0+0 (secure 0 0 0) 0x7fbccc0cdec0 con 0x5617b50c33c0 2024-04-23T15:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbccc0ba020 con 0x5617b50c33c0 2024-04-23T15:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbcc6000640 1 -- 172.21.15.7:0/3596731772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbccc0ce0c0 con 0x5617b50c33c0 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 10 client.16431 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5617b4e08620 con 0x5617b50c33c0 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbcc6000640 1 -- 172.21.15.7:0/3596731772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbccc0ba020 con 0x5617b50c33c0 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbcc6000640 1 -- 172.21.15.7:0/3596731772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbccc0981e0 con 0x5617b50c33c0 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 10 client.16431 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 20 client.16431 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b5144850 0x5617b5146c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 4 client.16431 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.027+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617b5031190 con 0x5617b5144850 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.028+0000 7fbcdb400640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b5144850 0x5617b5146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.029+0000 7fbcdb400640 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b5144850 0x5617b5146c70 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a2aa2352182251 server_cookie=9fa45e48c1c50b66 in_seq=0 out_seq=0 2024-04-23T15:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.029+0000 7fbcc6000640 10 client.16431 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbcc6000640 1 -- 172.21.15.7:0/3596731772 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617b5031190 con 0x5617b5144850 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbcc6000640 10 client.16431 handle_command_reply: tid=0 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 client.16431 shutdown 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 msgr2=0x5617b50d6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50d6540 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bfa0 tx=0x7fbccc0106f0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 shutdown_connections 2024-04-23T15:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617b5144850 0x5617b5146c70 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617b50ce5a0 0x5617b50c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617b50c3ce0 0x5617b50d6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 --2- 172.21.15.7:0/3596731772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617b50c33c0 0x5617b50d6540 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbcc6000640 0 client.16431 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.058+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 >> 172.21.15.7:0/3596731772 conn(0x5617b50bf8d0 msgr2=0x5617b50cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.059+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 shutdown_connections 2024-04-23T15:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.059+0000 7fbce61cb740 1 -- 172.21.15.7:0/3596731772 wait complete. 2024-04-23T15:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.059+0000 7fbce61cb740 20 client.16431 trim_cache size 0 max 16384 2024-04-23T15:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbcc00a3d10 msgr2=0x7fbcc00a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbcc00a3d10 0x7fbcc00a61d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005ee0 tx=0x7fbcd4009280 comp rx=0 tx=0).stop 2024-04-23T15:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 msgr2=0x7fbcdc1a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 0x7fbcdc1a0470 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00d950 tx=0x7fbccc00de10 comp rx=0 tx=0).stop 2024-04-23T15:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 shutdown_connections 2024-04-23T15:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbcc00a3d10 0x7fbcc00a61d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc19a620 0x7fbcdc19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcdc107150 0x7fbcdc1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 --2- 172.21.15.7:0/1868539065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcdc102080 0x7fbcdc1a0470 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 >> 172.21.15.7:0/1868539065 conn(0x7fbcdc0fd940 msgr2=0x7fbcdc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 shutdown_connections 2024-04-23T15:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:07.060+0000 7fbce1c00640 1 -- 172.21.15.7:0/1868539065 wait complete. 2024-04-23T15:01:07.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:07 smithi007 ceph-mon[27906]: pgmap v302: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:01:07.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:07 smithi186 ceph-mon[31814]: pgmap v302: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:01:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:07 smithi137 ceph-mon[31694]: pgmap v302: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:01:08.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:08 smithi007 ceph-mon[27906]: osdmap e101: 12 total, 12 up, 12 in 2024-04-23T15:01:08.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:08 smithi186 ceph-mon[31814]: osdmap e101: 12 total, 12 up, 12 in 2024-04-23T15:01:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:08 smithi137 ceph-mon[31694]: osdmap e101: 12 total, 12 up, 12 in 2024-04-23T15:01:09.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:09 smithi007 ceph-mon[27906]: pgmap v304: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:01:09.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:09 smithi186 ceph-mon[31814]: pgmap v304: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:01:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:09 smithi137 ceph-mon[31694]: pgmap v304: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:01:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:11 smithi137 ceph-mon[31694]: pgmap v305: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:01:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:11 smithi007 ceph-mon[27906]: pgmap v305: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:01:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:11 smithi186 ceph-mon[31814]: pgmap v305: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:01:13.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:13 smithi137 ceph-mon[31694]: pgmap v306: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:01:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:13 smithi007 ceph-mon[27906]: pgmap v306: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:01:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:13 smithi186 ceph-mon[31814]: pgmap v306: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:01:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:15 smithi137 ceph-mon[31694]: pgmap v307: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:01:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:15 smithi137 ceph-mon[31694]: osdmap e102: 12 total, 12 up, 12 in 2024-04-23T15:01:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:15 smithi007 ceph-mon[27906]: pgmap v307: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:01:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:15 smithi007 ceph-mon[27906]: osdmap e102: 12 total, 12 up, 12 in 2024-04-23T15:01:16.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:15 smithi186 ceph-mon[31814]: pgmap v307: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:01:16.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:15 smithi186 ceph-mon[31814]: osdmap e102: 12 total, 12 up, 12 in 2024-04-23T15:01:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:17 smithi137 ceph-mon[31694]: pgmap v309: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:01:18.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:17 smithi007 ceph-mon[27906]: pgmap v309: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:01:18.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:17 smithi186 ceph-mon[31814]: pgmap v309: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:01:19.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:19 smithi007 ceph-mon[27906]: pgmap v310: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:01:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:19 smithi137 ceph-mon[31694]: pgmap v310: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:01:20.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:19 smithi186 ceph-mon[31814]: pgmap v310: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.211+0000 7f807ac00640 1 -- 172.21.15.7:0/2376825705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80740743d0 msgr2=0x7f80740747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.211+0000 7f807ac00640 1 --2- 172.21.15.7:0/2376825705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80740743d0 0x7f80740747b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8068009900 tx=0x7f806802a480 comp rx=0 tx=0).stop 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 -- 172.21.15.7:0/2376825705 shutdown_connections 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 --2- 172.21.15.7:0/2376825705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f807410e6c0 0x7f8074110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 --2- 172.21.15.7:0/2376825705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8074074cf0 0x7f807410e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 --2- 172.21.15.7:0/2376825705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80740743d0 0x7f80740747b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 -- 172.21.15.7:0/2376825705 >> 172.21.15.7:0/2376825705 conn(0x7f80740fd950 msgr2=0x7f80740ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 -- 172.21.15.7:0/2376825705 shutdown_connections 2024-04-23T15:01:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.212+0000 7f807ac00640 1 -- 172.21.15.7:0/2376825705 wait complete. 2024-04-23T15:01:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 Processor -- start 2024-04-23T15:01:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 -- start start 2024-04-23T15:01:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80740743d0 0x7f80741a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 0x7f80741a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f807410e6c0 0x7f807419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8074114330 con 0x7f8074074cf0 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80741141b0 con 0x7f80740743d0 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.213+0000 7f807ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f80741144b0 con 0x7f807410e6c0 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 0x7f80741a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 0x7f80741a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55668/0 (socket says 172.21.15.7:55668) 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 -- 172.21.15.7:0/631107149 learned_addr learned my addr 172.21.15.7:0/631107149 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8079800640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80740743d0 0x7f80741a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f807a200640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f807410e6c0 0x7f807419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 -- 172.21.15.7:0/631107149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f807410e6c0 msgr2=0x7f807419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f807410e6c0 0x7f807419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 -- 172.21.15.7:0/631107149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80740743d0 msgr2=0x7f80741a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80740743d0 0x7f80741a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.214+0000 7f8078e00640 1 -- 172.21.15.7:0/631107149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807419af70 con 0x7f8074074cf0 2024-04-23T15:01:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.215+0000 7f8078e00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 0x7f80741a0ae0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f806000d950 tx=0x7f806000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.215+0000 7f8072000640 1 -- 172.21.15.7:0/631107149 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060017070 con 0x7f8074074cf0 2024-04-23T15:01:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.215+0000 7f8072000640 1 -- 172.21.15.7:0/631107149 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8060009c30 con 0x7f8074074cf0 2024-04-23T15:01:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.215+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807419b260 con 0x7f8074074cf0 2024-04-23T15:01:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.215+0000 7f8072000640 1 -- 172.21.15.7:0/631107149 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806000f620 con 0x7f8074074cf0 2024-04-23T15:01:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.215+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80741a7520 con 0x7f8074074cf0 2024-04-23T15:01:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.218+0000 7f807f013740 1 Processor -- start 2024-04-23T15:01:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 -- start start 2024-04-23T15:01:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec30ce0 0x56538ec3b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec3d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56538eb96900 con 0x56538ec303c0 2024-04-23T15:01:20.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56538eb3cf20 con 0x56538ec30ce0 2024-04-23T15:01:20.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.219+0000 7f807f013740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56538eb928c0 con 0x56538ec3b5a0 2024-04-23T15:01:20.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55676/0 (socket says 172.21.15.7:55676) 2024-04-23T15:01:20.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 -- 172.21.15.7:0/4125292465 learned_addr learned my addr 172.21.15.7:0/4125292465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f8072000640 1 -- 172.21.15.7:0/631107149 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f80600109a0 con 0x7f8074074cf0 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f8079800640 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec30ce0 0x56538ec3b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 -- 172.21.15.7:0/4125292465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 msgr2=0x56538ec3d990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec3d990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 -- 172.21.15.7:0/4125292465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec30ce0 msgr2=0x56538ec3b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec30ce0 0x56538ec3b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.220+0000 7f807a200640 1 -- 172.21.15.7:0/4125292465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56538eb61e10 con 0x56538ec303c0 2024-04-23T15:01:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.221+0000 7f807a200640 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec307a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f806c008cd0 tx=0x7f806c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d985e8d266f346b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.221+0000 7f8066a00640 1 -- 172.21.15.7:0/4125292465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c018680 con 0x56538ec303c0 2024-04-23T15:01:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.221+0000 7f8066a00640 1 -- 172.21.15.7:0/4125292465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f806c018cd0 con 0x56538ec303c0 2024-04-23T15:01:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.221+0000 7f8066a00640 1 -- 172.21.15.7:0/4125292465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c00fd90 con 0x56538ec303c0 2024-04-23T15:01:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f8072000640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f805c0a3d10 0x7f805c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 -- 172.21.15.7:0/4125292465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 msgr2=0x56538ec307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec307a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f806c008cd0 tx=0x7f806c00d710 comp rx=0 tx=0).stop 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f8072000640 1 -- 172.21.15.7:0/631107149 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f80600d08c0 con 0x7f8074074cf0 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 -- 172.21.15.7:0/4125292465 shutdown_connections 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f8079800640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f805c0a3d10 0x7f805c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec30ce0 0x56538ec3b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec3d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 --2- 172.21.15.7:0/4125292465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec307a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.222+0000 7f807f013740 1 -- 172.21.15.7:0/4125292465 >> 172.21.15.7:0/4125292465 conn(0x56538ec2c8d0 msgr2=0x56538ec2ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.223+0000 7f807f013740 1 -- 172.21.15.7:0/4125292465 shutdown_connections 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.223+0000 7f807f013740 1 -- 172.21.15.7:0/4125292465 wait complete. 2024-04-23T15:01:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.223+0000 7f807f013740 1 -- start start 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.223+0000 7f8079800640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f805c0a3d10 0x7f805c0a61d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8068000c00 tx=0x7f8068031400 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.223+0000 7f807f013740 1 Processor -- start 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec38600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec38b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec3b5a0 0x56538ec39080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56538ec3e170 con 0x56538ec303c0 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56538eb502c0 con 0x56538ec3b5a0 2024-04-23T15:01:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56538ec3e2f0 con 0x56538ec30ce0 2024-04-23T15:01:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f807f013740 10 client.0 _ll_register_callbacks cb 0x56538e8a8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f8079800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec38600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f8079800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec38600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55684/0 (socket says 172.21.15.7:55684) 2024-04-23T15:01:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.224+0000 7f8079800640 1 -- 172.21.15.7:0/210032431 learned_addr learned my addr 172.21.15.7:0/210032431 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f8078e00640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec38b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f807a200640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec3b5a0 0x56538ec39080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f8079800640 1 -- 172.21.15.7:0/210032431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 msgr2=0x56538ec38b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f8079800640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec38b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f8079800640 1 -- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec3b5a0 msgr2=0x56538ec39080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f8079800640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec3b5a0 0x56538ec39080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.225+0000 7f8079800640 1 -- 172.21.15.7:0/210032431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56538eb60fd0 con 0x56538ec303c0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.226+0000 7f8079800640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec38600 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8068033000 tx=0x7f8068009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca63c0d30c851615 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.226+0000 7f805b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.226+0000 7f805b400640 1 -- 172.21.15.7:0/210032431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806804c070 con 0x56538ec303c0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.226+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f806c018cd0 con 0x56538ec303c0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.226+0000 7f805b400640 1 -- 172.21.15.7:0/210032431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f80680037f0 con 0x56538ec303c0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f805b400640 1 -- 172.21.15.7:0/210032431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8068035050 con 0x56538ec303c0 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 10 client.16443 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:20.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56538e8a9210 con 0x56538ec303c0 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f805b400640 1 -- 172.21.15.7:0/210032431 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8068058070 con 0x56538ec303c0 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f805b400640 1 -- 172.21.15.7:0/210032431 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8068032930 con 0x56538ec303c0 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 10 client.16443 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 10 client.16443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 20 client.16443 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ec4b7b0 0x56538ec4dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 4 client.16443 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:01:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.227+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56538eba4320 con 0x56538ec4b7b0 2024-04-23T15:01:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.228+0000 7f8078e00640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ec4b7b0 0x56538ec4dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.229+0000 7f8078e00640 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ec4b7b0 0x56538ec4dba0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa78529cd920dab server_cookie=c49266373ca30b05 in_seq=0 out_seq=0 2024-04-23T15:01:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.229+0000 7f805b400640 10 client.16443 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f805b400640 1 -- 172.21.15.7:0/210032431 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56538eba4320 con 0x56538ec4b7b0 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f805b400640 10 client.16443 handle_command_reply: tid=0 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 client.16443 shutdown 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 msgr2=0x56538ec38600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec38600 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8068033000 tx=0x7f8068009260 comp rx=0 tx=0).stop 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 shutdown_connections 2024-04-23T15:01:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ec4b7b0 0x56538ec4dba0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec3b5a0 0x56538ec39080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec38b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 --2- 172.21.15.7:0/210032431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec303c0 0x56538ec38600 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 >> 172.21.15.7:0/210032431 conn(0x56538ec2c8d0 msgr2=0x56538ec32650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f805b400640 0 client.16443 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 shutdown_connections 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.231+0000 7f807f013740 1 -- 172.21.15.7:0/210032431 wait complete. 2024-04-23T15:01:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.232+0000 7f807f013740 20 client.16443 trim_cache size 0 max 16384 2024-04-23T15:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 Processor -- start 2024-04-23T15:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 -- start start 2024-04-23T15:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec36ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 0x56538ec32dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80741b14b0 con 0x56538ec30ce0 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80741b2ff0 con 0x56538ec303c0 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.251+0000 7f807f013740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f80741b1b80 con 0x56538ec3b5a0 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 0x56538ec32dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 0x56538ec32dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55686/0 (socket says 172.21.15.7:55686) 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 -- 172.21.15.7:0/1877527556 learned_addr learned my addr 172.21.15.7:0/1877527556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8079800640 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec36ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f807a200640 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 -- 172.21.15.7:0/1877527556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 msgr2=0x56538ec534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 -- 172.21.15.7:0/1877527556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 msgr2=0x56538ec36ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec36ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.252+0000 7f8078e00640 1 -- 172.21.15.7:0/1877527556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56538ec375b0 con 0x56538ec30ce0 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.253+0000 7f8078e00640 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 0x56538ec32dd0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f806009c3e0 tx=0x7f8060005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba4b98c6893455e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.253+0000 7f8066000640 1 -- 172.21.15.7:0/1877527556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060020040 con 0x56538ec30ce0 2024-04-23T15:01:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.253+0000 7f8066000640 1 -- 172.21.15.7:0/1877527556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80600a0800 con 0x56538ec30ce0 2024-04-23T15:01:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.253+0000 7f8066000640 1 -- 172.21.15.7:0/1877527556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80600a4c30 con 0x56538ec30ce0 2024-04-23T15:01:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 -- 172.21.15.7:0/1877527556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 msgr2=0x56538ec32dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 0x56538ec32dd0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f806009c3e0 tx=0x7f8060005f70 comp rx=0 tx=0).stop 2024-04-23T15:01:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 -- 172.21.15.7:0/1877527556 shutdown_connections 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec3b5a0 0x56538ec534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec30ce0 0x56538ec32dd0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 --2- 172.21.15.7:0/1877527556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec36ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 -- 172.21.15.7:0/1877527556 >> 172.21.15.7:0/1877527556 conn(0x56538ec2c8d0 msgr2=0x56538ec2ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 -- 172.21.15.7:0/1877527556 shutdown_connections 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 -- 172.21.15.7:0/1877527556 wait complete. 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.254+0000 7f807f013740 1 -- start start 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 Processor -- start 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec35810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 0x56538ec35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80741b2920 con 0x56538ec3b5a0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80741b2250 con 0x56538ec303c0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f80741af4b0 con 0x56538ec30ce0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807f013740 10 client.0 _ll_register_callbacks cb 0x7f8068009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 0x56538ec35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 0x56538ec35d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55694/0 (socket says 172.21.15.7:55694) 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.255+0000 7f807a200640 1 -- 172.21.15.7:0/2894381381 learned_addr learned my addr 172.21.15.7:0/2894381381 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f8079800640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f8078e00640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec35810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f807a200640 1 -- 172.21.15.7:0/2894381381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 msgr2=0x56538ec35810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f807a200640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec35810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f807a200640 1 -- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 msgr2=0x56538ec352d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f807a200640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec352d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f807a200640 1 -- 172.21.15.7:0/2894381381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56538e975620 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f807a200640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 0x56538ec35d50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f806c0084f0 tx=0x7f806c0049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e62f4ae6c0cebd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.256+0000 7f805b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f805b400640 1 -- 172.21.15.7:0/2894381381 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c00f9c0 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80600a0800 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f805b400640 1 -- 172.21.15.7:0/2894381381 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f806c00fb60 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f805b400640 1 -- 172.21.15.7:0/2894381381 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f806c00fd80 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f807f013740 10 client.16449 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56538ecb1dc0 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.257+0000 7f805b400640 1 -- 172.21.15.7:0/2894381381 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80600a0800 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f805b400640 1 -- 172.21.15.7:0/2894381381 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f806c005240 con 0x56538ec3b5a0 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f807f013740 10 client.16449 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f807f013740 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f807f013740 20 client.16449 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f807f013740 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ecb23a0 0x56538ecb47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f807f013740 4 client.16449 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56538eb9e190 con 0x56538ecb23a0 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.258+0000 7f8079800640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ecb23a0 0x56538ecb47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.259+0000 7f8079800640 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ecb23a0 0x56538ecb47c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c774d39f701327b0 server_cookie=2634d84915f48a97 in_seq=0 out_seq=0 2024-04-23T15:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.259+0000 7f805b400640 10 client.16449 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.294+0000 7f805b400640 1 -- 172.21.15.7:0/2894381381 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56538eb9e190 con 0x56538ecb23a0 2024-04-23T15:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.294+0000 7f805b400640 10 client.16449 handle_command_reply: tid=0 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.294+0000 7f807f013740 1 client.16449 shutdown 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.294+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 msgr2=0x56538ec35d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.294+0000 7f807f013740 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 0x56538ec35d50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f806c0084f0 tx=0x7f806c0049c0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 shutdown_connections 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56538ecb23a0 0x56538ecb47c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56538ec3b5a0 0x56538ec35d50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56538ec30ce0 0x56538ec35810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 --2- 172.21.15.7:0/2894381381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56538ec303c0 0x56538ec352d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f805b400640 0 client.16449 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 >> 172.21.15.7:0/2894381381 conn(0x56538ec2c8d0 msgr2=0x56538ec38e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 shutdown_connections 2024-04-23T15:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 1 -- 172.21.15.7:0/2894381381 wait complete. 2024-04-23T15:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.295+0000 7f807f013740 20 client.16449 trim_cache size 0 max 16384 2024-04-23T15:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f805c0a3d10 msgr2=0x7f805c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f805c0a3d10 0x7f805c0a61d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8068000c00 tx=0x7f8068031400 comp rx=0 tx=0).stop 2024-04-23T15:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 msgr2=0x7f80741a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 0x7f80741a0ae0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f806000d950 tx=0x7f806000de10 comp rx=0 tx=0).stop 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 shutdown_connections 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f805c0a3d10 0x7f805c0a61d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f807410e6c0 0x7f807419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8074074cf0 0x7f80741a0ae0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 --2- 172.21.15.7:0/631107149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80740743d0 0x7f80741a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 >> 172.21.15.7:0/631107149 conn(0x7f80740fd950 msgr2=0x7f80740fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.296+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 shutdown_connections 2024-04-23T15:01:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:20.297+0000 7f807ac00640 1 -- 172.21.15.7:0/631107149 wait complete. 2024-04-23T15:01:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:21 smithi137 ceph-mon[31694]: pgmap v311: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:01:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:21 smithi007 ceph-mon[27906]: pgmap v311: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:01:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:21 smithi186 ceph-mon[31814]: pgmap v311: 129 pgs: 129 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:01:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:23 smithi137 ceph-mon[31694]: pgmap v312: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:01:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:23 smithi007 ceph-mon[27906]: pgmap v312: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:01:24.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:23 smithi186 ceph-mon[31814]: pgmap v312: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:01:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:25 smithi137 ceph-mon[31694]: pgmap v313: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:01:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:25 smithi007 ceph-mon[27906]: pgmap v313: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:01:26.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:25 smithi186 ceph-mon[31814]: pgmap v313: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:01:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:27 smithi007 ceph-mon[27906]: pgmap v314: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:01:28.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:27 smithi186 ceph-mon[31814]: pgmap v314: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:01:28.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:27 smithi137 ceph-mon[31694]: pgmap v314: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:01:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:29 smithi007 ceph-mon[27906]: pgmap v315: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:01:30.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:29 smithi186 ceph-mon[31814]: pgmap v315: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:01:30.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:29 smithi137 ceph-mon[31694]: pgmap v315: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:01:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:31 smithi007 ceph-mon[27906]: pgmap v316: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:01:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:31 smithi186 ceph-mon[31814]: pgmap v316: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:01:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:31 smithi137 ceph-mon[31694]: pgmap v316: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.448+0000 7f70b6200640 1 -- 172.21.15.7:0/336538178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 msgr2=0x7f70b0100f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.448+0000 7f70b6200640 1 --2- 172.21.15.7:0/336538178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b0100f60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009900 tx=0x7f70a402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 -- 172.21.15.7:0/336538178 shutdown_connections 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 --2- 172.21.15.7:0/336538178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101530 0x7f70b010e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 --2- 172.21.15.7:0/336538178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70b010e730 0x7f70b0110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 --2- 172.21.15.7:0/336538178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b0100f60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 -- 172.21.15.7:0/336538178 >> 172.21.15.7:0/336538178 conn(0x7f70b00fc820 msgr2=0x7f70b00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 -- 172.21.15.7:0/336538178 shutdown_connections 2024-04-23T15:01:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.449+0000 7f70b6200640 1 -- 172.21.15.7:0/336538178 wait complete. 2024-04-23T15:01:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 Processor -- start 2024-04-23T15:01:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 -- start start 2024-04-23T15:01:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b01a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70b0101530 0x7f70b01a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b010e730 0x7f70b019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01142e0 con 0x7f70b0100b80 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0114160 con 0x7f70b010e730 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.450+0000 7f70b6200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0114460 con 0x7f70b0101530 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b01a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b01a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35790/0 (socket says 172.21.15.7:35790) 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 -- 172.21.15.7:0/3474996933 learned_addr learned my addr 172.21.15.7:0/3474996933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70afe00640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70b0101530 0x7f70b01a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b5800640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b010e730 0x7f70b019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 -- 172.21.15.7:0/3474996933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70b0101530 msgr2=0x7f70b01a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70b0101530 0x7f70b01a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 -- 172.21.15.7:0/3474996933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b010e730 msgr2=0x7f70b019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b010e730 0x7f70b019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b4e00640 1 -- 172.21.15.7:0/3474996933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b019af80 con 0x7f70b0100b80 2024-04-23T15:01:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.451+0000 7f70b5800640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b010e730 0x7f70b019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.452+0000 7f70b4e00640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b01a05b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005ab0 tx=0x7f70a4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.452+0000 7f70ad600640 1 -- 172.21.15.7:0/3474996933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a403f070 con 0x7f70b0100b80 2024-04-23T15:01:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.452+0000 7f70ad600640 1 -- 172.21.15.7:0/3474996933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70a4031d60 con 0x7f70b0100b80 2024-04-23T15:01:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.452+0000 7f70ad600640 1 -- 172.21.15.7:0/3474996933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4035030 con 0x7f70b0100b80 2024-04-23T15:01:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.452+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b019b210 con 0x7f70b0100b80 2024-04-23T15:01:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.452+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b01a7530 con 0x7f70b0100b80 2024-04-23T15:01:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.456+0000 7f70ad600640 1 -- 172.21.15.7:0/3474996933 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f70a4042070 con 0x7f70b0100b80 2024-04-23T15:01:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.456+0000 7f70ba63b740 1 Processor -- start 2024-04-23T15:01:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.456+0000 7f70ba63b740 1 -- start start 2024-04-23T15:01:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e411933c0 0x560e411937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 0x560e4119e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e4119e5a0 0x560e411a0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70ba63b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560e410f9900 con 0x560e41193ce0 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70ba63b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560e4109ff20 con 0x560e411933c0 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70ba63b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560e410f58c0 con 0x560e4119e5a0 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 0x560e4119e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 0x560e4119e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35806/0 (socket says 172.21.15.7:35806) 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70b4e00640 1 -- 172.21.15.7:0/2992348321 learned_addr learned my addr 172.21.15.7:0/2992348321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70b5800640 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e411933c0 0x560e411937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.457+0000 7f70afe00640 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e4119e5a0 0x560e411a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70b4e00640 1 -- 172.21.15.7:0/2992348321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e4119e5a0 msgr2=0x560e411a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70b4e00640 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e4119e5a0 0x560e411a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70b4e00640 1 -- 172.21.15.7:0/2992348321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e411933c0 msgr2=0x560e411937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70b4e00640 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e411933c0 0x560e411937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70b4e00640 1 -- 172.21.15.7:0/2992348321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e410c4e10 con 0x560e41193ce0 2024-04-23T15:01:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70ad600640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f70980a3d90 0x7f70980a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70b4e00640 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 0x560e4119e060 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ee6c0 tx=0x7f70a40f9660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20e94dbce6713f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.458+0000 7f70ad600640 1 -- 172.21.15.7:0/3474996933 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f70a40f1440 con 0x7f70b0100b80 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.459+0000 7f70b5800640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f70980a3d90 0x7f70980a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.459+0000 7f70a2000640 1 -- 172.21.15.7:0/2992348321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a40b9270 con 0x560e41193ce0 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.459+0000 7f70a2000640 1 -- 172.21.15.7:0/2992348321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70a40bd6d0 con 0x560e41193ce0 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.459+0000 7f70a2000640 1 -- 172.21.15.7:0/2992348321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a40bc930 con 0x560e41193ce0 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 -- 172.21.15.7:0/2992348321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 msgr2=0x560e4119e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 0x560e4119e060 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ee6c0 tx=0x7f70a40f9660 comp rx=0 tx=0).stop 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70b5800640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f70980a3d90 0x7f70980a6250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70b006b5e0 tx=0x7f70a8009680 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 -- 172.21.15.7:0/2992348321 shutdown_connections 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e4119e5a0 0x560e411a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e41193ce0 0x560e4119e060 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 --2- 172.21.15.7:0/2992348321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e411933c0 0x560e411937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 -- 172.21.15.7:0/2992348321 >> 172.21.15.7:0/2992348321 conn(0x560e4118f8d0 msgr2=0x560e4118fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 -- 172.21.15.7:0/2992348321 shutdown_connections 2024-04-23T15:01:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 -- 172.21.15.7:0/2992348321 wait complete. 2024-04-23T15:01:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 -- start start 2024-04-23T15:01:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.460+0000 7f70ba63b740 1 Processor -- start 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e4119b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e4119bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e4119c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560e411a0f90 con 0x560e4119e5a0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560e410b32c0 con 0x560e41193ce0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560e411a1110 con 0x560e411933c0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70ba63b740 10 client.0 _ll_register_callbacks cb 0x560e40e0ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.461+0000 7f70b5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e4119c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e4119c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35820/0 (socket says 172.21.15.7:35820) 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 -- 172.21.15.7:0/1353982440 learned_addr learned my addr 172.21.15.7:0/1353982440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b4e00640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e4119b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70afe00640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e4119bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 -- 172.21.15.7:0/1353982440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 msgr2=0x560e4119b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e4119b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 -- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 msgr2=0x560e4119bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e4119bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.462+0000 7f70b5800640 1 -- 172.21.15.7:0/1353982440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e410c3fd0 con 0x560e4119e5a0 2024-04-23T15:01:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.463+0000 7f70b5800640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e4119c000 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f70a80129f0 tx=0x7f70a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856fd397cb9c04b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.463+0000 7f7096a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.463+0000 7f7096a00640 1 -- 172.21.15.7:0/1353982440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a800fdb0 con 0x560e4119e5a0 2024-04-23T15:01:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.463+0000 7f7096a00640 1 -- 172.21.15.7:0/1353982440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f70a801f420 con 0x560e4119e5a0 2024-04-23T15:01:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.464+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a40bd6d0 con 0x560e4119e5a0 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.464+0000 7f7096a00640 1 -- 172.21.15.7:0/1353982440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f70a801f620 con 0x560e4119e5a0 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.464+0000 7f70ba63b740 10 client.16461 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.464+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560e40e0c210 con 0x560e4119e5a0 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.464+0000 7f7096a00640 1 -- 172.21.15.7:0/1353982440 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70a40bd6d0 con 0x560e4119e5a0 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f7096a00640 1 -- 172.21.15.7:0/1353982440 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f70a80317f0 con 0x560e4119e5a0 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70ba63b740 10 client.16461 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70ba63b740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70ba63b740 20 client.16461 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e411ae510 0x560e411b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70ba63b740 4 client.16461 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e41107320 con 0x560e411ae510 2024-04-23T15:01:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.465+0000 7f70b4e00640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e411ae510 0x560e411b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.466+0000 7f70b4e00640 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e411ae510 0x560e411b0900 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a6eec0106d56a1d server_cookie=9de1841189c7d0b2 in_seq=0 out_seq=0 2024-04-23T15:01:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.466+0000 7f7096a00640 10 client.16461 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.468+0000 7f7096a00640 1 -- 172.21.15.7:0/1353982440 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560e41107320 con 0x560e411ae510 2024-04-23T15:01:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.468+0000 7f7096a00640 10 client.16461 handle_command_reply: tid=0 2024-04-23T15:01:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.468+0000 7f70ba63b740 1 client.16461 shutdown 2024-04-23T15:01:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.468+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 msgr2=0x560e4119c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.468+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e4119c000 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f70a80129f0 tx=0x7f70a8004a40 comp rx=0 tx=0).stop 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 shutdown_connections 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e411ae510 0x560e411b0900 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e4119bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e4119c000 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1353982440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e4119b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f7096a00640 0 client.16461 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 >> 172.21.15.7:0/1353982440 conn(0x560e4118f8d0 msgr2=0x560e41195650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 shutdown_connections 2024-04-23T15:01:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 1 -- 172.21.15.7:0/1353982440 wait complete. 2024-04-23T15:01:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.469+0000 7f70ba63b740 20 client.16461 trim_cache size 0 max 16384 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 Processor -- start 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 -- start start 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e411a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e41195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e411b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b14e0 con 0x560e4119e5a0 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b3020 con 0x560e41193ce0 2024-04-23T15:01:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.488+0000 7f70ba63b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b1bb0 con 0x560e411933c0 2024-04-23T15:01:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e411b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e411b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35828/0 (socket says 172.21.15.7:35828) 2024-04-23T15:01:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 -- 172.21.15.7:0/1097275468 learned_addr learned my addr 172.21.15.7:0/1097275468 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b4e00640 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e411a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70afe00640 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e41195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 -- 172.21.15.7:0/1097275468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 msgr2=0x560e411a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e411a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 -- 172.21.15.7:0/1097275468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 msgr2=0x560e41195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e41195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.489+0000 7f70b5800640 1 -- 172.21.15.7:0/1097275468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4119a530 con 0x560e4119e5a0 2024-04-23T15:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.490+0000 7f70b5800640 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e411b6210 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f70a80129c0 tx=0x7f70a8005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c068eaacce6d7137 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.490+0000 7f70a1600640 1 -- 172.21.15.7:0/1097275468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8036040 con 0x560e4119e5a0 2024-04-23T15:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.490+0000 7f70a1600640 1 -- 172.21.15.7:0/1097275468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70a800f730 con 0x560e4119e5a0 2024-04-23T15:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.490+0000 7f70a1600640 1 -- 172.21.15.7:0/1097275468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a801fa20 con 0x560e4119e5a0 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 -- 172.21.15.7:0/1097275468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 msgr2=0x560e411b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e411b6210 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f70a80129c0 tx=0x7f70a8005b40 comp rx=0 tx=0).stop 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 -- 172.21.15.7:0/1097275468 shutdown_connections 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e41193ce0 0x560e41195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e4119e5a0 0x560e411b6210 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 --2- 172.21.15.7:0/1097275468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e411933c0 0x560e411a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 -- 172.21.15.7:0/1097275468 >> 172.21.15.7:0/1097275468 conn(0x560e4118f8d0 msgr2=0x560e4119bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 -- 172.21.15.7:0/1097275468 shutdown_connections 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.491+0000 7f70ba63b740 1 -- 172.21.15.7:0/1097275468 wait complete. 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 -- start start 2024-04-23T15:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 Processor -- start 2024-04-23T15:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 0x560e411a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e41193ce0 0x560e411a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e4119e5a0 0x560e411a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b2950 con 0x560e411933c0 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b2280 con 0x560e4119e5a0 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01af4e0 con 0x560e41193ce0 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.492+0000 7f70ba63b740 10 client.0 _ll_register_callbacks cb 0x7f70a80098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 0x560e411a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 0x560e411a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35830/0 (socket says 172.21.15.7:35830) 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 -- 172.21.15.7:0/4201275516 learned_addr learned my addr 172.21.15.7:0/4201275516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70afe00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e41193ce0 0x560e411a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 -- 172.21.15.7:0/4201275516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e41193ce0 msgr2=0x560e411a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b5800640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e4119e5a0 0x560e411a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e41193ce0 0x560e411a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 -- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e4119e5a0 msgr2=0x560e411a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e4119e5a0 0x560e411a3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 -- 172.21.15.7:0/4201275516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e41193b10 con 0x560e411933c0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70afe00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e41193ce0 0x560e411a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f70b4e00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 0x560e411a6430 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000c00 tx=0x7f70a4031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c715474fefa7e9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.493+0000 7f7096a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f7096a00640 1 -- 172.21.15.7:0/4201275516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4049040 con 0x560e411933c0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f7096a00640 1 -- 172.21.15.7:0/4201275516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f70a40bb070 con 0x560e411933c0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a800f730 con 0x560e411933c0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f7096a00640 1 -- 172.21.15.7:0/4201275516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f70a40bcb10 con 0x560e411933c0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f70ba63b740 10 client.16467 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560e40ed8620 con 0x560e411933c0 2024-04-23T15:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f7096a00640 1 -- 172.21.15.7:0/4201275516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70a800f730 con 0x560e411933c0 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f7096a00640 1 -- 172.21.15.7:0/4201275516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f70a40f10c0 con 0x560e411933c0 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f70ba63b740 10 client.16467 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.494+0000 7f70ba63b740 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.495+0000 7f70ba63b740 20 client.16467 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.495+0000 7f70ba63b740 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e412157d0 0x560e41217be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.495+0000 7f70ba63b740 4 client.16467 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.495+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e41101190 con 0x560e412157d0 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.495+0000 7f70afe00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e412157d0 0x560e41217be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.496+0000 7f70afe00640 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e412157d0 0x560e41217be0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=659fe88db43b51e3 server_cookie=4b9198e55954f6f4 in_seq=0 out_seq=0 2024-04-23T15:01:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.496+0000 7f7096a00640 10 client.16467 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f7096a00640 1 -- 172.21.15.7:0/4201275516 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e41101190 con 0x560e412157d0 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f7096a00640 10 client.16467 handle_command_reply: tid=0 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 client.16467 shutdown 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 msgr2=0x560e411a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 0x560e411a6430 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000c00 tx=0x7f70a4031f10 comp rx=0 tx=0).stop 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 shutdown_connections 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560e412157d0 0x560e41217be0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560e4119e5a0 0x560e411a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e41193ce0 0x560e411a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 --2- 172.21.15.7:0/4201275516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e411933c0 0x560e411a6430 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f7096a00640 0 client.16467 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.532+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 >> 172.21.15.7:0/4201275516 conn(0x560e4118f8d0 msgr2=0x560e4118e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.533+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 shutdown_connections 2024-04-23T15:01:33.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.533+0000 7f70ba63b740 1 -- 172.21.15.7:0/4201275516 wait complete. 2024-04-23T15:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.533+0000 7f70ba63b740 20 client.16467 trim_cache size 0 max 16384 2024-04-23T15:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f70980a3d90 msgr2=0x7f70980a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f70980a3d90 0x7f70980a6250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70b006b5e0 tx=0x7f70a8009680 comp rx=0 tx=0).stop 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 msgr2=0x7f70b01a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b01a05b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005ab0 tx=0x7f70a4003c80 comp rx=0 tx=0).stop 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 shutdown_connections 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f70980a3d90 0x7f70980a6250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b010e730 0x7f70b019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70b0101530 0x7f70b01a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 --2- 172.21.15.7:0/3474996933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70b0100b80 0x7f70b01a05b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 >> 172.21.15.7:0/3474996933 conn(0x7f70b00fc820 msgr2=0x7f70b00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 shutdown_connections 2024-04-23T15:01:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:33.534+0000 7f70b6200640 1 -- 172.21.15.7:0/3474996933 wait complete. 2024-04-23T15:01:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:33 smithi007 ceph-mon[27906]: pgmap v317: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:34.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:33 smithi186 ceph-mon[31814]: pgmap v317: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:34.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:33 smithi137 ceph-mon[31694]: pgmap v317: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:35 smithi007 ceph-mon[27906]: pgmap v318: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:01:36.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:35 smithi186 ceph-mon[31814]: pgmap v318: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:01:36.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:35 smithi137 ceph-mon[31694]: pgmap v318: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:01:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:37 smithi007 ceph-mon[27906]: pgmap v319: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:37 smithi186 ceph-mon[31814]: pgmap v319: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:37 smithi137 ceph-mon[31694]: pgmap v319: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:01:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:39 smithi007 ceph-mon[27906]: pgmap v320: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:01:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:39 smithi186 ceph-mon[31814]: pgmap v320: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:01:40.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:39 smithi137 ceph-mon[31694]: pgmap v320: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:01:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:41 smithi007 ceph-mon[27906]: pgmap v321: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:01:42.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:41 smithi186 ceph-mon[31814]: pgmap v321: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:01:42.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:41 smithi137 ceph-mon[31694]: pgmap v321: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:01:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:43 smithi007 ceph-mon[27906]: pgmap v322: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:01:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:43 smithi186 ceph-mon[31814]: pgmap v322: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:01:44.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:43 smithi137 ceph-mon[31694]: pgmap v322: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:01:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:45 smithi007 ceph-mon[27906]: pgmap v323: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:01:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:45 smithi186 ceph-mon[31814]: pgmap v323: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:01:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:45 smithi137 ceph-mon[31694]: pgmap v323: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:01:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 -- 172.21.15.7:0/999695700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 msgr2=0x7f245c10ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 --2- 172.21.15.7:0/999695700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c10ea70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f244c009930 tx=0x7f244c02a420 comp rx=0 tx=0).stop 2024-04-23T15:01:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 -- 172.21.15.7:0/999695700 shutdown_connections 2024-04-23T15:01:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 --2- 172.21.15.7:0/999695700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f245c1085f0 0x7f245c108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 --2- 172.21.15.7:0/999695700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f245c108fb0 0x7f245c1154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 --2- 172.21.15.7:0/999695700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c10ea70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 -- 172.21.15.7:0/999695700 >> 172.21.15.7:0/999695700 conn(0x7f245c076590 msgr2=0x7f245c0789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 -- 172.21.15.7:0/999695700 shutdown_connections 2024-04-23T15:01:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.685+0000 7f2460a00640 1 -- 172.21.15.7:0/999695700 wait complete. 2024-04-23T15:01:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.686+0000 7f2460a00640 1 Processor -- start 2024-04-23T15:01:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 -- start start 2024-04-23T15:01:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f245c1085f0 0x7f245c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f245c108fb0 0x7f245c19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c1a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f245c118910 con 0x7f245c10e690 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f245c118790 con 0x7f245c108fb0 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f2460a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f245c118a90 con 0x7f245c1085f0 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f245a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c1a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f245a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c1a35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42972/0 (socket says 172.21.15.7:42972) 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.687+0000 7f245a800640 1 -- 172.21.15.7:0/491072201 learned_addr learned my addr 172.21.15.7:0/491072201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f2459e00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f245c1085f0 0x7f245c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f2459400640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f245c108fb0 0x7f245c19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f245a800640 1 -- 172.21.15.7:0/491072201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f245c1085f0 msgr2=0x7f245c19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f245a800640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f245c1085f0 0x7f245c19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f245a800640 1 -- 172.21.15.7:0/491072201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f245c108fb0 msgr2=0x7f245c19f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f245a800640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f245c108fb0 0x7f245c19f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f245a800640 1 -- 172.21.15.7:0/491072201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c1a3d20 con 0x7f245c10e690 2024-04-23T15:01:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.688+0000 7f245a800640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c1a35f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f245400eaa0 tx=0x7f245400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.689+0000 7f2452a00640 1 -- 172.21.15.7:0/491072201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245400cdb0 con 0x7f245c10e690 2024-04-23T15:01:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.689+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c1a4010 con 0x7f245c10e690 2024-04-23T15:01:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.689+0000 7f2452a00640 1 -- 172.21.15.7:0/491072201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2454005020 con 0x7f245c10e690 2024-04-23T15:01:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.689+0000 7f2452a00640 1 -- 172.21.15.7:0/491072201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24540116d0 con 0x7f245c10e690 2024-04-23T15:01:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.689+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1ab8a0 con 0x7f245c10e690 2024-04-23T15:01:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.693+0000 7f2452a00640 1 -- 172.21.15.7:0/491072201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f24540051d0 con 0x7f245c10e690 2024-04-23T15:01:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.693+0000 7f24639bd740 1 Processor -- start 2024-04-23T15:01:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.693+0000 7f24639bd740 1 -- start start 2024-04-23T15:01:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f24639bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578273590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f24639bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f24639bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x564578280780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f24639bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645781d9900 con 0x564578273ad0 2024-04-23T15:01:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f24639bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56457817ff20 con 0x56457827e390 2024-04-23T15:01:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f24639bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5645781d58c0 con 0x5645782731b0 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f2459e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f2459e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42976/0 (socket says 172.21.15.7:42976) 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f2459e00640 1 -- 172.21.15.7:0/3165050422 learned_addr learned my addr 172.21.15.7:0/3165050422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.694+0000 7f2459400640 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578273590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459400640 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x564578280780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459e00640 1 -- 172.21.15.7:0/3165050422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 msgr2=0x564578273590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459e00640 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578273590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459e00640 1 -- 172.21.15.7:0/3165050422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 msgr2=0x564578280780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459e00640 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x564578280780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459e00640 1 -- 172.21.15.7:0/3165050422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645781a4e10 con 0x564578273ad0 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2452a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24400a3e40 0x7f24400a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2452a00640 1 -- 172.21.15.7:0/491072201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f24540d0c70 con 0x7f245c10e690 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459e00640 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827de50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f244c005ab0 tx=0x7f244c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2bb1ef0caf6aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.695+0000 7f2459400640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24400a3e40 0x7f24400a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.696+0000 7f2447000640 1 -- 172.21.15.7:0/3165050422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c035040 con 0x564578273ad0 2024-04-23T15:01:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.696+0000 7f2447000640 1 -- 172.21.15.7:0/3165050422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f244c0054f0 con 0x564578273ad0 2024-04-23T15:01:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.696+0000 7f2447000640 1 -- 172.21.15.7:0/3165050422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c003850 con 0x564578273ad0 2024-04-23T15:01:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 -- 172.21.15.7:0/3165050422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 msgr2=0x56457827de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f2459400640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24400a3e40 0x7f24400a6300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x564578270ae0 tx=0x7f244800b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827de50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f244c005ab0 tx=0x7f244c004180 comp rx=0 tx=0).stop 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 -- 172.21.15.7:0/3165050422 shutdown_connections 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x564578280780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827de50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 --2- 172.21.15.7:0/3165050422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578273590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 -- 172.21.15.7:0/3165050422 >> 172.21.15.7:0/3165050422 conn(0x56457826f6c0 msgr2=0x56457826faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 -- 172.21.15.7:0/3165050422 shutdown_connections 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 -- 172.21.15.7:0/3165050422 wait complete. 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.697+0000 7f24639bd740 1 -- start start 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 Processor -- start 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x56457827b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x56457827bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564578280f60 con 0x564578273ad0 2024-04-23T15:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5645781932c0 con 0x56457827e390 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5645782810e0 con 0x5645782731b0 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.698+0000 7f24639bd740 10 client.0 _ll_register_callbacks cb 0x564577eeba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42992/0 (socket says 172.21.15.7:42992) 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 -- 172.21.15.7:0/1314302775 learned_addr learned my addr 172.21.15.7:0/1314302775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459e00640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x56457827b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f245a800640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x56457827bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 -- 172.21.15.7:0/1314302775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 msgr2=0x56457827b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x56457827b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 -- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 msgr2=0x56457827bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x56457827bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f2459400640 1 -- 172.21.15.7:0/1314302775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645781a3fd0 con 0x564578273ad0 2024-04-23T15:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.699+0000 7f245a800640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x56457827bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f2459400640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827b7c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2448003f60 tx=0x7f2448005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61c1c5fe6a8d046 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f243b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f243b400640 1 -- 172.21.15.7:0/1314302775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244801f600 con 0x564578273ad0 2024-04-23T15:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f243b400640 1 -- 172.21.15.7:0/1314302775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f244801f7a0 con 0x564578273ad0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f244c0054f0 con 0x564578273ad0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f243b400640 1 -- 172.21.15.7:0/1314302775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f244801f9a0 con 0x564578273ad0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f24639bd740 10 client.16479 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.700+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564577eec210 con 0x564578273ad0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f243b400640 1 -- 172.21.15.7:0/1314302775 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f244c0054f0 con 0x564578273ad0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f243b400640 1 -- 172.21.15.7:0/1314302775 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2448028b80 con 0x564578273ad0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f24639bd740 10 client.16479 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f24639bd740 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f24639bd740 20 client.16479 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f24639bd740 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56457828e430 0x564578290860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f24639bd740 4 client.16479 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.701+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645781e7320 con 0x56457828e430 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.702+0000 7f2459e00640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56457828e430 0x564578290860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.703+0000 7f2459e00640 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56457828e430 0x564578290860 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad045d49bf025268 server_cookie=decf5557009da52f in_seq=0 out_seq=0 2024-04-23T15:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.703+0000 7f243b400640 10 client.16479 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f243b400640 1 -- 172.21.15.7:0/1314302775 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5645781e7320 con 0x56457828e430 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f243b400640 10 client.16479 handle_command_reply: tid=0 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 client.16479 shutdown 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 msgr2=0x56457827b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827b7c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2448003f60 tx=0x7f2448005c90 comp rx=0 tx=0).stop 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 shutdown_connections 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56457828e430 0x564578290860 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56457827e390 0x56457827bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564578273ad0 0x56457827b7c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 --2- 172.21.15.7:0/1314302775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x56457827b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f243b400640 0 client.16479 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 >> 172.21.15.7:0/1314302775 conn(0x56457826f6c0 msgr2=0x5645782753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 shutdown_connections 2024-04-23T15:01:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.705+0000 7f24639bd740 1 -- 172.21.15.7:0/1314302775 wait complete. 2024-04-23T15:01:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.706+0000 7f24639bd740 20 client.16479 trim_cache size 0 max 16384 2024-04-23T15:01:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.725+0000 7f24639bd740 1 Processor -- start 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.725+0000 7f24639bd740 1 -- start start 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.725+0000 7f24639bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 0x564578289e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f24639bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x564578275270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f24639bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56457827e390 0x564578296170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f24639bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b59b0 con 0x5645782731b0 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f24639bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b74f0 con 0x564578273ad0 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f24639bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b6080 con 0x56457827e390 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f2459e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 0x564578289e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f2459e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 0x564578289e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42994/0 (socket says 172.21.15.7:42994) 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f2459e00640 1 -- 172.21.15.7:0/3074383609 learned_addr learned my addr 172.21.15.7:0/3074383609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f2459400640 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x564578275270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.726+0000 7f245a800640 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56457827e390 0x564578296170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459e00640 1 -- 172.21.15.7:0/3074383609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56457827e390 msgr2=0x564578296170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459e00640 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56457827e390 0x564578296170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459e00640 1 -- 172.21.15.7:0/3074383609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 msgr2=0x564578275270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459e00640 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x564578275270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459e00640 1 -- 172.21.15.7:0/3074383609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564577fb8620 con 0x5645782731b0 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459400640 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x564578275270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2459e00640 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 0x564578289e20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f244c0096c0 tx=0x7f244c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32901be1dbed6c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2446600640 1 -- 172.21.15.7:0/3074383609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c035040 con 0x5645782731b0 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2446600640 1 -- 172.21.15.7:0/3074383609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f244c053820 con 0x5645782731b0 2024-04-23T15:01:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.727+0000 7f2446600640 1 -- 172.21.15.7:0/3074383609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c003d70 con 0x5645782731b0 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 -- 172.21.15.7:0/3074383609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 msgr2=0x564578289e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 0x564578289e20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f244c0096c0 tx=0x7f244c02a420 comp rx=0 tx=0).stop 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 -- 172.21.15.7:0/3074383609 shutdown_connections 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x564578275270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56457827e390 0x564578296170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 --2- 172.21.15.7:0/3074383609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645782731b0 0x564578289e20 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 -- 172.21.15.7:0/3074383609 >> 172.21.15.7:0/3074383609 conn(0x56457826f6c0 msgr2=0x564578274b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 -- 172.21.15.7:0/3074383609 shutdown_connections 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.728+0000 7f24639bd740 1 -- 172.21.15.7:0/3074383609 wait complete. 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.729+0000 7f24639bd740 1 -- start start 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.729+0000 7f24639bd740 1 Processor -- start 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.729+0000 7f24639bd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578278370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.729+0000 7f24639bd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x5645782788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f24639bd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 0x5645782f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f24639bd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b6e20 con 0x56457827e390 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f24639bd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b6750 con 0x564578273ad0 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f24639bd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1b39b0 con 0x5645782731b0 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f24639bd740 10 client.0 _ll_register_callbacks cb 0x7f2448003be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 0x5645782f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 0x5645782f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43000/0 (socket says 172.21.15.7:43000) 2024-04-23T15:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 -- 172.21.15.7:0/4119654060 learned_addr learned my addr 172.21.15.7:0/4119654060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f2459e00640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578278370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f2459400640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x5645782788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 -- 172.21.15.7:0/4119654060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 msgr2=0x564578278370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578278370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 -- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 msgr2=0x5645782788b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x5645782788b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.730+0000 7f245a800640 1 -- 172.21.15.7:0/4119654060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645782f3f20 con 0x56457827e390 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f2459400640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x5645782788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f245a800640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 0x5645782f39e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f24540054c0 tx=0x7f245409c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e792beba88085115 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f243b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f243b400640 1 -- 172.21.15.7:0/4119654060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245401f040 con 0x56457827e390 2024-04-23T15:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f244c053820 con 0x56457827e390 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f243b400640 1 -- 172.21.15.7:0/4119654060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f24540870b0 con 0x56457827e390 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f243b400640 1 -- 172.21.15.7:0/4119654060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f24540872b0 con 0x56457827e390 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f24639bd740 10 client.16485 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.731+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5645782f5150 con 0x56457827e390 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f243b400640 1 -- 172.21.15.7:0/4119654060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f244c053820 con 0x56457827e390 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f243b400640 1 -- 172.21.15.7:0/4119654060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f245400f040 con 0x56457827e390 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f24639bd740 10 client.16485 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f24639bd740 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f24639bd740 20 client.16485 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f24639bd740 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5645782f58c0 0x5645782f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f24639bd740 4 client.16485 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:01:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.732+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5645781e1190 con 0x5645782f58c0 2024-04-23T15:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.733+0000 7f2459e00640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5645782f58c0 0x5645782f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.734+0000 7f2459e00640 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5645782f58c0 0x5645782f7cb0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=245dcaa381cee65d server_cookie=d8386447dba14317 in_seq=0 out_seq=0 2024-04-23T15:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.734+0000 7f243b400640 10 client.16485 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f243b400640 1 -- 172.21.15.7:0/4119654060 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5645781e1190 con 0x5645782f58c0 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f243b400640 10 client.16485 handle_command_reply: tid=0 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 client.16485 shutdown 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 msgr2=0x5645782f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 0x5645782f39e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f24540054c0 tx=0x7f245409c9f0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 shutdown_connections 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5645782f58c0 0x5645782f7cb0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564578273ad0 0x5645782788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56457827e390 0x5645782f39e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 --2- 172.21.15.7:0/4119654060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5645782731b0 0x564578278370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.761+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 >> 172.21.15.7:0/4119654060 conn(0x56457826f6c0 msgr2=0x5645782753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.762+0000 7f243b400640 0 client.16485 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.762+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 shutdown_connections 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.762+0000 7f24639bd740 1 -- 172.21.15.7:0/4119654060 wait complete. 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.762+0000 7f24639bd740 20 client.16485 trim_cache size 0 max 16384 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:01:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24400a3e40 msgr2=0x7f24400a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24400a3e40 0x7f24400a6300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x564578270ae0 tx=0x7f244800b390 comp rx=0 tx=0).stop 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 msgr2=0x7f245c1a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c1a35f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f245400eaa0 tx=0x7f245400ef60 comp rx=0 tx=0).stop 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 shutdown_connections 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24400a3e40 0x7f24400a6300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f245c108fb0 0x7f245c19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f245c10e690 0x7f245c1a35f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 --2- 172.21.15.7:0/491072201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f245c1085f0 0x7f245c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 >> 172.21.15.7:0/491072201 conn(0x7f245c076590 msgr2=0x7f245c077bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 shutdown_connections 2024-04-23T15:01:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:46.763+0000 7f2460a00640 1 -- 172.21.15.7:0/491072201 wait complete. 2024-04-23T15:01:48.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:47 smithi007 ceph-mon[27906]: pgmap v324: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:01:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:47 smithi186 ceph-mon[31814]: pgmap v324: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:01:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:47 smithi137 ceph-mon[31694]: pgmap v324: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:01:49.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:49.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:48 smithi007 ceph-mon[27906]: pgmap v325: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:01:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:49.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:48 smithi186 ceph-mon[31814]: pgmap v325: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:01:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:48 smithi137 ceph-mon[31694]: pgmap v325: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:01:50.095 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:49 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:50.095 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:49 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:49 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:49 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:50.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:49 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:50.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:49 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:50 smithi186 ceph-mon[31814]: pgmap v326: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:01:51.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:50 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:51.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:50 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:50 smithi137 ceph-mon[31694]: pgmap v326: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:01:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:50 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:50 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:50 smithi007 ceph-mon[27906]: pgmap v326: 129 pgs: 129 active+clean; 2.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:01:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:50 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:50 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:52.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:01:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: pgmap v327: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 18 op/s 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:53.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: pgmap v327: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 18 op/s 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:53.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: pgmap v327: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 18 op/s 2024-04-23T15:01:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:53.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:01:54.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:54 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:01:54.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:54 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:01:54.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:54 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:01:54.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:54 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:01:54.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:54 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:01:54.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:54 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:01:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:55 smithi186 ceph-mon[31814]: pgmap v328: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:01:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:55 smithi137 ceph-mon[31694]: pgmap v328: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:01:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:55 smithi007 ceph-mon[27906]: pgmap v328: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:01:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:57 smithi186 ceph-mon[31814]: pgmap v329: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:01:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:57 smithi137 ceph-mon[31694]: pgmap v329: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:01:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:57 smithi007 ceph-mon[27906]: pgmap v329: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:01:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:01:59 smithi186 ceph-mon[31814]: pgmap v330: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:01:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 -- 172.21.15.7:0/895421049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec102250 msgr2=0x7f5fec102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 --2- 172.21.15.7:0/895421049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec102250 0x7f5fec102630 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009900 tx=0x7f5fdc02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 -- 172.21.15.7:0/895421049 shutdown_connections 2024-04-23T15:01:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 --2- 172.21.15.7:0/895421049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fec102c00 0x7f5fec106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 --2- 172.21.15.7:0/895421049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fec107320 0x7f5fec10eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 --2- 172.21.15.7:0/895421049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec102250 0x7f5fec102630 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 -- 172.21.15.7:0/895421049 >> 172.21.15.7:0/895421049 conn(0x7f5fec079490 msgr2=0x7f5fec0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 -- 172.21.15.7:0/895421049 shutdown_connections 2024-04-23T15:01:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.909+0000 7f5ff2800640 1 -- 172.21.15.7:0/895421049 wait complete. 2024-04-23T15:01:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.910+0000 7f5ff2800640 1 Processor -- start 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.910+0000 7f5ff2800640 1 -- start start 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5ff2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fec102250 0x7f5fec074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5ff2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fec107320 0x7f5fec074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5ff2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 0x7f5fec1a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5ff2800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1122e0 con 0x7f5fec074d80 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5ff2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec112160 con 0x7f5fec102250 2024-04-23T15:01:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5ff2800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec112460 con 0x7f5fec107320 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5febe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 0x7f5fec1a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5febe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 0x7f5fec1a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44818/0 (socket says 172.21.15.7:44818) 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5febe00640 1 -- 172.21.15.7:0/1446988259 learned_addr learned my addr 172.21.15.7:0/1446988259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5feb400640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fec102250 0x7f5fec074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.911+0000 7f5feaa00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fec107320 0x7f5fec074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.912+0000 7f5febe00640 1 -- 172.21.15.7:0/1446988259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fec107320 msgr2=0x7f5fec074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.912+0000 7f5febe00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fec107320 0x7f5fec074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.912+0000 7f5febe00640 1 -- 172.21.15.7:0/1446988259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fec102250 msgr2=0x7f5fec074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.912+0000 7f5febe00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fec102250 0x7f5fec074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.912+0000 7f5febe00640 1 -- 172.21.15.7:0/1446988259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec1a6fb0 con 0x7f5fec074d80 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.912+0000 7f5febe00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 0x7f5fec1a6910 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400e960 tx=0x7f5fe400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.913+0000 7f5fe3e00640 1 -- 172.21.15.7:0/1446988259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4004d20 con 0x7f5fec074d80 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.913+0000 7f5fe3e00640 1 -- 172.21.15.7:0/1446988259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fe4005020 con 0x7f5fec074d80 2024-04-23T15:01:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.913+0000 7f5fe3e00640 1 -- 172.21.15.7:0/1446988259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40116d0 con 0x7f5fec074d80 2024-04-23T15:01:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.913+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec1a72a0 con 0x7f5fec074d80 2024-04-23T15:01:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.913+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec1a77f0 con 0x7f5fec074d80 2024-04-23T15:01:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.916+0000 7f5fe3e00640 1 -- 172.21.15.7:0/1446988259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5fe40051d0 con 0x7f5fec074d80 2024-04-23T15:01:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.917+0000 7f5ff5601740 1 Processor -- start 2024-04-23T15:01:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:01:59 smithi137 ceph-mon[31694]: pgmap v330: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:01:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.917+0000 7f5ff5601740 1 -- start start 2024-04-23T15:01:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a191b0 0x55dbe8a19590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a24390 0x55dbe8a26780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5ff5601740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dbe897f900 con 0x55dbe8a19ad0 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5ff5601740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8925f20 con 0x55dbe8a191b0 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5ff5601740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55dbe897b8c0 con 0x55dbe8a24390 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5feb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.918+0000 7f5fe3e00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5fd00a3dc0 0x7f5fd00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a23e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44830/0 (socket says 172.21.15.7:44830) 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 -- 172.21.15.7:0/954369722 learned_addr learned my addr 172.21.15.7:0/954369722 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feaa00640 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a191b0 0x55dbe8a19590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5fe3e00640 1 -- 172.21.15.7:0/1446988259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f5fe40d0f90 con 0x7f5fec074d80 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feaa00640 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a24390 0x55dbe8a26780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5febe00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5fd00a3dc0 0x7f5fd00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 -- 172.21.15.7:0/954369722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a24390 msgr2=0x55dbe8a26780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a24390 0x55dbe8a26780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 -- 172.21.15.7:0/954369722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a191b0 msgr2=0x55dbe8a19590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a191b0 0x55dbe8a19590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.919+0000 7f5feb400640 1 -- 172.21.15.7:0/954369722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe894ae10 con 0x55dbe8a19ad0 2024-04-23T15:01:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.920+0000 7f5feb400640 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a23e50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009230 tx=0x7f5fdc004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b888ed3968fbc999 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.920+0000 7f5febe00640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5fd00a3dc0 0x7f5fd00a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4099550 tx=0x7f5fe4009270 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.920+0000 7f5fe0c00640 1 -- 172.21.15.7:0/954369722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc035040 con 0x55dbe8a19ad0 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.920+0000 7f5fe0c00640 1 -- 172.21.15.7:0/954369722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fdc004770 con 0x55dbe8a19ad0 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.920+0000 7f5fe0c00640 1 -- 172.21.15.7:0/954369722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc003850 con 0x55dbe8a19ad0 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 -- 172.21.15.7:0/954369722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 msgr2=0x55dbe8a23e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a23e50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009230 tx=0x7f5fdc004310 comp rx=0 tx=0).stop 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 -- 172.21.15.7:0/954369722 shutdown_connections 2024-04-23T15:01:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a24390 0x55dbe8a26780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a23e50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 --2- 172.21.15.7:0/954369722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a191b0 0x55dbe8a19590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 -- 172.21.15.7:0/954369722 >> 172.21.15.7:0/954369722 conn(0x55dbe8a156c0 msgr2=0x55dbe8a15aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 -- 172.21.15.7:0/954369722 shutdown_connections 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.921+0000 7f5ff5601740 1 -- 172.21.15.7:0/954369722 wait complete. 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.922+0000 7f5ff5601740 1 -- start start 2024-04-23T15:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.922+0000 7f5ff5601740 1 Processor -- start 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 0x55dbe8a21350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a21890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a21dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8a26f60 con 0x55dbe8a191b0 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dbe89392c0 con 0x55dbe8a24390 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8a270e0 con 0x55dbe8a19ad0 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5ff5601740 10 client.0 _ll_register_callbacks cb 0x55dbe8691a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5feaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 0x55dbe8a21350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5feaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 0x55dbe8a21350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44832/0 (socket says 172.21.15.7:44832) 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5feaa00640 1 -- 172.21.15.7:0/39037668 learned_addr learned my addr 172.21.15.7:0/39037668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5feb400640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a21890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.923+0000 7f5feaa00640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a21dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5feaa00640 1 -- 172.21.15.7:0/39037668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a19ad0 msgr2=0x55dbe8a21890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5feaa00640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a21890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5feaa00640 1 -- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 msgr2=0x55dbe8a21dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5feaa00640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a21dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5feaa00640 1 -- 172.21.15.7:0/39037668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe8949fd0 con 0x55dbe8a191b0 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5feaa00640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 0x55dbe8a21350 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800de00 tx=0x7f5fd800d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d125cdc8cd3ebe20 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5fd5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5fd5600640 1 -- 172.21.15.7:0/39037668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8005020 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5fd5600640 1 -- 172.21.15.7:0/39037668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f5fd80051c0 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.924+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fdc004770 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5fd5600640 1 -- 172.21.15.7:0/39037668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5fd8026050 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 10 client.16497 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dbe8692210 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5fd5600640 1 -- 172.21.15.7:0/39037668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fdc004770 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5fd5600640 1 -- 172.21.15.7:0/39037668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5fd801d030 con 0x55dbe8a191b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 10 client.16497 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 10 client.16497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 20 client.16497 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a344b0 0x55dbe8a368e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 4 client.16497 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.925+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbe898d320 con 0x55dbe8a344b0 2024-04-23T15:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.926+0000 7f5feb400640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a344b0 0x55dbe8a368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.927+0000 7f5feb400640 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a344b0 0x55dbe8a368e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ddc6a03ebf71170 server_cookie=619c5116b4afa05f in_seq=0 out_seq=0 2024-04-23T15:01:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.927+0000 7f5fd5600640 10 client.16497 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.929+0000 7f5fd5600640 1 -- 172.21.15.7:0/39037668 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dbe898d320 con 0x55dbe8a344b0 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.929+0000 7f5fd5600640 10 client.16497 handle_command_reply: tid=0 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.929+0000 7f5ff5601740 1 client.16497 shutdown 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 msgr2=0x55dbe8a21350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 0x55dbe8a21350 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800de00 tx=0x7f5fd800d960 comp rx=0 tx=0).stop 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 shutdown_connections 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a344b0 0x55dbe8a368e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a21dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5fd5600640 0 client.16497 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a21890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 --2- 172.21.15.7:0/39037668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a191b0 0x55dbe8a21350 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 >> 172.21.15.7:0/39037668 conn(0x55dbe8a156c0 msgr2=0x55dbe8a1b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 shutdown_connections 2024-04-23T15:01:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 1 -- 172.21.15.7:0/39037668 wait complete. 2024-04-23T15:01:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.930+0000 7f5ff5601740 20 client.16497 trim_cache size 0 max 16384 2024-04-23T15:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.949+0000 7f5ff5601740 1 Processor -- start 2024-04-23T15:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.949+0000 7f5ff5601740 1 -- start start 2024-04-23T15:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a2fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a146c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 0x55dbe8a3c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5ff5601740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1b1590 con 0x55dbe8a24390 2024-04-23T15:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5ff5601740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1b30d0 con 0x55dbe8a19ad0 2024-04-23T15:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5ff5601740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1b1c60 con 0x55dbe8a191b0 2024-04-23T15:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5feaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 0x55dbe8a3c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5feaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 0x55dbe8a3c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44838/0 (socket says 172.21.15.7:44838) 2024-04-23T15:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5feaa00640 1 -- 172.21.15.7:0/2423238227 learned_addr learned my addr 172.21.15.7:0/2423238227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5feb400640 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.950+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a2fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.951+0000 7f5feaa00640 1 -- 172.21.15.7:0/2423238227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 msgr2=0x55dbe8a2fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.951+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a2fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.951+0000 7f5feaa00640 1 -- 172.21.15.7:0/2423238227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a19ad0 msgr2=0x55dbe8a146c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.951+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a146c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.951+0000 7f5feaa00640 1 -- 172.21.15.7:0/2423238227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe8a19900 con 0x55dbe8a24390 2024-04-23T15:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.952+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 0x55dbe8a3c1f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80114c0 tx=0x7f5fd8010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8de6e9523099c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.952+0000 7f5fd7e00640 1 -- 172.21.15.7:0/2423238227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8004030 con 0x55dbe8a24390 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.952+0000 7f5fd7e00640 1 -- 172.21.15.7:0/2423238227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fd80046c0 con 0x55dbe8a24390 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.952+0000 7f5fd7e00640 1 -- 172.21.15.7:0/2423238227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011be0 con 0x55dbe8a24390 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 -- 172.21.15.7:0/2423238227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 msgr2=0x55dbe8a3c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 0x55dbe8a3c1f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80114c0 tx=0x7f5fd8010fd0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 -- 172.21.15.7:0/2423238227 shutdown_connections 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a146c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a24390 0x55dbe8a3c1f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2423238227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a2fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 -- 172.21.15.7:0/2423238227 >> 172.21.15.7:0/2423238227 conn(0x55dbe8a156c0 msgr2=0x55dbe8a13fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 -- 172.21.15.7:0/2423238227 shutdown_connections 2024-04-23T15:01:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.953+0000 7f5ff5601740 1 -- 172.21.15.7:0/2423238227 wait complete. 2024-04-23T15:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 -- start start 2024-04-23T15:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 Processor -- start 2024-04-23T15:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a1e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a1e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a1eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1b2a00 con 0x55dbe8a19ad0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1b2330 con 0x55dbe8a24390 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.954+0000 7f5ff5601740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1af590 con 0x55dbe8a191b0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5ff5601740 10 client.0 _ll_register_callbacks cb 0x7f5fd800d8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a1e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a1e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44842/0 (socket says 172.21.15.7:44842) 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 -- 172.21.15.7:0/2052989051 learned_addr learned my addr 172.21.15.7:0/2052989051 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a1e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 -- 172.21.15.7:0/2052989051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 msgr2=0x55dbe8a1e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a1e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 -- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 msgr2=0x55dbe8a1eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a1eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.955+0000 7f5feb400640 1 -- 172.21.15.7:0/2052989051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe875e620 con 0x55dbe8a19ad0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5feb400640 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a1e650 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009900 tx=0x7f5fdc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2844bc52d0b493 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5fd5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:01:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5fd5600640 1 -- 172.21.15.7:0/2052989051 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc058060 con 0x55dbe8a19ad0 2024-04-23T15:01:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5fd5600640 1 -- 172.21.15.7:0/2052989051 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9467+0+0 (secure 0 0 0) 0x7f5fdc053370 con 0x55dbe8a19ad0 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fd80046c0 con 0x55dbe8a19ad0 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5fd5600640 1 -- 172.21.15.7:0/2052989051 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5fdc05f050 con 0x55dbe8a19ad0 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5ff5601740 10 client.16503 fetch_fsmap learned FSMap version 32 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.956+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dbe8a9ac80 con 0x55dbe8a19ad0 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5fd5600640 1 -- 172.21.15.7:0/2052989051 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fd80046c0 con 0x55dbe8a19ad0 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5fd5600640 1 -- 172.21.15.7:0/2052989051 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5fdc031c90 con 0x55dbe8a19ad0 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5ff5601740 10 client.16503 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5ff5601740 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5ff5601740 20 client.16503 populate_metadata read hostname 'smithi007' 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a9af60 0x55dbe8a9d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5ff5601740 4 client.16503 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.957+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbe8987190 con 0x55dbe8a9af60 2024-04-23T15:01:59.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.959+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a9af60 0x55dbe8a9d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:59.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.960+0000 7f5feaa00640 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a9af60 0x55dbe8a9d350 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91f77753d3fd97 server_cookie=2d24028df9b818a6 in_seq=0 out_seq=0 2024-04-23T15:01:59.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.960+0000 7f5fd5600640 10 client.16503 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5fd5600640 1 -- 172.21.15.7:0/2052989051 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbe8987190 con 0x55dbe8a9af60 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5fd5600640 10 client.16503 handle_command_reply: tid=0 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 client.16503 shutdown 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 msgr2=0x55dbe8a1e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a1e650 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009900 tx=0x7f5fdc000bc0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 shutdown_connections 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbe8a9af60 0x55dbe8a9d350 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbe8a24390 0x55dbe8a1eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbe8a19ad0 0x55dbe8a1e650 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5ff5601740 1 --2- 172.21.15.7:0/2052989051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbe8a191b0 0x55dbe8a1e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.989+0000 7f5fd5600640 0 client.16503 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.990+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 >> 172.21.15.7:0/2052989051 conn(0x55dbe8a156c0 msgr2=0x55dbe8a1b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.990+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 shutdown_connections 2024-04-23T15:01:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.990+0000 7f5ff5601740 1 -- 172.21.15.7:0/2052989051 wait complete. 2024-04-23T15:01:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.990+0000 7f5ff5601740 20 client.16503 trim_cache size 0 max 16384 2024-04-23T15:01:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:01:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:01:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:01:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5fd00a3dc0 msgr2=0x7f5fd00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5fd00a3dc0 0x7f5fd00a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4099550 tx=0x7f5fe4009270 comp rx=0 tx=0).stop 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 msgr2=0x7f5fec1a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 0x7f5fec1a6910 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400e960 tx=0x7f5fe400ee20 comp rx=0 tx=0).stop 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 shutdown_connections 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5fd00a3dc0 0x7f5fd00a6280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fec074d80 0x7f5fec1a6910 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fec107320 0x7f5fec074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 --2- 172.21.15.7:0/1446988259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fec102250 0x7f5fec074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 >> 172.21.15.7:0/1446988259 conn(0x7f5fec079490 msgr2=0x7f5fec0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 shutdown_connections 2024-04-23T15:01:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:01:59.991+0000 7f5ff2800640 1 -- 172.21.15.7:0/1446988259 wait complete. 2024-04-23T15:02:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:01:59 smithi007 ceph-mon[27906]: pgmap v330: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:02:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:01 smithi137 ceph-mon[31694]: pgmap v331: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:02:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:01 smithi007 ceph-mon[27906]: pgmap v331: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:02:02.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:01 smithi186 ceph-mon[31814]: pgmap v331: 129 pgs: 129 active+clean; 2.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 13 op/s 2024-04-23T15:02:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:03 smithi137 ceph-mon[31694]: pgmap v332: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 39 op/s 2024-04-23T15:02:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:03 smithi137 ceph-mon[31694]: osdmap e103: 12 total, 12 up, 12 in 2024-04-23T15:02:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:03 smithi007 ceph-mon[27906]: pgmap v332: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 39 op/s 2024-04-23T15:02:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:03 smithi007 ceph-mon[27906]: osdmap e103: 12 total, 12 up, 12 in 2024-04-23T15:02:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:03 smithi186 ceph-mon[31814]: pgmap v332: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 39 op/s 2024-04-23T15:02:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:03 smithi186 ceph-mon[31814]: osdmap e103: 12 total, 12 up, 12 in 2024-04-23T15:02:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:05 smithi137 ceph-mon[31694]: pgmap v334: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 36 op/s 2024-04-23T15:02:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:05 smithi007 ceph-mon[27906]: pgmap v334: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 36 op/s 2024-04-23T15:02:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:05 smithi186 ceph-mon[31814]: pgmap v334: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 36 op/s 2024-04-23T15:02:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:07 smithi137 ceph-mon[31694]: pgmap v335: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:02:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:07 smithi007 ceph-mon[27906]: pgmap v335: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:02:08.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:07 smithi186 ceph-mon[31814]: pgmap v335: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:02:09.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:09 smithi137 ceph-mon[31694]: pgmap v336: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:02:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:09 smithi007 ceph-mon[27906]: pgmap v336: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:02:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:09 smithi186 ceph-mon[31814]: pgmap v336: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:02:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:11 smithi186 ceph-mon[31814]: osdmap e104: 12 total, 12 up, 12 in 2024-04-23T15:02:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:11 smithi186 ceph-mon[31814]: pgmap v338: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 2.8 MiB/s wr, 7 op/s 2024-04-23T15:02:11.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:11 smithi137 ceph-mon[31694]: osdmap e104: 12 total, 12 up, 12 in 2024-04-23T15:02:11.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:11 smithi137 ceph-mon[31694]: pgmap v338: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 2.8 MiB/s wr, 7 op/s 2024-04-23T15:02:11.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:11 smithi007 ceph-mon[27906]: osdmap e104: 12 total, 12 up, 12 in 2024-04-23T15:02:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:11 smithi007 ceph-mon[27906]: pgmap v338: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 2.8 MiB/s wr, 7 op/s 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.146+0000 7f16fe800640 1 -- 172.21.15.7:0/712232267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 msgr2=0x7f16f8104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.146+0000 7f16fe800640 1 --2- 172.21.15.7:0/712232267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f8104850 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009900 tx=0x7f16e802a410 comp rx=0 tx=0).stop 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 -- 172.21.15.7:0/712232267 shutdown_connections 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 --2- 172.21.15.7:0/712232267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f8109540 0x7f16f8111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 --2- 172.21.15.7:0/712232267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8104e20 0x7f16f8108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 --2- 172.21.15.7:0/712232267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f8104850 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 -- 172.21.15.7:0/712232267 >> 172.21.15.7:0/712232267 conn(0x7f16f80ffcd0 msgr2=0x7f16f81020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 -- 172.21.15.7:0/712232267 shutdown_connections 2024-04-23T15:02:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.147+0000 7f16fe800640 1 -- 172.21.15.7:0/712232267 wait complete. 2024-04-23T15:02:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.148+0000 7f16fe800640 1 Processor -- start 2024-04-23T15:02:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.148+0000 7f16fe800640 1 -- start start 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16fe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f81a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16fe800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8109540 0x7f16f81a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16fe800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f819a850 0x7f16f819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16fe800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16f81144d0 con 0x7f16f8104470 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16fe800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8114350 con 0x7f16f819a850 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16fe800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8114650 con 0x7f16f8109540 2024-04-23T15:02:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f81a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f81a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39246/0 (socket says 172.21.15.7:39246) 2024-04-23T15:02:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.149+0000 7f16f7400640 1 -- 172.21.15.7:0/2159851924 learned_addr learned my addr 172.21.15.7:0/2159851924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7e00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f819a850 0x7f16f819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f6a00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8109540 0x7f16f81a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7400640 1 -- 172.21.15.7:0/2159851924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8109540 msgr2=0x7f16f81a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7400640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8109540 0x7f16f81a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7400640 1 -- 172.21.15.7:0/2159851924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f819a850 msgr2=0x7f16f819ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7400640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f819a850 0x7f16f819ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7400640 1 -- 172.21.15.7:0/2159851924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f819b3e0 con 0x7f16f8104470 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f6a00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8109540 0x7f16f81a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7e00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f819a850 0x7f16f819ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.150+0000 7f16f7400640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f81a0690 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005ab0 tx=0x7f16e8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.151+0000 7f16efe00640 1 -- 172.21.15.7:0/2159851924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e803f070 con 0x7f16f8104470 2024-04-23T15:02:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.151+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f819b670 con 0x7f16f8104470 2024-04-23T15:02:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.151+0000 7f16efe00640 1 -- 172.21.15.7:0/2159851924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e8031b60 con 0x7f16f8104470 2024-04-23T15:02:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.151+0000 7f16efe00640 1 -- 172.21.15.7:0/2159851924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8035030 con 0x7f16f8104470 2024-04-23T15:02:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.151+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f81a7800 con 0x7f16f8104470 2024-04-23T15:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.154+0000 7f16efe00640 1 -- 172.21.15.7:0/2159851924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f16e8042070 con 0x7f16f8104470 2024-04-23T15:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.155+0000 7f17015d7740 1 Processor -- start 2024-04-23T15:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.155+0000 7f17015d7740 1 -- start start 2024-04-23T15:02:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f17015d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b419e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f17015d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f17015d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f17015d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618b4104900 con 0x5618b419ead0 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f17015d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5618b40aaf20 con 0x5618b419e1b0 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f17015d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5618b41008c0 con 0x5618b41a9390 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41a8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39256/0 (socket says 172.21.15.7:39256) 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f16f7400640 1 -- 172.21.15.7:0/1899368748 learned_addr learned my addr 172.21.15.7:0/1899368748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f16f7e00640 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.156+0000 7f16f6a00640 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7400640 1 -- 172.21.15.7:0/1899368748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 msgr2=0x5618b41ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7400640 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7400640 1 -- 172.21.15.7:0/1899368748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 msgr2=0x5618b419e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16efe00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3e40 0x7f16dc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7400640 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b419e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7400640 1 -- 172.21.15.7:0/1899368748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b40cfe10 con 0x5618b419ead0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16efe00640 1 -- 172.21.15.7:0/2159851924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7f16e80f0fc0 con 0x7f16f8104470 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7e00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3e40 0x7f16dc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16f7400640 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41a8e50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ee240 tx=0x7f16e80b8eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33afa201d0ac92e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.157+0000 7f16ecc00640 1 -- 172.21.15.7:0/1899368748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8049070 con 0x5618b419ead0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.158+0000 7f16ecc00640 1 -- 172.21.15.7:0/1899368748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e80bfcd0 con 0x5618b419ead0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.158+0000 7f16ecc00640 1 -- 172.21.15.7:0/1899368748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e80bc690 con 0x5618b419ead0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.158+0000 7f17015d7740 1 -- 172.21.15.7:0/1899368748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 msgr2=0x5618b41a8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.158+0000 7f16f7e00640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3e40 0x7f16dc0a6300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16f0005fd0 tx=0x7f16f0004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.158+0000 7f17015d7740 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41a8e50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ee240 tx=0x7f16e80b8eb0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 -- 172.21.15.7:0/1899368748 shutdown_connections 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41a8e50 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 --2- 172.21.15.7:0/1899368748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 -- 172.21.15.7:0/1899368748 >> 172.21.15.7:0/1899368748 conn(0x5618b419a6c0 msgr2=0x5618b419aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 -- 172.21.15.7:0/1899368748 shutdown_connections 2024-04-23T15:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 -- 172.21.15.7:0/1899368748 wait complete. 2024-04-23T15:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 -- start start 2024-04-23T15:02:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.159+0000 7f17015d7740 1 Processor -- start 2024-04-23T15:02:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41a6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 0x5618b41a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618b41abd80 con 0x5618b41a9390 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5618b40be2c0 con 0x5618b419e1b0 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5618b41abf00 con 0x5618b419ead0 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f17015d7740 10 client.0 _ll_register_callbacks cb 0x5618b3e16a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 0x5618b41a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 0x5618b41a6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39260/0 (socket says 172.21.15.7:39260) 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.160+0000 7f16f7e00640 1 -- 172.21.15.7:0/515888471 learned_addr learned my addr 172.21.15.7:0/515888471 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7400640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f6a00640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7e00640 1 -- 172.21.15.7:0/515888471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 msgr2=0x5618b41a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7e00640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7e00640 1 -- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 msgr2=0x5618b41a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7e00640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7e00640 1 -- 172.21.15.7:0/515888471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b40cefd0 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7400640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16f7e00640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 0x5618b41a6d70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f16f0012930 tx=0x7f16f0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be646664697dfef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.161+0000 7f16e1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f16e1600640 1 -- 172.21.15.7:0/515888471 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0022070 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f16e1600640 1 -- 172.21.15.7:0/515888471 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7f16f0010de0 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618b4112320 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f16e1600640 1 -- 172.21.15.7:0/515888471 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f16f001e420 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f17015d7740 10 client.16515 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5618b3e17210 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.162+0000 7f16e1600640 1 -- 172.21.15.7:0/515888471 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5618b4112320 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f16e1600640 1 -- 172.21.15.7:0/515888471 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f16f001d630 con 0x5618b41a9390 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f17015d7740 10 client.16515 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f17015d7740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f17015d7740 20 client.16515 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f17015d7740 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b41b92c0 0x5618b41bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f17015d7740 4 client.16515 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.163+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618b410c190 con 0x5618b41b92c0 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.164+0000 7f16f7400640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b41b92c0 0x5618b41bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.165+0000 7f16f7400640 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b41b92c0 0x5618b41bb6d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ed3cef70c3de94 server_cookie=b9307929560755f in_seq=0 out_seq=0 2024-04-23T15:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.165+0000 7f16e1600640 10 client.16515 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.166+0000 7f16e1600640 1 -- 172.21.15.7:0/515888471 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5618b410c190 con 0x5618b41b92c0 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.166+0000 7f16e1600640 10 client.16515 handle_command_reply: tid=0 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 client.16515 shutdown 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 msgr2=0x5618b41a6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 0x5618b41a6d70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f16f0012930 tx=0x7f16f0004ab0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 shutdown_connections 2024-04-23T15:02:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b41b92c0 0x5618b41bb6d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b41a9390 0x5618b41a6d70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 --2- 172.21.15.7:0/515888471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 >> 172.21.15.7:0/515888471 conn(0x5618b419a6c0 msgr2=0x5618b41a0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f16e1600640 0 client.16515 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 shutdown_connections 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 1 -- 172.21.15.7:0/515888471 wait complete. 2024-04-23T15:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.167+0000 7f17015d7740 20 client.16515 trim_cache size 0 max 16384 2024-04-23T15:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 Processor -- start 2024-04-23T15:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 -- start start 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 0x5618b41a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b41a9390 0x5618b41996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16d800ff10 con 0x5618b419e1b0 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16d8011a50 con 0x5618b41a9390 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.184+0000 7f17015d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16d80105e0 con 0x5618b419ead0 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 0x5618b41a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 0x5618b41a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39266/0 (socket says 172.21.15.7:39266) 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 -- 172.21.15.7:0/3941593303 learned_addr learned my addr 172.21.15.7:0/3941593303 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7e00640 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b41a9390 0x5618b41996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f6a00640 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 -- 172.21.15.7:0/3941593303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 msgr2=0x5618b41b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 -- 172.21.15.7:0/3941593303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b41a9390 msgr2=0x5618b41996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b41a9390 0x5618b41996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f7400640 1 -- 172.21.15.7:0/3941593303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618b4195ea0 con 0x5618b419e1b0 2024-04-23T15:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.185+0000 7f16f6a00640 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.186+0000 7f16f7400640 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 0x5618b41a0bc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f16e80bae00 tx=0x7f16e80bf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8e5594acf31bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.186+0000 7f16e3e00640 1 -- 172.21.15.7:0/3941593303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8049040 con 0x5618b419e1b0 2024-04-23T15:02:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.186+0000 7f16e3e00640 1 -- 172.21.15.7:0/3941593303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e80bd250 con 0x5618b419e1b0 2024-04-23T15:02:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.186+0000 7f16e3e00640 1 -- 172.21.15.7:0/3941593303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e80bfa70 con 0x5618b419e1b0 2024-04-23T15:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 -- 172.21.15.7:0/3941593303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 msgr2=0x5618b41a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 0x5618b41a0bc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f16e80bae00 tx=0x7f16e80bf040 comp rx=0 tx=0).stop 2024-04-23T15:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 -- 172.21.15.7:0/3941593303 shutdown_connections 2024-04-23T15:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b41a9390 0x5618b41996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b419ead0 0x5618b41b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 --2- 172.21.15.7:0/3941593303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419e1b0 0x5618b41a0bc0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 -- 172.21.15.7:0/3941593303 >> 172.21.15.7:0/3941593303 conn(0x5618b419a6c0 msgr2=0x5618b4198fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 -- 172.21.15.7:0/3941593303 shutdown_connections 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.187+0000 7f17015d7740 1 -- 172.21.15.7:0/3941593303 wait complete. 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.188+0000 7f17015d7740 1 -- start start 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.188+0000 7f17015d7740 1 Processor -- start 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.188+0000 7f17015d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.188+0000 7f17015d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41ac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f17015d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41acb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f17015d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16d8011380 con 0x5618b419ead0 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f17015d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16d8010cb0 con 0x5618b419e1b0 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f17015d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16d800df10 con 0x5618b41a9390 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f17015d7740 10 client.0 _ll_register_callbacks cb 0x7f16f00125b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39268/0 (socket says 172.21.15.7:39268) 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 -- 172.21.15.7:0/876783777 learned_addr learned my addr 172.21.15.7:0/876783777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f7400640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f7e00640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 -- 172.21.15.7:0/876783777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 msgr2=0x5618b41acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 -- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 msgr2=0x5618b41b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.189+0000 7f16f6a00640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f16f6a00640 1 -- 172.21.15.7:0/876783777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618b3ee3620 con 0x5618b419ead0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f16f7e00640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f16f6a00640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41ac630 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f16f819bb50 tx=0x7f16e40138e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc7140ffad26a02 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f16e1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f16e1600640 1 -- 172.21.15.7:0/876783777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4004030 con 0x5618b419ead0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f16e1600640 1 -- 172.21.15.7:0/876783777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7f16e40041d0 con 0x5618b419ead0 2024-04-23T15:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.190+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16e80bd250 con 0x5618b419ead0 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.191+0000 7f16e1600640 1 -- 172.21.15.7:0/876783777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f16e4027050 con 0x5618b419ead0 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.191+0000 7f17015d7740 10 client.16521 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.191+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5618b421f550 con 0x5618b419ead0 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.191+0000 7f16e1600640 1 -- 172.21.15.7:0/876783777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e80bd250 con 0x5618b419ead0 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f16e1600640 1 -- 172.21.15.7:0/876783777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f16e400f040 con 0x5618b419ead0 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f17015d7740 10 client.16521 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f17015d7740 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f17015d7740 20 client.16521 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f17015d7740 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b421fd80 0x5618b42221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f17015d7740 4 client.16521 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618b40884b0 con 0x5618b421fd80 2024-04-23T15:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.192+0000 7f16f7400640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b421fd80 0x5618b42221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.193+0000 7f16f7400640 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b421fd80 0x5618b42221a0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87b309ac57b62674 server_cookie=2aac530a844f0f9b in_seq=0 out_seq=0 2024-04-23T15:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.193+0000 7f16e1600640 10 client.16521 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:13.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f16e1600640 1 -- 172.21.15.7:0/876783777 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618b40884b0 con 0x5618b421fd80 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f16e1600640 10 client.16521 handle_command_reply: tid=0 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f17015d7740 1 client.16521 shutdown 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 msgr2=0x5618b41ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f17015d7740 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41ac630 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f16f819bb50 tx=0x7f16e40138e0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 shutdown_connections 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.226+0000 7f17015d7740 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5618b421fd80 0x5618b42221a0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5618b41a9390 0x5618b41acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618b419ead0 0x5618b41ac630 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 1 --2- 172.21.15.7:0/876783777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618b419e1b0 0x5618b41b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 >> 172.21.15.7:0/876783777 conn(0x5618b419a6c0 msgr2=0x5618b4199840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f16e1600640 0 client.16521 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 shutdown_connections 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 1 -- 172.21.15.7:0/876783777 wait complete. 2024-04-23T15:02:13.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.227+0000 7f17015d7740 20 client.16521 trim_cache size 0 max 16384 2024-04-23T15:02:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:02:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:02:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:02:13.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3e40 msgr2=0x7f16dc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3e40 0x7f16dc0a6300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16f0005fd0 tx=0x7f16f0004a40 comp rx=0 tx=0).stop 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 msgr2=0x7f16f81a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f81a0690 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005ab0 tx=0x7f16e8003c10 comp rx=0 tx=0).stop 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 shutdown_connections 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3e40 0x7f16dc0a6300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f819a850 0x7f16f819ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f8109540 0x7f16f81a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 --2- 172.21.15.7:0/2159851924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f8104470 0x7f16f81a0690 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:13.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.228+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 >> 172.21.15.7:0/2159851924 conn(0x7f16f80ffcd0 msgr2=0x7f16f8101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:13.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.229+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 shutdown_connections 2024-04-23T15:02:13.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:13.229+0000 7f16fe800640 1 -- 172.21.15.7:0/2159851924 wait complete. 2024-04-23T15:02:13.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:13 smithi186 ceph-mon[31814]: pgmap v339: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:02:13.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:13 smithi137 ceph-mon[31694]: pgmap v339: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:02:14.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:13 smithi007 ceph-mon[27906]: pgmap v339: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:02:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:15 smithi137 ceph-mon[31694]: pgmap v340: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:02:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:15 smithi007 ceph-mon[27906]: pgmap v340: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:02:16.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:15 smithi186 ceph-mon[31814]: pgmap v340: 129 pgs: 129 active+clean; 2.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:02:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:17 smithi137 ceph-mon[31694]: pgmap v341: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:02:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:17 smithi007 ceph-mon[27906]: pgmap v341: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:02:18.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:17 smithi186 ceph-mon[31814]: pgmap v341: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:02:19.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:19 smithi137 ceph-mon[31694]: pgmap v342: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:02:20.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:19 smithi007 ceph-mon[27906]: pgmap v342: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:02:20.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:19 smithi186 ceph-mon[31814]: pgmap v342: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:02:21.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:21 smithi137 ceph-mon[31694]: pgmap v343: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 17 op/s 2024-04-23T15:02:22.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:21 smithi007 ceph-mon[27906]: pgmap v343: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 17 op/s 2024-04-23T15:02:22.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:21 smithi186 ceph-mon[31814]: pgmap v343: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 17 op/s 2024-04-23T15:02:23.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:23 smithi137 ceph-mon[31694]: pgmap v344: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:02:24.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:23 smithi007 ceph-mon[27906]: pgmap v344: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:02:24.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:23 smithi186 ceph-mon[31814]: pgmap v344: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:02:25.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:25 smithi137 ceph-mon[31694]: pgmap v345: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:25 smithi007 ceph-mon[27906]: pgmap v345: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:26.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:25 smithi186 ceph-mon[31814]: pgmap v345: 129 pgs: 129 active+clean; 2.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.382+0000 7ff97be00640 1 -- 172.21.15.7:0/2932811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c104c60 msgr2=0x7ff97c108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.382+0000 7ff97be00640 1 --2- 172.21.15.7:0/2932811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c104c60 0x7ff97c108ca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff968009900 tx=0x7ff96802a410 comp rx=0 tx=0).stop 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 -- 172.21.15.7:0/2932811794 shutdown_connections 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 --2- 172.21.15.7:0/2932811794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff97c109380 0x7ff97c110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 --2- 172.21.15.7:0/2932811794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c104c60 0x7ff97c108ca0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 --2- 172.21.15.7:0/2932811794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97c1042b0 0x7ff97c104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 -- 172.21.15.7:0/2932811794 >> 172.21.15.7:0/2932811794 conn(0x7ff97c0ffb70 msgr2=0x7ff97c101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 -- 172.21.15.7:0/2932811794 shutdown_connections 2024-04-23T15:02:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.383+0000 7ff97be00640 1 -- 172.21.15.7:0/2932811794 wait complete. 2024-04-23T15:02:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.384+0000 7ff97be00640 1 Processor -- start 2024-04-23T15:02:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.384+0000 7ff97be00640 1 -- start start 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97c1042b0 0x7ff97c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff97c109380 0x7ff97c1a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 0x7ff97c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c114310 con 0x7ff97c19a7d0 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c114190 con 0x7ff97c109380 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c114490 con 0x7ff97c1042b0 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 0x7ff97c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 0x7ff97c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46852/0 (socket says 172.21.15.7:46852) 2024-04-23T15:02:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 -- 172.21.15.7:0/1532257827 learned_addr learned my addr 172.21.15.7:0/1532257827 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97a000640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff97c109380 0x7ff97c1a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97c1042b0 0x7ff97c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 -- 172.21.15.7:0/1532257827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97c1042b0 msgr2=0x7ff97c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97c1042b0 0x7ff97c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 -- 172.21.15.7:0/1532257827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff97c109380 msgr2=0x7ff97c1a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff97c109380 0x7ff97c1a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.385+0000 7ff97b400640 1 -- 172.21.15.7:0/1532257827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c19b360 con 0x7ff97c19a7d0 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.386+0000 7ff97b400640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 0x7ff97c19ac80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d750 tx=0x7ff96c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.386+0000 7ff973400640 1 -- 172.21.15.7:0/1532257827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c017070 con 0x7ff97c19a7d0 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.386+0000 7ff973400640 1 -- 172.21.15.7:0/1532257827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff96c0054d0 con 0x7ff97c19a7d0 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.386+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c19b650 con 0x7ff97c19a7d0 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.386+0000 7ff973400640 1 -- 172.21.15.7:0/1532257827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004c60 con 0x7ff97c19a7d0 2024-04-23T15:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.386+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c1a77b0 con 0x7ff97c19a7d0 2024-04-23T15:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.390+0000 7ff984a1d740 1 Processor -- start 2024-04-23T15:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff973400640 1 -- 172.21.15.7:0/1532257827 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff96c004e00 con 0x7ff97c19a7d0 2024-04-23T15:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 -- start start 2024-04-23T15:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b2f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b3a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b3c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557578a95900 con 0x557578b2f3c0 2024-04-23T15:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557578a3bf20 con 0x557578b2fce0 2024-04-23T15:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.391+0000 7ff984a1d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557578a918c0 con 0x557578b3a5a0 2024-04-23T15:02:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b2f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b2f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46856/0 (socket says 172.21.15.7:46856) 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 -- 172.21.15.7:0/2243056071 learned_addr learned my addr 172.21.15.7:0/2243056071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97aa00640 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b3a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b3c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 -- 172.21.15.7:0/2243056071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 msgr2=0x557578b3c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b3c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 -- 172.21.15.7:0/2243056071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 msgr2=0x557578b3a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b3a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97a000640 1 -- 172.21.15.7:0/2243056071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557578a60e10 con 0x557578b2f3c0 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff97aa00640 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b3a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.392+0000 7ff973400640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9600a3d90 0x7ff9600a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.393+0000 7ff973400640 1 -- 172.21.15.7:0/1532257827 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7ff96c0d0530 con 0x7ff97c19a7d0 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.393+0000 7ff97a000640 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b2f7a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff968005c40 tx=0x7ff968005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dd51cdbed9dbd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.393+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9600a3d90 0x7ff9600a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.393+0000 7ff967e00640 1 -- 172.21.15.7:0/2243056071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968035070 con 0x557578b2f3c0 2024-04-23T15:02:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.393+0000 7ff967e00640 1 -- 172.21.15.7:0/2243056071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9680046c0 con 0x557578b2f3c0 2024-04-23T15:02:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.393+0000 7ff967e00640 1 -- 172.21.15.7:0/2243056071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968003830 con 0x557578b2f3c0 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 -- 172.21.15.7:0/2243056071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 msgr2=0x557578b2f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b2f7a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff968005c40 tx=0x7ff968005bb0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9600a3d90 0x7ff9600a6250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x557578b30960 tx=0x7ff974009660 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 -- 172.21.15.7:0/2243056071 shutdown_connections 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b3a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b3c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 --2- 172.21.15.7:0/2243056071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b2f7a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 -- 172.21.15.7:0/2243056071 >> 172.21.15.7:0/2243056071 conn(0x557578b2b8d0 msgr2=0x557578b2bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 -- 172.21.15.7:0/2243056071 shutdown_connections 2024-04-23T15:02:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.394+0000 7ff984a1d740 1 -- 172.21.15.7:0/2243056071 wait complete. 2024-04-23T15:02:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.395+0000 7ff984a1d740 1 -- start start 2024-04-23T15:02:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.395+0000 7ff984a1d740 1 Processor -- start 2024-04-23T15:02:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b37be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b38120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557578b3cfc0 con 0x557578b3a5a0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557578a4f2c0 con 0x557578b2fce0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557578b3d140 con 0x557578b2f3c0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff984a1d740 10 client.0 _ll_register_callbacks cb 0x5575787a7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff97b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b38120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff97b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b38120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46870/0 (socket says 172.21.15.7:46870) 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff97b400640 1 -- 172.21.15.7:0/3689956046 learned_addr learned my addr 172.21.15.7:0/3689956046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff97a000640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b37be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.396+0000 7ff97aa00640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97b400640 1 -- 172.21.15.7:0/3689956046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 msgr2=0x557578b376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97b400640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97b400640 1 -- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 msgr2=0x557578b37be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97b400640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b37be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97b400640 1 -- 172.21.15.7:0/3689956046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557578a5ffd0 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97a000640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b37be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff97b400640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b38120 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff96c098580 tx=0x7ff96c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d6bbb630221864 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff964c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff964c00640 1 -- 172.21.15.7:0/3689956046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c020040 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff964c00640 1 -- 172.21.15.7:0/3689956046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7ff96c098790 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9680046c0 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.397+0000 7ff964c00640 1 -- 172.21.15.7:0/3689956046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff96c0ba050 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 10 client.16533 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575787a8210 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff964c00640 1 -- 172.21.15.7:0/3689956046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9680046c0 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff964c00640 1 -- 172.21.15.7:0/3689956046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff96c0d0140 con 0x557578b3a5a0 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 10 client.16533 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 10 client.16533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 20 client.16533 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578b4a750 0x557578b4cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 4 client.16533 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.398+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557578aa3320 con 0x557578b4a750 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.399+0000 7ff97aa00640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578b4a750 0x557578b4cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.400+0000 7ff97aa00640 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578b4a750 0x557578b4cb40 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91a4c7a76c09c90 server_cookie=81551902ee67d26d in_seq=0 out_seq=0 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.400+0000 7ff964c00640 10 client.16533 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff964c00640 1 -- 172.21.15.7:0/3689956046 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557578aa3320 con 0x557578b4a750 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff964c00640 10 client.16533 handle_command_reply: tid=0 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 client.16533 shutdown 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 msgr2=0x557578b38120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b38120 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff96c098580 tx=0x7ff96c0057c0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 shutdown_connections 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578b4a750 0x557578b4cb40 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b37be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b38120 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 --2- 172.21.15.7:0/3689956046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 >> 172.21.15.7:0/3689956046 conn(0x557578b2b8d0 msgr2=0x557578b31650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff964c00640 0 client.16533 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 shutdown_connections 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 1 -- 172.21.15.7:0/3689956046 wait complete. 2024-04-23T15:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.402+0000 7ff984a1d740 20 client.16533 trim_cache size 0 max 16384 2024-04-23T15:02:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 Processor -- start 2024-04-23T15:02:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 -- start start 2024-04-23T15:02:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b39dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b2b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b35f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b1380 con 0x557578b2f3c0 2024-04-23T15:02:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b2ec0 con 0x557578b2fce0 2024-04-23T15:02:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.424+0000 7ff984a1d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b1a50 con 0x557578b3a5a0 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b39dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b39dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46872/0 (socket says 172.21.15.7:46872) 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 -- 172.21.15.7:0/1624624825 learned_addr learned my addr 172.21.15.7:0/1624624825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97b400640 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b35f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97a000640 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b2b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 -- 172.21.15.7:0/1624624825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 msgr2=0x557578b35f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b35f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 -- 172.21.15.7:0/1624624825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 msgr2=0x557578b2b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b2b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97aa00640 1 -- 172.21.15.7:0/1624624825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557578b36670 con 0x557578b2f3c0 2024-04-23T15:02:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.425+0000 7ff97a000640 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b2b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.426+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b39dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff974012010 tx=0x7ff974014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c63cee2e7b9ae0b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.426+0000 7ff967400640 1 -- 172.21.15.7:0/1624624825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9740295a0 con 0x557578b2f3c0 2024-04-23T15:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.426+0000 7ff967400640 1 -- 172.21.15.7:0/1624624825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff97402f070 con 0x557578b2f3c0 2024-04-23T15:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.426+0000 7ff967400640 1 -- 172.21.15.7:0/1624624825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97401f450 con 0x557578b2f3c0 2024-04-23T15:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 -- 172.21.15.7:0/1624624825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 msgr2=0x557578b39dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b39dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff974012010 tx=0x7ff974014000 comp rx=0 tx=0).stop 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 -- 172.21.15.7:0/1624624825 shutdown_connections 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b2b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b3a5a0 0x557578b35f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1624624825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b2f3c0 0x557578b39dd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 -- 172.21.15.7:0/1624624825 >> 172.21.15.7:0/1624624825 conn(0x557578b2b8d0 msgr2=0x557578b31650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.427+0000 7ff984a1d740 1 -- 172.21.15.7:0/1624624825 shutdown_connections 2024-04-23T15:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.428+0000 7ff984a1d740 1 -- 172.21.15.7:0/1624624825 wait complete. 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.428+0000 7ff984a1d740 1 -- start start 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.428+0000 7ff984a1d740 1 Processor -- start 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b424d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b3f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b27f0 con 0x557578b3a5a0 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b2120 con 0x557578b2fce0 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1af380 con 0x557578b2f3c0 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff984a1d740 10 client.0 _ll_register_callbacks cb 0x7ff96c0983c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b3f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b3f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46880/0 (socket says 172.21.15.7:46880) 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97b400640 1 -- 172.21.15.7:0/1635738226 learned_addr learned my addr 172.21.15.7:0/1635738226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97a000640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97b400640 1 -- 172.21.15.7:0/1635738226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 msgr2=0x557578b424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.429+0000 7ff97b400640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff97b400640 1 -- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 msgr2=0x557578b42a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff97b400640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b42a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff97b400640 1 -- 172.21.15.7:0/1635738226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557578b3cd00 con 0x557578b3a5a0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff97a000640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff97b400640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b3f4a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009610 tx=0x7ff96c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee55b716c1a43e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff964c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff964c00640 1 -- 172.21.15.7:0/1635738226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c014030 con 0x557578b3a5a0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff964c00640 1 -- 172.21.15.7:0/1635738226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7ff96c09b570 con 0x557578b3a5a0 2024-04-23T15:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff97402f070 con 0x557578b3a5a0 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff964c00640 1 -- 172.21.15.7:0/1635738226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff96c020070 con 0x557578b3a5a0 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.430+0000 7ff984a1d740 10 client.16539 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557578874620 con 0x557578b3a5a0 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff964c00640 1 -- 172.21.15.7:0/1635738226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff97402f070 con 0x557578b3a5a0 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff964c00640 1 -- 172.21.15.7:0/1635738226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff96c0a0120 con 0x557578b3a5a0 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 10 client.16539 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 20 client.16539 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578bba170 0x557578bbc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 4 client.16539 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.431+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557578a9d190 con 0x557578bba170 2024-04-23T15:02:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.432+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578bba170 0x557578bbc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.433+0000 7ff97aa00640 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578bba170 0x557578bbc590 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=379176c47fd39e99 server_cookie=92f5a7262f8d2545 in_seq=0 out_seq=0 2024-04-23T15:02:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.433+0000 7ff964c00640 10 client.16539 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff964c00640 1 -- 172.21.15.7:0/1635738226 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557578a9d190 con 0x557578bba170 2024-04-23T15:02:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff964c00640 10 client.16539 handle_command_reply: tid=0 2024-04-23T15:02:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 client.16539 shutdown 2024-04-23T15:02:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 msgr2=0x557578b3f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b3f4a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009610 tx=0x7ff96c0046c0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 shutdown_connections 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557578bba170 0x557578bbc590 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557578b2fce0 0x557578b42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557578b3a5a0 0x557578b3f4a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 --2- 172.21.15.7:0/1635738226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557578b2f3c0 0x557578b424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff964c00640 0 client.16539 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.463+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 >> 172.21.15.7:0/1635738226 conn(0x557578b2b8d0 msgr2=0x557578b37660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.464+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 shutdown_connections 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.464+0000 7ff984a1d740 1 -- 172.21.15.7:0/1635738226 wait complete. 2024-04-23T15:02:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.464+0000 7ff984a1d740 20 client.16539 trim_cache size 0 max 16384 2024-04-23T15:02:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:02:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:02:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:02:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:02:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9600a3d90 msgr2=0x7ff9600a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9600a3d90 0x7ff9600a6250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x557578b30960 tx=0x7ff974009660 comp rx=0 tx=0).stop 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 msgr2=0x7ff97c19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 0x7ff97c19ac80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d750 tx=0x7ff96c00dc10 comp rx=0 tx=0).stop 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 shutdown_connections 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9600a3d90 0x7ff9600a6250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff97c109380 0x7ff97c1a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff97c19a7d0 0x7ff97c19ac80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 --2- 172.21.15.7:0/1532257827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97c1042b0 0x7ff97c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 >> 172.21.15.7:0/1532257827 conn(0x7ff97c0ffb70 msgr2=0x7ff97c100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 shutdown_connections 2024-04-23T15:02:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:26.465+0000 7ff97be00640 1 -- 172.21.15.7:0/1532257827 wait complete. 2024-04-23T15:02:27.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:27 smithi137 ceph-mon[31694]: pgmap v346: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:28.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:27 smithi007 ceph-mon[27906]: pgmap v346: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:28.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:27 smithi186 ceph-mon[31814]: pgmap v346: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:29 smithi137 ceph-mon[31694]: pgmap v347: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:29 smithi007 ceph-mon[27906]: pgmap v347: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:30.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:29 smithi186 ceph-mon[31814]: pgmap v347: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:31 smithi007 ceph-mon[27906]: pgmap v348: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:31 smithi186 ceph-mon[31814]: pgmap v348: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:31 smithi137 ceph-mon[31694]: pgmap v348: 129 pgs: 129 active+clean; 2.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:33 smithi007 ceph-mon[27906]: pgmap v349: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:34.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:33 smithi186 ceph-mon[31814]: pgmap v349: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:34.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:33 smithi137 ceph-mon[31694]: pgmap v349: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:35 smithi007 ceph-mon[27906]: pgmap v350: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:02:36.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:35 smithi186 ceph-mon[31814]: pgmap v350: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:02:36.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:35 smithi137 ceph-mon[31694]: pgmap v350: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:02:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:37 smithi007 ceph-mon[27906]: pgmap v351: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:37 smithi186 ceph-mon[31814]: pgmap v351: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:37 smithi137 ceph-mon[31694]: pgmap v351: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 -- 172.21.15.7:0/4150780118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc074cf0 msgr2=0x7fd1dc10e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/4150780118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc074cf0 0x7fd1dc10e180 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009900 tx=0x7fd1cc02a4a0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 -- 172.21.15.7:0/4150780118 shutdown_connections 2024-04-23T15:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/4150780118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1dc10e6c0 0x7fd1dc110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/4150780118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc074cf0 0x7fd1dc10e180 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/4150780118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc0747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 -- 172.21.15.7:0/4150780118 >> 172.21.15.7:0/4150780118 conn(0x7fd1dc0fd950 msgr2=0x7fd1dc0ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 -- 172.21.15.7:0/4150780118 shutdown_connections 2024-04-23T15:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.621+0000 7fd1dbe00640 1 -- 172.21.15.7:0/4150780118 wait complete. 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.622+0000 7fd1dbe00640 1 Processor -- start 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 -- start start 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc1a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1dc074cf0 0x7fd1dc1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1dc10e6c0 0x7fd1dc19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc114380 con 0x7fd1dc0743d0 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc114200 con 0x7fd1dc074cf0 2024-04-23T15:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1dbe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc114500 con 0x7fd1dc10e6c0 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc1a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc1a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40092/0 (socket says 172.21.15.7:40092) 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.623+0000 7fd1daa00640 1 -- 172.21.15.7:0/3005847357 learned_addr learned my addr 172.21.15.7:0/3005847357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1da000640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1dc074cf0 0x7fd1dc1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1db400640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1dc10e6c0 0x7fd1dc19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1daa00640 1 -- 172.21.15.7:0/3005847357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1dc10e6c0 msgr2=0x7fd1dc19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1daa00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1dc10e6c0 0x7fd1dc19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1daa00640 1 -- 172.21.15.7:0/3005847357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1dc074cf0 msgr2=0x7fd1dc1a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1daa00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1dc074cf0 0x7fd1dc1a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1daa00640 1 -- 172.21.15.7:0/3005847357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc19afc0 con 0x7fd1dc0743d0 2024-04-23T15:02:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.624+0000 7fd1daa00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc1a0640 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400eab0 tx=0x7fd1d400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.625+0000 7fd1d3400640 1 -- 172.21.15.7:0/3005847357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400ce40 con 0x7fd1dc0743d0 2024-04-23T15:02:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.625+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1dc19b2b0 con 0x7fd1dc0743d0 2024-04-23T15:02:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.625+0000 7fd1d3400640 1 -- 172.21.15.7:0/3005847357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1d4011920 con 0x7fd1dc0743d0 2024-04-23T15:02:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.625+0000 7fd1d3400640 1 -- 172.21.15.7:0/3005847357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4010a00 con 0x7fd1dc0743d0 2024-04-23T15:02:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.625+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1dc1a75c0 con 0x7fd1dc0743d0 2024-04-23T15:02:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.629+0000 7fd1d3400640 1 -- 172.21.15.7:0/3005847357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd1d4011ad0 con 0x7fd1dc0743d0 2024-04-23T15:02:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.629+0000 7fd1e47de740 1 Processor -- start 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.629+0000 7fd1e47de740 1 -- start start 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.629+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.629+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.629+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d51990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1e47de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557b45caa900 con 0x557b45d443c0 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1e47de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557b45c50f20 con 0x557b45d4f5a0 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1e47de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557b45ca68c0 con 0x557b45d44ce0 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40108/0 (socket says 172.21.15.7:40108) 2024-04-23T15:02:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1db400640 1 -- 172.21.15.7:0/822867201 learned_addr learned my addr 172.21.15.7:0/822867201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1da000640 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1daa00640 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.630+0000 7fd1db400640 1 -- 172.21.15.7:0/822867201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 msgr2=0x557b45d4f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1db400640 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1db400640 1 -- 172.21.15.7:0/822867201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 msgr2=0x557b45d51990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1db400640 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d51990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1db400640 1 -- 172.21.15.7:0/822867201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b45c75e10 con 0x557b45d443c0 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1d3400640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd1c00a3d90 0x7fd1c00a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1daa00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd1c00a3d90 0x7fd1c00a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1db400640 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d447a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400b740 tx=0x7fd1c400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2acaafd816bea3e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1d3400640 1 -- 172.21.15.7:0/3005847357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7fd1d40d12a0 con 0x7fd1dc0743d0 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1cbe00640 1 -- 172.21.15.7:0/822867201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400be50 con 0x557b45d443c0 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1cbe00640 1 -- 172.21.15.7:0/822867201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1c4019070 con 0x557b45d443c0 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.631+0000 7fd1cbe00640 1 -- 172.21.15.7:0/822867201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4014d10 con 0x557b45d443c0 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.632+0000 7fd1e47de740 1 -- 172.21.15.7:0/822867201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 msgr2=0x557b45d447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.632+0000 7fd1daa00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd1c00a3d90 0x7fd1c00a6250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x557b45d45960 tx=0x7fd1d40094a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.632+0000 7fd1e47de740 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d447a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400b740 tx=0x7fd1c400bc00 comp rx=0 tx=0).stop 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 -- 172.21.15.7:0/822867201 shutdown_connections 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d51990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 --2- 172.21.15.7:0/822867201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d447a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 -- 172.21.15.7:0/822867201 >> 172.21.15.7:0/822867201 conn(0x557b45d408d0 msgr2=0x557b45d40cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 -- 172.21.15.7:0/822867201 shutdown_connections 2024-04-23T15:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 -- 172.21.15.7:0/822867201 wait complete. 2024-04-23T15:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 -- start start 2024-04-23T15:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.633+0000 7fd1e47de740 1 Processor -- start 2024-04-23T15:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d4c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d4d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557b45d520e0 con 0x557b45d443c0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557b45c642c0 con 0x557b45d4f5a0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557b45d52260 con 0x557b45d44ce0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1e47de740 10 client.0 _ll_register_callbacks cb 0x557b459bca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d4c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d4c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40114/0 (socket says 172.21.15.7:40114) 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.634+0000 7fd1db400640 1 -- 172.21.15.7:0/3477825721 learned_addr learned my addr 172.21.15.7:0/3477825721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1da000640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d4d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 -- 172.21.15.7:0/3477825721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 msgr2=0x557b45d4cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 -- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 msgr2=0x557b45d4d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d4d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 -- 172.21.15.7:0/3477825721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b45c74fd0 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1db400640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d4c5a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4014850 tx=0x7fd1c40149e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff195255b29bcf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.635+0000 7fd1c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1c8c00640 1 -- 172.21.15.7:0/3477825721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400db50 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1c4019070 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1c8c00640 1 -- 172.21.15.7:0/3477825721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7fd1c400dcf0 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1c8c00640 1 -- 172.21.15.7:0/3477825721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd1c4032050 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1e47de740 10 client.16551 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557b459bd210 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.636+0000 7fd1c8c00640 1 -- 172.21.15.7:0/3477825721 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1c4019070 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1c8c00640 1 -- 172.21.15.7:0/3477825721 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd1c4013070 con 0x557b45d443c0 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1e47de740 10 client.16551 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1e47de740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1e47de740 20 client.16551 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1e47de740 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45d67ef0 0x557b45d6a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1e47de740 4 client.16551 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.637+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b45cb8320 con 0x557b45d67ef0 2024-04-23T15:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.638+0000 7fd1da000640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45d67ef0 0x557b45d6a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.638+0000 7fd1da000640 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45d67ef0 0x557b45d6a2e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75fad6f6f68449a9 server_cookie=dc40332f04c34aff in_seq=0 out_seq=0 2024-04-23T15:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.638+0000 7fd1c8c00640 10 client.16551 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.640+0000 7fd1c8c00640 1 -- 172.21.15.7:0/3477825721 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557b45cb8320 con 0x557b45d67ef0 2024-04-23T15:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.640+0000 7fd1c8c00640 10 client.16551 handle_command_reply: tid=0 2024-04-23T15:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.640+0000 7fd1e47de740 1 client.16551 shutdown 2024-04-23T15:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 msgr2=0x557b45d4c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d4c5a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4014850 tx=0x7fd1c40149e0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 shutdown_connections 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45d67ef0 0x557b45d6a2e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d4d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d4cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 --2- 172.21.15.7:0/3477825721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d4c5a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 >> 172.21.15.7:0/3477825721 conn(0x557b45d408d0 msgr2=0x557b45d46600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1c8c00640 0 client.16551 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 shutdown_connections 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 1 -- 172.21.15.7:0/3477825721 wait complete. 2024-04-23T15:02:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.641+0000 7fd1e47de740 20 client.16551 trim_cache size 0 max 16384 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.662+0000 7fd1e47de740 1 Processor -- start 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 -- start start 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d443c0 0x557b45d4ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 0x557b45d40210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d45d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1ad0a0 con 0x557b45d44ce0 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1aebe0 con 0x557b45d4f5a0 2024-04-23T15:02:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1e47de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1ad770 con 0x557b45d443c0 2024-04-23T15:02:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1da000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 0x557b45d40210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1da000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 0x557b45d40210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40126/0 (socket says 172.21.15.7:40126) 2024-04-23T15:02:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.663+0000 7fd1da000640 1 -- 172.21.15.7:0/2453972941 learned_addr learned my addr 172.21.15.7:0/2453972941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1db400640 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d443c0 0x557b45d4ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1db400640 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d45d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1da000640 1 -- 172.21.15.7:0/2453972941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d443c0 msgr2=0x557b45d4ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1da000640 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d443c0 0x557b45d4ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1da000640 1 -- 172.21.15.7:0/2453972941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 msgr2=0x557b45d45d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1da000640 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d45d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1da000640 1 -- 172.21.15.7:0/2453972941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b45d51d00 con 0x557b45d44ce0 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1db400640 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d45d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1da000640 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 0x557b45d40210 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc02aa60 tx=0x7fd1cc005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b69a56adc5e8b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.664+0000 7fd1cb400640 1 -- 172.21.15.7:0/2453972941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc035040 con 0x557b45d44ce0 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.665+0000 7fd1cb400640 1 -- 172.21.15.7:0/2453972941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1cc04a070 con 0x557b45d44ce0 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.665+0000 7fd1cb400640 1 -- 172.21.15.7:0/2453972941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc004920 con 0x557b45d44ce0 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.665+0000 7fd1e47de740 1 -- 172.21.15.7:0/2453972941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 msgr2=0x557b45d40210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.665+0000 7fd1e47de740 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 0x557b45d40210 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc02aa60 tx=0x7fd1cc005bb0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 -- 172.21.15.7:0/2453972941 shutdown_connections 2024-04-23T15:02:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d45d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d44ce0 0x557b45d40210 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 --2- 172.21.15.7:0/2453972941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d443c0 0x557b45d4ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 -- 172.21.15.7:0/2453972941 >> 172.21.15.7:0/2453972941 conn(0x557b45d408d0 msgr2=0x557b45d4cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 -- 172.21.15.7:0/2453972941 shutdown_connections 2024-04-23T15:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 -- 172.21.15.7:0/2453972941 wait complete. 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 -- start start 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.666+0000 7fd1e47de740 1 Processor -- start 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d48ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d49430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1ae510 con 0x557b45d443c0 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1ade40 con 0x557b45d4f5a0 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc1ab0a0 con 0x557b45d44ce0 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1e47de740 10 client.0 _ll_register_callbacks cb 0x7fd1cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40134/0 (socket says 172.21.15.7:40134) 2024-04-23T15:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1db400640 1 -- 172.21.15.7:0/4158624287 learned_addr learned my addr 172.21.15.7:0/4158624287 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.667+0000 7fd1da000640 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d48ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1db400640 1 -- 172.21.15.7:0/4158624287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 msgr2=0x557b45d48ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1db400640 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d48ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1db400640 1 -- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 msgr2=0x557b45d49430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1db400640 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d49430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1db400640 1 -- 172.21.15.7:0/4158624287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b45a89620 con 0x557b45d443c0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1db400640 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d601d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd1c401e5a0 tx=0x7fd1c4006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbcdb5708d84d9f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1c8c00640 1 -- 172.21.15.7:0/4158624287 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4014630 con 0x557b45d443c0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1c8c00640 1 -- 172.21.15.7:0/4158624287 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7fd1c400d950 con 0x557b45d443c0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.668+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1cc04a070 con 0x557b45d443c0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1c8c00640 1 -- 172.21.15.7:0/4158624287 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd1c400b590 con 0x557b45d443c0 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 10 client.16557 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557b45dcde40 con 0x557b45d443c0 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1c8c00640 1 -- 172.21.15.7:0/4158624287 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1cc04a070 con 0x557b45d443c0 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1c8c00640 1 -- 172.21.15.7:0/4158624287 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd1c401e680 con 0x557b45d443c0 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 10 client.16557 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 20 client.16557 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45dce4d0 0x557b45dd08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 4 client.16557 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.669+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b45cb2190 con 0x557b45dce4d0 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.670+0000 7fd1da000640 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45dce4d0 0x557b45dd08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.671+0000 7fd1da000640 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45dce4d0 0x557b45dd08f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e173ffd9878e089 server_cookie=556a8aae35c4c028 in_seq=0 out_seq=0 2024-04-23T15:02:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.671+0000 7fd1c8c00640 10 client.16557 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1c8c00640 1 -- 172.21.15.7:0/4158624287 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b45cb2190 con 0x557b45dce4d0 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1c8c00640 10 client.16557 handle_command_reply: tid=0 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 client.16557 shutdown 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 msgr2=0x557b45d601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d601d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd1c401e5a0 tx=0x7fd1c4006a30 comp rx=0 tx=0).stop 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 shutdown_connections 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557b45dce4d0 0x557b45dd08f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557b45d4f5a0 0x557b45d49430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b45d44ce0 0x557b45d48ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.698+0000 7fd1e47de740 1 --2- 172.21.15.7:0/4158624287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557b45d443c0 0x557b45d601d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.699+0000 7fd1c8c00640 0 client.16557 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.699+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 >> 172.21.15.7:0/4158624287 conn(0x557b45d408d0 msgr2=0x557b45d4dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.699+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 shutdown_connections 2024-04-23T15:02:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.699+0000 7fd1e47de740 1 -- 172.21.15.7:0/4158624287 wait complete. 2024-04-23T15:02:39.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.699+0000 7fd1e47de740 20 client.16557 trim_cache size 0 max 16384 2024-04-23T15:02:39.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:02:39.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:02:39.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:02:39.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd1c00a3d90 msgr2=0x7fd1c00a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd1c00a3d90 0x7fd1c00a6250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x557b45d45960 tx=0x7fd1d40094a0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 msgr2=0x7fd1dc1a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc1a0640 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400eab0 tx=0x7fd1d400ef70 comp rx=0 tx=0).stop 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 shutdown_connections 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd1c00a3d90 0x7fd1c00a6250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1dc074cf0 0x7fd1dc1a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1dc10e6c0 0x7fd1dc19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 --2- 172.21.15.7:0/3005847357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0743d0 0x7fd1dc1a0640 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.700+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 >> 172.21.15.7:0/3005847357 conn(0x7fd1dc0fd950 msgr2=0x7fd1dc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.701+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 shutdown_connections 2024-04-23T15:02:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:39.701+0000 7fd1dbe00640 1 -- 172.21.15.7:0/3005847357 wait complete. 2024-04-23T15:02:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:39 smithi007 ceph-mon[27906]: pgmap v352: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:39 smithi186 ceph-mon[31814]: pgmap v352: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:40.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:39 smithi137 ceph-mon[31694]: pgmap v352: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:41 smithi007 ceph-mon[27906]: pgmap v353: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:42.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:41 smithi186 ceph-mon[31814]: pgmap v353: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:42.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:41 smithi137 ceph-mon[31694]: pgmap v353: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:43.970 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:43 smithi137 ceph-mon[31694]: pgmap v354: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:02:44.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:43 smithi007 ceph-mon[27906]: pgmap v354: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:02:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:43 smithi186 ceph-mon[31814]: pgmap v354: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:02:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:45 smithi007 ceph-mon[27906]: pgmap v355: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:45 smithi186 ceph-mon[31814]: pgmap v355: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:45 smithi137 ceph-mon[31694]: pgmap v355: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:02:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:47 smithi007 ceph-mon[27906]: pgmap v356: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:47 smithi186 ceph-mon[31814]: pgmap v356: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:47 smithi137 ceph-mon[31694]: pgmap v356: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:49 smithi007 ceph-mon[27906]: pgmap v357: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:02:50.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:49 smithi186 ceph-mon[31814]: pgmap v357: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:02:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:49 smithi137 ceph-mon[31694]: pgmap v357: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:02:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:51 smithi007 ceph-mon[27906]: pgmap v358: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:02:52.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:51 smithi186 ceph-mon[31814]: pgmap v358: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:02:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:51 smithi137 ceph-mon[31694]: pgmap v358: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:02:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 -- 172.21.15.7:0/382376153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4109360 msgr2=0x7f33f4110f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 --2- 172.21.15.7:0/382376153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4109360 0x7f33f4110f30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009ca0 tx=0x7f33ec02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 -- 172.21.15.7:0/382376153 shutdown_connections 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 --2- 172.21.15.7:0/382376153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f4104c40 0x7f33f4108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 --2- 172.21.15.7:0/382376153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4109360 0x7f33f4110f30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 --2- 172.21.15.7:0/382376153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4104290 0x7f33f4104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 -- 172.21.15.7:0/382376153 >> 172.21.15.7:0/382376153 conn(0x7f33f40ffb10 msgr2=0x7f33f4101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 -- 172.21.15.7:0/382376153 shutdown_connections 2024-04-23T15:02:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.854+0000 7f33f3200640 1 -- 172.21.15.7:0/382376153 wait complete. 2024-04-23T15:02:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 Processor -- start 2024-04-23T15:02:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 -- start start 2024-04-23T15:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 0x7f33f41a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4109360 0x7f33f41a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f419a720 0x7f33f419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4114300 con 0x7f33f4104290 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4114180 con 0x7f33f419a720 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.856+0000 7f33f3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4114480 con 0x7f33f4109360 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 0x7f33f41a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 0x7f33f41a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37978/0 (socket says 172.21.15.7:37978) 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 -- 172.21.15.7:0/1051192218 learned_addr learned my addr 172.21.15.7:0/1051192218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1400640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4109360 0x7f33f41a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f2800640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f419a720 0x7f33f419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 -- 172.21.15.7:0/1051192218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4109360 msgr2=0x7f33f41a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4109360 0x7f33f41a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 -- 172.21.15.7:0/1051192218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f419a720 msgr2=0x7f33f419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f419a720 0x7f33f419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1e00640 1 -- 172.21.15.7:0/1051192218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f419b320 con 0x7f33f4104290 2024-04-23T15:02:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f1400640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4109360 0x7f33f41a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.857+0000 7f33f2800640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f419a720 0x7f33f419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.858+0000 7f33f1e00640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 0x7f33f41a0610 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f33e400d950 tx=0x7f33e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.858+0000 7f33eaa00640 1 -- 172.21.15.7:0/1051192218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4017030 con 0x7f33f4104290 2024-04-23T15:02:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.858+0000 7f33eaa00640 1 -- 172.21.15.7:0/1051192218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e4004020 con 0x7f33f4104290 2024-04-23T15:02:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.858+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f41a73b0 con 0x7f33f4104290 2024-04-23T15:02:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.858+0000 7f33eaa00640 1 -- 172.21.15.7:0/1051192218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40047a0 con 0x7f33f4104290 2024-04-23T15:02:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.858+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a77b0 con 0x7f33f4104290 2024-04-23T15:02:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.862+0000 7f33eaa00640 1 -- 172.21.15.7:0/1051192218 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f33e40041d0 con 0x7f33f4104290 2024-04-23T15:02:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.862+0000 7f33fc018740 1 Processor -- start 2024-04-23T15:02:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.862+0000 7f33fc018740 1 -- start start 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.862+0000 7f33fc018740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f454c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.862+0000 7f33fc018740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f4557060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.862+0000 7f33fc018740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4559990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33fc018740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b0f44b2900 con 0x55b0f454cce0 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33fc018740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b0f4458f20 con 0x55b0f45575a0 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33fc018740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b0f44ae8c0 con 0x55b0f454c3c0 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f4557060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f4557060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47170/0 (socket says 172.21.15.7:47170) 2024-04-23T15:02:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 -- 172.21.15.7:0/4035950575 learned_addr learned my addr 172.21.15.7:0/4035950575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f2800640 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f454c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1400640 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4559990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 -- 172.21.15.7:0/4035950575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 msgr2=0x55b0f454c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f454c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 -- 172.21.15.7:0/4035950575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 msgr2=0x55b0f4559990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.863+0000 7f33f1e00640 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4559990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33f1e00640 1 -- 172.21.15.7:0/4035950575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f447de10 con 0x55b0f454cce0 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33eaa00640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33d80a3d10 0x7f33d80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33eaa00640 1 -- 172.21.15.7:0/1051192218 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7f33e40d0740 con 0x7f33f4104290 2024-04-23T15:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33f1e00640 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f4557060 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f33e40cd9c0 tx=0x7f33e40d6ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b6b7d926e67dd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33f2800640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33d80a3d10 0x7f33d80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33df400640 1 -- 172.21.15.7:0/4035950575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4098570 con 0x55b0f454cce0 2024-04-23T15:02:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33df400640 1 -- 172.21.15.7:0/4035950575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e409c9d0 con 0x55b0f454cce0 2024-04-23T15:02:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.864+0000 7f33df400640 1 -- 172.21.15.7:0/4035950575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e409bc30 con 0x55b0f454cce0 2024-04-23T15:02:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 -- 172.21.15.7:0/4035950575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 msgr2=0x55b0f4557060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f4557060 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f33e40cd9c0 tx=0x7f33e40d6ef0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33f2800640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33d80a3d10 0x7f33d80a61d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33ec004af0 tx=0x7f33ec004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 -- 172.21.15.7:0/4035950575 shutdown_connections 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4559990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f4557060 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 --2- 172.21.15.7:0/4035950575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f454c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.865+0000 7f33fc018740 1 -- 172.21.15.7:0/4035950575 >> 172.21.15.7:0/4035950575 conn(0x55b0f45488d0 msgr2=0x55b0f4548cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.866+0000 7f33fc018740 1 -- 172.21.15.7:0/4035950575 shutdown_connections 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.866+0000 7f33fc018740 1 -- 172.21.15.7:0/4035950575 wait complete. 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.866+0000 7f33fc018740 1 -- start start 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.866+0000 7f33fc018740 1 Processor -- start 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4554510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f4554a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4554f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b0f455a140 con 0x55b0f454c3c0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b0f446c2c0 con 0x55b0f45575a0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b0f455a2c0 con 0x55b0f454cce0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33fc018740 10 client.0 _ll_register_callbacks cb 0x55b0f41c4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4554510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4554510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47172/0 (socket says 172.21.15.7:47172) 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33f1e00640 1 -- 172.21.15.7:0/2688702748 learned_addr learned my addr 172.21.15.7:0/2688702748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33f2800640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4554f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.867+0000 7f33f1400640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f4554a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f1e00640 1 -- 172.21.15.7:0/2688702748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 msgr2=0x55b0f4554a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f1e00640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f4554a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f1e00640 1 -- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 msgr2=0x55b0f4554f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f1e00640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4554f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f1e00640 1 -- 172.21.15.7:0/2688702748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f447cfd0 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f2800640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4554f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33f1e00640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4554510 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f33e40a4a10 tx=0x7f33e4098b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b5d507ca93108b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33d3e00640 1 -- 172.21.15.7:0/2688702748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b5060 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33d3e00640 1 -- 172.21.15.7:0/2688702748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7f33e409a5d0 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.868+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e409c9d0 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33d3e00640 1 -- 172.21.15.7:0/2688702748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f33e409be10 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 10 client.16569 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0f41c5210 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33d3e00640 1 -- 172.21.15.7:0/2688702748 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e409c9d0 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33d3e00640 1 -- 172.21.15.7:0/2688702748 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f33e400e350 con 0x55b0f454c3c0 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 10 client.16569 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 20 client.16569 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f4567550 0x55b0f4569940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 4 client.16569 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.869+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0f44c0320 con 0x55b0f4567550 2024-04-23T15:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.870+0000 7f33f1400640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f4567550 0x55b0f4569940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.871+0000 7f33f1400640 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f4567550 0x55b0f4569940 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a10c9889fff502 server_cookie=51341f492514bffe in_seq=0 out_seq=0 2024-04-23T15:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.871+0000 7f33d3e00640 10 client.16569 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33d3e00640 1 -- 172.21.15.7:0/2688702748 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0f44c0320 con 0x55b0f4567550 2024-04-23T15:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33d3e00640 10 client.16569 handle_command_reply: tid=0 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 client.16569 shutdown 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 msgr2=0x55b0f4554510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4554510 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f33e40a4a10 tx=0x7f33e4098b70 comp rx=0 tx=0).stop 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 shutdown_connections 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f4567550 0x55b0f4569940 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f4554f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f4554a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 --2- 172.21.15.7:0/2688702748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4554510 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33d3e00640 0 client.16569 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 >> 172.21.15.7:0/2688702748 conn(0x55b0f45488d0 msgr2=0x55b0f4547a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 shutdown_connections 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.873+0000 7f33fc018740 1 -- 172.21.15.7:0/2688702748 wait complete. 2024-04-23T15:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.874+0000 7f33fc018740 20 client.16569 trim_cache size 0 max 16384 2024-04-23T15:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.893+0000 7f33fc018740 1 Processor -- start 2024-04-23T15:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.893+0000 7f33fc018740 1 -- start start 2024-04-23T15:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.893+0000 7f33fc018740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4556bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.893+0000 7f33fc018740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f454e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.893+0000 7f33fc018740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f45517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33fc018740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41b14e0 con 0x55b0f454c3c0 2024-04-23T15:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33fc018740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41b3020 con 0x55b0f45575a0 2024-04-23T15:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33fc018740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41b1bb0 con 0x55b0f454cce0 2024-04-23T15:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4556bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4556bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47184/0 (socket says 172.21.15.7:47184) 2024-04-23T15:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 -- 172.21.15.7:0/3603478825 learned_addr learned my addr 172.21.15.7:0/3603478825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1400640 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f454e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f2800640 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f45517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 -- 172.21.15.7:0/3603478825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 msgr2=0x55b0f454e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f454e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 -- 172.21.15.7:0/3603478825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 msgr2=0x55b0f45517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f45517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.894+0000 7f33f1e00640 1 -- 172.21.15.7:0/3603478825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f4291620 con 0x55b0f454c3c0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.895+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4556bd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f33e409a580 tx=0x7f33e40d6ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d963a7fad5c76f08 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.895+0000 7f33dea00640 1 -- 172.21.15.7:0/3603478825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b5040 con 0x55b0f454c3c0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.895+0000 7f33dea00640 1 -- 172.21.15.7:0/3603478825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e40d6300 con 0x55b0f454c3c0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.895+0000 7f33dea00640 1 -- 172.21.15.7:0/3603478825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e409c0a0 con 0x55b0f454c3c0 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 -- 172.21.15.7:0/3603478825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 msgr2=0x55b0f4556bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4556bd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f33e409a580 tx=0x7f33e40d6ef0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 -- 172.21.15.7:0/3603478825 shutdown_connections 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f45517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454cce0 0x55b0f454e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 --2- 172.21.15.7:0/3603478825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454c3c0 0x55b0f4556bd0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 -- 172.21.15.7:0/3603478825 >> 172.21.15.7:0/3603478825 conn(0x55b0f45488d0 msgr2=0x55b0f454dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 -- 172.21.15.7:0/3603478825 shutdown_connections 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 -- 172.21.15.7:0/3603478825 wait complete. 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.896+0000 7f33fc018740 1 -- start start 2024-04-23T15:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 Processor -- start 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f456cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f456af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f456b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41b2950 con 0x55b0f454cce0 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41b2280 con 0x55b0f45575a0 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41af4e0 con 0x55b0f454c3c0 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.897+0000 7f33fc018740 10 client.0 _ll_register_callbacks cb 0x7f33e40d68e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f456af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f456af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47198/0 (socket says 172.21.15.7:47198) 2024-04-23T15:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 -- 172.21.15.7:0/3311982819 learned_addr learned my addr 172.21.15.7:0/3311982819 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f456cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f2800640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f456b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 -- 172.21.15.7:0/3311982819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 msgr2=0x55b0f456cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f456cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 -- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 msgr2=0x55b0f456b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f456b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 -- 172.21.15.7:0/3311982819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f456bbb0 con 0x55b0f454cce0 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f456cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f2800640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f456b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33f1400640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f456af80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e000fa90 tx=0x7f33e00127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135da97486c9eeb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.898+0000 7f33d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33d3e00640 1 -- 172.21.15.7:0/3311982819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e001cdd0 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33d3e00640 1 -- 172.21.15.7:0/3311982819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7f33e001c3b0 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e40d6300 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33d3e00640 1 -- 172.21.15.7:0/3311982819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f33e002a050 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33fc018740 10 client.16575 fetch_fsmap learned FSMap version 32 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0f45ce700 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.899+0000 7f33d3e00640 1 -- 172.21.15.7:0/3311982819 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e40d6300 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33d3e00640 1 -- 172.21.15.7:0/3311982819 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f33e000f040 con 0x55b0f454cce0 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33fc018740 10 client.16575 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33fc018740 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33fc018740 20 client.16575 populate_metadata read hostname 'smithi007' 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33fc018740 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f45cef00 0x55b0f45d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33fc018740 4 client.16575 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0f44ba190 con 0x55b0f45cef00 2024-04-23T15:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.900+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f45cef00 0x55b0f45d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.901+0000 7f33f1e00640 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f45cef00 0x55b0f45d1320 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369c1808296c0746 server_cookie=962d883335de1efa in_seq=0 out_seq=0 2024-04-23T15:02:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.901+0000 7f33d3e00640 10 client.16575 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33d3e00640 1 -- 172.21.15.7:0/3311982819 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0f44ba190 con 0x55b0f45cef00 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33d3e00640 10 client.16575 handle_command_reply: tid=0 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33fc018740 1 client.16575 shutdown 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 msgr2=0x55b0f456af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33fc018740 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f456af80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e000fa90 tx=0x7f33e00127c0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 shutdown_connections 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.930+0000 7f33fc018740 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0f45cef00 0x55b0f45d1320 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0f45575a0 0x55b0f456b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0f454cce0 0x55b0f456af80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 1 --2- 172.21.15.7:0/3311982819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0f454c3c0 0x55b0f456cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33d3e00640 0 client.16575 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 >> 172.21.15.7:0/3311982819 conn(0x55b0f45488d0 msgr2=0x55b0f4562ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 shutdown_connections 2024-04-23T15:02:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 1 -- 172.21.15.7:0/3311982819 wait complete. 2024-04-23T15:02:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.931+0000 7f33fc018740 20 client.16575 trim_cache size 0 max 16384 2024-04-23T15:02:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:02:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:02:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:02:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33d80a3d10 msgr2=0x7f33d80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33d80a3d10 0x7f33d80a61d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33ec004af0 tx=0x7f33ec004a40 comp rx=0 tx=0).stop 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 msgr2=0x7f33f41a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 0x7f33f41a0610 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f33e400d950 tx=0x7f33e400de10 comp rx=0 tx=0).stop 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 shutdown_connections 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33d80a3d10 0x7f33d80a61d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33f419a720 0x7f33f419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33f4109360 0x7f33f41a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 --2- 172.21.15.7:0/1051192218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4104290 0x7f33f41a0610 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 >> 172.21.15.7:0/1051192218 conn(0x7f33f40ffb10 msgr2=0x7f33f4101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 shutdown_connections 2024-04-23T15:02:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:02:52.932+0000 7f33f3200640 1 -- 172.21.15.7:0/1051192218 wait complete. 2024-04-23T15:02:54.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:53 smithi007 ceph-mon[27906]: pgmap v359: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:54.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:02:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:53 smithi186 ceph-mon[31814]: pgmap v359: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:02:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:53 smithi137 ceph-mon[31694]: pgmap v359: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:02:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:02:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:54 smithi007 ceph-mon[27906]: pgmap v360: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:02:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:02:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:54 smithi186 ceph-mon[31814]: pgmap v360: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:02:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:02:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:54 smithi137 ceph-mon[31694]: pgmap v360: 129 pgs: 129 active+clean; 2.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:02:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:02:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:02:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:55 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:02:56.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:55 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:02:56.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:55 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:02:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:56 smithi007 ceph-mon[27906]: pgmap v361: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:02:57.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:56 smithi186 ceph-mon[31814]: pgmap v361: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:02:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:56 smithi137 ceph-mon[31694]: pgmap v361: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:02:59.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:02:59 smithi137 ceph-mon[31694]: pgmap v362: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:03:00.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:02:59 smithi007 ceph-mon[27906]: pgmap v362: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:03:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:02:59 smithi186 ceph-mon[31814]: pgmap v362: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:03:01.915 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:01 smithi186 ceph-mon[31814]: pgmap v363: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:03:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:01 smithi137 ceph-mon[31694]: pgmap v363: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:03:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:01 smithi007 ceph-mon[27906]: pgmap v363: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:03:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:03 smithi137 ceph-mon[31694]: pgmap v364: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-04-23T15:03:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:03 smithi007 ceph-mon[27906]: pgmap v364: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-04-23T15:03:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:03 smithi186 ceph-mon[31814]: pgmap v364: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-04-23T15:03:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:05 smithi137 ceph-mon[31694]: pgmap v365: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 30 op/s 2024-04-23T15:03:06.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:05 smithi007 ceph-mon[27906]: pgmap v365: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 30 op/s 2024-04-23T15:03:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.084+0000 7fd2af200640 1 -- 172.21.15.7:0/3937272863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a810e6c0 msgr2=0x7fd2a8110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.084+0000 7fd2af200640 1 --2- 172.21.15.7:0/3937272863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a810e6c0 0x7fd2a8110ad0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009ca0 tx=0x7fd2a402a950 comp rx=0 tx=0).stop 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 -- 172.21.15.7:0/3937272863 shutdown_connections 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 --2- 172.21.15.7:0/3937272863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a810e6c0 0x7fd2a8110ad0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 --2- 172.21.15.7:0/3937272863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2a8074cf0 0x7fd2a810e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 --2- 172.21.15.7:0/3937272863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a80743d0 0x7fd2a80747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 -- 172.21.15.7:0/3937272863 >> 172.21.15.7:0/3937272863 conn(0x7fd2a80fd950 msgr2=0x7fd2a80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 -- 172.21.15.7:0/3937272863 shutdown_connections 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.085+0000 7fd2af200640 1 -- 172.21.15.7:0/3937272863 wait complete. 2024-04-23T15:03:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 Processor -- start 2024-04-23T15:03:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 -- start start 2024-04-23T15:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2a80743d0 0x7fd2a81a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 0x7fd2a81a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a810e6c0 0x7fd2a819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a8114300 con 0x7fd2a8074cf0 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a8114180 con 0x7fd2a810e6c0 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.086+0000 7fd2af200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a8114480 con 0x7fd2a80743d0 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 0x7fd2a81a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 0x7fd2a81a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42916/0 (socket says 172.21.15.7:42916) 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 -- 172.21.15.7:0/3790749678 learned_addr learned my addr 172.21.15.7:0/3790749678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ade00640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2a80743d0 0x7fd2a81a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ae800640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a810e6c0 0x7fd2a819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 -- 172.21.15.7:0/3790749678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2a80743d0 msgr2=0x7fd2a81a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2a80743d0 0x7fd2a81a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 -- 172.21.15.7:0/3790749678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a810e6c0 msgr2=0x7fd2a819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a810e6c0 0x7fd2a819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.087+0000 7fd2ad400640 1 -- 172.21.15.7:0/3790749678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a819af00 con 0x7fd2a8074cf0 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.088+0000 7fd2ad400640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 0x7fd2a81a0ac0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd29800e9f0 tx=0x7fd29800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.088+0000 7fd2a2a00640 1 -- 172.21.15.7:0/3790749678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29800cd80 con 0x7fd2a8074cf0 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.088+0000 7fd2a2a00640 1 -- 172.21.15.7:0/3790749678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2980054d0 con 0x7fd2a8074cf0 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.088+0000 7fd2a2a00640 1 -- 172.21.15.7:0/3790749678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298010490 con 0x7fd2a8074cf0 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.088+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a819b1f0 con 0x7fd2a8074cf0 2024-04-23T15:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.088+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a81a7500 con 0x7fd2a8074cf0 2024-04-23T15:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.092+0000 7fd2b364c740 1 Processor -- start 2024-04-23T15:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.092+0000 7fd2b364c740 1 -- start start 2024-04-23T15:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.092+0000 7fd2a2a00640 1 -- 172.21.15.7:0/3790749678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd298005020 con 0x7fd2a8074cf0 2024-04-23T15:03:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2de060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d2e0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2b364c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55664d239900 con 0x55664d2d3ce0 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2b364c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55664d1dff20 con 0x55664d2d33c0 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2b364c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55664d2358c0 con 0x55664d2de5a0 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2ade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2ade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42928/0 (socket says 172.21.15.7:42928) 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2ade00640 1 -- 172.21.15.7:0/1065344334 learned_addr learned my addr 172.21.15.7:0/1065344334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2ad400640 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d2e0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.093+0000 7fd2ae800640 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2ade00640 1 -- 172.21.15.7:0/1065344334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 msgr2=0x55664d2e0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2ade00640 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d2e0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2ade00640 1 -- 172.21.15.7:0/1065344334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 msgr2=0x55664d2d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2ade00640 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2ade00640 1 -- 172.21.15.7:0/1065344334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55664d204e10 con 0x55664d2d3ce0 2024-04-23T15:03:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2ade00640 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2de060 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009c80 tx=0x7fd29c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f50f544bb2263e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd2a2a00640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd2900a3d10 0x7fd2900a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.094+0000 7fd297000640 1 -- 172.21.15.7:0/1065344334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c012450 con 0x55664d2d3ce0 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.095+0000 7fd297000640 1 -- 172.21.15.7:0/1065344334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd29c012aa0 con 0x55664d2d3ce0 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.095+0000 7fd297000640 1 -- 172.21.15.7:0/1065344334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00fb70 con 0x55664d2d3ce0 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.095+0000 7fd2a2a00640 1 -- 172.21.15.7:0/3790749678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7fd2980d0ff0 con 0x7fd2a8074cf0 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.095+0000 7fd2ae800640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd2900a3d10 0x7fd2900a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.095+0000 7fd2b364c740 1 -- 172.21.15.7:0/1065344334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 msgr2=0x55664d2de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.095+0000 7fd2b364c740 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2de060 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009c80 tx=0x7fd29c0117b0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2ae800640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd2900a3d10 0x7fd2900a61d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006010 tx=0x7fd2a4004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 -- 172.21.15.7:0/1065344334 shutdown_connections 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d2e0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2de060 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 --2- 172.21.15.7:0/1065344334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 -- 172.21.15.7:0/1065344334 >> 172.21.15.7:0/1065344334 conn(0x55664d2cf8d0 msgr2=0x55664d2cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 -- 172.21.15.7:0/1065344334 shutdown_connections 2024-04-23T15:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 -- 172.21.15.7:0/1065344334 wait complete. 2024-04-23T15:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.096+0000 7fd2b364c740 1 -- start start 2024-04-23T15:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 Processor -- start 2024-04-23T15:03:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 0x55664d2db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d3ce0 0x55664d2dba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2dbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55664d2e1140 con 0x55664d2d33c0 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55664d1f32c0 con 0x55664d2de5a0 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55664d2e12c0 con 0x55664d2d3ce0 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2b364c740 10 client.0 _ll_register_callbacks cb 0x55664cf4ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.097+0000 7fd2ade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 0x55664d2db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 0x55664d2db550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42940/0 (socket says 172.21.15.7:42940) 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 -- 172.21.15.7:0/2147472940 learned_addr learned my addr 172.21.15.7:0/2147472940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ad400640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d3ce0 0x55664d2dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ae800640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 -- 172.21.15.7:0/2147472940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d3ce0 msgr2=0x55664d2dba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d3ce0 0x55664d2dba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 -- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 msgr2=0x55664d2dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2dbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 -- 172.21.15.7:0/2147472940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664d203fd0 con 0x55664d2d33c0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd2ade00640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 0x55664d2db550 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00f710 tx=0x7fd29c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e890561715ee0d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.098+0000 7fd28b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.099+0000 7fd28b400640 1 -- 172.21.15.7:0/2147472940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c028020 con 0x55664d2d33c0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.099+0000 7fd28b400640 1 -- 172.21.15.7:0/2147472940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7fd29c004450 con 0x55664d2d33c0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.099+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd29c012aa0 con 0x55664d2d33c0 2024-04-23T15:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.099+0000 7fd28b400640 1 -- 172.21.15.7:0/2147472940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd29c033050 con 0x55664d2d33c0 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.099+0000 7fd2b364c740 10 client.16587 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.099+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55664cf4c210 con 0x55664d2d33c0 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd28b400640 1 -- 172.21.15.7:0/2147472940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd29c012aa0 con 0x55664d2d33c0 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd28b400640 1 -- 172.21.15.7:0/2147472940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd29c0035f0 con 0x55664d2d33c0 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd2b364c740 10 client.16587 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd2b364c740 10 client.16587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd2b364c740 20 client.16587 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d2ee6e0 0x55664d2f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd2b364c740 4 client.16587 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.100+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55664d247320 con 0x55664d2ee6e0 2024-04-23T15:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.101+0000 7fd2ad400640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d2ee6e0 0x55664d2f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.102+0000 7fd2ad400640 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d2ee6e0 0x55664d2f0ad0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=768442677037ea3b server_cookie=54e810aacb9db01f in_seq=0 out_seq=0 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.102+0000 7fd28b400640 10 client.16587 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.103+0000 7fd28b400640 1 -- 172.21.15.7:0/2147472940 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55664d247320 con 0x55664d2ee6e0 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.103+0000 7fd28b400640 10 client.16587 handle_command_reply: tid=0 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 client.16587 shutdown 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 msgr2=0x55664d2db550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 0x55664d2db550 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00f710 tx=0x7fd29c009f80 comp rx=0 tx=0).stop 2024-04-23T15:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 shutdown_connections 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d2ee6e0 0x55664d2f0ad0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2dbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d3ce0 0x55664d2dba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2147472940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d33c0 0x55664d2db550 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 >> 172.21.15.7:0/2147472940 conn(0x55664d2cf8d0 msgr2=0x55664d2d5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd28b400640 0 client.16587 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 shutdown_connections 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 1 -- 172.21.15.7:0/2147472940 wait complete. 2024-04-23T15:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.104+0000 7fd2b364c740 20 client.16587 trim_cache size 0 max 16384 2024-04-23T15:03:06.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:05 smithi186 ceph-mon[31814]: pgmap v365: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 30 op/s 2024-04-23T15:03:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 Processor -- start 2024-04-23T15:03:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 -- start start 2024-04-23T15:03:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d33c0 0x55664d2ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2dae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2d5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81b14d0 con 0x55664d2d3ce0 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81b3010 con 0x55664d2de5a0 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2b364c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81b1ba0 con 0x55664d2d33c0 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.121+0000 7fd2ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2dae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2dae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42952/0 (socket says 172.21.15.7:42952) 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 -- 172.21.15.7:0/2529224722 learned_addr learned my addr 172.21.15.7:0/2529224722 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ade00640 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d33c0 0x55664d2ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ae800640 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 -- 172.21.15.7:0/2529224722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d33c0 msgr2=0x55664d2ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d33c0 0x55664d2ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 -- 172.21.15.7:0/2529224722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 msgr2=0x55664d2d5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2d5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 -- 172.21.15.7:0/2529224722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55664d2dbbf0 con 0x55664d2d3ce0 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ade00640 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d33c0 0x55664d2ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:03:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.122+0000 7fd2ad400640 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2dae30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd29809c8e0 tx=0x7fd2980d3500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d68da43c8387cf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.123+0000 7fd296600640 1 -- 172.21.15.7:0/2529224722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298005310 con 0x55664d2d3ce0 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.123+0000 7fd296600640 1 -- 172.21.15.7:0/2529224722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd298005680 con 0x55664d2d3ce0 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.123+0000 7fd296600640 1 -- 172.21.15.7:0/2529224722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980046c0 con 0x55664d2d3ce0 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 -- 172.21.15.7:0/2529224722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 msgr2=0x55664d2dae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2dae30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd29809c8e0 tx=0x7fd2980d3500 comp rx=0 tx=0).stop 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 -- 172.21.15.7:0/2529224722 shutdown_connections 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2de5a0 0x55664d2d5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2dae30 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 --2- 172.21.15.7:0/2529224722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2d33c0 0x55664d2ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 -- 172.21.15.7:0/2529224722 >> 172.21.15.7:0/2529224722 conn(0x55664d2cf8d0 msgr2=0x55664d2ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 -- 172.21.15.7:0/2529224722 shutdown_connections 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 -- 172.21.15.7:0/2529224722 wait complete. 2024-04-23T15:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.124+0000 7fd2b364c740 1 -- start start 2024-04-23T15:03:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 Processor -- start 2024-04-23T15:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d35c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81b2940 con 0x55664d2d3ce0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81b2270 con 0x55664d2d33c0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81af4d0 con 0x55664d2de5a0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2b364c740 10 client.0 _ll_register_callbacks cb 0x7fd29c009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2d8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42962/0 (socket says 172.21.15.7:42962) 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.125+0000 7fd2ad400640 1 -- 172.21.15.7:0/3037401140 learned_addr learned my addr 172.21.15.7:0/3037401140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ade00640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ae800640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d35c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ad400640 1 -- 172.21.15.7:0/3037401140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 msgr2=0x55664d35c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ad400640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d35c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ad400640 1 -- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 msgr2=0x55664d2d8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ad400640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ad400640 1 -- 172.21.15.7:0/3037401140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664d018620 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd2ad400640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2d8a50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd2980ce440 tx=0x7fd2980d13b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49c6f23421b17cf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd28b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.126+0000 7fd28b400640 1 -- 172.21.15.7:0/3037401140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980b5060 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd28b400640 1 -- 172.21.15.7:0/3037401140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9467+0+0 (secure 0 0 0) 0x7fd298016d70 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd298005680 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd28b400640 1 -- 172.21.15.7:0/3037401140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd29809cbe0 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 10 client.16593 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55664d35d590 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd28b400640 1 -- 172.21.15.7:0/3037401140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd298005680 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd28b400640 1 -- 172.21.15.7:0/3037401140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd298099250 con 0x55664d2d3ce0 2024-04-23T15:03:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 10 client.16593 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 10 client.16593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 20 client.16593 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d35dd30 0x55664d360120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 4 client.16593 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.127+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55664d2f0ec0 con 0x55664d35dd30 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.128+0000 7fd2ade00640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d35dd30 0x55664d360120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.129+0000 7fd2ade00640 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d35dd30 0x55664d360120 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c2b09d40ab212b server_cookie=6fbd4193a54529ff in_seq=0 out_seq=0 2024-04-23T15:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.129+0000 7fd28b400640 10 client.16593 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.160+0000 7fd28b400640 1 -- 172.21.15.7:0/3037401140 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55664d2f0ec0 con 0x55664d35dd30 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.160+0000 7fd28b400640 10 client.16593 handle_command_reply: tid=0 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.160+0000 7fd2b364c740 1 client.16593 shutdown 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 msgr2=0x55664d2d8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2d8a50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd2980ce440 tx=0x7fd2980d13b0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 shutdown_connections 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55664d35dd30 0x55664d360120 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55664d2de5a0 0x55664d35c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55664d2d3ce0 0x55664d2d8a50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 --2- 172.21.15.7:0/3037401140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55664d2d33c0 0x55664d2d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd28b400640 0 client.16593 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 >> 172.21.15.7:0/3037401140 conn(0x55664d2cf8d0 msgr2=0x55664d2cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 shutdown_connections 2024-04-23T15:03:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.161+0000 7fd2b364c740 1 -- 172.21.15.7:0/3037401140 wait complete. 2024-04-23T15:03:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.162+0000 7fd2b364c740 20 client.16593 trim_cache size 0 max 16384 2024-04-23T15:03:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:03:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:03:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:03:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.162+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd2900a3d10 msgr2=0x7fd2900a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.162+0000 7fd2af200640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd2900a3d10 0x7fd2900a61d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006010 tx=0x7fd2a4004a40 comp rx=0 tx=0).stop 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.162+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 msgr2=0x7fd2a81a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.162+0000 7fd2af200640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 0x7fd2a81a0ac0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd29800e9f0 tx=0x7fd29800edf0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 shutdown_connections 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd2900a3d10 0x7fd2900a61d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a810e6c0 0x7fd2a819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2a8074cf0 0x7fd2a81a0ac0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 --2- 172.21.15.7:0/3790749678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2a80743d0 0x7fd2a81a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 >> 172.21.15.7:0/3790749678 conn(0x7fd2a80fd950 msgr2=0x7fd2a80fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 shutdown_connections 2024-04-23T15:03:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:06.163+0000 7fd2af200640 1 -- 172.21.15.7:0/3790749678 wait complete. 2024-04-23T15:03:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:07 smithi007 ceph-mon[27906]: pgmap v366: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 38 op/s 2024-04-23T15:03:08.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:07 smithi186 ceph-mon[31814]: pgmap v366: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 38 op/s 2024-04-23T15:03:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:07 smithi137 ceph-mon[31694]: pgmap v366: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 38 op/s 2024-04-23T15:03:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:08 smithi007 ceph-mon[27906]: osdmap e105: 12 total, 12 up, 12 in 2024-04-23T15:03:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:08 smithi186 ceph-mon[31814]: osdmap e105: 12 total, 12 up, 12 in 2024-04-23T15:03:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:08 smithi137 ceph-mon[31694]: osdmap e105: 12 total, 12 up, 12 in 2024-04-23T15:03:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:09 smithi007 ceph-mon[27906]: pgmap v368: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:03:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:09 smithi186 ceph-mon[31814]: pgmap v368: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:03:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:09 smithi137 ceph-mon[31694]: pgmap v368: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:03:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:11 smithi007 ceph-mon[27906]: pgmap v369: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:03:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:11 smithi186 ceph-mon[31814]: pgmap v369: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:03:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:11 smithi137 ceph-mon[31694]: pgmap v369: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:03:13.970 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:13 smithi137 ceph-mon[31694]: pgmap v370: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:03:14.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:13 smithi007 ceph-mon[27906]: pgmap v370: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:03:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:13 smithi186 ceph-mon[31814]: pgmap v370: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:03:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:15 smithi007 ceph-mon[27906]: pgmap v371: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:03:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:15 smithi007 ceph-mon[27906]: osdmap e106: 12 total, 12 up, 12 in 2024-04-23T15:03:16.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:15 smithi186 ceph-mon[31814]: pgmap v371: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:03:16.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:15 smithi186 ceph-mon[31814]: osdmap e106: 12 total, 12 up, 12 in 2024-04-23T15:03:16.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:15 smithi137 ceph-mon[31694]: pgmap v371: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:03:16.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:15 smithi137 ceph-mon[31694]: osdmap e106: 12 total, 12 up, 12 in 2024-04-23T15:03:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:17 smithi007 ceph-mon[27906]: pgmap v373: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 14 op/s 2024-04-23T15:03:18.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:17 smithi186 ceph-mon[31814]: pgmap v373: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 14 op/s 2024-04-23T15:03:18.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:17 smithi137 ceph-mon[31694]: pgmap v373: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.9 MiB/s wr, 14 op/s 2024-04-23T15:03:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 -- 172.21.15.7:0/2609204995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4100710 msgr2=0x7ff9e4100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 --2- 172.21.15.7:0/2609204995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4100710 0x7ff9e4100b90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009930 tx=0x7ff9d002a420 comp rx=0 tx=0).stop 2024-04-23T15:03:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 -- 172.21.15.7:0/2609204995 shutdown_connections 2024-04-23T15:03:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 --2- 172.21.15.7:0/2609204995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9e41010d0 0x7ff9e410ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 --2- 172.21.15.7:0/2609204995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4100710 0x7ff9e4100b90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 --2- 172.21.15.7:0/2609204995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9e4108050 0x7ff9e4108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 -- 172.21.15.7:0/2609204995 >> 172.21.15.7:0/2609204995 conn(0x7ff9e4076000 msgr2=0x7ff9e4076410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 -- 172.21.15.7:0/2609204995 shutdown_connections 2024-04-23T15:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.328+0000 7ff9e9800640 1 -- 172.21.15.7:0/2609204995 wait complete. 2024-04-23T15:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.329+0000 7ff9e9800640 1 Processor -- start 2024-04-23T15:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 -- start start 2024-04-23T15:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9e4100710 0x7ff9e4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9e41010d0 0x7ff9e4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 0x7ff9e419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4112100 con 0x7ff9e4108050 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4111f80 con 0x7ff9e4100710 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.330+0000 7ff9e9800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4112280 con 0x7ff9e41010d0 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 0x7ff9e419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 0x7ff9e419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60496/0 (socket says 172.21.15.7:60496) 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 -- 172.21.15.7:0/781279984 learned_addr learned my addr 172.21.15.7:0/781279984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9e4100710 0x7ff9e4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e3400640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9e41010d0 0x7ff9e4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 -- 172.21.15.7:0/781279984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9e41010d0 msgr2=0x7ff9e4198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9e41010d0 0x7ff9e4198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 -- 172.21.15.7:0/781279984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9e4100710 msgr2=0x7ff9e4198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9e4100710 0x7ff9e4198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.331+0000 7ff9e8e00640 1 -- 172.21.15.7:0/781279984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e419d670 con 0x7ff9e4108050 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.332+0000 7ff9e8e00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 0x7ff9e419cf40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00eaa0 tx=0x7ff9dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.332+0000 7ff9e0c00640 1 -- 172.21.15.7:0/781279984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00cdb0 con 0x7ff9e4108050 2024-04-23T15:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.332+0000 7ff9e0c00640 1 -- 172.21.15.7:0/781279984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9dc005020 con 0x7ff9e4108050 2024-04-23T15:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.332+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e419d960 con 0x7ff9e4108050 2024-04-23T15:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.332+0000 7ff9e0c00640 1 -- 172.21.15.7:0/781279984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0116d0 con 0x7ff9e4108050 2024-04-23T15:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.332+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e4101820 con 0x7ff9e4108050 2024-04-23T15:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.336+0000 7ff9e0c00640 1 -- 172.21.15.7:0/781279984 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff9dc0051d0 con 0x7ff9e4108050 2024-04-23T15:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.336+0000 7ff9eddc3740 1 Processor -- start 2024-04-23T15:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.336+0000 7ff9eddc3740 1 -- start start 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e17803c0 0x5633e17807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e178b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e178d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633e16e6900 con 0x5633e1780ce0 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633e168cf20 con 0x5633e178b5a0 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5633e16e28c0 con 0x5633e17803c0 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e178b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e178b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60498/0 (socket says 172.21.15.7:60498) 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.337+0000 7ff9e3e00640 1 -- 172.21.15.7:0/4131887216 learned_addr learned my addr 172.21.15.7:0/4131887216 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e0c00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9c80a8120 0x7ff9c80aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3400640 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e17803c0 0x5633e17807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3400640 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e178d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e0c00640 1 -- 172.21.15.7:0/781279984 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7ff9dc0d0ec0 con 0x7ff9e4108050 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e8e00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9c80a8120 0x7ff9c80aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3e00640 1 -- 172.21.15.7:0/4131887216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e17803c0 msgr2=0x5633e17807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e17803c0 0x5633e17807a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3e00640 1 -- 172.21.15.7:0/4131887216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 msgr2=0x5633e178d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e178d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.338+0000 7ff9e3e00640 1 -- 172.21.15.7:0/4131887216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e16b1e10 con 0x5633e1780ce0 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.339+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e178b060 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400bcf0 tx=0x7ff9d400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcb5780fe8f1306 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.339+0000 7ff9e8e00640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9c80a8120 0x7ff9c80aa5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc098eb0 tx=0x7ff9dc005830 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.339+0000 7ff9d9600640 1 -- 172.21.15.7:0/4131887216 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4015070 con 0x5633e1780ce0 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.339+0000 7ff9d9600640 1 -- 172.21.15.7:0/4131887216 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9d401a910 con 0x5633e1780ce0 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.339+0000 7ff9d9600640 1 -- 172.21.15.7:0/4131887216 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40119d0 con 0x5633e1780ce0 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 -- 172.21.15.7:0/4131887216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 msgr2=0x5633e178b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e178b060 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400bcf0 tx=0x7ff9d400f730 comp rx=0 tx=0).stop 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 -- 172.21.15.7:0/4131887216 shutdown_connections 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e178d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e178b060 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/4131887216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e17803c0 0x5633e17807a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 -- 172.21.15.7:0/4131887216 >> 172.21.15.7:0/4131887216 conn(0x5633e177c8d0 msgr2=0x5633e177ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 -- 172.21.15.7:0/4131887216 shutdown_connections 2024-04-23T15:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.340+0000 7ff9eddc3740 1 -- 172.21.15.7:0/4131887216 wait complete. 2024-04-23T15:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.341+0000 7ff9eddc3740 1 -- start start 2024-04-23T15:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.341+0000 7ff9eddc3740 1 Processor -- start 2024-04-23T15:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.341+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1788520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.341+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e1788a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.341+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 0x5633e1788fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633e178e140 con 0x5633e178b5a0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633e16a02c0 con 0x5633e17803c0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5633e178e2c0 con 0x5633e1780ce0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9eddc3740 10 client.0 _ll_register_callbacks cb 0x5633e13f8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 0x5633e1788fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 0x5633e1788fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60514/0 (socket says 172.21.15.7:60514) 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 -- 172.21.15.7:0/3929855552 learned_addr learned my addr 172.21.15.7:0/3929855552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e1788a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1788520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 -- 172.21.15.7:0/3929855552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 msgr2=0x5633e1788a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e1788a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 -- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 msgr2=0x5633e1788520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1788520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.342+0000 7ff9e3400640 1 -- 172.21.15.7:0/3929855552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e16b0fd0 con 0x5633e178b5a0 2024-04-23T15:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.343+0000 7ff9e3400640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 0x5633e1788fa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009930 tx=0x7ff9d0040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23e4d7927aab81f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.343+0000 7ff9ce000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.343+0000 7ff9ce000640 1 -- 172.21.15.7:0/3929855552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0035040 con 0x5633e178b5a0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.343+0000 7ff9ce000640 1 -- 172.21.15.7:0/3929855552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7ff9d0004040 con 0x5633e178b5a0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.343+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d401a910 con 0x5633e178b5a0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.343+0000 7ff9ce000640 1 -- 172.21.15.7:0/3929855552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff9d0054050 con 0x5633e178b5a0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 10 client.16605 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5633e13f9210 con 0x5633e178b5a0 2024-04-23T15:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9ce000640 1 -- 172.21.15.7:0/3929855552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9d401a910 con 0x5633e178b5a0 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9ce000640 1 -- 172.21.15.7:0/3929855552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff9d003d480 con 0x5633e178b5a0 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 10 client.16605 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 20 client.16605 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e179b720 0x5633e179db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 4 client.16605 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.344+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633e16f4320 con 0x5633e179b720 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.345+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e179b720 0x5633e179db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.346+0000 7ff9ce000640 10 client.16605 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.346+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e179b720 0x5633e179db10 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f04a91a91e1b5e77 server_cookie=5625a8cbac448def in_seq=0 out_seq=0 2024-04-23T15:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9ce000640 1 -- 172.21.15.7:0/3929855552 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633e16f4320 con 0x5633e179b720 2024-04-23T15:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9ce000640 10 client.16605 handle_command_reply: tid=0 2024-04-23T15:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 client.16605 shutdown 2024-04-23T15:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 msgr2=0x5633e1788fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 0x5633e1788fa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009930 tx=0x7ff9d0040040 comp rx=0 tx=0).stop 2024-04-23T15:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 shutdown_connections 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e179b720 0x5633e179db10 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e178b5a0 0x5633e1788fa0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e1788a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/3929855552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1788520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 >> 172.21.15.7:0/3929855552 conn(0x5633e177c8d0 msgr2=0x5633e1782600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9ce000640 0 client.16605 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.348+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 shutdown_connections 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.349+0000 7ff9eddc3740 1 -- 172.21.15.7:0/3929855552 wait complete. 2024-04-23T15:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.349+0000 7ff9eddc3740 20 client.16605 trim_cache size 0 max 16384 2024-04-23T15:03:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 Processor -- start 2024-04-23T15:03:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 -- start start 2024-04-23T15:03:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 0x5633e178ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e177c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e1782d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41ad040 con 0x5633e17803c0 2024-04-23T15:03:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41aeb80 con 0x5633e178b5a0 2024-04-23T15:03:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41ad710 con 0x5633e1780ce0 2024-04-23T15:03:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.368+0000 7ff9e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 0x5633e178ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 0x5633e178ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60520/0 (socket says 172.21.15.7:60520) 2024-04-23T15:03:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 -- 172.21.15.7:0/2753254834 learned_addr learned my addr 172.21.15.7:0/2753254834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e177c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 -- 172.21.15.7:0/2753254834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 msgr2=0x5633e177c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e177c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 -- 172.21.15.7:0/2753254834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 msgr2=0x5633e1782d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e1782d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 -- 172.21.15.7:0/2753254834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e17874f0 con 0x5633e17803c0 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e177c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.369+0000 7ff9e3400640 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 0x5633e178ac50 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00059d0 tx=0x7ff9d002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a6b9a99333bf5b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.370+0000 7ff9d8c00640 1 -- 172.21.15.7:0/2753254834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0035030 con 0x5633e17803c0 2024-04-23T15:03:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.370+0000 7ff9d8c00640 1 -- 172.21.15.7:0/2753254834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9d003d480 con 0x5633e17803c0 2024-04-23T15:03:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.370+0000 7ff9d8c00640 1 -- 172.21.15.7:0/2753254834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0031bb0 con 0x5633e17803c0 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 -- 172.21.15.7:0/2753254834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 msgr2=0x5633e178ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 0x5633e178ac50 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00059d0 tx=0x7ff9d002a420 comp rx=0 tx=0).stop 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 -- 172.21.15.7:0/2753254834 shutdown_connections 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e178b5a0 0x5633e1782d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e1780ce0 0x5633e177c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/2753254834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e17803c0 0x5633e178ac50 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 -- 172.21.15.7:0/2753254834 >> 172.21.15.7:0/2753254834 conn(0x5633e177c8d0 msgr2=0x5633e17884e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 -- 172.21.15.7:0/2753254834 shutdown_connections 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 -- 172.21.15.7:0/2753254834 wait complete. 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 -- start start 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.371+0000 7ff9eddc3740 1 Processor -- start 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1785250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e1785790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e178b5a0 0x5633e1785cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41ae4b0 con 0x5633e1780ce0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41adde0 con 0x5633e17803c0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41ab040 con 0x5633e178b5a0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9eddc3740 10 client.0 _ll_register_callbacks cb 0x7ff9d0031600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e1785790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e1785790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60530/0 (socket says 172.21.15.7:60530) 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9e3e00640 1 -- 172.21.15.7:0/850340812 learned_addr learned my addr 172.21.15.7:0/850340812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.372+0000 7ff9e3400640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1785250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3400640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e178b5a0 0x5633e1785cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3e00640 1 -- 172.21.15.7:0/850340812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e178b5a0 msgr2=0x5633e1785cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e178b5a0 0x5633e1785cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3e00640 1 -- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 msgr2=0x5633e1785250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1785250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3e00640 1 -- 172.21.15.7:0/850340812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e14c5620 con 0x5633e1780ce0 2024-04-23T15:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3400640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1785250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9e3e00640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e1785790 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400bc10 tx=0x7ff9d400b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f04976470cdeaac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9ce000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9ce000640 1 -- 172.21.15.7:0/850340812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d402d060 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.373+0000 7ff9ce000640 1 -- 172.21.15.7:0/850340812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7ff9d4005240 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.374+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d003d480 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.374+0000 7ff9ce000640 1 -- 172.21.15.7:0/850340812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff9d4034050 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.374+0000 7ff9eddc3740 10 client.16611 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.374+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5633e1801db0 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.374+0000 7ff9ce000640 1 -- 172.21.15.7:0/850340812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9d003d480 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.374+0000 7ff9ce000640 1 -- 172.21.15.7:0/850340812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff9d4004640 con 0x5633e1780ce0 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9eddc3740 10 client.16611 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9eddc3740 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9eddc3740 20 client.16611 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:19.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e1802280 0x5633e18046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:19.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9eddc3740 4 client.16611 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:03:19.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633e16ee190 con 0x5633e1802280 2024-04-23T15:03:19.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.375+0000 7ff9e3400640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e1802280 0x5633e18046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:19.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.376+0000 7ff9e3400640 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e1802280 0x5633e18046a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea75c9cc8c53bd3f server_cookie=ffb05b5d27bf19f0 in_seq=0 out_seq=0 2024-04-23T15:03:19.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.376+0000 7ff9ce000640 10 client.16611 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.407+0000 7ff9ce000640 1 -- 172.21.15.7:0/850340812 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633e16ee190 con 0x5633e1802280 2024-04-23T15:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.407+0000 7ff9ce000640 10 client.16611 handle_command_reply: tid=0 2024-04-23T15:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.407+0000 7ff9eddc3740 1 client.16611 shutdown 2024-04-23T15:03:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.407+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 msgr2=0x5633e1785790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.407+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e1785790 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400bc10 tx=0x7ff9d400b450 comp rx=0 tx=0).stop 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 shutdown_connections 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5633e1802280 0x5633e18046a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5633e178b5a0 0x5633e1785cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9ce000640 0 client.16611 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633e1780ce0 0x5633e1785790 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 --2- 172.21.15.7:0/850340812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633e17803c0 0x5633e1785250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 >> 172.21.15.7:0/850340812 conn(0x5633e177c8d0 msgr2=0x5633e1788d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 shutdown_connections 2024-04-23T15:03:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 1 -- 172.21.15.7:0/850340812 wait complete. 2024-04-23T15:03:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.408+0000 7ff9eddc3740 20 client.16611 trim_cache size 0 max 16384 2024-04-23T15:03:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:03:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:03:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:03:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.409+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9c80a8120 msgr2=0x7ff9c80aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.409+0000 7ff9e9800640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9c80a8120 0x7ff9c80aa5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc098eb0 tx=0x7ff9dc005830 comp rx=0 tx=0).stop 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.409+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 msgr2=0x7ff9e419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.409+0000 7ff9e9800640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 0x7ff9e419cf40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00eaa0 tx=0x7ff9dc00ef60 comp rx=0 tx=0).stop 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 shutdown_connections 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9c80a8120 0x7ff9c80aa5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9e4108050 0x7ff9e419cf40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9e41010d0 0x7ff9e4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 --2- 172.21.15.7:0/781279984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9e4100710 0x7ff9e4198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 >> 172.21.15.7:0/781279984 conn(0x7ff9e4076000 msgr2=0x7ff9e40ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 shutdown_connections 2024-04-23T15:03:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:19.410+0000 7ff9e9800640 1 -- 172.21.15.7:0/781279984 wait complete. 2024-04-23T15:03:20.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:19 smithi007 ceph-mon[27906]: pgmap v374: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:03:20.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:19 smithi186 ceph-mon[31814]: pgmap v374: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:03:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:19 smithi137 ceph-mon[31694]: pgmap v374: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:03:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:21 smithi007 ceph-mon[27906]: pgmap v375: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:03:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:21 smithi186 ceph-mon[31814]: pgmap v375: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:03:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:21 smithi137 ceph-mon[31694]: pgmap v375: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:03:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:23 smithi007 ceph-mon[27906]: pgmap v376: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:03:24.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:23 smithi186 ceph-mon[31814]: pgmap v376: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:03:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:23 smithi137 ceph-mon[31694]: pgmap v376: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:03:26.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:25 smithi007 ceph-mon[27906]: pgmap v377: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:03:26.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:25 smithi186 ceph-mon[31814]: pgmap v377: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:03:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:25 smithi137 ceph-mon[31694]: pgmap v377: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:03:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:26 smithi007 ceph-mon[27906]: pgmap v378: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:03:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:26 smithi186 ceph-mon[31814]: pgmap v378: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:03:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:26 smithi137 ceph-mon[31694]: pgmap v378: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:03:29.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:29 smithi137 ceph-mon[31694]: pgmap v379: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:03:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:29 smithi007 ceph-mon[27906]: pgmap v379: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:03:30.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:29 smithi186 ceph-mon[31814]: pgmap v379: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:03:31.915 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:31 smithi186 ceph-mon[31814]: pgmap v380: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:03:31.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:31 smithi137 ceph-mon[31694]: pgmap v380: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:03:32.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:31 smithi007 ceph-mon[27906]: pgmap v380: 129 pgs: 129 active+clean; 2.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:03:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 -- 172.21.15.7:0/2833215434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04109520 msgr2=0x7fdb041110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 --2- 172.21.15.7:0/2833215434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04109520 0x7fdb041110f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009900 tx=0x7fdafc02a410 comp rx=0 tx=0).stop 2024-04-23T15:03:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 -- 172.21.15.7:0/2833215434 shutdown_connections 2024-04-23T15:03:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 --2- 172.21.15.7:0/2833215434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb04104e00 0x7fdb04108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 --2- 172.21.15.7:0/2833215434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04109520 0x7fdb041110f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 --2- 172.21.15.7:0/2833215434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb04104450 0x7fdb04104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 -- 172.21.15.7:0/2833215434 >> 172.21.15.7:0/2833215434 conn(0x7fdb040ffcf0 msgr2=0x7fdb04102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 -- 172.21.15.7:0/2833215434 shutdown_connections 2024-04-23T15:03:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.563+0000 7fdb09800640 1 -- 172.21.15.7:0/2833215434 wait complete. 2024-04-23T15:03:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.564+0000 7fdb09800640 1 Processor -- start 2024-04-23T15:03:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 -- start start 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 0x7fdb041a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb04109520 0x7fdb041a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0419a740 0x7fdb0419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041144e0 con 0x7fdb04104450 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04114360 con 0x7fdb0419a740 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb09800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04114660 con 0x7fdb04109520 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 0x7fdb041a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 0x7fdb041a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45690/0 (socket says 172.21.15.7:45690) 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.565+0000 7fdb02a00640 1 -- 172.21.15.7:0/3228875149 learned_addr learned my addr 172.21.15.7:0/3228875149 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdafa000640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb04109520 0x7fdb041a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb03400640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0419a740 0x7fdb0419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb02a00640 1 -- 172.21.15.7:0/3228875149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb04109520 msgr2=0x7fdb041a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb02a00640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb04109520 0x7fdb041a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb02a00640 1 -- 172.21.15.7:0/3228875149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0419a740 msgr2=0x7fdb0419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb02a00640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0419a740 0x7fdb0419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb02a00640 1 -- 172.21.15.7:0/3228875149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0419b340 con 0x7fdb04104450 2024-04-23T15:03:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.566+0000 7fdb02a00640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 0x7fdb041a0680 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400eb90 tx=0x7fdaf400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.567+0000 7fdafbe00640 1 -- 172.21.15.7:0/3228875149 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4004d20 con 0x7fdb04104450 2024-04-23T15:03:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.567+0000 7fdafbe00640 1 -- 172.21.15.7:0/3228875149 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaf400ee90 con 0x7fdb04104450 2024-04-23T15:03:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.567+0000 7fdafbe00640 1 -- 172.21.15.7:0/3228875149 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4010670 con 0x7fdb04104450 2024-04-23T15:03:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.567+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb041a7420 con 0x7fdb04104450 2024-04-23T15:03:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.567+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb041a77d0 con 0x7fdb04104450 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.570+0000 7fdb0c61b740 1 Processor -- start 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.570+0000 7fdb0c61b740 1 -- start start 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.570+0000 7fdafbe00640 1 -- 172.21.15.7:0/3228875149 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdaf4005020 con 0x7fdb04104450 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bdd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25be7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b25b43900 con 0x558b25be8390 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b25ae9f20 con 0x558b25bddad0 2024-04-23T15:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558b25b3f8c0 con 0x558b25bdd1b0 2024-04-23T15:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdafa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdafa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bea780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45694/0 (socket says 172.21.15.7:45694) 2024-04-23T15:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdafa000640 1 -- 172.21.15.7:0/1787883098 learned_addr learned my addr 172.21.15.7:0/1787883098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb03400640 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bdd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.571+0000 7fdb02a00640 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25be7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafa000640 1 -- 172.21.15.7:0/1787883098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 msgr2=0x558b25bdd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafa000640 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bdd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafa000640 1 -- 172.21.15.7:0/1787883098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 msgr2=0x558b25be7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafa000640 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25be7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafa000640 1 -- 172.21.15.7:0/1787883098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b25b0ee10 con 0x558b25be8390 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdb03400640 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bdd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafa000640 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bea780 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009b70 tx=0x7fdaec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62effc74e79044e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafbe00640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdae80a3e40 0x7fdae80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdaf3e00640 1 -- 172.21.15.7:0/1787883098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec009e60 con 0x558b25be8390 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdaf3e00640 1 -- 172.21.15.7:0/1787883098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaec012900 con 0x558b25be8390 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdaf3e00640 1 -- 172.21.15.7:0/1787883098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00fad0 con 0x558b25be8390 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.572+0000 7fdafbe00640 1 -- 172.21.15.7:0/3228875149 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7fdaf40d1300 con 0x7fdb04104450 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.573+0000 7fdb03400640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdae80a3e40 0x7fdae80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.573+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1787883098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 msgr2=0x558b25bea780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.573+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bea780 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009b70 tx=0x7fdaec0117b0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.573+0000 7fdb03400640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdae80a3e40 0x7fdae80a6300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdafc031440 tx=0x7fdafc005b50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1787883098 shutdown_connections 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25be7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bea780 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1787883098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bdd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1787883098 >> 172.21.15.7:0/1787883098 conn(0x558b25bd96c0 msgr2=0x558b25bd9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1787883098 shutdown_connections 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1787883098 wait complete. 2024-04-23T15:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.574+0000 7fdb0c61b740 1 -- start start 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 Processor -- start 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bdd1b0 0x558b25be5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 0x558b25be5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25be8390 0x558b25be5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b25beafc0 con 0x558b25bddad0 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b25afd2c0 con 0x558b25bdd1b0 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558b25beb140 con 0x558b25be8390 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.575+0000 7fdb0c61b740 10 client.0 _ll_register_callbacks cb 0x558b25855a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 0x558b25be5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 0x558b25be5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45704/0 (socket says 172.21.15.7:45704) 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 -- 172.21.15.7:0/2265953869 learned_addr learned my addr 172.21.15.7:0/2265953869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdb03400640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25be8390 0x558b25be5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdb02a00640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bdd1b0 0x558b25be5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 -- 172.21.15.7:0/2265953869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25be8390 msgr2=0x558b25be5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25be8390 0x558b25be5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 -- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bdd1b0 msgr2=0x558b25be5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bdd1b0 0x558b25be5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.576+0000 7fdafa000640 1 -- 172.21.15.7:0/2265953869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b25b0dfd0 con 0x558b25bddad0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdafa000640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 0x558b25be5850 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdaec01c040 tx=0x7fdaec012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecee5e85f749a9e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdaf0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2265953869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00f440 con 0x558b25bddad0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2265953869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7fdaec005040 con 0x558b25bddad0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaec012900 con 0x558b25bddad0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2265953869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdaec033050 con 0x558b25bddad0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdb0c61b740 10 client.16623 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.577+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b25856210 con 0x558b25bddad0 2024-04-23T15:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2265953869 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaec012900 con 0x558b25bddad0 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2265953869 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdaec0035f0 con 0x558b25bddad0 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdb0c61b740 10 client.16623 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdb0c61b740 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdb0c61b740 20 client.16623 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25bf8400 0x558b25bfa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdb0c61b740 4 client.16623 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.578+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b25b51320 con 0x558b25bf8400 2024-04-23T15:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.579+0000 7fdb02a00640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25bf8400 0x558b25bfa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.580+0000 7fdb02a00640 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25bf8400 0x558b25bfa7f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d476373de8977fe server_cookie=aedc26dab387cb36 in_seq=0 out_seq=0 2024-04-23T15:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.580+0000 7fdaf0c00640 10 client.16623 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.581+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2265953869 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558b25b51320 con 0x558b25bf8400 2024-04-23T15:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.581+0000 7fdaf0c00640 10 client.16623 handle_command_reply: tid=0 2024-04-23T15:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 client.16623 shutdown 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 msgr2=0x558b25be5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 0x558b25be5850 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdaec01c040 tx=0x7fdaec012700 comp rx=0 tx=0).stop 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 shutdown_connections 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25bf8400 0x558b25bfa7f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25be8390 0x558b25be5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25bddad0 0x558b25be5850 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdaf0c00640 0 client.16623 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2265953869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bdd1b0 0x558b25be5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 >> 172.21.15.7:0/2265953869 conn(0x558b25bd96c0 msgr2=0x558b25bd8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 shutdown_connections 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2265953869 wait complete. 2024-04-23T15:03:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.582+0000 7fdb0c61b740 20 client.16623 trim_cache size 0 max 16384 2024-04-23T15:03:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 Processor -- start 2024-04-23T15:03:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 -- start start 2024-04-23T15:03:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bf3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bdfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041b15d0 con 0x558b25be8390 2024-04-23T15:03:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041b3110 con 0x558b25bddad0 2024-04-23T15:03:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.600+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041b1ca0 con 0x558b25bdd1b0 2024-04-23T15:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bffe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45706/0 (socket says 172.21.15.7:45706) 2024-04-23T15:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 -- 172.21.15.7:0/1570229708 learned_addr learned my addr 172.21.15.7:0/1570229708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb02a00640 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bf3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdafa000640 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bdfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 -- 172.21.15.7:0/1570229708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 msgr2=0x558b25bf3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bf3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 -- 172.21.15.7:0/1570229708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 msgr2=0x558b25bdfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bdfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.601+0000 7fdb03400640 1 -- 172.21.15.7:0/1570229708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b25922620 con 0x558b25be8390 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.602+0000 7fdb03400640 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bffe80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009900 tx=0x7fdafc03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9054761070d6f1dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.602+0000 7fdaf3400640 1 -- 172.21.15.7:0/1570229708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc035050 con 0x558b25be8390 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.602+0000 7fdaf3400640 1 -- 172.21.15.7:0/1570229708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdafc004d70 con 0x558b25be8390 2024-04-23T15:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.602+0000 7fdaf3400640 1 -- 172.21.15.7:0/1570229708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc003da0 con 0x558b25be8390 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1570229708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 msgr2=0x558b25bffe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bffe80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009900 tx=0x7fdafc03d000 comp rx=0 tx=0).stop 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1570229708 shutdown_connections 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bdfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bffe80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/1570229708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bf3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1570229708 >> 172.21.15.7:0/1570229708 conn(0x558b25bd96c0 msgr2=0x558b25bd9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.603+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1570229708 shutdown_connections 2024-04-23T15:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.604+0000 7fdb0c61b740 1 -- 172.21.15.7:0/1570229708 wait complete. 2024-04-23T15:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.604+0000 7fdb0c61b740 1 -- start start 2024-04-23T15:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.604+0000 7fdb0c61b740 1 Processor -- start 2024-04-23T15:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041b2a40 con 0x558b25be8390 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041b2370 con 0x558b25bddad0 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb041af5d0 con 0x558b25bdd1b0 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb0c61b740 10 client.0 _ll_register_callbacks cb 0x7fdaf40d4c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb03400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45710/0 (socket says 172.21.15.7:45710) 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb03400640 1 -- 172.21.15.7:0/2361100531 learned_addr learned my addr 172.21.15.7:0/2361100531 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdb02a00640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.605+0000 7fdafa000640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdb03400640 1 -- 172.21.15.7:0/2361100531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 msgr2=0x558b25bebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdb03400640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bebdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdb03400640 1 -- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 msgr2=0x558b25bec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdb03400640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdb03400640 1 -- 172.21.15.7:0/2361100531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b25c5d6f0 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdb03400640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bec870 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdafc003fa0 tx=0x7fdafc003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829b7c175173f529 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdaf0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.606+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2361100531 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc035030 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2361100531 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7fdafc0046c0 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdafc004d70 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2361100531 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdafc064050 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 10 client.16629 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b25c5e9e0 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2361100531 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdafc004d70 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2361100531 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdafc0329e0 con 0x558b25be8390 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 10 client.16629 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 20 client.16629 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25c5f0d0 0x558b25c614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 4 client.16629 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.607+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558b25b4b190 con 0x558b25c5f0d0 2024-04-23T15:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.608+0000 7fdb02a00640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25c5f0d0 0x558b25c614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.609+0000 7fdb02a00640 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25c5f0d0 0x558b25c614f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7035a6ede3efc624 server_cookie=3a795547fdb73e17 in_seq=0 out_seq=0 2024-04-23T15:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.609+0000 7fdaf0c00640 10 client.16629 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdaf0c00640 1 -- 172.21.15.7:0/2361100531 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558b25b4b190 con 0x558b25c5f0d0 2024-04-23T15:03:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdaf0c00640 10 client.16629 handle_command_reply: tid=0 2024-04-23T15:03:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 client.16629 shutdown 2024-04-23T15:03:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 msgr2=0x558b25bec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bec870 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdafc003fa0 tx=0x7fdafc003fd0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 shutdown_connections 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b25c5f0d0 0x558b25c614f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b25bddad0 0x558b25bec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b25be8390 0x558b25bec870 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 --2- 172.21.15.7:0/2361100531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b25bdd1b0 0x558b25bebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 >> 172.21.15.7:0/2361100531 conn(0x558b25bd96c0 msgr2=0x558b25bd7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.637+0000 7fdaf0c00640 0 client.16629 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.638+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 shutdown_connections 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.638+0000 7fdb0c61b740 1 -- 172.21.15.7:0/2361100531 wait complete. 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.638+0000 7fdb0c61b740 20 client.16629 trim_cache size 0 max 16384 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:03:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:03:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdae80a3e40 msgr2=0x7fdae80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdae80a3e40 0x7fdae80a6300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdafc031440 tx=0x7fdafc005b50 comp rx=0 tx=0).stop 2024-04-23T15:03:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 msgr2=0x7fdb041a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 0x7fdb041a0680 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400eb90 tx=0x7fdaf400c6a0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 shutdown_connections 2024-04-23T15:03:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdae80a3e40 0x7fdae80a6300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb0419a740 0x7fdb0419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb04109520 0x7fdb041a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 --2- 172.21.15.7:0/3228875149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb04104450 0x7fdb041a0680 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 >> 172.21.15.7:0/3228875149 conn(0x7fdb040ffcf0 msgr2=0x7fdb04100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 shutdown_connections 2024-04-23T15:03:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:32.639+0000 7fdb09800640 1 -- 172.21.15.7:0/3228875149 wait complete. 2024-04-23T15:03:33.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:33 smithi137 ceph-mon[31694]: pgmap v381: 129 pgs: 129 active+clean; 2.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:03:34.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:33 smithi007 ceph-mon[27906]: pgmap v381: 129 pgs: 129 active+clean; 2.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:03:34.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:33 smithi186 ceph-mon[31814]: pgmap v381: 129 pgs: 129 active+clean; 2.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:03:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:35 smithi007 ceph-mon[27906]: pgmap v382: 129 pgs: 129 active+clean; 2.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:03:36.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:35 smithi186 ceph-mon[31814]: pgmap v382: 129 pgs: 129 active+clean; 2.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:03:36.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:35 smithi137 ceph-mon[31694]: pgmap v382: 129 pgs: 129 active+clean; 2.7 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:03:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:37 smithi007 ceph-mon[27906]: pgmap v383: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:03:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:37 smithi186 ceph-mon[31814]: pgmap v383: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:03:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:37 smithi137 ceph-mon[31694]: pgmap v383: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:03:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:39 smithi007 ceph-mon[27906]: pgmap v384: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:39 smithi186 ceph-mon[31814]: pgmap v384: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:40.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:39 smithi137 ceph-mon[31694]: pgmap v384: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:41 smithi007 ceph-mon[27906]: pgmap v385: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:42.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:41 smithi186 ceph-mon[31814]: pgmap v385: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:42.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:41 smithi137 ceph-mon[31694]: pgmap v385: 129 pgs: 129 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:43.970 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:43 smithi137 ceph-mon[31694]: pgmap v386: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:03:44.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:43 smithi007 ceph-mon[27906]: pgmap v386: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:03:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:43 smithi186 ceph-mon[31814]: pgmap v386: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.799+0000 7f834aa00640 1 -- 172.21.15.7:0/3784882858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344104c60 msgr2=0x7f8344108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.799+0000 7f834aa00640 1 --2- 172.21.15.7:0/3784882858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344104c60 0x7f8344108ca0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8330009900 tx=0x7f833002a410 comp rx=0 tx=0).stop 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.799+0000 7f834aa00640 1 -- 172.21.15.7:0/3784882858 shutdown_connections 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.799+0000 7f834aa00640 1 --2- 172.21.15.7:0/3784882858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8344109380 0x7f8344110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.800+0000 7f834aa00640 1 --2- 172.21.15.7:0/3784882858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344104c60 0x7f8344108ca0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.800+0000 7f834aa00640 1 --2- 172.21.15.7:0/3784882858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83441042b0 0x7f8344104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.800+0000 7f834aa00640 1 -- 172.21.15.7:0/3784882858 >> 172.21.15.7:0/3784882858 conn(0x7f83440ffb10 msgr2=0x7f8344101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.800+0000 7f834aa00640 1 -- 172.21.15.7:0/3784882858 shutdown_connections 2024-04-23T15:03:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.800+0000 7f834aa00640 1 -- 172.21.15.7:0/3784882858 wait complete. 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 Processor -- start 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 -- start start 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83441042b0 0x7f83441a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 0x7f83441a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f834419a6c0 0x7f834419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83441142c0 con 0x7f8344109380 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8344114140 con 0x7f83441042b0 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.801+0000 7f834aa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8344114440 con 0x7f834419a6c0 2024-04-23T15:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 0x7f83441a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 0x7f83441a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37570/0 (socket says 172.21.15.7:37570) 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 -- 172.21.15.7:0/2935882687 learned_addr learned my addr 172.21.15.7:0/2935882687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f834a000640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f834419a6c0 0x7f834419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8349600640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83441042b0 0x7f83441a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 -- 172.21.15.7:0/2935882687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f834419a6c0 msgr2=0x7f834419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f834419a6c0 0x7f834419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 -- 172.21.15.7:0/2935882687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83441042b0 msgr2=0x7f83441a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83441042b0 0x7f83441a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 -- 172.21.15.7:0/2935882687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834419b2c0 con 0x7f8344109380 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.802+0000 7f8348c00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 0x7f83441a0b40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8330004040 tx=0x7f8330004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.803+0000 7f8342000640 1 -- 172.21.15.7:0/2935882687 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833003f030 con 0x7f8344109380 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.803+0000 7f8342000640 1 -- 172.21.15.7:0/2935882687 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8330003aa0 con 0x7f8344109380 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.803+0000 7f8342000640 1 -- 172.21.15.7:0/2935882687 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330035070 con 0x7f8344109380 2024-04-23T15:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.803+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834419b550 con 0x7f8344109380 2024-04-23T15:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.803+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83441a7640 con 0x7f8344109380 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 Processor -- start 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f8342000640 1 -- 172.21.15.7:0/2935882687 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8330042030 con 0x7f8344109380 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 -- start start 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b48512e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512ece0 0x55b485139060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b48513b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b485094900 con 0x55b48512e3c0 2024-04-23T15:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b48503af20 con 0x55b4851395a0 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.807+0000 7f834efd7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b4850908c0 con 0x55b48512ece0 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b48512e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b48512e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37582/0 (socket says 172.21.15.7:37582) 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 -- 172.21.15.7:0/3133455450 learned_addr learned my addr 172.21.15.7:0/3133455450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f8349600640 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512ece0 0x55b485139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f8348c00640 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b48513b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 -- 172.21.15.7:0/3133455450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512ece0 msgr2=0x55b485139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512ece0 0x55b485139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 -- 172.21.15.7:0/3133455450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 msgr2=0x55b48513b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b48513b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f834a000640 1 -- 172.21.15.7:0/3133455450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b48505fe10 con 0x55b48512e3c0 2024-04-23T15:03:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.808+0000 7f8348c00640 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b48513b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.809+0000 7f834a000640 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b48512e7a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f833c009e60 tx=0x7f833c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2c10c84f57ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.809+0000 7f8336600640 1 -- 172.21.15.7:0/3133455450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c016070 con 0x55b48512e3c0 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.809+0000 7f8336600640 1 -- 172.21.15.7:0/3133455450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f833c004d20 con 0x55b48512e3c0 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.809+0000 7f8336600640 1 -- 172.21.15.7:0/3133455450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c012740 con 0x55b48512e3c0 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f8342000640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f832c0a3d90 0x7f832c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f8342000640 1 -- 172.21.15.7:0/2935882687 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7f83300f1090 con 0x7f8344109380 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f8349600640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f832c0a3d90 0x7f832c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 -- 172.21.15.7:0/3133455450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 msgr2=0x55b48512e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b48512e7a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f833c009e60 tx=0x7f833c010740 comp rx=0 tx=0).stop 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 -- 172.21.15.7:0/3133455450 shutdown_connections 2024-04-23T15:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b48513b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512ece0 0x55b485139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 --2- 172.21.15.7:0/3133455450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b48512e7a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 -- 172.21.15.7:0/3133455450 >> 172.21.15.7:0/3133455450 conn(0x55b48512a8d0 msgr2=0x55b48512acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.810+0000 7f834efd7740 1 -- 172.21.15.7:0/3133455450 shutdown_connections 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.811+0000 7f834efd7740 1 -- 172.21.15.7:0/3133455450 wait complete. 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.811+0000 7f8349600640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f832c0a3d90 0x7f832c0a6250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55b48512f960 tx=0x7f8338005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.811+0000 7f834efd7740 1 -- start start 2024-04-23T15:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.811+0000 7f834efd7740 1 Processor -- start 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b485136580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512ece0 0x55b485136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b485137000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b48513c170 con 0x55b48512e3c0 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b48504e2c0 con 0x55b48512ece0 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b48513c2f0 con 0x55b4851395a0 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f834efd7740 10 client.0 _ll_register_callbacks cb 0x55b484da6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f8349600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b485136580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f8349600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b485136580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37596/0 (socket says 172.21.15.7:37596) 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.812+0000 7f8349600640 1 -- 172.21.15.7:0/1319020670 learned_addr learned my addr 172.21.15.7:0/1319020670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8348c00640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512ece0 0x55b485136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f834a000640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b485137000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8349600640 1 -- 172.21.15.7:0/1319020670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 msgr2=0x55b485137000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8349600640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b485137000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8349600640 1 -- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512ece0 msgr2=0x55b485136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8349600640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512ece0 0x55b485136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8349600640 1 -- 172.21.15.7:0/1319020670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b48505efd0 con 0x55b48512e3c0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f8349600640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b485136580 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8338011c40 tx=0x7f83380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3f8b306e98ce9e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f832aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.813+0000 7f832aa00640 1 -- 172.21.15.7:0/1319020670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8338010d60 con 0x55b48512e3c0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.814+0000 7f832aa00640 1 -- 172.21.15.7:0/1319020670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7f83380203f0 con 0x55b48512e3c0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.814+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f833c004d20 con 0x55b48512e3c0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.814+0000 7f832aa00640 1 -- 172.21.15.7:0/1319020670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83380205f0 con 0x55b48512e3c0 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.814+0000 7f834efd7740 10 client.16641 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.814+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b484da7210 con 0x55b48512e3c0 2024-04-23T15:03:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.814+0000 7f832aa00640 1 -- 172.21.15.7:0/1319020670 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f833c004d20 con 0x55b48512e3c0 2024-04-23T15:03:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f832aa00640 1 -- 172.21.15.7:0/1319020670 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8338028730 con 0x55b48512e3c0 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f834efd7740 10 client.16641 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f834efd7740 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f834efd7740 20 client.16641 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f834efd7740 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851496a0 0x55b48514ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f834efd7740 4 client.16641 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4850a2320 con 0x55b4851496a0 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.815+0000 7f8348c00640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851496a0 0x55b48514ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.817+0000 7f8348c00640 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851496a0 0x55b48514ba90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf4faf6e33d164ef server_cookie=d9843f3f8c9b3676 in_seq=0 out_seq=0 2024-04-23T15:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.817+0000 7f832aa00640 10 client.16641 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.818+0000 7f832aa00640 1 -- 172.21.15.7:0/1319020670 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b4850a2320 con 0x55b4851496a0 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.818+0000 7f832aa00640 10 client.16641 handle_command_reply: tid=0 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.818+0000 7f834efd7740 1 client.16641 shutdown 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 msgr2=0x55b485136580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b485136580 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8338011c40 tx=0x7f83380046c0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 shutdown_connections 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851496a0 0x55b48514ba90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512ece0 0x55b485136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b485137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 --2- 172.21.15.7:0/1319020670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512e3c0 0x55b485136580 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 >> 172.21.15.7:0/1319020670 conn(0x55b48512a8d0 msgr2=0x55b485130600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f832aa00640 0 client.16641 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 shutdown_connections 2024-04-23T15:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 1 -- 172.21.15.7:0/1319020670 wait complete. 2024-04-23T15:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.819+0000 7f834efd7740 20 client.16641 trim_cache size 0 max 16384 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 Processor -- start 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 -- start start 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512e3c0 0x55b485138d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b48512a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b485137010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83441b14c0 con 0x55b48512ece0 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83441b3000 con 0x55b4851395a0 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f834efd7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83441b1b90 con 0x55b48512e3c0 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.837+0000 7f8348c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b48512a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b48512a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37604/0 (socket says 172.21.15.7:37604) 2024-04-23T15:03:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 -- 172.21.15.7:0/1819233912 learned_addr learned my addr 172.21.15.7:0/1819233912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8349600640 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512e3c0 0x55b485138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f834a000640 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b485137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 -- 172.21.15.7:0/1819233912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512e3c0 msgr2=0x55b485138d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512e3c0 0x55b485138d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 -- 172.21.15.7:0/1819233912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 msgr2=0x55b485137010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b485137010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 -- 172.21.15.7:0/1819233912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b48513bd00 con 0x55b48512ece0 2024-04-23T15:03:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8349600640 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512e3c0 0x55b485138d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:03:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.838+0000 7f8348c00640 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b48512a210 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f83300b95f0 tx=0x7f83300dd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbf884bd01cfe3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.839+0000 7f8335c00640 1 -- 172.21.15.7:0/1819233912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330049040 con 0x55b48512ece0 2024-04-23T15:03:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.839+0000 7f8335c00640 1 -- 172.21.15.7:0/1819233912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83300c0fd0 con 0x55b48512ece0 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.839+0000 7f8335c00640 1 -- 172.21.15.7:0/1819233912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330003c50 con 0x55b48512ece0 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.839+0000 7f834efd7740 1 -- 172.21.15.7:0/1819233912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 msgr2=0x55b48512a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.839+0000 7f834efd7740 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b48512a210 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f83300b95f0 tx=0x7f83300dd040 comp rx=0 tx=0).stop 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 -- 172.21.15.7:0/1819233912 shutdown_connections 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b4851395a0 0x55b485137010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b48512a210 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 --2- 172.21.15.7:0/1819233912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b48512e3c0 0x55b485138d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 -- 172.21.15.7:0/1819233912 >> 172.21.15.7:0/1819233912 conn(0x55b48512a8d0 msgr2=0x55b485138640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 -- 172.21.15.7:0/1819233912 shutdown_connections 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 -- 172.21.15.7:0/1819233912 wait complete. 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 -- start start 2024-04-23T15:03:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.840+0000 7f834efd7740 1 Processor -- start 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512e3c0 0x55b485133940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b485133e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b4851aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83441b2930 con 0x55b48512ece0 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83441b2260 con 0x55b48512e3c0 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83441af4c0 con 0x55b4851395a0 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f834efd7740 10 client.0 _ll_register_callbacks cb 0x7f83380098b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f8348c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b485133e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f8348c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b485133e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37606/0 (socket says 172.21.15.7:37606) 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.841+0000 7f8348c00640 1 -- 172.21.15.7:0/1388168260 learned_addr learned my addr 172.21.15.7:0/1388168260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8349600640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512e3c0 0x55b485133940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f834a000640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b4851aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8348c00640 1 -- 172.21.15.7:0/1388168260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 msgr2=0x55b4851aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8348c00640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b4851aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8348c00640 1 -- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512e3c0 msgr2=0x55b485133940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8348c00640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512e3c0 0x55b485133940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8348c00640 1 -- 172.21.15.7:0/1388168260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b48512f790 con 0x55b48512ece0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f8348c00640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b485133e80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f83300bc780 tx=0x7f83300bad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff6828d42117e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f832aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f832aa00640 1 -- 172.21.15.7:0/1388168260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330049070 con 0x55b48512ece0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f832aa00640 1 -- 172.21.15.7:0/1388168260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7f8330003c50 con 0x55b48512ece0 2024-04-23T15:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.842+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83300c0fd0 con 0x55b48512ece0 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f832aa00640 1 -- 172.21.15.7:0/1388168260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f83300dd0b0 con 0x55b48512ece0 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 10 client.16647 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b484e73620 con 0x55b48512ece0 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f832aa00640 1 -- 172.21.15.7:0/1388168260 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83300c0fd0 con 0x55b48512ece0 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f832aa00640 1 -- 172.21.15.7:0/1388168260 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f83300f30b0 con 0x55b48512ece0 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 10 client.16647 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 10 client.16647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 20 client.16647 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851b0770 0x55b4851b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 4 client.16647 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.843+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b48509c190 con 0x55b4851b0770 2024-04-23T15:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.844+0000 7f8349600640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851b0770 0x55b4851b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.845+0000 7f8349600640 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851b0770 0x55b4851b2b90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414adb8d2dfde754 server_cookie=9ee775165fd7de6 in_seq=0 out_seq=0 2024-04-23T15:03:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.845+0000 7f832aa00640 10 client.16647 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f832aa00640 1 -- 172.21.15.7:0/1388168260 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b48509c190 con 0x55b4851b0770 2024-04-23T15:03:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f832aa00640 10 client.16647 handle_command_reply: tid=0 2024-04-23T15:03:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 client.16647 shutdown 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 msgr2=0x55b485133e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b485133e80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f83300bc780 tx=0x7f83300bad40 comp rx=0 tx=0).stop 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 shutdown_connections 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b4851b0770 0x55b4851b2b90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b4851395a0 0x55b4851aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f832aa00640 0 client.16647 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b48512ece0 0x55b485133e80 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 --2- 172.21.15.7:0/1388168260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b48512e3c0 0x55b485133940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.884+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 >> 172.21.15.7:0/1388168260 conn(0x55b48512a8d0 msgr2=0x55b485129200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.885+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 shutdown_connections 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.885+0000 7f834efd7740 1 -- 172.21.15.7:0/1388168260 wait complete. 2024-04-23T15:03:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.885+0000 7f834efd7740 20 client.16647 trim_cache size 0 max 16384 2024-04-23T15:03:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:03:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:03:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:03:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:03:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f832c0a3d90 msgr2=0x7f832c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f832c0a3d90 0x7f832c0a6250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55b48512f960 tx=0x7f8338005f90 comp rx=0 tx=0).stop 2024-04-23T15:03:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 msgr2=0x7f83441a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 0x7f83441a0b40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8330004040 tx=0x7f8330004070 comp rx=0 tx=0).stop 2024-04-23T15:03:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 shutdown_connections 2024-04-23T15:03:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f832c0a3d90 0x7f832c0a6250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f834419a6c0 0x7f834419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8344109380 0x7f83441a0b40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 --2- 172.21.15.7:0/2935882687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83441042b0 0x7f83441a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 >> 172.21.15.7:0/2935882687 conn(0x7f83440ffb10 msgr2=0x7f8344100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 shutdown_connections 2024-04-23T15:03:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:45.886+0000 7f834aa00640 1 -- 172.21.15.7:0/2935882687 wait complete. 2024-04-23T15:03:46.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:45 smithi007 ceph-mon[27906]: pgmap v387: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:45 smithi186 ceph-mon[31814]: pgmap v387: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:45 smithi137 ceph-mon[31694]: pgmap v387: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:03:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:47 smithi007 ceph-mon[27906]: pgmap v388: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:03:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:47 smithi186 ceph-mon[31814]: pgmap v388: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:03:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:47 smithi137 ceph-mon[31694]: pgmap v388: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:03:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:49 smithi007 ceph-mon[27906]: pgmap v389: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:03:50.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:49 smithi186 ceph-mon[31814]: pgmap v389: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:03:50.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:49 smithi137 ceph-mon[31694]: pgmap v389: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:03:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:51 smithi007 ceph-mon[27906]: pgmap v390: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:03:52.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:51 smithi186 ceph-mon[31814]: pgmap v390: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:03:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:51 smithi137 ceph-mon[31694]: pgmap v390: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:03:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:53 smithi007 ceph-mon[27906]: pgmap v391: 129 pgs: 129 active+clean; 2.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T15:03:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:53 smithi186 ceph-mon[31814]: pgmap v391: 129 pgs: 129 active+clean; 2.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T15:03:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:53 smithi137 ceph-mon[31694]: pgmap v391: 129 pgs: 129 active+clean; 2.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T15:03:56.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:55 smithi007 ceph-mon[27906]: pgmap v392: 129 pgs: 129 active+clean; 2.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:03:56.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:55 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:03:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:55 smithi186 ceph-mon[31814]: pgmap v392: 129 pgs: 129 active+clean; 2.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:03:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:55 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:03:56.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:55 smithi137 ceph-mon[31694]: pgmap v392: 129 pgs: 129 active+clean; 2.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:03:56.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:55 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:03:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:56 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:03:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:56 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:03:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:56 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:03:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:56 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:03:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:56 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:03:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:56 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:03:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:56 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:03:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:56 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:03:57.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:56 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:03:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:57 smithi007 ceph-mon[27906]: pgmap v393: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:03:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:57 smithi186 ceph-mon[31814]: pgmap v393: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:03:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:57 smithi137 ceph-mon[31694]: pgmap v393: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 -- 172.21.15.7:0/1583495055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3764106030 msgr2=0x7f376410dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 --2- 172.21.15.7:0/1583495055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3764106030 0x7f376410dc00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f375c009ca0 tx=0x7f375c02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 -- 172.21.15.7:0/1583495055 shutdown_connections 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 --2- 172.21.15.7:0/1583495055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764101910 0x7f3764105950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 --2- 172.21.15.7:0/1583495055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3764106030 0x7f376410dc00 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 --2- 172.21.15.7:0/1583495055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 0x7f3764101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.044+0000 7f3768a00640 1 -- 172.21.15.7:0/1583495055 >> 172.21.15.7:0/1583495055 conn(0x7f37640fc820 msgr2=0x7f37640fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.045+0000 7f3768a00640 1 -- 172.21.15.7:0/1583495055 shutdown_connections 2024-04-23T15:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.045+0000 7f3768a00640 1 -- 172.21.15.7:0/1583495055 wait complete. 2024-04-23T15:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.046+0000 7f3768a00640 1 Processor -- start 2024-04-23T15:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.046+0000 7f3768a00640 1 -- start start 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3768a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 0x7f37641985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3768a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764106030 0x7f3764198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3768a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 0x7f376419d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3768a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3764110f90 con 0x7f376419ceb0 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3768a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3764110e10 con 0x7f3764106030 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3768a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3764111110 con 0x7f3764100f60 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 0x7f376419d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 0x7f376419d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58604/0 (socket says 172.21.15.7:58604) 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3763e00640 1 -- 172.21.15.7:0/243257986 learned_addr learned my addr 172.21.15.7:0/243257986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3763400640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 0x7f37641985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.047+0000 7f3762a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764106030 0x7f3764198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763e00640 1 -- 172.21.15.7:0/243257986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 msgr2=0x7f37641985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763e00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 0x7f37641985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763e00640 1 -- 172.21.15.7:0/243257986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764106030 msgr2=0x7f3764198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763e00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764106030 0x7f3764198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763e00640 1 -- 172.21.15.7:0/243257986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376419d9a0 con 0x7f376419ceb0 2024-04-23T15:03:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763400640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 0x7f37641985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:03:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3763e00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 0x7f376419d360 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f375c009dc0 tx=0x7f375c032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f375be00640 1 -- 172.21.15.7:0/243257986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c003bf0 con 0x7f376419ceb0 2024-04-23T15:03:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f375be00640 1 -- 172.21.15.7:0/243257986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f375c003d90 con 0x7f376419ceb0 2024-04-23T15:03:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f375be00640 1 -- 172.21.15.7:0/243257986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c030b80 con 0x7f376419ceb0 2024-04-23T15:03:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.048+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376419dc30 con 0x7f376419ceb0 2024-04-23T15:03:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.049+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37641a5480 con 0x7f376419ceb0 2024-04-23T15:03:59.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.053+0000 7f375be00640 1 -- 172.21.15.7:0/243257986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f375c004040 con 0x7f376419ceb0 2024-04-23T15:03:59.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.053+0000 7f376ce78740 1 Processor -- start 2024-04-23T15:03:59.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 -- start start 2024-04-23T15:03:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 0x55fbffc58bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc63470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc639b0 0x55fbffc65da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fbffbba900 con 0x55fbffc587d0 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fbffb60f20 con 0x55fbffc639b0 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f376ce78740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fbffbb68c0 con 0x55fbffc590f0 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.054+0000 7f3762a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 0x55fbffc58bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 0x55fbffc58bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58614/0 (socket says 172.21.15.7:58614) 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 -- 172.21.15.7:0/481024672 learned_addr learned my addr 172.21.15.7:0/481024672 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3763400640 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc63470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f375be00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f37480a3d90 0x7f37480a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc639b0 0x55fbffc65da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 -- 172.21.15.7:0/481024672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 msgr2=0x55fbffc63470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc63470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 -- 172.21.15.7:0/481024672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc639b0 msgr2=0x55fbffc65da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc639b0 0x55fbffc65da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f375be00640 1 -- 172.21.15.7:0/243257986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7f375c0f21d0 con 0x7f376419ceb0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3762a00640 1 -- 172.21.15.7:0/481024672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbffb85e10 con 0x55fbffc587d0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.055+0000 7f3763e00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f37480a3d90 0x7f37480a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.056+0000 7f3762a00640 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 0x55fbffc58bb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f37500058c0 tx=0x7f375000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374b1cd4eb781096 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.056+0000 7f374fe00640 1 -- 172.21.15.7:0/481024672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750011e50 con 0x55fbffc587d0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.056+0000 7f3763e00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f37480a3d90 0x7f37480a6250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f375c003fd0 tx=0x7f375c0095c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.056+0000 7f374fe00640 1 -- 172.21.15.7:0/481024672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3750005bf0 con 0x55fbffc587d0 2024-04-23T15:03:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.056+0000 7f374fe00640 1 -- 172.21.15.7:0/481024672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750012770 con 0x55fbffc587d0 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 -- 172.21.15.7:0/481024672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 msgr2=0x55fbffc58bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 0x55fbffc58bb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f37500058c0 tx=0x7f375000b600 comp rx=0 tx=0).stop 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 -- 172.21.15.7:0/481024672 shutdown_connections 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc639b0 0x55fbffc65da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc63470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 --2- 172.21.15.7:0/481024672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc587d0 0x55fbffc58bb0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 -- 172.21.15.7:0/481024672 >> 172.21.15.7:0/481024672 conn(0x55fbffc54ce0 msgr2=0x55fbffc550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 -- 172.21.15.7:0/481024672 shutdown_connections 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.057+0000 7f376ce78740 1 -- 172.21.15.7:0/481024672 wait complete. 2024-04-23T15:03:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.058+0000 7f376ce78740 1 -- start start 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.058+0000 7f376ce78740 1 Processor -- start 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.058+0000 7f376ce78740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc60900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.058+0000 7f376ce78740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc60e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.058+0000 7f376ce78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 0x55fbffc61380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.058+0000 7f376ce78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fbffc66580 con 0x55fbffc639b0 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f376ce78740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fbffb742c0 con 0x55fbffc587d0 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f376ce78740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fbffc66700 con 0x55fbffc590f0 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f376ce78740 10 client.0 _ll_register_callbacks cb 0x55fbff8cca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f3762a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 0x55fbffc61380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f3762a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 0x55fbffc61380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58626/0 (socket says 172.21.15.7:58626) 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f3762a00640 1 -- 172.21.15.7:0/3777658973 learned_addr learned my addr 172.21.15.7:0/3777658973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f3763400640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc60e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.059+0000 7f3762a00640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc60900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f3762a00640 1 -- 172.21.15.7:0/3777658973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 msgr2=0x55fbffc60e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f3762a00640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc60e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f3762a00640 1 -- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 msgr2=0x55fbffc60900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f3762a00640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc60900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f3762a00640 1 -- 172.21.15.7:0/3777658973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbffb84fd0 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f3762a00640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 0x55fbffc61380 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3750012010 tx=0x7f375000ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba55a623b0dfcfd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f374cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f374cc00640 1 -- 172.21.15.7:0/3777658973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750025040 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f374cc00640 1 -- 172.21.15.7:0/3777658973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7f375000f660 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.060+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbffbc8320 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f374cc00640 1 -- 172.21.15.7:0/3777658973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3750034050 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f376ce78740 10 client.16659 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fbff8cd210 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f374cc00640 1 -- 172.21.15.7:0/3777658973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55fbffbc8320 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f374cc00640 1 -- 172.21.15.7:0/3777658973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3750012a10 con 0x55fbffc639b0 2024-04-23T15:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f376ce78740 10 client.16659 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f376ce78740 10 client.16659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f376ce78740 20 client.16659 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.061+0000 7f376ce78740 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffc739b0 0x55fbffc75da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.062+0000 7f376ce78740 4 client.16659 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.062+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbffbc2190 con 0x55fbffc739b0 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.062+0000 7f3763400640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffc739b0 0x55fbffc75da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.063+0000 7f3763400640 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffc739b0 0x55fbffc75da0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b98cf54f44496300 server_cookie=366d5655aec9b1fd in_seq=0 out_seq=0 2024-04-23T15:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.063+0000 7f374cc00640 10 client.16659 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.065+0000 7f374cc00640 1 -- 172.21.15.7:0/3777658973 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fbffbc2190 con 0x55fbffc739b0 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.065+0000 7f374cc00640 10 client.16659 handle_command_reply: tid=0 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.065+0000 7f376ce78740 1 client.16659 shutdown 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 msgr2=0x55fbffc61380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 0x55fbffc61380 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3750012010 tx=0x7f375000ff00 comp rx=0 tx=0).stop 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 shutdown_connections 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffc739b0 0x55fbffc75da0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc639b0 0x55fbffc61380 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc590f0 0x55fbffc60e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 --2- 172.21.15.7:0/3777658973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc60900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f374cc00640 0 client.16659 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 >> 172.21.15.7:0/3777658973 conn(0x55fbffc54ce0 msgr2=0x55fbffc4fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 shutdown_connections 2024-04-23T15:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 1 -- 172.21.15.7:0/3777658973 wait complete. 2024-04-23T15:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.066+0000 7f376ce78740 20 client.16659 trim_cache size 0 max 16384 2024-04-23T15:03:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.086+0000 7f376ce78740 1 Processor -- start 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.086+0000 7f376ce78740 1 -- start start 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f376ce78740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc6f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f376ce78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc7b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f376ce78740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffc7ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f376ce78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ad000 con 0x55fbffc590f0 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f376ce78740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37641aeb40 con 0x55fbffc587d0 2024-04-23T15:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f376ce78740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ad6d0 con 0x55fbffc639b0 2024-04-23T15:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f3763400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc7b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f3763400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc7b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58640/0 (socket says 172.21.15.7:58640) 2024-04-23T15:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.087+0000 7f3763400640 1 -- 172.21.15.7:0/2892527708 learned_addr learned my addr 172.21.15.7:0/2892527708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3762a00640 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc6f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3762a00640 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffc7ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3763400640 1 -- 172.21.15.7:0/2892527708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 msgr2=0x55fbffc7ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3763400640 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffc7ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3763400640 1 -- 172.21.15.7:0/2892527708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 msgr2=0x55fbffc6f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3763400640 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc6f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3763400640 1 -- 172.21.15.7:0/2892527708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbff999620 con 0x55fbffc590f0 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3762a00640 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffc7ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.088+0000 7f3763400640 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc7b4e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x55fbffc76480 tx=0x7f3754005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e89a76844cc70 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.089+0000 7f374f400640 1 -- 172.21.15.7:0/2892527708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754005220 con 0x55fbffc590f0 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.089+0000 7f374f400640 1 -- 172.21.15.7:0/2892527708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3754025030 con 0x55fbffc590f0 2024-04-23T15:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.089+0000 7f374f400640 1 -- 172.21.15.7:0/2892527708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540214a0 con 0x55fbffc590f0 2024-04-23T15:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 -- 172.21.15.7:0/2892527708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 msgr2=0x55fbffc7b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc7b4e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x55fbffc76480 tx=0x7f3754005f90 comp rx=0 tx=0).stop 2024-04-23T15:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 -- 172.21.15.7:0/2892527708 shutdown_connections 2024-04-23T15:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffc7ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc7b4e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 --2- 172.21.15.7:0/2892527708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc6f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 -- 172.21.15.7:0/2892527708 >> 172.21.15.7:0/2892527708 conn(0x55fbffc54ce0 msgr2=0x55fbffc5bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 -- 172.21.15.7:0/2892527708 shutdown_connections 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 -- 172.21.15.7:0/2892527708 wait complete. 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.090+0000 7f376ce78740 1 -- start start 2024-04-23T15:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 Processor -- start 2024-04-23T15:03:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc66b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc67040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffcd7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ae470 con 0x55fbffc590f0 2024-04-23T15:03:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37641adda0 con 0x55fbffc587d0 2024-04-23T15:03:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ab000 con 0x55fbffc639b0 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.091+0000 7f376ce78740 10 client.0 _ll_register_callbacks cb 0x7f37540095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc67040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc67040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58652/0 (socket says 172.21.15.7:58652) 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 -- 172.21.15.7:0/2724886333 learned_addr learned my addr 172.21.15.7:0/2724886333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3762a00640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc66b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3762a00640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffcd7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 -- 172.21.15.7:0/2724886333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 msgr2=0x55fbffcd7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffcd7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 -- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 msgr2=0x55fbffc66b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc66b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.092+0000 7f3763400640 1 -- 172.21.15.7:0/2724886333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbffcd8280 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f3763400640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc67040 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3754014010 tx=0x7f3754005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f33787a1bc75c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f374cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f374cc00640 1 -- 172.21.15.7:0/2724886333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754005520 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f374cc00640 1 -- 172.21.15.7:0/2724886333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9467+0+0 (secure 0 0 0) 0x7f3754021260 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3754025030 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f374cc00640 1 -- 172.21.15.7:0/2724886333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3754021460 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f376ce78740 10 client.16665 fetch_fsmap learned FSMap version 32 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.093+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fbffcd9510 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f374cc00640 1 -- 172.21.15.7:0/2724886333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3754025030 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f374cc00640 1 -- 172.21.15.7:0/2724886333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3754033510 con 0x55fbffc590f0 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f376ce78740 10 client.16665 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f376ce78740 10 client.16665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:03:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f376ce78740 20 client.16665 populate_metadata read hostname 'smithi007' 2024-04-23T15:03:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f376ce78740 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffcd9cb0 0x55fbffcdc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f376ce78740 4 client.16665 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:03:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.094+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fbffb3e4b0 con 0x55fbffcd9cb0 2024-04-23T15:03:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.095+0000 7f3762a00640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffcd9cb0 0x55fbffcdc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.096+0000 7f3762a00640 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffcd9cb0 0x55fbffcdc0d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6376f27a9eab3ba server_cookie=9a01be4c68e49121 in_seq=0 out_seq=0 2024-04-23T15:03:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.096+0000 7f374cc00640 10 client.16665 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f374cc00640 1 -- 172.21.15.7:0/2724886333 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fbffb3e4b0 con 0x55fbffcd9cb0 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f374cc00640 10 client.16665 handle_command_reply: tid=0 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f376ce78740 1 client.16665 shutdown 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 msgr2=0x55fbffc67040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f376ce78740 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc67040 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3754014010 tx=0x7f3754005130 comp rx=0 tx=0).stop 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 shutdown_connections 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f376ce78740 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fbffcd9cb0 0x55fbffcdc0d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.142+0000 7f376ce78740 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fbffc639b0 0x55fbffcd7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f376ce78740 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbffc590f0 0x55fbffc67040 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f376ce78740 1 --2- 172.21.15.7:0/2724886333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fbffc587d0 0x55fbffc66b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f374cc00640 0 client.16665 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 >> 172.21.15.7:0/2724886333 conn(0x55fbffc54ce0 msgr2=0x55fbffc4f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 shutdown_connections 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f376ce78740 1 -- 172.21.15.7:0/2724886333 wait complete. 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.143+0000 7f376ce78740 20 client.16665 trim_cache size 0 max 16384 2024-04-23T15:03:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:03:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:03:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:03:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:03:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f37480a3d90 msgr2=0x7f37480a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f37480a3d90 0x7f37480a6250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f375c003fd0 tx=0x7f375c0095c0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 msgr2=0x7f376419d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 0x7f376419d360 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f375c009dc0 tx=0x7f375c032ff0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 shutdown_connections 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f37480a3d90 0x7f37480a6250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764106030 0x7f3764198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f376419ceb0 0x7f376419d360 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 --2- 172.21.15.7:0/243257986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3764100f60 0x7f37641985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 >> 172.21.15.7:0/243257986 conn(0x7f37640fc820 msgr2=0x7f3764069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 shutdown_connections 2024-04-23T15:03:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:03:59.144+0000 7f3768a00640 1 -- 172.21.15.7:0/243257986 wait complete. 2024-04-23T15:04:00.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:03:59 smithi007 ceph-mon[27906]: pgmap v394: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:03:59 smithi186 ceph-mon[31814]: pgmap v394: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:03:59 smithi137 ceph-mon[31694]: pgmap v394: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:01.015 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:00 smithi186 ceph-mon[31814]: pgmap v395: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:01.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:00 smithi007 ceph-mon[27906]: pgmap v395: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:00 smithi137 ceph-mon[31694]: pgmap v395: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:03 smithi007 ceph-mon[27906]: osdmap e107: 12 total, 12 up, 12 in 2024-04-23T15:04:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:03 smithi007 ceph-mon[27906]: pgmap v397: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.8 MiB/s wr, 37 op/s 2024-04-23T15:04:03.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:03 smithi186 ceph-mon[31814]: osdmap e107: 12 total, 12 up, 12 in 2024-04-23T15:04:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:03 smithi186 ceph-mon[31814]: pgmap v397: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.8 MiB/s wr, 37 op/s 2024-04-23T15:04:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:03 smithi137 ceph-mon[31694]: osdmap e107: 12 total, 12 up, 12 in 2024-04-23T15:04:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:03 smithi137 ceph-mon[31694]: pgmap v397: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.8 MiB/s wr, 37 op/s 2024-04-23T15:04:06.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:05 smithi007 ceph-mon[27906]: pgmap v398: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.8 MiB/s wr, 37 op/s 2024-04-23T15:04:06.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:05 smithi186 ceph-mon[31814]: pgmap v398: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.8 MiB/s wr, 37 op/s 2024-04-23T15:04:06.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:05 smithi137 ceph-mon[31694]: pgmap v398: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.8 MiB/s wr, 37 op/s 2024-04-23T15:04:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:07 smithi007 ceph-mon[27906]: pgmap v399: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:04:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:07 smithi186 ceph-mon[31814]: pgmap v399: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:04:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:07 smithi137 ceph-mon[31694]: pgmap v399: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:04:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:09 smithi007 ceph-mon[27906]: pgmap v400: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:04:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:09 smithi186 ceph-mon[31814]: pgmap v400: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:04:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:09 smithi137 ceph-mon[31694]: pgmap v400: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:04:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:11 smithi137 ceph-mon[31694]: osdmap e108: 12 total, 12 up, 12 in 2024-04-23T15:04:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:11 smithi137 ceph-mon[31694]: pgmap v402: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.6 MiB/s wr, 7 op/s 2024-04-23T15:04:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:11 smithi007 ceph-mon[27906]: osdmap e108: 12 total, 12 up, 12 in 2024-04-23T15:04:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:11 smithi007 ceph-mon[27906]: pgmap v402: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.6 MiB/s wr, 7 op/s 2024-04-23T15:04:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:11 smithi186 ceph-mon[31814]: osdmap e108: 12 total, 12 up, 12 in 2024-04-23T15:04:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:11 smithi186 ceph-mon[31814]: pgmap v402: 129 pgs: 129 active+clean; 2.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.6 MiB/s wr, 7 op/s 2024-04-23T15:04:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 -- 172.21.15.7:0/196871255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103060 msgr2=0x7f7714103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 --2- 172.21.15.7:0/196871255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103060 0x7f7714103440 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7704009900 tx=0x7f770402a480 comp rx=0 tx=0).stop 2024-04-23T15:04:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 -- 172.21.15.7:0/196871255 shutdown_connections 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 --2- 172.21.15.7:0/196871255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f771410c430 0x7f771410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 --2- 172.21.15.7:0/196871255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103980 0x7f771410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 --2- 172.21.15.7:0/196871255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103060 0x7f7714103440 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 -- 172.21.15.7:0/196871255 >> 172.21.15.7:0/196871255 conn(0x7f77140fc820 msgr2=0x7f77140fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 -- 172.21.15.7:0/196871255 shutdown_connections 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.297+0000 7f7713200640 1 -- 172.21.15.7:0/196871255 wait complete. 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.298+0000 7f7713200640 1 Processor -- start 2024-04-23T15:04:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 -- start start 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103060 0x7f7714196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 0x7f7714196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f771410c430 0x7f771419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f771410fec0 con 0x7f7714103980 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f771410fd40 con 0x7f771410c430 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7713200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7714110040 con 0x7f7714103060 2024-04-23T15:04:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.299+0000 7f7711400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 0x7f7714196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 0x7f7714196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37766/0 (socket says 172.21.15.7:37766) 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 -- 172.21.15.7:0/2716067849 learned_addr learned my addr 172.21.15.7:0/2716067849 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711e00640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103060 0x7f7714196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7712800640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f771410c430 0x7f771419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 -- 172.21.15.7:0/2716067849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103060 msgr2=0x7f7714196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103060 0x7f7714196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 -- 172.21.15.7:0/2716067849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f771410c430 msgr2=0x7f771419ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f771410c430 0x7f771419ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 -- 172.21.15.7:0/2716067849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771419b430 con 0x7f7714103980 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711e00640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103060 0x7f7714196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.300+0000 7f7711400640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 0x7f7714196980 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f770000e9f0 tx=0x7f770000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.301+0000 7f770aa00640 1 -- 172.21.15.7:0/2716067849 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770000cd80 con 0x7f7714103980 2024-04-23T15:04:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.301+0000 7f770aa00640 1 -- 172.21.15.7:0/2716067849 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77000054d0 con 0x7f7714103980 2024-04-23T15:04:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.301+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771419b720 con 0x7f7714103980 2024-04-23T15:04:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.301+0000 7f770aa00640 1 -- 172.21.15.7:0/2716067849 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700010490 con 0x7f7714103980 2024-04-23T15:04:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.301+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141a2fb0 con 0x7f7714103980 2024-04-23T15:04:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 Processor -- start 2024-04-23T15:04:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 -- start start 2024-04-23T15:04:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f770aa00640 1 -- 172.21.15.7:0/2716067849 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7700005020 con 0x7f7714103980 2024-04-23T15:04:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 0x55f7cf5567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf556ce0 0x55f7cf561060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf563990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f7cf4bc900 con 0x55f7cf5563c0 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f7cf462f20 con 0x55f7cf556ce0 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.305+0000 7f771be09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f7cf4b88c0 con 0x55f7cf5615a0 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 0x55f7cf5567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 0x55f7cf5567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37776/0 (socket says 172.21.15.7:37776) 2024-04-23T15:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 -- 172.21.15.7:0/4091942172 learned_addr learned my addr 172.21.15.7:0/4091942172 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7711400640 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf563990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7711e00640 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf556ce0 0x55f7cf561060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 -- 172.21.15.7:0/4091942172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 msgr2=0x55f7cf563990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf563990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 -- 172.21.15.7:0/4091942172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf556ce0 msgr2=0x55f7cf561060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf556ce0 0x55f7cf561060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.306+0000 7f7712800640 1 -- 172.21.15.7:0/4091942172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7cf487e10 con 0x55f7cf5563c0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.307+0000 7f7712800640 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 0x55f7cf5567a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f770c009e60 tx=0x7f770c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934603d36634b83f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.307+0000 7f76ff400640 1 -- 172.21.15.7:0/4091942172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c016070 con 0x55f7cf5563c0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.307+0000 7f76ff400640 1 -- 172.21.15.7:0/4091942172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f770c004d20 con 0x55f7cf5563c0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.307+0000 7f76ff400640 1 -- 172.21.15.7:0/4091942172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c012740 con 0x55f7cf5563c0 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 -- 172.21.15.7:0/4091942172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 msgr2=0x55f7cf5567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 0x55f7cf5567a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f770c009e60 tx=0x7f770c010740 comp rx=0 tx=0).stop 2024-04-23T15:04:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f770aa00640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f76f80a8120 0x7f76f80aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 -- 172.21.15.7:0/4091942172 shutdown_connections 2024-04-23T15:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf556ce0 0x55f7cf561060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf563990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 --2- 172.21.15.7:0/4091942172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5563c0 0x55f7cf5567a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 -- 172.21.15.7:0/4091942172 >> 172.21.15.7:0/4091942172 conn(0x55f7cf5528d0 msgr2=0x55f7cf552cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f770aa00640 1 -- 172.21.15.7:0/2716067849 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f77000d10d0 con 0x7f7714103980 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f7712800640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f76f80a8120 0x7f76f80aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 -- 172.21.15.7:0/4091942172 shutdown_connections 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.308+0000 7f771be09740 1 -- 172.21.15.7:0/4091942172 wait complete. 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.309+0000 7f771be09740 1 -- start start 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.309+0000 7f7712800640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f76f80a8120 0x7f76f80aa5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f770c005a00 tx=0x7f770c005a60 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.309+0000 7f771be09740 1 Processor -- start 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf55e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf55eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf55f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f7cf5640e0 con 0x55f7cf556ce0 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f7cf4762c0 con 0x55f7cf5563c0 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f7cf564260 con 0x55f7cf5615a0 2024-04-23T15:04:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f771be09740 10 client.0 _ll_register_callbacks cb 0x55f7cf1cea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f7711400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf55eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f7711400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf55eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37788/0 (socket says 172.21.15.7:37788) 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f7711400640 1 -- 172.21.15.7:0/1645727892 learned_addr learned my addr 172.21.15.7:0/1645727892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f7711e00640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf55e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.310+0000 7f7712800640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf55f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711400640 1 -- 172.21.15.7:0/1645727892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 msgr2=0x55f7cf55f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711400640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf55f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711400640 1 -- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 msgr2=0x55f7cf55e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711400640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf55e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711400640 1 -- 172.21.15.7:0/1645727892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7cf486fd0 con 0x55f7cf556ce0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711e00640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf55e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f7711400640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf55eb40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f77000ce470 tx=0x7f770009c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31ae34a881797f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f76f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f76f3e00640 1 -- 172.21.15.7:0/1645727892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700005680 con 0x55f7cf556ce0 2024-04-23T15:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f76f3e00640 1 -- 172.21.15.7:0/1645727892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f77000ce690 con 0x55f7cf556ce0 2024-04-23T15:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.311+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f770c004d20 con 0x55f7cf556ce0 2024-04-23T15:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f76f3e00640 1 -- 172.21.15.7:0/1645727892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f77000ce890 con 0x55f7cf556ce0 2024-04-23T15:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 10 client.16677 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f7cf1cf210 con 0x55f7cf556ce0 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f76f3e00640 1 -- 172.21.15.7:0/1645727892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f770c004d20 con 0x55f7cf556ce0 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f76f3e00640 1 -- 172.21.15.7:0/1645727892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f77000bd0c0 con 0x55f7cf556ce0 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 10 client.16677 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 10 client.16677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 20 client.16677 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5717e0 0x55f7cf573c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 4 client.16677 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.312+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7cf4ca320 con 0x55f7cf5717e0 2024-04-23T15:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.313+0000 7f7711e00640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5717e0 0x55f7cf573c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.314+0000 7f7711e00640 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5717e0 0x55f7cf573c30 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8786d4cf2c0c9ab server_cookie=36e65f00c135b4e7 in_seq=0 out_seq=0 2024-04-23T15:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.314+0000 7f76f3e00640 10 client.16677 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f76f3e00640 1 -- 172.21.15.7:0/1645727892 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f7cf4ca320 con 0x55f7cf5717e0 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f76f3e00640 10 client.16677 handle_command_reply: tid=0 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 client.16677 shutdown 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 msgr2=0x55f7cf55eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf55eb40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f77000ce470 tx=0x7f770009c860 comp rx=0 tx=0).stop 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 shutdown_connections 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5717e0 0x55f7cf573c30 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5615a0 0x55f7cf55f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf55eb40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 --2- 172.21.15.7:0/1645727892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf55e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f76f3e00640 0 client.16677 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 >> 172.21.15.7:0/1645727892 conn(0x55f7cf5528d0 msgr2=0x55f7cf558650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 shutdown_connections 2024-04-23T15:04:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.316+0000 7f771be09740 1 -- 172.21.15.7:0/1645727892 wait complete. 2024-04-23T15:04:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.317+0000 7f771be09740 20 client.16677 trim_cache size 0 max 16384 2024-04-23T15:04:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.333+0000 7f771be09740 1 Processor -- start 2024-04-23T15:04:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.333+0000 7f771be09740 1 -- start start 2024-04-23T15:04:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.333+0000 7f771be09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5563c0 0x55f7cf560d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.333+0000 7f771be09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf552210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.333+0000 7f771be09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5615a0 0x55f7cf55e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f771be09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ad080 con 0x55f7cf556ce0 2024-04-23T15:04:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f771be09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f77141aebc0 con 0x55f7cf5615a0 2024-04-23T15:04:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f771be09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ad750 con 0x55f7cf5563c0 2024-04-23T15:04:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf552210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf552210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37798/0 (socket says 172.21.15.7:37798) 2024-04-23T15:04:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 -- 172.21.15.7:0/3368977077 learned_addr learned my addr 172.21.15.7:0/3368977077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711e00640 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5563c0 0x55f7cf560d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7712800640 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5615a0 0x55f7cf55e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 -- 172.21.15.7:0/3368977077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5563c0 msgr2=0x55f7cf560d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5563c0 0x55f7cf560d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 -- 172.21.15.7:0/3368977077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5615a0 msgr2=0x55f7cf55e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5615a0 0x55f7cf55e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.334+0000 7f7711400640 1 -- 172.21.15.7:0/3368977077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7cf563d00 con 0x55f7cf556ce0 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.335+0000 7f7711400640 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf552210 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7700009380 tx=0x7f770009b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd618620e6095f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.335+0000 7f76fea00640 1 -- 172.21.15.7:0/3368977077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770009ca30 con 0x55f7cf556ce0 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.335+0000 7f76fea00640 1 -- 172.21.15.7:0/3368977077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f770009d360 con 0x55f7cf556ce0 2024-04-23T15:04:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.335+0000 7f76fea00640 1 -- 172.21.15.7:0/3368977077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77000ce8a0 con 0x55f7cf556ce0 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 -- 172.21.15.7:0/3368977077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 msgr2=0x55f7cf552210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf552210 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7700009380 tx=0x7f770009b170 comp rx=0 tx=0).stop 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 -- 172.21.15.7:0/3368977077 shutdown_connections 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5615a0 0x55f7cf55e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf556ce0 0x55f7cf552210 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 --2- 172.21.15.7:0/3368977077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf5563c0 0x55f7cf560d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 -- 172.21.15.7:0/3368977077 >> 172.21.15.7:0/3368977077 conn(0x55f7cf5528d0 msgr2=0x55f7cf558650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 -- 172.21.15.7:0/3368977077 shutdown_connections 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.336+0000 7f771be09740 1 -- 172.21.15.7:0/3368977077 wait complete. 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 -- start start 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 Processor -- start 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf569540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf556ce0 0x55f7cf569a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 0x55f7cf566600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ae4f0 con 0x55f7cf5615a0 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ade20 con 0x55f7cf5563c0 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ab080 con 0x55f7cf556ce0 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.337+0000 7f771be09740 10 client.0 _ll_register_callbacks cb 0x7f770000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 0x55f7cf566600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 0x55f7cf566600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37808/0 (socket says 172.21.15.7:37808) 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 -- 172.21.15.7:0/3676159097 learned_addr learned my addr 172.21.15.7:0/3676159097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7711400640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf556ce0 0x55f7cf569a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7711e00640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf569540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 -- 172.21.15.7:0/3676159097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf556ce0 msgr2=0x55f7cf569a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf556ce0 0x55f7cf569a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 -- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 msgr2=0x55f7cf569540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf569540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.338+0000 7f7712800640 1 -- 172.21.15.7:0/3676159097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7cf29b620 con 0x55f7cf5615a0 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f7712800640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 0x55f7cf566600 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f770c010c40 tx=0x7f770c012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48251df1d9431ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f76f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f76f3e00640 1 -- 172.21.15.7:0/3676159097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c016040 con 0x55f7cf5615a0 2024-04-23T15:04:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f770009d360 con 0x55f7cf5615a0 2024-04-23T15:04:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f76f3e00640 1 -- 172.21.15.7:0/3676159097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f770c014270 con 0x55f7cf5615a0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f76f3e00640 1 -- 172.21.15.7:0/3676159097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f770c03d050 con 0x55f7cf5615a0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f771be09740 10 client.16683 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f7cf5e0f20 con 0x55f7cf5615a0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.339+0000 7f76f3e00640 1 -- 172.21.15.7:0/3676159097 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f770009d360 con 0x55f7cf5615a0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f76f3e00640 1 -- 172.21.15.7:0/3676159097 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f770c00f040 con 0x55f7cf5615a0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f771be09740 10 client.16683 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f771be09740 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f771be09740 20 client.16683 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f771be09740 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5e1350 0x55f7cf5e3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f771be09740 4 client.16683 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7cf4c4190 con 0x55f7cf5e1350 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.340+0000 7f7711e00640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5e1350 0x55f7cf5e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.341+0000 7f7711e00640 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5e1350 0x55f7cf5e3770 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96150ac2a6990936 server_cookie=238862618fc4fc6e in_seq=0 out_seq=0 2024-04-23T15:04:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.341+0000 7f76f3e00640 10 client.16683 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f76f3e00640 1 -- 172.21.15.7:0/3676159097 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f7cf4c4190 con 0x55f7cf5e1350 2024-04-23T15:04:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f76f3e00640 10 client.16683 handle_command_reply: tid=0 2024-04-23T15:04:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 client.16683 shutdown 2024-04-23T15:04:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 msgr2=0x55f7cf566600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 0x55f7cf566600 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f770c010c40 tx=0x7f770c012450 comp rx=0 tx=0).stop 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 shutdown_connections 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f7cf5e1350 0x55f7cf5e3770 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7cf5615a0 0x55f7cf566600 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7cf556ce0 0x55f7cf569a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 --2- 172.21.15.7:0/3676159097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f7cf5563c0 0x55f7cf569540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f76f3e00640 0 client.16683 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.392+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 >> 172.21.15.7:0/3676159097 conn(0x55f7cf5528d0 msgr2=0x55f7cf56c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.393+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 shutdown_connections 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.393+0000 7f771be09740 1 -- 172.21.15.7:0/3676159097 wait complete. 2024-04-23T15:04:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.393+0000 7f771be09740 20 client.16683 trim_cache size 0 max 16384 2024-04-23T15:04:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:04:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:04:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:04:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f76f80a8120 msgr2=0x7f76f80aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f76f80a8120 0x7f76f80aa5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f770c005a00 tx=0x7f770c005a60 comp rx=0 tx=0).stop 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 msgr2=0x7f7714196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 0x7f7714196980 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f770000e9f0 tx=0x7f770000edf0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 shutdown_connections 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f76f80a8120 0x7f76f80aa5e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f771410c430 0x7f771419ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7714103980 0x7f7714196980 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 --2- 172.21.15.7:0/2716067849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7714103060 0x7f7714196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 >> 172.21.15.7:0/2716067849 conn(0x7f77140fc820 msgr2=0x7f77140fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 shutdown_connections 2024-04-23T15:04:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:12.394+0000 7f7713200640 1 -- 172.21.15.7:0/2716067849 wait complete. 2024-04-23T15:04:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:13 smithi007 ceph-mon[27906]: pgmap v403: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-04-23T15:04:14.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:13 smithi186 ceph-mon[31814]: pgmap v403: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-04-23T15:04:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:13 smithi137 ceph-mon[31694]: pgmap v403: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-04-23T15:04:16.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:15 smithi007 ceph-mon[27906]: pgmap v404: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-04-23T15:04:16.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:15 smithi186 ceph-mon[31814]: pgmap v404: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-04-23T15:04:16.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:15 smithi137 ceph-mon[31694]: pgmap v404: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2024-04-23T15:04:18.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:17 smithi007 ceph-mon[27906]: pgmap v405: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:04:18.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:17 smithi186 ceph-mon[31814]: pgmap v405: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:04:18.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:17 smithi137 ceph-mon[31694]: pgmap v405: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:04:20.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:19 smithi007 ceph-mon[27906]: pgmap v406: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:04:20.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:19 smithi186 ceph-mon[31814]: pgmap v406: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:04:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:19 smithi137 ceph-mon[31694]: pgmap v406: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:04:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:21 smithi007 ceph-mon[27906]: pgmap v407: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:04:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:21 smithi186 ceph-mon[31814]: pgmap v407: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:04:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:21 smithi137 ceph-mon[31694]: pgmap v407: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:04:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:23 smithi007 ceph-mon[27906]: pgmap v408: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:04:24.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:23 smithi186 ceph-mon[31814]: pgmap v408: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:04:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:23 smithi137 ceph-mon[31694]: pgmap v408: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 -- 172.21.15.7:0/2212678275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490100b80 msgr2=0x7f1490100f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 --2- 172.21.15.7:0/2212678275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490100b80 0x7f1490100f60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1484009900 tx=0x7f148402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 -- 172.21.15.7:0/2212678275 shutdown_connections 2024-04-23T15:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 --2- 172.21.15.7:0/2212678275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490101530 0x7f149010e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 --2- 172.21.15.7:0/2212678275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f149010e730 0x7f1490110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 --2- 172.21.15.7:0/2212678275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490100b80 0x7f1490100f60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 -- 172.21.15.7:0/2212678275 >> 172.21.15.7:0/2212678275 conn(0x7f14900fc820 msgr2=0x7f14900fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 -- 172.21.15.7:0/2212678275 shutdown_connections 2024-04-23T15:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.549+0000 7f1497200640 1 -- 172.21.15.7:0/2212678275 wait complete. 2024-04-23T15:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.550+0000 7f1497200640 1 Processor -- start 2024-04-23T15:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.550+0000 7f1497200640 1 -- start start 2024-04-23T15:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1497200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490100b80 0x7f14901a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1497200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 0x7f14901a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1497200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f149010e730 0x7f149019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1497200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1490114360 con 0x7f1490101530 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1497200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f14901141e0 con 0x7f1490100b80 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1497200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14901144e0 con 0x7f149010e730 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1495400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 0x7f14901a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1495400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 0x7f14901a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51192/0 (socket says 172.21.15.7:51192) 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1495400640 1 -- 172.21.15.7:0/824880030 learned_addr learned my addr 172.21.15.7:0/824880030 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1495e00640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490100b80 0x7f14901a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.551+0000 7f1496800640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f149010e730 0x7f149019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495400640 1 -- 172.21.15.7:0/824880030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f149010e730 msgr2=0x7f149019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495400640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f149010e730 0x7f149019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495400640 1 -- 172.21.15.7:0/824880030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490100b80 msgr2=0x7f14901a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495400640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490100b80 0x7f14901a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495400640 1 -- 172.21.15.7:0/824880030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149019afe0 con 0x7f1490101530 2024-04-23T15:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495e00640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490100b80 0x7f14901a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1495400640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 0x7f14901a0ba0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f148000b4a0 tx=0x7f148000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f148aa00640 1 -- 172.21.15.7:0/824880030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480014070 con 0x7f1490101530 2024-04-23T15:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f148aa00640 1 -- 172.21.15.7:0/824880030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1480010ac0 con 0x7f1490101530 2024-04-23T15:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f148aa00640 1 -- 172.21.15.7:0/824880030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480017c30 con 0x7f1490101530 2024-04-23T15:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.552+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149019b2d0 con 0x7f1490101530 2024-04-23T15:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.553+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14901a75e0 con 0x7f1490101530 2024-04-23T15:04:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 Processor -- start 2024-04-23T15:04:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f148aa00640 1 -- 172.21.15.7:0/824880030 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f1490101530 2024-04-23T15:04:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 -- start start 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf6723d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 0x55cf6723f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf67198900 con 0x55cf6723d5a0 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cf6713ef20 con 0x55cf672323c0 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.557+0000 7f149b625740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cf671948c0 con 0x55cf67232ce0 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 0x55cf6723f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 0x55cf6723f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51204/0 (socket says 172.21.15.7:51204) 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 -- 172.21.15.7:0/4093566579 learned_addr learned my addr 172.21.15.7:0/4093566579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495e00640 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf6723d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1496800640 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 -- 172.21.15.7:0/4093566579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 msgr2=0x55cf6723d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf6723d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 -- 172.21.15.7:0/4093566579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 msgr2=0x55cf672327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.558+0000 7f1495400640 1 -- 172.21.15.7:0/4093566579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf67163e10 con 0x55cf6723d5a0 2024-04-23T15:04:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f148aa00640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14780a3d90 0x7f14780a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f1495400640 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 0x55cf6723f990 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f14800cd5c0 tx=0x7f14800d84b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ad4d819cc2fb07 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f148aa00640 1 -- 172.21.15.7:0/824880030 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f14800d0230 con 0x7f1490101530 2024-04-23T15:04:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f1496800640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14780a3d90 0x7f14780a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f147f000640 1 -- 172.21.15.7:0/4093566579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480098170 con 0x55cf6723d5a0 2024-04-23T15:04:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f147f000640 1 -- 172.21.15.7:0/4093566579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f148009c5d0 con 0x55cf6723d5a0 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.559+0000 7f147f000640 1 -- 172.21.15.7:0/4093566579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800d3dd0 con 0x55cf6723d5a0 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f1496800640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14780a3d90 0x7f14780a6250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f149006b5e0 tx=0x7f148c009580 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 -- 172.21.15.7:0/4093566579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 msgr2=0x55cf6723f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 0x55cf6723f990 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f14800cd5c0 tx=0x7f14800d84b0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 -- 172.21.15.7:0/4093566579 shutdown_connections 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf6723d5a0 0x55cf6723f990 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf6723d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 --2- 172.21.15.7:0/4093566579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.560+0000 7f149b625740 1 -- 172.21.15.7:0/4093566579 >> 172.21.15.7:0/4093566579 conn(0x55cf6722e8d0 msgr2=0x55cf6722ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.561+0000 7f149b625740 1 -- 172.21.15.7:0/4093566579 shutdown_connections 2024-04-23T15:04:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.561+0000 7f149b625740 1 -- 172.21.15.7:0/4093566579 wait complete. 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.561+0000 7f149b625740 1 -- start start 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.561+0000 7f149b625740 1 Processor -- start 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf6723a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf67232ce0 0x55cf6723aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6723d5a0 0x55cf6723aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf672400e0 con 0x55cf672323c0 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cf671522c0 con 0x55cf67232ce0 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cf67240260 con 0x55cf6723d5a0 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f149b625740 10 client.0 _ll_register_callbacks cb 0x55cf66eaaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f1495e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf6723a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f1495e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf6723a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51212/0 (socket says 172.21.15.7:51212) 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.562+0000 7f1495e00640 1 -- 172.21.15.7:0/3308104918 learned_addr learned my addr 172.21.15.7:0/3308104918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495400640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf67232ce0 0x55cf6723aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1496800640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6723d5a0 0x55cf6723aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495e00640 1 -- 172.21.15.7:0/3308104918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6723d5a0 msgr2=0x55cf6723aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495e00640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6723d5a0 0x55cf6723aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495e00640 1 -- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf67232ce0 msgr2=0x55cf6723aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495e00640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf67232ce0 0x55cf6723aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495e00640 1 -- 172.21.15.7:0/3308104918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf67162fd0 con 0x55cf672323c0 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1495e00640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf6723a570 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1484009900 tx=0x7f14840052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee1825792e7106 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1473400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.563+0000 7f1473400640 1 -- 172.21.15.7:0/3308104918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484035040 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.564+0000 7f1473400640 1 -- 172.21.15.7:0/3308104918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f14840048c0 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.564+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f148009c5d0 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.564+0000 7f1473400640 1 -- 172.21.15.7:0/3308104918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1484004ac0 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.564+0000 7f149b625740 10 client.16695 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.564+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cf66eab210 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.564+0000 7f1473400640 1 -- 172.21.15.7:0/3308104918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f148009c5d0 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f1473400640 1 -- 172.21.15.7:0/3308104918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f14840314a0 con 0x55cf672323c0 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f149b625740 10 client.16695 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f149b625740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f149b625740 20 client.16695 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f149b625740 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6724d700 0x55cf6724fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f149b625740 4 client.16695 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf671a6320 con 0x55cf6724d700 2024-04-23T15:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.565+0000 7f1495400640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6724d700 0x55cf6724fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.566+0000 7f1495400640 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6724d700 0x55cf6724fb10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8762f3cbc55df1bd server_cookie=1ff85a3fd3f938f2 in_seq=0 out_seq=0 2024-04-23T15:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.566+0000 7f1473400640 10 client.16695 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.568+0000 7f1473400640 1 -- 172.21.15.7:0/3308104918 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cf671a6320 con 0x55cf6724d700 2024-04-23T15:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.568+0000 7f1473400640 10 client.16695 handle_command_reply: tid=0 2024-04-23T15:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.568+0000 7f149b625740 1 client.16695 shutdown 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 msgr2=0x55cf6723a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf6723a570 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1484009900 tx=0x7f14840052e0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 shutdown_connections 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6724d700 0x55cf6724fb10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf67232ce0 0x55cf6723aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6723d5a0 0x55cf6723aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 --2- 172.21.15.7:0/3308104918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf6723a570 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f1473400640 0 client.16695 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 >> 172.21.15.7:0/3308104918 conn(0x55cf6722e8d0 msgr2=0x55cf6722da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 shutdown_connections 2024-04-23T15:04:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 1 -- 172.21.15.7:0/3308104918 wait complete. 2024-04-23T15:04:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.569+0000 7f149b625740 20 client.16695 trim_cache size 0 max 16384 2024-04-23T15:04:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.589+0000 7f149b625740 1 Processor -- start 2024-04-23T15:04:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.589+0000 7f149b625740 1 -- start start 2024-04-23T15:04:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f149b625740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6722e8d0 0x55cf6723cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f149b625740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672490e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f149b625740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 0x55cf67255420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f149b625740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14901b1500 con 0x55cf67232ce0 2024-04-23T15:04:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f149b625740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f14901b3040 con 0x55cf672323c0 2024-04-23T15:04:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f149b625740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14901b1bd0 con 0x55cf6722e8d0 2024-04-23T15:04:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f1496800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 0x55cf67255420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f1496800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 0x55cf67255420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51214/0 (socket says 172.21.15.7:51214) 2024-04-23T15:04:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f1496800640 1 -- 172.21.15.7:0/1952391911 learned_addr learned my addr 172.21.15.7:0/1952391911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.590+0000 7f1495e00640 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6722e8d0 0x55cf6723cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.591+0000 7f1496800640 1 -- 172.21.15.7:0/1952391911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6722e8d0 msgr2=0x55cf6723cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.591+0000 7f1496800640 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6722e8d0 0x55cf6723cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.591+0000 7f1496800640 1 -- 172.21.15.7:0/1952391911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 msgr2=0x55cf672490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.591+0000 7f1496800640 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.591+0000 7f1496800640 1 -- 172.21.15.7:0/1952391911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf66f77620 con 0x55cf67232ce0 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.591+0000 7f1496800640 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 0x55cf67255420 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f148c012790 tx=0x7f148c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79880813bd771bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.592+0000 7f147e600640 1 -- 172.21.15.7:0/1952391911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c01f780 con 0x55cf67232ce0 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.592+0000 7f147e600640 1 -- 172.21.15.7:0/1952391911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f148c01fdd0 con 0x55cf67232ce0 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.592+0000 7f147e600640 1 -- 172.21.15.7:0/1952391911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c0283d0 con 0x55cf67232ce0 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 -- 172.21.15.7:0/1952391911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 msgr2=0x55cf67255420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 0x55cf67255420 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f148c012790 tx=0x7f148c014000 comp rx=0 tx=0).stop 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 -- 172.21.15.7:0/1952391911 shutdown_connections 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf672323c0 0x55cf672490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf67232ce0 0x55cf67255420 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 --2- 172.21.15.7:0/1952391911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf6722e8d0 0x55cf6723cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 -- 172.21.15.7:0/1952391911 >> 172.21.15.7:0/1952391911 conn(0x55cf67229e60 msgr2=0x55cf67238e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 -- 172.21.15.7:0/1952391911 shutdown_connections 2024-04-23T15:04:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 -- 172.21.15.7:0/1952391911 wait complete. 2024-04-23T15:04:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 -- start start 2024-04-23T15:04:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.593+0000 7f149b625740 1 Processor -- start 2024-04-23T15:04:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf6722e8d0 0x55cf67245870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf67240c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf67241170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14901b2970 con 0x55cf672323c0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f14901b22a0 con 0x55cf6722e8d0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14901af500 con 0x55cf67232ce0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f149b625740 10 client.0 _ll_register_callbacks cb 0x7f1484004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f1495400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf67240c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f1495400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf67240c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51226/0 (socket says 172.21.15.7:51226) 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.594+0000 7f1495400640 1 -- 172.21.15.7:0/3640662695 learned_addr learned my addr 172.21.15.7:0/3640662695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495e00640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf6722e8d0 0x55cf67245870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1496800640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf67241170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495400640 1 -- 172.21.15.7:0/3640662695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 msgr2=0x55cf67241170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495400640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf67241170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495400640 1 -- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf6722e8d0 msgr2=0x55cf67245870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495400640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf6722e8d0 0x55cf67245870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495400640 1 -- 172.21.15.7:0/3640662695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf67241810 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1495400640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf67240c30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f14800d89b0 tx=0x7f14800175f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16ba5127e9985bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1473400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.595+0000 7f1473400640 1 -- 172.21.15.7:0/3640662695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800b5060 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f1473400640 1 -- 172.21.15.7:0/3640662695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f148009a1d0 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f148c01fdd0 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f1473400640 1 -- 172.21.15.7:0/3640662695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f148001e040 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 10 client.16701 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cf672b3bb0 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f1473400640 1 -- 172.21.15.7:0/3640662695 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f148c01fdd0 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f1473400640 1 -- 172.21.15.7:0/3640662695 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1480098540 con 0x55cf672323c0 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 10 client.16701 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 20 client.16701 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6723d5a0 0x55cf672b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 4 client.16701 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:04:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.596+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf671a0190 con 0x55cf6723d5a0 2024-04-23T15:04:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.597+0000 7f1495e00640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6723d5a0 0x55cf672b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.598+0000 7f1495e00640 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6723d5a0 0x55cf672b5eb0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd023f0b68ec7e9a server_cookie=826b7a95b2ce4109 in_seq=0 out_seq=0 2024-04-23T15:04:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.598+0000 7f1473400640 10 client.16701 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f1473400640 1 -- 172.21.15.7:0/3640662695 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf671a0190 con 0x55cf6723d5a0 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f1473400640 10 client.16701 handle_command_reply: tid=0 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 client.16701 shutdown 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 msgr2=0x55cf67240c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf67240c30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f14800d89b0 tx=0x7f14800175f0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 shutdown_connections 2024-04-23T15:04:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cf6723d5a0 0x55cf672b5eb0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf67232ce0 0x55cf67241170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf672323c0 0x55cf67240c30 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 --2- 172.21.15.7:0/3640662695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cf6722e8d0 0x55cf67245870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 >> 172.21.15.7:0/3640662695 conn(0x55cf67229e60 msgr2=0x55cf6722d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f1473400640 0 client.16701 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 shutdown_connections 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.630+0000 7f149b625740 1 -- 172.21.15.7:0/3640662695 wait complete. 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.631+0000 7f149b625740 20 client.16701 trim_cache size 0 max 16384 2024-04-23T15:04:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:04:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:04:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:04:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:04:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.631+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14780a3d90 msgr2=0x7f14780a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.631+0000 7f1497200640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14780a3d90 0x7f14780a6250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f149006b5e0 tx=0x7f148c009580 comp rx=0 tx=0).stop 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.631+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 msgr2=0x7f14901a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.631+0000 7f1497200640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 0x7f14901a0ba0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f148000b4a0 tx=0x7f148000b960 comp rx=0 tx=0).stop 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 shutdown_connections 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14780a3d90 0x7f14780a6250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f149010e730 0x7f149019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1490101530 0x7f14901a0ba0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 --2- 172.21.15.7:0/824880030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1490100b80 0x7f14901a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 >> 172.21.15.7:0/824880030 conn(0x7f14900fc820 msgr2=0x7f14900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 shutdown_connections 2024-04-23T15:04:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:25.632+0000 7f1497200640 1 -- 172.21.15.7:0/824880030 wait complete. 2024-04-23T15:04:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:25 smithi007 ceph-mon[27906]: pgmap v409: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:04:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:25 smithi186 ceph-mon[31814]: pgmap v409: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:04:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:25 smithi137 ceph-mon[31694]: pgmap v409: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:04:28.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:27 smithi007 ceph-mon[27906]: pgmap v410: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:04:28.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:27 smithi186 ceph-mon[31814]: pgmap v410: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:04:28.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:27 smithi137 ceph-mon[31694]: pgmap v410: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:04:30.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:29 smithi007 ceph-mon[27906]: pgmap v411: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:04:30.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:29 smithi186 ceph-mon[31814]: pgmap v411: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:04:30.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:29 smithi137 ceph-mon[31694]: pgmap v411: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:04:32.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:31 smithi007 ceph-mon[27906]: pgmap v412: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:04:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:31 smithi186 ceph-mon[31814]: pgmap v412: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:04:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:31 smithi137 ceph-mon[31694]: pgmap v412: 129 pgs: 129 active+clean; 3.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:04:34.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:33 smithi007 ceph-mon[27906]: pgmap v413: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:04:34.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:33 smithi186 ceph-mon[31814]: pgmap v413: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:04:34.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:33 smithi137 ceph-mon[31694]: pgmap v413: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:04:36.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:35 smithi007 ceph-mon[27906]: pgmap v414: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:04:36.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:35 smithi186 ceph-mon[31814]: pgmap v414: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:04:36.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:35 smithi137 ceph-mon[31694]: pgmap v414: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:04:38.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:37 smithi007 ceph-mon[27906]: pgmap v415: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:04:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:37 smithi186 ceph-mon[31814]: pgmap v415: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:04:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:37 smithi137 ceph-mon[31694]: pgmap v415: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 -- 172.21.15.7:0/2220054903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 msgr2=0x7f485c10ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 --2- 172.21.15.7:0/2220054903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c10ddf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4854009ca0 tx=0x7f485402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 -- 172.21.15.7:0/2220054903 shutdown_connections 2024-04-23T15:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 --2- 172.21.15.7:0/2220054903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c101b50 0x7f485c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 --2- 172.21.15.7:0/2220054903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c10ddf0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 --2- 172.21.15.7:0/2220054903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f485c1011a0 0x7f485c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 -- 172.21.15.7:0/2220054903 >> 172.21.15.7:0/2220054903 conn(0x7f485c078080 msgr2=0x7f485c078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 -- 172.21.15.7:0/2220054903 shutdown_connections 2024-04-23T15:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.784+0000 7f4862e00640 1 -- 172.21.15.7:0/2220054903 wait complete. 2024-04-23T15:04:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.785+0000 7f4862e00640 1 Processor -- start 2024-04-23T15:04:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 -- start start 2024-04-23T15:04:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f485c1011a0 0x7f485c1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c19a7c0 0x7f485c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f485c111190 con 0x7f485c106220 2024-04-23T15:04:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f485c111010 con 0x7f485c19a7c0 2024-04-23T15:04:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f4862e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f485c111310 con 0x7f485c1011a0 2024-04-23T15:04:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f485b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f485b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c1a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34422/0 (socket says 172.21.15.7:34422) 2024-04-23T15:04:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.786+0000 7f485b400640 1 -- 172.21.15.7:0/2014121495 learned_addr learned my addr 172.21.15.7:0/2014121495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:38.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f4860e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c19a7c0 0x7f485c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485be00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f485c1011a0 0x7f485c1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485b400640 1 -- 172.21.15.7:0/2014121495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f485c1011a0 msgr2=0x7f485c1a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485b400640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f485c1011a0 0x7f485c1a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485b400640 1 -- 172.21.15.7:0/2014121495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c19a7c0 msgr2=0x7f485c19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485b400640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c19a7c0 0x7f485c19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485b400640 1 -- 172.21.15.7:0/2014121495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c19b350 con 0x7f485c106220 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.787+0000 7f485b400640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c1a0b90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f484800d770 tx=0x7f484800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.788+0000 7f4858c00640 1 -- 172.21.15.7:0/2014121495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848017070 con 0x7f485c106220 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.788+0000 7f4858c00640 1 -- 172.21.15.7:0/2014121495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4848009c30 con 0x7f485c106220 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.788+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c19b640 con 0x7f485c106220 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.788+0000 7f4858c00640 1 -- 172.21.15.7:0/2014121495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484800f620 con 0x7f485c106220 2024-04-23T15:04:38.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.788+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c1a7820 con 0x7f485c106220 2024-04-23T15:04:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.792+0000 7f4865def740 1 Processor -- start 2024-04-23T15:04:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.792+0000 7f4865def740 1 -- start start 2024-04-23T15:04:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.792+0000 7f4858c00640 1 -- 172.21.15.7:0/2014121495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f484801a070 con 0x7f485c106220 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4865def740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c1131b0 0x558b4c113590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4865def740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c113ad0 0x558b4c11de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4865def740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c120780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4865def740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b4c079900 con 0x558b4c11e390 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4865def740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b4c01ff20 con 0x558b4c113ad0 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4865def740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558b4c0758c0 con 0x558b4c1131b0 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f485b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f485b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c120780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34436/0 (socket says 172.21.15.7:34436) 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f485b400640 1 -- 172.21.15.7:0/3860461770 learned_addr learned my addr 172.21.15.7:0/3860461770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f485be00640 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c113ad0 0x558b4c11de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.793+0000 7f4860e00640 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c1131b0 0x558b4c113590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f485b400640 1 -- 172.21.15.7:0/3860461770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c1131b0 msgr2=0x558b4c113590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f485b400640 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c1131b0 0x558b4c113590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f485b400640 1 -- 172.21.15.7:0/3860461770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c113ad0 msgr2=0x558b4c11de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f485b400640 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c113ad0 0x558b4c11de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f485b400640 1 -- 172.21.15.7:0/3860461770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b4c044e10 con 0x558b4c11e390 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f4858c00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48400a3dc0 0x7f48400a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.794+0000 7f485b400640 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c120780 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f48480cda00 tx=0x7f48480d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d354c3c076af8068 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.795+0000 7f4858c00640 1 -- 172.21.15.7:0/2014121495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f48480d0780 con 0x7f485c106220 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.795+0000 7f4860e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48400a3dc0 0x7f48400a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.795+0000 7f4851600640 1 -- 172.21.15.7:0/3860461770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48480df070 con 0x558b4c11e390 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.795+0000 7f4851600640 1 -- 172.21.15.7:0/3860461770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f484809ca10 con 0x558b4c11e390 2024-04-23T15:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.795+0000 7f4851600640 1 -- 172.21.15.7:0/3860461770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48480985b0 con 0x558b4c11e390 2024-04-23T15:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 -- 172.21.15.7:0/3860461770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 msgr2=0x558b4c120780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4860e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48400a3dc0 0x7f48400a6280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4854005cc0 tx=0x7f4854031b20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c120780 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f48480cda00 tx=0x7f48480d8670 comp rx=0 tx=0).stop 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 -- 172.21.15.7:0/3860461770 shutdown_connections 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c113ad0 0x558b4c11de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c120780 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 --2- 172.21.15.7:0/3860461770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c1131b0 0x558b4c113590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 -- 172.21.15.7:0/3860461770 >> 172.21.15.7:0/3860461770 conn(0x558b4c10f6c0 msgr2=0x558b4c10faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 -- 172.21.15.7:0/3860461770 shutdown_connections 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 -- 172.21.15.7:0/3860461770 wait complete. 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.796+0000 7f4865def740 1 -- start start 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 Processor -- start 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c11b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c11b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c11bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b4c120f60 con 0x558b4c11e390 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b4c0332c0 con 0x558b4c1131b0 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558b4c1210e0 con 0x558b4c113ad0 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.797+0000 7f4865def740 10 client.0 _ll_register_callbacks cb 0x558b4bd8ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c11bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c11bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34446/0 (socket says 172.21.15.7:34446) 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 -- 172.21.15.7:0/495638616 learned_addr learned my addr 172.21.15.7:0/495638616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f485b400640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c11b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f485be00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c11b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 -- 172.21.15.7:0/495638616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 msgr2=0x558b4c11b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c11b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 -- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 msgr2=0x558b4c11b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c11b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f4860e00640 1 -- 172.21.15.7:0/495638616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b4c043fd0 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.798+0000 7f485be00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c11b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.799+0000 7f4860e00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c11bdf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4854035000 tx=0x7f485402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16257c3e956a3def server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.799+0000 7f4846000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.799+0000 7f4846000640 1 -- 172.21.15.7:0/495638616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854003b80 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.799+0000 7f4846000640 1 -- 172.21.15.7:0/495638616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f4854003d20 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.799+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f484809ca10 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4846000640 1 -- 172.21.15.7:0/495638616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4854004040 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 10 client.16713 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b4bd8c210 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4846000640 1 -- 172.21.15.7:0/495638616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f484809ca10 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4846000640 1 -- 172.21.15.7:0/495638616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4854051070 con 0x558b4c11e390 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 10 client.16713 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 20 client.16713 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c12e4b0 0x558b4c130900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 4 client.16713 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:04:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.800+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b4c087320 con 0x558b4c12e4b0 2024-04-23T15:04:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.801+0000 7f485be00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c12e4b0 0x558b4c130900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.802+0000 7f485be00640 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c12e4b0 0x558b4c130900 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10932165149ea8d9 server_cookie=2ffc61f1851398d4 in_seq=0 out_seq=0 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.802+0000 7f4846000640 10 client.16713 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4846000640 1 -- 172.21.15.7:0/495638616 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558b4c087320 con 0x558b4c12e4b0 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4846000640 10 client.16713 handle_command_reply: tid=0 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 client.16713 shutdown 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 msgr2=0x558b4c11bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c11bdf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4854035000 tx=0x7f485402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 shutdown_connections 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c12e4b0 0x558b4c130900 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c11e390 0x558b4c11bdf0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c11b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 --2- 172.21.15.7:0/495638616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c11b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4846000640 0 client.16713 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 >> 172.21.15.7:0/495638616 conn(0x558b4c10f6c0 msgr2=0x558b4c10e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 shutdown_connections 2024-04-23T15:04:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.804+0000 7f4865def740 1 -- 172.21.15.7:0/495638616 wait complete. 2024-04-23T15:04:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.805+0000 7f4865def740 20 client.16713 trim_cache size 0 max 16384 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 Processor -- start 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 -- start start 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c129e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 0x558b4c115b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c11e390 0x558b4c10e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b1550 con 0x558b4c113ad0 2024-04-23T15:04:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b3090 con 0x558b4c1131b0 2024-04-23T15:04:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.825+0000 7f4865def740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b1c20 con 0x558b4c11e390 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 0x558b4c115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 0x558b4c115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34458/0 (socket says 172.21.15.7:34458) 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 -- 172.21.15.7:0/1291385895 learned_addr learned my addr 172.21.15.7:0/1291385895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f4860e00640 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c11e390 0x558b4c10e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485be00640 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c129e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 -- 172.21.15.7:0/1291385895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c11e390 msgr2=0x558b4c10e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c11e390 0x558b4c10e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 -- 172.21.15.7:0/1291385895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 msgr2=0x558b4c129e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c129e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.826+0000 7f485b400640 1 -- 172.21.15.7:0/1291385895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b4be58620 con 0x558b4c113ad0 2024-04-23T15:04:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.827+0000 7f485b400640 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 0x558b4c115b70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4848009610 tx=0x7f48480d0a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2773a6d3995596 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.827+0000 7f4850c00640 1 -- 172.21.15.7:0/1291385895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48480df030 con 0x558b4c113ad0 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.827+0000 7f4850c00640 1 -- 172.21.15.7:0/1291385895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4848009de0 con 0x558b4c113ad0 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.827+0000 7f4850c00640 1 -- 172.21.15.7:0/1291385895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848021070 con 0x558b4c113ad0 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 -- 172.21.15.7:0/1291385895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 msgr2=0x558b4c115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 0x558b4c115b70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4848009610 tx=0x7f48480d0a00 comp rx=0 tx=0).stop 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 -- 172.21.15.7:0/1291385895 shutdown_connections 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c11e390 0x558b4c10e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c113ad0 0x558b4c115b70 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 --2- 172.21.15.7:0/1291385895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c1131b0 0x558b4c129e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 -- 172.21.15.7:0/1291385895 >> 172.21.15.7:0/1291385895 conn(0x558b4c10f6c0 msgr2=0x558b4c10dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 -- 172.21.15.7:0/1291385895 shutdown_connections 2024-04-23T15:04:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 -- 172.21.15.7:0/1291385895 wait complete. 2024-04-23T15:04:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.828+0000 7f4865def740 1 -- start start 2024-04-23T15:04:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 Processor -- start 2024-04-23T15:04:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 0x558b4c121ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c1223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c11e390 0x558b4c122920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b29c0 con 0x558b4c1131b0 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1b22f0 con 0x558b4c11e390 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1af550 con 0x558b4c113ad0 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f4865def740 10 client.0 _ll_register_callbacks cb 0x7f4854009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f485be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 0x558b4c121ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.829+0000 7f485be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 0x558b4c121ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34472/0 (socket says 172.21.15.7:34472) 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 -- 172.21.15.7:0/3776104552 learned_addr learned my addr 172.21.15.7:0/3776104552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485b400640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c1223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 -- 172.21.15.7:0/3776104552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 msgr2=0x558b4c1223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c1223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f4860e00640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c11e390 0x558b4c122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 -- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c11e390 msgr2=0x558b4c122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c11e390 0x558b4c122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 -- 172.21.15.7:0/3776104552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b4c193b80 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485b400640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c1223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f4860e00640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c11e390 0x558b4c122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f485be00640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 0x558b4c121ea0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x558b4c131180 tx=0x7f484c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a233b72559ad9343 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.830+0000 7f4846000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4846000640 1 -- 172.21.15.7:0/3776104552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c004460 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4848009de0 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4846000640 1 -- 172.21.15.7:0/3776104552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f484c01e3b0 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4846000640 1 -- 172.21.15.7:0/3776104552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f484c02d050 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4865def740 10 client.16719 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b4c194ef0 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.831+0000 7f4846000640 1 -- 172.21.15.7:0/3776104552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4848009de0 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4846000640 1 -- 172.21.15.7:0/3776104552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f484c004830 con 0x558b4c1131b0 2024-04-23T15:04:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4865def740 10 client.16719 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4865def740 10 client.16719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4865def740 20 client.16719 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4865def740 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c1956a0 0x558b4c197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4865def740 4 client.16719 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558b4c081190 con 0x558b4c1956a0 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.832+0000 7f485b400640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c1956a0 0x558b4c197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.833+0000 7f485b400640 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c1956a0 0x558b4c197ac0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35761d3e651c29b4 server_cookie=d759999e9985f0b3 in_seq=0 out_seq=0 2024-04-23T15:04:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.833+0000 7f4846000640 10 client.16719 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.863+0000 7f4846000640 1 -- 172.21.15.7:0/3776104552 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558b4c081190 con 0x558b4c1956a0 2024-04-23T15:04:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.863+0000 7f4846000640 10 client.16719 handle_command_reply: tid=0 2024-04-23T15:04:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.863+0000 7f4865def740 1 client.16719 shutdown 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 msgr2=0x558b4c121ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 0x558b4c121ea0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x558b4c131180 tx=0x7f484c0128e0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 shutdown_connections 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b4c1956a0 0x558b4c197ac0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b4c11e390 0x558b4c122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b4c113ad0 0x558b4c1223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 --2- 172.21.15.7:0/3776104552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b4c1131b0 0x558b4c121ea0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4846000640 0 client.16719 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 >> 172.21.15.7:0/3776104552 conn(0x558b4c10f6c0 msgr2=0x558b4c10e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 shutdown_connections 2024-04-23T15:04:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 1 -- 172.21.15.7:0/3776104552 wait complete. 2024-04-23T15:04:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.864+0000 7f4865def740 20 client.16719 trim_cache size 0 max 16384 2024-04-23T15:04:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:04:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:04:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:04:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:04:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48400a3dc0 msgr2=0x7f48400a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48400a3dc0 0x7f48400a6280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4854005cc0 tx=0x7f4854031b20 comp rx=0 tx=0).stop 2024-04-23T15:04:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 msgr2=0x7f485c1a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c1a0b90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f484800d770 tx=0x7f484800dc30 comp rx=0 tx=0).stop 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 shutdown_connections 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f48400a3dc0 0x7f48400a6280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c19a7c0 0x7f485c19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f485c106220 0x7f485c1a0b90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 --2- 172.21.15.7:0/2014121495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f485c1011a0 0x7f485c1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 >> 172.21.15.7:0/2014121495 conn(0x7f485c078080 msgr2=0x7f485c10d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 shutdown_connections 2024-04-23T15:04:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:38.865+0000 7f4862e00640 1 -- 172.21.15.7:0/2014121495 wait complete. 2024-04-23T15:04:40.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:39 smithi007 ceph-mon[27906]: pgmap v416: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:39 smithi186 ceph-mon[31814]: pgmap v416: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:40.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:39 smithi137 ceph-mon[31694]: pgmap v416: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:41.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:40 smithi007 ceph-mon[27906]: pgmap v417: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:41.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:40 smithi186 ceph-mon[31814]: pgmap v417: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:40 smithi137 ceph-mon[31694]: pgmap v417: 129 pgs: 129 active+clean; 3.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:43 smithi007 ceph-mon[27906]: pgmap v418: 129 pgs: 129 active+clean; 3.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:04:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:43 smithi186 ceph-mon[31814]: pgmap v418: 129 pgs: 129 active+clean; 3.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:04:44.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:43 smithi137 ceph-mon[31694]: pgmap v418: 129 pgs: 129 active+clean; 3.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:04:45.970 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:45 smithi137 ceph-mon[31694]: pgmap v419: 129 pgs: 129 active+clean; 3.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-04-23T15:04:46.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:45 smithi007 ceph-mon[27906]: pgmap v419: 129 pgs: 129 active+clean; 3.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-04-23T15:04:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:45 smithi186 ceph-mon[31814]: pgmap v419: 129 pgs: 129 active+clean; 3.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 11 op/s 2024-04-23T15:04:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:47 smithi007 ceph-mon[27906]: pgmap v420: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 16 op/s 2024-04-23T15:04:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:47 smithi186 ceph-mon[31814]: pgmap v420: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 16 op/s 2024-04-23T15:04:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:47 smithi137 ceph-mon[31694]: pgmap v420: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 16 op/s 2024-04-23T15:04:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:49 smithi007 ceph-mon[27906]: pgmap v421: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:04:50.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:49 smithi186 ceph-mon[31814]: pgmap v421: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:04:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:49 smithi137 ceph-mon[31694]: pgmap v421: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:04:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 -- 172.21.15.7:0/1345725369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe81006ad70 msgr2=0x7fe81006b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 --2- 172.21.15.7:0/1345725369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe81006ad70 0x7fe81006b1f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009900 tx=0x7fe7fc02a410 comp rx=0 tx=0).stop 2024-04-23T15:04:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 -- 172.21.15.7:0/1345725369 shutdown_connections 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 --2- 172.21.15.7:0/1345725369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8101049f0 0x7fe810104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 --2- 172.21.15.7:0/1345725369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe81006ad70 0x7fe81006b1f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 --2- 172.21.15.7:0/1345725369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe810107050 0x7fe81006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 -- 172.21.15.7:0/1345725369 >> 172.21.15.7:0/1345725369 conn(0x7fe810076d00 msgr2=0x7fe810077110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 -- 172.21.15.7:0/1345725369 shutdown_connections 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.024+0000 7fe818200640 1 -- 172.21.15.7:0/1345725369 wait complete. 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.025+0000 7fe818200640 1 Processor -- start 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 -- start start 2024-04-23T15:04:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81006ad70 0x7fe8101a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8101049f0 0x7fe8101a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 0x7fe81019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe810118890 con 0x7fe810107050 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe810118710 con 0x7fe81006ad70 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe818200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe810118a10 con 0x7fe8101049f0 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe816200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 0x7fe81019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe816200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 0x7fe81019ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59614/0 (socket says 172.21.15.7:59614) 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.026+0000 7fe816200640 1 -- 172.21.15.7:0/968086638 learned_addr learned my addr 172.21.15.7:0/968086638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe815800640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81006ad70 0x7fe8101a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe814e00640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8101049f0 0x7fe8101a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe816200640 1 -- 172.21.15.7:0/968086638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8101049f0 msgr2=0x7fe8101a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe816200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8101049f0 0x7fe8101a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe816200640 1 -- 172.21.15.7:0/968086638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81006ad70 msgr2=0x7fe8101a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe816200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81006ad70 0x7fe8101a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe816200640 1 -- 172.21.15.7:0/968086638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81019f1b0 con 0x7fe810107050 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe815800640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81006ad70 0x7fe8101a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.027+0000 7fe816200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 0x7fe81019ea30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe80800eaa0 tx=0x7fe80800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.028+0000 7fe80e000640 1 -- 172.21.15.7:0/968086638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80800cdb0 con 0x7fe810107050 2024-04-23T15:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.028+0000 7fe80e000640 1 -- 172.21.15.7:0/968086638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe808005020 con 0x7fe810107050 2024-04-23T15:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.028+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81019f4a0 con 0x7fe810107050 2024-04-23T15:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.028+0000 7fe80e000640 1 -- 172.21.15.7:0/968086638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8080116d0 con 0x7fe810107050 2024-04-23T15:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.028+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101ab740 con 0x7fe810107050 2024-04-23T15:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe80e000640 1 -- 172.21.15.7:0/968086638 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe8080051d0 con 0x7fe810107050 2024-04-23T15:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 Processor -- start 2024-04-23T15:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 -- start start 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 0x55f35469a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3546a5390 0x55f3546a7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f354600900 con 0x55f35469a1b0 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f3545a6f20 con 0x55f3546a5390 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.032+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f3545fc8c0 con 0x55f35469aad0 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 0x55f35469a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 0x55f35469a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59618/0 (socket says 172.21.15.7:59618) 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 -- 172.21.15.7:0/62962793 learned_addr learned my addr 172.21.15.7:0/62962793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe815800640 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3546a5390 0x55f3546a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 -- 172.21.15.7:0/62962793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 msgr2=0x55f3546a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.033+0000 7fe814e00640 1 -- 172.21.15.7:0/62962793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3546a5390 msgr2=0x55f3546a7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe814e00640 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3546a5390 0x55f3546a7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe814e00640 1 -- 172.21.15.7:0/62962793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3545cbe10 con 0x55f35469a1b0 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe814e00640 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 0x55f35469a590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009230 tx=0x7fe7fc005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4477d8279e41febf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe80e000640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3dc0 0x7fe7f80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe80e000640 1 -- 172.21.15.7:0/968086638 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fe8080d0e70 con 0x7fe810107050 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe802a00640 1 -- 172.21.15.7:0/62962793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc043020 con 0x55f35469a1b0 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe815800640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3dc0 0x7fe7f80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe802a00640 1 -- 172.21.15.7:0/62962793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7fc0046c0 con 0x55f35469a1b0 2024-04-23T15:04:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.034+0000 7fe802a00640 1 -- 172.21.15.7:0/62962793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc035070 con 0x55f35469a1b0 2024-04-23T15:04:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.035+0000 7fe815800640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3dc0 0x7fe7f80a6280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55f35469b750 tx=0x7fe80400b5c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.035+0000 7fe81b1bf740 1 -- 172.21.15.7:0/62962793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 msgr2=0x55f35469a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.035+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 0x55f35469a590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009230 tx=0x7fe7fc005bc0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 -- 172.21.15.7:0/62962793 shutdown_connections 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3546a5390 0x55f3546a7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/62962793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469a1b0 0x55f35469a590 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 -- 172.21.15.7:0/62962793 >> 172.21.15.7:0/62962793 conn(0x55f3546966c0 msgr2=0x55f354696aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 -- 172.21.15.7:0/62962793 shutdown_connections 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 -- 172.21.15.7:0/62962793 wait complete. 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 -- start start 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.036+0000 7fe81b1bf740 1 Processor -- start 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 0x55f3546a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f3546a5390 0x55f3546a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3546a7fc0 con 0x55f35469aad0 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f3545ba2c0 con 0x55f35469a1b0 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f3546a8140 con 0x55f3546a5390 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe81b1bf740 10 client.0 _ll_register_callbacks cb 0x55f354312a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe814e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 0x55f3546a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe814e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 0x55f3546a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59624/0 (socket says 172.21.15.7:59624) 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.037+0000 7fe814e00640 1 -- 172.21.15.7:0/4206258812 learned_addr learned my addr 172.21.15.7:0/4206258812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe815800640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe816200640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f3546a5390 0x55f3546a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe814e00640 1 -- 172.21.15.7:0/4206258812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f3546a5390 msgr2=0x55f3546a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe814e00640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f3546a5390 0x55f3546a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe814e00640 1 -- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 msgr2=0x55f3546a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe814e00640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe814e00640 1 -- 172.21.15.7:0/4206258812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3545cafd0 con 0x55f35469aad0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe815800640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe814e00640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 0x55f3546a28e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc004f50 tx=0x7fe7fc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1ebf9526f05505 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.038+0000 7fe7f7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe7f7400640 1 -- 172.21.15.7:0/4206258812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc043030 con 0x55f35469aad0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7fc0046c0 con 0x55f35469aad0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe7f7400640 1 -- 172.21.15.7:0/4206258812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fe7fc005410 con 0x55f35469aad0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe7f7400640 1 -- 172.21.15.7:0/4206258812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe7fc058050 con 0x55f35469aad0 2024-04-23T15:04:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe81b1bf740 10 client.16731 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f354313210 con 0x55f35469aad0 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.039+0000 7fe7f7400640 1 -- 172.21.15.7:0/4206258812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7fc0046c0 con 0x55f35469aad0 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe7f7400640 1 -- 172.21.15.7:0/4206258812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe7fc003680 con 0x55f35469aad0 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe81b1bf740 10 client.16731 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe81b1bf740 10 client.16731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe81b1bf740 20 client.16731 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f3546b53f0 0x55f3546b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe81b1bf740 4 client.16731 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.040+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f35460e320 con 0x55f3546b53f0 2024-04-23T15:04:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.041+0000 7fe815800640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f3546b53f0 0x55f3546b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.042+0000 7fe815800640 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f3546b53f0 0x55f3546b77e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a3499b3bde2f3f server_cookie=4c5cdba1973ec50 in_seq=0 out_seq=0 2024-04-23T15:04:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.042+0000 7fe7f7400640 10 client.16731 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.043+0000 7fe7f7400640 1 -- 172.21.15.7:0/4206258812 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f35460e320 con 0x55f3546b53f0 2024-04-23T15:04:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.043+0000 7fe7f7400640 10 client.16731 handle_command_reply: tid=0 2024-04-23T15:04:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.043+0000 7fe81b1bf740 1 client.16731 shutdown 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 msgr2=0x55f3546a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 0x55f3546a28e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc004f50 tx=0x7fe7fc02a410 comp rx=0 tx=0).stop 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 shutdown_connections 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f3546b53f0 0x55f3546b77e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f3546a5390 0x55f3546a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f35469aad0 0x55f3546a28e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/4206258812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe7f7400640 0 client.16731 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 >> 172.21.15.7:0/4206258812 conn(0x55f3546966c0 msgr2=0x55f35469c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 shutdown_connections 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 1 -- 172.21.15.7:0/4206258812 wait complete. 2024-04-23T15:04:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.044+0000 7fe81b1bf740 20 client.16731 trim_cache size 0 max 16384 2024-04-23T15:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.062+0000 7fe81b1bf740 1 Processor -- start 2024-04-23T15:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.062+0000 7fe81b1bf740 1 -- start start 2024-04-23T15:04:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469a1b0 0x55f3546ba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469aad0 0x55f3546bad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f35469f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101b5820 con 0x55f3546a5390 2024-04-23T15:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101b7360 con 0x55f35469aad0 2024-04-23T15:04:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101b5ef0 con 0x55f35469a1b0 2024-04-23T15:04:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe816200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f35469f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe816200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f35469f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59640/0 (socket says 172.21.15.7:59640) 2024-04-23T15:04:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe816200640 1 -- 172.21.15.7:0/3982586616 learned_addr learned my addr 172.21.15.7:0/3982586616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe814e00640 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469aad0 0x55f3546bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.063+0000 7fe815800640 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469a1b0 0x55f3546ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe816200640 1 -- 172.21.15.7:0/3982586616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469a1b0 msgr2=0x55f3546ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe816200640 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469a1b0 0x55f3546ba800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe816200640 1 -- 172.21.15.7:0/3982586616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469aad0 msgr2=0x55f3546bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe816200640 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469aad0 0x55f3546bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe816200640 1 -- 172.21.15.7:0/3982586616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3543df620 con 0x55f3546a5390 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe814e00640 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469aad0 0x55f3546bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe816200640 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f35469f660 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe80800cfd0 tx=0x7fe80809d100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892e24d9c4344ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe802000640 1 -- 172.21.15.7:0/3982586616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80801f040 con 0x55f3546a5390 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe802000640 1 -- 172.21.15.7:0/3982586616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8080bd070 con 0x55f3546a5390 2024-04-23T15:04:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.064+0000 7fe802000640 1 -- 172.21.15.7:0/3982586616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808099200 con 0x55f3546a5390 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 -- 172.21.15.7:0/3982586616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 msgr2=0x55f35469f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f35469f660 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe80800cfd0 tx=0x7fe80809d100 comp rx=0 tx=0).stop 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 -- 172.21.15.7:0/3982586616 shutdown_connections 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469aad0 0x55f3546bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f35469f660 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/3982586616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469a1b0 0x55f3546ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 -- 172.21.15.7:0/3982586616 >> 172.21.15.7:0/3982586616 conn(0x55f3546966c0 msgr2=0x55f3546b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 -- 172.21.15.7:0/3982586616 shutdown_connections 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.065+0000 7fe81b1bf740 1 -- 172.21.15.7:0/3982586616 wait complete. 2024-04-23T15:04:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.066+0000 7fe81b1bf740 1 -- start start 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.066+0000 7fe81b1bf740 1 Processor -- start 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546baca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f3546b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101b6c90 con 0x55f3546a5390 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101b65c0 con 0x55f35469a1b0 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101b3820 con 0x55f35469aad0 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe81b1bf740 10 client.0 _ll_register_callbacks cb 0x7fe80400b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe816200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f3546b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe816200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f3546b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59656/0 (socket says 172.21.15.7:59656) 2024-04-23T15:04:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe816200640 1 -- 172.21.15.7:0/1648822416 learned_addr learned my addr 172.21.15.7:0/1648822416 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe815800640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546baca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe814e00640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.067+0000 7fe816200640 1 -- 172.21.15.7:0/1648822416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 msgr2=0x55f3546b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe816200640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe816200640 1 -- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 msgr2=0x55f3546baca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe816200640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546baca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe816200640 1 -- 172.21.15.7:0/1648822416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3546b8f10 con 0x55f3546a5390 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe814e00640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe816200640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f3546b86e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe808009270 tx=0x7fe808005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea86f540dabe0cf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe7f7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe7f7400640 1 -- 172.21.15.7:0/1648822416 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80801f040 con 0x55f3546a5390 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe7f7400640 1 -- 172.21.15.7:0/1648822416 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fe8080bbdd0 con 0x55f3546a5390 2024-04-23T15:04:52.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8080bd070 con 0x55f3546a5390 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.068+0000 7fe7f7400640 1 -- 172.21.15.7:0/1648822416 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe8080a0db0 con 0x55f3546a5390 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 10 client.16737 fetch_fsmap learned FSMap version 32 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f35471b710 con 0x55f3546a5390 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe7f7400640 1 -- 172.21.15.7:0/1648822416 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8080bd070 con 0x55f3546a5390 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe7f7400640 1 -- 172.21.15.7:0/1648822416 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe80800f040 con 0x55f3546a5390 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 10 client.16737 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 10 client.16737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 20 client.16737 populate_metadata read hostname 'smithi007' 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f35471bd80 0x55f35471e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 4 client.16737 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:04:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.069+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f354608190 con 0x55f35471bd80 2024-04-23T15:04:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.070+0000 7fe815800640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f35471bd80 0x55f35471e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:04:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.071+0000 7fe815800640 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f35471bd80 0x55f35471e170 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=838da687832e5cb server_cookie=f5d16498b5052d83 in_seq=0 out_seq=0 2024-04-23T15:04:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.071+0000 7fe7f7400640 10 client.16737 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:51 smithi007 ceph-mon[27906]: pgmap v422: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:04:52.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe7f7400640 1 -- 172.21.15.7:0/1648822416 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f354608190 con 0x55f35471bd80 2024-04-23T15:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe7f7400640 10 client.16737 handle_command_reply: tid=0 2024-04-23T15:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 client.16737 shutdown 2024-04-23T15:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 msgr2=0x55f3546b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f3546b86e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe808009270 tx=0x7fe808005790 comp rx=0 tx=0).stop 2024-04-23T15:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 shutdown_connections 2024-04-23T15:04:52.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f35471bd80 0x55f35471e170 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3546a5390 0x55f3546b86e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f35469aad0 0x55f3546b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 --2- 172.21.15.7:0/1648822416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f35469a1b0 0x55f3546baca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 >> 172.21.15.7:0/1648822416 conn(0x55f3546966c0 msgr2=0x55f3546a2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe7f7400640 0 client.16737 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 shutdown_connections 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.100+0000 7fe81b1bf740 1 -- 172.21.15.7:0/1648822416 wait complete. 2024-04-23T15:04:52.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.101+0000 7fe81b1bf740 20 client.16737 trim_cache size 0 max 16384 2024-04-23T15:04:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:04:52.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:04:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:04:52.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:04:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.101+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3dc0 msgr2=0x7fe7f80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.101+0000 7fe818200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3dc0 0x7fe7f80a6280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55f35469b750 tx=0x7fe80400b5c0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.101+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 msgr2=0x7fe81019ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:04:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.101+0000 7fe818200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 0x7fe81019ea30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe80800eaa0 tx=0x7fe80800ef60 comp rx=0 tx=0).stop 2024-04-23T15:04:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 shutdown_connections 2024-04-23T15:04:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3dc0 0x7fe7f80a6280 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe810107050 0x7fe81019ea30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8101049f0 0x7fe8101a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 --2- 172.21.15.7:0/968086638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81006ad70 0x7fe8101a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:04:52.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 >> 172.21.15.7:0/968086638 conn(0x7fe810076d00 msgr2=0x7fe8101036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:04:52.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 shutdown_connections 2024-04-23T15:04:52.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:04:52.102+0000 7fe818200640 1 -- 172.21.15.7:0/968086638 wait complete. 2024-04-23T15:04:52.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:51 smithi186 ceph-mon[31814]: pgmap v422: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:04:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:51 smithi137 ceph-mon[31694]: pgmap v422: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:04:54.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:53 smithi007 ceph-mon[27906]: pgmap v423: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:04:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:53 smithi186 ceph-mon[31814]: pgmap v423: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:04:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:53 smithi137 ceph-mon[31694]: pgmap v423: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:04:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:55 smithi007 ceph-mon[27906]: pgmap v424: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:56.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:55 smithi186 ceph-mon[31814]: pgmap v424: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:56.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:55 smithi137 ceph-mon[31694]: pgmap v424: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:04:58.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:57 smithi007 ceph-mon[27906]: pgmap v425: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:04:58.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:57 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:04:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:57 smithi186 ceph-mon[31814]: pgmap v425: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:04:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:57 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:04:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:57 smithi137 ceph-mon[31694]: pgmap v425: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:04:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:57 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:04:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:04:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:04:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:04:59.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:04:59.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:04:59.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:04:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:04:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:04:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:05:00.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:04:59 smithi007 ceph-mon[27906]: pgmap v426: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:04:59 smithi186 ceph-mon[31814]: pgmap v426: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:04:59 smithi137 ceph-mon[31694]: pgmap v426: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:02.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:01 smithi007 ceph-mon[27906]: pgmap v427: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:02.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:01 smithi186 ceph-mon[31814]: pgmap v427: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:02.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:01 smithi137 ceph-mon[31694]: pgmap v427: 129 pgs: 129 active+clean; 3.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:04.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:03 smithi007 ceph-mon[27906]: pgmap v428: 129 pgs: 129 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.5 MiB/s wr, 33 op/s 2024-04-23T15:05:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:03 smithi186 ceph-mon[31814]: pgmap v428: 129 pgs: 129 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.5 MiB/s wr, 33 op/s 2024-04-23T15:05:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:03 smithi137 ceph-mon[31694]: pgmap v428: 129 pgs: 129 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.5 MiB/s wr, 33 op/s 2024-04-23T15:05:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 -- 172.21.15.7:0/3021228605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e4109370 msgr2=0x7fa0e4110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 --2- 172.21.15.7:0/3021228605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e4109370 0x7fa0e4110f40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009ca0 tx=0x7fa0dc02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 -- 172.21.15.7:0/3021228605 shutdown_connections 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 --2- 172.21.15.7:0/3021228605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e4104c50 0x7fa0e4108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 --2- 172.21.15.7:0/3021228605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e4109370 0x7fa0e4110f40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 --2- 172.21.15.7:0/3021228605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e41042a0 0x7fa0e4104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 -- 172.21.15.7:0/3021228605 >> 172.21.15.7:0/3021228605 conn(0x7fa0e40ffae0 msgr2=0x7fa0e4101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 -- 172.21.15.7:0/3021228605 shutdown_connections 2024-04-23T15:05:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.261+0000 7fa0ea600640 1 -- 172.21.15.7:0/3021228605 wait complete. 2024-04-23T15:05:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.262+0000 7fa0ea600640 1 Processor -- start 2024-04-23T15:05:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 -- start start 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 0x7fa0e41a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e4109370 0x7fa0e41a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e419a6f0 0x7fa0e419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4114310 con 0x7fa0e41042a0 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4114190 con 0x7fa0e4109370 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.263+0000 7fa0ea600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4114490 con 0x7fa0e419a6f0 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 0x7fa0e41a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 0x7fa0e41a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52246/0 (socket says 172.21.15.7:52246) 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 -- 172.21.15.7:0/465227692 learned_addr learned my addr 172.21.15.7:0/465227692 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e4109370 0x7fa0e41a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e419a6f0 0x7fa0e419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 -- 172.21.15.7:0/465227692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e419a6f0 msgr2=0x7fa0e419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e419a6f0 0x7fa0e419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 -- 172.21.15.7:0/465227692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e4109370 msgr2=0x7fa0e41a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e4109370 0x7fa0e41a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.264+0000 7fa0e9200640 1 -- 172.21.15.7:0/465227692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e419b2f0 con 0x7fa0e41042a0 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.265+0000 7fa0e9200640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 0x7fa0e41a05e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e9f0 tx=0x7fa0d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.265+0000 7fa0e1600640 1 -- 172.21.15.7:0/465227692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400cd80 con 0x7fa0e41042a0 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.265+0000 7fa0e1600640 1 -- 172.21.15.7:0/465227692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0d40108e0 con 0x7fa0e41042a0 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.265+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e41a7380 con 0x7fa0e41042a0 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.265+0000 7fa0e1600640 1 -- 172.21.15.7:0/465227692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4018920 con 0x7fa0e41042a0 2024-04-23T15:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.265+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41a77e0 con 0x7fa0e41042a0 2024-04-23T15:05:05.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.268+0000 7fa0eea08740 1 Processor -- start 2024-04-23T15:05:05.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 -- start start 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea6447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea651990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557fea5aa900 con 0x557fea64f5a0 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557fea550f20 con 0x557fea6443c0 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0eea08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557fea5a68c0 con 0x557fea644ce0 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0e1600640 1 -- 172.21.15.7:0/465227692 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa0d4010a90 con 0x7fa0e41042a0 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea651990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea651990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52256/0 (socket says 172.21.15.7:52256) 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.269+0000 7fa0e3e00640 1 -- 172.21.15.7:0/3411960666 learned_addr learned my addr 172.21.15.7:0/3411960666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea6447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e9200640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e3e00640 1 -- 172.21.15.7:0/3411960666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 msgr2=0x557fea64f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e3e00640 1 -- 172.21.15.7:0/3411960666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 msgr2=0x557fea6447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea6447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e3e00640 1 -- 172.21.15.7:0/3411960666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fea575e10 con 0x557fea64f5a0 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea6447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e9200640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:05:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.270+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea651990 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009c20 tx=0x7fa0cc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4743b348be513c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.271+0000 7fa0da000640 1 -- 172.21.15.7:0/3411960666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc004050 con 0x557fea64f5a0 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.271+0000 7fa0da000640 1 -- 172.21.15.7:0/3411960666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0cc0054d0 con 0x557fea64f5a0 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.271+0000 7fa0da000640 1 -- 172.21.15.7:0/3411960666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc004c90 con 0x557fea64f5a0 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.271+0000 7fa0e1600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa0c80a3d90 0x7fa0c80a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.271+0000 7fa0e1600640 1 -- 172.21.15.7:0/465227692 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fa0d40d0e80 con 0x7fa0e41042a0 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.271+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa0c80a3d90 0x7fa0c80a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 -- 172.21.15.7:0/3411960666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 msgr2=0x557fea651990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea651990 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009c20 tx=0x7fa0cc011810 comp rx=0 tx=0).stop 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 -- 172.21.15.7:0/3411960666 shutdown_connections 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea651990 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3411960666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea6447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 -- 172.21.15.7:0/3411960666 >> 172.21.15.7:0/3411960666 conn(0x557fea6408d0 msgr2=0x557fea640cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 -- 172.21.15.7:0/3411960666 shutdown_connections 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa0c80a3d90 0x7fa0c80a6250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc006010 tx=0x7fa0dc004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.272+0000 7fa0eea08740 1 -- 172.21.15.7:0/3411960666 wait complete. 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.273+0000 7fa0eea08740 1 -- start start 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.273+0000 7fa0eea08740 1 Processor -- start 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea64cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557fea652170 con 0x557fea64f5a0 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557fea5642c0 con 0x557fea6443c0 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557fea6522f0 con 0x557fea644ce0 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0eea08740 10 client.0 _ll_register_callbacks cb 0x557fea2bca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0e9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea64cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0e9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea64cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52260/0 (socket says 172.21.15.7:52260) 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0e9c00640 1 -- 172.21.15.7:0/178013920 learned_addr learned my addr 172.21.15.7:0/178013920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0e9200640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.274+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0e9c00640 1 -- 172.21.15.7:0/178013920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 msgr2=0x557fea64c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0e9c00640 1 -- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 msgr2=0x557fea64c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0e9c00640 1 -- 172.21.15.7:0/178013920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fea574fd0 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea64cf00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009ca0 tx=0x7fa0dc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07d20810bd1311b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0d2a00640 1 -- 172.21.15.7:0/178013920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0305c0 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0d2a00640 1 -- 172.21.15.7:0/178013920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fa0dc030760 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.275+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0cc0054d0 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0d2a00640 1 -- 172.21.15.7:0/178013920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa0dc030960 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 10 client.16749 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557fea2bd210 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0d2a00640 1 -- 172.21.15.7:0/178013920 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0cc0054d0 con 0x557fea64f5a0 2024-04-23T15:05:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0d2a00640 1 -- 172.21.15.7:0/178013920 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa0dc051070 con 0x557fea64f5a0 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 10 client.16749 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 10 client.16749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 20 client.16749 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea65f600 0x557fea661aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 4 client.16749 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.276+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fea5b8320 con 0x557fea65f600 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.277+0000 7fa0e9200640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea65f600 0x557fea661aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.278+0000 7fa0e9200640 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea65f600 0x557fea661aa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a805736b5bb6c45 server_cookie=a28f9e007b60a195 in_seq=0 out_seq=0 2024-04-23T15:05:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.278+0000 7fa0d2a00640 10 client.16749 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0d2a00640 1 -- 172.21.15.7:0/178013920 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557fea5b8320 con 0x557fea65f600 2024-04-23T15:05:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0d2a00640 10 client.16749 handle_command_reply: tid=0 2024-04-23T15:05:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 client.16749 shutdown 2024-04-23T15:05:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 msgr2=0x557fea64cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea64cf00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009ca0 tx=0x7fa0dc02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 shutdown_connections 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea65f600 0x557fea661aa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea64cf00 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea64c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 --2- 172.21.15.7:0/178013920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 >> 172.21.15.7:0/178013920 conn(0x557fea6408d0 msgr2=0x557fea646600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.280+0000 7fa0d2a00640 0 client.16749 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.281+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 shutdown_connections 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.281+0000 7fa0eea08740 1 -- 172.21.15.7:0/178013920 wait complete. 2024-04-23T15:05:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.281+0000 7fa0eea08740 20 client.16749 trim_cache size 0 max 16384 2024-04-23T15:05:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 Processor -- start 2024-04-23T15:05:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 -- start start 2024-04-23T15:05:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea65b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea6673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41b1450 con 0x557fea64f5a0 2024-04-23T15:05:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41b2f90 con 0x557fea6443c0 2024-04-23T15:05:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.300+0000 7fa0eea08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41b1b20 con 0x557fea644ce0 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea6673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea6673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52268/0 (socket says 172.21.15.7:52268) 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 -- 172.21.15.7:0/973533394 learned_addr learned my addr 172.21.15.7:0/973533394 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea65b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9200640 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 -- 172.21.15.7:0/973533394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 msgr2=0x557fea65b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea65b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 -- 172.21.15.7:0/973533394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 msgr2=0x557fea64ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.301+0000 7fa0e9c00640 1 -- 172.21.15.7:0/973533394 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fea389620 con 0x557fea64f5a0 2024-04-23T15:05:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.302+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea6673b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc032010 tx=0x7fa0dc031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86975f155d6b90ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.302+0000 7fa0d9600640 1 -- 172.21.15.7:0/973533394 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc049420 con 0x557fea64f5a0 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.302+0000 7fa0d9600640 1 -- 172.21.15.7:0/973533394 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0dc036050 con 0x557fea64f5a0 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.302+0000 7fa0d9600640 1 -- 172.21.15.7:0/973533394 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc053a10 con 0x557fea64f5a0 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 -- 172.21.15.7:0/973533394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 msgr2=0x557fea6673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea6673b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc032010 tx=0x7fa0dc031960 comp rx=0 tx=0).stop 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 -- 172.21.15.7:0/973533394 shutdown_connections 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea64f5a0 0x557fea6673b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea644ce0 0x557fea65b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 --2- 172.21.15.7:0/973533394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea6443c0 0x557fea64ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 -- 172.21.15.7:0/973533394 >> 172.21.15.7:0/973533394 conn(0x557fea6408d0 msgr2=0x557fea64ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 -- 172.21.15.7:0/973533394 shutdown_connections 2024-04-23T15:05:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.303+0000 7fa0eea08740 1 -- 172.21.15.7:0/973533394 wait complete. 2024-04-23T15:05:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 -- start start 2024-04-23T15:05:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 Processor -- start 2024-04-23T15:05:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 0x557fea64a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea644ce0 0x557fea6575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea64f5a0 0x557fea6486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41b28c0 con 0x557fea6443c0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41b21f0 con 0x557fea644ce0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.304+0000 7fa0eea08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41af450 con 0x557fea64f5a0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0eea08740 10 client.0 _ll_register_callbacks cb 0x7fa0d4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 0x557fea64a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 0x557fea64a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52272/0 (socket says 172.21.15.7:52272) 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 -- 172.21.15.7:0/3380522075 learned_addr learned my addr 172.21.15.7:0/3380522075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea644ce0 0x557fea6575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9c00640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea64f5a0 0x557fea6486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 -- 172.21.15.7:0/3380522075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea64f5a0 msgr2=0x557fea6486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea64f5a0 0x557fea6486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 -- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea644ce0 msgr2=0x557fea6575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea644ce0 0x557fea6575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.305+0000 7fa0e9200640 1 -- 172.21.15.7:0/3380522075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fea648c30 con 0x557fea6443c0 2024-04-23T15:05:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0e9200640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 0x557fea64a160 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa0d409c7c0 tx=0x7fa0d40d32d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82d518d0dd81794 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0d2a00640 1 -- 172.21.15.7:0/3380522075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40b5020 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0d2a00640 1 -- 172.21.15.7:0/3380522075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fa0d40ce440 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0dc036050 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0d2a00640 1 -- 172.21.15.7:0/3380522075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa0d40ce640 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0eea08740 10 client.16755 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557fea6c52e0 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.306+0000 7fa0d2a00640 1 -- 172.21.15.7:0/3380522075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0dc036050 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0d2a00640 1 -- 172.21.15.7:0/3380522075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa0d409bf10 con 0x557fea6443c0 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0eea08740 10 client.16755 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0eea08740 10 client.16755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0eea08740 20 client.16755 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea6c59b0 0x557fea6c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0eea08740 4 client.16755 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:05:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.307+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557fea5b2190 con 0x557fea6c59b0 2024-04-23T15:05:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.308+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea6c59b0 0x557fea6c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.309+0000 7fa0e3e00640 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea6c59b0 0x557fea6c7dd0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c572a61ec07c2e server_cookie=29f4732c37997d0d in_seq=0 out_seq=0 2024-04-23T15:05:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.309+0000 7fa0d2a00640 10 client.16755 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.341+0000 7fa0d2a00640 1 -- 172.21.15.7:0/3380522075 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557fea5b2190 con 0x557fea6c59b0 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.341+0000 7fa0d2a00640 10 client.16755 handle_command_reply: tid=0 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.341+0000 7fa0eea08740 1 client.16755 shutdown 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.341+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 msgr2=0x557fea64a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.341+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 0x557fea64a160 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa0d409c7c0 tx=0x7fa0d40d32d0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 shutdown_connections 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557fea6c59b0 0x557fea6c7dd0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557fea644ce0 0x557fea6575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557fea64f5a0 0x557fea6486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 --2- 172.21.15.7:0/3380522075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fea6443c0 0x557fea64a160 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0d2a00640 0 client.16755 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 >> 172.21.15.7:0/3380522075 conn(0x557fea6408d0 msgr2=0x557fea645d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 shutdown_connections 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 1 -- 172.21.15.7:0/3380522075 wait complete. 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.342+0000 7fa0eea08740 20 client.16755 trim_cache size 0 max 16384 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:05:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:05:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:05:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:05:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.343+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa0c80a3d90 msgr2=0x7fa0c80a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.343+0000 7fa0ea600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa0c80a3d90 0x7fa0c80a6250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc006010 tx=0x7fa0dc004a40 comp rx=0 tx=0).stop 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.343+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 msgr2=0x7fa0e41a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.343+0000 7fa0ea600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 0x7fa0e41a05e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e9f0 tx=0x7fa0d400eeb0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 shutdown_connections 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa0c80a3d90 0x7fa0c80a6250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e4109370 0x7fa0e41a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e419a6f0 0x7fa0e419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 --2- 172.21.15.7:0/465227692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0e41042a0 0x7fa0e41a05e0 secure :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e9f0 tx=0x7fa0d400eeb0 comp rx=0 tx=0).stop 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 >> 172.21.15.7:0/465227692 conn(0x7fa0e40ffae0 msgr2=0x7fa0e4101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 shutdown_connections 2024-04-23T15:05:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:05.344+0000 7fa0ea600640 1 -- 172.21.15.7:0/465227692 wait complete. 2024-04-23T15:05:06.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:05 smithi007 ceph-mon[27906]: pgmap v429: 129 pgs: 129 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 28 op/s 2024-04-23T15:05:06.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:05 smithi186 ceph-mon[31814]: pgmap v429: 129 pgs: 129 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 28 op/s 2024-04-23T15:05:06.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:05 smithi137 ceph-mon[31694]: pgmap v429: 129 pgs: 129 active+clean; 3.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 28 op/s 2024-04-23T15:05:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:06 smithi007 ceph-mon[27906]: pgmap v430: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:05:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:06 smithi186 ceph-mon[31814]: pgmap v430: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:05:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:06 smithi137 ceph-mon[31694]: pgmap v430: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:05:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:09 smithi007 ceph-mon[27906]: pgmap v431: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 28 op/s 2024-04-23T15:05:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:09 smithi186 ceph-mon[31814]: pgmap v431: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 28 op/s 2024-04-23T15:05:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:09 smithi137 ceph-mon[31694]: pgmap v431: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 28 op/s 2024-04-23T15:05:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:11 smithi007 ceph-mon[27906]: pgmap v432: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 28 op/s 2024-04-23T15:05:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:11 smithi186 ceph-mon[31814]: pgmap v432: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 28 op/s 2024-04-23T15:05:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:11 smithi137 ceph-mon[31694]: pgmap v432: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 28 op/s 2024-04-23T15:05:14.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:13 smithi007 ceph-mon[27906]: pgmap v433: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T15:05:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:13 smithi186 ceph-mon[31814]: pgmap v433: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T15:05:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:13 smithi137 ceph-mon[31694]: pgmap v433: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T15:05:16.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:15 smithi007 ceph-mon[27906]: pgmap v434: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-04-23T15:05:16.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:15 smithi186 ceph-mon[31814]: pgmap v434: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-04-23T15:05:16.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:15 smithi137 ceph-mon[31694]: pgmap v434: 129 pgs: 129 active+clean; 3.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.6 MiB/s wr, 13 op/s 2024-04-23T15:05:18.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:17 smithi007 ceph-mon[27906]: pgmap v435: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.9 MiB/s wr, 18 op/s 2024-04-23T15:05:18.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:17 smithi186 ceph-mon[31814]: pgmap v435: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.9 MiB/s wr, 18 op/s 2024-04-23T15:05:18.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:17 smithi137 ceph-mon[31694]: pgmap v435: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.9 MiB/s wr, 18 op/s 2024-04-23T15:05:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 -- 172.21.15.7:0/3067991085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48107150 msgr2=0x7f4e4810ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/3067991085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48107150 0x7f4e4810ed20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009900 tx=0x7f4e4002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 -- 172.21.15.7:0/3067991085 shutdown_connections 2024-04-23T15:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/3067991085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48107150 0x7f4e4810ed20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/3067991085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e48102a30 0x7f4e48106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/3067991085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48102080 0x7f4e48102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 -- 172.21.15.7:0/3067991085 >> 172.21.15.7:0/3067991085 conn(0x7f4e480fd980 msgr2=0x7f4e480ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 -- 172.21.15.7:0/3067991085 shutdown_connections 2024-04-23T15:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.504+0000 7f4e4ca00640 1 -- 172.21.15.7:0/3067991085 wait complete. 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.505+0000 7f4e4ca00640 1 Processor -- start 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 -- start start 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 0x7f4e48074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48107150 0x7f4e48074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e48074d80 0x7f4e481a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48112110 con 0x7f4e48102080 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48111f90 con 0x7f4e48107150 2024-04-23T15:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e4ca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48112290 con 0x7f4e48074d80 2024-04-23T15:05:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.506+0000 7f4e47400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 0x7f4e48074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 0x7f4e48074300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50570/0 (socket says 172.21.15.7:50570) 2024-04-23T15:05:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 -- 172.21.15.7:0/1635746731 learned_addr learned my addr 172.21.15.7:0/1635746731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47e00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e48074d80 0x7f4e481a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48107150 0x7f4e48074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 -- 172.21.15.7:0/1635746731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e48074d80 msgr2=0x7f4e481a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e48074d80 0x7f4e481a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 -- 172.21.15.7:0/1635746731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48107150 msgr2=0x7f4e48074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48107150 0x7f4e48074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e47400640 1 -- 172.21.15.7:0/1635746731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e481a6ea0 con 0x7f4e48102080 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.507+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48107150 0x7f4e48074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:05:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.508+0000 7f4e47400640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 0x7f4e48074300 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800eab0 tx=0x7f4e3800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.508+0000 7f4e44c00640 1 -- 172.21.15.7:0/1635746731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800ce40 con 0x7f4e48102080 2024-04-23T15:05:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.508+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e481a7190 con 0x7f4e48102080 2024-04-23T15:05:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.508+0000 7f4e44c00640 1 -- 172.21.15.7:0/1635746731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e38011920 con 0x7f4e48102080 2024-04-23T15:05:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.508+0000 7f4e44c00640 1 -- 172.21.15.7:0/1635746731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38010a00 con 0x7f4e48102080 2024-04-23T15:05:18.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.508+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e481a7730 con 0x7f4e48102080 2024-04-23T15:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.513+0000 7f4e50dd0740 1 Processor -- start 2024-04-23T15:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 -- start start 2024-04-23T15:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6d97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6e6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5558ba63f900 con 0x5558ba6d93c0 2024-04-23T15:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5558ba5e5f20 con 0x5558ba6d9ce0 2024-04-23T15:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5558ba63b8c0 con 0x5558ba6e45a0 2024-04-23T15:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e44c00640 1 -- 172.21.15.7:0/1635746731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4e38011ad0 con 0x7f4e48102080 2024-04-23T15:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6d97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.514+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6d97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50574/0 (socket says 172.21.15.7:50574) 2024-04-23T15:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47e00640 1 -- 172.21.15.7:0/2027977025 learned_addr learned my addr 172.21.15.7:0/2027977025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47400640 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47e00640 1 -- 172.21.15.7:0/2027977025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 msgr2=0x5558ba6e6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6e6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47e00640 1 -- 172.21.15.7:0/2027977025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d9ce0 msgr2=0x5558ba6e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.515+0000 7f4e47e00640 1 -- 172.21.15.7:0/2027977025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ba60ae10 con 0x5558ba6d93c0 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.516+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6d97a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009900 tx=0x7f4e400041c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5f6b083b5bc1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.516+0000 7f4e44c00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e2c0a3d40 0x7f4e2c0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.517+0000 7f4e37e00640 1 -- 172.21.15.7:0/2027977025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40040070 con 0x5558ba6d93c0 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.517+0000 7f4e44c00640 1 -- 172.21.15.7:0/1635746731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f4e380d11f0 con 0x7f4e48102080 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.517+0000 7f4e37e00640 1 -- 172.21.15.7:0/2027977025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e400054d0 con 0x5558ba6d93c0 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.517+0000 7f4e37e00640 1 -- 172.21.15.7:0/2027977025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40035040 con 0x5558ba6d93c0 2024-04-23T15:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.517+0000 7f4e47400640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e2c0a3d40 0x7f4e2c0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2027977025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 msgr2=0x5558ba6d97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e47400640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e2c0a3d40 0x7f4e2c0a6200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e380ce640 tx=0x7f4e380094a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6d97a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009900 tx=0x7f4e400041c0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2027977025 shutdown_connections 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6e6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2027977025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6d97a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2027977025 >> 172.21.15.7:0/2027977025 conn(0x5558ba6d58d0 msgr2=0x5558ba6d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2027977025 shutdown_connections 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.518+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2027977025 wait complete. 2024-04-23T15:05:18.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.519+0000 7f4e50dd0740 1 -- start start 2024-04-23T15:05:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.519+0000 7f4e50dd0740 1 Processor -- start 2024-04-23T15:05:18.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d93c0 0x5558ba6e1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba6e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5558ba6e7080 con 0x5558ba6d9ce0 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5558ba5f92c0 con 0x5558ba6e45a0 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5558ba6e7200 con 0x5558ba6d93c0 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e50dd0740 10 client.0 _ll_register_callbacks cb 0x5558ba351a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50582/0 (socket says 172.21.15.7:50582) 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.520+0000 7f4e3ea00640 1 -- 172.21.15.7:0/2035806366 learned_addr learned my addr 172.21.15.7:0/2035806366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d93c0 0x5558ba6e1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba6e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e3ea00640 1 -- 172.21.15.7:0/2035806366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d93c0 msgr2=0x5558ba6e1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d93c0 0x5558ba6e1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e3ea00640 1 -- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 msgr2=0x5558ba6e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba6e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.521+0000 7f4e3ea00640 1 -- 172.21.15.7:0/2035806366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ba609fd0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.522+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e1b60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000bd90 tx=0x7f4e300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66b172687d02cef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.522+0000 7f4e34c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.523+0000 7f4e34c00640 1 -- 172.21.15.7:0/2035806366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30012650 con 0x5558ba6d9ce0 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.523+0000 7f4e34c00640 1 -- 172.21.15.7:0/2035806366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f4e300127f0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.523+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e400054d0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.523+0000 7f4e34c00640 1 -- 172.21.15.7:0/2035806366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4e300129f0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.523+0000 7f4e50dd0740 10 client.16767 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.523+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5558ba352210 con 0x5558ba6d9ce0 2024-04-23T15:05:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.524+0000 7f4e34c00640 1 -- 172.21.15.7:0/2035806366 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e400054d0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.524+0000 7f4e34c00640 1 -- 172.21.15.7:0/2035806366 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4e30004830 con 0x5558ba6d9ce0 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.524+0000 7f4e50dd0740 10 client.16767 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.524+0000 7f4e50dd0740 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.525+0000 7f4e50dd0740 20 client.16767 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.525+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba6f47d0 0x5558ba6f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.525+0000 7f4e50dd0740 4 client.16767 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.525+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558ba64d320 con 0x5558ba6f47d0 2024-04-23T15:05:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.526+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba6f47d0 0x5558ba6f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.527+0000 7f4e47e00640 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba6f47d0 0x5558ba6f6bc0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c8ec74691501a8 server_cookie=226ed0c328dcc7fc in_seq=0 out_seq=0 2024-04-23T15:05:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.527+0000 7f4e34c00640 10 client.16767 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.529+0000 7f4e34c00640 1 -- 172.21.15.7:0/2035806366 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5558ba64d320 con 0x5558ba6f47d0 2024-04-23T15:05:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.529+0000 7f4e34c00640 10 client.16767 handle_command_reply: tid=0 2024-04-23T15:05:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.529+0000 7f4e50dd0740 1 client.16767 shutdown 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 msgr2=0x5558ba6e1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e1b60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000bd90 tx=0x7f4e300117b0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 shutdown_connections 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba6f47d0 0x5558ba6f6bc0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba6e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e1b60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/2035806366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d93c0 0x5558ba6e1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e34c00640 0 client.16767 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 >> 172.21.15.7:0/2035806366 conn(0x5558ba6d58d0 msgr2=0x5558ba6db650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 shutdown_connections 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 1 -- 172.21.15.7:0/2035806366 wait complete. 2024-04-23T15:05:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.530+0000 7f4e50dd0740 20 client.16767 trim_cache size 0 max 16384 2024-04-23T15:05:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 Processor -- start 2024-04-23T15:05:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 -- start start 2024-04-23T15:05:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d93c0 0x5558ba6d5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6effd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6da420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b13f0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b2f30 con 0x5558ba6d93c0 2024-04-23T15:05:18.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.556+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b1ac0 con 0x5558ba6e45a0 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50586/0 (socket says 172.21.15.7:50586) 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 -- 172.21.15.7:0/1758558229 learned_addr learned my addr 172.21.15.7:0/1758558229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 -- 172.21.15.7:0/1758558229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 msgr2=0x5558ba6da420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e47e00640 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6da420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 -- 172.21.15.7:0/1758558229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d93c0 msgr2=0x5558ba6d5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d93c0 0x5558ba6d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e3ea00640 1 -- 172.21.15.7:0/1758558229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ba6e05d0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.557+0000 7f4e47e00640 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6da420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:05:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.558+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6effd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4e30004ca0 tx=0x7f4e3000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e547c155feb2f11 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.558+0000 7f4e37400640 1 -- 172.21.15.7:0/1758558229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3002e020 con 0x5558ba6d9ce0 2024-04-23T15:05:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.558+0000 7f4e37400640 1 -- 172.21.15.7:0/1758558229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e30012d90 con 0x5558ba6d9ce0 2024-04-23T15:05:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.558+0000 7f4e37400640 1 -- 172.21.15.7:0/1758558229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30005290 con 0x5558ba6d9ce0 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1758558229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 msgr2=0x5558ba6effd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6effd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4e30004ca0 tx=0x7f4e3000bf00 comp rx=0 tx=0).stop 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1758558229 shutdown_connections 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6e45a0 0x5558ba6da420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d9ce0 0x5558ba6effd0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1758558229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6d93c0 0x5558ba6d5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1758558229 >> 172.21.15.7:0/1758558229 conn(0x5558ba6d58d0 msgr2=0x5558ba6db600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1758558229 shutdown_connections 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.559+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1758558229 wait complete. 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.560+0000 7f4e50dd0740 1 -- start start 2024-04-23T15:05:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.560+0000 7f4e50dd0740 1 Processor -- start 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.560+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.560+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e50dd0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba753d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b2860 con 0x5558ba6d93c0 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481b2190 con 0x5558ba6e45a0 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e50dd0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e481af3f0 con 0x5558ba6d9ce0 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e50dd0740 10 client.0 _ll_register_callbacks cb 0x7f4e3000b950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6e87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50598/0 (socket says 172.21.15.7:50598) 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 -- 172.21.15.7:0/1907378213 learned_addr learned my addr 172.21.15.7:0/1907378213 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 -- 172.21.15.7:0/1907378213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d9ce0 msgr2=0x5558ba6e8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 -- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 msgr2=0x5558ba753d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba753d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.561+0000 7f4e47e00640 1 -- 172.21.15.7:0/1907378213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ba41e620 con 0x5558ba6d93c0 2024-04-23T15:05:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e47e00640 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6e87c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e40005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0cd30549b7386 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e34c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e34c00640 1 -- 172.21.15.7:0/1907378213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40035040 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e34c00640 1 -- 172.21.15.7:0/1907378213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f4e400047a0 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e30012d90 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e34c00640 1 -- 172.21.15.7:0/1907378213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4e40040040 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e50dd0740 10 client.16773 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.562+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5558ba75b4a0 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e34c00640 1 -- 172.21.15.7:0/1907378213 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e30012d90 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e34c00640 1 -- 172.21.15.7:0/1907378213 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4e40005120 con 0x5558ba6d93c0 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e50dd0740 10 client.16773 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e50dd0740 10 client.16773 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e50dd0740 20 client.16773 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba75b730 0x5558ba75db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e50dd0740 4 client.16773 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:05:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.563+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558ba647190 con 0x5558ba75b730 2024-04-23T15:05:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.564+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba75b730 0x5558ba75db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.564+0000 7f4e3ea00640 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba75b730 0x5558ba75db20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b732ff840d919ad server_cookie=7a532ba16b6006e7 in_seq=0 out_seq=0 2024-04-23T15:05:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.564+0000 7f4e34c00640 10 client.16773 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.599+0000 7f4e34c00640 1 -- 172.21.15.7:0/1907378213 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558ba647190 con 0x5558ba75b730 2024-04-23T15:05:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.599+0000 7f4e34c00640 10 client.16773 handle_command_reply: tid=0 2024-04-23T15:05:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.599+0000 7f4e50dd0740 1 client.16773 shutdown 2024-04-23T15:05:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.599+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 msgr2=0x5558ba6e87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.599+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6e87c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e40005760 comp rx=0 tx=0).stop 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 shutdown_connections 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5558ba75b730 0x5558ba75db20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558ba6e45a0 0x5558ba753d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558ba6d9ce0 0x5558ba6e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e34c00640 0 client.16773 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 --2- 172.21.15.7:0/1907378213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558ba6d93c0 0x5558ba6e87c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 >> 172.21.15.7:0/1907378213 conn(0x5558ba6d58d0 msgr2=0x5558ba6dad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 shutdown_connections 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 1 -- 172.21.15.7:0/1907378213 wait complete. 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.600+0000 7f4e50dd0740 20 client.16773 trim_cache size 0 max 16384 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:05:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e2c0a3d40 msgr2=0x7f4e2c0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e2c0a3d40 0x7f4e2c0a6200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e380ce640 tx=0x7f4e380094a0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 msgr2=0x7f4e48074300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 0x7f4e48074300 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800eab0 tx=0x7f4e3800ef70 comp rx=0 tx=0).stop 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 shutdown_connections 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e2c0a3d40 0x7f4e2c0a6200 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e48107150 0x7f4e48074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e48074d80 0x7f4e481a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 --2- 172.21.15.7:0/1635746731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e48102080 0x7f4e48074300 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.601+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 >> 172.21.15.7:0/1635746731 conn(0x7f4e480fd980 msgr2=0x7f4e480ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.602+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 shutdown_connections 2024-04-23T15:05:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:18.602+0000 7f4e4ca00640 1 -- 172.21.15.7:0/1635746731 wait complete. 2024-04-23T15:05:20.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:19 smithi007 ceph-mon[27906]: pgmap v436: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:05:20.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:19 smithi186 ceph-mon[31814]: pgmap v436: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:05:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:19 smithi137 ceph-mon[31694]: pgmap v436: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:05:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:21 smithi007 ceph-mon[27906]: pgmap v437: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:05:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:21 smithi186 ceph-mon[31814]: pgmap v437: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:05:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:21 smithi137 ceph-mon[31694]: pgmap v437: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:05:24.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:23 smithi007 ceph-mon[27906]: pgmap v438: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:24.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:23 smithi186 ceph-mon[31814]: pgmap v438: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:23 smithi137 ceph-mon[31694]: pgmap v438: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:25 smithi007 ceph-mon[27906]: pgmap v439: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:25 smithi186 ceph-mon[31814]: pgmap v439: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:25 smithi137 ceph-mon[31694]: pgmap v439: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:27 smithi007 ceph-mon[27906]: pgmap v440: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:28.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:27 smithi186 ceph-mon[31814]: pgmap v440: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:28.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:27 smithi137 ceph-mon[31694]: pgmap v440: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:29 smithi007 ceph-mon[27906]: pgmap v441: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:30.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:29 smithi186 ceph-mon[31814]: pgmap v441: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:30.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:29 smithi137 ceph-mon[31694]: pgmap v441: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.760+0000 7fb0c0200640 1 -- 172.21.15.7:0/3281677062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103a30 msgr2=0x7fb0b810c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.760+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3281677062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103a30 0x7fb0b810c0f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009900 tx=0x7fb0a402a480 comp rx=0 tx=0).stop 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 -- 172.21.15.7:0/3281677062 shutdown_connections 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3281677062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b810c630 0x7fb0b810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3281677062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103a30 0x7fb0b810c0f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3281677062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b8103110 0x7fb0b81034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 -- 172.21.15.7:0/3281677062 >> 172.21.15.7:0/3281677062 conn(0x7fb0b8078080 msgr2=0x7fb0b8078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 -- 172.21.15.7:0/3281677062 shutdown_connections 2024-04-23T15:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.761+0000 7fb0c0200640 1 -- 172.21.15.7:0/3281677062 wait complete. 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.762+0000 7fb0c0200640 1 Processor -- start 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.762+0000 7fb0c0200640 1 -- start start 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0c0200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 0x7fb0b8100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0c0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8103a30 0x7fb0b8101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0c0200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b810c630 0x7fb0b81019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0c0200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81122a0 con 0x7fb0b8103110 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0c0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b8112120 con 0x7fb0b8103a30 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0c0200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b8112420 con 0x7fb0b810c630 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0bd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 0x7fb0b8100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0bd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 0x7fb0b8100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39538/0 (socket says 172.21.15.7:39538) 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0bd800640 1 -- 172.21.15.7:0/3015457066 learned_addr learned my addr 172.21.15.7:0/3015457066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0bce00640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8103a30 0x7fb0b8101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0be200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b810c630 0x7fb0b81019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0bd800640 1 -- 172.21.15.7:0/3015457066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b810c630 msgr2=0x7fb0b81019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.763+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b810c630 0x7fb0b81019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0bd800640 1 -- 172.21.15.7:0/3015457066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8103a30 msgr2=0x7fb0b8101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8103a30 0x7fb0b8101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0bd800640 1 -- 172.21.15.7:0/3015457066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b81a6cc0 con 0x7fb0b8103110 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0be200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b810c630 0x7fb0b81019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 0x7fb0b8100f40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00d950 tx=0x7fb0ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0b6000640 1 -- 172.21.15.7:0/3015457066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac017070 con 0x7fb0b8103110 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0b6000640 1 -- 172.21.15.7:0/3015457066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0ac009c30 con 0x7fb0b8103110 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b81a6fb0 con 0x7fb0b8103110 2024-04-23T15:05:31.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0b6000640 1 -- 172.21.15.7:0/3015457066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00f620 con 0x7fb0b8103110 2024-04-23T15:05:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.764+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b81a7470 con 0x7fb0b8103110 2024-04-23T15:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.768+0000 7fb0b6000640 1 -- 172.21.15.7:0/3015457066 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb0ac0109a0 con 0x7fb0b8103110 2024-04-23T15:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 Processor -- start 2024-04-23T15:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 -- start start 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbdf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbbec780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557edbb45900 con 0x557edbbea390 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557edbaebf20 con 0x557edbbdf1b0 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.769+0000 7fb0c3058740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557edbb418c0 con 0x557edbbdfad0 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0b6000640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0a00a3e70 0x7fb0a00a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbbec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbbec780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39554/0 (socket says 172.21.15.7:39554) 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bce00640 1 -- 172.21.15.7:0/2519264482 learned_addr learned my addr 172.21.15.7:0/2519264482 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bd800640 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0be200640 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbdf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0b6000640 1 -- 172.21.15.7:0/3015457066 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fb0ac0d0810 con 0x7fb0b8103110 2024-04-23T15:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0be200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0a00a3e70 0x7fb0a00a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bce00640 1 -- 172.21.15.7:0/2519264482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 msgr2=0x557edbbe9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bce00640 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.770+0000 7fb0bce00640 1 -- 172.21.15.7:0/2519264482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 msgr2=0x557edbbdf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0bce00640 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbdf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0bce00640 1 -- 172.21.15.7:0/2519264482 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557edbb10e10 con 0x557edbbea390 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0bce00640 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbbec780 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009230 tx=0x7fb0a4004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45981fd57644c233 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0be200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0a00a3e70 0x7fb0a00a6330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005fd0 tx=0x7fb0b0005c80 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0aaa00640 1 -- 172.21.15.7:0/2519264482 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4035030 con 0x557edbbea390 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0aaa00640 1 -- 172.21.15.7:0/2519264482 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0a40046c0 con 0x557edbbea390 2024-04-23T15:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.771+0000 7fb0aaa00640 1 -- 172.21.15.7:0/2519264482 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4005d50 con 0x557edbbea390 2024-04-23T15:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 -- 172.21.15.7:0/2519264482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 msgr2=0x557edbbec780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbbec780 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009230 tx=0x7fb0a4004390 comp rx=0 tx=0).stop 2024-04-23T15:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 -- 172.21.15.7:0/2519264482 shutdown_connections 2024-04-23T15:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbbec780 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2519264482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbdf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.772+0000 7fb0c3058740 1 -- 172.21.15.7:0/2519264482 >> 172.21.15.7:0/2519264482 conn(0x557edbbdb6c0 msgr2=0x557edbbdbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.773+0000 7fb0c3058740 1 -- 172.21.15.7:0/2519264482 shutdown_connections 2024-04-23T15:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.773+0000 7fb0c3058740 1 -- 172.21.15.7:0/2519264482 wait complete. 2024-04-23T15:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.773+0000 7fb0c3058740 1 -- start start 2024-04-23T15:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.773+0000 7fb0c3058740 1 Processor -- start 2024-04-23T15:05:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 0x557edbbe7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbea390 0x557edbbe7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557edbbecf60 con 0x557edbbdf1b0 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557edbaff2c0 con 0x557edbbea390 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557edbbed0e0 con 0x557edbbdfad0 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.774+0000 7fb0c3058740 10 client.0 _ll_register_callbacks cb 0x557edb857a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 0x557edbbe7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 0x557edbbe7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39570/0 (socket says 172.21.15.7:39570) 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 -- 172.21.15.7:0/2994088179 learned_addr learned my addr 172.21.15.7:0/2994088179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0be200640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbea390 0x557edbbe7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bce00640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 -- 172.21.15.7:0/2994088179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 msgr2=0x557edbbe77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 -- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbea390 msgr2=0x557edbbe7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbea390 0x557edbbe7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.775+0000 7fb0bd800640 1 -- 172.21.15.7:0/2994088179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557edbb0ffd0 con 0x557edbbdf1b0 2024-04-23T15:05:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.776+0000 7fb0bd800640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 0x557edbbe7290 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0cdbb0 tx=0x7fb0ac00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fd9213130cac25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.776+0000 7fb09f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb09f400640 1 -- 172.21.15.7:0/2994088179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac020040 con 0x557edbbdf1b0 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb09f400640 1 -- 172.21.15.7:0/2994088179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fb0ac0cddd0 con 0x557edbbdf1b0 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0a40046c0 con 0x557edbbdf1b0 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb09f400640 1 -- 172.21.15.7:0/2994088179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb0ac0cdfd0 con 0x557edbbdf1b0 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb0c3058740 10 client.16785 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557edb858210 con 0x557edbbdf1b0 2024-04-23T15:05:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.779+0000 7fb09f400640 1 -- 172.21.15.7:0/2994088179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0a40046c0 con 0x557edbbdf1b0 2024-04-23T15:05:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb09f400640 1 -- 172.21.15.7:0/2994088179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb0ac010460 con 0x557edbbdf1b0 2024-04-23T15:05:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb0c3058740 10 client.16785 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb0c3058740 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb0c3058740 20 client.16785 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc02be0 0x557edbc04ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb0c3058740 4 client.16785 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.780+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557edbb53320 con 0x557edbc02be0 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.781+0000 7fb0bce00640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc02be0 0x557edbc04ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.782+0000 7fb0bce00640 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc02be0 0x557edbc04ff0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafa3cff998f6efc server_cookie=207c16d6638ec07a in_seq=0 out_seq=0 2024-04-23T15:05:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.782+0000 7fb09f400640 10 client.16785 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb09f400640 1 -- 172.21.15.7:0/2994088179 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557edbb53320 con 0x557edbc02be0 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb09f400640 10 client.16785 handle_command_reply: tid=0 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 client.16785 shutdown 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 msgr2=0x557edbbe7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 0x557edbbe7290 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0cdbb0 tx=0x7fb0ac00bf60 comp rx=0 tx=0).stop 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 shutdown_connections 2024-04-23T15:05:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc02be0 0x557edbc04ff0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbea390 0x557edbbe7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 --2- 172.21.15.7:0/2994088179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdf1b0 0x557edbbe7290 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 >> 172.21.15.7:0/2994088179 conn(0x557edbbdb6c0 msgr2=0x557edbbe13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb09f400640 0 client.16785 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 shutdown_connections 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.784+0000 7fb0c3058740 1 -- 172.21.15.7:0/2994088179 wait complete. 2024-04-23T15:05:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.785+0000 7fb0c3058740 20 client.16785 trim_cache size 0 max 16384 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 Processor -- start 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 -- start start 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbfe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbc0a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81ad130 con 0x557edbbea390 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81aec70 con 0x557edbbdf1b0 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.801+0000 7fb0c3058740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81ad800 con 0x557edbbdfad0 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbc0a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbc0a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39584/0 (socket says 172.21.15.7:39584) 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 -- 172.21.15.7:0/228430963 learned_addr learned my addr 172.21.15.7:0/228430963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0bce00640 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0bd800640 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbfe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 -- 172.21.15.7:0/228430963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 msgr2=0x557edbbe1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 -- 172.21.15.7:0/228430963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 msgr2=0x557edbbfe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbfe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.802+0000 7fb0be200640 1 -- 172.21.15.7:0/228430963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557edb924620 con 0x557edbbea390 2024-04-23T15:05:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.803+0000 7fb0be200640 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbc0a950 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb0b001e590 tx=0x7fb0b000a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a44c019662d4287 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.803+0000 7fb0aa000640 1 -- 172.21.15.7:0/228430963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b001e220 con 0x557edbbea390 2024-04-23T15:05:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.803+0000 7fb0aa000640 1 -- 172.21.15.7:0/228430963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0b001caf0 con 0x557edbbea390 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.803+0000 7fb0aa000640 1 -- 172.21.15.7:0/228430963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b001dc80 con 0x557edbbea390 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 -- 172.21.15.7:0/228430963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 msgr2=0x557edbc0a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbc0a950 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb0b001e590 tx=0x7fb0b000a510 comp rx=0 tx=0).stop 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 -- 172.21.15.7:0/228430963 shutdown_connections 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbea390 0x557edbc0a950 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbdfad0 0x557edbbe1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 --2- 172.21.15.7:0/228430963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbfe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 -- 172.21.15.7:0/228430963 >> 172.21.15.7:0/228430963 conn(0x557edbbdb6c0 msgr2=0x557edbbe0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 -- 172.21.15.7:0/228430963 shutdown_connections 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.804+0000 7fb0c3058740 1 -- 172.21.15.7:0/228430963 wait complete. 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.805+0000 7fb0c3058740 1 -- start start 2024-04-23T15:05:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.805+0000 7fb0c3058740 1 Processor -- start 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.805+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbf6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.805+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 0x557edbbf7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0c3058740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbea390 0x557edbc681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0c3058740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81ae5a0 con 0x557edbbdfad0 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0c3058740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81aded0 con 0x557edbbdf1b0 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0c3058740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81ab130 con 0x557edbbea390 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0c3058740 10 client.0 _ll_register_callbacks cb 0x7fb0ac09bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 0x557edbbf7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 0x557edbbf7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39586/0 (socket says 172.21.15.7:39586) 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 -- 172.21.15.7:0/3953267201 learned_addr learned my addr 172.21.15.7:0/3953267201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbf6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0be200640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbea390 0x557edbc681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 -- 172.21.15.7:0/3953267201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbea390 msgr2=0x557edbc681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbea390 0x557edbc681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 -- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 msgr2=0x557edbbf6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbf6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bce00640 1 -- 172.21.15.7:0/3953267201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557edbc687b0 con 0x557edbbdfad0 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.806+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbf6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb0bce00640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 0x557edbbf7260 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb0a402a9a0 tx=0x7fb0a402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf0613bd5409d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb09f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb09f400640 1 -- 172.21.15.7:0/3953267201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4035040 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b001caf0 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb09f400640 1 -- 172.21.15.7:0/3953267201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7fb0a404f630 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb09f400640 1 -- 172.21.15.7:0/3953267201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb0a405e050 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.807+0000 7fb0c3058740 10 client.16791 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557edbc69b00 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb09f400640 1 -- 172.21.15.7:0/3953267201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0b001caf0 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb09f400640 1 -- 172.21.15.7:0/3953267201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb0a4004850 con 0x557edbbdfad0 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 10 client.16791 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 10 client.16791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 20 client.16791 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc69f50 0x557edbc6c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 4 client.16791 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:05:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.808+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557edbb4d190 con 0x557edbc69f50 2024-04-23T15:05:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.809+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc69f50 0x557edbc6c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.810+0000 7fb0bd800640 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc69f50 0x557edbc6c340 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3129f254ad21ffa7 server_cookie=7fccd45fc1e44f16 in_seq=0 out_seq=0 2024-04-23T15:05:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.810+0000 7fb09f400640 10 client.16791 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.846+0000 7fb09f400640 1 -- 172.21.15.7:0/3953267201 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557edbb4d190 con 0x557edbc69f50 2024-04-23T15:05:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.846+0000 7fb09f400640 10 client.16791 handle_command_reply: tid=0 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.846+0000 7fb0c3058740 1 client.16791 shutdown 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 msgr2=0x557edbbf7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 0x557edbbf7260 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb0a402a9a0 tx=0x7fb0a402a480 comp rx=0 tx=0).stop 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 shutdown_connections 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557edbc69f50 0x557edbc6c340 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557edbbea390 0x557edbc681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557edbbdfad0 0x557edbbf7260 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 --2- 172.21.15.7:0/3953267201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557edbbdf1b0 0x557edbbf6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb09f400640 0 client.16791 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 >> 172.21.15.7:0/3953267201 conn(0x557edbbdb6c0 msgr2=0x557edbbe5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 shutdown_connections 2024-04-23T15:05:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 1 -- 172.21.15.7:0/3953267201 wait complete. 2024-04-23T15:05:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.847+0000 7fb0c3058740 20 client.16791 trim_cache size 0 max 16384 2024-04-23T15:05:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:05:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:05:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:05:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:05:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0a00a3e70 msgr2=0x7fb0a00a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0a00a3e70 0x7fb0a00a6330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005fd0 tx=0x7fb0b0005c80 comp rx=0 tx=0).stop 2024-04-23T15:05:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 msgr2=0x7fb0b8100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 0x7fb0b8100f40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00d950 tx=0x7fb0ac00de10 comp rx=0 tx=0).stop 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 shutdown_connections 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0a00a3e70 0x7fb0a00a6330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0b8103a30 0x7fb0b8101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0b810c630 0x7fb0b81019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 --2- 172.21.15.7:0/3015457066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0b8103110 0x7fb0b8100f40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.848+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 >> 172.21.15.7:0/3015457066 conn(0x7fb0b8078080 msgr2=0x7fb0b80fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.849+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 shutdown_connections 2024-04-23T15:05:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:31.849+0000 7fb0c0200640 1 -- 172.21.15.7:0/3015457066 wait complete. 2024-04-23T15:05:32.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:31 smithi007 ceph-mon[27906]: pgmap v442: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:31 smithi186 ceph-mon[31814]: pgmap v442: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:31 smithi137 ceph-mon[31694]: pgmap v442: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:33.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:32 smithi007 ceph-mon[27906]: pgmap v443: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:32 smithi186 ceph-mon[31814]: pgmap v443: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:32 smithi137 ceph-mon[31694]: pgmap v443: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:36.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:35 smithi007 ceph-mon[27906]: pgmap v444: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:05:36.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:35 smithi186 ceph-mon[31814]: pgmap v444: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:05:36.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:35 smithi137 ceph-mon[31694]: pgmap v444: 129 pgs: 129 active+clean; 3.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:05:38.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:37 smithi007 ceph-mon[27906]: pgmap v445: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:37 smithi186 ceph-mon[31814]: pgmap v445: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:37 smithi137 ceph-mon[31694]: pgmap v445: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:40.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:39 smithi007 ceph-mon[27906]: pgmap v446: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:05:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:39 smithi186 ceph-mon[31814]: pgmap v446: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:05:40.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:39 smithi137 ceph-mon[31694]: pgmap v446: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:05:41.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:41 smithi007 ceph-mon[27906]: pgmap v447: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:05:41.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:41 smithi186 ceph-mon[31814]: pgmap v447: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:05:41.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:41 smithi137 ceph-mon[31694]: pgmap v447: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:05:44.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:43 smithi007 ceph-mon[27906]: pgmap v448: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:43 smithi186 ceph-mon[31814]: pgmap v448: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:44.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:43 smithi137 ceph-mon[31694]: pgmap v448: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 -- 172.21.15.7:0/2863314985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 msgr2=0x7f65541110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 --2- 172.21.15.7:0/2863314985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541110f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f654c009ca0 tx=0x7f654c02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 -- 172.21.15.7:0/2863314985 shutdown_connections 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 --2- 172.21.15.7:0/2863314985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104e00 0x7f6554108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 --2- 172.21.15.7:0/2863314985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541110f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 --2- 172.21.15.7:0/2863314985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6554104450 0x7f6554104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.003+0000 7f655ac00640 1 -- 172.21.15.7:0/2863314985 >> 172.21.15.7:0/2863314985 conn(0x7f65540ffcf0 msgr2=0x7f6554102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.004+0000 7f655ac00640 1 -- 172.21.15.7:0/2863314985 shutdown_connections 2024-04-23T15:05:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.004+0000 7f655ac00640 1 -- 172.21.15.7:0/2863314985 wait complete. 2024-04-23T15:05:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 Processor -- start 2024-04-23T15:05:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 -- start start 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104450 0x7f65541a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f655419a720 0x7f655419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65541144e0 con 0x7f6554109520 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6554114360 con 0x7f6554104450 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.005+0000 7f655ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6554114660 con 0x7f655419a720 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43136/0 (socket says 172.21.15.7:43136) 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 -- 172.21.15.7:0/1020340766 learned_addr learned my addr 172.21.15.7:0/1020340766 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553e00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104450 0x7f65541a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6558c00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f655419a720 0x7f655419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 -- 172.21.15.7:0/1020340766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f655419a720 msgr2=0x7f655419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f655419a720 0x7f655419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 -- 172.21.15.7:0/1020340766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104450 msgr2=0x7f65541a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104450 0x7f65541a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553400640 1 -- 172.21.15.7:0/1020340766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655419b320 con 0x7f6554109520 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6558c00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f655419a720 0x7f655419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.006+0000 7f6553e00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104450 0x7f65541a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.007+0000 7f6553400640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541a0ba0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f654000d740 tx=0x7f654000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.007+0000 7f6550c00640 1 -- 172.21.15.7:0/1020340766 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540017070 con 0x7f6554109520 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.007+0000 7f6550c00640 1 -- 172.21.15.7:0/1020340766 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f654000de50 con 0x7f6554109520 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.007+0000 7f6550c00640 1 -- 172.21.15.7:0/1020340766 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540004d60 con 0x7f6554109520 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.007+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65541a7400 con 0x7f6554109520 2024-04-23T15:05:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.007+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65541a77b0 con 0x7f6554109520 2024-04-23T15:05:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 Processor -- start 2024-04-23T15:05:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f6550c00640 1 -- 172.21.15.7:0/1020340766 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6540004f00 con 0x7f6554109520 2024-04-23T15:05:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 -- start start 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeea5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeafe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeb2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eebee0b900 con 0x55eebeea5ad0 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eebedb1f20 con 0x55eebeeb0390 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.011+0000 7f655db88740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55eebee078c0 con 0x55eebeea51b0 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.012+0000 7f6553e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeafe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.012+0000 7f6558c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeea5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.012+0000 7f6553e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeafe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43140/0 (socket says 172.21.15.7:43140) 2024-04-23T15:05:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.012+0000 7f6553e00640 1 -- 172.21.15.7:0/2046479407 learned_addr learned my addr 172.21.15.7:0/2046479407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.012+0000 7f6553400640 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeb2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6553e00640 1 -- 172.21.15.7:0/2046479407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 msgr2=0x55eebeea5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6553e00640 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeea5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6553e00640 1 -- 172.21.15.7:0/2046479407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 msgr2=0x55eebeeb2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6553e00640 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeb2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6553e00640 1 -- 172.21.15.7:0/2046479407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eebedd6e10 con 0x55eebeea5ad0 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6550c00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65380a3dc0 0x7f65380a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6550c00640 1 -- 172.21.15.7:0/1020340766 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f65400d0580 con 0x7f6554109520 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6558c00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65380a3dc0 0x7f65380a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6553e00640 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeafe50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f654400bd40 tx=0x7f654400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f453416c3a8f3b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.013+0000 7f6549200640 1 -- 172.21.15.7:0/2046479407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544015070 con 0x55eebeea5ad0 2024-04-23T15:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.014+0000 7f6549200640 1 -- 172.21.15.7:0/2046479407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f654400be30 con 0x55eebeea5ad0 2024-04-23T15:05:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.014+0000 7f6549200640 1 -- 172.21.15.7:0/2046479407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544011990 con 0x55eebeea5ad0 2024-04-23T15:05:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.014+0000 7f655db88740 1 -- 172.21.15.7:0/2046479407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 msgr2=0x55eebeeafe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.014+0000 7f6558c00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65380a3dc0 0x7f65380a6280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f654c004af0 tx=0x7f654c005d80 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.014+0000 7f655db88740 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeafe50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f654400bd40 tx=0x7f654400f730 comp rx=0 tx=0).stop 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 -- 172.21.15.7:0/2046479407 shutdown_connections 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeb2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeafe50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 --2- 172.21.15.7:0/2046479407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeea5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 -- 172.21.15.7:0/2046479407 >> 172.21.15.7:0/2046479407 conn(0x55eebeea16c0 msgr2=0x55eebeea1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 -- 172.21.15.7:0/2046479407 shutdown_connections 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 -- 172.21.15.7:0/2046479407 wait complete. 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.015+0000 7f655db88740 1 -- start start 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 Processor -- start 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 0x55eebeead300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea5ad0 0x55eebeead840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeadd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eebeeb2fc0 con 0x55eebeea51b0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eebedc52c0 con 0x55eebeeb0390 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55eebeeb3140 con 0x55eebeea5ad0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f655db88740 10 client.0 _ll_register_callbacks cb 0x55eebeb1da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f6553e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 0x55eebeead300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.016+0000 7f6553e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 0x55eebeead300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43148/0 (socket says 172.21.15.7:43148) 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 -- 172.21.15.7:0/2487008562 learned_addr learned my addr 172.21.15.7:0/2487008562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553400640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea5ad0 0x55eebeead840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6558c00640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeadd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 -- 172.21.15.7:0/2487008562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea5ad0 msgr2=0x55eebeead840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea5ad0 0x55eebeead840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 -- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 msgr2=0x55eebeeadd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeadd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 -- 172.21.15.7:0/2487008562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eebedd5fd0 con 0x55eebeea51b0 2024-04-23T15:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553400640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea5ad0 0x55eebeead840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:05:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f6553e00640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 0x55eebeead300 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6544000c00 tx=0x7f654401ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf180dc32c3ead5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.017+0000 7f653d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.018+0000 7f653d600640 1 -- 172.21.15.7:0/2487008562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544015070 con 0x55eebeea51b0 2024-04-23T15:05:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.018+0000 7f653d600640 1 -- 172.21.15.7:0/2487008562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f6544005310 con 0x55eebeea51b0 2024-04-23T15:05:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.018+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f654400be30 con 0x55eebeea51b0 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.018+0000 7f653d600640 1 -- 172.21.15.7:0/2487008562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f654402e050 con 0x55eebeea51b0 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.018+0000 7f655db88740 10 client.16803 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.018+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55eebeb1e210 con 0x55eebeea51b0 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f653d600640 1 -- 172.21.15.7:0/2487008562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f654400be30 con 0x55eebeea51b0 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f653d600640 1 -- 172.21.15.7:0/2487008562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6544011ab0 con 0x55eebeea51b0 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f655db88740 10 client.16803 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f655db88740 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f655db88740 20 client.16803 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f655db88740 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebeec03f0 0x55eebeec27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f655db88740 4 client.16803 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.019+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eebee19320 con 0x55eebeec03f0 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.020+0000 7f6553400640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebeec03f0 0x55eebeec27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.021+0000 7f6553400640 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebeec03f0 0x55eebeec27e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7f81bc7c4268a7 server_cookie=26c737faa73c08fc in_seq=0 out_seq=0 2024-04-23T15:05:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.021+0000 7f653d600640 10 client.16803 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.022+0000 7f653d600640 1 -- 172.21.15.7:0/2487008562 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eebee19320 con 0x55eebeec03f0 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.022+0000 7f653d600640 10 client.16803 handle_command_reply: tid=0 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 client.16803 shutdown 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 msgr2=0x55eebeead300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 0x55eebeead300 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6544000c00 tx=0x7f654401ae90 comp rx=0 tx=0).stop 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 shutdown_connections 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebeec03f0 0x55eebeec27e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeeadd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea5ad0 0x55eebeead840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 --2- 172.21.15.7:0/2487008562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea51b0 0x55eebeead300 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f653d600640 0 client.16803 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 >> 172.21.15.7:0/2487008562 conn(0x55eebeea16c0 msgr2=0x55eebeea0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 shutdown_connections 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 1 -- 172.21.15.7:0/2487008562 wait complete. 2024-04-23T15:05:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.023+0000 7f655db88740 20 client.16803 trim_cache size 0 max 16384 2024-04-23T15:05:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.043+0000 7f655db88740 1 Processor -- start 2024-04-23T15:05:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 -- start start 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeebbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeec7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeec8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65541b1560 con 0x55eebeea5ad0 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65541b30a0 con 0x55eebeeb0390 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f655db88740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f65541b1c30 con 0x55eebeea51b0 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f6553400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeec7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f6553400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeec7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43152/0 (socket says 172.21.15.7:43152) 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.044+0000 7f6553400640 1 -- 172.21.15.7:0/2441070354 learned_addr learned my addr 172.21.15.7:0/2441070354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6558c00640 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeec8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553e00640 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeebbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553400640 1 -- 172.21.15.7:0/2441070354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 msgr2=0x55eebeebbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553400640 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeebbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553400640 1 -- 172.21.15.7:0/2441070354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 msgr2=0x55eebeec8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553400640 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeec8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553400640 1 -- 172.21.15.7:0/2441070354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eebeea5900 con 0x55eebeea5ad0 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.045+0000 7f6553400640 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeec7e10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6540009610 tx=0x7f65400d5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cecd966cfb85529 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.046+0000 7f653fe00640 1 -- 172.21.15.7:0/2441070354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65400046c0 con 0x55eebeea5ad0 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.046+0000 7f653fe00640 1 -- 172.21.15.7:0/2441070354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6540009cc0 con 0x55eebeea5ad0 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.046+0000 7f653fe00640 1 -- 172.21.15.7:0/2441070354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654009a550 con 0x55eebeea5ad0 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.046+0000 7f655db88740 1 -- 172.21.15.7:0/2441070354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 msgr2=0x55eebeec7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.046+0000 7f655db88740 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeec7e10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6540009610 tx=0x7f65400d5040 comp rx=0 tx=0).stop 2024-04-23T15:05:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 -- 172.21.15.7:0/2441070354 shutdown_connections 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeeb0390 0x55eebeec8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeec7e10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 --2- 172.21.15.7:0/2441070354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeea51b0 0x55eebeebbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 -- 172.21.15.7:0/2441070354 >> 172.21.15.7:0/2441070354 conn(0x55eebeea16c0 msgr2=0x55eebeea85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 -- 172.21.15.7:0/2441070354 shutdown_connections 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 -- 172.21.15.7:0/2441070354 wait complete. 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 -- start start 2024-04-23T15:05:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.047+0000 7f655db88740 1 Processor -- start 2024-04-23T15:05:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeea51b0 0x55eebeeaa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeaa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeeb0390 0x55eebeeaac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65541b29d0 con 0x55eebeea5ad0 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65541b2300 con 0x55eebeea51b0 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f65541af560 con 0x55eebeeb0390 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f655db88740 10 client.0 _ll_register_callbacks cb 0x7f65400d6060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f6553400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeaa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f6553400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeaa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43162/0 (socket says 172.21.15.7:43162) 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.048+0000 7f6553400640 1 -- 172.21.15.7:0/1768889094 learned_addr learned my addr 172.21.15.7:0/1768889094 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6558c00640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeeb0390 0x55eebeeaac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553e00640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeea51b0 0x55eebeeaa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553400640 1 -- 172.21.15.7:0/1768889094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeeb0390 msgr2=0x55eebeeaac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553400640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeeb0390 0x55eebeeaac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553400640 1 -- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeea51b0 msgr2=0x55eebeeaa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553400640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeea51b0 0x55eebeeaa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553400640 1 -- 172.21.15.7:0/1768889094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eebebea620 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553e00640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeea51b0 0x55eebeeaa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f6553400640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeaa6e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f65400985d0 tx=0x7f6540004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880131976cbb3358 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f653d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.049+0000 7f653d600640 1 -- 172.21.15.7:0/1768889094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65400ba060 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f653d600640 1 -- 172.21.15.7:0/1768889094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f65400987e0 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eebee13190 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f653d600640 1 -- 172.21.15.7:0/1768889094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f65400a0520 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 10 client.16809 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55eebef269a0 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f653d600640 1 -- 172.21.15.7:0/1768889094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55eebee13190 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f653d600640 1 -- 172.21.15.7:0/1768889094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6540096ce0 con 0x55eebeea5ad0 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 10 client.16809 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 10 client.16809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 20 client.16809 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebef27070 0x55eebef29490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 4 client.16809 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:05:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.050+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eebed8f4b0 con 0x55eebef27070 2024-04-23T15:05:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.051+0000 7f6553e00640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebef27070 0x55eebef29490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.052+0000 7f6553e00640 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebef27070 0x55eebef29490 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bfc2f1202fd25be server_cookie=ea90fd547f8f3aab in_seq=0 out_seq=0 2024-04-23T15:05:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.052+0000 7f653d600640 10 client.16809 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.087+0000 7f653d600640 1 -- 172.21.15.7:0/1768889094 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eebed8f4b0 con 0x55eebef27070 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.087+0000 7f653d600640 10 client.16809 handle_command_reply: tid=0 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.087+0000 7f655db88740 1 client.16809 shutdown 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 msgr2=0x55eebeeaa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeaa6e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f65400985d0 tx=0x7f6540004800 comp rx=0 tx=0).stop 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 shutdown_connections 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebef27070 0x55eebef29490 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebeeb0390 0x55eebeeaac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebeea5ad0 0x55eebeeaa6e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 --2- 172.21.15.7:0/1768889094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebeea51b0 0x55eebeeaa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 >> 172.21.15.7:0/1768889094 conn(0x55eebeea16c0 msgr2=0x55eebee9ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f653d600640 0 client.16809 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 shutdown_connections 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 1 -- 172.21.15.7:0/1768889094 wait complete. 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.088+0000 7f655db88740 20 client.16809 trim_cache size 0 max 16384 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:05:45.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:05:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:05:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:05:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.089+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65380a3dc0 msgr2=0x7f65380a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.089+0000 7f655ac00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65380a3dc0 0x7f65380a6280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f654c004af0 tx=0x7f654c005d80 comp rx=0 tx=0).stop 2024-04-23T15:05:45.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.089+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 msgr2=0x7f65541a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.089+0000 7f655ac00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541a0ba0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f654000d740 tx=0x7f654000dc00 comp rx=0 tx=0).stop 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 shutdown_connections 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65380a3dc0 0x7f65380a6280 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f655419a720 0x7f655419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6554109520 0x7f65541a0ba0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 --2- 172.21.15.7:0/1020340766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6554104450 0x7f65541a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 >> 172.21.15.7:0/1020340766 conn(0x7f65540ffcf0 msgr2=0x7f6554100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 shutdown_connections 2024-04-23T15:05:45.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:45.091+0000 7f655ac00640 1 -- 172.21.15.7:0/1020340766 wait complete. 2024-04-23T15:05:46.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:45 smithi007 ceph-mon[27906]: pgmap v449: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:45 smithi186 ceph-mon[31814]: pgmap v449: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:45 smithi137 ceph-mon[31694]: pgmap v449: 129 pgs: 129 active+clean; 3.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:05:48.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:47 smithi007 ceph-mon[27906]: pgmap v450: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:05:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:47 smithi186 ceph-mon[31814]: pgmap v450: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:05:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:47 smithi137 ceph-mon[31694]: pgmap v450: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:05:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:49 smithi007 ceph-mon[27906]: pgmap v451: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:05:50.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:49 smithi186 ceph-mon[31814]: pgmap v451: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:05:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:49 smithi137 ceph-mon[31694]: pgmap v451: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:05:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:51 smithi007 ceph-mon[27906]: pgmap v452: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:05:52.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:51 smithi186 ceph-mon[31814]: pgmap v452: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:05:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:51 smithi137 ceph-mon[31694]: pgmap v452: 129 pgs: 129 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:05:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:53 smithi007 ceph-mon[27906]: pgmap v453: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:54.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:53 smithi186 ceph-mon[31814]: pgmap v453: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:53 smithi137 ceph-mon[31694]: pgmap v453: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:55 smithi007 ceph-mon[27906]: pgmap v454: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:56.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:55 smithi186 ceph-mon[31814]: pgmap v454: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:56.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:55 smithi137 ceph-mon[31694]: pgmap v454: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:05:58.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:57 smithi007 ceph-mon[27906]: pgmap v455: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:58.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:57 smithi186 ceph-mon[31814]: pgmap v455: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:57 smithi137 ceph-mon[31694]: pgmap v455: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 -- 172.21.15.7:0/3590116521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 msgr2=0x7f6fbc06ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 --2- 172.21.15.7:0/3590116521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc06ac90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009930 tx=0x7f6fa802a420 comp rx=0 tx=0).stop 2024-04-23T15:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 -- 172.21.15.7:0/3590116521 shutdown_connections 2024-04-23T15:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 --2- 172.21.15.7:0/3590116521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc06b1d0 0x7f6fbc10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 --2- 172.21.15.7:0/3590116521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc06ac90 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 --2- 172.21.15.7:0/3590116521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fbc108090 0x7f6fbc108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 -- 172.21.15.7:0/3590116521 >> 172.21.15.7:0/3590116521 conn(0x7f6fbc076d00 msgr2=0x7f6fbc077110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 -- 172.21.15.7:0/3590116521 shutdown_connections 2024-04-23T15:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.252+0000 7f6fc4200640 1 -- 172.21.15.7:0/3590116521 wait complete. 2024-04-23T15:05:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.253+0000 7f6fc4200640 1 Processor -- start 2024-04-23T15:05:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.253+0000 7f6fc4200640 1 -- start start 2024-04-23T15:05:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc4200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc4200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fbc06b1d0 0x7f6fbc1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc4200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc108090 0x7f6fbc19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc4200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc112290 con 0x7f6fbc06a830 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc4200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc112110 con 0x7f6fbc06b1d0 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc4200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc112410 con 0x7f6fbc108090 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc1a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58020/0 (socket says 172.21.15.7:58020) 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc1800640 1 -- 172.21.15.7:0/1026994586 learned_addr learned my addr 172.21.15.7:0/1026994586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc2200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc108090 0x7f6fbc19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.254+0000 7f6fc1800640 1 -- 172.21.15.7:0/1026994586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc108090 msgr2=0x7f6fbc19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fbc06b1d0 0x7f6fbc1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc108090 0x7f6fbc19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc1800640 1 -- 172.21.15.7:0/1026994586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fbc06b1d0 msgr2=0x7f6fbc1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fbc06b1d0 0x7f6fbc1a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc1800640 1 -- 172.21.15.7:0/1026994586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc19b020 con 0x7f6fbc06a830 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc2200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc108090 0x7f6fbc19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc1a0650 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000d950 tx=0x7f6fb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fba000640 1 -- 172.21.15.7:0/1026994586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0017070 con 0x7f6fbc06a830 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.256+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fbc19b310 con 0x7f6fbc06a830 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.255+0000 7f6fba000640 1 -- 172.21.15.7:0/1026994586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fb0009c30 con 0x7f6fbc06a830 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.256+0000 7f6fba000640 1 -- 172.21.15.7:0/1026994586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000f620 con 0x7f6fbc06a830 2024-04-23T15:05:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.256+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fbc1a75d0 con 0x7f6fbc06a830 2024-04-23T15:05:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.260+0000 7f6fba000640 1 -- 172.21.15.7:0/1026994586 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6fb00109a0 con 0x7f6fbc06a830 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.260+0000 7f6fc701f740 1 Processor -- start 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.260+0000 7f6fc701f740 1 -- start start 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.260+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc2fb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc305e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc308780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc701f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55decc261900 con 0x55decc2fb1b0 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc701f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55decc207f20 con 0x55decc2fbad0 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc701f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55decc25d8c0 con 0x55decc306390 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc2fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc2fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58028/0 (socket says 172.21.15.7:58028) 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc2200640 1 -- 172.21.15.7:0/3522748811 learned_addr learned my addr 172.21.15.7:0/3522748811 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc1800640 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc305e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc308780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.261+0000 7f6fba000640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6fa40a3e40 0x7f6fa40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 -- 172.21.15.7:0/3522748811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 msgr2=0x55decc308780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc308780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 -- 172.21.15.7:0/3522748811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 msgr2=0x55decc305e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc305e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 -- 172.21.15.7:0/3522748811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decc22ce10 con 0x55decc2fb1b0 2024-04-23T15:05:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fba000640 1 -- 172.21.15.7:0/1026994586 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f6fb00d0800 con 0x7f6fbc06a830 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6fa40a3e40 0x7f6fa40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.262+0000 7f6fc2200640 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc2fb590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009ea0 tx=0x7f6fb4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e434c3f2f789b976 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.263+0000 7f6faea00640 1 -- 172.21.15.7:0/3522748811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4021070 con 0x55decc2fb1b0 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.263+0000 7f6faea00640 1 -- 172.21.15.7:0/3522748811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fb401bdb0 con 0x55decc2fb1b0 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.263+0000 7f6faea00640 1 -- 172.21.15.7:0/3522748811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4010a90 con 0x55decc2fb1b0 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 -- 172.21.15.7:0/3522748811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 msgr2=0x55decc2fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc2200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6fa40a3e40 0x7f6fa40a6300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4010010 tx=0x7f6fb4021000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc2fb590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009ea0 tx=0x7f6fb4009f90 comp rx=0 tx=0).stop 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 -- 172.21.15.7:0/3522748811 shutdown_connections 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc305e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc308780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 --2- 172.21.15.7:0/3522748811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc2fb590 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 -- 172.21.15.7:0/3522748811 >> 172.21.15.7:0/3522748811 conn(0x55decc2f76c0 msgr2=0x55decc2f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 -- 172.21.15.7:0/3522748811 shutdown_connections 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.264+0000 7f6fc701f740 1 -- 172.21.15.7:0/3522748811 wait complete. 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 -- start start 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 Processor -- start 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc3032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc303800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 0x55decc303d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55decc308fc0 con 0x55decc306390 2024-04-23T15:05:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55decc21b2c0 con 0x55decc2fbad0 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.265+0000 7f6fc701f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55decc309140 con 0x55decc2fb1b0 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc701f740 10 client.0 _ll_register_callbacks cb 0x55decbf73a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 0x55decc303d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 0x55decc303d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58036/0 (socket says 172.21.15.7:58036) 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 -- 172.21.15.7:0/2225150980 learned_addr learned my addr 172.21.15.7:0/2225150980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc1800640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc3032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc303800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 -- 172.21.15.7:0/2225150980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 msgr2=0x55decc3032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc3032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 -- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 msgr2=0x55decc303800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc303800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.266+0000 7f6fc2200640 1 -- 172.21.15.7:0/2225150980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decc22bfd0 con 0x55decc306390 2024-04-23T15:05:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fc2200640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 0x55decc303d40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6fb401f040 tx=0x7f6fb4011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe57a86c60a3b0c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fa3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fa3400640 1 -- 172.21.15.7:0/2225150980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4010890 con 0x55decc306390 2024-04-23T15:05:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fa3400640 1 -- 172.21.15.7:0/2225150980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f6fb4010a30 con 0x55decc306390 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb401bdb0 con 0x55decc306390 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fa3400640 1 -- 172.21.15.7:0/2225150980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6fb403c050 con 0x55decc306390 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fc701f740 10 client.16821 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.267+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55decbf74210 con 0x55decc306390 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fa3400640 1 -- 172.21.15.7:0/2225150980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fb401bdb0 con 0x55decc306390 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fa3400640 1 -- 172.21.15.7:0/2225150980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6fb4026750 con 0x55decc306390 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fc701f740 10 client.16821 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fc701f740 10 client.16821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fc701f740 20 client.16821 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fc701f740 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc316360 0x55decc318750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fc701f740 4 client.16821 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.268+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55decc26f320 con 0x55decc316360 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.269+0000 7f6fc1800640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc316360 0x55decc318750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.270+0000 7f6fc1800640 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc316360 0x55decc318750 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2165f8f555dffb60 server_cookie=5a3ae4a1b8065ffb in_seq=0 out_seq=0 2024-04-23T15:05:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.270+0000 7f6fa3400640 10 client.16821 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fa3400640 1 -- 172.21.15.7:0/2225150980 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55decc26f320 con 0x55decc316360 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fa3400640 10 client.16821 handle_command_reply: tid=0 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 client.16821 shutdown 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 msgr2=0x55decc303d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 0x55decc303d40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6fb401f040 tx=0x7f6fb4011f50 comp rx=0 tx=0).stop 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 shutdown_connections 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc316360 0x55decc318750 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc303800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fa3400640 0 client.16821 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc306390 0x55decc303d40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 --2- 172.21.15.7:0/2225150980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc3032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.272+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 >> 172.21.15.7:0/2225150980 conn(0x55decc2f76c0 msgr2=0x55decc2fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.273+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 shutdown_connections 2024-04-23T15:05:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.273+0000 7f6fc701f740 1 -- 172.21.15.7:0/2225150980 wait complete. 2024-04-23T15:05:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.273+0000 7f6fc701f740 20 client.16821 trim_cache size 0 max 16384 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 Processor -- start 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 -- start start 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc311e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 0x55decc2fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc306390 0x55decc2f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc1b1660 con 0x55decc2fbad0 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc1b31a0 con 0x55decc306390 2024-04-23T15:05:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.291+0000 7f6fc701f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc1b1d30 con 0x55decc2fb1b0 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 0x55decc2fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 0x55decc2fdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58048/0 (socket says 172.21.15.7:58048) 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 -- 172.21.15.7:0/1903221732 learned_addr learned my addr 172.21.15.7:0/1903221732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc2200640 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc306390 0x55decc2f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc311e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 -- 172.21.15.7:0/1903221732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 msgr2=0x55decc311e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc311e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 -- 172.21.15.7:0/1903221732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc306390 msgr2=0x55decc2f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc306390 0x55decc2f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc0e00640 1 -- 172.21.15.7:0/1903221732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decc040620 con 0x55decc2fbad0 2024-04-23T15:05:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.292+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc311e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:05:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.293+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 0x55decc2fdb70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009230 tx=0x7f6fa80040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e56e471bc07d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.293+0000 7f6fae000640 1 -- 172.21.15.7:0/1903221732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8035030 con 0x55decc2fbad0 2024-04-23T15:05:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.293+0000 7f6fae000640 1 -- 172.21.15.7:0/1903221732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fa803f070 con 0x55decc2fbad0 2024-04-23T15:05:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.293+0000 7f6fae000640 1 -- 172.21.15.7:0/1903221732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8004ce0 con 0x55decc2fbad0 2024-04-23T15:05:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 -- 172.21.15.7:0/1903221732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 msgr2=0x55decc2fdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 0x55decc2fdb70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009230 tx=0x7f6fa80040f0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 -- 172.21.15.7:0/1903221732 shutdown_connections 2024-04-23T15:05:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc306390 0x55decc2f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fbad0 0x55decc2fdb70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1903221732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc2fb1b0 0x55decc311e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 -- 172.21.15.7:0/1903221732 >> 172.21.15.7:0/1903221732 conn(0x55decc2f76c0 msgr2=0x55decc2f5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 -- 172.21.15.7:0/1903221732 shutdown_connections 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.294+0000 7f6fc701f740 1 -- 172.21.15.7:0/1903221732 wait complete. 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 -- start start 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 Processor -- start 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc30e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc30e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc3097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc1b2ad0 con 0x55decc2fb1b0 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc1b2400 con 0x55decc2fbad0 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc1af660 con 0x55decc306390 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.295+0000 7f6fc701f740 10 client.0 _ll_register_callbacks cb 0x7f6fb401f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc30e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc30e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58062/0 (socket says 172.21.15.7:58062) 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 -- 172.21.15.7:0/1084991499 learned_addr learned my addr 172.21.15.7:0/1084991499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 -- 172.21.15.7:0/1084991499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 msgr2=0x55decc3097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc3097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 -- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 msgr2=0x55decc30e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc30e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 -- 172.21.15.7:0/1084991499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decc309ff0 con 0x55decc2fb1b0 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fc1800640 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc30e310 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00cdc00 tx=0x7f6fb000d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c0147bf6052afb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fa3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.296+0000 7f6fa3400640 1 -- 172.21.15.7:0/1084991499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0020040 con 0x55decc2fb1b0 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fa3400640 1 -- 172.21.15.7:0/1084991499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9467+0+0 (secure 0 0 0) 0x7f6fb0098a60 con 0x55decc2fb1b0 2024-04-23T15:05:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fa803f070 con 0x55decc2fb1b0 2024-04-23T15:05:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fa3400640 1 -- 172.21.15.7:0/1084991499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6fb00d3e60 con 0x55decc2fb1b0 2024-04-23T15:05:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 10 client.16827 fetch_fsmap learned FSMap version 32 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55decc37c380 con 0x55decc2fb1b0 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fa3400640 1 -- 172.21.15.7:0/1084991499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fa803f070 con 0x55decc2fb1b0 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fa3400640 1 -- 172.21.15.7:0/1084991499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6fb00cf040 con 0x55decc2fb1b0 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 10 client.16827 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 20 client.16827 populate_metadata read hostname 'smithi007' 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc37cad0 0x55decc37ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 4 client.16827 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.297+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55decc269190 con 0x55decc37cad0 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.298+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc37cad0 0x55decc37ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.299+0000 7f6fc0e00640 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc37cad0 0x55decc37ef90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf238d4491944843 server_cookie=2ecfaca54d614ba8 in_seq=0 out_seq=0 2024-04-23T15:05:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.299+0000 7f6fa3400640 10 client.16827 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.325+0000 7f6fa3400640 1 -- 172.21.15.7:0/1084991499 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55decc269190 con 0x55decc37cad0 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.325+0000 7f6fa3400640 10 client.16827 handle_command_reply: tid=0 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.325+0000 7f6fc701f740 1 client.16827 shutdown 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 msgr2=0x55decc30e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc30e310 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00cdc00 tx=0x7f6fb000d8d0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 shutdown_connections 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55decc37cad0 0x55decc37ef90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55decc2fbad0 0x55decc30e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55decc306390 0x55decc3097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 --2- 172.21.15.7:0/1084991499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55decc2fb1b0 0x55decc30e310 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fa3400640 0 client.16827 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:05:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 >> 172.21.15.7:0/1084991499 conn(0x55decc2f76c0 msgr2=0x55decc2f6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 shutdown_connections 2024-04-23T15:05:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.326+0000 7f6fc701f740 1 -- 172.21.15.7:0/1084991499 wait complete. 2024-04-23T15:05:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.327+0000 7f6fc701f740 20 client.16827 trim_cache size 0 max 16384 2024-04-23T15:05:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:05:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:05:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:05:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6fa40a3e40 msgr2=0x7f6fa40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6fa40a3e40 0x7f6fa40a6300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4010010 tx=0x7f6fb4021000 comp rx=0 tx=0).stop 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 msgr2=0x7f6fbc1a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc1a0650 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000d950 tx=0x7f6fb000de10 comp rx=0 tx=0).stop 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 shutdown_connections 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6fa40a3e40 0x7f6fa40a6300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fbc06b1d0 0x7f6fbc1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fbc108090 0x7f6fbc19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 --2- 172.21.15.7:0/1026994586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fbc06a830 0x7f6fbc1a0650 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 >> 172.21.15.7:0/1026994586 conn(0x7f6fbc076d00 msgr2=0x7f6fbc0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 shutdown_connections 2024-04-23T15:05:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:05:58.328+0000 7f6fc4200640 1 -- 172.21.15.7:0/1026994586 wait complete. 2024-04-23T15:06:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:59 smithi007 ceph-mon[27906]: pgmap v456: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:06:00.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:05:59 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:06:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:59 smithi186 ceph-mon[31814]: pgmap v456: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:06:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:05:59 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:06:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:59 smithi137 ceph-mon[31694]: pgmap v456: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:06:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:05:59 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:06:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:00 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:06:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:00 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:06:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:00 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:06:01.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:00 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:06:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:00 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:06:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:00 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:06:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:00 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:06:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:00 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:06:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:00 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:06:02.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:01 smithi007 ceph-mon[27906]: pgmap v457: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:06:02.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:01 smithi186 ceph-mon[31814]: pgmap v457: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:06:02.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:01 smithi137 ceph-mon[31694]: pgmap v457: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:06:03.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:02 smithi186 ceph-mon[31814]: pgmap v458: 129 pgs: 129 active+clean; 3.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 35 op/s 2024-04-23T15:06:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:02 smithi137 ceph-mon[31694]: pgmap v458: 129 pgs: 129 active+clean; 3.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 35 op/s 2024-04-23T15:06:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:02 smithi007 ceph-mon[27906]: pgmap v458: 129 pgs: 129 active+clean; 3.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.5 MiB/s wr, 35 op/s 2024-04-23T15:06:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:05 smithi007 ceph-mon[27906]: pgmap v459: 129 pgs: 129 active+clean; 3.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 30 op/s 2024-04-23T15:06:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:05 smithi186 ceph-mon[31814]: pgmap v459: 129 pgs: 129 active+clean; 3.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 30 op/s 2024-04-23T15:06:06.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:05 smithi137 ceph-mon[31694]: pgmap v459: 129 pgs: 129 active+clean; 3.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 30 op/s 2024-04-23T15:06:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:07 smithi007 ceph-mon[27906]: pgmap v460: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:06:08.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:07 smithi186 ceph-mon[31814]: pgmap v460: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:06:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:07 smithi137 ceph-mon[31694]: pgmap v460: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:06:09.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:08 smithi007 ceph-mon[27906]: osdmap e109: 12 total, 12 up, 12 in 2024-04-23T15:06:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:08 smithi186 ceph-mon[31814]: osdmap e109: 12 total, 12 up, 12 in 2024-04-23T15:06:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:08 smithi137 ceph-mon[31694]: osdmap e109: 12 total, 12 up, 12 in 2024-04-23T15:06:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:09 smithi007 ceph-mon[27906]: pgmap v462: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:06:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:09 smithi186 ceph-mon[31814]: pgmap v462: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:06:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:09 smithi137 ceph-mon[31694]: pgmap v462: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 -- 172.21.15.7:0/3826421317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c1042a0 msgr2=0x7f0c9c104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 --2- 172.21.15.7:0/3826421317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c104680 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009900 tx=0x7f0c8c02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 -- 172.21.15.7:0/3826421317 shutdown_connections 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 --2- 172.21.15.7:0/3826421317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c9c109370 0x7f0c9c110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 --2- 172.21.15.7:0/3826421317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c104c50 0x7f0c9c108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 --2- 172.21.15.7:0/3826421317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c104680 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 -- 172.21.15.7:0/3826421317 >> 172.21.15.7:0/3826421317 conn(0x7f0c9c0ffae0 msgr2=0x7f0c9c101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 -- 172.21.15.7:0/3826421317 shutdown_connections 2024-04-23T15:06:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.485+0000 7f0c9b200640 1 -- 172.21.15.7:0/3826421317 wait complete. 2024-04-23T15:06:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.486+0000 7f0c9b200640 1 Processor -- start 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.486+0000 7f0c9b200640 1 -- start start 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c9c109370 0x7f0c9c1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 0x7f0c9c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c114320 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1141a0 con 0x7f0c9c109370 2024-04-23T15:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1144a0 con 0x7f0c9c1042a0 2024-04-23T15:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 0x7f0c9c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 0x7f0c9c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35932/0 (socket says 172.21.15.7:35932) 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c9a800640 1 -- 172.21.15.7:0/135950927 learned_addr learned my addr 172.21.15.7:0/135950927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.487+0000 7f0c99e00640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c93e00640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c9c109370 0x7f0c9c1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c9a800640 1 -- 172.21.15.7:0/135950927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c1042a0 msgr2=0x7f0c9c1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c9a800640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c9a800640 1 -- 172.21.15.7:0/135950927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c9c109370 msgr2=0x7f0c9c1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c9a800640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c9c109370 0x7f0c9c1a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c9a800640 1 -- 172.21.15.7:0/135950927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c19b2e0 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c99e00640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c9a800640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 0x7f0c9c19ab60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400eb10 tx=0x7f0c9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.488+0000 7f0c92a00640 1 -- 172.21.15.7:0/135950927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94004b20 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.489+0000 7f0c92a00640 1 -- 172.21.15.7:0/135950927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c94004cc0 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.489+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c1a73c0 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.489+0000 7f0c92a00640 1 -- 172.21.15.7:0/135950927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94010690 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.489+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c1a77c0 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.492+0000 7f0ca3922740 1 Processor -- start 2024-04-23T15:06:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.493+0000 7f0c92a00640 1 -- 172.21.15.7:0/135950927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0c94005020 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.493+0000 7f0ca3922740 1 -- start start 2024-04-23T15:06:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa797a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa84060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa86990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0ca3922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bbfa9df900 con 0x55bbfaa79ce0 2024-04-23T15:06:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0ca3922740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbfa985f20 con 0x55bbfaa845a0 2024-04-23T15:06:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0ca3922740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55bbfa9db8c0 con 0x55bbfaa793c0 2024-04-23T15:06:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0c99e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa84060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0c99e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa84060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35944/0 (socket says 172.21.15.7:35944) 2024-04-23T15:06:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0c99e00640 1 -- 172.21.15.7:0/1757710089 learned_addr learned my addr 172.21.15.7:0/1757710089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0c93e00640 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa86990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.494+0000 7f0c93e00640 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa797a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c99e00640 1 -- 172.21.15.7:0/1757710089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 msgr2=0x55bbfaa797a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c99e00640 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa797a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c99e00640 1 -- 172.21.15.7:0/1757710089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 msgr2=0x55bbfaa86990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c99e00640 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa86990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c99e00640 1 -- 172.21.15.7:0/1757710089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbfa9aae10 con 0x55bbfaa79ce0 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c92a00640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c800a3d90 0x7f0c800a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c99e00640 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa84060 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c031440 tx=0x7f0c8c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ad4b848fc07304 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c92a00640 1 -- 172.21.15.7:0/135950927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9555+0+0 (secure 0 0 0) 0x7f0c940d1200 con 0x7f0c9c19a6e0 2024-04-23T15:06:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.495+0000 7f0c93e00640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c800a3d90 0x7f0c800a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.496+0000 7f0c8b400640 1 -- 172.21.15.7:0/1757710089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c035030 con 0x55bbfaa79ce0 2024-04-23T15:06:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.496+0000 7f0c8b400640 1 -- 172.21.15.7:0/1757710089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c8c0044d0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.496+0000 7f0c8b400640 1 -- 172.21.15.7:0/1757710089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0035f0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 -- 172.21.15.7:0/1757710089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 msgr2=0x55bbfaa84060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa84060 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c031440 tx=0x7f0c8c0042e0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0c93e00640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c800a3d90 0x7f0c800a6250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55bbfaa76cf0 tx=0x7f0c84012040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 -- 172.21.15.7:0/1757710089 shutdown_connections 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa86990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa84060 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 --2- 172.21.15.7:0/1757710089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa797a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 -- 172.21.15.7:0/1757710089 >> 172.21.15.7:0/1757710089 conn(0x55bbfaa758d0 msgr2=0x55bbfaa75cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 -- 172.21.15.7:0/1757710089 shutdown_connections 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.497+0000 7f0ca3922740 1 -- 172.21.15.7:0/1757710089 wait complete. 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.498+0000 7f0ca3922740 1 -- start start 2024-04-23T15:06:11.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.498+0000 7f0ca3922740 1 Processor -- start 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.498+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa81590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.498+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa82010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0ca3922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bbfaa87170 con 0x55bbfaa79ce0 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0ca3922740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbfa9992c0 con 0x55bbfaa845a0 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0ca3922740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55bbfaa872f0 con 0x55bbfaa793c0 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0ca3922740 10 client.0 _ll_register_callbacks cb 0x55bbfa6f1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35960/0 (socket says 172.21.15.7:35960) 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 -- 172.21.15.7:0/3928363432 learned_addr learned my addr 172.21.15.7:0/3928363432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c99e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa81590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c9a800640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa82010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 -- 172.21.15.7:0/3928363432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 msgr2=0x55bbfaa81590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa81590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 -- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 msgr2=0x55bbfaa82010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa82010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c93e00640 1 -- 172.21.15.7:0/3928363432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbfa9a9fd0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.499+0000 7f0c99e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa81590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.500+0000 7f0c93e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81ad0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400fb80 tx=0x7f0c840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f417e3f1489044d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.500+0000 7f0c7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.500+0000 7f0c7fe00640 1 -- 172.21.15.7:0/3928363432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84020b20 con 0x55bbfaa79ce0 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.500+0000 7f0c7fe00640 1 -- 172.21.15.7:0/3928363432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9555+0+0 (secure 0 0 0) 0x7f0c84020cc0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.500+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c8c0044d0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0c7fe00640 1 -- 172.21.15.7:0/3928363432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0c84035050 con 0x55bbfaa79ce0 2024-04-23T15:06:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 10 client.16839 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bbfa6f2210 con 0x55bbfaa79ce0 2024-04-23T15:06:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0c7fe00640 1 -- 172.21.15.7:0/3928363432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c8c0044d0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0c7fe00640 1 -- 172.21.15.7:0/3928363432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0c8401e390 con 0x55bbfaa79ce0 2024-04-23T15:06:11.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 10 client.16839 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 10 client.16839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 20 client.16839 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaa947e0 0x55bbfaa96c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.501+0000 7f0ca3922740 4 client.16839 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.502+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbfa9ed320 con 0x55bbfaa947e0 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.502+0000 7f0c99e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaa947e0 0x55bbfaa96c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.503+0000 7f0c99e00640 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaa947e0 0x55bbfaa96c80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35329031c067fe52 server_cookie=b46da4b942ff5063 in_seq=0 out_seq=0 2024-04-23T15:06:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.503+0000 7f0c7fe00640 10 client.16839 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0c7fe00640 1 -- 172.21.15.7:0/3928363432 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bbfa9ed320 con 0x55bbfaa947e0 2024-04-23T15:06:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0c7fe00640 10 client.16839 handle_command_reply: tid=0 2024-04-23T15:06:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0ca3922740 1 client.16839 shutdown 2024-04-23T15:06:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 msgr2=0x55bbfaa81ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81ad0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400fb80 tx=0x7f0c840046c0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 shutdown_connections 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaa947e0 0x55bbfaa96c80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0c7fe00640 0 client.16839 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.505+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa82010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.506+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81ad0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.506+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3928363432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa81590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.506+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 >> 172.21.15.7:0/3928363432 conn(0x55bbfaa758d0 msgr2=0x55bbfaa74a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.506+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 shutdown_connections 2024-04-23T15:06:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.506+0000 7f0ca3922740 1 -- 172.21.15.7:0/3928363432 wait complete. 2024-04-23T15:06:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.506+0000 7f0ca3922740 20 client.16839 trim_cache size 0 max 16384 2024-04-23T15:06:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.522+0000 7f0ca3922740 1 Processor -- start 2024-04-23T15:06:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.522+0000 7f0ca3922740 1 -- start start 2024-04-23T15:06:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa793c0 0x55bbfaa75210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa845a0 0x55bbfaa7b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0ca3922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1b15d0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0ca3922740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1b3110 con 0x55bbfaa793c0 2024-04-23T15:06:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0ca3922740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1b1ca0 con 0x55bbfaa845a0 2024-04-23T15:06:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35974/0 (socket says 172.21.15.7:35974) 2024-04-23T15:06:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0c93e00640 1 -- 172.21.15.7:0/3009626755 learned_addr learned my addr 172.21.15.7:0/3009626755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.523+0000 7f0c99e00640 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa793c0 0x55bbfaa75210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c93e00640 1 -- 172.21.15.7:0/3009626755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa845a0 msgr2=0x55bbfaa7b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c9a800640 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa845a0 0x55bbfaa7b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c93e00640 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa845a0 0x55bbfaa7b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c93e00640 1 -- 172.21.15.7:0/3009626755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa793c0 msgr2=0x55bbfaa75210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c93e00640 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa793c0 0x55bbfaa75210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c93e00640 1 -- 172.21.15.7:0/3009626755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbfa7be620 con 0x55bbfaa79ce0 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c93e00640 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81de0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0c84012010 tx=0x7f0c84009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c06bb2a8bb9382f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c8aa00640 1 -- 172.21.15.7:0/3009626755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400fe80 con 0x55bbfaa79ce0 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c8aa00640 1 -- 172.21.15.7:0/3009626755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c840044f0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.524+0000 7f0c8aa00640 1 -- 172.21.15.7:0/3009626755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84005280 con 0x55bbfaa79ce0 2024-04-23T15:06:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 -- 172.21.15.7:0/3009626755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 msgr2=0x55bbfaa81de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81de0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0c84012010 tx=0x7f0c84009a40 comp rx=0 tx=0).stop 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 -- 172.21.15.7:0/3009626755 shutdown_connections 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa845a0 0x55bbfaa7b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa81de0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 --2- 172.21.15.7:0/3009626755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa793c0 0x55bbfaa75210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 -- 172.21.15.7:0/3009626755 >> 172.21.15.7:0/3009626755 conn(0x55bbfaa758d0 msgr2=0x55bbfaa7ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.525+0000 7f0ca3922740 1 -- 172.21.15.7:0/3009626755 shutdown_connections 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.526+0000 7f0ca3922740 1 -- 172.21.15.7:0/3009626755 wait complete. 2024-04-23T15:06:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.526+0000 7f0ca3922740 1 -- start start 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.526+0000 7f0ca3922740 1 Processor -- start 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa8c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa8ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa89510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1b2a40 con 0x55bbfaa79ce0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1b2370 con 0x55bbfaa845a0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c1af5d0 con 0x55bbfaa793c0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0ca3922740 10 client.0 _ll_register_callbacks cb 0x7f0c84010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa8ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa8ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35980/0 (socket says 172.21.15.7:35980) 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0c93e00640 1 -- 172.21.15.7:0/2979325802 learned_addr learned my addr 172.21.15.7:0/2979325802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0c9a800640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa89510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.527+0000 7f0c99e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa8c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c93e00640 1 -- 172.21.15.7:0/2979325802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 msgr2=0x55bbfaa8c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c93e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa8c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c93e00640 1 -- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 msgr2=0x55bbfaa89510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c93e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa89510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c93e00640 1 -- 172.21.15.7:0/2979325802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbfaa89b50 con 0x55bbfaa79ce0 2024-04-23T15:06:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c99e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa8c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:06:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c93e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa8ca80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0c8403d040 tx=0x7f0c8401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc9d0bda2295a32 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c7fe00640 1 -- 172.21.15.7:0/2979325802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84005230 con 0x55bbfaa79ce0 2024-04-23T15:06:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0c7fe00640 1 -- 172.21.15.7:0/2979325802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9555+0+0 (secure 0 0 0) 0x7f0c840053d0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.528+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c840044f0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0c7fe00640 1 -- 172.21.15.7:0/2979325802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0c84050050 con 0x55bbfaa79ce0 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 10 client.16845 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bbfaafb720 con 0x55bbfaa79ce0 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0c7fe00640 1 -- 172.21.15.7:0/2979325802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c840044f0 con 0x55bbfaa79ce0 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0c7fe00640 1 -- 172.21.15.7:0/2979325802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0c84038030 con 0x55bbfaa79ce0 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 10 client.16845 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 10 client.16845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 20 client.16845 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaafbd90 0x55bbfaafe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 4 client.16845 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:06:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.529+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bbfa9e7190 con 0x55bbfaafbd90 2024-04-23T15:06:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.530+0000 7f0c99e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaafbd90 0x55bbfaafe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.531+0000 7f0c99e00640 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaafbd90 0x55bbfaafe1b0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d65c180b16f6282 server_cookie=776b9a9415362d85 in_seq=0 out_seq=0 2024-04-23T15:06:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.531+0000 7f0c7fe00640 10 client.16845 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.560+0000 7f0c7fe00640 1 -- 172.21.15.7:0/2979325802 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bbfa9e7190 con 0x55bbfaafbd90 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0c7fe00640 10 client.16845 handle_command_reply: tid=0 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 client.16845 shutdown 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 msgr2=0x55bbfaa8ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa8ca80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0c8403d040 tx=0x7f0c8401eb80 comp rx=0 tx=0).stop 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 shutdown_connections 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbfaafbd90 0x55bbfaafe1b0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbfaa845a0 0x55bbfaa89510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0c7fe00640 0 client.16845 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbfaa79ce0 0x55bbfaa8ca80 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 --2- 172.21.15.7:0/2979325802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbfaa793c0 0x55bbfaa8c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 >> 172.21.15.7:0/2979325802 conn(0x55bbfaa758d0 msgr2=0x55bbfaa7b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.561+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 shutdown_connections 2024-04-23T15:06:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.562+0000 7f0ca3922740 1 -- 172.21.15.7:0/2979325802 wait complete. 2024-04-23T15:06:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.562+0000 7f0ca3922740 20 client.16845 trim_cache size 0 max 16384 2024-04-23T15:06:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:06:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:06:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:06:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c800a3d90 msgr2=0x7f0c800a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c800a3d90 0x7f0c800a6250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55bbfaa76cf0 tx=0x7f0c84012040 comp rx=0 tx=0).stop 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 msgr2=0x7f0c9c19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 0x7f0c9c19ab60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400eb10 tx=0x7f0c9400c2d0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 shutdown_connections 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c800a3d90 0x7f0c800a6250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c9c109370 0x7f0c9c1a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c9c19a6e0 0x7f0c9c19ab60 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 --2- 172.21.15.7:0/135950927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c9c1042a0 0x7f0c9c1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 >> 172.21.15.7:0/135950927 conn(0x7f0c9c0ffae0 msgr2=0x7f0c9c100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 shutdown_connections 2024-04-23T15:06:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:11.563+0000 7f0c9b200640 1 -- 172.21.15.7:0/135950927 wait complete. 2024-04-23T15:06:12.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:11 smithi007 ceph-mon[27906]: pgmap v463: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:06:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:11 smithi186 ceph-mon[31814]: pgmap v463: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:06:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:11 smithi137 ceph-mon[31694]: pgmap v463: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:06:14.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:13 smithi007 ceph-mon[27906]: pgmap v464: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:06:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:13 smithi186 ceph-mon[31814]: pgmap v464: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:06:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:13 smithi137 ceph-mon[31694]: pgmap v464: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:06:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:14 smithi186 ceph-mon[31814]: pgmap v465: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:06:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:14 smithi137 ceph-mon[31694]: pgmap v465: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:06:15.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:14 smithi007 ceph-mon[27906]: pgmap v465: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:06:16.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:16 smithi007 ceph-mon[27906]: osdmap e110: 12 total, 12 up, 12 in 2024-04-23T15:06:16.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:16 smithi186 ceph-mon[31814]: osdmap e110: 12 total, 12 up, 12 in 2024-04-23T15:06:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:16 smithi137 ceph-mon[31694]: osdmap e110: 12 total, 12 up, 12 in 2024-04-23T15:06:17.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:17 smithi007 ceph-mon[27906]: pgmap v467: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:06:17.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:17 smithi186 ceph-mon[31814]: pgmap v467: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:06:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:17 smithi137 ceph-mon[31694]: pgmap v467: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:06:20.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:19 smithi007 ceph-mon[27906]: pgmap v468: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:20.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:19 smithi186 ceph-mon[31814]: pgmap v468: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:19 smithi137 ceph-mon[31694]: pgmap v468: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:21 smithi007 ceph-mon[27906]: pgmap v469: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:21 smithi186 ceph-mon[31814]: pgmap v469: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:21 smithi137 ceph-mon[31694]: pgmap v469: 129 pgs: 129 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:24.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:23 smithi007 ceph-mon[27906]: pgmap v470: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:23 smithi186 ceph-mon[31814]: pgmap v470: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:24.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:23 smithi137 ceph-mon[31694]: pgmap v470: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 -- 172.21.15.7:0/2616276833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 msgr2=0x7faee8074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 --2- 172.21.15.7:0/2616276833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee8074790 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7faedc009900 tx=0x7faedc02a480 comp rx=0 tx=0).stop 2024-04-23T15:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 -- 172.21.15.7:0/2616276833 shutdown_connections 2024-04-23T15:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 --2- 172.21.15.7:0/2616276833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee810e6e0 0x7faee8110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 --2- 172.21.15.7:0/2616276833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee8074cd0 0x7faee810e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 --2- 172.21.15.7:0/2616276833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee8074790 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 -- 172.21.15.7:0/2616276833 >> 172.21.15.7:0/2616276833 conn(0x7faee80fd970 msgr2=0x7faee80ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 -- 172.21.15.7:0/2616276833 shutdown_connections 2024-04-23T15:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.724+0000 7faeee600640 1 -- 172.21.15.7:0/2616276833 wait complete. 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.725+0000 7faeee600640 1 Processor -- start 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.725+0000 7faeee600640 1 -- start start 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeee600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeee600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8074cd0 0x7faee81a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeee600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee810e6e0 0x7faee819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeee600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee8114290 con 0x7faee80743b0 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeee600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faee8114110 con 0x7faee8074cd0 2024-04-23T15:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeee600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faee8114410 con 0x7faee810e6e0 2024-04-23T15:06:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeed200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeed200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee81a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60630/0 (socket says 172.21.15.7:60630) 2024-04-23T15:06:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faeed200640 1 -- 172.21.15.7:0/352461945 learned_addr learned my addr 172.21.15.7:0/352461945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.726+0000 7faee7e00640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8074cd0 0x7faee81a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeedc00640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee810e6e0 0x7faee819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeed200640 1 -- 172.21.15.7:0/352461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee810e6e0 msgr2=0x7faee819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeed200640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee810e6e0 0x7faee819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeed200640 1 -- 172.21.15.7:0/352461945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8074cd0 msgr2=0x7faee81a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeed200640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8074cd0 0x7faee81a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeed200640 1 -- 172.21.15.7:0/352461945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee819aff0 con 0x7faee80743b0 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeedc00640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee810e6e0 0x7faee819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.727+0000 7faeed200640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee81a0620 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7faedc005940 tx=0x7faedc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.728+0000 7faee5600640 1 -- 172.21.15.7:0/352461945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc03f030 con 0x7faee80743b0 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.728+0000 7faee5600640 1 -- 172.21.15.7:0/352461945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faedc003aa0 con 0x7faee80743b0 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.728+0000 7faee5600640 1 -- 172.21.15.7:0/352461945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc035070 con 0x7faee80743b0 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.728+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee819b280 con 0x7faee80743b0 2024-04-23T15:06:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.728+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee81a73c0 con 0x7faee80743b0 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 Processor -- start 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 -- start start 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faee5600640 1 -- 172.21.15.7:0/352461945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7faedc042030 con 0x7faee80743b0 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58e27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58ed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58ef990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5e5848900 con 0x55b5e58ed5a0 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b5e57eef20 con 0x55b5e58e2ce0 2024-04-23T15:06:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faef29cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b5e58448c0 con 0x55b5e58e23c0 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.732+0000 7faee7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58ef990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60642/0 (socket says 172.21.15.7:60642) 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 -- 172.21.15.7:0/4137584498 learned_addr learned my addr 172.21.15.7:0/4137584498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faeedc00640 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58e27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faeed200640 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 -- 172.21.15.7:0/4137584498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 msgr2=0x55b5e58e27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58e27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 -- 172.21.15.7:0/4137584498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 msgr2=0x55b5e58ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.733+0000 7faee7e00640 1 -- 172.21.15.7:0/4137584498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5e5813e10 con 0x55b5e58ed5a0 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faee7e00640 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58ef990 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7faed400bc80 tx=0x7faed400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d07c8e0a015315 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faee5600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faed00a3d90 0x7faed00a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faeda000640 1 -- 172.21.15.7:0/4137584498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4015070 con 0x55b5e58ed5a0 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faeda000640 1 -- 172.21.15.7:0/4137584498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faed401a910 con 0x55b5e58ed5a0 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faeda000640 1 -- 172.21.15.7:0/4137584498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4011860 con 0x55b5e58ed5a0 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faee5600640 1 -- 172.21.15.7:0/352461945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7faedc0f0e10 con 0x7faee80743b0 2024-04-23T15:06:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.734+0000 7faeedc00640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faed00a3d90 0x7faed00a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 -- 172.21.15.7:0/4137584498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 msgr2=0x55b5e58ef990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58ef990 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7faed400bc80 tx=0x7faed400f730 comp rx=0 tx=0).stop 2024-04-23T15:06:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faeedc00640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faed00a3d90 0x7faed00a6250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faee0005fd0 tx=0x7faee0009530 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 -- 172.21.15.7:0/4137584498 shutdown_connections 2024-04-23T15:06:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58ef990 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 --2- 172.21.15.7:0/4137584498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58e27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 -- 172.21.15.7:0/4137584498 >> 172.21.15.7:0/4137584498 conn(0x55b5e58de8d0 msgr2=0x55b5e58decb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 -- 172.21.15.7:0/4137584498 shutdown_connections 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.735+0000 7faef29cb740 1 -- 172.21.15.7:0/4137584498 wait complete. 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.736+0000 7faef29cb740 1 -- start start 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.736+0000 7faef29cb740 1 Processor -- start 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58eb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b5e58f00e0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b5e58022c0 con 0x55b5e58e23c0 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b5e58f0260 con 0x55b5e58e2ce0 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faef29cb740 10 client.0 _ll_register_callbacks cb 0x55b5e555aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faeedc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faeedc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58eb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60654/0 (socket says 172.21.15.7:60654) 2024-04-23T15:06:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faeedc00640 1 -- 172.21.15.7:0/3073537779 learned_addr learned my addr 172.21.15.7:0/3073537779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faeed200640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.737+0000 7faee7e00640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeedc00640 1 -- 172.21.15.7:0/3073537779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 msgr2=0x55b5e58eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeedc00640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeedc00640 1 -- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 msgr2=0x55b5e58ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeedc00640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeedc00640 1 -- 172.21.15.7:0/3073537779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5e5812fd0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeed200640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faeedc00640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58eb000 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faee0012930 tx=0x7faee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35da55984aea821f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.738+0000 7faecea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faecea00640 1 -- 172.21.15.7:0/3073537779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0022070 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed401a910 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faecea00640 1 -- 172.21.15.7:0/3073537779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7faee000fd60 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faecea00640 1 -- 172.21.15.7:0/3073537779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faee0027460 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faef29cb740 10 client.16857 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b5e555b210 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.739+0000 7faecea00640 1 -- 172.21.15.7:0/3073537779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faed401a910 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faecea00640 1 -- 172.21.15.7:0/3073537779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7faee001e5a0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faef29cb740 10 client.16857 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faef29cb740 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faef29cb740 20 client.16857 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faef29cb740 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e58fd800 0x55b5e58ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faef29cb740 4 client.16857 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:06:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.740+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5e5856320 con 0x55b5e58fd800 2024-04-23T15:06:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.741+0000 7faeed200640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e58fd800 0x55b5e58ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.742+0000 7faeed200640 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e58fd800 0x55b5e58ffc50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45065cfa3595237 server_cookie=8418a4afcb67bc45 in_seq=0 out_seq=0 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.742+0000 7faecea00640 10 client.16857 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faecea00640 1 -- 172.21.15.7:0/3073537779 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b5e5856320 con 0x55b5e58fd800 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faecea00640 10 client.16857 handle_command_reply: tid=0 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 client.16857 shutdown 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 msgr2=0x55b5e58eb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58eb000 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faee0012930 tx=0x7faee0004a40 comp rx=0 tx=0).stop 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 shutdown_connections 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e58fd800 0x55b5e58ffc50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e58eb000 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 --2- 172.21.15.7:0/3073537779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 >> 172.21.15.7:0/3073537779 conn(0x55b5e58de8d0 msgr2=0x55b5e58dda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.744+0000 7faecea00640 0 client.16857 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.745+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 shutdown_connections 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.745+0000 7faef29cb740 1 -- 172.21.15.7:0/3073537779 wait complete. 2024-04-23T15:06:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.745+0000 7faef29cb740 20 client.16857 trim_cache size 0 max 16384 2024-04-23T15:06:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 Processor -- start 2024-04-23T15:06:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 -- start start 2024-04-23T15:06:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5905520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee81b14c0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faee81b3000 con 0x55b5e58e2ce0 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.767+0000 7faef29cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faee81b1b90 con 0x55b5e58e23c0 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5905520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeed200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5905520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60658/0 (socket says 172.21.15.7:60658) 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 -- 172.21.15.7:0/1101843515 learned_addr learned my addr 172.21.15.7:0/1101843515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faee7e00640 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 -- 172.21.15.7:0/1101843515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 msgr2=0x55b5e58f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 -- 172.21.15.7:0/1101843515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 msgr2=0x55b5e58dd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58dd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faeedc00640 1 -- 172.21.15.7:0/1101843515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5e5627620 con 0x55b5e58ed5a0 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.768+0000 7faee7e00640 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58dd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.769+0000 7faeedc00640 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5905520 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faee001e990 tx=0x7faee0011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6db3be6cb09f2a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.769+0000 7faed9600640 1 -- 172.21.15.7:0/1101843515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0038070 con 0x55b5e58ed5a0 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.769+0000 7faed9600640 1 -- 172.21.15.7:0/1101843515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faee000f7a0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.769+0000 7faed9600640 1 -- 172.21.15.7:0/1101843515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0022040 con 0x55b5e58ed5a0 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 -- 172.21.15.7:0/1101843515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 msgr2=0x55b5e5905520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5905520 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faee001e990 tx=0x7faee0011d20 comp rx=0 tx=0).stop 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 -- 172.21.15.7:0/1101843515 shutdown_connections 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e2ce0 0x55b5e58dd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5905520 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 --2- 172.21.15.7:0/1101843515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e23c0 0x55b5e58f90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 -- 172.21.15.7:0/1101843515 >> 172.21.15.7:0/1101843515 conn(0x55b5e58de8d0 msgr2=0x55b5e58dd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 -- 172.21.15.7:0/1101843515 shutdown_connections 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.770+0000 7faef29cb740 1 -- 172.21.15.7:0/1101843515 wait complete. 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.771+0000 7faef29cb740 1 -- start start 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.771+0000 7faef29cb740 1 Processor -- start 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.771+0000 7faef29cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58e7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.771+0000 7faef29cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faef29cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5962d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faef29cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee81b2930 con 0x55b5e58ed5a0 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faef29cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faee81b2260 con 0x55b5e58e23c0 2024-04-23T15:06:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faef29cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faee81af4c0 con 0x55b5e58e2ce0 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faef29cb740 10 client.0 _ll_register_callbacks cb 0x7faee0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5962d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5962d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60660/0 (socket says 172.21.15.7:60660) 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 -- 172.21.15.7:0/2337155241 learned_addr learned my addr 172.21.15.7:0/2337155241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faee7e00640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeed200640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 -- 172.21.15.7:0/2337155241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 msgr2=0x55b5e58e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58e7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 -- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 msgr2=0x55b5e58e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeedc00640 1 -- 172.21.15.7:0/2337155241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5e58e8320 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.772+0000 7faeed200640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.773+0000 7faeedc00640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5962d90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7faee00092d0 tx=0x7faee0004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e13ef87859289a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.773+0000 7faecea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.773+0000 7faecea00640 1 -- 172.21.15.7:0/2337155241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0038070 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.773+0000 7faecea00640 1 -- 172.21.15.7:0/2337155241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7faee0027800 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.773+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faee000f7a0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faecea00640 1 -- 172.21.15.7:0/2337155241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faee0022040 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 10 client.16863 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b5e59643b0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faecea00640 1 -- 172.21.15.7:0/2337155241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faee000f7a0 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faecea00640 1 -- 172.21.15.7:0/2337155241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7faee0044070 con 0x55b5e58ed5a0 2024-04-23T15:06:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 10 client.16863 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 20 client.16863 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e59649c0 0x55b5e5966de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 4 client.16863 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.774+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5e5850190 con 0x55b5e59649c0 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.775+0000 7faeed200640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e59649c0 0x55b5e5966de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.776+0000 7faeed200640 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e59649c0 0x55b5e5966de0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe750b1972871904 server_cookie=8750e8da048d335c in_seq=0 out_seq=0 2024-04-23T15:06:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.776+0000 7faecea00640 10 client.16863 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faecea00640 1 -- 172.21.15.7:0/2337155241 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5e5850190 con 0x55b5e59649c0 2024-04-23T15:06:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faecea00640 10 client.16863 handle_command_reply: tid=0 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 client.16863 shutdown 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 msgr2=0x55b5e5962d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5962d90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7faee00092d0 tx=0x7faee0004bc0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 shutdown_connections 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b5e59649c0 0x55b5e5966de0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b5e58ed5a0 0x55b5e5962d90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b5e58e2ce0 0x55b5e58e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 --2- 172.21.15.7:0/2337155241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b5e58e23c0 0x55b5e58e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faecea00640 0 client.16863 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.806+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 >> 172.21.15.7:0/2337155241 conn(0x55b5e58de8d0 msgr2=0x55b5e58dda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.807+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 shutdown_connections 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.807+0000 7faef29cb740 1 -- 172.21.15.7:0/2337155241 wait complete. 2024-04-23T15:06:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.807+0000 7faef29cb740 20 client.16863 trim_cache size 0 max 16384 2024-04-23T15:06:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:06:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:06:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:06:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faed00a3d90 msgr2=0x7faed00a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faed00a3d90 0x7faed00a6250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faee0005fd0 tx=0x7faee0009530 comp rx=0 tx=0).stop 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 msgr2=0x7faee81a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee81a0620 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7faedc005940 tx=0x7faedc004270 comp rx=0 tx=0).stop 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 shutdown_connections 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faed00a3d90 0x7faed00a6250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8074cd0 0x7faee81a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee810e6e0 0x7faee819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 --2- 172.21.15.7:0/352461945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee80743b0 0x7faee81a0620 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 >> 172.21.15.7:0/352461945 conn(0x7faee80fd970 msgr2=0x7faee80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 shutdown_connections 2024-04-23T15:06:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:24.808+0000 7faeee600640 1 -- 172.21.15.7:0/352461945 wait complete. 2024-04-23T15:06:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:25 smithi007 ceph-mon[27906]: pgmap v471: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:26.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:25 smithi186 ceph-mon[31814]: pgmap v471: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:25 smithi137 ceph-mon[31694]: pgmap v471: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:06:28.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:27 smithi007 ceph-mon[27906]: pgmap v472: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 23 op/s 2024-04-23T15:06:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:27 smithi186 ceph-mon[31814]: pgmap v472: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 23 op/s 2024-04-23T15:06:28.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:27 smithi137 ceph-mon[31694]: pgmap v472: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 23 op/s 2024-04-23T15:06:30.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:29 smithi007 ceph-mon[27906]: pgmap v473: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:30.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:29 smithi186 ceph-mon[31814]: pgmap v473: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:30.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:29 smithi137 ceph-mon[31694]: pgmap v473: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:32.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:31 smithi007 ceph-mon[27906]: pgmap v474: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:31 smithi186 ceph-mon[31814]: pgmap v474: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:31 smithi137 ceph-mon[31694]: pgmap v474: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:34.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:33 smithi007 ceph-mon[27906]: pgmap v475: 129 pgs: 129 active+clean; 3.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:06:34.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:33 smithi186 ceph-mon[31814]: pgmap v475: 129 pgs: 129 active+clean; 3.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:06:34.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:33 smithi137 ceph-mon[31694]: pgmap v475: 129 pgs: 129 active+clean; 3.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:06:35.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:34 smithi186 ceph-mon[31814]: pgmap v476: 129 pgs: 129 active+clean; 3.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:06:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:34 smithi137 ceph-mon[31694]: pgmap v476: 129 pgs: 129 active+clean; 3.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:06:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:34 smithi007 ceph-mon[27906]: pgmap v476: 129 pgs: 129 active+clean; 3.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 -- 172.21.15.7:0/2705350741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19541038e0 msgr2=0x7f195410bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 --2- 172.21.15.7:0/2705350741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19541038e0 0x7f195410bdc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1940009900 tx=0x7f194002a480 comp rx=0 tx=0).stop 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 -- 172.21.15.7:0/2705350741 shutdown_connections 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 --2- 172.21.15.7:0/2705350741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f195410c3e0 0x7f195410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 --2- 172.21.15.7:0/2705350741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19541038e0 0x7f195410bdc0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 --2- 172.21.15.7:0/2705350741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1954102fc0 0x7f19541033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.966+0000 7f1959e00640 1 -- 172.21.15.7:0/2705350741 >> 172.21.15.7:0/2705350741 conn(0x7f19540fc820 msgr2=0x7f19540fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.967+0000 7f1959e00640 1 -- 172.21.15.7:0/2705350741 shutdown_connections 2024-04-23T15:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.967+0000 7f1959e00640 1 -- 172.21.15.7:0/2705350741 wait complete. 2024-04-23T15:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 Processor -- start 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 -- start start 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 0x7f19541985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19541038e0 0x7f1954198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f195410c3e0 0x7f195419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1954112070 con 0x7f1954102fc0 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1954111ef0 con 0x7f19541038e0 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.968+0000 7f1959e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f19541121f0 con 0x7f195410c3e0 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 0x7f19541985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 0x7f19541985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43032/0 (socket says 172.21.15.7:43032) 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 -- 172.21.15.7:0/2130772674 learned_addr learned my addr 172.21.15.7:0/2130772674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f194be00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19541038e0 0x7f1954198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1959400640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f195410c3e0 0x7f195419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 -- 172.21.15.7:0/2130772674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f195410c3e0 msgr2=0x7f195419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f195410c3e0 0x7f195419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 -- 172.21.15.7:0/2130772674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19541038e0 msgr2=0x7f1954198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19541038e0 0x7f1954198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.969+0000 7f1958a00640 1 -- 172.21.15.7:0/2130772674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195419d5c0 con 0x7f1954102fc0 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.970+0000 7f1958a00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 0x7f19541985d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f193800d770 tx=0x7f193800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.970+0000 7f1952000640 1 -- 172.21.15.7:0/2130772674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938017070 con 0x7f1954102fc0 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.970+0000 7f1952000640 1 -- 172.21.15.7:0/2130772674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19380054d0 con 0x7f1954102fc0 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.970+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195419d8b0 con 0x7f1954102fc0 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.970+0000 7f1952000640 1 -- 172.21.15.7:0/2130772674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938004cf0 con 0x7f1954102fc0 2024-04-23T15:06:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.970+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19541a5140 con 0x7f1954102fc0 2024-04-23T15:06:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 Processor -- start 2024-04-23T15:06:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 -- start start 2024-04-23T15:06:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 0x563f435497a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f43549ce0 0x563f43554060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435545a0 0x563f43556990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f434af900 con 0x563f435493c0 2024-04-23T15:06:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f43455f20 con 0x563f43549ce0 2024-04-23T15:06:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.974+0000 7f195e387740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563f434ab8c0 con 0x563f435545a0 2024-04-23T15:06:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 0x563f435497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 0x563f435497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43046/0 (socket says 172.21.15.7:43046) 2024-04-23T15:06:37.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 -- 172.21.15.7:0/2949466388 learned_addr learned my addr 172.21.15.7:0/2949466388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f194be00640 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435545a0 0x563f43556990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1952000640 1 -- 172.21.15.7:0/2130772674 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1938004e90 con 0x7f1954102fc0 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 -- 172.21.15.7:0/2949466388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435545a0 msgr2=0x563f43556990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435545a0 0x563f43556990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 -- 172.21.15.7:0/2949466388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f43549ce0 msgr2=0x563f43554060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f43549ce0 0x563f43554060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.975+0000 7f1959400640 1 -- 172.21.15.7:0/2949466388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f4347ae10 con 0x563f435493c0 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.976+0000 7f1959400640 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 0x563f435497a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f194c007dd0 tx=0x7f194c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285c3f87df2da203 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:37.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.976+0000 7f1949c00640 1 -- 172.21.15.7:0/2949466388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c014070 con 0x563f435493c0 2024-04-23T15:06:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.976+0000 7f1949c00640 1 -- 172.21.15.7:0/2949466388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f194c004d20 con 0x563f435493c0 2024-04-23T15:06:37.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.976+0000 7f1949c00640 1 -- 172.21.15.7:0/2949466388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c010790 con 0x563f435493c0 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.977+0000 7f1952000640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f19300a3d10 0x7f19300a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.977+0000 7f195e387740 1 -- 172.21.15.7:0/2949466388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 msgr2=0x563f435497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.977+0000 7f195e387740 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 0x563f435497a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f194c007dd0 tx=0x7f194c00e720 comp rx=0 tx=0).stop 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.977+0000 7f1952000640 1 -- 172.21.15.7:0/2130772674 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7f19380d06e0 con 0x7f1954102fc0 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.977+0000 7f195e387740 1 -- 172.21.15.7:0/2949466388 shutdown_connections 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f43549ce0 0x563f43554060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.977+0000 7f1958a00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f19300a3d10 0x7f19300a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435545a0 0x563f43556990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 --2- 172.21.15.7:0/2949466388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435493c0 0x563f435497a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 -- 172.21.15.7:0/2949466388 >> 172.21.15.7:0/2949466388 conn(0x563f435458d0 msgr2=0x563f43545cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 -- 172.21.15.7:0/2949466388 shutdown_connections 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 -- 172.21.15.7:0/2949466388 wait complete. 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f195e387740 1 -- start start 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.978+0000 7f1958a00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f19300a3d10 0x7f19300a61d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x563f4354a960 tx=0x7f1938004750 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 Processor -- start 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435493c0 0x563f43551520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f43549ce0 0x563f43551a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 0x563f43551fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f43557140 con 0x563f435545a0 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f434692c0 con 0x563f435493c0 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563f435572c0 con 0x563f43549ce0 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.979+0000 7f195e387740 10 client.0 _ll_register_callbacks cb 0x563f431c1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 0x563f43551fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 0x563f43551fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43056/0 (socket says 172.21.15.7:43056) 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 -- 172.21.15.7:0/241959824 learned_addr learned my addr 172.21.15.7:0/241959824 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f194be00640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f43549ce0 0x563f43551a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435493c0 0x563f43551520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 -- 172.21.15.7:0/241959824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f43549ce0 msgr2=0x563f43551a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f43549ce0 0x563f43551a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 -- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435493c0 msgr2=0x563f43551520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435493c0 0x563f43551520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.980+0000 7f1959400640 1 -- 172.21.15.7:0/241959824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f43479fd0 con 0x563f435545a0 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f1959400640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 0x563f43551fa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f194c007690 tx=0x7f194c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5838a43a7c6ac980 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f1946a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f1946a00640 1 -- 172.21.15.7:0/241959824 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c014040 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f1946a00640 1 -- 172.21.15.7:0/241959824 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7f194c010bc0 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f194c004d20 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f1946a00640 1 -- 172.21.15.7:0/241959824 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f194c010dc0 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f195e387740 10 client.16875 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.981+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f431c2210 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f1946a00640 1 -- 172.21.15.7:0/241959824 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f194c004d20 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f1946a00640 1 -- 172.21.15.7:0/241959824 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f194c023030 con 0x563f435545a0 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f195e387740 10 client.16875 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f195e387740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f195e387740 20 client.16875 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f195e387740 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f43564690 0x563f43566a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f195e387740 4 client.16875 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:06:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.982+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f434bd320 con 0x563f43564690 2024-04-23T15:06:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.983+0000 7f194be00640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f43564690 0x563f43566a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.983+0000 7f194be00640 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f43564690 0x563f43566a80 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15996b9d406b0bd6 server_cookie=3c9f90cdad3a0708 in_seq=0 out_seq=0 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.983+0000 7f1946a00640 10 client.16875 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.985+0000 7f1946a00640 1 -- 172.21.15.7:0/241959824 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563f434bd320 con 0x563f43564690 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.985+0000 7f1946a00640 10 client.16875 handle_command_reply: tid=0 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.985+0000 7f195e387740 1 client.16875 shutdown 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 msgr2=0x563f43551fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 0x563f43551fa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f194c007690 tx=0x7f194c005b00 comp rx=0 tx=0).stop 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 shutdown_connections 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f43564690 0x563f43566a80 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f435545a0 0x563f43551fa0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f1946a00640 0 client.16875 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f43549ce0 0x563f43551a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 --2- 172.21.15.7:0/241959824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435493c0 0x563f43551520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 >> 172.21.15.7:0/241959824 conn(0x563f435458d0 msgr2=0x563f4354b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 shutdown_connections 2024-04-23T15:06:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 1 -- 172.21.15.7:0/241959824 wait complete. 2024-04-23T15:06:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:37.986+0000 7f195e387740 20 client.16875 trim_cache size 0 max 16384 2024-04-23T15:06:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.006+0000 7f195e387740 1 Processor -- start 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.006+0000 7f195e387740 1 -- start start 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f195e387740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f43553be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f195e387740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f43560130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f195e387740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f43544cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f195e387740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19541af270 con 0x563f43549ce0 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f195e387740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19541b0db0 con 0x563f435545a0 2024-04-23T15:06:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f195e387740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f19541af940 con 0x563f435493c0 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f194be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f43560130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f194be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f43560130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43070/0 (socket says 172.21.15.7:43070) 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.007+0000 7f194be00640 1 -- 172.21.15.7:0/4233389569 learned_addr learned my addr 172.21.15.7:0/4233389569 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f1959400640 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f43553be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f1959400640 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f43544cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f194be00640 1 -- 172.21.15.7:0/4233389569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 msgr2=0x563f43553be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f194be00640 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f43553be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f194be00640 1 -- 172.21.15.7:0/4233389569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 msgr2=0x563f43544cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f194be00640 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f43544cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f194be00640 1 -- 172.21.15.7:0/4233389569 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f4328e620 con 0x563f43549ce0 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f1959400640 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f43544cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.008+0000 7f194be00640 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f43560130 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1940005ab0 tx=0x7f1940009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ef5715e4bfc890 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.009+0000 7f1949200640 1 -- 172.21.15.7:0/4233389569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940049070 con 0x563f43549ce0 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.009+0000 7f1949200640 1 -- 172.21.15.7:0/4233389569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1940044dc0 con 0x563f43549ce0 2024-04-23T15:06:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.009+0000 7f1949200640 1 -- 172.21.15.7:0/4233389569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940035040 con 0x563f43549ce0 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 -- 172.21.15.7:0/4233389569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 msgr2=0x563f43560130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f43560130 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1940005ab0 tx=0x7f1940009640 comp rx=0 tx=0).stop 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 -- 172.21.15.7:0/4233389569 shutdown_connections 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f43544cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f43560130 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 --2- 172.21.15.7:0/4233389569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f43553be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 -- 172.21.15.7:0/4233389569 >> 172.21.15.7:0/4233389569 conn(0x563f435458d0 msgr2=0x563f435534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 -- 172.21.15.7:0/4233389569 shutdown_connections 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 -- 172.21.15.7:0/4233389569 wait complete. 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.010+0000 7f195e387740 1 -- start start 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 Processor -- start 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f4354e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f4354e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f4354ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19541b06e0 con 0x563f43549ce0 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19541b0010 con 0x563f435545a0 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f19541ad270 con 0x563f435493c0 2024-04-23T15:06:38.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.011+0000 7f195e387740 10 client.0 _ll_register_callbacks cb 0x7f194c007c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f4354e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f4354e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43076/0 (socket says 172.21.15.7:43076) 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 -- 172.21.15.7:0/2612403714 learned_addr learned my addr 172.21.15.7:0/2612403714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f1959400640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f4354e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f1959400640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f4354ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 -- 172.21.15.7:0/2612403714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 msgr2=0x563f4354e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f4354e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 -- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 msgr2=0x563f4354ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f4354ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f194be00640 1 -- 172.21.15.7:0/2612403714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f435c99b0 con 0x563f43549ce0 2024-04-23T15:06:38.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.012+0000 7f1959400640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f4354ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f194be00640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f4354e6b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1940009230 tx=0x7f1940000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe8555f3cdc12ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f1946a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f1946a00640 1 -- 172.21.15.7:0/2612403714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940049040 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f1946a00640 1 -- 172.21.15.7:0/2612403714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7f19400035f0 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1940044dc0 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f1946a00640 1 -- 172.21.15.7:0/2612403714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f194005b050 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f195e387740 10 client.16881 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.013+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f435cac00 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f1946a00640 1 -- 172.21.15.7:0/2612403714 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1940044dc0 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f1946a00640 1 -- 172.21.15.7:0/2612403714 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1940032420 con 0x563f43549ce0 2024-04-23T15:06:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f195e387740 10 client.16881 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f195e387740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f195e387740 20 client.16881 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f195e387740 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f435cb2f0 0x563f435cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f195e387740 4 client.16881 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:06:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.014+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f434b7190 con 0x563f435cb2f0 2024-04-23T15:06:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.015+0000 7f1959400640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f435cb2f0 0x563f435cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.016+0000 7f1959400640 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f435cb2f0 0x563f435cd710 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4520c65dc1331c3 server_cookie=6d76d307f257d0d7 in_seq=0 out_seq=0 2024-04-23T15:06:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.016+0000 7f1946a00640 10 client.16881 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f1946a00640 1 -- 172.21.15.7:0/2612403714 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f434b7190 con 0x563f435cb2f0 2024-04-23T15:06:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f1946a00640 10 client.16881 handle_command_reply: tid=0 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 client.16881 shutdown 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 msgr2=0x563f4354e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f4354e6b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1940009230 tx=0x7f1940000bc0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 shutdown_connections 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f435cb2f0 0x563f435cd710 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f435545a0 0x563f4354ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f43549ce0 0x563f4354e6b0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 --2- 172.21.15.7:0/2612403714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f435493c0 0x563f4354e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 >> 172.21.15.7:0/2612403714 conn(0x563f435458d0 msgr2=0x563f43552bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f1946a00640 0 client.16881 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 shutdown_connections 2024-04-23T15:06:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.044+0000 7f195e387740 1 -- 172.21.15.7:0/2612403714 wait complete. 2024-04-23T15:06:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f195e387740 20 client.16881 trim_cache size 0 max 16384 2024-04-23T15:06:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:06:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:06:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:06:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:06:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f19300a3d10 msgr2=0x7f19300a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f19300a3d10 0x7f19300a61d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x563f4354a960 tx=0x7f1938004750 comp rx=0 tx=0).stop 2024-04-23T15:06:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 msgr2=0x7f19541985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 0x7f19541985d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f193800d770 tx=0x7f193800dc30 comp rx=0 tx=0).stop 2024-04-23T15:06:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 shutdown_connections 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f19300a3d10 0x7f19300a61d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19541038e0 0x7f1954198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f195410c3e0 0x7f195419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 --2- 172.21.15.7:0/2130772674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1954102fc0 0x7f19541985d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.045+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 >> 172.21.15.7:0/2130772674 conn(0x7f19540fc820 msgr2=0x7f19540fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.046+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 shutdown_connections 2024-04-23T15:06:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:38.046+0000 7f1959e00640 1 -- 172.21.15.7:0/2130772674 wait complete. 2024-04-23T15:06:38.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:37 smithi007 ceph-mon[27906]: pgmap v477: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:06:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:37 smithi186 ceph-mon[31814]: pgmap v477: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:06:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:37 smithi137 ceph-mon[31694]: pgmap v477: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:06:40.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:39 smithi007 ceph-mon[27906]: pgmap v478: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:06:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:39 smithi186 ceph-mon[31814]: pgmap v478: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:06:40.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:39 smithi137 ceph-mon[31694]: pgmap v478: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:06:42.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:41 smithi007 ceph-mon[27906]: pgmap v479: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:06:42.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:41 smithi186 ceph-mon[31814]: pgmap v479: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:06:42.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:41 smithi137 ceph-mon[31694]: pgmap v479: 129 pgs: 129 active+clean; 3.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:06:44.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:43 smithi007 ceph-mon[27906]: pgmap v480: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:06:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:43 smithi186 ceph-mon[31814]: pgmap v480: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:06:44.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:43 smithi137 ceph-mon[31694]: pgmap v480: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:06:46.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:45 smithi007 ceph-mon[27906]: pgmap v481: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:45 smithi186 ceph-mon[31814]: pgmap v481: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:06:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:45 smithi137 ceph-mon[31694]: pgmap v481: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:06:48.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:47 smithi007 ceph-mon[27906]: pgmap v482: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T15:06:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:47 smithi186 ceph-mon[31814]: pgmap v482: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T15:06:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:47 smithi137 ceph-mon[31694]: pgmap v482: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-04-23T15:06:50.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:49 smithi007 ceph-mon[27906]: pgmap v483: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:06:50.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:49 smithi186 ceph-mon[31814]: pgmap v483: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:06:50.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:49 smithi137 ceph-mon[31694]: pgmap v483: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:06:51.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:50 smithi007 ceph-mon[27906]: pgmap v484: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:06:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:50 smithi186 ceph-mon[31814]: pgmap v484: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:06:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:50 smithi137 ceph-mon[31694]: pgmap v484: 129 pgs: 129 active+clean; 3.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.194+0000 7f28e1400640 1 -- 172.21.15.7:0/1339594482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc104c30 msgr2=0x7f28dc108c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.194+0000 7f28e1400640 1 --2- 172.21.15.7:0/1339594482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc104c30 0x7f28dc108c70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009900 tx=0x7f28c402a410 comp rx=0 tx=0).stop 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 -- 172.21.15.7:0/1339594482 shutdown_connections 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 --2- 172.21.15.7:0/1339594482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28dc109350 0x7f28dc110f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 --2- 172.21.15.7:0/1339594482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc104c30 0x7f28dc108c70 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 --2- 172.21.15.7:0/1339594482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28dc104280 0x7f28dc104660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 -- 172.21.15.7:0/1339594482 >> 172.21.15.7:0/1339594482 conn(0x7f28dc0ffb20 msgr2=0x7f28dc101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 -- 172.21.15.7:0/1339594482 shutdown_connections 2024-04-23T15:06:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.195+0000 7f28e1400640 1 -- 172.21.15.7:0/1339594482 wait complete. 2024-04-23T15:06:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.197+0000 7f28e1400640 1 Processor -- start 2024-04-23T15:06:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.197+0000 7f28e1400640 1 -- start start 2024-04-23T15:06:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.198+0000 7f28e1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28dc104280 0x7f28dc1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.198+0000 7f28e1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28dc109350 0x7f28dc1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.198+0000 7f28e1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 0x7f28dc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.198+0000 7f28e1400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1142e0 con 0x7f28dc19a770 2024-04-23T15:06:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.198+0000 7f28e1400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc114160 con 0x7f28dc104280 2024-04-23T15:06:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.198+0000 7f28e1400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc114460 con 0x7f28dc109350 2024-04-23T15:06:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.199+0000 7f28e0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 0x7f28dc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.199+0000 7f28dbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28dc104280 0x7f28dc1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.199+0000 7f28e0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 0x7f28dc19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40736/0 (socket says 172.21.15.7:40736) 2024-04-23T15:06:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.199+0000 7f28e0a00640 1 -- 172.21.15.7:0/3588634151 learned_addr learned my addr 172.21.15.7:0/3588634151 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.199+0000 7f28db400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28dc109350 0x7f28dc1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e0a00640 1 -- 172.21.15.7:0/3588634151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28dc109350 msgr2=0x7f28dc1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e0a00640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28dc109350 0x7f28dc1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e0a00640 1 -- 172.21.15.7:0/3588634151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28dc104280 msgr2=0x7f28dc1a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e0a00640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28dc104280 0x7f28dc1a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e0a00640 1 -- 172.21.15.7:0/3588634151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc19b370 con 0x7f28dc19a770 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e0a00640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 0x7f28dc19abf0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009fd0 tx=0x7f28d400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28d8c00640 1 -- 172.21.15.7:0/3588634151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4017070 con 0x7f28dc19a770 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28d8c00640 1 -- 172.21.15.7:0/3588634151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28d4003e20 con 0x7f28dc19a770 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28d8c00640 1 -- 172.21.15.7:0/3588634151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4010460 con 0x7f28dc19a770 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.200+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc1a7450 con 0x7f28dc19a770 2024-04-23T15:06:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.201+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc1a7800 con 0x7f28dc19a770 2024-04-23T15:06:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.204+0000 7f28e5774740 1 Processor -- start 2024-04-23T15:06:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.204+0000 7f28d8c00640 1 -- 172.21.15.7:0/3588634151 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f28d4003970 con 0x7f28dc19a770 2024-04-23T15:06:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.204+0000 7f28e5774740 1 -- start start 2024-04-23T15:06:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28e5774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28e5774740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bbce0 0x556d1d7c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28e5774740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7c65a0 0x556d1d7c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28e5774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d1d721900 con 0x556d1d7bb3c0 2024-04-23T15:06:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28e5774740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556d1d6c7f20 con 0x556d1d7c65a0 2024-04-23T15:06:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28e5774740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556d1d71d8c0 con 0x556d1d7bbce0 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7bb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40750/0 (socket says 172.21.15.7:40750) 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.205+0000 7f28db400640 1 -- 172.21.15.7:0/1676444456 learned_addr learned my addr 172.21.15.7:0/1676444456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28dbe00640 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bbce0 0x556d1d7c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7c65a0 0x556d1d7c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 -- 172.21.15.7:0/1676444456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bbce0 msgr2=0x556d1d7c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bbce0 0x556d1d7c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 -- 172.21.15.7:0/1676444456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7c65a0 msgr2=0x556d1d7c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7c65a0 0x556d1d7c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 -- 172.21.15.7:0/1676444456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d1d6ece10 con 0x556d1d7bb3c0 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.206+0000 7f28db400640 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7bb7a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006010 tx=0x7f28c4005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424fcf57022cbec4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.207+0000 7f28d8c00640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f28c00a3d10 0x7f28c00a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.207+0000 7f28d1200640 1 -- 172.21.15.7:0/1676444456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4044020 con 0x556d1d7bb3c0 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.207+0000 7f28d1200640 1 -- 172.21.15.7:0/1676444456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28c4004750 con 0x556d1d7bb3c0 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.207+0000 7f28d1200640 1 -- 172.21.15.7:0/1676444456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4035040 con 0x556d1d7bb3c0 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.207+0000 7f28d8c00640 1 -- 172.21.15.7:0/3588634151 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7f28d40d0940 con 0x7f28dc19a770 2024-04-23T15:06:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.207+0000 7f28dbe00640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f28c00a3d10 0x7f28c00a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 -- 172.21.15.7:0/1676444456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 msgr2=0x556d1d7bb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7bb7a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006010 tx=0x7f28c4005e50 comp rx=0 tx=0).stop 2024-04-23T15:06:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28dbe00640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f28c00a3d10 0x7f28c00a61d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x556d1d7bc960 tx=0x7f28cc005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 -- 172.21.15.7:0/1676444456 shutdown_connections 2024-04-23T15:06:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7c65a0 0x556d1d7c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bbce0 0x556d1d7c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 --2- 172.21.15.7:0/1676444456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7bb7a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 -- 172.21.15.7:0/1676444456 >> 172.21.15.7:0/1676444456 conn(0x556d1d7b78d0 msgr2=0x556d1d7b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 -- 172.21.15.7:0/1676444456 shutdown_connections 2024-04-23T15:06:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.208+0000 7f28e5774740 1 -- 172.21.15.7:0/1676444456 wait complete. 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.209+0000 7f28e5774740 1 -- start start 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.209+0000 7f28e5774740 1 Processor -- start 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.209+0000 7f28e5774740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e5774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 0x556d1d7c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e5774740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d7c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e5774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d1d7c9020 con 0x556d1d7bbce0 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e5774740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556d1d6db2c0 con 0x556d1d7bb3c0 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e5774740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556d1d7c91a0 con 0x556d1d7c65a0 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e5774740 10 client.0 _ll_register_callbacks cb 0x556d1d433a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 0x556d1d7c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 0x556d1d7c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40762/0 (socket says 172.21.15.7:40762) 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 -- 172.21.15.7:0/13526284 learned_addr learned my addr 172.21.15.7:0/13526284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28dbe00640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28e0a00640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d7c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 -- 172.21.15.7:0/13526284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 msgr2=0x556d1d7c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d7c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 -- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bb3c0 msgr2=0x556d1d7c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.210+0000 7f28db400640 1 -- 172.21.15.7:0/13526284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d1d6ebfd0 con 0x556d1d7bbce0 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.211+0000 7f28db400640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 0x556d1d7c3c00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f28c402ac00 tx=0x7f28c40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb86c9f18e50b809 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.211+0000 7f28c9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.211+0000 7f28c9600640 1 -- 172.21.15.7:0/13526284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4044030 con 0x556d1d7bbce0 2024-04-23T15:06:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.211+0000 7f28c9600640 1 -- 172.21.15.7:0/13526284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7f28c4003ea0 con 0x556d1d7bbce0 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.211+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c4004750 con 0x556d1d7bbce0 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.211+0000 7f28c9600640 1 -- 172.21.15.7:0/13526284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f28c4056050 con 0x556d1d7bbce0 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 10 client.16893 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556d1d434210 con 0x556d1d7bbce0 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28c9600640 1 -- 172.21.15.7:0/13526284 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28c4004750 con 0x556d1d7bbce0 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28c9600640 1 -- 172.21.15.7:0/13526284 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f28c4051030 con 0x556d1d7bbce0 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 10 client.16893 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 10 client.16893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 20 client.16893 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d7d65c0 0x556d1d7d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 4 client.16893 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:06:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.212+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d1d72f320 con 0x556d1d7d65c0 2024-04-23T15:06:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.213+0000 7f28dbe00640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d7d65c0 0x556d1d7d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.214+0000 7f28dbe00640 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d7d65c0 0x556d1d7d89b0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2bd2fa5da142a75 server_cookie=bebba3dc271a0413 in_seq=0 out_seq=0 2024-04-23T15:06:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.214+0000 7f28c9600640 10 client.16893 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28c9600640 1 -- 172.21.15.7:0/13526284 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d1d72f320 con 0x556d1d7d65c0 2024-04-23T15:06:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28c9600640 10 client.16893 handle_command_reply: tid=0 2024-04-23T15:06:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 client.16893 shutdown 2024-04-23T15:06:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 msgr2=0x556d1d7c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 0x556d1d7c3c00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f28c402ac00 tx=0x7f28c40038a0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 shutdown_connections 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d7d65c0 0x556d1d7d89b0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d7c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bbce0 0x556d1d7c3c00 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 --2- 172.21.15.7:0/13526284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28c9600640 0 client.16893 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 >> 172.21.15.7:0/13526284 conn(0x556d1d7b78d0 msgr2=0x556d1d7bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.216+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 shutdown_connections 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.217+0000 7f28e5774740 1 -- 172.21.15.7:0/13526284 wait complete. 2024-04-23T15:06:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.217+0000 7f28e5774740 20 client.16893 trim_cache size 0 max 16384 2024-04-23T15:06:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 Processor -- start 2024-04-23T15:06:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 -- start start 2024-04-23T15:06:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 0x556d1d7db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1b1330 con 0x556d1d7c65a0 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1b2e70 con 0x556d1d7bbce0 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.238+0000 7f28e5774740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1b1a00 con 0x556d1d7bb3c0 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 0x556d1d7db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 0x556d1d7db9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40768/0 (socket says 172.21.15.7:40768) 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 -- 172.21.15.7:0/1074581719 learned_addr learned my addr 172.21.15.7:0/1074581719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28dbe00640 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28db400640 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 -- 172.21.15.7:0/1074581719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bb3c0 msgr2=0x556d1d7c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 -- 172.21.15.7:0/1074581719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 msgr2=0x556d1d7b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28e0a00640 1 -- 172.21.15.7:0/1074581719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d1d500620 con 0x556d1d7c65a0 2024-04-23T15:06:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.239+0000 7f28db400640 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:06:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.240+0000 7f28e0a00640 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 0x556d1d7db9d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f28d400b760 tx=0x7f28d409c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af7b9fc8fca62fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.240+0000 7f28cbe00640 1 -- 172.21.15.7:0/1074581719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4020040 con 0x556d1d7c65a0 2024-04-23T15:06:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.240+0000 7f28cbe00640 1 -- 172.21.15.7:0/1074581719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28d40a0880 con 0x556d1d7c65a0 2024-04-23T15:06:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.240+0000 7f28cbe00640 1 -- 172.21.15.7:0/1074581719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40982d0 con 0x556d1d7c65a0 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 -- 172.21.15.7:0/1074581719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 msgr2=0x556d1d7db9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 0x556d1d7db9d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f28d400b760 tx=0x7f28d409c1b0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 -- 172.21.15.7:0/1074581719 shutdown_connections 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7c65a0 0x556d1d7db9d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 --2- 172.21.15.7:0/1074581719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7bb3c0 0x556d1d7c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 -- 172.21.15.7:0/1074581719 >> 172.21.15.7:0/1074581719 conn(0x556d1d7b78d0 msgr2=0x556d1d7d1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 -- 172.21.15.7:0/1074581719 shutdown_connections 2024-04-23T15:06:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 -- 172.21.15.7:0/1074581719 wait complete. 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.241+0000 7f28e5774740 1 -- start start 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 Processor -- start 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7d9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7da070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d83b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1b27a0 con 0x556d1d7bb3c0 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1b20d0 con 0x556d1d7bbce0 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1af330 con 0x556d1d7c65a0 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.242+0000 7f28e5774740 10 client.0 _ll_register_callbacks cb 0x7f28cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7d9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7d9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40776/0 (socket says 172.21.15.7:40776) 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 -- 172.21.15.7:0/974602033 learned_addr learned my addr 172.21.15.7:0/974602033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28e0a00640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d83b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28db400640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7da070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 -- 172.21.15.7:0/974602033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 msgr2=0x556d1d83b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d83b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 -- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 msgr2=0x556d1d7da070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7da070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 -- 172.21.15.7:0/974602033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d1d83bce0 con 0x556d1d7bb3c0 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28db400640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7da070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28dbe00640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7d9b30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x556d1d7c9270 tx=0x7f28cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89feacdbb614a30a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:06:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.243+0000 7f28c9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.244+0000 7f28c9600640 1 -- 172.21.15.7:0/974602033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc003d30 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.244+0000 7f28c9600640 1 -- 172.21.15.7:0/974602033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9467+0+0 (secure 0 0 0) 0x7f28cc02b380 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.244+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d40a0880 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.244+0000 7f28c9600640 1 -- 172.21.15.7:0/974602033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f28cc03b050 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.244+0000 7f28e5774740 10 client.16899 fetch_fsmap learned FSMap version 32 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.244+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556d1d83cf90 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28c9600640 1 -- 172.21.15.7:0/974602033 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28d40a0880 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28c9600640 1 -- 172.21.15.7:0/974602033 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f28cc0047a0 con 0x556d1d7bb3c0 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28e5774740 10 client.16899 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28e5774740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28e5774740 20 client.16899 populate_metadata read hostname 'smithi007' 2024-04-23T15:06:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28e5774740 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d83d740 0x556d1d83fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:06:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28e5774740 4 client.16899 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:06:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.245+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d1d729190 con 0x556d1d83d740 2024-04-23T15:06:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.246+0000 7f28db400640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d83d740 0x556d1d83fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:06:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.247+0000 7f28db400640 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d83d740 0x556d1d83fb60 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67b3693ac8effb0 server_cookie=e4c2ac02be4ebd02 in_seq=0 out_seq=0 2024-04-23T15:06:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.247+0000 7f28c9600640 10 client.16899 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.275+0000 7f28c9600640 1 -- 172.21.15.7:0/974602033 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556d1d729190 con 0x556d1d83d740 2024-04-23T15:06:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.275+0000 7f28c9600640 10 client.16899 handle_command_reply: tid=0 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.275+0000 7f28e5774740 1 client.16899 shutdown 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 msgr2=0x556d1d7d9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7d9b30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x556d1d7c9270 tx=0x7f28cc0046c0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 shutdown_connections 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556d1d83d740 0x556d1d83fb60 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556d1d7bbce0 0x556d1d7da070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d1d7c65a0 0x556d1d83b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 --2- 172.21.15.7:0/974602033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d1d7bb3c0 0x556d1d7d9b30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28c9600640 0 client.16899 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:06:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 >> 172.21.15.7:0/974602033 conn(0x556d1d7b78d0 msgr2=0x556d1d7c3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 shutdown_connections 2024-04-23T15:06:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 1 -- 172.21.15.7:0/974602033 wait complete. 2024-04-23T15:06:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.276+0000 7f28e5774740 20 client.16899 trim_cache size 0 max 16384 2024-04-23T15:06:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:06:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:06:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:06:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:06:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f28c00a3d10 msgr2=0x7f28c00a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f28c00a3d10 0x7f28c00a61d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x556d1d7bc960 tx=0x7f28cc005f90 comp rx=0 tx=0).stop 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 msgr2=0x7f28dc19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 0x7f28dc19abf0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009fd0 tx=0x7f28d400b260 comp rx=0 tx=0).stop 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 shutdown_connections 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f28c00a3d10 0x7f28c00a61d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28dc19a770 0x7f28dc19abf0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28dc109350 0x7f28dc1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 --2- 172.21.15.7:0/3588634151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28dc104280 0x7f28dc1a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.277+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 >> 172.21.15.7:0/3588634151 conn(0x7f28dc0ffb20 msgr2=0x7f28dc100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.278+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 shutdown_connections 2024-04-23T15:06:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:06:51.278+0000 7f28e1400640 1 -- 172.21.15.7:0/3588634151 wait complete. 2024-04-23T15:06:54.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:53 smithi007 ceph-mon[27906]: pgmap v485: 129 pgs: 129 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:06:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:53 smithi186 ceph-mon[31814]: pgmap v485: 129 pgs: 129 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:06:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:53 smithi137 ceph-mon[31694]: pgmap v485: 129 pgs: 129 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:06:56.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:55 smithi007 ceph-mon[27906]: pgmap v486: 129 pgs: 129 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:56.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:55 smithi186 ceph-mon[31814]: pgmap v486: 129 pgs: 129 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:56.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:55 smithi137 ceph-mon[31694]: pgmap v486: 129 pgs: 129 active+clean; 3.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:06:58.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:57 smithi007 ceph-mon[27906]: pgmap v487: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:06:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:57 smithi186 ceph-mon[31814]: pgmap v487: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:06:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:57 smithi137 ceph-mon[31694]: pgmap v487: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:00.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:06:59 smithi007 ceph-mon[27906]: pgmap v488: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:07:00.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:06:59 smithi186 ceph-mon[31814]: pgmap v488: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:07:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:06:59 smithi137 ceph-mon[31694]: pgmap v488: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:07:02.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:01 smithi007 ceph-mon[27906]: pgmap v489: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:07:02.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:01 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:07:02.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:01 smithi186 ceph-mon[31814]: pgmap v489: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:07:02.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:01 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:07:02.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:01 smithi137 ceph-mon[31694]: pgmap v489: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:07:02.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:01 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:07:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:02 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:07:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:02 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:07:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:02 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:07:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:02 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:07:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:02 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:07:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:02 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:07:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:02 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:07:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:02 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:07:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:02 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:07:04.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:03 smithi007 ceph-mon[27906]: pgmap v490: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.1 MiB/s wr, 34 op/s 2024-04-23T15:07:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:03 smithi007 ceph-mon[27906]: osdmap e111: 12 total, 12 up, 12 in 2024-04-23T15:07:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:03 smithi186 ceph-mon[31814]: pgmap v490: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.1 MiB/s wr, 34 op/s 2024-04-23T15:07:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:03 smithi186 ceph-mon[31814]: osdmap e111: 12 total, 12 up, 12 in 2024-04-23T15:07:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:03 smithi137 ceph-mon[31694]: pgmap v490: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.1 MiB/s wr, 34 op/s 2024-04-23T15:07:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:03 smithi137 ceph-mon[31694]: osdmap e111: 12 total, 12 up, 12 in 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 -- 172.21.15.7:0/2180300516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc104c60 msgr2=0x7fd0dc108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2180300516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc104c60 0x7fd0dc108ca0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009900 tx=0x7fd0c802a400 comp rx=0 tx=0).stop 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 -- 172.21.15.7:0/2180300516 shutdown_connections 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2180300516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0dc109380 0x7fd0dc110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2180300516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc104c60 0x7fd0dc108ca0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2180300516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 -- 172.21.15.7:0/2180300516 >> 172.21.15.7:0/2180300516 conn(0x7fd0dc0ffb10 msgr2=0x7fd0dc101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 -- 172.21.15.7:0/2180300516 shutdown_connections 2024-04-23T15:07:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.445+0000 7fd0e2600640 1 -- 172.21.15.7:0/2180300516 wait complete. 2024-04-23T15:07:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.446+0000 7fd0e2600640 1 Processor -- start 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.446+0000 7fd0e2600640 1 -- start start 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0dc109380 0x7fd0dc1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc19a6f0 0x7fd0dc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e2600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc114310 con 0x7fd0dc1042b0 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc114190 con 0x7fd0dc109380 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc114490 con 0x7fd0dc19a6f0 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc1a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59856/0 (socket says 172.21.15.7:59856) 2024-04-23T15:07:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e1200640 1 -- 172.21.15.7:0/2830649698 learned_addr learned my addr 172.21.15.7:0/2830649698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0dc109380 0x7fd0dc1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc19a6f0 0x7fd0dc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e1200640 1 -- 172.21.15.7:0/2830649698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc19a6f0 msgr2=0x7fd0dc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.447+0000 7fd0e1200640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc19a6f0 0x7fd0dc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0e1200640 1 -- 172.21.15.7:0/2830649698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0dc109380 msgr2=0x7fd0dc1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0e1200640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0dc109380 0x7fd0dc1a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0e1200640 1 -- 172.21.15.7:0/2830649698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc19b2f0 con 0x7fd0dc1042b0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc19a6f0 0x7fd0dc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0e1200640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc1a05e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000d770 tx=0x7fd0d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0d9600640 1 -- 172.21.15.7:0/2830649698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0017070 con 0x7fd0dc1042b0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0d9600640 1 -- 172.21.15.7:0/2830649698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0d00054d0 con 0x7fd0dc1042b0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0d9600640 1 -- 172.21.15.7:0/2830649698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0004cf0 con 0x7fd0dc1042b0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.448+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1a7380 con 0x7fd0dc1042b0 2024-04-23T15:07:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.449+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1a7730 con 0x7fd0dc1042b0 2024-04-23T15:07:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 Processor -- start 2024-04-23T15:07:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 -- start start 2024-04-23T15:07:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0d9600640 1 -- 172.21.15.7:0/2830649698 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd0d0004e90 con 0x7fd0dc1042b0 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a30990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596e3989900 con 0x5596e3a2e5a0 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5596e392ff20 con 0x5596e3a233c0 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.453+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5596e39858c0 con 0x5596e3a23ce0 2024-04-23T15:07:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a30990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a30990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59870/0 (socket says 172.21.15.7:59870) 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 -- 172.21.15.7:0/440621139 learned_addr learned my addr 172.21.15.7:0/440621139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0e1200640 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 -- 172.21.15.7:0/440621139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 msgr2=0x5596e3a2e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 -- 172.21.15.7:0/440621139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 msgr2=0x5596e3a237a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a237a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0dbe00640 1 -- 172.21.15.7:0/440621139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596e3954e10 con 0x5596e3a2e5a0 2024-04-23T15:07:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.454+0000 7fd0e1200640 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.455+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a30990 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8031440 tx=0x7fd0c8004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9724a87bf2d28e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.455+0000 7fd0ce000640 1 -- 172.21.15.7:0/440621139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8035030 con 0x5596e3a2e5a0 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.455+0000 7fd0d9600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd0c40a3d90 0x7fd0c40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.455+0000 7fd0ce000640 1 -- 172.21.15.7:0/440621139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c80054f0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.455+0000 7fd0ce000640 1 -- 172.21.15.7:0/440621139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80035f0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.455+0000 7fd0d9600640 1 -- 172.21.15.7:0/2830649698 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9555+0+0 (secure 0 0 0) 0x7fd0d00d06e0 con 0x7fd0dc1042b0 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd0c40a3d90 0x7fd0c40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 -- 172.21.15.7:0/440621139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 msgr2=0x5596e3a30990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a30990 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8031440 tx=0x7fd0c8004160 comp rx=0 tx=0).stop 2024-04-23T15:07:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 -- 172.21.15.7:0/440621139 shutdown_connections 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a30990 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/440621139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a237a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 -- 172.21.15.7:0/440621139 >> 172.21.15.7:0/440621139 conn(0x5596e3a1f8d0 msgr2=0x5596e3a1fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e6b71740 1 -- 172.21.15.7:0/440621139 shutdown_connections 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.456+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd0c40a3d90 0x7fd0c40a6250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4005fd0 tx=0x7fd0d4009680 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.457+0000 7fd0e6b71740 1 -- 172.21.15.7:0/440621139 wait complete. 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.457+0000 7fd0e6b71740 1 -- start start 2024-04-23T15:07:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.457+0000 7fd0e6b71740 1 Processor -- start 2024-04-23T15:07:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a2bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596e3a31020 con 0x5596e3a2e5a0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5596e39432c0 con 0x5596e3a233c0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5596e3a311a0 con 0x5596e3a23ce0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e6b71740 10 client.0 _ll_register_callbacks cb 0x5596e369ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a2bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a2bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59878/0 (socket says 172.21.15.7:59878) 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e1c00640 1 -- 172.21.15.7:0/2981521159 learned_addr learned my addr 172.21.15.7:0/2981521159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.458+0000 7fd0e1200640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0e1c00640 1 -- 172.21.15.7:0/2981521159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 msgr2=0x5596e3a2ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0e1c00640 1 -- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 msgr2=0x5596e3a2b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0e1c00640 1 -- 172.21.15.7:0/2981521159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596e3953fd0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a2bf40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4012930 tx=0x7fd0d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdb86c84b706172 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.459+0000 7fd0c2a00640 1 -- 172.21.15.7:0/2981521159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400fcf0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0c2a00640 1 -- 172.21.15.7:0/2981521159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9555+0+0 (secure 0 0 0) 0x7fd0d401f420 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c80054f0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0c2a00640 1 -- 172.21.15.7:0/2981521159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd0d4030050 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0e6b71740 10 client.16911 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5596e369c210 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0c2a00640 1 -- 172.21.15.7:0/2981521159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c80054f0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.460+0000 7fd0c2a00640 1 -- 172.21.15.7:0/2981521159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd0d4027630 con 0x5596e3a2e5a0 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e6b71740 10 client.16911 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e6b71740 10 client.16911 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e6b71740 20 client.16911 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3a3e6f0 0x5596e3a40b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e6b71740 4 client.16911 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596e3997320 con 0x5596e3a3e6f0 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.461+0000 7fd0e1200640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3a3e6f0 0x5596e3a40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.462+0000 7fd0e1200640 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3a3e6f0 0x5596e3a40b00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3506acfdbe9c330 server_cookie=9b2b7705987ae472 in_seq=0 out_seq=0 2024-04-23T15:07:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.462+0000 7fd0c2a00640 10 client.16911 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.465+0000 7fd0c2a00640 1 -- 172.21.15.7:0/2981521159 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5596e3997320 con 0x5596e3a3e6f0 2024-04-23T15:07:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.465+0000 7fd0c2a00640 10 client.16911 handle_command_reply: tid=0 2024-04-23T15:07:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.465+0000 7fd0e6b71740 1 client.16911 shutdown 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 msgr2=0x5596e3a2bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a2bf40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4012930 tx=0x7fd0d4004a40 comp rx=0 tx=0).stop 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 shutdown_connections 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3a3e6f0 0x5596e3a40b00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a2bf40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a23ce0 0x5596e3a2ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/2981521159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0c2a00640 0 client.16911 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 >> 172.21.15.7:0/2981521159 conn(0x5596e3a1f8d0 msgr2=0x5596e3a1ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 shutdown_connections 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 1 -- 172.21.15.7:0/2981521159 wait complete. 2024-04-23T15:07:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.466+0000 7fd0e6b71740 20 client.16911 trim_cache size 0 max 16384 2024-04-23T15:07:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.487+0000 7fd0e6b71740 1 Processor -- start 2024-04-23T15:07:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.487+0000 7fd0e6b71740 1 -- start start 2024-04-23T15:07:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 0x5596e3a3a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a2e5a0 0x5596e3a46410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b1450 con 0x5596e3a23ce0 2024-04-23T15:07:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b2f90 con 0x5596e3a233c0 2024-04-23T15:07:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b1b20 con 0x5596e3a2e5a0 2024-04-23T15:07:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 0x5596e3a3a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 0x5596e3a3a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59882/0 (socket says 172.21.15.7:59882) 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0dbe00640 1 -- 172.21.15.7:0/3577375645 learned_addr learned my addr 172.21.15.7:0/3577375645 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e1200640 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.488+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a2e5a0 0x5596e3a46410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.489+0000 7fd0dbe00640 1 -- 172.21.15.7:0/3577375645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a2e5a0 msgr2=0x5596e3a46410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.489+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a2e5a0 0x5596e3a46410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.489+0000 7fd0dbe00640 1 -- 172.21.15.7:0/3577375645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 msgr2=0x5596e3a2dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.489+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.489+0000 7fd0dbe00640 1 -- 172.21.15.7:0/3577375645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596e3768620 con 0x5596e3a23ce0 2024-04-23T15:07:04.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.489+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 0x5596e3a3a080 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8031440 tx=0x7fd0c80044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f43e9214a29aa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:04.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.490+0000 7fd0cd600640 1 -- 172.21.15.7:0/3577375645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8035070 con 0x5596e3a23ce0 2024-04-23T15:07:04.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.490+0000 7fd0cd600640 1 -- 172.21.15.7:0/3577375645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c80046c0 con 0x5596e3a23ce0 2024-04-23T15:07:04.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.490+0000 7fd0cd600640 1 -- 172.21.15.7:0/3577375645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8003850 con 0x5596e3a23ce0 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3577375645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 msgr2=0x5596e3a3a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 0x5596e3a3a080 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8031440 tx=0x7fd0c80044e0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3577375645 shutdown_connections 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a2e5a0 0x5596e3a46410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a23ce0 0x5596e3a3a080 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3577375645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a233c0 0x5596e3a2dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3577375645 >> 172.21.15.7:0/3577375645 conn(0x5596e3a1f8d0 msgr2=0x5596e3a1ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3577375645 shutdown_connections 2024-04-23T15:07:04.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3577375645 wait complete. 2024-04-23T15:07:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.491+0000 7fd0e6b71740 1 -- start start 2024-04-23T15:07:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 Processor -- start 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a233c0 0x5596e3a36590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a23ce0 0x5596e3a36ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a33650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b28c0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b21f0 con 0x5596e3a23ce0 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1af450 con 0x5596e3a233c0 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.492+0000 7fd0e6b71740 10 client.0 _ll_register_callbacks cb 0x7fd0d40125e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a33650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a33650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59888/0 (socket says 172.21.15.7:59888) 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 -- 172.21.15.7:0/3406067651 learned_addr learned my addr 172.21.15.7:0/3406067651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1200640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a233c0 0x5596e3a36590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a23ce0 0x5596e3a36ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 -- 172.21.15.7:0/3406067651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a233c0 msgr2=0x5596e3a36590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a233c0 0x5596e3a36590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 -- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a23ce0 msgr2=0x5596e3a36ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a23ce0 0x5596e3a36ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0e1c00640 1 -- 172.21.15.7:0/3406067651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596e3a33e80 con 0x5596e3a2e5a0 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.493+0000 7fd0dbe00640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a23ce0 0x5596e3a36ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0e1c00640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a33650 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009a90 tx=0x7fd0d400fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada5532b4b5c0c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0c2a00640 1 -- 172.21.15.7:0/3406067651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d402d040 con 0x5596e3a2e5a0 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c80046c0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0c2a00640 1 -- 172.21.15.7:0/3406067651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9555+0+0 (secure 0 0 0) 0x7fd0d401f420 con 0x5596e3a2e5a0 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0c2a00640 1 -- 172.21.15.7:0/3406067651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd0d4027810 con 0x5596e3a2e5a0 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0e6b71740 10 client.16917 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.494+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5596e3aa58c0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0c2a00640 1 -- 172.21.15.7:0/3406067651 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c80046c0 con 0x5596e3a2e5a0 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0c2a00640 1 -- 172.21.15.7:0/3406067651 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd0d403d070 con 0x5596e3a2e5a0 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0e6b71740 10 client.16917 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0e6b71740 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0e6b71740 20 client.16917 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3aa6000 0x5596e3aa8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0e6b71740 4 client.16917 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:07:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.495+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596e3991190 con 0x5596e3aa6000 2024-04-23T15:07:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.496+0000 7fd0e1200640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3aa6000 0x5596e3aa8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.497+0000 7fd0e1200640 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3aa6000 0x5596e3aa8420 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e45b989261908c93 server_cookie=98dc0bfe49c11b68 in_seq=0 out_seq=0 2024-04-23T15:07:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.497+0000 7fd0c2a00640 10 client.16917 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0c2a00640 1 -- 172.21.15.7:0/3406067651 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596e3991190 con 0x5596e3aa6000 2024-04-23T15:07:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0c2a00640 10 client.16917 handle_command_reply: tid=0 2024-04-23T15:07:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 client.16917 shutdown 2024-04-23T15:07:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 msgr2=0x5596e3a33650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a33650 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009a90 tx=0x7fd0d400fd80 comp rx=0 tx=0).stop 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 shutdown_connections 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5596e3aa6000 0x5596e3aa8420 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596e3a23ce0 0x5596e3a36ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596e3a2e5a0 0x5596e3a33650 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 --2- 172.21.15.7:0/3406067651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596e3a233c0 0x5596e3a36590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 >> 172.21.15.7:0/3406067651 conn(0x5596e3a1f8d0 msgr2=0x5596e3a24d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0c2a00640 0 client.16917 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 shutdown_connections 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.532+0000 7fd0e6b71740 1 -- 172.21.15.7:0/3406067651 wait complete. 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.533+0000 7fd0e6b71740 20 client.16917 trim_cache size 0 max 16384 2024-04-23T15:07:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:07:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:07:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:07:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:07:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.533+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd0c40a3d90 msgr2=0x7fd0c40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.533+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd0c40a3d90 0x7fd0c40a6250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4005fd0 tx=0x7fd0d4009680 comp rx=0 tx=0).stop 2024-04-23T15:07:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.533+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 msgr2=0x7fd0dc1a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.533+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc1a05e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000d770 tx=0x7fd0d000dc30 comp rx=0 tx=0).stop 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 shutdown_connections 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd0c40a3d90 0x7fd0c40a6250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0dc109380 0x7fd0dc1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0dc19a6f0 0x7fd0dc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 --2- 172.21.15.7:0/2830649698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc1042b0 0x7fd0dc1a05e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 >> 172.21.15.7:0/2830649698 conn(0x7fd0dc0ffb10 msgr2=0x7fd0dc100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 shutdown_connections 2024-04-23T15:07:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:04.534+0000 7fd0e2600640 1 -- 172.21.15.7:0/2830649698 wait complete. 2024-04-23T15:07:05.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:04 smithi007 ceph-mon[27906]: pgmap v492: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.3 MiB/s wr, 32 op/s 2024-04-23T15:07:05.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:04 smithi186 ceph-mon[31814]: pgmap v492: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.3 MiB/s wr, 32 op/s 2024-04-23T15:07:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:04 smithi137 ceph-mon[31694]: pgmap v492: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.3 MiB/s wr, 32 op/s 2024-04-23T15:07:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:07 smithi007 ceph-mon[27906]: pgmap v493: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:07:08.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:07 smithi186 ceph-mon[31814]: pgmap v493: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:07:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:07 smithi137 ceph-mon[31694]: pgmap v493: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:07:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:09 smithi007 ceph-mon[27906]: pgmap v494: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:07:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:09 smithi186 ceph-mon[31814]: pgmap v494: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:07:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:09 smithi137 ceph-mon[31694]: pgmap v494: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:07:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:11 smithi007 ceph-mon[27906]: osdmap e112: 12 total, 12 up, 12 in 2024-04-23T15:07:11.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:11 smithi007 ceph-mon[27906]: pgmap v496: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-04-23T15:07:11.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:11 smithi186 ceph-mon[31814]: osdmap e112: 12 total, 12 up, 12 in 2024-04-23T15:07:11.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:11 smithi186 ceph-mon[31814]: pgmap v496: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-04-23T15:07:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:11 smithi137 ceph-mon[31694]: osdmap e112: 12 total, 12 up, 12 in 2024-04-23T15:07:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:11 smithi137 ceph-mon[31694]: pgmap v496: 129 pgs: 129 active+clean; 3.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.0 MiB/s wr, 13 op/s 2024-04-23T15:07:14.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:13 smithi007 ceph-mon[27906]: pgmap v497: 129 pgs: 129 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:07:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:13 smithi186 ceph-mon[31814]: pgmap v497: 129 pgs: 129 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:07:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:13 smithi137 ceph-mon[31694]: pgmap v497: 129 pgs: 129 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:07:16.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:15 smithi007 ceph-mon[27906]: pgmap v498: 129 pgs: 129 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:07:16.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:15 smithi186 ceph-mon[31814]: pgmap v498: 129 pgs: 129 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:07:16.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:15 smithi137 ceph-mon[31694]: pgmap v498: 129 pgs: 129 active+clean; 3.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 -- 172.21.15.7:0/1104472549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8100f60 msgr2=0x7f18b8101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 --2- 172.21.15.7:0/1104472549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8100f60 0x7f18b8101340 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009900 tx=0x7f18a802a410 comp rx=0 tx=0).stop 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 -- 172.21.15.7:0/1104472549 shutdown_connections 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 --2- 172.21.15.7:0/1104472549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18b8101910 0x7f18b8105950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 --2- 172.21.15.7:0/1104472549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8106030 0x7f18b810dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 --2- 172.21.15.7:0/1104472549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8100f60 0x7f18b8101340 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 -- 172.21.15.7:0/1104472549 >> 172.21.15.7:0/1104472549 conn(0x7f18b80fc820 msgr2=0x7f18b80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 -- 172.21.15.7:0/1104472549 shutdown_connections 2024-04-23T15:07:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.690+0000 7f18b7e00640 1 -- 172.21.15.7:0/1104472549 wait complete. 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 Processor -- start 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 -- start start 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8100f60 0x7f18b81029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 0x7f18b8102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18b8103470 0x7f18b81a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8110fc0 con 0x7f18b8106030 2024-04-23T15:07:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8110e40 con 0x7f18b8103470 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.691+0000 7f18b7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8111140 con 0x7f18b8100f60 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 0x7f18b8102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 0x7f18b8102f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47594/0 (socket says 172.21.15.7:47594) 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 -- 172.21.15.7:0/3670227137 learned_addr learned my addr 172.21.15.7:0/3670227137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6a00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8100f60 0x7f18b81029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b7400640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18b8103470 0x7f18b81a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 -- 172.21.15.7:0/3670227137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8100f60 msgr2=0x7f18b81029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8100f60 0x7f18b81029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 -- 172.21.15.7:0/3670227137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18b8103470 msgr2=0x7f18b81a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18b8103470 0x7f18b81a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6000640 1 -- 172.21.15.7:0/3670227137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b81a6f60 con 0x7f18b8106030 2024-04-23T15:07:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.692+0000 7f18b6a00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8100f60 0x7f18b81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.693+0000 7f18b6000640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 0x7f18b8102f30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f18a000d770 tx=0x7f18a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.693+0000 7f18af400640 1 -- 172.21.15.7:0/3670227137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0017070 con 0x7f18b8106030 2024-04-23T15:07:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.693+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b81a7250 con 0x7f18b8106030 2024-04-23T15:07:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.693+0000 7f18af400640 1 -- 172.21.15.7:0/3670227137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18a0009c30 con 0x7f18b8106030 2024-04-23T15:07:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.693+0000 7f18af400640 1 -- 172.21.15.7:0/3670227137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a000f620 con 0x7f18b8106030 2024-04-23T15:07:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.693+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b81a77a0 con 0x7f18b8106030 2024-04-23T15:07:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.697+0000 7f18af400640 1 -- 172.21.15.7:0/3670227137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f18a001a070 con 0x7f18b8106030 2024-04-23T15:07:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.697+0000 7f18c0425740 1 Processor -- start 2024-04-23T15:07:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 -- start start 2024-04-23T15:07:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9b1ce0 0x55743d9bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 0x55743d9be990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55743d917900 con 0x55743d9bc5a0 2024-04-23T15:07:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55743d8bdf20 con 0x55743d9b13c0 2024-04-23T15:07:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18c0425740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55743d9138c0 con 0x55743d9b1ce0 2024-04-23T15:07:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 0x55743d9be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 0x55743d9be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47598/0 (socket says 172.21.15.7:47598) 2024-04-23T15:07:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.698+0000 7f18b6000640 1 -- 172.21.15.7:0/2228640523 learned_addr learned my addr 172.21.15.7:0/2228640523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b6a00640 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9b1ce0 0x55743d9bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b7400640 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b6000640 1 -- 172.21.15.7:0/2228640523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9b1ce0 msgr2=0x55743d9bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b6000640 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9b1ce0 0x55743d9bc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b6000640 1 -- 172.21.15.7:0/2228640523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 msgr2=0x55743d9b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b6000640 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.699+0000 7f18b6000640 1 -- 172.21.15.7:0/2228640523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743d8e2e10 con 0x55743d9bc5a0 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18af400640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f189c0a3d40 0x7f189c0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18b6000640 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 0x55743d9be990 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f18a00cda40 tx=0x7f18a00d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0595af0b382bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18af400640 1 -- 172.21.15.7:0/3670227137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f18a00d07c0 con 0x7f18b8106030 2024-04-23T15:07:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18b7400640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f189c0a3d40 0x7f189c0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18a7400640 1 -- 172.21.15.7:0/2228640523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0021030 con 0x55743d9bc5a0 2024-04-23T15:07:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18a7400640 1 -- 172.21.15.7:0/2228640523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18a009ca50 con 0x55743d9bc5a0 2024-04-23T15:07:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.700+0000 7f18a7400640 1 -- 172.21.15.7:0/2228640523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a009c120 con 0x55743d9bc5a0 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 -- 172.21.15.7:0/2228640523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 msgr2=0x55743d9be990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 0x55743d9be990 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f18a00cda40 tx=0x7f18a00d8670 comp rx=0 tx=0).stop 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18b7400640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f189c0a3d40 0x7f189c0a6200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005fd0 tx=0x7f18b00096e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 -- 172.21.15.7:0/2228640523 shutdown_connections 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9bc5a0 0x55743d9be990 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9b1ce0 0x55743d9bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 --2- 172.21.15.7:0/2228640523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.701+0000 7f18c0425740 1 -- 172.21.15.7:0/2228640523 >> 172.21.15.7:0/2228640523 conn(0x55743d9ad8d0 msgr2=0x55743d9adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.702+0000 7f18c0425740 1 -- 172.21.15.7:0/2228640523 shutdown_connections 2024-04-23T15:07:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.702+0000 7f18c0425740 1 -- 172.21.15.7:0/2228640523 wait complete. 2024-04-23T15:07:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.702+0000 7f18c0425740 1 -- start start 2024-04-23T15:07:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.702+0000 7f18c0425740 1 Processor -- start 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 0x55743d9b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b1ce0 0x55743d9b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55743d9bf080 con 0x55743d9b13c0 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55743d8d12c0 con 0x55743d9b1ce0 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55743d9bf200 con 0x55743d9bc5a0 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18c0425740 10 client.0 _ll_register_callbacks cb 0x55743d629a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 0x55743d9b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 0x55743d9b95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47612/0 (socket says 172.21.15.7:47612) 2024-04-23T15:07:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.703+0000 7f18b6a00640 1 -- 172.21.15.7:0/1894658556 learned_addr learned my addr 172.21.15.7:0/1894658556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b7400640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6000640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b1ce0 0x55743d9b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6a00640 1 -- 172.21.15.7:0/1894658556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 msgr2=0x55743d9ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6a00640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9ba030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6a00640 1 -- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b1ce0 msgr2=0x55743d9b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6a00640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b1ce0 0x55743d9b9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6a00640 1 -- 172.21.15.7:0/1894658556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743d8e1fd0 con 0x55743d9b13c0 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f18b6a00640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 0x55743d9b95b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009230 tx=0x7f18a80052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7587f6328c83b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.704+0000 7f189be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f189be00640 1 -- 172.21.15.7:0/1894658556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8035040 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f189be00640 1 -- 172.21.15.7:0/1894658556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f18a80048c0 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a009ca50 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f189be00640 1 -- 172.21.15.7:0/1894658556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f18a8004ac0 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f18c0425740 10 client.16929 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55743d62a210 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.705+0000 7f189be00640 1 -- 172.21.15.7:0/1894658556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18a009ca50 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f189be00640 1 -- 172.21.15.7:0/1894658556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f18a80314a0 con 0x55743d9b13c0 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18c0425740 10 client.16929 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18c0425740 10 client.16929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18c0425740 20 client.16929 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18c0425740 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743d9cc730 0x55743d9ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18c0425740 4 client.16929 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55743d925320 con 0x55743d9cc730 2024-04-23T15:07:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.706+0000 7f18b6000640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743d9cc730 0x55743d9ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.707+0000 7f18b6000640 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743d9cc730 0x55743d9ceb60 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33f5004ae3f92f46 server_cookie=9225ccc396b79c77 in_seq=0 out_seq=0 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.707+0000 7f189be00640 10 client.16929 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.709+0000 7f189be00640 1 -- 172.21.15.7:0/1894658556 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55743d925320 con 0x55743d9cc730 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.709+0000 7f189be00640 10 client.16929 handle_command_reply: tid=0 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.709+0000 7f18c0425740 1 client.16929 shutdown 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.709+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 msgr2=0x55743d9b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.709+0000 7f18c0425740 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 0x55743d9b95b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009230 tx=0x7f18a80052e0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 shutdown_connections 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743d9cc730 0x55743d9ceb60 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b1ce0 0x55743d9b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 --2- 172.21.15.7:0/1894658556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b13c0 0x55743d9b95b0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 >> 172.21.15.7:0/1894658556 conn(0x55743d9ad8d0 msgr2=0x55743d9aca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f189be00640 0 client.16929 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 shutdown_connections 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 1 -- 172.21.15.7:0/1894658556 wait complete. 2024-04-23T15:07:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.710+0000 7f18c0425740 20 client.16929 trim_cache size 0 max 16384 2024-04-23T15:07:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 Processor -- start 2024-04-23T15:07:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 -- start start 2024-04-23T15:07:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9c8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9d4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b14b0 con 0x55743d9b1ce0 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b2ff0 con 0x55743d9b13c0 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.730+0000 7f18c0425740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b1b80 con 0x55743d9bc5a0 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47624/0 (socket says 172.21.15.7:47624) 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 -- 172.21.15.7:0/2886857675 learned_addr learned my addr 172.21.15.7:0/2886857675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6a00640 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b7400640 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9d4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 -- 172.21.15.7:0/2886857675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 msgr2=0x55743d9d4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9d4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 -- 172.21.15.7:0/2886857675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 msgr2=0x55743d9ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.731+0000 7f18b6000640 1 -- 172.21.15.7:0/2886857675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743d9bed00 con 0x55743d9b1ce0 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.732+0000 7f18b6000640 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9c8030 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f18a000d740 tx=0x7f18a00d8c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d153b6365afc80 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.732+0000 7f18a6a00640 1 -- 172.21.15.7:0/2886857675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0081ae0 con 0x55743d9b1ce0 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.732+0000 7f18a6a00640 1 -- 172.21.15.7:0/2886857675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18a009ca50 con 0x55743d9b1ce0 2024-04-23T15:07:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.732+0000 7f18a6a00640 1 -- 172.21.15.7:0/2886857675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0021040 con 0x55743d9b1ce0 2024-04-23T15:07:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 -- 172.21.15.7:0/2886857675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 msgr2=0x55743d9c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9c8030 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f18a000d740 tx=0x7f18a00d8c20 comp rx=0 tx=0).stop 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 -- 172.21.15.7:0/2886857675 shutdown_connections 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743d9d4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9c8030 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 --2- 172.21.15.7:0/2886857675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 -- 172.21.15.7:0/2886857675 >> 172.21.15.7:0/2886857675 conn(0x55743d9ad8d0 msgr2=0x55743d9b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 -- 172.21.15.7:0/2886857675 shutdown_connections 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.733+0000 7f18c0425740 1 -- 172.21.15.7:0/2886857675 wait complete. 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 -- start start 2024-04-23T15:07:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 Processor -- start 2024-04-23T15:07:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743da31ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b2920 con 0x55743d9b1ce0 2024-04-23T15:07:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b2250 con 0x55743d9b13c0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.734+0000 7f18c0425740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81af4b0 con 0x55743d9bc5a0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18c0425740 10 client.0 _ll_register_callbacks cb 0x7f18a8004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47636/0 (socket says 172.21.15.7:47636) 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 -- 172.21.15.7:0/2969462120 learned_addr learned my addr 172.21.15.7:0/2969462120 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b7400640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743da31ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6a00640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 -- 172.21.15.7:0/2969462120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 msgr2=0x55743da31ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743da31ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 -- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 msgr2=0x55743d9b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6000640 1 -- 172.21.15.7:0/2969462120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743d6f6620 con 0x55743d9b1ce0 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b6a00640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:07:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.735+0000 7f18b7400640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743da31ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f18b6000640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9b6ef0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f18a0000c00 tx=0x7f18a0010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87671f0ee8b5fdc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f189be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f189be00640 1 -- 172.21.15.7:0/2969462120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a00ba060 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f189be00640 1 -- 172.21.15.7:0/2969462120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f18a009a650 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a009ca50 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f189be00640 1 -- 172.21.15.7:0/2969462120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f18a0021070 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f18c0425740 10 client.16935 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.736+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55743da332d0 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f189be00640 1 -- 172.21.15.7:0/2969462120 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18a009ca50 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f189be00640 1 -- 172.21.15.7:0/2969462120 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f18a00d6cb0 con 0x55743d9b1ce0 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18c0425740 10 client.16935 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18c0425740 10 client.16935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18c0425740 20 client.16935 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18c0425740 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743da335f0 0x55743da359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18c0425740 4 client.16935 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:07:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55743d91f190 con 0x55743da335f0 2024-04-23T15:07:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.737+0000 7f18b6a00640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743da335f0 0x55743da359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.738+0000 7f18b6a00640 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743da335f0 0x55743da359e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16d1022d0c880110 server_cookie=784f59a6e1d222ed in_seq=0 out_seq=0 2024-04-23T15:07:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.738+0000 7f189be00640 10 client.16935 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f189be00640 1 -- 172.21.15.7:0/2969462120 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55743d91f190 con 0x55743da335f0 2024-04-23T15:07:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f189be00640 10 client.16935 handle_command_reply: tid=0 2024-04-23T15:07:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 client.16935 shutdown 2024-04-23T15:07:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 msgr2=0x55743d9b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9b6ef0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f18a0000c00 tx=0x7f18a0010f90 comp rx=0 tx=0).stop 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 shutdown_connections 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55743da335f0 0x55743da359e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55743d9bc5a0 0x55743da31ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55743d9b1ce0 0x55743d9b6ef0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 --2- 172.21.15.7:0/2969462120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55743d9b13c0 0x55743d9b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f189be00640 0 client.16935 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.781+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 >> 172.21.15.7:0/2969462120 conn(0x55743d9ad8d0 msgr2=0x55743d9b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.782+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 shutdown_connections 2024-04-23T15:07:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.782+0000 7f18c0425740 1 -- 172.21.15.7:0/2969462120 wait complete. 2024-04-23T15:07:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.782+0000 7f18c0425740 20 client.16935 trim_cache size 0 max 16384 2024-04-23T15:07:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:07:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:07:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:07:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f189c0a3d40 msgr2=0x7f189c0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f189c0a3d40 0x7f189c0a6200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005fd0 tx=0x7f18b00096e0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 msgr2=0x7f18b8102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 0x7f18b8102f30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f18a000d770 tx=0x7f18a000dc30 comp rx=0 tx=0).stop 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 shutdown_connections 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f189c0a3d40 0x7f189c0a6200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18b8103470 0x7f18b81a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b8106030 0x7f18b8102f30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 --2- 172.21.15.7:0/3670227137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18b8100f60 0x7f18b81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 >> 172.21.15.7:0/3670227137 conn(0x7f18b80fc820 msgr2=0x7f18b8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 shutdown_connections 2024-04-23T15:07:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:17.783+0000 7f18b7e00640 1 -- 172.21.15.7:0/3670227137 wait complete. 2024-04-23T15:07:18.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:17 smithi007 ceph-mon[27906]: pgmap v499: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:07:18.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:17 smithi186 ceph-mon[31814]: pgmap v499: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:07:18.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:17 smithi137 ceph-mon[31694]: pgmap v499: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:07:20.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:19 smithi007 ceph-mon[27906]: pgmap v500: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:07:20.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:19 smithi186 ceph-mon[31814]: pgmap v500: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:07:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:19 smithi137 ceph-mon[31694]: pgmap v500: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:07:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:21 smithi007 ceph-mon[27906]: pgmap v501: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-04-23T15:07:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:21 smithi186 ceph-mon[31814]: pgmap v501: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-04-23T15:07:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:21 smithi137 ceph-mon[31694]: pgmap v501: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 11 op/s 2024-04-23T15:07:23.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:22 smithi007 ceph-mon[27906]: pgmap v502: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:07:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:22 smithi186 ceph-mon[31814]: pgmap v502: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:07:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:22 smithi137 ceph-mon[31694]: pgmap v502: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:07:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:25 smithi007 ceph-mon[27906]: pgmap v503: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:07:26.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:25 smithi186 ceph-mon[31814]: pgmap v503: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:07:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:25 smithi137 ceph-mon[31694]: pgmap v503: 129 pgs: 129 active+clean; 3.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:07:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:27 smithi007 ceph-mon[27906]: pgmap v504: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:28.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:27 smithi186 ceph-mon[31814]: pgmap v504: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:28.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:27 smithi137 ceph-mon[31694]: pgmap v504: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:30.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:29 smithi007 ceph-mon[27906]: pgmap v505: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:30.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:29 smithi186 ceph-mon[31814]: pgmap v505: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:30.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:29 smithi137 ceph-mon[31694]: pgmap v505: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 -- 172.21.15.7:0/539305558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc4101580 msgr2=0x7fbdc410e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/539305558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc4101580 0x7fbdc410e1b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009900 tx=0x7fbdb002a410 comp rx=0 tx=0).stop 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 -- 172.21.15.7:0/539305558 shutdown_connections 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/539305558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc410e780 0x7fbdc4110b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/539305558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc4101580 0x7fbdc410e1b0 secure :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009900 tx=0x7fbdb002a410 comp rx=0 tx=0).stop 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/539305558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 0x7fbdc4100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 -- 172.21.15.7:0/539305558 >> 172.21.15.7:0/539305558 conn(0x7fbdc40fc820 msgr2=0x7fbdc40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 -- 172.21.15.7:0/539305558 shutdown_connections 2024-04-23T15:07:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.941+0000 7fbdc3e00640 1 -- 172.21.15.7:0/539305558 wait complete. 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.942+0000 7fbdc3e00640 1 Processor -- start 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 -- start start 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 0x7fbdc41a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 0x7fbdc41a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc419a960 0x7fbdc419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4114390 con 0x7fbdc410e780 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4114210 con 0x7fbdc4100bd0 2024-04-23T15:07:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.943+0000 7fbdc3e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4114510 con 0x7fbdc419a960 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 0x7fbdc41a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 0x7fbdc41a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc419a960 0x7fbdc419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 0x7fbdc41a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40052/0 (socket says 172.21.15.7:40052) 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 0x7fbdc41a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45870/0 (socket says 172.21.15.7:45870) 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc2000640 1 -- 172.21.15.7:0/2343533868 learned_addr learned my addr 172.21.15.7:0/2343533868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.944+0000 7fbdc3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc419a960 0x7fbdc419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59198/0 (socket says 172.21.15.7:59198) 2024-04-23T15:07:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.945+0000 7fbdc2000640 1 -- 172.21.15.7:0/2343533868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc419a960 msgr2=0x7fbdc419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.945+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc419a960 0x7fbdc419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.945+0000 7fbdc2000640 1 -- 172.21.15.7:0/2343533868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 msgr2=0x7fbdc41a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.945+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 0x7fbdc41a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.945+0000 7fbdc2000640 1 -- 172.21.15.7:0/2343533868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc419b480 con 0x7fbdc410e780 2024-04-23T15:07:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.945+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 0x7fbdc41a0ca0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbdb002aa00 tx=0x7fbdb0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.946+0000 7fbdc8a00640 1 -- 172.21.15.7:0/2343533868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb003f020 con 0x7fbdc410e780 2024-04-23T15:07:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.946+0000 7fbdc8a00640 1 -- 172.21.15.7:0/2343533868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdb0031d60 con 0x7fbdc410e780 2024-04-23T15:07:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.946+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc419b710 con 0x7fbdc410e780 2024-04-23T15:07:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.946+0000 7fbdc8a00640 1 -- 172.21.15.7:0/2343533868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0035070 con 0x7fbdc410e780 2024-04-23T15:07:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.946+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc4102f90 con 0x7fbdc410e780 2024-04-23T15:07:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.951+0000 7fbdccc57740 1 Processor -- start 2024-04-23T15:07:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.951+0000 7fbdccc57740 1 -- start start 2024-04-23T15:07:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdc8a00640 1 -- 172.21.15.7:0/2343533868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbdb0042020 con 0x7fbdc410e780 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212d3c0 0x5646d212d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 0x5646d2138060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d213a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdccc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5646d2093900 con 0x5646d212dce0 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdccc57740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5646d2039f20 con 0x5646d212d3c0 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdccc57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5646d208f8c0 con 0x5646d21385a0 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 0x5646d2138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 0x5646d2138060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40062/0 (socket says 172.21.15.7:40062) 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.952+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2675765698 learned_addr learned my addr 172.21.15.7:0/2675765698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212d3c0 0x5646d212d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d213a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2675765698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 msgr2=0x5646d213a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d213a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2675765698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212d3c0 msgr2=0x5646d212d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212d3c0 0x5646d212d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2675765698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d205ee10 con 0x5646d212dce0 2024-04-23T15:07:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212d3c0 0x5646d212d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.953+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 0x5646d2138060 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4016490 tx=0x7fbdb4011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16026f451ba4d12c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.954+0000 7fbdafe00640 1 -- 172.21.15.7:0/2675765698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40114e0 con 0x5646d212dce0 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.954+0000 7fbdc8a00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbda80a3ee0 0x7fbda80a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.954+0000 7fbdafe00640 1 -- 172.21.15.7:0/2675765698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdb4021070 con 0x5646d212dce0 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.954+0000 7fbdafe00640 1 -- 172.21.15.7:0/2675765698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb401ca80 con 0x5646d212dce0 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.954+0000 7fbdc8a00640 1 -- 172.21.15.7:0/2343533868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7fbdb00f1380 con 0x7fbdc410e780 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.954+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbda80a3ee0 0x7fbda80a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 -- 172.21.15.7:0/2675765698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 msgr2=0x5646d2138060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 0x5646d2138060 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4016490 tx=0x7fbdb4011920 comp rx=0 tx=0).stop 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 -- 172.21.15.7:0/2675765698 shutdown_connections 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d213a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212dce0 0x5646d2138060 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2675765698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212d3c0 0x5646d212d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 -- 172.21.15.7:0/2675765698 >> 172.21.15.7:0/2675765698 conn(0x5646d21298d0 msgr2=0x5646d2129cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 -- 172.21.15.7:0/2675765698 shutdown_connections 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbda80a3ee0 0x7fbda80a63a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdc406b5e0 tx=0x7fbdbc009600 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.955+0000 7fbdccc57740 1 -- 172.21.15.7:0/2675765698 wait complete. 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.956+0000 7fbdccc57740 1 -- start start 2024-04-23T15:07:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.956+0000 7fbdccc57740 1 Processor -- start 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d21355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2136020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5646d213b1d0 con 0x5646d212d3c0 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5646d204d2c0 con 0x5646d212dce0 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5646d213b350 con 0x5646d21385a0 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdccc57740 10 client.0 _ll_register_callbacks cb 0x5646d1da5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d21355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d21355a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40078/0 (socket says 172.21.15.7:40078) 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2193929744 learned_addr learned my addr 172.21.15.7:0/2193929744 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.957+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2193929744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 msgr2=0x5646d2136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 msgr2=0x5646d2135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2135ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2193929744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d205dfd0 con 0x5646d212d3c0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d21355a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4006a80 tx=0x7fbdb4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfbda2781731b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdacc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdacc00640 1 -- 172.21.15.7:0/2193929744 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4029070 con 0x5646d212d3c0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdacc00640 1 -- 172.21.15.7:0/2193929744 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7fbdb400fc60 con 0x5646d212d3c0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.958+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb4021070 con 0x5646d212d3c0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdacc00640 1 -- 172.21.15.7:0/2193929744 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbdb4036050 con 0x5646d212d3c0 2024-04-23T15:07:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 10 client.16947 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5646d1da6210 con 0x5646d212d3c0 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdacc00640 1 -- 172.21.15.7:0/2193929744 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdb4021070 con 0x5646d212d3c0 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdacc00640 1 -- 172.21.15.7:0/2193929744 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbdb4006040 con 0x5646d212d3c0 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 10 client.16947 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 10 client.16947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 20 client.16947 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21486e0 0x5646d214aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 4 client.16947 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.959+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646d20a1320 con 0x5646d21486e0 2024-04-23T15:07:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.960+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21486e0 0x5646d214aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.961+0000 7fbdacc00640 10 client.16947 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.961+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21486e0 0x5646d214aad0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a11f1f397ffd6de server_cookie=4e9389d3b62e68d5 in_seq=0 out_seq=0 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdacc00640 1 -- 172.21.15.7:0/2193929744 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5646d20a1320 con 0x5646d21486e0 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdacc00640 10 client.16947 handle_command_reply: tid=0 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 client.16947 shutdown 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 msgr2=0x5646d21355a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d21355a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4006a80 tx=0x7fbdb4005c70 comp rx=0 tx=0).stop 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 shutdown_connections 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21486e0 0x5646d214aad0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2193929744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d21355a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 >> 172.21.15.7:0/2193929744 conn(0x5646d21298d0 msgr2=0x5646d212f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdacc00640 0 client.16947 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 shutdown_connections 2024-04-23T15:07:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.963+0000 7fbdccc57740 1 -- 172.21.15.7:0/2193929744 wait complete. 2024-04-23T15:07:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.964+0000 7fbdccc57740 20 client.16947 trim_cache size 0 max 16384 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 Processor -- start 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 -- start start 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d212d3c0 0x5646d2144090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2150100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 0x5646d2150640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41ad600 con 0x5646d21385a0 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41af140 con 0x5646d212dce0 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.980+0000 7fbdccc57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41adcd0 con 0x5646d212d3c0 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 0x5646d2150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 0x5646d2150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40088/0 (socket says 172.21.15.7:40088) 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 -- 172.21.15.7:0/1619861805 learned_addr learned my addr 172.21.15.7:0/1619861805 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d212d3c0 0x5646d2144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc2000640 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 -- 172.21.15.7:0/1619861805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d212d3c0 msgr2=0x5646d2144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d212d3c0 0x5646d2144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 -- 172.21.15.7:0/1619861805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 msgr2=0x5646d2150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.981+0000 7fbdc3400640 1 -- 172.21.15.7:0/1619861805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d1e72620 con 0x5646d21385a0 2024-04-23T15:07:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.982+0000 7fbdc3400640 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 0x5646d2150640 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc003b00 tx=0x7fbdbc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9d21362b6aefbf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.982+0000 7fbdaf400640 1 -- 172.21.15.7:0/1619861805 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004600 con 0x5646d21385a0 2024-04-23T15:07:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.982+0000 7fbdaf400640 1 -- 172.21.15.7:0/1619861805 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdbc0047a0 con 0x5646d21385a0 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.982+0000 7fbdaf400640 1 -- 172.21.15.7:0/1619861805 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0059b0 con 0x5646d21385a0 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 -- 172.21.15.7:0/1619861805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 msgr2=0x5646d2150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 0x5646d2150640 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc003b00 tx=0x7fbdbc015000 comp rx=0 tx=0).stop 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 -- 172.21.15.7:0/1619861805 shutdown_connections 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d2150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d21385a0 0x5646d2150640 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 --2- 172.21.15.7:0/1619861805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d212d3c0 0x5646d2144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 -- 172.21.15.7:0/1619861805 >> 172.21.15.7:0/1619861805 conn(0x5646d21298d0 msgr2=0x5646d21308c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 -- 172.21.15.7:0/1619861805 shutdown_connections 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.983+0000 7fbdccc57740 1 -- 172.21.15.7:0/1619861805 wait complete. 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 -- start start 2024-04-23T15:07:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 Processor -- start 2024-04-23T15:07:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d2132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d21326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2132c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41aea70 con 0x5646d212d3c0 2024-04-23T15:07:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41ae3a0 con 0x5646d212dce0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41ab600 con 0x5646d21385a0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.984+0000 7fbdccc57740 10 client.0 _ll_register_callbacks cb 0x7fbdb4016360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d2132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d2132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40098/0 (socket says 172.21.15.7:40098) 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2840793950 learned_addr learned my addr 172.21.15.7:0/2840793950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d21326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2132c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2840793950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 msgr2=0x5646d2132c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2132c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 msgr2=0x5646d21326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d21326d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 -- 172.21.15.7:0/2840793950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d21ad970 con 0x5646d212d3c0 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc3400640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2132c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:07:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d21326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdc2a00640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d2132190 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4004700 tx=0x7fbdb4006de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108cf290e8dea38b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.985+0000 7fbdacc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdacc00640 1 -- 172.21.15.7:0/2840793950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb403e020 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdacc00640 1 -- 172.21.15.7:0/2840793950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7fbdb4006680 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdbc0047a0 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdacc00640 1 -- 172.21.15.7:0/2840793950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbdb4049050 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdccc57740 10 client.16953 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5646d21aeb80 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.986+0000 7fbdacc00640 1 -- 172.21.15.7:0/2840793950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdbc0047a0 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdacc00640 1 -- 172.21.15.7:0/2840793950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbdb4005f50 con 0x5646d212d3c0 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdccc57740 10 client.16953 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdccc57740 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdccc57740 20 client.16953 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21af2f0 0x5646d21b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdccc57740 4 client.16953 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:07:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5646d209b190 con 0x5646d21af2f0 2024-04-23T15:07:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.987+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21af2f0 0x5646d21b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.988+0000 7fbdc2000640 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21af2f0 0x5646d21b1710 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54cdf089659f41d5 server_cookie=ea93063d0ab7999 in_seq=0 out_seq=0 2024-04-23T15:07:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:30.988+0000 7fbdacc00640 10 client.16953 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:31.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdacc00640 1 -- 172.21.15.7:0/2840793950 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5646d209b190 con 0x5646d21af2f0 2024-04-23T15:07:31.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdacc00640 10 client.16953 handle_command_reply: tid=0 2024-04-23T15:07:31.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 client.16953 shutdown 2024-04-23T15:07:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 msgr2=0x5646d2132190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d2132190 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4004700 tx=0x7fbdb4006de0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 shutdown_connections 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5646d21af2f0 0x5646d21b1710 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d212dce0 0x5646d21326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646d21385a0 0x5646d2132c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 --2- 172.21.15.7:0/2840793950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5646d212d3c0 0x5646d2132190 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdacc00640 0 client.16953 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 >> 172.21.15.7:0/2840793950 conn(0x5646d21298d0 msgr2=0x5646d2128200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 shutdown_connections 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.021+0000 7fbdccc57740 1 -- 172.21.15.7:0/2840793950 wait complete. 2024-04-23T15:07:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.022+0000 7fbdccc57740 20 client.16953 trim_cache size 0 max 16384 2024-04-23T15:07:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:07:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:07:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:07:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.022+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbda80a3ee0 msgr2=0x7fbda80a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.022+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbda80a3ee0 0x7fbda80a63a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdc406b5e0 tx=0x7fbdbc009600 comp rx=0 tx=0).stop 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.022+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 msgr2=0x7fbdc41a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.022+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 0x7fbdc41a0ca0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbdb002aa00 tx=0x7fbdb0003cd0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 shutdown_connections 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbda80a3ee0 0x7fbda80a63a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdc419a960 0x7fbdc419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdc410e780 0x7fbdc41a0ca0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/2343533868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdc4100bd0 0x7fbdc41a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 >> 172.21.15.7:0/2343533868 conn(0x7fbdc40fc820 msgr2=0x7fbdc40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 shutdown_connections 2024-04-23T15:07:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:31.023+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2343533868 wait complete. 2024-04-23T15:07:32.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:31 smithi007 ceph-mon[27906]: pgmap v506: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:31 smithi186 ceph-mon[31814]: pgmap v506: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:31 smithi137 ceph-mon[31694]: pgmap v506: 129 pgs: 129 active+clean; 3.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:33.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:32 smithi007 ceph-mon[27906]: pgmap v507: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:07:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:32 smithi186 ceph-mon[31814]: pgmap v507: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:07:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:32 smithi137 ceph-mon[31694]: pgmap v507: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:07:36.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:35 smithi007 ceph-mon[27906]: pgmap v508: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:36.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:35 smithi186 ceph-mon[31814]: pgmap v508: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:36.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:35 smithi137 ceph-mon[31694]: pgmap v508: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:38.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:37 smithi007 ceph-mon[27906]: pgmap v509: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:38.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:37 smithi186 ceph-mon[31814]: pgmap v509: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:38.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:37 smithi137 ceph-mon[31694]: pgmap v509: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:40.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:39 smithi007 ceph-mon[27906]: pgmap v510: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:40.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:39 smithi186 ceph-mon[31814]: pgmap v510: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:40.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:39 smithi137 ceph-mon[31694]: pgmap v510: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:41.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:40 smithi186 ceph-mon[31814]: pgmap v511: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:40 smithi137 ceph-mon[31694]: pgmap v511: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:41.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:40 smithi007 ceph-mon[27906]: pgmap v511: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:07:44.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:43 smithi007 ceph-mon[27906]: pgmap v512: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:44.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:43 smithi186 ceph-mon[31814]: pgmap v512: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:44.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:43 smithi137 ceph-mon[31694]: pgmap v512: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 -- 172.21.15.7:0/3522683648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 msgr2=0x7f6068074810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 --2- 172.21.15.7:0/3522683648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f6068074810 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f605c009900 tx=0x7f605c02a490 comp rx=0 tx=0).stop 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 -- 172.21.15.7:0/3522683648 shutdown_connections 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 --2- 172.21.15.7:0/3522683648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6068074d50 0x7f606810e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 --2- 172.21.15.7:0/3522683648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f606810e820 0x7f6068110c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 --2- 172.21.15.7:0/3522683648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f6068074810 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 -- 172.21.15.7:0/3522683648 >> 172.21.15.7:0/3522683648 conn(0x7f60680fdab0 msgr2=0x7f60680ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 -- 172.21.15.7:0/3522683648 shutdown_connections 2024-04-23T15:07:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.193+0000 7f6070800640 1 -- 172.21.15.7:0/3522683648 wait complete. 2024-04-23T15:07:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 Processor -- start 2024-04-23T15:07:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 -- start start 2024-04-23T15:07:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f60681a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6068074d50 0x7f60681a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606810e820 0x7f606819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6068114450 con 0x7f6068074430 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60681142d0 con 0x7f606810e820 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.195+0000 7f6070800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f60681145d0 con 0x7f6068074d50 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f60681a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f60681a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50366/0 (socket says 172.21.15.7:50366) 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 -- 172.21.15.7:0/3278255067 learned_addr learned my addr 172.21.15.7:0/3278255067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606e800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606810e820 0x7f606819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606d400640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6068074d50 0x7f60681a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 -- 172.21.15.7:0/3278255067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6068074d50 msgr2=0x7f60681a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6068074d50 0x7f60681a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 -- 172.21.15.7:0/3278255067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606810e820 msgr2=0x7f606819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606810e820 0x7f606819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606de00640 1 -- 172.21.15.7:0/3278255067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606819b010 con 0x7f6068074430 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.196+0000 7f606e800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606810e820 0x7f606819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.197+0000 7f606de00640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f60681a0690 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f605c005940 tx=0x7f605c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.197+0000 7f6062a00640 1 -- 172.21.15.7:0/3278255067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c03f030 con 0x7f6068074430 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.197+0000 7f6062a00640 1 -- 172.21.15.7:0/3278255067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f605c003aa0 con 0x7f6068074430 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.197+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606819b2a0 con 0x7f6068074430 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.197+0000 7f6062a00640 1 -- 172.21.15.7:0/3278255067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c035070 con 0x7f6068074430 2024-04-23T15:07:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.197+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681a7610 con 0x7f6068074430 2024-04-23T15:07:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 Processor -- start 2024-04-23T15:07:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 -- start start 2024-04-23T15:07:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf3b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3bad0 0x560abaf45e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf46390 0x560abaf48780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560abaea1900 con 0x560abaf3b1b0 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560abae47f20 con 0x560abaf3bad0 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f60735c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560abae9d8c0 con 0x560abaf46390 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.201+0000 7f6062a00640 1 -- 172.21.15.7:0/3278255067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f605c042030 con 0x7f6068074430 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf3b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf3b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50380/0 (socket says 172.21.15.7:50380) 2024-04-23T15:07:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 -- 172.21.15.7:0/175201087 learned_addr learned my addr 172.21.15.7:0/175201087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 -- 172.21.15.7:0/175201087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf46390 msgr2=0x560abaf48780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf46390 0x560abaf48780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 -- 172.21.15.7:0/175201087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3bad0 msgr2=0x560abaf45e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3bad0 0x560abaf45e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.202+0000 7f606e800640 1 -- 172.21.15.7:0/175201087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abae6ce10 con 0x560abaf3b1b0 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.203+0000 7f606e800640 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf3b590 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6064007e60 tx=0x7f606400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c50d2a18b3f8ac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.203+0000 7f6057000640 1 -- 172.21.15.7:0/175201087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064014070 con 0x560abaf3b1b0 2024-04-23T15:07:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.203+0000 7f6057000640 1 -- 172.21.15.7:0/175201087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6064004d20 con 0x560abaf3b1b0 2024-04-23T15:07:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.203+0000 7f6057000640 1 -- 172.21.15.7:0/175201087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60640053e0 con 0x560abaf3b1b0 2024-04-23T15:07:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.203+0000 7f6062a00640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f60500a3e40 0x7f60500a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f6062a00640 1 -- 172.21.15.7:0/3278255067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f605c0f13d0 con 0x7f6068074430 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f606de00640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f60500a3e40 0x7f60500a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 -- 172.21.15.7:0/175201087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 msgr2=0x560abaf3b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf3b590 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6064007e60 tx=0x7f606400e720 comp rx=0 tx=0).stop 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 -- 172.21.15.7:0/175201087 shutdown_connections 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3bad0 0x560abaf45e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf46390 0x560abaf48780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 --2- 172.21.15.7:0/175201087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf3b590 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.204+0000 7f60735c2740 1 -- 172.21.15.7:0/175201087 >> 172.21.15.7:0/175201087 conn(0x560abaf376c0 msgr2=0x560abaf37aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.205+0000 7f60735c2740 1 -- 172.21.15.7:0/175201087 shutdown_connections 2024-04-23T15:07:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.205+0000 7f60735c2740 1 -- 172.21.15.7:0/175201087 wait complete. 2024-04-23T15:07:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.205+0000 7f606de00640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f60500a3e40 0x7f60500a6300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x560abaf3c750 tx=0x7f605c009230 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.205+0000 7f60735c2740 1 -- start start 2024-04-23T15:07:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.205+0000 7f60735c2740 1 Processor -- start 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf43340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf43880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 0x560abaf43dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560abaf48fc0 con 0x560abaf3b1b0 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560abae5b2c0 con 0x560abaf46390 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560abaf49140 con 0x560abaf3bad0 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f60735c2740 10 client.0 _ll_register_callbacks cb 0x560ababb3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f606e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf43340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f606e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf43340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50390/0 (socket says 172.21.15.7:50390) 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.206+0000 7f606e800640 1 -- 172.21.15.7:0/4275870050 learned_addr learned my addr 172.21.15.7:0/4275870050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606d400640 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf43880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606e800640 1 -- 172.21.15.7:0/4275870050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 msgr2=0x560abaf43880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606e800640 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf43880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606e800640 1 -- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 msgr2=0x560abaf43dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606e800640 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 0x560abaf43dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606e800640 1 -- 172.21.15.7:0/4275870050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560abae6bfd0 con 0x560abaf3b1b0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f606e800640 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf43340 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6064010fb0 tx=0x7f6064004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719d86fb739d73fc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.207+0000 7f604b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.208+0000 7f604b400640 1 -- 172.21.15.7:0/4275870050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064027020 con 0x560abaf3b1b0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.208+0000 7f604b400640 1 -- 172.21.15.7:0/4275870050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f6064003b70 con 0x560abaf3b1b0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.208+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6064004d20 con 0x560abaf3b1b0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.208+0000 7f604b400640 1 -- 172.21.15.7:0/4275870050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f606402f050 con 0x560abaf3b1b0 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.208+0000 7f60735c2740 10 client.16965 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.208+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560ababb4210 con 0x560abaf3b1b0 2024-04-23T15:07:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f604b400640 1 -- 172.21.15.7:0/4275870050 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6064004d20 con 0x560abaf3b1b0 2024-04-23T15:07:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f604b400640 1 -- 172.21.15.7:0/4275870050 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f60640235f0 con 0x560abaf3b1b0 2024-04-23T15:07:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f60735c2740 10 client.16965 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f60735c2740 10 client.16965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f60735c2740 20 client.16965 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f60735c2740 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abaf56420 0x560abaf58810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f60735c2740 4 client.16965 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.209+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560abaeaf320 con 0x560abaf56420 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.210+0000 7f606d400640 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abaf56420 0x560abaf58810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.210+0000 7f604b400640 10 client.16965 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.210+0000 7f606d400640 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abaf56420 0x560abaf58810 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc2ca1b0bba71e60 server_cookie=acd8f925fe393579 in_seq=0 out_seq=0 2024-04-23T15:07:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.212+0000 7f604b400640 1 -- 172.21.15.7:0/4275870050 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560abaeaf320 con 0x560abaf56420 2024-04-23T15:07:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.212+0000 7f604b400640 10 client.16965 handle_command_reply: tid=0 2024-04-23T15:07:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.212+0000 7f60735c2740 1 client.16965 shutdown 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 msgr2=0x560abaf43340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf43340 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6064010fb0 tx=0x7f6064004c70 comp rx=0 tx=0).stop 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 shutdown_connections 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abaf56420 0x560abaf58810 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 0x560abaf43dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf43880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 --2- 172.21.15.7:0/4275870050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3b1b0 0x560abaf43340 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f604b400640 0 client.16965 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 >> 172.21.15.7:0/4275870050 conn(0x560abaf376c0 msgr2=0x560abaf3d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 shutdown_connections 2024-04-23T15:07:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 1 -- 172.21.15.7:0/4275870050 wait complete. 2024-04-23T15:07:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.213+0000 7f60735c2740 20 client.16965 trim_cache size 0 max 16384 2024-04-23T15:07:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.231+0000 7f60735c2740 1 Processor -- start 2024-04-23T15:07:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 -- start start 2024-04-23T15:07:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3b1b0 0x560abaf51e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf5dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 0x560abaf5e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60681b1540 con 0x560abaf46390 2024-04-23T15:07:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60681b3080 con 0x560abaf3b1b0 2024-04-23T15:07:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f60735c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f60681b1c10 con 0x560abaf3bad0 2024-04-23T15:07:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f606e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 0x560abaf5e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f606e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 0x560abaf5e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50404/0 (socket says 172.21.15.7:50404) 2024-04-23T15:07:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.232+0000 7f606e800640 1 -- 172.21.15.7:0/1036556626 learned_addr learned my addr 172.21.15.7:0/1036556626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3b1b0 0x560abaf51e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606d400640 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf5dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 -- 172.21.15.7:0/1036556626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 msgr2=0x560abaf5dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf5dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 -- 172.21.15.7:0/1036556626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3b1b0 msgr2=0x560abaf51e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3b1b0 0x560abaf51e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 -- 172.21.15.7:0/1036556626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abaf3b900 con 0x560abaf46390 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f606e800640 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 0x560abaf5e3e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6064005cc0 tx=0x7f606400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72da4d8868c90103 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f6056600640 1 -- 172.21.15.7:0/1036556626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064027040 con 0x560abaf46390 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f6056600640 1 -- 172.21.15.7:0/1036556626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60640079a0 con 0x560abaf46390 2024-04-23T15:07:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.233+0000 7f6056600640 1 -- 172.21.15.7:0/1036556626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064014040 con 0x560abaf46390 2024-04-23T15:07:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 -- 172.21.15.7:0/1036556626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 msgr2=0x560abaf5e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 0x560abaf5e3e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6064005cc0 tx=0x7f606400e720 comp rx=0 tx=0).stop 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 -- 172.21.15.7:0/1036556626 shutdown_connections 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf46390 0x560abaf5e3e0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3bad0 0x560abaf5dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 --2- 172.21.15.7:0/1036556626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf3b1b0 0x560abaf51e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.234+0000 7f60735c2740 1 -- 172.21.15.7:0/1036556626 >> 172.21.15.7:0/1036556626 conn(0x560abaf376c0 msgr2=0x560abaf36840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.235+0000 7f60735c2740 1 -- 172.21.15.7:0/1036556626 shutdown_connections 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.235+0000 7f60735c2740 1 -- 172.21.15.7:0/1036556626 wait complete. 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.235+0000 7f60735c2740 1 -- start start 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.235+0000 7f60735c2740 1 Processor -- start 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3b1b0 0x560abaf4a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 0x560abaf4aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 0x560abafbb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60681b29b0 con 0x560abaf3bad0 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60681b22e0 con 0x560abaf46390 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f60681af540 con 0x560abaf3b1b0 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f60735c2740 10 client.0 _ll_register_callbacks cb 0x7f6064007ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 0x560abaf4aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 0x560abaf4aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50420/0 (socket says 172.21.15.7:50420) 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 -- 172.21.15.7:0/840660212 learned_addr learned my addr 172.21.15.7:0/840660212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606e800640 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3b1b0 0x560abaf4a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 -- 172.21.15.7:0/840660212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3b1b0 msgr2=0x560abaf4a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3b1b0 0x560abaf4a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 -- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 msgr2=0x560abafbb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 0x560abafbb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.236+0000 7f606d400640 1 -- 172.21.15.7:0/840660212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560abac80620 con 0x560abaf3bad0 2024-04-23T15:07:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.237+0000 7f606d400640 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 0x560abaf4aa80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x560abaf38850 tx=0x7f605800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84044e7d5d6afa17 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.237+0000 7f604b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.237+0000 7f604b400640 1 -- 172.21.15.7:0/840660212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058012980 con 0x560abaf3bad0 2024-04-23T15:07:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.237+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60640079a0 con 0x560abaf3bad0 2024-04-23T15:07:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.237+0000 7f604b400640 1 -- 172.21.15.7:0/840660212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f6058012b20 con 0x560abaf3bad0 2024-04-23T15:07:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.237+0000 7f604b400640 1 -- 172.21.15.7:0/840660212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6058012d20 con 0x560abaf3bad0 2024-04-23T15:07:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 10 client.16971 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560abafbce20 con 0x560abaf3bad0 2024-04-23T15:07:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f604b400640 1 -- 172.21.15.7:0/840660212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60640079a0 con 0x560abaf3bad0 2024-04-23T15:07:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f604b400640 1 -- 172.21.15.7:0/840660212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6058003a10 con 0x560abaf3bad0 2024-04-23T15:07:44.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 10 client.16971 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 10 client.16971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 20 client.16971 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abafbd620 0x560abafbfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 4 client.16971 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.238+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560abaea9190 con 0x560abafbd620 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.239+0000 7f606e800640 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abafbd620 0x560abafbfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.240+0000 7f606e800640 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abafbd620 0x560abafbfa40 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac4aa82981a4966a server_cookie=aaf42f11deae8dc0 in_seq=0 out_seq=0 2024-04-23T15:07:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.240+0000 7f604b400640 10 client.16971 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f604b400640 1 -- 172.21.15.7:0/840660212 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560abaea9190 con 0x560abafbd620 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f604b400640 10 client.16971 handle_command_reply: tid=0 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 client.16971 shutdown 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 msgr2=0x560abaf4aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 0x560abaf4aa80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x560abaf38850 tx=0x7f605800bdf0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 shutdown_connections 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560abafbd620 0x560abafbfa40 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560abaf46390 0x560abafbb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560abaf3bad0 0x560abaf4aa80 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 --2- 172.21.15.7:0/840660212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560abaf3b1b0 0x560abaf4a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 >> 172.21.15.7:0/840660212 conn(0x560abaf376c0 msgr2=0x560abaf3cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f604b400640 0 client.16971 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 shutdown_connections 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.272+0000 7f60735c2740 1 -- 172.21.15.7:0/840660212 wait complete. 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.273+0000 7f60735c2740 20 client.16971 trim_cache size 0 max 16384 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:07:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:07:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:07:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:07:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.273+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f60500a3e40 msgr2=0x7f60500a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.273+0000 7f6070800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f60500a3e40 0x7f60500a6300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x560abaf3c750 tx=0x7f605c009230 comp rx=0 tx=0).stop 2024-04-23T15:07:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 msgr2=0x7f60681a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f60681a0690 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f605c005940 tx=0x7f605c004270 comp rx=0 tx=0).stop 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 shutdown_connections 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f60500a3e40 0x7f60500a6300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f606810e820 0x7f606819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6068074d50 0x7f60681a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 --2- 172.21.15.7:0/3278255067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6068074430 0x7f60681a0690 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 >> 172.21.15.7:0/3278255067 conn(0x7f60680fdab0 msgr2=0x7f60680fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 shutdown_connections 2024-04-23T15:07:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:44.274+0000 7f6070800640 1 -- 172.21.15.7:0/3278255067 wait complete. 2024-04-23T15:07:46.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:45 smithi007 ceph-mon[27906]: pgmap v513: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:07:46.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:45 smithi186 ceph-mon[31814]: pgmap v513: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:07:46.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:45 smithi137 ceph-mon[31694]: pgmap v513: 129 pgs: 129 active+clean; 3.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:07:48.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:47 smithi007 ceph-mon[27906]: pgmap v514: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:48.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:47 smithi186 ceph-mon[31814]: pgmap v514: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:48.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:47 smithi137 ceph-mon[31694]: pgmap v514: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:48 smithi007 ceph-mon[27906]: pgmap v515: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:48 smithi186 ceph-mon[31814]: pgmap v515: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:48 smithi137 ceph-mon[31694]: pgmap v515: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:51 smithi007 ceph-mon[27906]: pgmap v516: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:52.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:51 smithi186 ceph-mon[31814]: pgmap v516: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:52.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:51 smithi137 ceph-mon[31694]: pgmap v516: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:07:54.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:53 smithi007 ceph-mon[27906]: pgmap v517: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:54.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:53 smithi186 ceph-mon[31814]: pgmap v517: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:54.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:53 smithi137 ceph-mon[31694]: pgmap v517: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:07:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:54 smithi186 ceph-mon[31814]: pgmap v518: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:07:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:54 smithi137 ceph-mon[31694]: pgmap v518: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:07:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:54 smithi007 ceph-mon[27906]: pgmap v518: 129 pgs: 129 active+clean; 3.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:07:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 -- 172.21.15.7:0/1819518097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 msgr2=0x7f95a010bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 --2- 172.21.15.7:0/1819518097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a010bdc0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f958c009900 tx=0x7f958c02a480 comp rx=0 tx=0).stop 2024-04-23T15:07:57.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 -- 172.21.15.7:0/1819518097 shutdown_connections 2024-04-23T15:07:57.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 --2- 172.21.15.7:0/1819518097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a010c3e0 0x7f95a010e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 --2- 172.21.15.7:0/1819518097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a010bdc0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 --2- 172.21.15.7:0/1819518097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 0x7f95a01033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 -- 172.21.15.7:0/1819518097 >> 172.21.15.7:0/1819518097 conn(0x7f95a00fc820 msgr2=0x7f95a00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 -- 172.21.15.7:0/1819518097 shutdown_connections 2024-04-23T15:07:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.431+0000 7f959f200640 1 -- 172.21.15.7:0/1819518097 wait complete. 2024-04-23T15:07:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.432+0000 7f959f200640 1 Processor -- start 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.432+0000 7f959f200640 1 -- start start 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.432+0000 7f959f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 0x7f95a01a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.432+0000 7f959f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a01a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a010c3e0 0x7f95a019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01120c0 con 0x7f95a01038e0 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0111f40 con 0x7f95a010c3e0 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0112240 con 0x7f95a0102fc0 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a01a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a01a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39830/0 (socket says 172.21.15.7:39830) 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 -- 172.21.15.7:0/3787160259 learned_addr learned my addr 172.21.15.7:0/3787160259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959de00640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 0x7f95a01a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959e800640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a010c3e0 0x7f95a019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 -- 172.21.15.7:0/3787160259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 msgr2=0x7f95a01a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 0x7f95a01a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 -- 172.21.15.7:0/3787160259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a010c3e0 msgr2=0x7f95a019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.433+0000 7f959d400640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a010c3e0 0x7f95a019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f959d400640 1 -- 172.21.15.7:0/3787160259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a019afe0 con 0x7f95a01038e0 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f959de00640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 0x7f95a01a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f959d400640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a01a0ba0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f958c005ab0 tx=0x7f958c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f9596a00640 1 -- 172.21.15.7:0/3787160259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c03f070 con 0x7f95a01038e0 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f9596a00640 1 -- 172.21.15.7:0/3787160259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f958c031d60 con 0x7f95a01038e0 2024-04-23T15:07:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f9596a00640 1 -- 172.21.15.7:0/3787160259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c035030 con 0x7f95a01038e0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.434+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a019b270 con 0x7f95a01038e0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.435+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a7400 con 0x7f95a01038e0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.438+0000 7f9596a00640 1 -- 172.21.15.7:0/3787160259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f958c042070 con 0x7f95a01038e0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.438+0000 7f95a7c19740 1 Processor -- start 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 -- start start 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e3357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e340060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e342990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe3e29b900 con 0x55fe3e3405a0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fe3e241f20 con 0x55fe3e3353c0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f95a7c19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fe3e2978c0 con 0x55fe3e335ce0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.439+0000 7f959d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e342990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e342990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39838/0 (socket says 172.21.15.7:39838) 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 -- 172.21.15.7:0/1613679020 learned_addr learned my addr 172.21.15.7:0/1613679020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959e800640 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e3357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959de00640 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e340060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 -- 172.21.15.7:0/1613679020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 msgr2=0x55fe3e340060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e340060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 -- 172.21.15.7:0/1613679020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 msgr2=0x55fe3e3357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e3357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f959d400640 1 -- 172.21.15.7:0/1613679020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3e266e10 con 0x55fe3e3405a0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.440+0000 7f9596a00640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f95840a3d10 0x7f95840a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.441+0000 7f9596a00640 1 -- 172.21.15.7:0/3787160259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f958c0f1130 con 0x7f95a01038e0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.441+0000 7f959d400640 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e342990 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f958c0ee3b0 tx=0x7f958c0f93b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995671970f1f837a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.441+0000 7f959e800640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f95840a3d10 0x7f95840a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.441+0000 7f958b400640 1 -- 172.21.15.7:0/1613679020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c049070 con 0x55fe3e3405a0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.441+0000 7f958b400640 1 -- 172.21.15.7:0/1613679020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f958c0bd3c0 con 0x55fe3e3405a0 2024-04-23T15:07:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.441+0000 7f958b400640 1 -- 172.21.15.7:0/1613679020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c0b8f60 con 0x55fe3e3405a0 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 -- 172.21.15.7:0/1613679020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 msgr2=0x55fe3e342990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f959e800640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f95840a3d10 0x7f95840a61d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9598005fd0 tx=0x7f95980096e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e342990 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f958c0ee3b0 tx=0x7f958c0f93b0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 -- 172.21.15.7:0/1613679020 shutdown_connections 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e342990 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e340060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 --2- 172.21.15.7:0/1613679020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e3357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 -- 172.21.15.7:0/1613679020 >> 172.21.15.7:0/1613679020 conn(0x55fe3e3318d0 msgr2=0x55fe3e331cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 -- 172.21.15.7:0/1613679020 shutdown_connections 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.442+0000 7f95a7c19740 1 -- 172.21.15.7:0/1613679020 wait complete. 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 -- start start 2024-04-23T15:07:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 Processor -- start 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3353c0 0x55fe3e33d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e33e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe3e342f90 con 0x55fe3e3405a0 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fe3e2552c0 con 0x55fe3e335ce0 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fe3e343110 con 0x55fe3e3353c0 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.443+0000 7f95a7c19740 10 client.0 _ll_register_callbacks cb 0x55fe3dfada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e33e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e33e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39842/0 (socket says 172.21.15.7:39842) 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 -- 172.21.15.7:0/3253023106 learned_addr learned my addr 172.21.15.7:0/3253023106 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959de00640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3353c0 0x55fe3e33d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959d400640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 -- 172.21.15.7:0/3253023106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3353c0 msgr2=0x55fe3e33d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3353c0 0x55fe3e33d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 -- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 msgr2=0x55fe3e33db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959e800640 1 -- 172.21.15.7:0/3253023106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3e265fd0 con 0x55fe3e3405a0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.444+0000 7f959de00640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3353c0 0x55fe3e33d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f959e800640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e33e070 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f959801d7c0 tx=0x7f9598004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278ed14f8464db5b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f957fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f957fe00640 1 -- 172.21.15.7:0/3253023106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959801e820 con 0x55fe3e3405a0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c0bd3c0 con 0x55fe3e3405a0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f957fe00640 1 -- 172.21.15.7:0/3253023106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f959801e9c0 con 0x55fe3e3405a0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f957fe00640 1 -- 172.21.15.7:0/3253023106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f959801ebc0 con 0x55fe3e3405a0 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f95a7c19740 10 client.16983 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.445+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe3dfae210 con 0x55fe3e3405a0 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f957fe00640 1 -- 172.21.15.7:0/3253023106 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f958c0bd3c0 con 0x55fe3e3405a0 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f957fe00640 1 -- 172.21.15.7:0/3253023106 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f959800f040 con 0x55fe3e3405a0 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f95a7c19740 10 client.16983 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f95a7c19740 10 client.16983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f95a7c19740 20 client.16983 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e350530 0x55fe3e352920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f95a7c19740 4 client.16983 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.446+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe3e2a9320 con 0x55fe3e350530 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.447+0000 7f959de00640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e350530 0x55fe3e352920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.448+0000 7f959de00640 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e350530 0x55fe3e352920 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9d2bd7cede47885 server_cookie=628524e99c61d54c in_seq=0 out_seq=0 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.448+0000 7f957fe00640 10 client.16983 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f957fe00640 1 -- 172.21.15.7:0/3253023106 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fe3e2a9320 con 0x55fe3e350530 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f957fe00640 10 client.16983 handle_command_reply: tid=0 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 client.16983 shutdown 2024-04-23T15:07:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 msgr2=0x55fe3e33e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e33e070 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f959801d7c0 tx=0x7f9598004a40 comp rx=0 tx=0).stop 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 shutdown_connections 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e350530 0x55fe3e352920 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e33e070 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3253023106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3353c0 0x55fe3e33d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 >> 172.21.15.7:0/3253023106 conn(0x55fe3e3318d0 msgr2=0x55fe3e330a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f957fe00640 0 client.16983 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 shutdown_connections 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.450+0000 7f95a7c19740 1 -- 172.21.15.7:0/3253023106 wait complete. 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.451+0000 7f95a7c19740 20 client.16983 trim_cache size 0 max 16384 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.473+0000 7f95a7c19740 1 Processor -- start 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 -- start start 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e331210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e32c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e34bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01b1510 con 0x55fe3e3405a0 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01b3050 con 0x55fe3e3353c0 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f95a7c19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01b1be0 con 0x55fe3e335ce0 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f959e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e34bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f959e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e34bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39844/0 (socket says 172.21.15.7:39844) 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.474+0000 7f959e800640 1 -- 172.21.15.7:0/3876979336 learned_addr learned my addr 172.21.15.7:0/3876979336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959de00640 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e331210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959d400640 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e32c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959e800640 1 -- 172.21.15.7:0/3876979336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 msgr2=0x55fe3e32c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959e800640 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e32c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959e800640 1 -- 172.21.15.7:0/3876979336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 msgr2=0x55fe3e331210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959e800640 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e331210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959e800640 1 -- 172.21.15.7:0/3876979336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3e33c5a0 con 0x55fe3e3405a0 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.475+0000 7f959e800640 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e34bd90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9598009d30 tx=0x7f959801d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ecbf97307b597e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.476+0000 7f958aa00640 1 -- 172.21.15.7:0/3876979336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959803b070 con 0x55fe3e3405a0 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.476+0000 7f958aa00640 1 -- 172.21.15.7:0/3876979336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f959801e820 con 0x55fe3e3405a0 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.476+0000 7f958aa00640 1 -- 172.21.15.7:0/3876979336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959801b740 con 0x55fe3e3405a0 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 -- 172.21.15.7:0/3876979336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 msgr2=0x55fe3e34bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e34bd90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9598009d30 tx=0x7f959801d400 comp rx=0 tx=0).stop 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 -- 172.21.15.7:0/3876979336 shutdown_connections 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3405a0 0x55fe3e34bd90 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e335ce0 0x55fe3e32c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 --2- 172.21.15.7:0/3876979336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e3353c0 0x55fe3e331210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 -- 172.21.15.7:0/3876979336 >> 172.21.15.7:0/3876979336 conn(0x55fe3e3318d0 msgr2=0x55fe3e336d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 -- 172.21.15.7:0/3876979336 shutdown_connections 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 -- 172.21.15.7:0/3876979336 wait complete. 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.477+0000 7f95a7c19740 1 -- start start 2024-04-23T15:07:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 Processor -- start 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 0x55fe3e33a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3405a0 0x55fe3e33acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01b2980 con 0x55fe3e3353c0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01b22b0 con 0x55fe3e335ce0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01af510 con 0x55fe3e3405a0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.478+0000 7f95a7c19740 10 client.0 _ll_register_callbacks cb 0x7f959801d470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 0x55fe3e33a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 0x55fe3e33a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39854/0 (socket says 172.21.15.7:39854) 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 -- 172.21.15.7:0/2121039860 learned_addr learned my addr 172.21.15.7:0/2121039860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959e800640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3405a0 0x55fe3e33acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959d400640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 -- 172.21.15.7:0/2121039860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3405a0 msgr2=0x55fe3e33acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3405a0 0x55fe3e33acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 -- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 msgr2=0x55fe3e33a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 -- 172.21.15.7:0/2121039860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3e342d00 con 0x55fe3e3353c0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959e800640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3405a0 0x55fe3e33acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.479+0000 7f959de00640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 0x55fe3e33a240 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f95900134d0 tx=0x7f9590013990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143918610ffb056f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f957fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f957fe00640 1 -- 172.21.15.7:0/2121039860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959001d620 con 0x55fe3e3353c0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f957fe00640 1 -- 172.21.15.7:0/2121039860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9467+0+0 (secure 0 0 0) 0x7f959001d7c0 con 0x55fe3e3353c0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f959801e820 con 0x55fe3e3353c0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f957fe00640 1 -- 172.21.15.7:0/2121039860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f959002d050 con 0x55fe3e3353c0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f95a7c19740 10 client.16989 fetch_fsmap learned FSMap version 32 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.480+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe3e07a620 con 0x55fe3e3353c0 2024-04-23T15:07:57.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f957fe00640 1 -- 172.21.15.7:0/2121039860 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f959801e820 con 0x55fe3e3353c0 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f957fe00640 1 -- 172.21.15.7:0/2121039860 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9590011560 con 0x55fe3e3353c0 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f95a7c19740 10 client.16989 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f95a7c19740 10 client.16989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f95a7c19740 20 client.16989 populate_metadata read hostname 'smithi007' 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f95a7c19740 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e3b70a0 0x55fe3e3b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f95a7c19740 4 client.16989 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.481+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe3e2a3190 con 0x55fe3e3b70a0 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.482+0000 7f959d400640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e3b70a0 0x55fe3e3b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.482+0000 7f959d400640 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e3b70a0 0x55fe3e3b94c0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7e877cc7e830009 server_cookie=66d0171f33fd3daa in_seq=0 out_seq=0 2024-04-23T15:07:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.482+0000 7f957fe00640 10 client.16989 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f957fe00640 1 -- 172.21.15.7:0/2121039860 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe3e2a3190 con 0x55fe3e3b70a0 2024-04-23T15:07:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f957fe00640 10 client.16989 handle_command_reply: tid=0 2024-04-23T15:07:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 client.16989 shutdown 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 msgr2=0x55fe3e33a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 0x55fe3e33a240 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f95900134d0 tx=0x7f9590013990 comp rx=0 tx=0).stop 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 shutdown_connections 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fe3e3b70a0 0x55fe3e3b94c0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe3e335ce0 0x55fe3e33a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe3e3405a0 0x55fe3e33acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 --2- 172.21.15.7:0/2121039860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe3e3353c0 0x55fe3e33a240 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f957fe00640 0 client.16989 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.515+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 >> 172.21.15.7:0/2121039860 conn(0x55fe3e3318d0 msgr2=0x55fe3e33de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.516+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 shutdown_connections 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.516+0000 7f95a7c19740 1 -- 172.21.15.7:0/2121039860 wait complete. 2024-04-23T15:07:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.516+0000 7f95a7c19740 20 client.16989 trim_cache size 0 max 16384 2024-04-23T15:07:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:07:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:07:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:07:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:07:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f95840a3d10 msgr2=0x7f95840a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f95840a3d10 0x7f95840a61d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9598005fd0 tx=0x7f95980096e0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 msgr2=0x7f95a01a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a01a0ba0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f958c005ab0 tx=0x7f958c003c80 comp rx=0 tx=0).stop 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 shutdown_connections 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f95840a3d10 0x7f95840a61d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a010c3e0 0x7f95a019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95a01038e0 0x7f95a01a0ba0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 --2- 172.21.15.7:0/3787160259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a0102fc0 0x7f95a01a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 >> 172.21.15.7:0/3787160259 conn(0x7f95a00fc820 msgr2=0x7f95a0101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 shutdown_connections 2024-04-23T15:07:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:07:57.517+0000 7f959f200640 1 -- 172.21.15.7:0/3787160259 wait complete. 2024-04-23T15:07:58.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:57 smithi007 ceph-mon[27906]: pgmap v519: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:07:58.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:57 smithi186 ceph-mon[31814]: pgmap v519: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:07:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:57 smithi137 ceph-mon[31694]: pgmap v519: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:08:00.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:07:59 smithi007 ceph-mon[27906]: pgmap v520: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:00.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:07:59 smithi186 ceph-mon[31814]: pgmap v520: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:07:59 smithi137 ceph-mon[31694]: pgmap v520: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:01.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:00 smithi007 ceph-mon[27906]: pgmap v521: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:01.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:00 smithi186 ceph-mon[31814]: pgmap v521: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:00 smithi137 ceph-mon[31694]: pgmap v521: 129 pgs: 129 active+clean; 4.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:04.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:03 smithi007 ceph-mon[27906]: pgmap v522: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:08:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:03 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:08:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:03 smithi186 ceph-mon[31814]: pgmap v522: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:08:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:03 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:08:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:03 smithi137 ceph-mon[31694]: pgmap v522: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:08:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:03 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:08:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:04 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:08:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:04 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:08:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:04 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:08:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:04 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:08:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:04 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:08:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:04 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:08:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:04 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:08:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:04 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:08:05.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:04 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:08:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:05 smithi007 ceph-mon[27906]: pgmap v523: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.1 MiB/s wr, 30 op/s 2024-04-23T15:08:06.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:05 smithi186 ceph-mon[31814]: pgmap v523: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.1 MiB/s wr, 30 op/s 2024-04-23T15:08:06.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:05 smithi137 ceph-mon[31694]: pgmap v523: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.1 MiB/s wr, 30 op/s 2024-04-23T15:08:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:06 smithi007 ceph-mon[27906]: pgmap v524: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:08:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:06 smithi186 ceph-mon[31814]: pgmap v524: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:08:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:06 smithi137 ceph-mon[31694]: pgmap v524: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:08:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:08 smithi186 ceph-mon[31814]: osdmap e113: 12 total, 12 up, 12 in 2024-04-23T15:08:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:08 smithi186 ceph-mon[31814]: pgmap v526: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:08:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:08 smithi137 ceph-mon[31694]: osdmap e113: 12 total, 12 up, 12 in 2024-04-23T15:08:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:08 smithi137 ceph-mon[31694]: pgmap v526: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:08:09.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:08 smithi007 ceph-mon[27906]: osdmap e113: 12 total, 12 up, 12 in 2024-04-23T15:08:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:08 smithi007 ceph-mon[27906]: pgmap v526: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 -- 172.21.15.7:0/774821096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce8109530 msgr2=0x7f8ce8111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 --2- 172.21.15.7:0/774821096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce8109530 0x7f8ce8111100 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009ca0 tx=0x7f8ce002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 -- 172.21.15.7:0/774821096 shutdown_connections 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 --2- 172.21.15.7:0/774821096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8104e10 0x7f8ce8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 --2- 172.21.15.7:0/774821096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce8109530 0x7f8ce8111100 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 --2- 172.21.15.7:0/774821096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 0x7f8ce8104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 -- 172.21.15.7:0/774821096 >> 172.21.15.7:0/774821096 conn(0x7f8ce80ffd00 msgr2=0x7f8ce8102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 -- 172.21.15.7:0/774821096 shutdown_connections 2024-04-23T15:08:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.676+0000 7f8ceda00640 1 -- 172.21.15.7:0/774821096 wait complete. 2024-04-23T15:08:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.677+0000 7f8ceda00640 1 Processor -- start 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.677+0000 7f8ceda00640 1 -- start start 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ceda00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 0x7f8ce81a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ceda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8109530 0x7f8ce81a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ceda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 0x7f8ce819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ceda00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81144f0 con 0x7f8ce819a750 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ceda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8114370 con 0x7f8ce8109530 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ceda00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8114670 con 0x7f8ce8104460 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ce7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 0x7f8ce819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ce7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 0x7f8ce819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40308/0 (socket says 172.21.15.7:40308) 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ce7400640 1 -- 172.21.15.7:0/3333987567 learned_addr learned my addr 172.21.15.7:0/3333987567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.678+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 0x7f8ce81a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce6000640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8109530 0x7f8ce81a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce7400640 1 -- 172.21.15.7:0/3333987567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 msgr2=0x7f8ce81a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce7400640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 0x7f8ce81a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce7400640 1 -- 172.21.15.7:0/3333987567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8109530 msgr2=0x7f8ce81a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce7400640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8109530 0x7f8ce81a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce7400640 1 -- 172.21.15.7:0/3333987567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce819b350 con 0x7f8ce819a750 2024-04-23T15:08:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce6000640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8109530 0x7f8ce81a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:10.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 0x7f8ce81a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.679+0000 7f8ce7400640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 0x7f8ce819abd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0031040 tx=0x7f8ce0032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.680+0000 7f8cdf400640 1 -- 172.21.15.7:0/3333987567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0003b70 con 0x7f8ce819a750 2024-04-23T15:08:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.680+0000 7f8cdf400640 1 -- 172.21.15.7:0/3333987567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ce0003d10 con 0x7f8ce819a750 2024-04-23T15:08:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.680+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce819b5e0 con 0x7f8ce819a750 2024-04-23T15:08:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.680+0000 7f8cdf400640 1 -- 172.21.15.7:0/3333987567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0030b20 con 0x7f8ce819a750 2024-04-23T15:08:10.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.680+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce81a7780 con 0x7f8ce819a750 2024-04-23T15:08:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.684+0000 7f8cf0827740 1 Processor -- start 2024-04-23T15:08:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cdf400640 1 -- 172.21.15.7:0/3333987567 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8ce0030cc0 con 0x7f8ce819a750 2024-04-23T15:08:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 -- start start 2024-04-23T15:08:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ad9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ae4390 0x5578a6ae6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5578a6a3f900 con 0x5578a6ad91b0 2024-04-23T15:08:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5578a69e5f20 con 0x5578a6ad9ad0 2024-04-23T15:08:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8cf0827740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5578a6a3b8c0 con 0x5578a6ae4390 2024-04-23T15:08:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.685+0000 7f8ce6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ad9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ad9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40320/0 (socket says 172.21.15.7:40320) 2024-04-23T15:08:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 -- 172.21.15.7:0/4076082362 learned_addr learned my addr 172.21.15.7:0/4076082362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:10.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ae4390 0x5578a6ae6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 -- 172.21.15.7:0/4076082362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ae4390 msgr2=0x5578a6ae6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ae4390 0x5578a6ae6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 -- 172.21.15.7:0/4076082362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 msgr2=0x5578a6ae3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8ce6000640 1 -- 172.21.15.7:0/4076082362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a6a0ae10 con 0x5578a6ad91b0 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.686+0000 7f8cdf400640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3dc0 0x7f8ccc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.687+0000 7f8ce6000640 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ad9590 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4005f60 tx=0x7f8cd4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23325bd4f18cf053 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.687+0000 7f8cdf400640 1 -- 172.21.15.7:0/3333987567 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9555+0+0 (secure 0 0 0) 0x7f8ce00f1fd0 con 0x7f8ce819a750 2024-04-23T15:08:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.687+0000 7f8cd3e00640 1 -- 172.21.15.7:0/4076082362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4004030 con 0x5578a6ad91b0 2024-04-23T15:08:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.687+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3dc0 0x7f8ccc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.687+0000 7f8cd3e00640 1 -- 172.21.15.7:0/4076082362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cd40035f0 con 0x5578a6ad91b0 2024-04-23T15:08:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.687+0000 7f8cd3e00640 1 -- 172.21.15.7:0/4076082362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40106f0 con 0x5578a6ad91b0 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 -- 172.21.15.7:0/4076082362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 msgr2=0x5578a6ad9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ad9590 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4005f60 tx=0x7f8cd4009740 comp rx=0 tx=0).stop 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3dc0 0x7f8ccc0a6280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5578a6ada750 tx=0x7f8cd8005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 -- 172.21.15.7:0/4076082362 shutdown_connections 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ae4390 0x5578a6ae6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 --2- 172.21.15.7:0/4076082362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ad9590 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 -- 172.21.15.7:0/4076082362 >> 172.21.15.7:0/4076082362 conn(0x5578a6ad56c0 msgr2=0x5578a6ad5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 -- 172.21.15.7:0/4076082362 shutdown_connections 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.688+0000 7f8cf0827740 1 -- 172.21.15.7:0/4076082362 wait complete. 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.689+0000 7f8cf0827740 1 -- start start 2024-04-23T15:08:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.689+0000 7f8cf0827740 1 Processor -- start 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ae1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ae4390 0x5578a6ae1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5578a6ae6fc0 con 0x5578a6ad91b0 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5578a69f92c0 con 0x5578a6ae4390 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5578a6ae7140 con 0x5578a6ad9ad0 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8cf0827740 10 client.0 _ll_register_callbacks cb 0x5578a6751a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8ce6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ae1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8ce6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ae1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40322/0 (socket says 172.21.15.7:40322) 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8ce6a00640 1 -- 172.21.15.7:0/259509480 learned_addr learned my addr 172.21.15.7:0/259509480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8ce7400640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ae4390 0x5578a6ae1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.690+0000 7f8ce6000640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce6a00640 1 -- 172.21.15.7:0/259509480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 msgr2=0x5578a6ae1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce6a00640 1 -- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ae4390 msgr2=0x5578a6ae1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ae4390 0x5578a6ae1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce6a00640 1 -- 172.21.15.7:0/259509480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a6a09fd0 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce7400640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ae4390 0x5578a6ae1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ae1310 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80097a0 tx=0x7f8cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505c96cc9bef95a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8cd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8cd0c00640 1 -- 172.21.15.7:0/259509480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd80108d0 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.691+0000 7f8cd0c00640 1 -- 172.21.15.7:0/259509480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9555+0+0 (secure 0 0 0) 0x7f8cd8010a70 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.692+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd40035f0 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.692+0000 7f8cd0c00640 1 -- 172.21.15.7:0/259509480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8cd8010c70 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.692+0000 7f8cf0827740 10 client.17001 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.692+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5578a6752210 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.692+0000 7f8cd0c00640 1 -- 172.21.15.7:0/259509480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cd40035f0 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cd0c00640 1 -- 172.21.15.7:0/259509480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8cd801e410 con 0x5578a6ad91b0 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cf0827740 10 client.17001 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cf0827740 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cf0827740 20 client.17001 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cf0827740 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6af45d0 0x5578a6af69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cf0827740 4 client.17001 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:08:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.693+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578a6a4d320 con 0x5578a6af45d0 2024-04-23T15:08:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.694+0000 7f8ce6000640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6af45d0 0x5578a6af69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.695+0000 7f8ce6000640 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6af45d0 0x5578a6af69c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9a105910ea18f1 server_cookie=dc90370f0de04bb7 in_seq=0 out_seq=0 2024-04-23T15:08:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.695+0000 7f8cd0c00640 10 client.17001 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.696+0000 7f8cd0c00640 1 -- 172.21.15.7:0/259509480 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5578a6a4d320 con 0x5578a6af45d0 2024-04-23T15:08:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.696+0000 7f8cd0c00640 10 client.17001 handle_command_reply: tid=0 2024-04-23T15:08:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.696+0000 7f8cf0827740 1 client.17001 shutdown 2024-04-23T15:08:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 msgr2=0x5578a6ae1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ae1310 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80097a0 tx=0x7f8cd80046c0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 shutdown_connections 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6af45d0 0x5578a6af69c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ae4390 0x5578a6ae1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 --2- 172.21.15.7:0/259509480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ad91b0 0x5578a6ae1310 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cd0c00640 0 client.17001 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 >> 172.21.15.7:0/259509480 conn(0x5578a6ad56c0 msgr2=0x5578a6adb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 shutdown_connections 2024-04-23T15:08:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 1 -- 172.21.15.7:0/259509480 wait complete. 2024-04-23T15:08:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.697+0000 7f8cf0827740 20 client.17001 trim_cache size 0 max 16384 2024-04-23T15:08:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.717+0000 7f8cf0827740 1 Processor -- start 2024-04-23T15:08:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.717+0000 7f8cf0827740 1 -- start start 2024-04-23T15:08:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.717+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad91b0 0x5578a6aefe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6adbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ad46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8cf0827740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81b16d0 con 0x5578a6ae4390 2024-04-23T15:08:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8cf0827740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81b3210 con 0x5578a6ad9ad0 2024-04-23T15:08:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8cf0827740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81b1da0 con 0x5578a6ad91b0 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ad46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ad46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40324/0 (socket says 172.21.15.7:40324) 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 -- 172.21.15.7:0/2107217397 learned_addr learned my addr 172.21.15.7:0/2107217397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad91b0 0x5578a6aefe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 -- 172.21.15.7:0/2107217397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad91b0 msgr2=0x5578a6aefe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad91b0 0x5578a6aefe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 -- 172.21.15.7:0/2107217397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 msgr2=0x5578a6adbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce6000640 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6adbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6adbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.718+0000 7f8ce7400640 1 -- 172.21.15.7:0/2107217397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a6ad9900 con 0x5578a6ae4390 2024-04-23T15:08:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.719+0000 7f8ce7400640 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ad46c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ba070 tx=0x7f8ce00bdaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3332ac943af6983e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.719+0000 7f8cd3400640 1 -- 172.21.15.7:0/2107217397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00be310 con 0x5578a6ae4390 2024-04-23T15:08:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.719+0000 7f8cd3400640 1 -- 172.21.15.7:0/2107217397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ce00d7070 con 0x5578a6ae4390 2024-04-23T15:08:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.719+0000 7f8cd3400640 1 -- 172.21.15.7:0/2107217397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00de0c0 con 0x5578a6ae4390 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 -- 172.21.15.7:0/2107217397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 msgr2=0x5578a6ad46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ad46c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ba070 tx=0x7f8ce00bdaa0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 -- 172.21.15.7:0/2107217397 shutdown_connections 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad9ad0 0x5578a6adbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ad46c0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 --2- 172.21.15.7:0/2107217397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad91b0 0x5578a6aefe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 -- 172.21.15.7:0/2107217397 >> 172.21.15.7:0/2107217397 conn(0x5578a6ad56c0 msgr2=0x5578a6ad3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 -- 172.21.15.7:0/2107217397 shutdown_connections 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.720+0000 7f8cf0827740 1 -- 172.21.15.7:0/2107217397 wait complete. 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 -- start start 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 Processor -- start 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad91b0 0x5578a6ae7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ae8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81b2b40 con 0x5578a6ae4390 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81b2470 con 0x5578a6ad91b0 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81af6d0 con 0x5578a6ad9ad0 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.721+0000 7f8cf0827740 10 client.0 _ll_register_callbacks cb 0x7f8cd8009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ae8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ae8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40336/0 (socket says 172.21.15.7:40336) 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 -- 172.21.15.7:0/1993612757 learned_addr learned my addr 172.21.15.7:0/1993612757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad91b0 0x5578a6ae7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce6000640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 -- 172.21.15.7:0/1993612757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 msgr2=0x5578a6ae8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 -- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad91b0 msgr2=0x5578a6ae7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad91b0 0x5578a6ae7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce7400640 1 -- 172.21.15.7:0/1993612757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a681e620 con 0x5578a6ae4390 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.722+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad91b0 0x5578a6ae7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8ce7400640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ae8750 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00d72d0 tx=0x7f8ce00ef360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5744f76c848d6afa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cd0c00640 1 -- 172.21.15.7:0/1993612757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00c1fc0 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cd0c00640 1 -- 172.21.15.7:0/1993612757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9555+0+0 (secure 0 0 0) 0x7f8ce00de050 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce00d7070 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cd0c00640 1 -- 172.21.15.7:0/1993612757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8ce00be310 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cf0827740 10 client.17007 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5578a6b5ab70 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.723+0000 7f8cd0c00640 1 -- 172.21.15.7:0/1993612757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ce00d7070 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cd0c00640 1 -- 172.21.15.7:0/1993612757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8ce00c63f0 con 0x5578a6ae4390 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cf0827740 10 client.17007 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cf0827740 10 client.17007 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cf0827740 20 client.17007 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cf0827740 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6b5b0d0 0x5578a6b5d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cf0827740 4 client.17007 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:08:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.724+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578a6a47190 con 0x5578a6b5b0d0 2024-04-23T15:08:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.725+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6b5b0d0 0x5578a6b5d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.725+0000 7f8ce6a00640 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6b5b0d0 0x5578a6b5d4f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e24d5056fa9c170 server_cookie=11909fb715892391 in_seq=0 out_seq=0 2024-04-23T15:08:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.725+0000 7f8cd0c00640 10 client.17007 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.761+0000 7f8cd0c00640 1 -- 172.21.15.7:0/1993612757 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578a6a47190 con 0x5578a6b5b0d0 2024-04-23T15:08:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.761+0000 7f8cd0c00640 10 client.17007 handle_command_reply: tid=0 2024-04-23T15:08:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.761+0000 7f8cf0827740 1 client.17007 shutdown 2024-04-23T15:08:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.761+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 msgr2=0x5578a6ae8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.761+0000 7f8cf0827740 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ae8750 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00d72d0 tx=0x7f8ce00ef360 comp rx=0 tx=0).stop 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 shutdown_connections 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5578a6b5b0d0 0x5578a6b5d4f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578a6ae4390 0x5578a6ae8750 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5578a6ad9ad0 0x5578a6ae8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 --2- 172.21.15.7:0/1993612757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578a6ad91b0 0x5578a6ae7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cd0c00640 0 client.17007 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 >> 172.21.15.7:0/1993612757 conn(0x5578a6ad56c0 msgr2=0x5578a6ae1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 shutdown_connections 2024-04-23T15:08:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 1 -- 172.21.15.7:0/1993612757 wait complete. 2024-04-23T15:08:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.762+0000 7f8cf0827740 20 client.17007 trim_cache size 0 max 16384 2024-04-23T15:08:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:08:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:08:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:08:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3dc0 msgr2=0x7f8ccc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3dc0 0x7f8ccc0a6280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5578a6ada750 tx=0x7f8cd8005f90 comp rx=0 tx=0).stop 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 msgr2=0x7f8ce819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 0x7f8ce819abd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0031040 tx=0x7f8ce0032f80 comp rx=0 tx=0).stop 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 shutdown_connections 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ccc0a3dc0 0x7f8ccc0a6280 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ce8109530 0x7f8ce81a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce819a750 0x7f8ce819abd0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 --2- 172.21.15.7:0/3333987567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce8104460 0x7f8ce81a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.763+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 >> 172.21.15.7:0/3333987567 conn(0x7f8ce80ffd00 msgr2=0x7f8ce8101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.764+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 shutdown_connections 2024-04-23T15:08:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:10.764+0000 7f8ceda00640 1 -- 172.21.15.7:0/3333987567 wait complete. 2024-04-23T15:08:12.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:11 smithi007 ceph-mon[27906]: pgmap v527: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:08:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:11 smithi186 ceph-mon[31814]: pgmap v527: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:08:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:11 smithi137 ceph-mon[31694]: pgmap v527: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:08:14.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:13 smithi007 ceph-mon[27906]: pgmap v528: 129 pgs: 129 active+clean; 4.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:08:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:13 smithi186 ceph-mon[31814]: pgmap v528: 129 pgs: 129 active+clean; 4.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:08:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:13 smithi137 ceph-mon[31694]: pgmap v528: 129 pgs: 129 active+clean; 4.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:08:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:14 smithi007 ceph-mon[27906]: pgmap v529: 129 pgs: 129 active+clean; 4.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:08:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:14 smithi186 ceph-mon[31814]: pgmap v529: 129 pgs: 129 active+clean; 4.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:08:15.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:14 smithi137 ceph-mon[31694]: pgmap v529: 129 pgs: 129 active+clean; 4.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:08:16.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:16 smithi007 ceph-mon[27906]: osdmap e114: 12 total, 12 up, 12 in 2024-04-23T15:08:16.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:16 smithi186 ceph-mon[31814]: osdmap e114: 12 total, 12 up, 12 in 2024-04-23T15:08:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:16 smithi137 ceph-mon[31694]: osdmap e114: 12 total, 12 up, 12 in 2024-04-23T15:08:17.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:17 smithi007 ceph-mon[27906]: pgmap v531: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 18 op/s 2024-04-23T15:08:17.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:17 smithi186 ceph-mon[31814]: pgmap v531: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 18 op/s 2024-04-23T15:08:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:17 smithi137 ceph-mon[31694]: pgmap v531: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 18 op/s 2024-04-23T15:08:20.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:19 smithi007 ceph-mon[27906]: pgmap v532: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:08:20.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:19 smithi186 ceph-mon[31814]: pgmap v532: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:08:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:19 smithi137 ceph-mon[31694]: pgmap v532: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:08:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:20 smithi007 ceph-mon[27906]: pgmap v533: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:08:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:20 smithi186 ceph-mon[31814]: pgmap v533: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:08:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:20 smithi137 ceph-mon[31694]: pgmap v533: 129 pgs: 129 active+clean; 4.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:08:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:22 smithi137 ceph-mon[31694]: pgmap v534: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:08:23.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:22 smithi007 ceph-mon[27906]: pgmap v534: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:08:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:22 smithi186 ceph-mon[31814]: pgmap v534: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:08:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 -- 172.21.15.7:0/3675312062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000101910 msgr2=0x7f9000105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 --2- 172.21.15.7:0/3675312062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000101910 0x7f9000105950 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009900 tx=0x7f8fec02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 -- 172.21.15.7:0/3675312062 shutdown_connections 2024-04-23T15:08:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 --2- 172.21.15.7:0/3675312062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 0x7f900010dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 --2- 172.21.15.7:0/3675312062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000101910 0x7f9000105950 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 --2- 172.21.15.7:0/3675312062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9000100f60 0x7f9000101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 -- 172.21.15.7:0/3675312062 >> 172.21.15.7:0/3675312062 conn(0x7f90000fc820 msgr2=0x7f90000fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 -- 172.21.15.7:0/3675312062 shutdown_connections 2024-04-23T15:08:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.929+0000 7f9004a00640 1 -- 172.21.15.7:0/3675312062 wait complete. 2024-04-23T15:08:23.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.930+0000 7f9004a00640 1 Processor -- start 2024-04-23T15:08:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.930+0000 7f9004a00640 1 -- start start 2024-04-23T15:08:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f9004a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 0x7f90001a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f9004a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 0x7f90001a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f9004a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f900019a6e0 0x7f900019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f9004a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90001120e0 con 0x7f9000100f60 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f9004a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9000111f60 con 0x7f9000106030 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f9004a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9000112260 con 0x7f900019a6e0 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 0x7f90001a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 0x7f90001a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44278/0 (socket says 172.21.15.7:44278) 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f8ffe800640 1 -- 172.21.15.7:0/3190225875 learned_addr learned my addr 172.21.15.7:0/3190225875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f8ffde00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 0x7f90001a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.931+0000 7f8fff200640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f900019a6e0 0x7f900019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffe800640 1 -- 172.21.15.7:0/3190225875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f900019a6e0 msgr2=0x7f900019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f900019a6e0 0x7f900019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffe800640 1 -- 172.21.15.7:0/3190225875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 msgr2=0x7f90001a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 0x7f90001a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffe800640 1 -- 172.21.15.7:0/3190225875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900019b2e0 con 0x7f9000100f60 2024-04-23T15:08:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8fff200640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f900019a6e0 0x7f900019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:08:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffde00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 0x7f90001a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:08:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 0x7f90001a05d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000d950 tx=0x7f8ff000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ff7400640 1 -- 172.21.15.7:0/3190225875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0017070 con 0x7f9000100f60 2024-04-23T15:08:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001a7370 con 0x7f9000100f60 2024-04-23T15:08:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ff7400640 1 -- 172.21.15.7:0/3190225875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ff0009c30 con 0x7f9000100f60 2024-04-23T15:08:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.932+0000 7f8ff7400640 1 -- 172.21.15.7:0/3190225875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000f620 con 0x7f9000100f60 2024-04-23T15:08:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.933+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001a7780 con 0x7f9000100f60 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.936+0000 7f8ff7400640 1 -- 172.21.15.7:0/3190225875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8ff00109a0 con 0x7f9000100f60 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.936+0000 7f90083a2740 1 Processor -- start 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 -- start start 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc8f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 0x56499dc9a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc9a5a0 0x56499dc9c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56499dbf5900 con 0x56499dc8fce0 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56499db9bf20 con 0x56499dc8f3c0 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f90083a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56499dbf18c0 con 0x56499dc9a5a0 2024-04-23T15:08:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 0x56499dc9a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 0x56499dc9a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44286/0 (socket says 172.21.15.7:44286) 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.937+0000 7f8ffe800640 1 -- 172.21.15.7:0/645096849 learned_addr learned my addr 172.21.15.7:0/645096849 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8fff200640 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc8f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ffde00640 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc9a5a0 0x56499dc9c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ffe800640 1 -- 172.21.15.7:0/645096849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc9a5a0 msgr2=0x56499dc9c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ffe800640 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc9a5a0 0x56499dc9c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ffe800640 1 -- 172.21.15.7:0/645096849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 msgr2=0x56499dc8f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ffe800640 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc8f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ffe800640 1 -- 172.21.15.7:0/645096849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56499dbc0e10 con 0x56499dc8fce0 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.938+0000 7f8ff7400640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8fe40a3d10 0x7f8fe40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.939+0000 7f8ffe800640 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 0x56499dc9a060 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00cdb80 tx=0x7f8ff00d8750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a29a3e2bf1ba85 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.939+0000 7f8ff7400640 1 -- 172.21.15.7:0/3190225875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f8ff00d0900 con 0x7f9000100f60 2024-04-23T15:08:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.939+0000 7f8fff200640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8fe40a3d10 0x7f8fe40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.939+0000 7f8feb400640 1 -- 172.21.15.7:0/645096849 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0020030 con 0x56499dc8fce0 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.939+0000 7f8feb400640 1 -- 172.21.15.7:0/645096849 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ff009cb90 con 0x56499dc8fce0 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.939+0000 7f8feb400640 1 -- 172.21.15.7:0/645096849 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff009bfd0 con 0x56499dc8fce0 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 -- 172.21.15.7:0/645096849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 msgr2=0x56499dc9a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f8fff200640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8fe40a3d10 0x7f8fe40a61d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8005fd0 tx=0x7f8ff80085b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 0x56499dc9a060 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00cdb80 tx=0x7f8ff00d8750 comp rx=0 tx=0).stop 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 -- 172.21.15.7:0/645096849 shutdown_connections 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc9a5a0 0x56499dc9c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc8fce0 0x56499dc9a060 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 --2- 172.21.15.7:0/645096849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc8f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 -- 172.21.15.7:0/645096849 >> 172.21.15.7:0/645096849 conn(0x56499dc8b8d0 msgr2=0x56499dc8bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 -- 172.21.15.7:0/645096849 shutdown_connections 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.940+0000 7f90083a2740 1 -- 172.21.15.7:0/645096849 wait complete. 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.941+0000 7f90083a2740 1 -- start start 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.941+0000 7f90083a2740 1 Processor -- start 2024-04-23T15:08:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.941+0000 7f90083a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc97450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.941+0000 7f90083a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8fce0 0x56499dc97990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f90083a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dc97ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f90083a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56499dc9d170 con 0x56499dc9a5a0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f90083a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56499dbaf2c0 con 0x56499dc8f3c0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f90083a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56499dc9d2f0 con 0x56499dc8fce0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f90083a2740 10 client.0 _ll_register_callbacks cb 0x56499d907a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dc97ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dc97ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44288/0 (socket says 172.21.15.7:44288) 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 -- 172.21.15.7:0/1888910461 learned_addr learned my addr 172.21.15.7:0/1888910461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8ffe800640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc97450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8ffde00640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8fce0 0x56499dc97990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 -- 172.21.15.7:0/1888910461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8fce0 msgr2=0x56499dc97990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8fce0 0x56499dc97990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 -- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 msgr2=0x56499dc97450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc97450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.942+0000 7f8fff200640 1 -- 172.21.15.7:0/1888910461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56499dbbffd0 con 0x56499dc9a5a0 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.943+0000 7f8fff200640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dc97ed0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8008800 tx=0x7f8ff8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0ecf2270495590 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.943+0000 7f8fdfe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.943+0000 7f8fdfe00640 1 -- 172.21.15.7:0/1888910461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8025600 con 0x56499dc9a5a0 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.943+0000 7f8fdfe00640 1 -- 172.21.15.7:0/1888910461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f8ff80257a0 con 0x56499dc9a5a0 2024-04-23T15:08:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.943+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ff009cb90 con 0x56499dc9a5a0 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f8fdfe00640 1 -- 172.21.15.7:0/1888910461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8ff802e050 con 0x56499dc9a5a0 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 10 client.17019 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56499d908210 con 0x56499dc9a5a0 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f8fdfe00640 1 -- 172.21.15.7:0/1888910461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ff009cb90 con 0x56499dc9a5a0 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f8fdfe00640 1 -- 172.21.15.7:0/1888910461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8ff801b380 con 0x56499dc9a5a0 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 10 client.17019 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 10 client.17019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 20 client.17019 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dcaa6b0 0x56499dcacaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 4 client.17019 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.944+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56499dc03320 con 0x56499dcaa6b0 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.945+0000 7f8ffe800640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dcaa6b0 0x56499dcacaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.946+0000 7f8ffe800640 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dcaa6b0 0x56499dcacaa0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409da19b5745daa server_cookie=1858d8d100a1fa0a in_seq=0 out_seq=0 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.946+0000 7f8fdfe00640 10 client.17019 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f8fdfe00640 1 -- 172.21.15.7:0/1888910461 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56499dc03320 con 0x56499dcaa6b0 2024-04-23T15:08:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f8fdfe00640 10 client.17019 handle_command_reply: tid=0 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 client.17019 shutdown 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 msgr2=0x56499dc97ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dc97ed0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8008800 tx=0x7f8ff8004a40 comp rx=0 tx=0).stop 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 shutdown_connections 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dcaa6b0 0x56499dcacaa0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dc97ed0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8fce0 0x56499dc97990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 --2- 172.21.15.7:0/1888910461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8f3c0 0x56499dc97450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 >> 172.21.15.7:0/1888910461 conn(0x56499dc8b8d0 msgr2=0x56499dc8aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f8fdfe00640 0 client.17019 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.948+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 shutdown_connections 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.949+0000 7f90083a2740 1 -- 172.21.15.7:0/1888910461 wait complete. 2024-04-23T15:08:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.949+0000 7f90083a2740 20 client.17019 trim_cache size 0 max 16384 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 Processor -- start 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 -- start start 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dca6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc96430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dcb2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90001b1580 con 0x56499dc9a5a0 2024-04-23T15:08:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90001b30c0 con 0x56499dc8fce0 2024-04-23T15:08:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.966+0000 7f90083a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f90001b1c50 con 0x56499dc8f3c0 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dcb2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dcb2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44294/0 (socket says 172.21.15.7:44294) 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 -- 172.21.15.7:0/4209889441 learned_addr learned my addr 172.21.15.7:0/4209889441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8ffde00640 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc96430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8ffe800640 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dca6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 -- 172.21.15.7:0/4209889441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 msgr2=0x56499dca6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dca6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 -- 172.21.15.7:0/4209889441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 msgr2=0x56499dc96430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc96430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8fff200640 1 -- 172.21.15.7:0/4209889441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56499dcace10 con 0x56499dc9a5a0 2024-04-23T15:08:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.967+0000 7f8ffe800640 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dca6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.968+0000 7f8fff200640 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dcb2390 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8004af0 tx=0x7f8ff8008c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820cee8135cb453b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.968+0000 7f8feaa00640 1 -- 172.21.15.7:0/4209889441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800ee80 con 0x56499dc9a5a0 2024-04-23T15:08:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.968+0000 7f8feaa00640 1 -- 172.21.15.7:0/4209889441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ff8036030 con 0x56499dc9a5a0 2024-04-23T15:08:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.968+0000 7f8feaa00640 1 -- 172.21.15.7:0/4209889441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80328b0 con 0x56499dc9a5a0 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 -- 172.21.15.7:0/4209889441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 msgr2=0x56499dcb2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dcb2390 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8004af0 tx=0x7f8ff8008c40 comp rx=0 tx=0).stop 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 -- 172.21.15.7:0/4209889441 shutdown_connections 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc96430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dcb2390 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 --2- 172.21.15.7:0/4209889441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dca6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 -- 172.21.15.7:0/4209889441 >> 172.21.15.7:0/4209889441 conn(0x56499dc8b8d0 msgr2=0x56499dc95d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 -- 172.21.15.7:0/4209889441 shutdown_connections 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.969+0000 7f90083a2740 1 -- 172.21.15.7:0/4209889441 wait complete. 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.970+0000 7f90083a2740 1 -- start start 2024-04-23T15:08:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.970+0000 7f90083a2740 1 Processor -- start 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dc9d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc9dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dd08bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90001b29f0 con 0x56499dc9a5a0 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90001b2320 con 0x56499dc8fce0 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f90001af580 con 0x56499dc8f3c0 2024-04-23T15:08:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f90083a2740 10 client.0 _ll_register_callbacks cb 0x7f8ff8008ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f8fff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dd08bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f8fff200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dd08bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44306/0 (socket says 172.21.15.7:44306) 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f8fff200640 1 -- 172.21.15.7:0/2015717044 learned_addr learned my addr 172.21.15.7:0/2015717044 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f8ffe800640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dc9d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.971+0000 7f8ffde00640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc9dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fff200640 1 -- 172.21.15.7:0/2015717044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 msgr2=0x56499dc9d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fff200640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dc9d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fff200640 1 -- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 msgr2=0x56499dc9dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fff200640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc9dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fff200640 1 -- 172.21.15.7:0/2015717044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56499d9d4620 con 0x56499dc9a5a0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8ffde00640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc9dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fff200640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dd08bc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8ff801b6d0 tx=0x7f8ff8010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecbf78f26a720f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fdfe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fdfe00640 1 -- 172.21.15.7:0/2015717044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff801bb50 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ff8036030 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.972+0000 7f8fdfe00640 1 -- 172.21.15.7:0/2015717044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f8ff801bcf0 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f8fdfe00640 1 -- 172.21.15.7:0/2015717044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8ff804c050 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 10 client.17025 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56499dd10360 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f8fdfe00640 1 -- 172.21.15.7:0/2015717044 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ff8036030 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f8fdfe00640 1 -- 172.21.15.7:0/2015717044 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8ff8032400 con 0x56499dc9a5a0 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 10 client.17025 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 20 client.17025 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dd10910 0x56499dd12d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 4 client.17025 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:08:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.973+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56499dbfd190 con 0x56499dd10910 2024-04-23T15:08:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.974+0000 7f8ffe800640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dd10910 0x56499dd12d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.975+0000 7f8ffe800640 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dd10910 0x56499dd12d30 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dfd150becedfc5a server_cookie=f5249e12197cb4cb in_seq=0 out_seq=0 2024-04-23T15:08:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:23.975+0000 7f8fdfe00640 10 client.17025 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f8fdfe00640 1 -- 172.21.15.7:0/2015717044 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56499dbfd190 con 0x56499dd10910 2024-04-23T15:08:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f8fdfe00640 10 client.17025 handle_command_reply: tid=0 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 client.17025 shutdown 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 msgr2=0x56499dd08bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dd08bc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8ff801b6d0 tx=0x7f8ff8010e10 comp rx=0 tx=0).stop 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 shutdown_connections 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56499dd10910 0x56499dd12d30 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56499dc8fce0 0x56499dc9dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56499dc9a5a0 0x56499dd08bc0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 --2- 172.21.15.7:0/2015717044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56499dc8f3c0 0x56499dc9d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 >> 172.21.15.7:0/2015717044 conn(0x56499dc8b8d0 msgr2=0x56499dc8aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f8fdfe00640 0 client.17025 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.010+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 shutdown_connections 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.011+0000 7f90083a2740 1 -- 172.21.15.7:0/2015717044 wait complete. 2024-04-23T15:08:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.011+0000 7f90083a2740 20 client.17025 trim_cache size 0 max 16384 2024-04-23T15:08:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:08:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:08:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:08:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.011+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8fe40a3d10 msgr2=0x7f8fe40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.011+0000 7f9004a00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8fe40a3d10 0x7f8fe40a61d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8005fd0 tx=0x7f8ff80085b0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.011+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 msgr2=0x7f90001a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.011+0000 7f9004a00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 0x7f90001a05d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000d950 tx=0x7f8ff000de10 comp rx=0 tx=0).stop 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 shutdown_connections 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8fe40a3d10 0x7f8fe40a61d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9000106030 0x7f90001a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f900019a6e0 0x7f900019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 --2- 172.21.15.7:0/3190225875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9000100f60 0x7f90001a05d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 >> 172.21.15.7:0/3190225875 conn(0x7f90000fc820 msgr2=0x7f90000feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 shutdown_connections 2024-04-23T15:08:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:24.012+0000 7f9004a00640 1 -- 172.21.15.7:0/3190225875 wait complete. 2024-04-23T15:08:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:24 smithi137 ceph-mon[31694]: pgmap v535: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:08:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:24 smithi007 ceph-mon[27906]: pgmap v535: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:08:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:24 smithi186 ceph-mon[31814]: pgmap v535: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:08:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:26 smithi137 ceph-mon[31694]: pgmap v536: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:08:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:26 smithi007 ceph-mon[27906]: pgmap v536: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:08:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:26 smithi186 ceph-mon[31814]: pgmap v536: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:08:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:28 smithi137 ceph-mon[31694]: pgmap v537: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:28 smithi007 ceph-mon[27906]: pgmap v537: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:28 smithi186 ceph-mon[31814]: pgmap v537: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:31.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:30 smithi186 ceph-mon[31814]: pgmap v538: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:30 smithi137 ceph-mon[31694]: pgmap v538: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:30 smithi007 ceph-mon[27906]: pgmap v538: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:32 smithi137 ceph-mon[31694]: pgmap v539: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:33.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:32 smithi007 ceph-mon[27906]: pgmap v539: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:32 smithi186 ceph-mon[31814]: pgmap v539: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:34 smithi137 ceph-mon[31694]: pgmap v540: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:34 smithi007 ceph-mon[27906]: pgmap v540: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:34 smithi186 ceph-mon[31814]: pgmap v540: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 -- 172.21.15.7:0/2496308973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec41130c0 msgr2=0x7f5ec41154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 --2- 172.21.15.7:0/2496308973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec41130c0 0x7f5ec41154b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009cd0 tx=0x7f5ebc02a970 comp rx=0 tx=0).stop 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 -- 172.21.15.7:0/2496308973 shutdown_connections 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 --2- 172.21.15.7:0/2496308973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ec4074bf0 0x7f5ec4112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 --2- 172.21.15.7:0/2496308973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec41130c0 0x7f5ec41154b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 --2- 172.21.15.7:0/2496308973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ec40742d0 0x7f5ec40746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.159+0000 7f5ecc600640 1 -- 172.21.15.7:0/2496308973 >> 172.21.15.7:0/2496308973 conn(0x7f5ec4079490 msgr2=0x7f5ec40798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.160+0000 7f5ecc600640 1 -- 172.21.15.7:0/2496308973 shutdown_connections 2024-04-23T15:08:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.160+0000 7f5ecc600640 1 -- 172.21.15.7:0/2496308973 wait complete. 2024-04-23T15:08:37.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:36 smithi137 ceph-mon[31694]: pgmap v541: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 Processor -- start 2024-04-23T15:08:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 -- start start 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ec40742d0 0x7f5ec419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 0x7f5ec419f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ec41130c0 0x7f5ec41a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41188e0 con 0x7f5ec4074bf0 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4118760 con 0x7f5ec41130c0 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.161+0000 7f5ecc600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4118a60 con 0x7f5ec40742d0 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 0x7f5ec419f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 0x7f5ec419f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57552/0 (socket says 172.21.15.7:57552) 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 -- 172.21.15.7:0/3286420850 learned_addr learned my addr 172.21.15.7:0/3286420850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ec40742d0 0x7f5ec419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 -- 172.21.15.7:0/3286420850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ec40742d0 msgr2=0x7f5ec419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ec40742d0 0x7f5ec419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 -- 172.21.15.7:0/3286420850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ec41130c0 msgr2=0x7f5ec41a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5eca600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ec41130c0 0x7f5ec41a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ec41130c0 0x7f5ec41a3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.162+0000 7f5ec9200640 1 -- 172.21.15.7:0/3286420850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec41a3d70 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.163+0000 7f5ec9200640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 0x7f5ec419f2c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000d950 tx=0x7f5eb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.163+0000 7f5ec2000640 1 -- 172.21.15.7:0/3286420850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0017070 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.163+0000 7f5ec2000640 1 -- 172.21.15.7:0/3286420850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5eb0009c30 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.163+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec41a4060 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.163+0000 7f5ec2000640 1 -- 172.21.15.7:0/3286420850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000f620 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.163+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec41ab8f0 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ec2000640 1 -- 172.21.15.7:0/3286420850 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5eb00109a0 con 0x7f5ec4074bf0 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 Processor -- start 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 -- start start 2024-04-23T15:08:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c741c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c7426e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c7429780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5634c7382900 con 0x5634c7427390 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5634c7328f20 con 0x5634c741c1b0 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.167+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5634c737e8c0 con 0x5634c741cad0 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c7429780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c7429780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57560/0 (socket says 172.21.15.7:57560) 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 -- 172.21.15.7:0/4289280443 learned_addr learned my addr 172.21.15.7:0/4289280443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c7426e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5eca600640 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c741c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 -- 172.21.15.7:0/4289280443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 msgr2=0x5634c7426e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c7426e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 -- 172.21.15.7:0/4289280443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 msgr2=0x5634c741c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c741c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec9200640 1 -- 172.21.15.7:0/4289280443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634c734de10 con 0x5634c7427390 2024-04-23T15:08:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.168+0000 7f5ec2000640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5eac0a3dc0 0x7f5eac0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.169+0000 7f5ec2000640 1 -- 172.21.15.7:0/3286420850 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f5eb00d0840 con 0x7f5ec4074bf0 2024-04-23T15:08:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.169+0000 7f5ec9200640 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c7429780 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00cdac0 tx=0x7f5eb00d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7454d8f08b8b8697 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.169+0000 7f5eca600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5eac0a3dc0 0x7f5eac0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.169+0000 7f5eb6a00640 1 -- 172.21.15.7:0/4289280443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0020030 con 0x5634c7427390 2024-04-23T15:08:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.169+0000 7f5eb6a00640 1 -- 172.21.15.7:0/4289280443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5eb009cad0 con 0x5634c7427390 2024-04-23T15:08:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.169+0000 7f5eb6a00640 1 -- 172.21.15.7:0/4289280443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb009c1a0 con 0x5634c7427390 2024-04-23T15:08:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 -- 172.21.15.7:0/4289280443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 msgr2=0x5634c7429780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c7429780 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00cdac0 tx=0x7f5eb00d8670 comp rx=0 tx=0).stop 2024-04-23T15:08:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5eca600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5eac0a3dc0 0x7f5eac0a6280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc004af0 tx=0x7f5ebc004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 -- 172.21.15.7:0/4289280443 shutdown_connections 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c7429780 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c7426e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/4289280443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c741c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 -- 172.21.15.7:0/4289280443 >> 172.21.15.7:0/4289280443 conn(0x5634c74186c0 msgr2=0x5634c7418aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 -- 172.21.15.7:0/4289280443 shutdown_connections 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.170+0000 7f5ecf58c740 1 -- 172.21.15.7:0/4289280443 wait complete. 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.171+0000 7f5ecf58c740 1 -- start start 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.171+0000 7f5ecf58c740 1 Processor -- start 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 0x5634c74242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c74247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c7424d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5634c7429fc0 con 0x5634c741c1b0 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5634c733c2c0 con 0x5634c7427390 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5634c742a140 con 0x5634c741cad0 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ecf58c740 10 client.0 _ll_register_callbacks cb 0x5634c7094a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ec9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 0x5634c74242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ec9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 0x5634c74242b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57574/0 (socket says 172.21.15.7:57574) 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ec9c00640 1 -- 172.21.15.7:0/3672086498 learned_addr learned my addr 172.21.15.7:0/3672086498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ec9200640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c74247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5eca600640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c7424d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ec9c00640 1 -- 172.21.15.7:0/3672086498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 msgr2=0x5634c74247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.172+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c74247f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5ec9c00640 1 -- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 msgr2=0x5634c7424d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c7424d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5ec9c00640 1 -- 172.21.15.7:0/3672086498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634c734cfd0 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 0x5634c74242b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800be10 tx=0x7f5eb80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd9dd267d25f715 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5eab400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5eab400640 1 -- 172.21.15.7:0/3672086498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8012650 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5eab400640 1 -- 172.21.15.7:0/3672086498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f5eb80127f0 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.173+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eb009cad0 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5eab400640 1 -- 172.21.15.7:0/3672086498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5eb80129f0 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5ecf58c740 10 client.17037 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5634c7095210 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5eab400640 1 -- 172.21.15.7:0/3672086498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5eb009cad0 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5eab400640 1 -- 172.21.15.7:0/3672086498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5eb801bbf0 con 0x5634c741c1b0 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5ecf58c740 10 client.17037 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5ecf58c740 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5ecf58c740 20 client.17037 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.174+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c7437540 0x5634c7439950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.175+0000 7f5ecf58c740 4 client.17037 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:08:37.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.175+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634c7390320 con 0x5634c7437540 2024-04-23T15:08:37.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.175+0000 7f5ec9200640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c7437540 0x5634c7439950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.176+0000 7f5eab400640 10 client.17037 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.176+0000 7f5ec9200640 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c7437540 0x5634c7439950 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b4abb1441570614 server_cookie=724987de29c99da5 in_seq=0 out_seq=0 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5eab400640 1 -- 172.21.15.7:0/3672086498 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5634c7390320 con 0x5634c7437540 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5eab400640 10 client.17037 handle_command_reply: tid=0 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 client.17037 shutdown 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 msgr2=0x5634c74242b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 0x5634c74242b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800be10 tx=0x7f5eb80117b0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 shutdown_connections 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c7437540 0x5634c7439950 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c7424d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c74247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/3672086498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741c1b0 0x5634c74242b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5eab400640 0 client.17037 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.178+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 >> 172.21.15.7:0/3672086498 conn(0x5634c74186c0 msgr2=0x5634c741e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.179+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 shutdown_connections 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.179+0000 7f5ecf58c740 1 -- 172.21.15.7:0/3672086498 wait complete. 2024-04-23T15:08:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.179+0000 7f5ecf58c740 20 client.17037 trim_cache size 0 max 16384 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 Processor -- start 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 -- start start 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c7432e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c741eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c74176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41b59d0 con 0x5634c7427390 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41b7510 con 0x5634c741c1b0 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.201+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41b60a0 con 0x5634c741cad0 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c74176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c74176c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57586/0 (socket says 172.21.15.7:57586) 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 -- 172.21.15.7:0/2919796252 learned_addr learned my addr 172.21.15.7:0/2919796252 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5ec9200640 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c741eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c7432e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 -- 172.21.15.7:0/2919796252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 msgr2=0x5634c741eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c741eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 -- 172.21.15.7:0/2919796252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 msgr2=0x5634c7432e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c7432e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5eca600640 1 -- 172.21.15.7:0/2919796252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634c7413ea0 con 0x5634c7427390 2024-04-23T15:08:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.202+0000 7f5ec9200640 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c741eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.203+0000 7f5eca600640 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c74176c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc02fe20 tx=0x7f5ebc040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c631610490a4f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.203+0000 7f5eb6000640 1 -- 172.21.15.7:0/2919796252 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc003e00 con 0x5634c7427390 2024-04-23T15:08:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.203+0000 7f5eb6000640 1 -- 172.21.15.7:0/2919796252 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ebc02fe50 con 0x5634c7427390 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.203+0000 7f5eb6000640 1 -- 172.21.15.7:0/2919796252 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc030a00 con 0x5634c7427390 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2919796252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 msgr2=0x5634c74176c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c74176c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc02fe20 tx=0x7f5ebc040000 comp rx=0 tx=0).stop 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2919796252 shutdown_connections 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c7427390 0x5634c74176c0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741cad0 0x5634c741eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2919796252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c741c1b0 0x5634c7432e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2919796252 >> 172.21.15.7:0/2919796252 conn(0x5634c74186c0 msgr2=0x5634c7416fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2919796252 shutdown_connections 2024-04-23T15:08:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2919796252 wait complete. 2024-04-23T15:08:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.204+0000 7f5ecf58c740 1 -- start start 2024-04-23T15:08:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 Processor -- start 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741c1b0 0x5634c742f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 0x5634c742f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c742ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41b6e40 con 0x5634c741cad0 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41b6770 con 0x5634c7427390 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec41b39d0 con 0x5634c741c1b0 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.205+0000 7f5ecf58c740 10 client.0 _ll_register_callbacks cb 0x7f5eb800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 0x5634c742f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 0x5634c742f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57594/0 (socket says 172.21.15.7:57594) 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 -- 172.21.15.7:0/2630881766 learned_addr learned my addr 172.21.15.7:0/2630881766 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741c1b0 0x5634c742f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5eca600640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c742ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 -- 172.21.15.7:0/2630881766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741c1b0 msgr2=0x5634c742f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741c1b0 0x5634c742f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 -- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 msgr2=0x5634c742ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c742ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 -- 172.21.15.7:0/2630881766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634c7161620 con 0x5634c741cad0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5ec9200640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 0x5634c742f8f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5eb009a680 tx=0x7f5eb000b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b86a5dc5c0554c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.206+0000 7f5eab400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5eab400640 1 -- 172.21.15.7:0/2630881766 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0020040 con 0x5634c741cad0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5eab400640 1 -- 172.21.15.7:0/2630881766 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f5eb0098a40 con 0x5634c741cad0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ebc02fe50 con 0x5634c741cad0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5eab400640 1 -- 172.21.15.7:0/2630881766 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5eb009bd30 con 0x5634c741cad0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5ecf58c740 10 client.17043 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5634c749d5e0 con 0x5634c741cad0 2024-04-23T15:08:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5eab400640 1 -- 172.21.15.7:0/2630881766 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ebc02fe50 con 0x5634c741cad0 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5eab400640 1 -- 172.21.15.7:0/2630881766 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5eb00d6cb0 con 0x5634c741cad0 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5ecf58c740 10 client.17043 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.207+0000 7f5ecf58c740 10 client.17043 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.208+0000 7f5ecf58c740 20 client.17043 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.208+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c749d920 0x5634c749fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.208+0000 7f5ecf58c740 4 client.17043 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.208+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634c738a190 con 0x5634c749d920 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.208+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c749d920 0x5634c749fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.209+0000 7f5ec9c00640 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c749d920 0x5634c749fd10 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=610a49cb50bde176 server_cookie=ef75a8a2ed51efe1 in_seq=0 out_seq=0 2024-04-23T15:08:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.209+0000 7f5eab400640 10 client.17043 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.236+0000 7f5eab400640 1 -- 172.21.15.7:0/2630881766 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5634c738a190 con 0x5634c749d920 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.236+0000 7f5eab400640 10 client.17043 handle_command_reply: tid=0 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.236+0000 7f5ecf58c740 1 client.17043 shutdown 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 msgr2=0x5634c742f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 0x5634c742f8f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5eb009a680 tx=0x7f5eb000b530 comp rx=0 tx=0).stop 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 shutdown_connections 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5634c749d920 0x5634c749fd10 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5634c7427390 0x5634c742ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634c741cad0 0x5634c742f8f0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 --2- 172.21.15.7:0/2630881766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5634c741c1b0 0x5634c742f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5eab400640 0 client.17043 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 >> 172.21.15.7:0/2630881766 conn(0x5634c74186c0 msgr2=0x5634c7426370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 shutdown_connections 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 1 -- 172.21.15.7:0/2630881766 wait complete. 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.237+0000 7f5ecf58c740 20 client.17043 trim_cache size 0 max 16384 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:08:37.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:08:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:08:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:08:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.238+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5eac0a3dc0 msgr2=0x7f5eac0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.238+0000 7f5ecc600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5eac0a3dc0 0x7f5eac0a6280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc004af0 tx=0x7f5ebc004a40 comp rx=0 tx=0).stop 2024-04-23T15:08:37.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.238+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 msgr2=0x7f5ec419f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.238+0000 7f5ecc600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 0x7f5ec419f2c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000d950 tx=0x7f5eb000de10 comp rx=0 tx=0).stop 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 shutdown_connections 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5eac0a3dc0 0x7f5eac0a6280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ec41130c0 0x7f5ec41a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ec4074bf0 0x7f5ec419f2c0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 --2- 172.21.15.7:0/3286420850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ec40742d0 0x7f5ec419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 >> 172.21.15.7:0/3286420850 conn(0x7f5ec4079490 msgr2=0x7f5ec40fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 shutdown_connections 2024-04-23T15:08:37.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:37.239+0000 7f5ecc600640 1 -- 172.21.15.7:0/3286420850 wait complete. 2024-04-23T15:08:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:36 smithi007 ceph-mon[27906]: pgmap v541: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:36 smithi186 ceph-mon[31814]: pgmap v541: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:38 smithi137 ceph-mon[31694]: pgmap v542: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:38 smithi007 ceph-mon[27906]: pgmap v542: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:38 smithi186 ceph-mon[31814]: pgmap v542: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:40 smithi137 ceph-mon[31694]: pgmap v543: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:41.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:40 smithi007 ceph-mon[27906]: pgmap v543: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:40 smithi186 ceph-mon[31814]: pgmap v543: 129 pgs: 129 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:08:43.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:42 smithi007 ceph-mon[27906]: pgmap v544: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:42 smithi137 ceph-mon[31694]: pgmap v544: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:42 smithi186 ceph-mon[31814]: pgmap v544: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:08:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:44 smithi137 ceph-mon[31694]: pgmap v545: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:08:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:44 smithi007 ceph-mon[27906]: pgmap v545: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:08:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:44 smithi186 ceph-mon[31814]: pgmap v545: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:08:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:46 smithi137 ceph-mon[31694]: pgmap v546: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:08:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:46 smithi007 ceph-mon[27906]: pgmap v546: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:08:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:46 smithi186 ceph-mon[31814]: pgmap v546: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:08:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:48 smithi137 ceph-mon[31694]: pgmap v547: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:08:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:48 smithi007 ceph-mon[27906]: pgmap v547: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:08:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:48 smithi186 ceph-mon[31814]: pgmap v547: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:08:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 -- 172.21.15.7:0/1065309847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa28010e6d0 msgr2=0x7fa280110ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 --2- 172.21.15.7:0/1065309847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa28010e6d0 0x7fa280110ac0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa278009ca0 tx=0x7fa27802a950 comp rx=0 tx=0).stop 2024-04-23T15:08:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 -- 172.21.15.7:0/1065309847 shutdown_connections 2024-04-23T15:08:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 --2- 172.21.15.7:0/1065309847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280074cd0 0x7fa28010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 --2- 172.21.15.7:0/1065309847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa28010e6d0 0x7fa280110ac0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 --2- 172.21.15.7:0/1065309847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2800743b0 0x7fa280074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 -- 172.21.15.7:0/1065309847 >> 172.21.15.7:0/1065309847 conn(0x7fa2800fd940 msgr2=0x7fa2800ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 -- 172.21.15.7:0/1065309847 shutdown_connections 2024-04-23T15:08:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.389+0000 7fa285c00640 1 -- 172.21.15.7:0/1065309847 wait complete. 2024-04-23T15:08:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.390+0000 7fa285c00640 1 Processor -- start 2024-04-23T15:08:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.390+0000 7fa285c00640 1 -- start start 2024-04-23T15:08:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 0x7fa2801a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280074cd0 0x7fa2801a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28010e6d0 0x7fa28019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801142b0 con 0x7fa2800743b0 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa280114130 con 0x7fa280074cd0 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa280114430 con 0x7fa28010e6d0 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 0x7fa2801a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 0x7fa2801a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42776/0 (socket says 172.21.15.7:42776) 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa27fe00640 1 -- 172.21.15.7:0/1912848087 learned_addr learned my addr 172.21.15.7:0/1912848087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa27f400640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280074cd0 0x7fa2801a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.391+0000 7fa285200640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28010e6d0 0x7fa28019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27fe00640 1 -- 172.21.15.7:0/1912848087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28010e6d0 msgr2=0x7fa28019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27fe00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28010e6d0 0x7fa28019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27fe00640 1 -- 172.21.15.7:0/1912848087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280074cd0 msgr2=0x7fa2801a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27fe00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280074cd0 0x7fa2801a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27fe00640 1 -- 172.21.15.7:0/1912848087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28019adf0 con 0x7fa2800743b0 2024-04-23T15:08:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa285200640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28010e6d0 0x7fa28019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:08:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27fe00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 0x7fa2801a0470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e9f0 tx=0x7fa27000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27cc00640 1 -- 172.21.15.7:0/1912848087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27000cd80 con 0x7fa2800743b0 2024-04-23T15:08:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28019b0e0 con 0x7fa2800743b0 2024-04-23T15:08:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27cc00640 1 -- 172.21.15.7:0/1912848087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2700108e0 con 0x7fa2800743b0 2024-04-23T15:08:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa27cc00640 1 -- 172.21.15.7:0/1912848087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270018920 con 0x7fa2800743b0 2024-04-23T15:08:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.392+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a7330 con 0x7fa2800743b0 2024-04-23T15:08:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 Processor -- start 2024-04-23T15:08:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 -- start start 2024-04-23T15:08:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604f3c0 0x55b3e604f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e605a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e605c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b3e5fb5900 con 0x55b3e604fce0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b3e5f5bf20 con 0x55b3e605a5a0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.396+0000 7fa28a037740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b3e5fb18c0 con 0x55b3e604f3c0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.397+0000 7fa27cc00640 1 -- 172.21.15.7:0/1912848087 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa270010a90 con 0x7fa2800743b0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.397+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e605a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.397+0000 7fa285200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604f3c0 0x55b3e604f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.397+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e605a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42784/0 (socket says 172.21.15.7:42784) 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.397+0000 7fa27fe00640 1 -- 172.21.15.7:0/4259007202 learned_addr learned my addr 172.21.15.7:0/4259007202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.397+0000 7fa27f400640 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e605c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27fe00640 1 -- 172.21.15.7:0/4259007202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604f3c0 msgr2=0x55b3e604f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27fe00640 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604f3c0 0x55b3e604f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27fe00640 1 -- 172.21.15.7:0/4259007202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 msgr2=0x55b3e605c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27fe00640 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e605c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27fe00640 1 -- 172.21.15.7:0/4259007202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3e5f80e10 con 0x55b3e604fce0 2024-04-23T15:08:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27fe00640 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e605a060 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa2700ce310 tx=0x7fa2700d96f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68c6ab13f32c650 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa27cc00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2640a3d10 0x7fa2640a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.398+0000 7fa275600640 1 -- 172.21.15.7:0/4259007202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700e4070 con 0x55b3e604fce0 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.399+0000 7fa275600640 1 -- 172.21.15.7:0/4259007202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2700d32e0 con 0x55b3e604fce0 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.399+0000 7fa275600640 1 -- 172.21.15.7:0/4259007202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700cba80 con 0x55b3e604fce0 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.399+0000 7fa27cc00640 1 -- 172.21.15.7:0/1912848087 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7fa2700d1000 con 0x7fa2800743b0 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.399+0000 7fa285200640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2640a3d10 0x7fa2640a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.399+0000 7fa28a037740 1 -- 172.21.15.7:0/4259007202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 msgr2=0x55b3e605a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.399+0000 7fa28a037740 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e605a060 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa2700ce310 tx=0x7fa2700d96f0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 -- 172.21.15.7:0/4259007202 shutdown_connections 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e605c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e605a060 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 --2- 172.21.15.7:0/4259007202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604f3c0 0x55b3e604f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 -- 172.21.15.7:0/4259007202 >> 172.21.15.7:0/4259007202 conn(0x55b3e604b8d0 msgr2=0x55b3e604bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa285200640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2640a3d10 0x7fa2640a61d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa278009a60 tx=0x7fa27803c040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 -- 172.21.15.7:0/4259007202 shutdown_connections 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 -- 172.21.15.7:0/4259007202 wait complete. 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 -- start start 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.400+0000 7fa28a037740 1 Processor -- start 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6057650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604fce0 0x55b3e6057b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e60580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b3e605d140 con 0x55b3e604f3c0 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b3e5f6f2c0 con 0x55b3e604fce0 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b3e605d2c0 con 0x55b3e605a5a0 2024-04-23T15:08:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa28a037740 10 client.0 _ll_register_callbacks cb 0x55b3e5cc7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6057650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6057650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42796/0 (socket says 172.21.15.7:42796) 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.401+0000 7fa27fe00640 1 -- 172.21.15.7:0/3884668457 learned_addr learned my addr 172.21.15.7:0/3884668457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa285200640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e60580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27f400640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604fce0 0x55b3e6057b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27fe00640 1 -- 172.21.15.7:0/3884668457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 msgr2=0x55b3e60580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27fe00640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e60580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27fe00640 1 -- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604fce0 msgr2=0x55b3e6057b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27fe00640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604fce0 0x55b3e6057b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27fe00640 1 -- 172.21.15.7:0/3884668457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3e5f7ffd0 con 0x55b3e604f3c0 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa27fe00640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6057650 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa27009cb80 tx=0x7fa2700d12d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844fb37607e1955f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa26a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.402+0000 7fa26a000640 1 -- 172.21.15.7:0/3884668457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270066e90 con 0x55b3e604f3c0 2024-04-23T15:08:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa26a000640 1 -- 172.21.15.7:0/3884668457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7fa2700cb9e0 con 0x55b3e604f3c0 2024-04-23T15:08:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3e5fc3320 con 0x55b3e604f3c0 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa26a000640 1 -- 172.21.15.7:0/3884668457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa270061c30 con 0x55b3e604f3c0 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa28a037740 10 client.17055 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b3e5cc8210 con 0x55b3e604f3c0 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa26a000640 1 -- 172.21.15.7:0/3884668457 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55b3e5fc3320 con 0x55b3e604f3c0 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.403+0000 7fa26a000640 1 -- 172.21.15.7:0/3884668457 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa2700bd0d0 con 0x55b3e604f3c0 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa28a037740 10 client.17055 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa28a037740 10 client.17055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa28a037740 20 client.17055 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa28a037740 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e606a680 0x55b3e606ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa28a037740 4 client.17055 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3e5fbd190 con 0x55b3e606a680 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.404+0000 7fa27f400640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e606a680 0x55b3e606ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.405+0000 7fa27f400640 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e606a680 0x55b3e606ca70 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf19ac9360d3fa8 server_cookie=ff241cfbbb492cb1 in_seq=0 out_seq=0 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.405+0000 7fa26a000640 10 client.17055 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa26a000640 1 -- 172.21.15.7:0/3884668457 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b3e5fbd190 con 0x55b3e606a680 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa26a000640 10 client.17055 handle_command_reply: tid=0 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 client.17055 shutdown 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 msgr2=0x55b3e6057650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6057650 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa27009cb80 tx=0x7fa2700d12d0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 shutdown_connections 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e606a680 0x55b3e606ca70 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604fce0 0x55b3e6057b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e60580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 --2- 172.21.15.7:0/3884668457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6057650 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa26a000640 0 client.17055 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.407+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 >> 172.21.15.7:0/3884668457 conn(0x55b3e604b8d0 msgr2=0x55b3e604aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.408+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 shutdown_connections 2024-04-23T15:08:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.408+0000 7fa28a037740 1 -- 172.21.15.7:0/3884668457 wait complete. 2024-04-23T15:08:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.408+0000 7fa28a037740 20 client.17055 trim_cache size 0 max 16384 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.426+0000 7fa28a037740 1 Processor -- start 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 -- start start 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6059d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604fce0 0x55b3e60720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e60725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801b1550 con 0x55b3e604f3c0 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801b3090 con 0x55b3e605a5a0 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa28a037740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801b1c20 con 0x55b3e604fce0 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6059d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6059d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42802/0 (socket says 172.21.15.7:42802) 2024-04-23T15:08:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.427+0000 7fa27fe00640 1 -- 172.21.15.7:0/2110294443 learned_addr learned my addr 172.21.15.7:0/2110294443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27f400640 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604fce0 0x55b3e60720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa285200640 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e60725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27fe00640 1 -- 172.21.15.7:0/2110294443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604fce0 msgr2=0x55b3e60720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604fce0 0x55b3e60720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27fe00640 1 -- 172.21.15.7:0/2110294443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 msgr2=0x55b3e60725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e60725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27fe00640 1 -- 172.21.15.7:0/2110294443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3e5d94620 con 0x55b3e604f3c0 2024-04-23T15:08:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6059d80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e9c0 tx=0x7fa2700d1340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eb330f0f1ed124 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.428+0000 7fa274c00640 1 -- 172.21.15.7:0/2110294443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700cbe60 con 0x55b3e604f3c0 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.429+0000 7fa274c00640 1 -- 172.21.15.7:0/2110294443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2700d4910 con 0x55b3e604f3c0 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.429+0000 7fa274c00640 1 -- 172.21.15.7:0/2110294443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270064370 con 0x55b3e604f3c0 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.429+0000 7fa28a037740 1 -- 172.21.15.7:0/2110294443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 msgr2=0x55b3e6059d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.429+0000 7fa28a037740 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6059d80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e9c0 tx=0x7fa2700d1340 comp rx=0 tx=0).stop 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 -- 172.21.15.7:0/2110294443 shutdown_connections 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e605a5a0 0x55b3e60725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e604fce0 0x55b3e60720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 --2- 172.21.15.7:0/2110294443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604f3c0 0x55b3e6059d80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 -- 172.21.15.7:0/2110294443 >> 172.21.15.7:0/2110294443 conn(0x55b3e604b8d0 msgr2=0x55b3e6066c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 -- 172.21.15.7:0/2110294443 shutdown_connections 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 -- 172.21.15.7:0/2110294443 wait complete. 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 -- start start 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.430+0000 7fa28a037740 1 Processor -- start 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604f3c0 0x55b3e6054160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e60546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e6054be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801b29c0 con 0x55b3e604fce0 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801b22f0 con 0x55b3e604f3c0 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801af550 con 0x55b3e605a5a0 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa28a037740 10 client.0 _ll_register_callbacks cb 0x7fa2700e2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa27f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e60546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa27f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e60546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42814/0 (socket says 172.21.15.7:42814) 2024-04-23T15:08:50.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa27f400640 1 -- 172.21.15.7:0/2138402475 learned_addr learned my addr 172.21.15.7:0/2138402475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:08:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.431+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604f3c0 0x55b3e6054160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa285200640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e6054be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27f400640 1 -- 172.21.15.7:0/2138402475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 msgr2=0x55b3e6054be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27f400640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e6054be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27f400640 1 -- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604f3c0 msgr2=0x55b3e6054160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27f400640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604f3c0 0x55b3e6054160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27f400640 1 -- 172.21.15.7:0/2138402475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3e60cf910 con 0x55b3e604fce0 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa285200640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e6054be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604f3c0 0x55b3e6054160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa27f400640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e60546a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x55b3e604ca60 tx=0x7fa26c014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9d16d03e186978 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.432+0000 7fa26a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa26a000640 1 -- 172.21.15.7:0/2138402475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c004030 con 0x55b3e604fce0 2024-04-23T15:08:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2700d4910 con 0x55b3e604fce0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa26a000640 1 -- 172.21.15.7:0/2138402475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7fa26c0041d0 con 0x55b3e604fce0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa26a000640 1 -- 172.21.15.7:0/2138402475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa26c030050 con 0x55b3e604fce0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa28a037740 10 client.17061 fetch_fsmap learned FSMap version 32 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b3e60d0b70 con 0x55b3e604fce0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.433+0000 7fa26a000640 1 -- 172.21.15.7:0/2138402475 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2700d4910 con 0x55b3e604fce0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa26a000640 1 -- 172.21.15.7:0/2138402475 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa26c0035f0 con 0x55b3e604fce0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa28a037740 10 client.17061 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa28a037740 10 client.17061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa28a037740 20 client.17061 populate_metadata read hostname 'smithi007' 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa28a037740 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e60d12d0 0x55b3e60d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa28a037740 4 client.17061 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3e5f394b0 con 0x55b3e60d12d0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.434+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e60d12d0 0x55b3e60d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:08:50.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.435+0000 7fa27fe00640 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e60d12d0 0x55b3e60d36f0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04b40bcd7e39c0 server_cookie=55f54c2fdee5f4a5 in_seq=0 out_seq=0 2024-04-23T15:08:50.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.435+0000 7fa26a000640 10 client.17061 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa26a000640 1 -- 172.21.15.7:0/2138402475 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3e5f394b0 con 0x55b3e60d12d0 2024-04-23T15:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa26a000640 10 client.17061 handle_command_reply: tid=0 2024-04-23T15:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 client.17061 shutdown 2024-04-23T15:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 msgr2=0x55b3e60546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e60546a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x55b3e604ca60 tx=0x7fa26c014840 comp rx=0 tx=0).stop 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 shutdown_connections 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b3e60d12d0 0x55b3e60d36f0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3e605a5a0 0x55b3e6054be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b3e604fce0 0x55b3e60546a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 --2- 172.21.15.7:0/2138402475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b3e604f3c0 0x55b3e6054160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 >> 172.21.15.7:0/2138402475 conn(0x55b3e604b8d0 msgr2=0x55b3e604a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.466+0000 7fa26a000640 0 client.17061 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.467+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 shutdown_connections 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.467+0000 7fa28a037740 1 -- 172.21.15.7:0/2138402475 wait complete. 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.467+0000 7fa28a037740 20 client.17061 trim_cache size 0 max 16384 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:08:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:08:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2640a3d10 msgr2=0x7fa2640a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2640a3d10 0x7fa2640a61d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa278009a60 tx=0x7fa27803c040 comp rx=0 tx=0).stop 2024-04-23T15:08:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 msgr2=0x7fa2801a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:08:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 0x7fa2801a0470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e9f0 tx=0x7fa27000eeb0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 shutdown_connections 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2640a3d10 0x7fa2640a61d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa280074cd0 0x7fa2801a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28010e6d0 0x7fa28019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 --2- 172.21.15.7:0/1912848087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2800743b0 0x7fa2801a0470 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 >> 172.21.15.7:0/1912848087 conn(0x7fa2800fd940 msgr2=0x7fa2800ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.468+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 shutdown_connections 2024-04-23T15:08:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:08:50.469+0000 7fa285c00640 1 -- 172.21.15.7:0/1912848087 wait complete. 2024-04-23T15:08:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:50 smithi137 ceph-mon[31694]: pgmap v548: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:08:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:50 smithi007 ceph-mon[27906]: pgmap v548: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:08:51.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:50 smithi186 ceph-mon[31814]: pgmap v548: 129 pgs: 129 active+clean; 4.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:08:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:52 smithi137 ceph-mon[31694]: pgmap v549: 129 pgs: 129 active+clean; 4.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:08:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:52 smithi007 ceph-mon[27906]: pgmap v549: 129 pgs: 129 active+clean; 4.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:08:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:52 smithi186 ceph-mon[31814]: pgmap v549: 129 pgs: 129 active+clean; 4.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:08:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:54 smithi137 ceph-mon[31694]: pgmap v550: 129 pgs: 129 active+clean; 4.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:08:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:54 smithi007 ceph-mon[27906]: pgmap v550: 129 pgs: 129 active+clean; 4.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:08:55.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:54 smithi186 ceph-mon[31814]: pgmap v550: 129 pgs: 129 active+clean; 4.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:08:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:56 smithi137 ceph-mon[31694]: pgmap v551: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:08:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:56 smithi007 ceph-mon[27906]: pgmap v551: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:08:57.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:56 smithi186 ceph-mon[31814]: pgmap v551: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:08:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:08:58 smithi137 ceph-mon[31694]: pgmap v552: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:08:58 smithi007 ceph-mon[27906]: pgmap v552: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:08:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:08:58 smithi186 ceph-mon[31814]: pgmap v552: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:01.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:00 smithi186 ceph-mon[31814]: pgmap v553: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:00 smithi137 ceph-mon[31694]: pgmap v553: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:00 smithi007 ceph-mon[27906]: pgmap v553: 129 pgs: 129 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:02 smithi137 ceph-mon[31694]: pgmap v554: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:09:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:02 smithi007 ceph-mon[27906]: pgmap v554: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:09:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:02 smithi186 ceph-mon[31814]: pgmap v554: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 -- 172.21.15.7:0/2526694656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038102c00 msgr2=0x7f2038106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 --2- 172.21.15.7:0/2526694656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038102c00 0x7f2038106c40 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f2024009900 tx=0x7f202402a410 comp rx=0 tx=0).stop 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 -- 172.21.15.7:0/2526694656 shutdown_connections 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 --2- 172.21.15.7:0/2526694656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2038107320 0x7f203810eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 --2- 172.21.15.7:0/2526694656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038102c00 0x7f2038106c40 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 --2- 172.21.15.7:0/2526694656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2038102250 0x7f2038102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 -- 172.21.15.7:0/2526694656 >> 172.21.15.7:0/2526694656 conn(0x7f2038079490 msgr2=0x7f20380798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 -- 172.21.15.7:0/2526694656 shutdown_connections 2024-04-23T15:09:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.627+0000 7f203d400640 1 -- 172.21.15.7:0/2526694656 wait complete. 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.628+0000 7f203d400640 1 Processor -- start 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.628+0000 7f203d400640 1 -- start start 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f203d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2038102250 0x7f20381a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f203d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 0x7f20381a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f203d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203819a740 0x7f203819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f203d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2038112240 con 0x7f2038107320 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f203d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20381120c0 con 0x7f203819a740 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f203d400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20381123c0 con 0x7f2038102250 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f2035e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 0x7f20381a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f2035e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 0x7f20381a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53996/0 (socket says 172.21.15.7:53996) 2024-04-23T15:09:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f2035e00640 1 -- 172.21.15.7:0/646969857 learned_addr learned my addr 172.21.15.7:0/646969857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f2037200640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203819a740 0x7f203819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.629+0000 7f2036800640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2038102250 0x7f20381a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.630+0000 7f2035e00640 1 -- 172.21.15.7:0/646969857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2038102250 msgr2=0x7f20381a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.630+0000 7f2035e00640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2038102250 0x7f20381a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.630+0000 7f2035e00640 1 -- 172.21.15.7:0/646969857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203819a740 msgr2=0x7f203819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.630+0000 7f2035e00640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203819a740 0x7f203819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.630+0000 7f2035e00640 1 -- 172.21.15.7:0/646969857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203819b340 con 0x7f2038107320 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.630+0000 7f2035e00640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 0x7f20381a0bc0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f2024004270 tx=0x7f20240042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.631+0000 7f202f400640 1 -- 172.21.15.7:0/646969857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202403f030 con 0x7f2038107320 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.631+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203819b5d0 con 0x7f2038107320 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.631+0000 7f202f400640 1 -- 172.21.15.7:0/646969857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20240044c0 con 0x7f2038107320 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.631+0000 7f202f400640 1 -- 172.21.15.7:0/646969857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024035070 con 0x7f2038107320 2024-04-23T15:09:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.631+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20381a7710 con 0x7f2038107320 2024-04-23T15:09:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.635+0000 7f204026e740 1 Processor -- start 2024-04-23T15:09:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.635+0000 7f204026e740 1 -- start start 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f204026e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd61590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f204026e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd6be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f204026e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd6e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f204026e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6cfcc7900 con 0x55a6cfd61ad0 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f204026e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a6cfc6df20 con 0x55a6cfd611b0 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f204026e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a6cfcc38c0 con 0x55a6cfd6c390 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f2036800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd6be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f2036800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd6be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54000/0 (socket says 172.21.15.7:54000) 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f2036800640 1 -- 172.21.15.7:0/4091313593 learned_addr learned my addr 172.21.15.7:0/4091313593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.636+0000 7f202f400640 1 -- 172.21.15.7:0/646969857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2024042030 con 0x7f2038107320 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2037200640 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd61590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2036800640 1 -- 172.21.15.7:0/4091313593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 msgr2=0x55a6cfd6e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2036800640 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd6e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2036800640 1 -- 172.21.15.7:0/4091313593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 msgr2=0x55a6cfd61590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2036800640 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd61590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2036800640 1 -- 172.21.15.7:0/4091313593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cfc92e10 con 0x55a6cfd61ad0 2024-04-23T15:09:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2037200640 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd61590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.637+0000 7f2036800640 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd6be50 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f202800dcb0 tx=0x7f202800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeaead4dc1654b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.638+0000 7f2023400640 1 -- 172.21.15.7:0/4091313593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028011440 con 0x55a6cfd61ad0 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.638+0000 7f2023400640 1 -- 172.21.15.7:0/4091313593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2028011a90 con 0x55a6cfd61ad0 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.638+0000 7f2023400640 1 -- 172.21.15.7:0/4091313593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202801ba50 con 0x55a6cfd61ad0 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.638+0000 7f204026e740 1 -- 172.21.15.7:0/4091313593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 msgr2=0x55a6cfd6be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd6be50 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f202800dcb0 tx=0x7f202800f730 comp rx=0 tx=0).stop 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.638+0000 7f202f400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f201c0a3dc0 0x7f201c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f202f400640 1 -- 172.21.15.7:0/646969857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f20240f1160 con 0x7f2038107320 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 -- 172.21.15.7:0/4091313593 shutdown_connections 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd6e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd6be50 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 --2- 172.21.15.7:0/4091313593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd61590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 -- 172.21.15.7:0/4091313593 >> 172.21.15.7:0/4091313593 conn(0x55a6cfd5d6c0 msgr2=0x55a6cfd5daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f2037200640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f201c0a3dc0 0x7f201c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 -- 172.21.15.7:0/4091313593 shutdown_connections 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.639+0000 7f204026e740 1 -- 172.21.15.7:0/4091313593 wait complete. 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 -- start start 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 Processor -- start 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f2037200640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f201c0a3dc0 0x7f201c0a6280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2030007e90 tx=0x7f2030007870 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 0x55a6cfd693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd69900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd69e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6cfd6efc0 con 0x55a6cfd611b0 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a6cfc812c0 con 0x55a6cfd61ad0 2024-04-23T15:09:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a6cfd6f140 con 0x55a6cfd6c390 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.640+0000 7f204026e740 10 client.0 _ll_register_callbacks cb 0x55a6cf9d9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 0x55a6cfd693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 0x55a6cfd693c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54008/0 (socket says 172.21.15.7:54008) 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 -- 172.21.15.7:0/656280041 learned_addr learned my addr 172.21.15.7:0/656280041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2035e00640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd69900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2037200640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd69e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 -- 172.21.15.7:0/656280041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 msgr2=0x55a6cfd69e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd69e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 -- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd61ad0 msgr2=0x55a6cfd69900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd69900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.641+0000 7f2036800640 1 -- 172.21.15.7:0/656280041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cfc91fd0 con 0x55a6cfd611b0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f2036800640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 0x55a6cfd693c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2028006010 tx=0x7f202801b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53863fa3d79e395 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f2017e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f2017e00640 1 -- 172.21.15.7:0/656280041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202802a060 con 0x55a6cfd611b0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f2017e00640 1 -- 172.21.15.7:0/656280041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f2028004250 con 0x55a6cfd611b0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2028011a90 con 0x55a6cfd611b0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f2017e00640 1 -- 172.21.15.7:0/656280041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2028031050 con 0x55a6cfd611b0 2024-04-23T15:09:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f204026e740 10 client.17073 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.642+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a6cf9da210 con 0x55a6cfd611b0 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f2017e00640 1 -- 172.21.15.7:0/656280041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2028011a90 con 0x55a6cfd611b0 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f2017e00640 1 -- 172.21.15.7:0/656280041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f202801bb80 con 0x55a6cfd611b0 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f204026e740 10 client.17073 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f204026e740 10 client.17073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f204026e740 20 client.17073 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f204026e740 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfd7c4e0 0x55a6cfd7e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f204026e740 4 client.17073 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.643+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6cfcd5320 con 0x55a6cfd7c4e0 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.644+0000 7f2035e00640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfd7c4e0 0x55a6cfd7e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.645+0000 7f2017e00640 10 client.17073 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.645+0000 7f2035e00640 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfd7c4e0 0x55a6cfd7e8d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425ca34b965820fe server_cookie=a4d0804955ed2659 in_seq=0 out_seq=0 2024-04-23T15:09:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f2017e00640 1 -- 172.21.15.7:0/656280041 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a6cfcd5320 con 0x55a6cfd7c4e0 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f2017e00640 10 client.17073 handle_command_reply: tid=0 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 client.17073 shutdown 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 msgr2=0x55a6cfd693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 0x55a6cfd693c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2028006010 tx=0x7f202801b520 comp rx=0 tx=0).stop 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 shutdown_connections 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfd7c4e0 0x55a6cfd7e8d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd69900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd6c390 0x55a6cfd69e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 --2- 172.21.15.7:0/656280041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd611b0 0x55a6cfd693c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f2017e00640 0 client.17073 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 >> 172.21.15.7:0/656280041 conn(0x55a6cfd5d6c0 msgr2=0x55a6cfd63440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 shutdown_connections 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.647+0000 7f204026e740 1 -- 172.21.15.7:0/656280041 wait complete. 2024-04-23T15:09:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.648+0000 7f204026e740 20 client.17073 trim_cache size 0 max 16384 2024-04-23T15:09:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 Processor -- start 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 -- start start 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd77e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd83e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20381b14f0 con 0x55a6cfd6c390 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20381b3030 con 0x55a6cfd611b0 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.664+0000 7f204026e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20381b1bc0 con 0x55a6cfd61ad0 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd843b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54016/0 (socket says 172.21.15.7:54016) 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 -- 172.21.15.7:0/111557498 learned_addr learned my addr 172.21.15.7:0/111557498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2035e00640 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd83e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2036800640 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd77e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 -- 172.21.15.7:0/111557498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 msgr2=0x55a6cfd83e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd83e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 -- 172.21.15.7:0/111557498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 msgr2=0x55a6cfd77e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd77e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2037200640 1 -- 172.21.15.7:0/111557498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cfaa6620 con 0x55a6cfd6c390 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.665+0000 7f2036800640 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd77e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.666+0000 7f2037200640 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd843b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2030011710 tx=0x7f2030013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d22dff444ccf8f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.666+0000 7f2022a00640 1 -- 172.21.15.7:0/111557498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203001e800 con 0x55a6cfd6c390 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.666+0000 7f2022a00640 1 -- 172.21.15.7:0/111557498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f203001ee50 con 0x55a6cfd6c390 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.666+0000 7f2022a00640 1 -- 172.21.15.7:0/111557498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20300273d0 con 0x55a6cfd6c390 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 -- 172.21.15.7:0/111557498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 msgr2=0x55a6cfd843b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd843b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2030011710 tx=0x7f2030013000 comp rx=0 tx=0).stop 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 -- 172.21.15.7:0/111557498 shutdown_connections 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd843b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd83e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 --2- 172.21.15.7:0/111557498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd77e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 -- 172.21.15.7:0/111557498 >> 172.21.15.7:0/111557498 conn(0x55a6cfd5d6c0 msgr2=0x55a6cfd64710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 -- 172.21.15.7:0/111557498 shutdown_connections 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.667+0000 7f204026e740 1 -- 172.21.15.7:0/111557498 wait complete. 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 -- start start 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 Processor -- start 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd67060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd74390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd65650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20381b2960 con 0x55a6cfd6c390 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20381b2290 con 0x55a6cfd611b0 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20381af4f0 con 0x55a6cfd61ad0 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.668+0000 7f204026e740 10 client.0 _ll_register_callbacks cb 0x7f2028015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd65650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd65650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54030/0 (socket says 172.21.15.7:54030) 2024-04-23T15:09:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 -- 172.21.15.7:0/1473023128 learned_addr learned my addr 172.21.15.7:0/1473023128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2036800640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd67060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2035e00640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd74390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 -- 172.21.15.7:0/1473023128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 msgr2=0x55a6cfd74390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd74390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 -- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 msgr2=0x55a6cfd67060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd67060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.669+0000 7f2037200640 1 -- 172.21.15.7:0/1473023128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cfd65b90 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f2037200640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd65650 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f203001fb60 tx=0x7f2030020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1a25ac74d98d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f2017e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f2017e00640 1 -- 172.21.15.7:0/1473023128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030035020 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f2017e00640 1 -- 172.21.15.7:0/1473023128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9467+0+0 (secure 0 0 0) 0x7f203001f630 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203001ee50 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f2017e00640 1 -- 172.21.15.7:0/1473023128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2030040050 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f204026e740 10 client.17079 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.670+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a6cfde1dd0 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f2017e00640 1 -- 172.21.15.7:0/1473023128 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f203001ee50 con 0x55a6cfd6c390 2024-04-23T15:09:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f2017e00640 1 -- 172.21.15.7:0/1473023128 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2030030030 con 0x55a6cfd6c390 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f204026e740 10 client.17079 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f204026e740 10 client.17079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f204026e740 20 client.17079 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f204026e740 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfde2480 0x55a6cfde48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f204026e740 4 client.17079 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.671+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a6cfccf190 con 0x55a6cfde2480 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.672+0000 7f2036800640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfde2480 0x55a6cfde48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.673+0000 7f2036800640 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfde2480 0x55a6cfde48a0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7546f0c033b5d9b0 server_cookie=1e845e258e7109f1 in_seq=0 out_seq=0 2024-04-23T15:09:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.673+0000 7f2017e00640 10 client.17079 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f2017e00640 1 -- 172.21.15.7:0/1473023128 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a6cfccf190 con 0x55a6cfde2480 2024-04-23T15:09:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f2017e00640 10 client.17079 handle_command_reply: tid=0 2024-04-23T15:09:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 client.17079 shutdown 2024-04-23T15:09:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 msgr2=0x55a6cfd65650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd65650 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f203001fb60 tx=0x7f2030020f60 comp rx=0 tx=0).stop 2024-04-23T15:09:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 shutdown_connections 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6cfde2480 0x55a6cfde48a0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6cfd6c390 0x55a6cfd65650 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6cfd61ad0 0x55a6cfd74390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 --2- 172.21.15.7:0/1473023128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6cfd611b0 0x55a6cfd67060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f2017e00640 0 client.17079 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.699+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 >> 172.21.15.7:0/1473023128 conn(0x55a6cfd5d6c0 msgr2=0x55a6cfd69340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.700+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 shutdown_connections 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.700+0000 7f204026e740 1 -- 172.21.15.7:0/1473023128 wait complete. 2024-04-23T15:09:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.700+0000 7f204026e740 20 client.17079 trim_cache size 0 max 16384 2024-04-23T15:09:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:09:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:09:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:09:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f201c0a3dc0 msgr2=0x7f201c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f201c0a3dc0 0x7f201c0a6280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2030007e90 tx=0x7f2030007870 comp rx=0 tx=0).stop 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 msgr2=0x7f20381a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 0x7f20381a0bc0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f2024004270 tx=0x7f20240042a0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 shutdown_connections 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f201c0a3dc0 0x7f201c0a6280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f203819a740 0x7f203819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2038107320 0x7f20381a0bc0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 --2- 172.21.15.7:0/646969857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2038102250 0x7f20381a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 >> 172.21.15.7:0/646969857 conn(0x7f2038079490 msgr2=0x7f2038100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 shutdown_connections 2024-04-23T15:09:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:03.701+0000 7f203d400640 1 -- 172.21.15.7:0/646969857 wait complete. 2024-04-23T15:09:05.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:04 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:09:05.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:04 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:09:05.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:04 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:09:06.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:05 smithi007 ceph-mon[27906]: pgmap v555: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 26 op/s 2024-04-23T15:09:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:05 smithi186 ceph-mon[31814]: pgmap v555: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 26 op/s 2024-04-23T15:09:06.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:05 smithi137 ceph-mon[31694]: pgmap v555: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 26 op/s 2024-04-23T15:09:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:06 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:09:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:06 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:09:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:06 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:09:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:06 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:09:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:06 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:09:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:06 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:09:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:06 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:09:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:06 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:09:07.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:06 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:09:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:07 smithi007 ceph-mon[27906]: pgmap v556: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 35 op/s 2024-04-23T15:09:08.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:07 smithi186 ceph-mon[31814]: pgmap v556: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 35 op/s 2024-04-23T15:09:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:07 smithi137 ceph-mon[31694]: pgmap v556: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 35 op/s 2024-04-23T15:09:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:09 smithi007 ceph-mon[27906]: osdmap e115: 12 total, 12 up, 12 in 2024-04-23T15:09:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:09 smithi007 ceph-mon[27906]: pgmap v558: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:09:09.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:09 smithi186 ceph-mon[31814]: osdmap e115: 12 total, 12 up, 12 in 2024-04-23T15:09:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:09 smithi186 ceph-mon[31814]: pgmap v558: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:09:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:09 smithi137 ceph-mon[31694]: osdmap e115: 12 total, 12 up, 12 in 2024-04-23T15:09:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:09 smithi137 ceph-mon[31694]: pgmap v558: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:09:11.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:10 smithi137 ceph-mon[31694]: pgmap v559: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:09:11.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:10 smithi007 ceph-mon[27906]: pgmap v559: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:09:11.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:10 smithi186 ceph-mon[31814]: pgmap v559: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:09:13.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:12 smithi007 ceph-mon[27906]: pgmap v560: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-04-23T15:09:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:12 smithi137 ceph-mon[31694]: pgmap v560: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-04-23T15:09:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:12 smithi186 ceph-mon[31814]: pgmap v560: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-04-23T15:09:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:14 smithi137 ceph-mon[31694]: pgmap v561: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-04-23T15:09:15.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:14 smithi007 ceph-mon[27906]: pgmap v561: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-04-23T15:09:15.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:14 smithi186 ceph-mon[31814]: pgmap v561: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-04-23T15:09:16.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:16 smithi007 ceph-mon[27906]: osdmap e116: 12 total, 12 up, 12 in 2024-04-23T15:09:16.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:16 smithi186 ceph-mon[31814]: osdmap e116: 12 total, 12 up, 12 in 2024-04-23T15:09:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 -- 172.21.15.7:0/2155831434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed810c3e0 msgr2=0x7f3ed810e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 --2- 172.21.15.7:0/2155831434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed810c3e0 0x7f3ed810e880 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009ca0 tx=0x7f3ed002a950 comp rx=0 tx=0).stop 2024-04-23T15:09:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 -- 172.21.15.7:0/2155831434 shutdown_connections 2024-04-23T15:09:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 --2- 172.21.15.7:0/2155831434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed810c3e0 0x7f3ed810e880 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 --2- 172.21.15.7:0/2155831434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed81038e0 0x7f3ed810bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 --2- 172.21.15.7:0/2155831434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 -- 172.21.15.7:0/2155831434 >> 172.21.15.7:0/2155831434 conn(0x7f3ed80fc820 msgr2=0x7f3ed80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 -- 172.21.15.7:0/2155831434 shutdown_connections 2024-04-23T15:09:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.872+0000 7f3ed7200640 1 -- 172.21.15.7:0/2155831434 wait complete. 2024-04-23T15:09:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.873+0000 7f3ed7200640 1 Processor -- start 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 -- start start 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed81038e0 0x7f3ed81a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed810c3e0 0x7f3ed819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81120a0 con 0x7f3ed8102fc0 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8111f20 con 0x7f3ed810c3e0 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8112220 con 0x7f3ed81038e0 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55472/0 (socket says 172.21.15.7:55472) 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.874+0000 7f3ed5e00640 1 -- 172.21.15.7:0/4191180875 learned_addr learned my addr 172.21.15.7:0/4191180875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5400640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed81038e0 0x7f3ed81a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed6800640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed810c3e0 0x7f3ed819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5e00640 1 -- 172.21.15.7:0/4191180875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed81038e0 msgr2=0x7f3ed81a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed81038e0 0x7f3ed81a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5e00640 1 -- 172.21.15.7:0/4191180875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed810c3e0 msgr2=0x7f3ed819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed810c3e0 0x7f3ed819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5e00640 1 -- 172.21.15.7:0/4191180875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed819ad60 con 0x7f3ed8102fc0 2024-04-23T15:09:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed6800640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed810c3e0 0x7f3ed819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:09:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.875+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81a0430 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800d950 tx=0x7f3ec800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.876+0000 7f3ecea00640 1 -- 172.21.15.7:0/4191180875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8017070 con 0x7f3ed8102fc0 2024-04-23T15:09:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.876+0000 7f3ecea00640 1 -- 172.21.15.7:0/4191180875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ec8009c30 con 0x7f3ed8102fc0 2024-04-23T15:09:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.876+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed819b050 con 0x7f3ed8102fc0 2024-04-23T15:09:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.876+0000 7f3ecea00640 1 -- 172.21.15.7:0/4191180875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800f620 con 0x7f3ed8102fc0 2024-04-23T15:09:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.876+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed81a72f0 con 0x7f3ed8102fc0 2024-04-23T15:09:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 Processor -- start 2024-04-23T15:09:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 -- start start 2024-04-23T15:09:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ebb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562384e21900 con 0x562384ebbce0 2024-04-23T15:09:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562384dc7f20 con 0x562384ec65a0 2024-04-23T15:09:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.880+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562384e1d8c0 con 0x562384ebb3c0 2024-04-23T15:09:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.881+0000 7f3ecea00640 1 -- 172.21.15.7:0/4191180875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3ec80109a0 con 0x7f3ed8102fc0 2024-04-23T15:09:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.881+0000 7f3ed6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ebb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.881+0000 7f3ed5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.881+0000 7f3ed5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.881+0000 7f3ed5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55478/0 (socket says 172.21.15.7:55478) 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.881+0000 7f3ed5e00640 1 -- 172.21.15.7:0/2795330415 learned_addr learned my addr 172.21.15.7:0/2795330415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.882+0000 7f3ed5e00640 1 -- 172.21.15.7:0/2795330415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 msgr2=0x562384ebb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.882+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ebb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.882+0000 7f3ed5e00640 1 -- 172.21.15.7:0/2795330415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 msgr2=0x562384ec8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.882+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.882+0000 7f3ed5e00640 1 -- 172.21.15.7:0/2795330415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562384dece10 con 0x562384ebbce0 2024-04-23T15:09:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.882+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec6060 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80cdaf0 tx=0x7f3ec80d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0271e33cfc5c6da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.883+0000 7f3ecea00640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3ebc0a3d90 0x7f3ebc0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.883+0000 7f3ec3400640 1 -- 172.21.15.7:0/2795330415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80df070 con 0x562384ebbce0 2024-04-23T15:09:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.883+0000 7f3ec3400640 1 -- 172.21.15.7:0/2795330415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ec80d3e50 con 0x562384ebbce0 2024-04-23T15:09:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.883+0000 7f3ec3400640 1 -- 172.21.15.7:0/2795330415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec809cb00 con 0x562384ebbce0 2024-04-23T15:09:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.883+0000 7f3ed6800640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3ebc0a3d90 0x7f3ebc0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3ecea00640 1 -- 172.21.15.7:0/4191180875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f3ec80d0870 con 0x7f3ed8102fc0 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2795330415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 msgr2=0x562384ec6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec6060 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80cdaf0 tx=0x7f3ec80d8670 comp rx=0 tx=0).stop 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3ed6800640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3ebc0a3d90 0x7f3ebc0a6250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009a60 tx=0x7f3ed003c040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2795330415 shutdown_connections 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec6060 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2795330415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ebb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.884+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2795330415 >> 172.21.15.7:0/2795330415 conn(0x562384eb78d0 msgr2=0x562384eb7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.885+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2795330415 shutdown_connections 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.885+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2795330415 wait complete. 2024-04-23T15:09:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.885+0000 7f3edfdd5740 1 -- start start 2024-04-23T15:09:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.885+0000 7f3edfdd5740 1 Processor -- start 2024-04-23T15:09:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ec3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562384ec9140 con 0x562384ebbce0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562384ddb2c0 con 0x562384ec65a0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562384ec92c0 con 0x562384ebb3c0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3edfdd5740 10 client.0 _ll_register_callbacks cb 0x562384b33a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3ed5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3ed5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55490/0 (socket says 172.21.15.7:55490) 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3ed5400640 1 -- 172.21.15.7:0/3389617590 learned_addr learned my addr 172.21.15.7:0/3389617590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3ed6800640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.886+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ec3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3ed5400640 1 -- 172.21.15.7:0/3389617590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 msgr2=0x562384ec3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3ed5400640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ec3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3ed5400640 1 -- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 msgr2=0x562384ec40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3ed5400640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3ed5400640 1 -- 172.21.15.7:0/3389617590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562384debfd0 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3ed5400640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec3b90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40116c0 tx=0x7f3ec4011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb7a8317c29ac9f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3eb7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3eb7e00640 1 -- 172.21.15.7:0/3389617590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400f9a0 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3eb7e00640 1 -- 172.21.15.7:0/3389617590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f3ec400fb40 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.887+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ec80d3e50 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.888+0000 7f3eb7e00640 1 -- 172.21.15.7:0/3389617590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3ec4022050 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.888+0000 7f3edfdd5740 10 client.17091 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.888+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562384b34210 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.888+0000 7f3eb7e00640 1 -- 172.21.15.7:0/3389617590 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ec80d3e50 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.888+0000 7f3eb7e00640 1 -- 172.21.15.7:0/3389617590 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3ec4018030 con 0x562384ebbce0 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3edfdd5740 10 client.17091 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3edfdd5740 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3edfdd5740 20 client.17091 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384ed8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3edfdd5740 4 client.17091 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:09:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562384e2f320 con 0x562384ed68a0 2024-04-23T15:09:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.889+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384ed8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.890+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384ed8cb0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec258ddffa78671d server_cookie=620a3db09488d354 in_seq=0 out_seq=0 2024-04-23T15:09:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.890+0000 7f3eb7e00640 10 client.17091 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.897+0000 7f3eb7e00640 1 -- 172.21.15.7:0/3389617590 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562384e2f320 con 0x562384ed68a0 2024-04-23T15:09:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.897+0000 7f3eb7e00640 10 client.17091 handle_command_reply: tid=0 2024-04-23T15:09:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.897+0000 7f3edfdd5740 1 client.17091 shutdown 2024-04-23T15:09:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.897+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 msgr2=0x562384ec3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.897+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec3b90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40116c0 tx=0x7f3ec4011b80 comp rx=0 tx=0).stop 2024-04-23T15:09:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 shutdown_connections 2024-04-23T15:09:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384ed8cb0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ec40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384ec3b90 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/3389617590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ec3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3eb7e00640 0 client.17091 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 >> 172.21.15.7:0/3389617590 conn(0x562384eb78d0 msgr2=0x562384eb6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 shutdown_connections 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 1 -- 172.21.15.7:0/3389617590 wait complete. 2024-04-23T15:09:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.898+0000 7f3edfdd5740 20 client.17091 trim_cache size 0 max 16384 2024-04-23T15:09:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:16 smithi137 ceph-mon[31694]: osdmap e116: 12 total, 12 up, 12 in 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.917+0000 7f3edfdd5740 1 Processor -- start 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 -- start start 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ebb3c0 0x562384ed2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebbce0 0x562384ebdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 0x562384ede5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81b1490 con 0x562384ec65a0 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81b2fd0 con 0x562384ebb3c0 2024-04-23T15:09:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81b1b60 con 0x562384ebbce0 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3ed6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 0x562384ede5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.918+0000 7f3ed6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 0x562384ede5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55498/0 (socket says 172.21.15.7:55498) 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 -- 172.21.15.7:0/1404129640 learned_addr learned my addr 172.21.15.7:0/1404129640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed5400640 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebbce0 0x562384ebdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ebb3c0 0x562384ed2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 -- 172.21.15.7:0/1404129640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebbce0 msgr2=0x562384ebdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebbce0 0x562384ebdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 -- 172.21.15.7:0/1404129640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ebb3c0 msgr2=0x562384ed2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ebb3c0 0x562384ed2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 -- 172.21.15.7:0/1404129640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562384ebbb10 con 0x562384ec65a0 2024-04-23T15:09:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.919+0000 7f3ed6800640 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 0x562384ede5c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0035000 tx=0x7f3ed0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da47bc754e300adb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.920+0000 7f3ec2a00640 1 -- 172.21.15.7:0/1404129640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0034050 con 0x562384ec65a0 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.920+0000 7f3ec2a00640 1 -- 172.21.15.7:0/1404129640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ed0003e10 con 0x562384ec65a0 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.920+0000 7f3ec2a00640 1 -- 172.21.15.7:0/1404129640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00306a0 con 0x562384ec65a0 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 -- 172.21.15.7:0/1404129640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 msgr2=0x562384ede5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 0x562384ede5c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0035000 tx=0x7f3ed0040000 comp rx=0 tx=0).stop 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 -- 172.21.15.7:0/1404129640 shutdown_connections 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ec65a0 0x562384ede5c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebbce0 0x562384ebdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/1404129640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ebb3c0 0x562384ed2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 -- 172.21.15.7:0/1404129640 >> 172.21.15.7:0/1404129640 conn(0x562384eb78d0 msgr2=0x562384eb7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 -- 172.21.15.7:0/1404129640 shutdown_connections 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 -- 172.21.15.7:0/1404129640 wait complete. 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.921+0000 7f3edfdd5740 1 -- start start 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 Processor -- start 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ece620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384eceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ebfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81b2900 con 0x562384ebbce0 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81b2230 con 0x562384ec65a0 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed81af490 con 0x562384ebb3c0 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3edfdd5740 10 client.0 _ll_register_callbacks cb 0x7f3ec4005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.922+0000 7f3ed5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384eceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384eceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55504/0 (socket says 172.21.15.7:55504) 2024-04-23T15:09:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 -- 172.21.15.7:0/2749188580 learned_addr learned my addr 172.21.15.7:0/2749188580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ece620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed6800640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ebfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 -- 172.21.15.7:0/2749188580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 msgr2=0x562384ece620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ece620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 -- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 msgr2=0x562384ebfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ebfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 -- 172.21.15.7:0/2749188580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562384c00620 con 0x562384ebbce0 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ece620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3ed5400640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384eceb60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000c00 tx=0x7f3ec400f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d039d099c7b90e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.923+0000 7f3eb7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3eb7e00640 1 -- 172.21.15.7:0/2749188580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec401f040 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3eb7e00640 1 -- 172.21.15.7:0/2749188580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f3ec400fbb0 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ed0003e10 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3eb7e00640 1 -- 172.21.15.7:0/2749188580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3ec400fdb0 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3edfdd5740 10 client.17097 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562384f3c8c0 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.924+0000 7f3eb7e00640 1 -- 172.21.15.7:0/2749188580 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ed0003e10 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3eb7e00640 1 -- 172.21.15.7:0/2749188580 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3ec4018070 con 0x562384ebbce0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3edfdd5740 10 client.17097 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3edfdd5740 10 client.17097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3edfdd5740 20 client.17097 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384f3f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3edfdd5740 4 client.17097 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562384e29190 con 0x562384ed68a0 2024-04-23T15:09:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.925+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384f3f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.926+0000 7f3ed5e00640 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384f3f100 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8a900841c2120e2 server_cookie=c12bee03d181ee25 in_seq=0 out_seq=0 2024-04-23T15:09:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.926+0000 7f3eb7e00640 10 client.17097 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3eb7e00640 1 -- 172.21.15.7:0/2749188580 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562384e29190 con 0x562384ed68a0 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3eb7e00640 10 client.17097 handle_command_reply: tid=0 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 client.17097 shutdown 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 msgr2=0x562384eceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384eceb60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000c00 tx=0x7f3ec400f8d0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 shutdown_connections 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562384ed68a0 0x562384f3f100 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562384ec65a0 0x562384ebfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562384ebbce0 0x562384eceb60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3eb7e00640 0 client.17097 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 --2- 172.21.15.7:0/2749188580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562384ebb3c0 0x562384ece620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.957+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 >> 172.21.15.7:0/2749188580 conn(0x562384eb78d0 msgr2=0x562384eb6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.958+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 shutdown_connections 2024-04-23T15:09:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.958+0000 7f3edfdd5740 1 -- 172.21.15.7:0/2749188580 wait complete. 2024-04-23T15:09:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.958+0000 7f3edfdd5740 20 client.17097 trim_cache size 0 max 16384 2024-04-23T15:09:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:09:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:09:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:09:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3ebc0a3d90 msgr2=0x7f3ebc0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3ebc0a3d90 0x7f3ebc0a6250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009a60 tx=0x7f3ed003c040 comp rx=0 tx=0).stop 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 msgr2=0x7f3ed81a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81a0430 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800d950 tx=0x7f3ec800de10 comp rx=0 tx=0).stop 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 shutdown_connections 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3ebc0a3d90 0x7f3ebc0a6250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ed810c3e0 0x7f3ed819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed81038e0 0x7f3ed81a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 --2- 172.21.15.7:0/4191180875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ed8102fc0 0x7f3ed81a0430 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 >> 172.21.15.7:0/4191180875 conn(0x7f3ed80fc820 msgr2=0x7f3ed80fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 shutdown_connections 2024-04-23T15:09:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:16.959+0000 7f3ed7200640 1 -- 172.21.15.7:0/4191180875 wait complete. 2024-04-23T15:09:17.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:17 smithi007 ceph-mon[27906]: pgmap v563: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 14 op/s 2024-04-23T15:09:17.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:17 smithi186 ceph-mon[31814]: pgmap v563: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 14 op/s 2024-04-23T15:09:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:17 smithi137 ceph-mon[31694]: pgmap v563: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 14 op/s 2024-04-23T15:09:19.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:18 smithi137 ceph-mon[31694]: pgmap v564: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:09:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:18 smithi007 ceph-mon[27906]: pgmap v564: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:09:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:18 smithi186 ceph-mon[31814]: pgmap v564: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:09:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:20 smithi137 ceph-mon[31694]: pgmap v565: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:09:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:20 smithi007 ceph-mon[27906]: pgmap v565: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:09:21.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:20 smithi186 ceph-mon[31814]: pgmap v565: 129 pgs: 129 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:09:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:22 smithi137 ceph-mon[31694]: pgmap v566: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:09:23.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:22 smithi007 ceph-mon[27906]: pgmap v566: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:09:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:22 smithi186 ceph-mon[31814]: pgmap v566: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:09:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:24 smithi137 ceph-mon[31694]: pgmap v567: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:09:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:24 smithi007 ceph-mon[27906]: pgmap v567: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:09:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:24 smithi186 ceph-mon[31814]: pgmap v567: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:09:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:26 smithi137 ceph-mon[31694]: pgmap v568: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 20 op/s 2024-04-23T15:09:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:26 smithi007 ceph-mon[27906]: pgmap v568: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 20 op/s 2024-04-23T15:09:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:26 smithi186 ceph-mon[31814]: pgmap v568: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.1 MiB/s wr, 20 op/s 2024-04-23T15:09:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:28 smithi137 ceph-mon[31694]: pgmap v569: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:28 smithi007 ceph-mon[27906]: pgmap v569: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:28 smithi186 ceph-mon[31814]: pgmap v569: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 -- 172.21.15.7:0/3606135488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 msgr2=0x7f000c10e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 --2- 172.21.15.7:0/3606135488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c10e480 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efff8009900 tx=0x7efff802a410 comp rx=0 tx=0).stop 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 -- 172.21.15.7:0/3606135488 shutdown_connections 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 --2- 172.21.15.7:0/3606135488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000c10e9c0 0x7f000c110db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 --2- 172.21.15.7:0/3606135488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c10e480 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 --2- 172.21.15.7:0/3606135488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f000c100e10 0x7f000c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 -- 172.21.15.7:0/3606135488 >> 172.21.15.7:0/3606135488 conn(0x7f000c0780b0 msgr2=0x7f000c0784c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 -- 172.21.15.7:0/3606135488 shutdown_connections 2024-04-23T15:09:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.111+0000 7f0013600640 1 -- 172.21.15.7:0/3606135488 wait complete. 2024-04-23T15:09:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.112+0000 7f0013600640 1 Processor -- start 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.112+0000 7f0013600640 1 -- start start 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0013600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000c100e10 0x7f000c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0013600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0013600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f000c10e9c0 0x7f000c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0013600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1144e0 con 0x7f000c101730 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0013600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f000c114360 con 0x7f000c10e9c0 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0013600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f000c114660 con 0x7f000c100e10 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f000be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f000be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c1a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59360/0 (socket says 172.21.15.7:59360) 2024-04-23T15:09:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f000be00640 1 -- 172.21.15.7:0/2624052184 learned_addr learned my addr 172.21.15.7:0/2624052184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0011600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f000c10e9c0 0x7f000c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.113+0000 7f0010c00640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000c100e10 0x7f000c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f000be00640 1 -- 172.21.15.7:0/2624052184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000c100e10 msgr2=0x7f000c1a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f000be00640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000c100e10 0x7f000c1a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f000be00640 1 -- 172.21.15.7:0/2624052184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f000c10e9c0 msgr2=0x7f000c19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f000be00640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f000c10e9c0 0x7f000c19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f000be00640 1 -- 172.21.15.7:0/2624052184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c19b020 con 0x7f000c101730 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f000be00640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c1a0be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7efff8005ab0 tx=0x7efff8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f0009600640 1 -- 172.21.15.7:0/2624052184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff803f070 con 0x7f000c101730 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.114+0000 7f0009600640 1 -- 172.21.15.7:0/2624052184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efff8031d60 con 0x7f000c101730 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.115+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c19b2b0 con 0x7f000c101730 2024-04-23T15:09:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.115+0000 7f0009600640 1 -- 172.21.15.7:0/2624052184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8035030 con 0x7f000c101730 2024-04-23T15:09:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.115+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c1a7440 con 0x7f000c101730 2024-04-23T15:09:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.118+0000 7f0009600640 1 -- 172.21.15.7:0/2624052184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7efff8042070 con 0x7f000c101730 2024-04-23T15:09:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.119+0000 7f0016470740 1 Processor -- start 2024-04-23T15:09:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.119+0000 7f0016470740 1 -- start start 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.119+0000 7f0016470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233df1b0 0x564d233df590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.119+0000 7f0016470740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f0016470740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233ec780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f0016470740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564d23345900 con 0x564d233ea390 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f0016470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d232ebf20 con 0x564d233df1b0 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f0016470740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564d233418c0 con 0x564d233dfad0 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f000be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233ec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f000be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233ec780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59370/0 (socket says 172.21.15.7:59370) 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f000be00640 1 -- 172.21.15.7:0/2219277192 learned_addr learned my addr 172.21.15.7:0/2219277192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f0010c00640 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.120+0000 7f0011600640 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233df1b0 0x564d233df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f000be00640 1 -- 172.21.15.7:0/2219277192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 msgr2=0x564d233e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f000be00640 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f000be00640 1 -- 172.21.15.7:0/2219277192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233df1b0 msgr2=0x564d233df590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f000be00640 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233df1b0 0x564d233df590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f000be00640 1 -- 172.21.15.7:0/2219277192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d23310e10 con 0x564d233ea390 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f0009600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efff40a3dc0 0x7efff40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f000be00640 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233ec780 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efff80ee820 tx=0x7efff80f77b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89355a4af6a2d2f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f0009600640 1 -- 172.21.15.7:0/2624052184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7efff80f1510 con 0x7f000c101730 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.121+0000 7f0011600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efff40a3dc0 0x7efff40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.122+0000 7efffdc00640 1 -- 172.21.15.7:0/2219277192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80b93a0 con 0x564d233ea390 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.122+0000 7efffdc00640 1 -- 172.21.15.7:0/2219277192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efff803be50 con 0x564d233ea390 2024-04-23T15:09:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.122+0000 7efffdc00640 1 -- 172.21.15.7:0/2219277192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80bca60 con 0x564d233ea390 2024-04-23T15:09:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 -- 172.21.15.7:0/2219277192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 msgr2=0x564d233ec780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233ec780 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7efff80ee820 tx=0x7efff80f77b0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0011600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efff40a3dc0 0x7efff40a6280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f000c06a6d0 tx=0x7f00040096e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 -- 172.21.15.7:0/2219277192 shutdown_connections 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233ec780 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 --2- 172.21.15.7:0/2219277192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233df1b0 0x564d233df590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 -- 172.21.15.7:0/2219277192 >> 172.21.15.7:0/2219277192 conn(0x564d233db6c0 msgr2=0x564d233dbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 -- 172.21.15.7:0/2219277192 shutdown_connections 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.123+0000 7f0016470740 1 -- 172.21.15.7:0/2219277192 wait complete. 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 -- start start 2024-04-23T15:09:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 Processor -- start 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233df1b0 0x564d233e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564d233ecd80 con 0x564d233ea390 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d232ff2c0 con 0x564d233dfad0 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564d233ecf00 con 0x564d233df1b0 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.124+0000 7f0016470740 10 client.0 _ll_register_callbacks cb 0x564d23057a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59374/0 (socket says 172.21.15.7:59374) 2024-04-23T15:09:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 -- 172.21.15.7:0/375669908 learned_addr learned my addr 172.21.15.7:0/375669908 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0010c00640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233df1b0 0x564d233e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f000be00640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 -- 172.21.15.7:0/375669908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233df1b0 msgr2=0x564d233e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233df1b0 0x564d233e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 -- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 msgr2=0x564d233e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.125+0000 7f0011600640 1 -- 172.21.15.7:0/375669908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2330ffd0 con 0x564d233ea390 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7f0011600640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233e7d30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0004010850 tx=0x7f0004004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f274468d95ba983c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7efff2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7efff2000640 1 -- 172.21.15.7:0/375669908 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000400eae0 con 0x564d233ea390 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7efff2000640 1 -- 172.21.15.7:0/375669908 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f000400ec80 con 0x564d233ea390 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efff803be50 con 0x564d233ea390 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7efff2000640 1 -- 172.21.15.7:0/375669908 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0004027400 con 0x564d233ea390 2024-04-23T15:09:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7f0016470740 10 client.17109 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.126+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564d23058210 con 0x564d233ea390 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7efff2000640 1 -- 172.21.15.7:0/375669908 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efff803be50 con 0x564d233ea390 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7efff2000640 1 -- 172.21.15.7:0/375669908 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f000400f040 con 0x564d233ea390 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7f0016470740 10 client.17109 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7f0016470740 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7f0016470740 20 client.17109 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7f0016470740 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d233fa250 0x564d233fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7f0016470740 4 client.17109 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:09:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.127+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d23353320 con 0x564d233fa250 2024-04-23T15:09:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.128+0000 7f0010c00640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d233fa250 0x564d233fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.129+0000 7f0010c00640 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d233fa250 0x564d233fc640 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77a1a3664b936d4 server_cookie=ec341f5d7321adf3 in_seq=0 out_seq=0 2024-04-23T15:09:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.129+0000 7efff2000640 10 client.17109 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.130+0000 7efff2000640 1 -- 172.21.15.7:0/375669908 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564d23353320 con 0x564d233fa250 2024-04-23T15:09:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.130+0000 7efff2000640 10 client.17109 handle_command_reply: tid=0 2024-04-23T15:09:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.130+0000 7f0016470740 1 client.17109 shutdown 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 msgr2=0x564d233e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233e7d30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0004010850 tx=0x7f0004004a40 comp rx=0 tx=0).stop 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 shutdown_connections 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d233fa250 0x564d233fc640 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233ea390 0x564d233e7d30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 --2- 172.21.15.7:0/375669908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233df1b0 0x564d233e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 >> 172.21.15.7:0/375669908 conn(0x564d233db6c0 msgr2=0x564d233e13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7efff2000640 0 client.17109 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 shutdown_connections 2024-04-23T15:09:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 1 -- 172.21.15.7:0/375669908 wait complete. 2024-04-23T15:09:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.131+0000 7f0016470740 20 client.17109 trim_cache size 0 max 16384 2024-04-23T15:09:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 Processor -- start 2024-04-23T15:09:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 -- start start 2024-04-23T15:09:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233ea390 0x564d23401f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1b1600 con 0x564d233df1b0 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1b3140 con 0x564d233dfad0 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0016470740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1b1cd0 con 0x564d233ea390 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0010c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0010c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59380/0 (socket says 172.21.15.7:59380) 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f0010c00640 1 -- 172.21.15.7:0/2352121410 learned_addr learned my addr 172.21.15.7:0/2352121410 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.148+0000 7f000be00640 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0011600640 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233ea390 0x564d23401f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0010c00640 1 -- 172.21.15.7:0/2352121410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233ea390 msgr2=0x564d23401f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0010c00640 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233ea390 0x564d23401f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0010c00640 1 -- 172.21.15.7:0/2352121410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 msgr2=0x564d233e1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0010c00640 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0010c00640 1 -- 172.21.15.7:0/2352121410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d233df900 con 0x564d233df1b0 2024-04-23T15:09:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7f0010c00640 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233f5bb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0000000c00 tx=0x7f00000138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d2b1fb37fb99f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7efffd200640 1 -- 172.21.15.7:0/2352121410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000004030 con 0x564d233df1b0 2024-04-23T15:09:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7efffd200640 1 -- 172.21.15.7:0/2352121410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f000001d8e0 con 0x564d233df1b0 2024-04-23T15:09:30.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.149+0000 7efffd200640 1 -- 172.21.15.7:0/2352121410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000003ab0 con 0x564d233df1b0 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 -- 172.21.15.7:0/2352121410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 msgr2=0x564d233f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233f5bb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0000000c00 tx=0x7f00000138f0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 -- 172.21.15.7:0/2352121410 shutdown_connections 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233dfad0 0x564d233e1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233ea390 0x564d23401f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 --2- 172.21.15.7:0/2352121410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233f5bb0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 -- 172.21.15.7:0/2352121410 >> 172.21.15.7:0/2352121410 conn(0x564d233db6c0 msgr2=0x564d233e9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 -- 172.21.15.7:0/2352121410 shutdown_connections 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.150+0000 7f0016470740 1 -- 172.21.15.7:0/2352121410 wait complete. 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 -- start start 2024-04-23T15:09:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 Processor -- start 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233edf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233ea390 0x564d233ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1b2a70 con 0x564d233df1b0 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1b23a0 con 0x564d233ea390 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1af600 con 0x564d233dfad0 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.151+0000 7f0016470740 10 client.0 _ll_register_callbacks cb 0x7f00040104a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233ed9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59392/0 (socket says 172.21.15.7:59392) 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 -- 172.21.15.7:0/2767747006 learned_addr learned my addr 172.21.15.7:0/2767747006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0011600640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233ea390 0x564d233ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f000be00640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 -- 172.21.15.7:0/2767747006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 msgr2=0x564d233edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 -- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233ea390 msgr2=0x564d233ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233ea390 0x564d233ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0010c00640 1 -- 172.21.15.7:0/2767747006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d23124620 con 0x564d233df1b0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.152+0000 7f0011600640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233ea390 0x564d233ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7f0010c00640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233ed9e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f00000036d0 tx=0x7f0000013110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efc66d71d96623b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7efff2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7efff2000640 1 -- 172.21.15.7:0/2767747006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000005220 con 0x564d233df1b0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7efff2000640 1 -- 172.21.15.7:0/2767747006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f00000053c0 con 0x564d233df1b0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f000001d8e0 con 0x564d233df1b0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7efff2000640 1 -- 172.21.15.7:0/2767747006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0000036050 con 0x564d233df1b0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7f0016470740 10 client.17115 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.153+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564d23460800 con 0x564d233df1b0 2024-04-23T15:09:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7efff2000640 1 -- 172.21.15.7:0/2767747006 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f000001d8e0 con 0x564d233df1b0 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7efff2000640 1 -- 172.21.15.7:0/2767747006 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0000011540 con 0x564d233df1b0 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7f0016470740 10 client.17115 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7f0016470740 10 client.17115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7f0016470740 20 client.17115 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7f0016470740 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d23460e90 0x564d234632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7f0016470740 4 client.17115 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.154+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d2334d190 con 0x564d23460e90 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.155+0000 7f000be00640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d23460e90 0x564d234632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.156+0000 7f000be00640 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d23460e90 0x564d234632b0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc61c73f1d6645b server_cookie=ef6f189b0fb8358a in_seq=0 out_seq=0 2024-04-23T15:09:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.156+0000 7efff2000640 10 client.17115 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.188+0000 7efff2000640 1 -- 172.21.15.7:0/2767747006 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d2334d190 con 0x564d23460e90 2024-04-23T15:09:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.188+0000 7efff2000640 10 client.17115 handle_command_reply: tid=0 2024-04-23T15:09:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.188+0000 7f0016470740 1 client.17115 shutdown 2024-04-23T15:09:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 msgr2=0x564d233ed9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233ed9e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f00000036d0 tx=0x7f0000013110 comp rx=0 tx=0).stop 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 shutdown_connections 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d23460e90 0x564d234632b0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d233ea390 0x564d233ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7efff2000640 0 client.17115 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d233dfad0 0x564d233edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 --2- 172.21.15.7:0/2767747006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d233df1b0 0x564d233ed9e0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.189+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 >> 172.21.15.7:0/2767747006 conn(0x564d233db6c0 msgr2=0x564d233e8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.191+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 shutdown_connections 2024-04-23T15:09:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.191+0000 7f0016470740 1 -- 172.21.15.7:0/2767747006 wait complete. 2024-04-23T15:09:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.191+0000 7f0016470740 20 client.17115 trim_cache size 0 max 16384 2024-04-23T15:09:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:09:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:09:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:09:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efff40a3dc0 msgr2=0x7efff40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efff40a3dc0 0x7efff40a6280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f000c06a6d0 tx=0x7f00040096e0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 msgr2=0x7f000c1a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c1a0be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7efff8005ab0 tx=0x7efff8003cd0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 shutdown_connections 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efff40a3dc0 0x7efff40a6280 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f000c10e9c0 0x7f000c19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f000c101730 0x7f000c1a0be0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 --2- 172.21.15.7:0/2624052184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000c100e10 0x7f000c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 >> 172.21.15.7:0/2624052184 conn(0x7f000c0780b0 msgr2=0x7f000c10fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 shutdown_connections 2024-04-23T15:09:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:30.192+0000 7f0013600640 1 -- 172.21.15.7:0/2624052184 wait complete. 2024-04-23T15:09:31.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:30 smithi186 ceph-mon[31814]: pgmap v570: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:30 smithi137 ceph-mon[31694]: pgmap v570: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:30 smithi007 ceph-mon[27906]: pgmap v570: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:32 smithi137 ceph-mon[31694]: pgmap v571: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:09:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:32 smithi007 ceph-mon[27906]: pgmap v571: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:09:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:32 smithi186 ceph-mon[31814]: pgmap v571: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:09:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:34 smithi137 ceph-mon[31694]: pgmap v572: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:09:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:34 smithi007 ceph-mon[27906]: pgmap v572: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:09:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:34 smithi186 ceph-mon[31814]: pgmap v572: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:09:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:36 smithi137 ceph-mon[31694]: pgmap v573: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:09:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:36 smithi007 ceph-mon[27906]: pgmap v573: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:09:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:36 smithi186 ceph-mon[31814]: pgmap v573: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:09:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:38 smithi137 ceph-mon[31694]: pgmap v574: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:09:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:38 smithi007 ceph-mon[27906]: pgmap v574: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:09:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:38 smithi186 ceph-mon[31814]: pgmap v574: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:09:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:40 smithi137 ceph-mon[31694]: pgmap v575: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:09:41.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:40 smithi007 ceph-mon[27906]: pgmap v575: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:09:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:40 smithi186 ceph-mon[31814]: pgmap v575: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:09:43.137 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:42 smithi007 ceph-mon[27906]: pgmap v576: 129 pgs: 129 active+clean; 4.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:09:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:42 smithi137 ceph-mon[31694]: pgmap v576: 129 pgs: 129 active+clean; 4.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:09:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 -- 172.21.15.7:0/3585739658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa010c3e0 msgr2=0x7f4fa010e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 --2- 172.21.15.7:0/3585739658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa010c3e0 0x7f4fa010e880 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009ca0 tx=0x7f4f9802a950 comp rx=0 tx=0).stop 2024-04-23T15:09:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 -- 172.21.15.7:0/3585739658 shutdown_connections 2024-04-23T15:09:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 --2- 172.21.15.7:0/3585739658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa01038e0 0x7f4fa010bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 --2- 172.21.15.7:0/3585739658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa010c3e0 0x7f4fa010e880 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 --2- 172.21.15.7:0/3585739658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa0102fc0 0x7f4fa01033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 -- 172.21.15.7:0/3585739658 >> 172.21.15.7:0/3585739658 conn(0x7f4fa00fc820 msgr2=0x7f4fa00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 -- 172.21.15.7:0/3585739658 shutdown_connections 2024-04-23T15:09:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.346+0000 7f4f9f200640 1 -- 172.21.15.7:0/3585739658 wait complete. 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.347+0000 7f4f9f200640 1 Processor -- start 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.347+0000 7f4f9f200640 1 -- start start 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 0x7f4fa0198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa01038e0 0x7f4fa0198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa010c3e0 0x7f4fa019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01120c0 con 0x7f4fa0102fc0 2024-04-23T15:09:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa0111f40 con 0x7f4fa010c3e0 2024-04-23T15:09:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa0112240 con 0x7f4fa01038e0 2024-04-23T15:09:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 0x7f4fa0198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 0x7f4fa0198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37610/0 (socket says 172.21.15.7:37610) 2024-04-23T15:09:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.348+0000 7f4f9de00640 1 -- 172.21.15.7:0/2317967242 learned_addr learned my addr 172.21.15.7:0/2317967242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f97e00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa01038e0 0x7f4fa0198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9e800640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa010c3e0 0x7f4fa019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9de00640 1 -- 172.21.15.7:0/2317967242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa01038e0 msgr2=0x7f4fa0198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa01038e0 0x7f4fa0198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9de00640 1 -- 172.21.15.7:0/2317967242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa010c3e0 msgr2=0x7f4fa019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa010c3e0 0x7f4fa019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9de00640 1 -- 172.21.15.7:0/2317967242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa019d600 con 0x7f4fa0102fc0 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f97e00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa01038e0 0x7f4fa0198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.349+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 0x7f4fa0198660 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d770 tx=0x7f4f9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.350+0000 7f4f96a00640 1 -- 172.21.15.7:0/2317967242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90017070 con 0x7f4fa0102fc0 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.350+0000 7f4f96a00640 1 -- 172.21.15.7:0/2317967242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f900054d0 con 0x7f4fa0102fc0 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.350+0000 7f4f96a00640 1 -- 172.21.15.7:0/2317967242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90004cf0 con 0x7f4fa0102fc0 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.350+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa019d8f0 con 0x7f4fa0102fc0 2024-04-23T15:09:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.350+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa01a5180 con 0x7f4fa0102fc0 2024-04-23T15:09:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 Processor -- start 2024-04-23T15:09:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 -- start start 2024-04-23T15:09:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b1e094900 con 0x558b1e1327d0 2024-04-23T15:09:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b1e03af20 con 0x558b1e1330f0 2024-04-23T15:09:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558b1e0908c0 con 0x558b1e13d9b0 2024-04-23T15:09:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.354+0000 7f4f96a00640 1 -- 172.21.15.7:0/2317967242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4f90004e90 con 0x7f4fa0102fc0 2024-04-23T15:09:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e132bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37614/0 (socket says 172.21.15.7:37614) 2024-04-23T15:09:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 -- 172.21.15.7:0/2681149280 learned_addr learned my addr 172.21.15.7:0/2681149280 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f97e00640 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 -- 172.21.15.7:0/2681149280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 msgr2=0x558b1e13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e13fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 -- 172.21.15.7:0/2681149280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 msgr2=0x558b1e13d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9e800640 1 -- 172.21.15.7:0/2681149280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b1e05fe10 con 0x558b1e1327d0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.355+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.356+0000 7f4f9e800640 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e132bb0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4f98035000 tx=0x7f4f98009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d0ad83d51eca64 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.356+0000 7f4f8f400640 1 -- 172.21.15.7:0/2681149280 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98034040 con 0x558b1e1327d0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.356+0000 7f4f96a00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f840a3d10 0x7f4f840a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.356+0000 7f4f8f400640 1 -- 172.21.15.7:0/2681149280 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f98003e20 con 0x558b1e1327d0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.356+0000 7f4f8f400640 1 -- 172.21.15.7:0/2681149280 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98004330 con 0x558b1e1327d0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.356+0000 7f4f96a00640 1 -- 172.21.15.7:0/2317967242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f4f900d06e0 con 0x7f4fa0102fc0 2024-04-23T15:09:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f840a3d10 0x7f4f840a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/2681149280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 msgr2=0x558b1e132bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e132bb0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4f98035000 tx=0x7f4f98009a20 comp rx=0 tx=0).stop 2024-04-23T15:09:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/2681149280 shutdown_connections 2024-04-23T15:09:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e13fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/2681149280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e132bb0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/2681149280 >> 172.21.15.7:0/2681149280 conn(0x558b1e12ece0 msgr2=0x558b1e12f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.357+0000 7f4f9de00640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f840a3d10 0x7f4f840a61d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f900cdb30 tx=0x7f4f90009f30 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.358+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/2681149280 shutdown_connections 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.358+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/2681149280 wait complete. 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.358+0000 7f4fa7f6a740 1 -- start start 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.358+0000 7f4fa7f6a740 1 Processor -- start 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1327d0 0x558b1e13a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 0x558b1e13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558b1e140580 con 0x558b1e13d9b0 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b1e04e2c0 con 0x558b1e1330f0 2024-04-23T15:09:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558b1e140700 con 0x558b1e1327d0 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4fa7f6a740 10 client.0 _ll_register_callbacks cb 0x558b1dda6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 0x558b1e13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 0x558b1e13b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37622/0 (socket says 172.21.15.7:37622) 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4f9e800640 1 -- 172.21.15.7:0/597309918 learned_addr learned my addr 172.21.15.7:0/597309918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4f97e00640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.359+0000 7f4f9e800640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1327d0 0x558b1e13a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f9e800640 1 -- 172.21.15.7:0/597309918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1327d0 msgr2=0x558b1e13a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f9e800640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1327d0 0x558b1e13a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f9e800640 1 -- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 msgr2=0x558b1e13aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f9e800640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f9e800640 1 -- 172.21.15.7:0/597309918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b1e05efd0 con 0x558b1e13d9b0 2024-04-23T15:09:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:42 smithi186 ceph-mon[31814]: pgmap v576: 129 pgs: 129 active+clean; 4.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:09:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f9e800640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 0x558b1e13b420 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f4f9802ae70 tx=0x7f4f9802fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb810e611e0585 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f83e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f83e00640 1 -- 172.21.15.7:0/597309918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98055060 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4f83e00640 1 -- 172.21.15.7:0/597309918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f4f98003970 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.360+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f98003e20 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4f83e00640 1 -- 172.21.15.7:0/597309918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4f98004820 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4fa7f6a740 10 client.17127 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b1dda7210 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4f83e00640 1 -- 172.21.15.7:0/597309918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f98003e20 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4f83e00640 1 -- 172.21.15.7:0/597309918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4f9804f040 con 0x558b1e13d9b0 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4fa7f6a740 10 client.17127 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.361+0000 7f4fa7f6a740 10 client.17127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.362+0000 7f4fa7f6a740 20 client.17127 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.362+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e14d930 0x558b1e14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.362+0000 7f4fa7f6a740 4 client.17127 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:09:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.362+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b1e0a2320 con 0x558b1e14d930 2024-04-23T15:09:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.362+0000 7f4f97e00640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e14d930 0x558b1e14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.363+0000 7f4f97e00640 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e14d930 0x558b1e14fd20 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=536036da55e4d26 server_cookie=595e1cabfde1affc in_seq=0 out_seq=0 2024-04-23T15:09:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.363+0000 7f4f83e00640 10 client.17127 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4f83e00640 1 -- 172.21.15.7:0/597309918 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558b1e0a2320 con 0x558b1e14d930 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4f83e00640 10 client.17127 handle_command_reply: tid=0 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4fa7f6a740 1 client.17127 shutdown 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 msgr2=0x558b1e13b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 0x558b1e13b420 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f4f9802ae70 tx=0x7f4f9802fee0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 shutdown_connections 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.365+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e14d930 0x558b1e14fd20 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e13aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e13d9b0 0x558b1e13b420 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/597309918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1327d0 0x558b1e13a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 >> 172.21.15.7:0/597309918 conn(0x558b1e12ece0 msgr2=0x558b1e129a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4f83e00640 0 client.17127 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 shutdown_connections 2024-04-23T15:09:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/597309918 wait complete. 2024-04-23T15:09:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.366+0000 7f4fa7f6a740 20 client.17127 trim_cache size 0 max 16384 2024-04-23T15:09:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.384+0000 7f4fa7f6a740 1 Processor -- start 2024-04-23T15:09:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 -- start start 2024-04-23T15:09:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e149440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1330f0 0x558b1e129910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e13d9b0 0x558b1e1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01ad0a0 con 0x558b1e1327d0 2024-04-23T15:09:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01aebe0 con 0x558b1e13d9b0 2024-04-23T15:09:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01ad770 con 0x558b1e1330f0 2024-04-23T15:09:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.385+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1330f0 0x558b1e129910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37636/0 (socket says 172.21.15.7:37636) 2024-04-23T15:09:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 -- 172.21.15.7:0/515892109 learned_addr learned my addr 172.21.15.7:0/515892109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 -- 172.21.15.7:0/515892109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1330f0 msgr2=0x558b1e129910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1330f0 0x558b1e129910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 -- 172.21.15.7:0/515892109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e13d9b0 msgr2=0x558b1e1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e13d9b0 0x558b1e1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 -- 172.21.15.7:0/515892109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b1e140110 con 0x558b1e1327d0 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.386+0000 7f4f9e800640 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e149440 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006010 tx=0x7f4f98004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7869a5ee5e74c633 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.387+0000 7f4f8ea00640 1 -- 172.21.15.7:0/515892109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9803e070 con 0x558b1e1327d0 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.387+0000 7f4f8ea00640 1 -- 172.21.15.7:0/515892109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f98009b20 con 0x558b1e1327d0 2024-04-23T15:09:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.387+0000 7f4f8ea00640 1 -- 172.21.15.7:0/515892109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98034040 con 0x558b1e1327d0 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.387+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/515892109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 msgr2=0x558b1e149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.387+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e149440 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006010 tx=0x7f4f98004a80 comp rx=0 tx=0).stop 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/515892109 shutdown_connections 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e13d9b0 0x558b1e1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e1330f0 0x558b1e129910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/515892109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e149440 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/515892109 >> 172.21.15.7:0/515892109 conn(0x558b1e12ece0 msgr2=0x558b1e129200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/515892109 shutdown_connections 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/515892109 wait complete. 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 -- start start 2024-04-23T15:09:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.388+0000 7f4fa7f6a740 1 Processor -- start 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e12dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e145e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01ae510 con 0x558b1e1327d0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01ade40 con 0x558b1e1330f0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01ab0a0 con 0x558b1e13d9b0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4fa7f6a740 10 client.0 _ll_register_callbacks cb 0x7f4f9802f3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e12dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4f9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e12dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37646/0 (socket says 172.21.15.7:37646) 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.389+0000 7f4f9e800640 1 -- 172.21.15.7:0/3565565226 learned_addr learned my addr 172.21.15.7:0/3565565226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f97e00640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 -- 172.21.15.7:0/3565565226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 msgr2=0x558b1e145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 -- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 msgr2=0x558b1e145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 -- 172.21.15.7:0/3565565226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b1de73620 con 0x558b1e1327d0 2024-04-23T15:09:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f9e800640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e12dcd0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f4f98044750 tx=0x7f4f98052040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dc6d51a9ac09ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.390+0000 7f4f83e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4f83e00640 1 -- 172.21.15.7:0/3565565226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98064020 con 0x558b1e1327d0 2024-04-23T15:09:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f98009b20 con 0x558b1e1327d0 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4f83e00640 1 -- 172.21.15.7:0/3565565226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f4f98003b80 con 0x558b1e1327d0 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4f83e00640 1 -- 172.21.15.7:0/3565565226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4f9806f050 con 0x558b1e1327d0 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4fa7f6a740 10 client.17133 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b1e1b8350 con 0x558b1e1327d0 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4f83e00640 1 -- 172.21.15.7:0/3565565226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f98009b20 con 0x558b1e1327d0 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.391+0000 7f4f83e00640 1 -- 172.21.15.7:0/3565565226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4f98042070 con 0x558b1e1327d0 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4fa7f6a740 10 client.17133 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4fa7f6a740 10 client.17133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4fa7f6a740 20 client.17133 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e1b87c0 0x558b1e1babb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4fa7f6a740 4 client.17133 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:09:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558b1e09c190 con 0x558b1e1b87c0 2024-04-23T15:09:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.392+0000 7f4f97e00640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e1b87c0 0x558b1e1babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.393+0000 7f4f97e00640 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e1b87c0 0x558b1e1babb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b8488a8266271d server_cookie=7ff40a385dc7a953 in_seq=0 out_seq=0 2024-04-23T15:09:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.393+0000 7f4f83e00640 10 client.17133 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.431+0000 7f4f83e00640 1 -- 172.21.15.7:0/3565565226 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558b1e09c190 con 0x558b1e1b87c0 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.431+0000 7f4f83e00640 10 client.17133 handle_command_reply: tid=0 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.431+0000 7f4fa7f6a740 1 client.17133 shutdown 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.431+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 msgr2=0x558b1e12dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.431+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e12dcd0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f4f98044750 tx=0x7f4f98052040 comp rx=0 tx=0).stop 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 shutdown_connections 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558b1e1b87c0 0x558b1e1babb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b1e1330f0 0x558b1e145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558b1e13d9b0 0x558b1e145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4f83e00640 0 client.17133 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 --2- 172.21.15.7:0/3565565226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558b1e1327d0 0x558b1e12dcd0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 >> 172.21.15.7:0/3565565226 conn(0x558b1e12ece0 msgr2=0x558b1e13b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 shutdown_connections 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 1 -- 172.21.15.7:0/3565565226 wait complete. 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.432+0000 7f4fa7f6a740 20 client.17133 trim_cache size 0 max 16384 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:09:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:09:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f840a3d10 msgr2=0x7f4f840a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f840a3d10 0x7f4f840a61d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f900cdb30 tx=0x7f4f90009f30 comp rx=0 tx=0).stop 2024-04-23T15:09:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 msgr2=0x7f4fa0198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 0x7f4fa0198660 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d770 tx=0x7f4f9000dc30 comp rx=0 tx=0).stop 2024-04-23T15:09:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 shutdown_connections 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f840a3d10 0x7f4f840a61d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa010c3e0 0x7f4fa019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa01038e0 0x7f4fa0198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 --2- 172.21.15.7:0/2317967242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa0102fc0 0x7f4fa0198660 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.433+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 >> 172.21.15.7:0/2317967242 conn(0x7f4fa00fc820 msgr2=0x7f4fa00fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.434+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 shutdown_connections 2024-04-23T15:09:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:43.434+0000 7f4f9f200640 1 -- 172.21.15.7:0/2317967242 wait complete. 2024-04-23T15:09:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:44 smithi137 ceph-mon[31694]: pgmap v577: 129 pgs: 129 active+clean; 4.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:09:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:44 smithi007 ceph-mon[27906]: pgmap v577: 129 pgs: 129 active+clean; 4.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:09:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:44 smithi186 ceph-mon[31814]: pgmap v577: 129 pgs: 129 active+clean; 4.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:09:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:46 smithi137 ceph-mon[31694]: pgmap v578: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:09:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:46 smithi007 ceph-mon[27906]: pgmap v578: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:09:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:46 smithi186 ceph-mon[31814]: pgmap v578: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:09:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:48 smithi137 ceph-mon[31694]: pgmap v579: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:48 smithi007 ceph-mon[27906]: pgmap v579: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:48 smithi186 ceph-mon[31814]: pgmap v579: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:50 smithi137 ceph-mon[31694]: pgmap v580: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:51.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:50 smithi007 ceph-mon[27906]: pgmap v580: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:51.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:50 smithi186 ceph-mon[31814]: pgmap v580: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:52 smithi137 ceph-mon[31694]: pgmap v581: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:09:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:52 smithi007 ceph-mon[27906]: pgmap v581: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:09:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:52 smithi186 ceph-mon[31814]: pgmap v581: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:09:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:54 smithi137 ceph-mon[31694]: pgmap v582: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:54 smithi007 ceph-mon[27906]: pgmap v582: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:55.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:54 smithi186 ceph-mon[31814]: pgmap v582: 129 pgs: 129 active+clean; 4.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:09:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 -- 172.21.15.7:0/2675562094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4076530 msgr2=0x7f4be4076910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 --2- 172.21.15.7:0/2675562094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4076530 0x7f4be4076910 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009900 tx=0x7f4bd402a400 comp rx=0 tx=0).stop 2024-04-23T15:09:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 -- 172.21.15.7:0/2675562094 shutdown_connections 2024-04-23T15:09:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 --2- 172.21.15.7:0/2675562094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076e50 0x7f4be4112950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 --2- 172.21.15.7:0/2675562094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4112e90 0x7f4be4115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 --2- 172.21.15.7:0/2675562094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4076530 0x7f4be4076910 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 -- 172.21.15.7:0/2675562094 >> 172.21.15.7:0/2675562094 conn(0x7f4be40ffd00 msgr2=0x7f4be4102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 -- 172.21.15.7:0/2675562094 shutdown_connections 2024-04-23T15:09:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.592+0000 7f4bea600640 1 -- 172.21.15.7:0/2675562094 wait complete. 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.593+0000 7f4bea600640 1 Processor -- start 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.593+0000 7f4bea600640 1 -- start start 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4bea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076530 0x7f4be41a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4bea600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4076e50 0x7f4be41a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4bea600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 0x7f4be419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4bea600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41188a0 con 0x7f4be4112e90 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4bea600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4118720 con 0x7f4be4076530 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4bea600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4118a20 con 0x7f4be4076e50 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 0x7f4be419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 0x7f4be419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40662/0 (socket says 172.21.15.7:40662) 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.594+0000 7f4be3e00640 1 -- 172.21.15.7:0/3389753833 learned_addr learned my addr 172.21.15.7:0/3389753833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3400640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076530 0x7f4be41a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be2a00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4076e50 0x7f4be41a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3e00640 1 -- 172.21.15.7:0/3389753833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4076e50 msgr2=0x7f4be41a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3e00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4076e50 0x7f4be41a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3e00640 1 -- 172.21.15.7:0/3389753833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076530 msgr2=0x7f4be41a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3e00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076530 0x7f4be41a48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3e00640 1 -- 172.21.15.7:0/3389753833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be419f240 con 0x7f4be4112e90 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3400640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076530 0x7f4be41a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be2a00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4076e50 0x7f4be41a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:09:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.595+0000 7f4be3e00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 0x7f4be419eac0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00ccb0 tx=0x7f4bdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.596+0000 7f4bdbe00640 1 -- 172.21.15.7:0/3389753833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00f450 con 0x7f4be4112e90 2024-04-23T15:09:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.596+0000 7f4bdbe00640 1 -- 172.21.15.7:0/3389753833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bdc00faa0 con 0x7f4be4112e90 2024-04-23T15:09:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.596+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be419f530 con 0x7f4be4112e90 2024-04-23T15:09:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.596+0000 7f4bdbe00640 1 -- 172.21.15.7:0/3389753833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc018b10 con 0x7f4be4112e90 2024-04-23T15:09:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.596+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41ab780 con 0x7f4be4112e90 2024-04-23T15:09:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.600+0000 7f4bed5b6740 1 Processor -- start 2024-04-23T15:09:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.600+0000 7f4bdbe00640 1 -- 172.21.15.7:0/3389753833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4bdc00f5f0 con 0x7f4be4112e90 2024-04-23T15:09:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 -- start start 2024-04-23T15:09:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f24a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f254e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f257780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d1f1b0900 con 0x562d1f255390 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d1f156f20 con 0x562d1f24a1b0 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.601+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562d1f1ac8c0 con 0x562d1f24aad0 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f257780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f257780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40664/0 (socket says 172.21.15.7:40664) 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 -- 172.21.15.7:0/268483457 learned_addr learned my addr 172.21.15.7:0/268483457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be3400640 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f254e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f24a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4bdbe00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4bc80a3e40 0x7f4bc80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 -- 172.21.15.7:0/268483457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 msgr2=0x562d1f254e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f254e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 -- 172.21.15.7:0/268483457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 msgr2=0x562d1f24a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f24a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4be2a00640 1 -- 172.21.15.7:0/268483457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1f17be10 con 0x562d1f255390 2024-04-23T15:09:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.602+0000 7f4bdbe00640 1 -- 172.21.15.7:0/3389753833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f4bdc0d12f0 con 0x7f4be4112e90 2024-04-23T15:09:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.603+0000 7f4be3e00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4bc80a3e40 0x7f4bc80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.603+0000 7f4be2a00640 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f257780 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0013970 tx=0x7f4bd000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c560906677d18c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.603+0000 7f4bd8c00640 1 -- 172.21.15.7:0/268483457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0004030 con 0x562d1f255390 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.603+0000 7f4bd8c00640 1 -- 172.21.15.7:0/268483457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bd000e960 con 0x562d1f255390 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.603+0000 7f4bd8c00640 1 -- 172.21.15.7:0/268483457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003850 con 0x562d1f255390 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 -- 172.21.15.7:0/268483457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 msgr2=0x562d1f257780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4be3e00640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4bc80a3e40 0x7f4bc80a6300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0a55c0 tx=0x7f4bdc018510 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f257780 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0013970 tx=0x7f4bd000b4c0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 -- 172.21.15.7:0/268483457 shutdown_connections 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f257780 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f254e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/268483457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f24a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.604+0000 7f4bed5b6740 1 -- 172.21.15.7:0/268483457 >> 172.21.15.7:0/268483457 conn(0x562d1f2466c0 msgr2=0x562d1f246aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.605+0000 7f4bed5b6740 1 -- 172.21.15.7:0/268483457 shutdown_connections 2024-04-23T15:09:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.605+0000 7f4bed5b6740 1 -- 172.21.15.7:0/268483457 wait complete. 2024-04-23T15:09:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.605+0000 7f4bed5b6740 1 -- start start 2024-04-23T15:09:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.605+0000 7f4bed5b6740 1 Processor -- start 2024-04-23T15:09:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 0x562d1f2523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24aad0 0x562d1f2528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f252e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562d1f257fc0 con 0x562d1f24a1b0 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d1f16a2c0 con 0x562d1f24aad0 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562d1f258140 con 0x562d1f255390 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4bed5b6740 10 client.0 _ll_register_callbacks cb 0x562d1eec2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 0x562d1f2523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 0x562d1f2523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40678/0 (socket says 172.21.15.7:40678) 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.606+0000 7f4be2a00640 1 -- 172.21.15.7:0/1640044826 learned_addr learned my addr 172.21.15.7:0/1640044826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be3400640 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24aad0 0x562d1f2528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be2a00640 1 -- 172.21.15.7:0/1640044826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 msgr2=0x562d1f252e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be2a00640 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f252e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be2a00640 1 -- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24aad0 msgr2=0x562d1f2528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be2a00640 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24aad0 0x562d1f2528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be2a00640 1 -- 172.21.15.7:0/1640044826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1f17afd0 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4be2a00640 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 0x562d1f2523a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000b920 tx=0x7f4bd0013300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8082ba400d015d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4bcd600640 1 -- 172.21.15.7:0/1640044826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0011440 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4bcd600640 1 -- 172.21.15.7:0/1640044826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f4bd00115e0 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.607+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bd000e960 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bcd600640 1 -- 172.21.15.7:0/1640044826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4bd0031050 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bed5b6740 10 client.17145 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562d1eec3210 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bcd600640 1 -- 172.21.15.7:0/1640044826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bd000e960 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bcd600640 1 -- 172.21.15.7:0/1640044826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4bd0020710 con 0x562d1f24a1b0 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bed5b6740 10 client.17145 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bed5b6740 10 client.17145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:56.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.608+0000 7f4bed5b6740 20 client.17145 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.609+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2653f0 0x562d1f2677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.609+0000 7f4bed5b6740 4 client.17145 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.609+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d1f1be320 con 0x562d1f2653f0 2024-04-23T15:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.609+0000 7f4be3400640 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2653f0 0x562d1f2677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.610+0000 7f4be3400640 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2653f0 0x562d1f2677e0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8249192210fffb03 server_cookie=7d97f35b8f7635ab in_seq=0 out_seq=0 2024-04-23T15:09:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.610+0000 7f4bcd600640 10 client.17145 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.612+0000 7f4bcd600640 1 -- 172.21.15.7:0/1640044826 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d1f1be320 con 0x562d1f2653f0 2024-04-23T15:09:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.612+0000 7f4bcd600640 10 client.17145 handle_command_reply: tid=0 2024-04-23T15:09:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.612+0000 7f4bed5b6740 1 client.17145 shutdown 2024-04-23T15:09:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 msgr2=0x562d1f2523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 0x562d1f2523a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000b920 tx=0x7f4bd0013300 comp rx=0 tx=0).stop 2024-04-23T15:09:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 shutdown_connections 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2653f0 0x562d1f2677e0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24aad0 0x562d1f2528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f252e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/1640044826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24a1b0 0x562d1f2523a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 >> 172.21.15.7:0/1640044826 conn(0x562d1f2466c0 msgr2=0x562d1f24c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bcd600640 0 client.17145 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 shutdown_connections 2024-04-23T15:09:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 1 -- 172.21.15.7:0/1640044826 wait complete. 2024-04-23T15:09:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.613+0000 7f4bed5b6740 20 client.17145 trim_cache size 0 max 16384 2024-04-23T15:09:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 Processor -- start 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 -- start start 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f251cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 0x562d1f252e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f24cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b5880 con 0x562d1f24aad0 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b73c0 con 0x562d1f24a1b0 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b5f50 con 0x562d1f255390 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4be3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 0x562d1f252e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.631+0000 7f4be3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 0x562d1f252e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40680/0 (socket says 172.21.15.7:40680) 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 -- 172.21.15.7:0/2112132501 learned_addr learned my addr 172.21.15.7:0/2112132501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be2a00640 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f251cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be2a00640 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f24cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 -- 172.21.15.7:0/2112132501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 msgr2=0x562d1f24cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f24cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 -- 172.21.15.7:0/2112132501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 msgr2=0x562d1f251cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f251cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 -- 172.21.15.7:0/2112132501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1ef8f620 con 0x562d1f24aad0 2024-04-23T15:09:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be2a00640 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f251cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4be3400640 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 0x562d1f252e30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f4bd402a920 tx=0x7f4bd4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8667028910152c02 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.632+0000 7f4bcfe00640 1 -- 172.21.15.7:0/2112132501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4048030 con 0x562d1f24aad0 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bcfe00640 1 -- 172.21.15.7:0/2112132501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bd40318e0 con 0x562d1f24aad0 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bcfe00640 1 -- 172.21.15.7:0/2112132501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4035040 con 0x562d1f24aad0 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 -- 172.21.15.7:0/2112132501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 msgr2=0x562d1f252e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 0x562d1f252e30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f4bd402a920 tx=0x7f4bd4009560 comp rx=0 tx=0).stop 2024-04-23T15:09:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 -- 172.21.15.7:0/2112132501 shutdown_connections 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f255390 0x562d1f24cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f24aad0 0x562d1f252e30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/2112132501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f251cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.633+0000 7f4bed5b6740 1 -- 172.21.15.7:0/2112132501 >> 172.21.15.7:0/2112132501 conn(0x562d1f2466c0 msgr2=0x562d1f245840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.634+0000 7f4bed5b6740 1 -- 172.21.15.7:0/2112132501 shutdown_connections 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.634+0000 7f4bed5b6740 1 -- 172.21.15.7:0/2112132501 wait complete. 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.634+0000 7f4bed5b6740 1 -- start start 2024-04-23T15:09:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.634+0000 7f4bed5b6740 1 Processor -- start 2024-04-23T15:09:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f25d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f25d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f24ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b6cf0 con 0x562d1f255390 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b6620 con 0x562d1f24a1b0 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4be41b3880 con 0x562d1f24aad0 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4bed5b6740 10 client.0 _ll_register_callbacks cb 0x7f4bd000bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f24ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4be2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f24ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40694/0 (socket says 172.21.15.7:40694) 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.635+0000 7f4be2a00640 1 -- 172.21.15.7:0/598188816 learned_addr learned my addr 172.21.15.7:0/598188816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f25d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be3400640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f25d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 -- 172.21.15.7:0/598188816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 msgr2=0x562d1f25d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f25d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 -- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 msgr2=0x562d1f25d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f25d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 -- 172.21.15.7:0/598188816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1f24f440 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4be2a00640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f24ec10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0000c00 tx=0x7f4bd0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b07bfcec77a886 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.636+0000 7f4bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bcd600640 1 -- 172.21.15.7:0/598188816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00133e0 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bcd600640 1 -- 172.21.15.7:0/598188816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9467+0+0 (secure 0 0 0) 0x7f4bd000b880 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d1f1b8190 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bcd600640 1 -- 172.21.15.7:0/598188816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4bd000bb40 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bed5b6740 10 client.17151 fetch_fsmap learned FSMap version 32 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562d1f2cb1d0 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.637+0000 7f4bcd600640 1 -- 172.21.15.7:0/598188816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x562d1f1b8190 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bcd600640 1 -- 172.21.15.7:0/598188816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4bd00206b0 con 0x562d1f255390 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bed5b6740 10 client.17151 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bed5b6740 10 client.17151 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:09:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bed5b6740 20 client.17151 populate_metadata read hostname 'smithi007' 2024-04-23T15:09:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2cb980 0x562d1f2cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:09:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bed5b6740 4 client.17151 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:09:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d1f1344b0 con 0x562d1f2cb980 2024-04-23T15:09:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.638+0000 7f4be3400640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2cb980 0x562d1f2cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:09:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.639+0000 7f4be3400640 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2cb980 0x562d1f2cdda0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b052dc3d5ebda35 server_cookie=54c478768a70d34d in_seq=0 out_seq=0 2024-04-23T15:09:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.639+0000 7f4bcd600640 10 client.17151 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bcd600640 1 -- 172.21.15.7:0/598188816 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d1f1344b0 con 0x562d1f2cb980 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bcd600640 10 client.17151 handle_command_reply: tid=0 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 client.17151 shutdown 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 msgr2=0x562d1f24ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f24ec10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0000c00 tx=0x7f4bd0001e50 comp rx=0 tx=0).stop 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 shutdown_connections 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562d1f2cb980 0x562d1f2cdda0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d1f255390 0x562d1f24ec10 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562d1f24aad0 0x562d1f25d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bcd600640 0 client.17151 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 --2- 172.21.15.7:0/598188816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d1f24a1b0 0x562d1f25d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.680+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 >> 172.21.15.7:0/598188816 conn(0x562d1f2466c0 msgr2=0x562d1f253bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.681+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 shutdown_connections 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.681+0000 7f4bed5b6740 1 -- 172.21.15.7:0/598188816 wait complete. 2024-04-23T15:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.681+0000 7f4bed5b6740 20 client.17151 trim_cache size 0 max 16384 2024-04-23T15:09:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:09:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:09:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:09:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4bc80a3e40 msgr2=0x7f4bc80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4bc80a3e40 0x7f4bc80a6300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0a55c0 tx=0x7f4bdc018510 comp rx=0 tx=0).stop 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 msgr2=0x7f4be419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 0x7f4be419eac0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00ccb0 tx=0x7f4bdc00a620 comp rx=0 tx=0).stop 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 shutdown_connections 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4bc80a3e40 0x7f4bc80a6300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4be4112e90 0x7f4be419eac0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4be4076e50 0x7f4be41a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 --2- 172.21.15.7:0/3389753833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be4076530 0x7f4be41a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:09:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.682+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 >> 172.21.15.7:0/3389753833 conn(0x7f4be40ffd00 msgr2=0x7f4be41148a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:09:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.683+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 shutdown_connections 2024-04-23T15:09:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:09:56.683+0000 7f4bea600640 1 -- 172.21.15.7:0/3389753833 wait complete. 2024-04-23T15:09:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:56 smithi137 ceph-mon[31694]: pgmap v583: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:09:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:56 smithi007 ceph-mon[27906]: pgmap v583: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:09:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:56 smithi186 ceph-mon[31814]: pgmap v583: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:09:59.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:09:58 smithi137 ceph-mon[31694]: pgmap v584: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:09:59.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:09:58 smithi007 ceph-mon[27906]: pgmap v584: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:09:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:09:58 smithi186 ceph-mon[31814]: pgmap v584: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:00.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T15:10:00.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T15:10:00.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T15:10:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:01 smithi007 ceph-mon[27906]: pgmap v585: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:01.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:01 smithi186 ceph-mon[31814]: pgmap v585: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:01.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:01 smithi137 ceph-mon[31694]: pgmap v585: 129 pgs: 129 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:02 smithi137 ceph-mon[31694]: pgmap v586: 129 pgs: 129 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.3 MiB/s wr, 36 op/s 2024-04-23T15:10:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:02 smithi007 ceph-mon[27906]: pgmap v586: 129 pgs: 129 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.3 MiB/s wr, 36 op/s 2024-04-23T15:10:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:02 smithi186 ceph-mon[31814]: pgmap v586: 129 pgs: 129 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.3 MiB/s wr, 36 op/s 2024-04-23T15:10:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:04 smithi137 ceph-mon[31694]: pgmap v587: 129 pgs: 129 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 30 op/s 2024-04-23T15:10:05.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:04 smithi007 ceph-mon[27906]: pgmap v587: 129 pgs: 129 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 30 op/s 2024-04-23T15:10:05.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:04 smithi186 ceph-mon[31814]: pgmap v587: 129 pgs: 129 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.3 MiB/s wr, 30 op/s 2024-04-23T15:10:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:06 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:10:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:06 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:10:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:06 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:10:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:07 smithi007 ceph-mon[27906]: pgmap v588: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:10:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:07 smithi186 ceph-mon[31814]: pgmap v588: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:10:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:07 smithi137 ceph-mon[31694]: pgmap v588: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:10:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:08.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:08 smithi007 ceph-mon[27906]: osdmap e117: 12 total, 12 up, 12 in 2024-04-23T15:10:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:08 smithi186 ceph-mon[31814]: osdmap e117: 12 total, 12 up, 12 in 2024-04-23T15:10:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:08 smithi137 ceph-mon[31694]: osdmap e117: 12 total, 12 up, 12 in 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 -- 172.21.15.7:0/707627475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f8101570 msgr2=0x7f55f810e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 --2- 172.21.15.7:0/707627475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f8101570 0x7f55f810e230 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009900 tx=0x7f55e402a410 comp rx=0 tx=0).stop 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 -- 172.21.15.7:0/707627475 shutdown_connections 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 --2- 172.21.15.7:0/707627475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55f810e770 0x7f55f8110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 --2- 172.21.15.7:0/707627475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f8101570 0x7f55f810e230 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 --2- 172.21.15.7:0/707627475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55f8100bc0 0x7f55f8100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 -- 172.21.15.7:0/707627475 >> 172.21.15.7:0/707627475 conn(0x7f55f80fc820 msgr2=0x7f55f80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 -- 172.21.15.7:0/707627475 shutdown_connections 2024-04-23T15:10:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.843+0000 7f55fcc00640 1 -- 172.21.15.7:0/707627475 wait complete. 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.844+0000 7f55fcc00640 1 Processor -- start 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.844+0000 7f55fcc00640 1 -- start start 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55fcc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55f8100bc0 0x7f55f81a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55fcc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55f8101570 0x7f55f81a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55fcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 0x7f55f819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55fcc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8114310 con 0x7f55f810e770 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55fcc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8114190 con 0x7f55f8100bc0 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55fcc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8114490 con 0x7f55f8101570 2024-04-23T15:10:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 0x7f55f819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 0x7f55f819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47794/0 (socket says 172.21.15.7:47794) 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 -- 172.21.15.7:0/1996675059 learned_addr learned my addr 172.21.15.7:0/1996675059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7400640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55f8100bc0 0x7f55f81a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f6a00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55f8101570 0x7f55f81a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 -- 172.21.15.7:0/1996675059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55f8101570 msgr2=0x7f55f81a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55f8101570 0x7f55f81a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 -- 172.21.15.7:0/1996675059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55f8100bc0 msgr2=0x7f55f81a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55f8100bc0 0x7f55f81a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.845+0000 7f55f7e00640 1 -- 172.21.15.7:0/1996675059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f819ad90 con 0x7f55f810e770 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.846+0000 7f55f7e00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 0x7f55f819a610 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009fd0 tx=0x7f55f000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.846+0000 7f55efe00640 1 -- 172.21.15.7:0/1996675059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0004d20 con 0x7f55f810e770 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.846+0000 7f55efe00640 1 -- 172.21.15.7:0/1996675059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55f0005020 con 0x7f55f810e770 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.846+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f819b080 con 0x7f55f810e770 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.846+0000 7f55efe00640 1 -- 172.21.15.7:0/1996675059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00116b0 con 0x7f55f810e770 2024-04-23T15:10:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.846+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f81a7320 con 0x7f55f810e770 2024-04-23T15:10:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.850+0000 7f5600f67740 1 Processor -- start 2024-04-23T15:10:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.851+0000 7f55efe00640 1 -- 172.21.15.7:0/1996675059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f55f00051d0 con 0x7f55f810e770 2024-04-23T15:10:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.851+0000 7f5600f67740 1 -- start start 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f5600f67740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108fe9f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f5600f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108fe9fce0 0x56108feaa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f5600f67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108feaa5a0 0x56108feac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f5600f67740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56108fe05900 con 0x56108fe9f3c0 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f5600f67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56108fdabf20 con 0x56108feaa5a0 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f5600f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56108fe018c0 con 0x56108fe9fce0 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108fe9f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108fe9f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47808/0 (socket says 172.21.15.7:47808) 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f55f6a00640 1 -- 172.21.15.7:0/3028804960 learned_addr learned my addr 172.21.15.7:0/3028804960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f55f7400640 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108fe9fce0 0x56108feaa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f55efe00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f55dc0a3d10 0x7f55dc0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.852+0000 7f55f6a00640 1 -- 172.21.15.7:0/3028804960 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108fe9fce0 msgr2=0x56108feaa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55f6a00640 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108fe9fce0 0x56108feaa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55f6a00640 1 -- 172.21.15.7:0/3028804960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108feaa5a0 msgr2=0x56108feac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55f6a00640 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108feaa5a0 0x56108feac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55f6a00640 1 -- 172.21.15.7:0/3028804960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108fdd0e10 con 0x56108fe9f3c0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55efe00640 1 -- 172.21.15.7:0/1996675059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9555+0+0 (secure 0 0 0) 0x7f55f00d1210 con 0x7f55f810e770 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55f7e00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f55dc0a3d10 0x7f55dc0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55f6a00640 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108fe9f7a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f55e4005ab0 tx=0x7f55e40041c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3db85fc93589f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55e3e00640 1 -- 172.21.15.7:0/3028804960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4040020 con 0x56108fe9f3c0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55e3e00640 1 -- 172.21.15.7:0/3028804960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55e40054f0 con 0x56108fe9f3c0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.853+0000 7f55e3e00640 1 -- 172.21.15.7:0/3028804960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4035070 con 0x56108fe9f3c0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 -- 172.21.15.7:0/3028804960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 msgr2=0x56108fe9f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f55f7e00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f55dc0a3d10 0x7f55dc0a61d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55f00ce550 tx=0x7f55f00054c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108fe9f7a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f55e4005ab0 tx=0x7f55e40041c0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 -- 172.21.15.7:0/3028804960 shutdown_connections 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108feaa5a0 0x56108feac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108fe9fce0 0x56108feaa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 --2- 172.21.15.7:0/3028804960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108fe9f7a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 -- 172.21.15.7:0/3028804960 >> 172.21.15.7:0/3028804960 conn(0x56108fe9b8d0 msgr2=0x56108fe9bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 -- 172.21.15.7:0/3028804960 shutdown_connections 2024-04-23T15:10:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.854+0000 7f5600f67740 1 -- 172.21.15.7:0/3028804960 wait complete. 2024-04-23T15:10:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.855+0000 7f5600f67740 1 -- start start 2024-04-23T15:10:09.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.855+0000 7f5600f67740 1 Processor -- start 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.855+0000 7f5600f67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108fea7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.855+0000 7f5600f67740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108fea7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.855+0000 7f5600f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108fea8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.855+0000 7f5600f67740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56108fead110 con 0x56108fe9fce0 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f5600f67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56108fdbf2c0 con 0x56108fe9f3c0 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f5600f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56108fead290 con 0x56108feaa5a0 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f5600f67740 10 client.0 _ll_register_callbacks cb 0x56108fb17a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108fea7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108fea7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47818/0 (socket says 172.21.15.7:47818) 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 -- 172.21.15.7:0/1590714961 learned_addr learned my addr 172.21.15.7:0/1590714961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 -- 172.21.15.7:0/1590714961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 msgr2=0x56108fea8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108fea8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 -- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 msgr2=0x56108fea7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108fea7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.856+0000 7f55f7400640 1 -- 172.21.15.7:0/1590714961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108fdcffd0 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f55f7400640 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108fea7ac0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f55e8010810 tx=0x7f55e8010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fc13a4e2ecdefd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f55e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f55e0c00640 1 -- 172.21.15.7:0/1590714961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e800ed40 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f55e0c00640 1 -- 172.21.15.7:0/1590714961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9555+0+0 (secure 0 0 0) 0x7f55e801c480 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e40054f0 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f55e0c00640 1 -- 172.21.15.7:0/1590714961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f55e8025050 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f5600f67740 10 client.17163 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56108fb18210 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.857+0000 7f55e0c00640 1 -- 172.21.15.7:0/1590714961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55e40054f0 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f55e0c00640 1 -- 172.21.15.7:0/1590714961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f55e80115b0 con 0x56108fe9fce0 2024-04-23T15:10:09.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f5600f67740 10 client.17163 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f5600f67740 10 client.17163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f5600f67740 20 client.17163 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f5600f67740 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108feba7a0 0x56108febcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f5600f67740 4 client.17163 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:10:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56108fe13320 con 0x56108feba7a0 2024-04-23T15:10:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.858+0000 7f55f6a00640 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108feba7a0 0x56108febcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.859+0000 7f55f6a00640 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108feba7a0 0x56108febcbd0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b2e8de7ce14319a server_cookie=69ab91d8573b6512 in_seq=0 out_seq=0 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.859+0000 7f55e0c00640 10 client.17163 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.861+0000 7f55e0c00640 1 -- 172.21.15.7:0/1590714961 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56108fe13320 con 0x56108feba7a0 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.861+0000 7f55e0c00640 10 client.17163 handle_command_reply: tid=0 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.861+0000 7f5600f67740 1 client.17163 shutdown 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.861+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 msgr2=0x56108fea7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.861+0000 7f5600f67740 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108fea7ac0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f55e8010810 tx=0x7f55e8010cd0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 shutdown_connections 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108feba7a0 0x56108febcbd0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108fea8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108fea7ac0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f55e0c00640 0 client.17163 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 --2- 172.21.15.7:0/1590714961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108fea7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 >> 172.21.15.7:0/1590714961 conn(0x56108fe9b8d0 msgr2=0x56108fea1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 shutdown_connections 2024-04-23T15:10:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 1 -- 172.21.15.7:0/1590714961 wait complete. 2024-04-23T15:10:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.862+0000 7f5600f67740 20 client.17163 trim_cache size 0 max 16384 2024-04-23T15:10:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.881+0000 7f5600f67740 1 Processor -- start 2024-04-23T15:10:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 -- start start 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108feb5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9fce0 0x56108fea7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108fec24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b14a0 con 0x56108fe9f3c0 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b2fe0 con 0x56108fe9fce0 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.882+0000 7f5600f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b1b70 con 0x56108feaa5a0 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108feb5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108feb5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47830/0 (socket says 172.21.15.7:47830) 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 -- 172.21.15.7:0/248365233 learned_addr learned my addr 172.21.15.7:0/248365233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f7400640 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9fce0 0x56108fea7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 -- 172.21.15.7:0/248365233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 msgr2=0x56108fec24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108fec24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 -- 172.21.15.7:0/248365233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9fce0 msgr2=0x56108fea7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9fce0 0x56108fea7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 -- 172.21.15.7:0/248365233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108fbe4620 con 0x56108fe9f3c0 2024-04-23T15:10:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f7400640 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9fce0 0x56108fea7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:10:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.883+0000 7f55f6a00640 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108feb5fd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f55e4004c90 tx=0x7f55e4004c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1243192d1d47a264 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.884+0000 7f55e3400640 1 -- 172.21.15.7:0/248365233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4040030 con 0x56108fe9f3c0 2024-04-23T15:10:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.884+0000 7f55e3400640 1 -- 172.21.15.7:0/248365233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55e40054f0 con 0x56108fe9f3c0 2024-04-23T15:10:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.884+0000 7f55e3400640 1 -- 172.21.15.7:0/248365233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4035040 con 0x56108fe9f3c0 2024-04-23T15:10:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 -- 172.21.15.7:0/248365233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 msgr2=0x56108feb5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108feb5fd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f55e4004c90 tx=0x7f55e4004c20 comp rx=0 tx=0).stop 2024-04-23T15:10:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 -- 172.21.15.7:0/248365233 shutdown_connections 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9fce0 0x56108fea7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108fec24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 --2- 172.21.15.7:0/248365233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9f3c0 0x56108feb5fd0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 -- 172.21.15.7:0/248365233 >> 172.21.15.7:0/248365233 conn(0x56108fe9b8d0 msgr2=0x56108fea7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 -- 172.21.15.7:0/248365233 shutdown_connections 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 -- 172.21.15.7:0/248365233 wait complete. 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 -- start start 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.885+0000 7f5600f67740 1 Processor -- start 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108feadf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108feae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108feaea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b2910 con 0x56108fe9fce0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81b2240 con 0x56108fe9f3c0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81af4a0 con 0x56108feaa5a0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f5600f67740 10 client.0 _ll_register_callbacks cb 0x7f55e800c450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f55f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108feae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f55f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108feae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47832/0 (socket says 172.21.15.7:47832) 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.886+0000 7f55f7400640 1 -- 172.21.15.7:0/557775783 learned_addr learned my addr 172.21.15.7:0/557775783 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f6a00640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108feadf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f6a00640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108feaea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f7400640 1 -- 172.21.15.7:0/557775783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 msgr2=0x56108feaea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f7400640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108feaea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f7400640 1 -- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 msgr2=0x56108feadf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f7400640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108feadf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f7400640 1 -- 172.21.15.7:0/557775783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108ff1fdd0 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f6a00640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108feaea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55f7400640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108feae4c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x56108fea8b50 tx=0x7f55e8011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa681531a51ee6a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.887+0000 7f55e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f55e0c00640 1 -- 172.21.15.7:0/557775783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8022040 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f55e0c00640 1 -- 172.21.15.7:0/557775783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9555+0+0 (secure 0 0 0) 0x7f55e800eb40 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e40054f0 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f55e0c00640 1 -- 172.21.15.7:0/557775783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f55e800ed40 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f5600f67740 10 client.17169 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56108ff210c0 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.888+0000 7f55e0c00640 1 -- 172.21.15.7:0/557775783 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55e40054f0 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f55e0c00640 1 -- 172.21.15.7:0/557775783 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f55e8003a40 con 0x56108fe9fce0 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f5600f67740 10 client.17169 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f5600f67740 10 client.17169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f5600f67740 20 client.17169 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f5600f67740 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108ff21870 0x56108ff23c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f5600f67740 4 client.17169 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56108fe0d190 con 0x56108ff21870 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.889+0000 7f55f6a00640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108ff21870 0x56108ff23c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.890+0000 7f55f6a00640 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108ff21870 0x56108ff23c90 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1df1095d003ad3 server_cookie=fb81f31632f89c20 in_seq=0 out_seq=0 2024-04-23T15:10:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.890+0000 7f55e0c00640 10 client.17169 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f55e0c00640 1 -- 172.21.15.7:0/557775783 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56108fe0d190 con 0x56108ff21870 2024-04-23T15:10:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f55e0c00640 10 client.17169 handle_command_reply: tid=0 2024-04-23T15:10:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 client.17169 shutdown 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 msgr2=0x56108feae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108feae4c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x56108fea8b50 tx=0x7f55e8011c70 comp rx=0 tx=0).stop 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 shutdown_connections 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56108ff21870 0x56108ff23c90 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56108feaa5a0 0x56108feaea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56108fe9fce0 0x56108feae4c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 --2- 172.21.15.7:0/557775783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56108fe9f3c0 0x56108feadf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 >> 172.21.15.7:0/557775783 conn(0x56108fe9b8d0 msgr2=0x56108fea7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.933+0000 7f55e0c00640 0 client.17169 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.934+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 shutdown_connections 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.934+0000 7f5600f67740 1 -- 172.21.15.7:0/557775783 wait complete. 2024-04-23T15:10:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.934+0000 7f5600f67740 20 client.17169 trim_cache size 0 max 16384 2024-04-23T15:10:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:10:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:10:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:10:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f55dc0a3d10 msgr2=0x7f55dc0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f55dc0a3d10 0x7f55dc0a61d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55f00ce550 tx=0x7f55f00054c0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 msgr2=0x7f55f819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 0x7f55f819a610 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009fd0 tx=0x7f55f000ee60 comp rx=0 tx=0).stop 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 shutdown_connections 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f55dc0a3d10 0x7f55dc0a61d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55f810e770 0x7f55f819a610 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55f8101570 0x7f55f81a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 --2- 172.21.15.7:0/1996675059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55f8100bc0 0x7f55f81a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 >> 172.21.15.7:0/1996675059 conn(0x7f55f80fc820 msgr2=0x7f55f810fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 shutdown_connections 2024-04-23T15:10:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:09.935+0000 7f55fcc00640 1 -- 172.21.15.7:0/1996675059 wait complete. 2024-04-23T15:10:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:09 smithi007 ceph-mon[27906]: pgmap v590: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:10:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:10:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:10:10.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:09 smithi186 ceph-mon[31814]: pgmap v590: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:10:10.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:10:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:10:10.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:09 smithi137 ceph-mon[31694]: pgmap v590: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:10:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:10:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:10:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:10:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:10 smithi137 ceph-mon[31694]: pgmap v591: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:10:11.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:10 smithi007 ceph-mon[27906]: pgmap v591: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:10:11.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:10 smithi186 ceph-mon[31814]: pgmap v591: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.3 MiB/s wr, 36 op/s 2024-04-23T15:10:13.137 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:12 smithi007 ceph-mon[27906]: pgmap v592: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:10:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:12 smithi137 ceph-mon[31694]: pgmap v592: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:10:13.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:12 smithi186 ceph-mon[31814]: pgmap v592: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:10:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:14 smithi137 ceph-mon[31694]: pgmap v593: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:10:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:14 smithi007 ceph-mon[27906]: pgmap v593: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:10:15.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:14 smithi186 ceph-mon[31814]: pgmap v593: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:10:16.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:16 smithi007 ceph-mon[27906]: osdmap e118: 12 total, 12 up, 12 in 2024-04-23T15:10:16.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:16 smithi186 ceph-mon[31814]: osdmap e118: 12 total, 12 up, 12 in 2024-04-23T15:10:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:16 smithi137 ceph-mon[31694]: osdmap e118: 12 total, 12 up, 12 in 2024-04-23T15:10:17.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:17 smithi007 ceph-mon[27906]: pgmap v595: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.6 MiB/s wr, 19 op/s 2024-04-23T15:10:17.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:17 smithi186 ceph-mon[31814]: pgmap v595: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.6 MiB/s wr, 19 op/s 2024-04-23T15:10:17.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:17 smithi137 ceph-mon[31694]: pgmap v595: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.6 MiB/s wr, 19 op/s 2024-04-23T15:10:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:18 smithi137 ceph-mon[31694]: pgmap v596: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:10:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:18 smithi007 ceph-mon[27906]: pgmap v596: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:10:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:18 smithi186 ceph-mon[31814]: pgmap v596: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:10:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:20 smithi137 ceph-mon[31694]: pgmap v597: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:10:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:20 smithi007 ceph-mon[27906]: pgmap v597: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:10:21.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:20 smithi186 ceph-mon[31814]: pgmap v597: 129 pgs: 129 active+clean; 4.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:10:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 -- 172.21.15.7:0/3365379425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5410c3e0 msgr2=0x7f5b5410e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 --2- 172.21.15.7:0/3365379425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5410c3e0 0x7f5b5410e880 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009ca0 tx=0x7f5b4c02a950 comp rx=0 tx=0).stop 2024-04-23T15:10:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 -- 172.21.15.7:0/3365379425 shutdown_connections 2024-04-23T15:10:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 --2- 172.21.15.7:0/3365379425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b5410c3e0 0x7f5b5410e880 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 --2- 172.21.15.7:0/3365379425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b541038e0 0x7f5b5410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 --2- 172.21.15.7:0/3365379425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b54102fc0 0x7f5b541033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 -- 172.21.15.7:0/3365379425 >> 172.21.15.7:0/3365379425 conn(0x7f5b540fc820 msgr2=0x7f5b540fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 -- 172.21.15.7:0/3365379425 shutdown_connections 2024-04-23T15:10:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.107+0000 7f5b53200640 1 -- 172.21.15.7:0/3365379425 wait complete. 2024-04-23T15:10:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 Processor -- start 2024-04-23T15:10:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 -- start start 2024-04-23T15:10:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 0x7f5b54100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b541038e0 0x7f5b54101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b5410c3e0 0x7f5b54101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54112070 con 0x7f5b54102fc0 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54111ef0 con 0x7f5b541038e0 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.109+0000 7f5b53200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541121f0 con 0x7f5b5410c3e0 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 0x7f5b54100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 0x7f5b54100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39780/0 (socket says 172.21.15.7:39780) 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 -- 172.21.15.7:0/3009871912 learned_addr learned my addr 172.21.15.7:0/3009871912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51400640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b541038e0 0x7f5b54101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b52800640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b5410c3e0 0x7f5b54101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 -- 172.21.15.7:0/3009871912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b5410c3e0 msgr2=0x7f5b54101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b5410c3e0 0x7f5b54101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 -- 172.21.15.7:0/3009871912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b541038e0 msgr2=0x7f5b54101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b541038e0 0x7f5b54101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.110+0000 7f5b51e00640 1 -- 172.21.15.7:0/3009871912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b541aaf70 con 0x7f5b54102fc0 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.111+0000 7f5b51e00640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 0x7f5b54100c10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400d950 tx=0x7f5b4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.111+0000 7f5b4aa00640 1 -- 172.21.15.7:0/3009871912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44017070 con 0x7f5b54102fc0 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.111+0000 7f5b4aa00640 1 -- 172.21.15.7:0/3009871912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b44009c30 con 0x7f5b54102fc0 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.111+0000 7f5b4aa00640 1 -- 172.21.15.7:0/3009871912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400f620 con 0x7f5b54102fc0 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.111+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b541ab1a0 con 0x7f5b54102fc0 2024-04-23T15:10:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.111+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b541ab740 con 0x7f5b54102fc0 2024-04-23T15:10:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.116+0000 7f5b5be5b740 1 Processor -- start 2024-04-23T15:10:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.116+0000 7f5b5be5b740 1 -- start start 2024-04-23T15:10:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.116+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c387a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.116+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c43060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c45990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a155b9e900 con 0x55a155c383c0 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a155b44f20 con 0x55a155c38ce0 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a155b9a8c0 con 0x55a155c435a0 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c387a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39796/0 (socket says 172.21.15.7:39796) 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 -- 172.21.15.7:0/1472647274 learned_addr learned my addr 172.21.15.7:0/1472647274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b4aa00640 1 -- 172.21.15.7:0/3009871912 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5b440109a0 con 0x7f5b54102fc0 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b51400640 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c45990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 -- 172.21.15.7:0/1472647274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 msgr2=0x55a155c45990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c45990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 -- 172.21.15.7:0/1472647274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 msgr2=0x55a155c43060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:10:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.117+0000 7f5b52800640 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c43060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.118+0000 7f5b52800640 1 -- 172.21.15.7:0/1472647274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a155b69e10 con 0x55a155c383c0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.118+0000 7f5b52800640 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c387a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009420 tx=0x7f5b4c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76e0386519da1b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.118+0000 7f5b3f400640 1 -- 172.21.15.7:0/1472647274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c034050 con 0x55a155c383c0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b3f400640 1 -- 172.21.15.7:0/1472647274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b4c003e20 con 0x55a155c383c0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b3f400640 1 -- 172.21.15.7:0/1472647274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0042a0 con 0x55a155c383c0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b4aa00640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5b380a3d90 0x7f5b380a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b4aa00640 1 -- 172.21.15.7:0/3009871912 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7f5b440d0820 con 0x7f5b54102fc0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b51e00640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5b380a3d90 0x7f5b380a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b5be5b740 1 -- 172.21.15.7:0/1472647274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 msgr2=0x55a155c387a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.119+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c387a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009420 tx=0x7f5b4c009a20 comp rx=0 tx=0).stop 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 -- 172.21.15.7:0/1472647274 shutdown_connections 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c43060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c45990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/1472647274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c387a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 -- 172.21.15.7:0/1472647274 >> 172.21.15.7:0/1472647274 conn(0x55a155c348d0 msgr2=0x55a155c34cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 -- 172.21.15.7:0/1472647274 shutdown_connections 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b5be5b740 1 -- 172.21.15.7:0/1472647274 wait complete. 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.120+0000 7f5b51e00640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5b380a3d90 0x7f5b380a6250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55a155c39960 tx=0x7f5b44098050 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.121+0000 7f5b5be5b740 1 -- start start 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.121+0000 7f5b5be5b740 1 Processor -- start 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c40550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c40a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c40fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a155c46180 con 0x55a155c383c0 2024-04-23T15:10:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a155b582c0 con 0x55a155c38ce0 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a155c46300 con 0x55a155c435a0 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b5be5b740 10 client.0 _ll_register_callbacks cb 0x55a1558b0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c40550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c40550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39802/0 (socket says 172.21.15.7:39802) 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b52800640 1 -- 172.21.15.7:0/3090651455 learned_addr learned my addr 172.21.15.7:0/3090651455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.122+0000 7f5b51400640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c40a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c40fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 -- 172.21.15.7:0/3090651455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 msgr2=0x55a155c40fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c40fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 -- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 msgr2=0x55a155c40a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c40a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 -- 172.21.15.7:0/3090651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a155b68fd0 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b52800640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c40550 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009ca0 tx=0x7f5b4c02b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05f98a3c6c07b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.123+0000 7f5b33e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.124+0000 7f5b33e00640 1 -- 172.21.15.7:0/3090651455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c048040 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.124+0000 7f5b33e00640 1 -- 172.21.15.7:0/3090651455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7f5b4c004000 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.124+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4c003e20 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.124+0000 7f5b33e00640 1 -- 172.21.15.7:0/3090651455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5b4c059050 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.124+0000 7f5b5be5b740 10 client.17181 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.124+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a1558b1210 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b33e00640 1 -- 172.21.15.7:0/3090651455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b4c003e20 con 0x55a155c383c0 2024-04-23T15:10:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b33e00640 1 -- 172.21.15.7:0/3090651455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5b4c04e020 con 0x55a155c383c0 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b5be5b740 10 client.17181 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b5be5b740 10 client.17181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b5be5b740 20 client.17181 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155c535f0 0x55a155c559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b5be5b740 4 client.17181 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.125+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a155bac320 con 0x55a155c535f0 2024-04-23T15:10:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.126+0000 7f5b51400640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155c535f0 0x55a155c559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.127+0000 7f5b51400640 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155c535f0 0x55a155c559e0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5978f558c3ffde server_cookie=478c407a738aa2e6 in_seq=0 out_seq=0 2024-04-23T15:10:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.127+0000 7f5b33e00640 10 client.17181 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.129+0000 7f5b33e00640 1 -- 172.21.15.7:0/3090651455 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a155bac320 con 0x55a155c535f0 2024-04-23T15:10:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.129+0000 7f5b33e00640 10 client.17181 handle_command_reply: tid=0 2024-04-23T15:10:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.129+0000 7f5b5be5b740 1 client.17181 shutdown 2024-04-23T15:10:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 msgr2=0x55a155c40550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c40550 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009ca0 tx=0x7f5b4c02b090 comp rx=0 tx=0).stop 2024-04-23T15:10:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 shutdown_connections 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155c535f0 0x55a155c559e0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c40a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b33e00640 0 client.17181 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c435a0 0x55a155c40fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/3090651455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c40550 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.130+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 >> 172.21.15.7:0/3090651455 conn(0x55a155c348d0 msgr2=0x55a155c3a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.131+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 shutdown_connections 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.131+0000 7f5b5be5b740 1 -- 172.21.15.7:0/3090651455 wait complete. 2024-04-23T15:10:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.131+0000 7f5b5be5b740 20 client.17181 trim_cache size 0 max 16384 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 Processor -- start 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 -- start start 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c383c0 0x55a155c42c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c4ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 0x55a155c58a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541b5900 con 0x55a155c435a0 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541b7440 con 0x55a155c38ce0 2024-04-23T15:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.154+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541b5fd0 con 0x55a155c383c0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 0x55a155c58a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 0x55a155c58a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39812/0 (socket says 172.21.15.7:39812) 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 -- 172.21.15.7:0/783916738 learned_addr learned my addr 172.21.15.7:0/783916738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c383c0 0x55a155c42c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b51400640 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c4ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 -- 172.21.15.7:0/783916738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c383c0 msgr2=0x55a155c42c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c383c0 0x55a155c42c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 -- 172.21.15.7:0/783916738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 msgr2=0x55a155c4ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c4ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 -- 172.21.15.7:0/783916738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15597d620 con 0x55a155c435a0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.155+0000 7f5b52800640 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 0x55a155c58a00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0439d0 tx=0x7f5b4c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb865d59f6bb903 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.156+0000 7f5b3ea00640 1 -- 172.21.15.7:0/783916738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c034070 con 0x55a155c435a0 2024-04-23T15:10:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.156+0000 7f5b3ea00640 1 -- 172.21.15.7:0/783916738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b4c005bf0 con 0x55a155c435a0 2024-04-23T15:10:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.156+0000 7f5b3ea00640 1 -- 172.21.15.7:0/783916738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c043a50 con 0x55a155c435a0 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 -- 172.21.15.7:0/783916738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 msgr2=0x55a155c58a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 0x55a155c58a00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0439d0 tx=0x7f5b4c009a20 comp rx=0 tx=0).stop 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 -- 172.21.15.7:0/783916738 shutdown_connections 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c38ce0 0x55a155c4ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c435a0 0x55a155c58a00 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/783916738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c383c0 0x55a155c42c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 -- 172.21.15.7:0/783916738 >> 172.21.15.7:0/783916738 conn(0x55a155c348d0 msgr2=0x55a155c4e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 -- 172.21.15.7:0/783916738 shutdown_connections 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 -- 172.21.15.7:0/783916738 wait complete. 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.157+0000 7f5b5be5b740 1 -- start start 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 Processor -- start 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c58a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c38ce0 0x55a155c55fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c435a0 0x55a155c564e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541b6d70 con 0x55a155c383c0 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541b66a0 con 0x55a155c435a0 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541b3900 con 0x55a155c38ce0 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.158+0000 7f5b5be5b740 10 client.0 _ll_register_callbacks cb 0x7f5b4c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c58a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c58a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39826/0 (socket says 172.21.15.7:39826) 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 -- 172.21.15.7:0/169459884 learned_addr learned my addr 172.21.15.7:0/169459884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b51400640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c38ce0 0x55a155c55fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c435a0 0x55a155c564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 -- 172.21.15.7:0/169459884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c38ce0 msgr2=0x55a155c55fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c38ce0 0x55a155c55fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 -- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c435a0 msgr2=0x55a155c564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c435a0 0x55a155c564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 -- 172.21.15.7:0/169459884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a155c56a20 con 0x55a155c383c0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b51400640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c38ce0 0x55a155c55fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b52800640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c58a90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c02fd10 tx=0x7f5b4c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7239b8568e0549ea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.159+0000 7f5b33e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b33e00640 1 -- 172.21.15.7:0/169459884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c062070 con 0x55a155c383c0 2024-04-23T15:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b33e00640 1 -- 172.21.15.7:0/169459884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7f5b4c05e480 con 0x55a155c383c0 2024-04-23T15:10:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4c005bf0 con 0x55a155c383c0 2024-04-23T15:10:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b33e00640 1 -- 172.21.15.7:0/169459884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5b4c034030 con 0x55a155c383c0 2024-04-23T15:10:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b5be5b740 10 client.17187 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a155cb94f0 con 0x55a155c383c0 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.160+0000 7f5b33e00640 1 -- 172.21.15.7:0/169459884 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b4c005bf0 con 0x55a155c383c0 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b33e00640 1 -- 172.21.15.7:0/169459884 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5b4c04e070 con 0x55a155c383c0 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b5be5b740 10 client.17187 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b5be5b740 10 client.17187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b5be5b740 20 client.17187 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155cb9970 0x55a155cbbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b5be5b740 4 client.17187 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.161+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a155ba6190 con 0x55a155cb9970 2024-04-23T15:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.162+0000 7f5b51400640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155cb9970 0x55a155cbbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.162+0000 7f5b51400640 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155cb9970 0x55a155cbbd60 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c116412c33cbb144 server_cookie=a045ab037aa8a974 in_seq=0 out_seq=0 2024-04-23T15:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.162+0000 7f5b33e00640 10 client.17187 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:22 smithi137 ceph-mon[31694]: pgmap v598: 129 pgs: 129 active+clean; 4.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b33e00640 1 -- 172.21.15.7:0/169459884 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a155ba6190 con 0x55a155cb9970 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b33e00640 10 client.17187 handle_command_reply: tid=0 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 client.17187 shutdown 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 msgr2=0x55a155c58a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c58a90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c02fd10 tx=0x7f5b4c0098e0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 shutdown_connections 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a155cb9970 0x55a155cbbd60 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a155c435a0 0x55a155c564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a155c38ce0 0x55a155c55fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 --2- 172.21.15.7:0/169459884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a155c383c0 0x55a155c58a90 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 >> 172.21.15.7:0/169459884 conn(0x55a155c348d0 msgr2=0x55a155c39d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b33e00640 0 client.17187 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.206+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 shutdown_connections 2024-04-23T15:10:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.207+0000 7f5b5be5b740 1 -- 172.21.15.7:0/169459884 wait complete. 2024-04-23T15:10:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.207+0000 7f5b5be5b740 20 client.17187 trim_cache size 0 max 16384 2024-04-23T15:10:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:10:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:10:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:10:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5b380a3d90 msgr2=0x7f5b380a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5b380a3d90 0x7f5b380a6250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55a155c39960 tx=0x7f5b44098050 comp rx=0 tx=0).stop 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 msgr2=0x7f5b54100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 0x7f5b54100c10 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400d950 tx=0x7f5b4400de10 comp rx=0 tx=0).stop 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 shutdown_connections 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5b380a3d90 0x7f5b380a6250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b541038e0 0x7f5b54101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b5410c3e0 0x7f5b54101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 --2- 172.21.15.7:0/3009871912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b54102fc0 0x7f5b54100c10 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 >> 172.21.15.7:0/3009871912 conn(0x7f5b540fc820 msgr2=0x7f5b540fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 shutdown_connections 2024-04-23T15:10:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:23.208+0000 7f5b53200640 1 -- 172.21.15.7:0/3009871912 wait complete. 2024-04-23T15:10:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:22 smithi007 ceph-mon[27906]: pgmap v598: 129 pgs: 129 active+clean; 4.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:10:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:22 smithi186 ceph-mon[31814]: pgmap v598: 129 pgs: 129 active+clean; 4.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:10:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:24 smithi137 ceph-mon[31694]: pgmap v599: 129 pgs: 129 active+clean; 4.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:10:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:24 smithi007 ceph-mon[27906]: pgmap v599: 129 pgs: 129 active+clean; 4.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:10:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:24 smithi186 ceph-mon[31814]: pgmap v599: 129 pgs: 129 active+clean; 4.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:10:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:26 smithi137 ceph-mon[31694]: pgmap v600: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:10:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:26 smithi007 ceph-mon[27906]: pgmap v600: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:10:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:26 smithi186 ceph-mon[31814]: pgmap v600: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 19 op/s 2024-04-23T15:10:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:28 smithi137 ceph-mon[31694]: pgmap v601: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:10:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:28 smithi007 ceph-mon[27906]: pgmap v601: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:10:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:28 smithi186 ceph-mon[31814]: pgmap v601: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:10:31.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:30 smithi186 ceph-mon[31814]: pgmap v602: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:10:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:30 smithi137 ceph-mon[31694]: pgmap v602: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:10:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:30 smithi007 ceph-mon[27906]: pgmap v602: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:10:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:32 smithi137 ceph-mon[31694]: pgmap v603: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:32 smithi007 ceph-mon[27906]: pgmap v603: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:33.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:32 smithi186 ceph-mon[31814]: pgmap v603: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:34 smithi137 ceph-mon[31694]: pgmap v604: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:10:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:34 smithi007 ceph-mon[27906]: pgmap v604: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:10:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:34 smithi186 ceph-mon[31814]: pgmap v604: 129 pgs: 129 active+clean; 4.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:10:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.365+0000 7fb050a00640 1 -- 172.21.15.7:0/3024676916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c102090 msgr2=0x7fb04c102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.365+0000 7fb050a00640 1 --2- 172.21.15.7:0/3024676916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c102090 0x7fb04c102470 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009900 tx=0x7fb03c02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 -- 172.21.15.7:0/3024676916 shutdown_connections 2024-04-23T15:10:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 --2- 172.21.15.7:0/3024676916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c102a40 0x7fb04c106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 --2- 172.21.15.7:0/3024676916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb04c107160 0x7fb04c10ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 --2- 172.21.15.7:0/3024676916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c102090 0x7fb04c102470 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 -- 172.21.15.7:0/3024676916 >> 172.21.15.7:0/3024676916 conn(0x7fb04c0fd950 msgr2=0x7fb04c0ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 -- 172.21.15.7:0/3024676916 shutdown_connections 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.366+0000 7fb050a00640 1 -- 172.21.15.7:0/3024676916 wait complete. 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 Processor -- start 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 -- start start 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb04c102090 0x7fb04c074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c107160 0x7fb04c074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 0x7fb04c1a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1120d0 con 0x7fb04c074d80 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c111f50 con 0x7fb04c107160 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.367+0000 7fb050a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c112250 con 0x7fb04c102090 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 0x7fb04c1a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 0x7fb04c1a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43862/0 (socket says 172.21.15.7:43862) 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 -- 172.21.15.7:0/2874194067 learned_addr learned my addr 172.21.15.7:0/2874194067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04a800640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb04c102090 0x7fb04c074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb049e00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c107160 0x7fb04c074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 -- 172.21.15.7:0/2874194067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb04c102090 msgr2=0x7fb04c074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb04c102090 0x7fb04c074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 -- 172.21.15.7:0/2874194067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c107160 msgr2=0x7fb04c074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c107160 0x7fb04c074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.368+0000 7fb04b200640 1 -- 172.21.15.7:0/2874194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c1a7000 con 0x7fb04c074d80 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.369+0000 7fb04b200640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 0x7fb04c1a6900 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb04400eaa0 tx=0x7fb04400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.369+0000 7fb043400640 1 -- 172.21.15.7:0/2874194067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04400cdb0 con 0x7fb04c074d80 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.369+0000 7fb043400640 1 -- 172.21.15.7:0/2874194067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb044005020 con 0x7fb04c074d80 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.369+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c1a72f0 con 0x7fb04c074d80 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.369+0000 7fb043400640 1 -- 172.21.15.7:0/2874194067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440116d0 con 0x7fb04c074d80 2024-04-23T15:10:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.369+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c1a7840 con 0x7fb04c074d80 2024-04-23T15:10:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.373+0000 7fb043400640 1 -- 172.21.15.7:0/2874194067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb0440051d0 con 0x7fb04c074d80 2024-04-23T15:10:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.373+0000 7fb0541e1740 1 Processor -- start 2024-04-23T15:10:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.373+0000 7fb0541e1740 1 -- start start 2024-04-23T15:10:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb0541e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561bee92e900 con 0x561bee9c8ce0 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb0541e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561bee8d4f20 con 0x561bee9c83c0 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb0541e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561bee92a8c0 con 0x561bee9d35a0 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb04a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb04a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43878/0 (socket says 172.21.15.7:43878) 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb04a800640 1 -- 172.21.15.7:0/438210984 learned_addr learned my addr 172.21.15.7:0/438210984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb049e00640 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb04a800640 1 -- 172.21.15.7:0/438210984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 msgr2=0x561bee9d5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.374+0000 7fb049e00640 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb04a800640 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb04a800640 1 -- 172.21.15.7:0/438210984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 msgr2=0x561bee9c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb04a800640 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb04a800640 1 -- 172.21.15.7:0/438210984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bee8f9e10 con 0x561bee9c8ce0 2024-04-23T15:10:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb049e00640 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:10:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb043400640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0300a3d40 0x7fb0300a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb04a800640 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d3060 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009900 tx=0x7fb03c032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf78ad5819c3036 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb043400640 1 -- 172.21.15.7:0/2874194067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7fb0440d0d40 con 0x7fb04c074d80 2024-04-23T15:10:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb049e00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0300a3d40 0x7fb0300a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.375+0000 7fb037400640 1 -- 172.21.15.7:0/438210984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c040070 con 0x561bee9c8ce0 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.376+0000 7fb037400640 1 -- 172.21.15.7:0/438210984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb03c004030 con 0x561bee9c8ce0 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.376+0000 7fb037400640 1 -- 172.21.15.7:0/438210984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c035040 con 0x561bee9c8ce0 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.376+0000 7fb0541e1740 1 -- 172.21.15.7:0/438210984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 msgr2=0x561bee9d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.376+0000 7fb049e00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0300a3d40 0x7fb0300a6200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561bee9c5cf0 tx=0x7fb038004730 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.376+0000 7fb0541e1740 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d3060 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009900 tx=0x7fb03c032bb0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 -- 172.21.15.7:0/438210984 shutdown_connections 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d3060 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 --2- 172.21.15.7:0/438210984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 -- 172.21.15.7:0/438210984 >> 172.21.15.7:0/438210984 conn(0x561bee9c48d0 msgr2=0x561bee9c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 -- 172.21.15.7:0/438210984 shutdown_connections 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 -- 172.21.15.7:0/438210984 wait complete. 2024-04-23T15:10:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 -- start start 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.377+0000 7fb0541e1740 1 Processor -- start 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561bee9d60e0 con 0x561bee9c8ce0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561bee8e82c0 con 0x561bee9c83c0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561bee9d6260 con 0x561bee9d35a0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb0541e1740 10 client.0 _ll_register_callbacks cb 0x561bee640a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb049e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb049e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43886/0 (socket says 172.21.15.7:43886) 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb049e00640 1 -- 172.21.15.7:0/2670421486 learned_addr learned my addr 172.21.15.7:0/2670421486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb04a800640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.378+0000 7fb04b200640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb049e00640 1 -- 172.21.15.7:0/2670421486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 msgr2=0x561bee9d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb049e00640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb049e00640 1 -- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 msgr2=0x561bee9d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb049e00640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb049e00640 1 -- 172.21.15.7:0/2670421486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bee8f8fd0 con 0x561bee9c8ce0 2024-04-23T15:10:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb049e00640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d0ba0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb038011a20 tx=0x7fb03800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc3993687f3eba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb02be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb02be00640 1 -- 172.21.15.7:0/2670421486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03801ee00 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb02be00640 1 -- 172.21.15.7:0/2670421486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7fb038004020 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.379+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb03c004030 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.380+0000 7fb02be00640 1 -- 172.21.15.7:0/2670421486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb038004220 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.380+0000 7fb0541e1740 10 client.17199 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.380+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561bee641210 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.380+0000 7fb02be00640 1 -- 172.21.15.7:0/2670421486 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb03c004030 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.380+0000 7fb02be00640 1 -- 172.21.15.7:0/2670421486 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb03801f440 con 0x561bee9c8ce0 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb0541e1740 10 client.17199 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb0541e1740 10 client.17199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb0541e1740 20 client.17199 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561bee9e3790 0x561bee9e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb0541e1740 4 client.17199 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:10:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bee93c320 con 0x561bee9e3790 2024-04-23T15:10:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.381+0000 7fb04a800640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561bee9e3790 0x561bee9e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.382+0000 7fb04a800640 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561bee9e3790 0x561bee9e5be0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a0b63d5db62c0e server_cookie=c511e936a187a7e3 in_seq=0 out_seq=0 2024-04-23T15:10:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.382+0000 7fb02be00640 10 client.17199 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.384+0000 7fb02be00640 1 -- 172.21.15.7:0/2670421486 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561bee93c320 con 0x561bee9e3790 2024-04-23T15:10:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.384+0000 7fb02be00640 10 client.17199 handle_command_reply: tid=0 2024-04-23T15:10:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.384+0000 7fb0541e1740 1 client.17199 shutdown 2024-04-23T15:10:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.384+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 msgr2=0x561bee9d0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.384+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d0ba0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb038011a20 tx=0x7fb03800c450 comp rx=0 tx=0).stop 2024-04-23T15:10:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 shutdown_connections 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561bee9e3790 0x561bee9e5be0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c8ce0 0x561bee9d0ba0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2670421486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c83c0 0x561bee9d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 >> 172.21.15.7:0/2670421486 conn(0x561bee9c48d0 msgr2=0x561bee9ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb02be00640 0 client.17199 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 shutdown_connections 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 1 -- 172.21.15.7:0/2670421486 wait complete. 2024-04-23T15:10:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.385+0000 7fb0541e1740 20 client.17199 trim_cache size 0 max 16384 2024-04-23T15:10:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.405+0000 7fb0541e1740 1 Processor -- start 2024-04-23T15:10:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.405+0000 7fb0541e1740 1 -- start start 2024-04-23T15:10:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c8ce0 0x561bee9cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9eb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb0541e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1b1540 con 0x561bee9c83c0 2024-04-23T15:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb0541e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1b3080 con 0x561bee9c8ce0 2024-04-23T15:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb0541e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1b1c10 con 0x561bee9d35a0 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb04a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb04a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9d2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43894/0 (socket says 172.21.15.7:43894) 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb04a800640 1 -- 172.21.15.7:0/2273655726 learned_addr learned my addr 172.21.15.7:0/2273655726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb049e00640 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c8ce0 0x561bee9cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.406+0000 7fb04b200640 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9eb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb04a800640 1 -- 172.21.15.7:0/2273655726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 msgr2=0x561bee9eb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb04a800640 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9eb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb04a800640 1 -- 172.21.15.7:0/2273655726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c8ce0 msgr2=0x561bee9cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb04a800640 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c8ce0 0x561bee9cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb04a800640 1 -- 172.21.15.7:0/2273655726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bee9cf610 con 0x561bee9c83c0 2024-04-23T15:10:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb04a800640 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9d2d90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb03c043000 tx=0x7fb03c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb286e790a634c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb036a00640 1 -- 172.21.15.7:0/2273655726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c035040 con 0x561bee9c83c0 2024-04-23T15:10:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb036a00640 1 -- 172.21.15.7:0/2273655726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb03c0054f0 con 0x561bee9c83c0 2024-04-23T15:10:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.407+0000 7fb036a00640 1 -- 172.21.15.7:0/2273655726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c040040 con 0x561bee9c83c0 2024-04-23T15:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 -- 172.21.15.7:0/2273655726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 msgr2=0x561bee9d2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9d2d90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb03c043000 tx=0x7fb03c005fd0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 -- 172.21.15.7:0/2273655726 shutdown_connections 2024-04-23T15:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9c8ce0 0x561bee9cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9d35a0 0x561bee9eb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 --2- 172.21.15.7:0/2273655726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9d2d90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 -- 172.21.15.7:0/2273655726 >> 172.21.15.7:0/2273655726 conn(0x561bee9c48d0 msgr2=0x561bee9ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 -- 172.21.15.7:0/2273655726 shutdown_connections 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.408+0000 7fb0541e1740 1 -- 172.21.15.7:0/2273655726 wait complete. 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 -- start start 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 Processor -- start 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9c8ce0 0x561bee9db790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9d35a0 0x561bee9d7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1b29b0 con 0x561bee9c83c0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1b22e0 con 0x561bee9d35a0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c1af540 con 0x561bee9c8ce0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.409+0000 7fb0541e1740 10 client.0 _ll_register_callbacks cb 0x7fb03800cae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9db250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43902/0 (socket says 172.21.15.7:43902) 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 -- 172.21.15.7:0/1271711924 learned_addr learned my addr 172.21.15.7:0/1271711924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb049e00640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9c8ce0 0x561bee9db790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 -- 172.21.15.7:0/1271711924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9c8ce0 msgr2=0x561bee9db790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9c8ce0 0x561bee9db790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 -- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9d35a0 msgr2=0x561bee9d7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9d35a0 0x561bee9d7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb04a800640 1 -- 172.21.15.7:0/1271711924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bee9c8b10 con 0x561bee9c83c0 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.410+0000 7fb049e00640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9c8ce0 0x561bee9db790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:10:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb04a800640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9db250 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb03c000c00 tx=0x7fb03c005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4beb4dbedace8aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb02be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb02be00640 1 -- 172.21.15.7:0/1271711924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c057070 con 0x561bee9c83c0 2024-04-23T15:10:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb03c0054f0 con 0x561bee9c83c0 2024-04-23T15:10:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb02be00640 1 -- 172.21.15.7:0/1271711924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7fb03c0500d0 con 0x561bee9c83c0 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb02be00640 1 -- 172.21.15.7:0/1271711924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb03c063050 con 0x561bee9c83c0 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb0541e1740 10 client.17205 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.411+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561bee70d620 con 0x561bee9c83c0 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb02be00640 1 -- 172.21.15.7:0/1271711924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb03c0054f0 con 0x561bee9c83c0 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb02be00640 1 -- 172.21.15.7:0/1271711924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb03c05c6d0 con 0x561bee9c83c0 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb0541e1740 10 client.17205 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb0541e1740 10 client.17205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb0541e1740 20 client.17205 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb0541e1740 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561beea4a600 0x561beea4c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb0541e1740 4 client.17205 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:10:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.412+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561bee936190 con 0x561beea4a600 2024-04-23T15:10:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.413+0000 7fb049e00640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561beea4a600 0x561beea4c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.414+0000 7fb049e00640 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561beea4a600 0x561beea4c9f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181c4c73734d8e45 server_cookie=b353661183593ab1 in_seq=0 out_seq=0 2024-04-23T15:10:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.414+0000 7fb02be00640 10 client.17205 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.453+0000 7fb02be00640 1 -- 172.21.15.7:0/1271711924 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561bee936190 con 0x561beea4a600 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.453+0000 7fb02be00640 10 client.17205 handle_command_reply: tid=0 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.453+0000 7fb0541e1740 1 client.17205 shutdown 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.453+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 msgr2=0x561bee9db250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.453+0000 7fb0541e1740 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9db250 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb03c000c00 tx=0x7fb03c005be0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 shutdown_connections 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561beea4a600 0x561beea4c9f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561bee9d35a0 0x561bee9d7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561bee9c8ce0 0x561bee9db790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 --2- 172.21.15.7:0/1271711924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561bee9c83c0 0x561bee9db250 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb02be00640 0 client.17205 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 >> 172.21.15.7:0/1271711924 conn(0x561bee9c48d0 msgr2=0x561bee9ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 shutdown_connections 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 1 -- 172.21.15.7:0/1271711924 wait complete. 2024-04-23T15:10:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.454+0000 7fb0541e1740 20 client.17205 trim_cache size 0 max 16384 2024-04-23T15:10:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:10:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:10:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:10:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0300a3d40 msgr2=0x7fb0300a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0300a3d40 0x7fb0300a6200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561bee9c5cf0 tx=0x7fb038004730 comp rx=0 tx=0).stop 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 msgr2=0x7fb04c1a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 0x7fb04c1a6900 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb04400eaa0 tx=0x7fb04400ef60 comp rx=0 tx=0).stop 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 shutdown_connections 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb0300a3d40 0x7fb0300a6200 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c107160 0x7fb04c074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb04c074d80 0x7fb04c1a6900 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 --2- 172.21.15.7:0/2874194067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb04c102090 0x7fb04c074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 >> 172.21.15.7:0/2874194067 conn(0x7fb04c0fd950 msgr2=0x7fb04c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 shutdown_connections 2024-04-23T15:10:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:36.455+0000 7fb050a00640 1 -- 172.21.15.7:0/2874194067 wait complete. 2024-04-23T15:10:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:36 smithi137 ceph-mon[31694]: pgmap v605: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:10:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:36 smithi007 ceph-mon[27906]: pgmap v605: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:10:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:36 smithi186 ceph-mon[31814]: pgmap v605: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:10:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:38 smithi137 ceph-mon[31694]: pgmap v606: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:10:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:38 smithi007 ceph-mon[27906]: pgmap v606: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:10:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:38 smithi186 ceph-mon[31814]: pgmap v606: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:10:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:40 smithi137 ceph-mon[31694]: pgmap v607: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:10:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:40 smithi007 ceph-mon[27906]: pgmap v607: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:10:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:40 smithi186 ceph-mon[31814]: pgmap v607: 129 pgs: 129 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:10:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:42 smithi137 ceph-mon[31694]: pgmap v608: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:10:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:42 smithi007 ceph-mon[27906]: pgmap v608: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:10:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:42 smithi186 ceph-mon[31814]: pgmap v608: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:10:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:44 smithi137 ceph-mon[31694]: pgmap v609: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:10:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:44 smithi007 ceph-mon[27906]: pgmap v609: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:10:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:44 smithi186 ceph-mon[31814]: pgmap v609: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:10:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:46 smithi137 ceph-mon[31694]: pgmap v610: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:46 smithi007 ceph-mon[27906]: pgmap v610: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:46 smithi186 ceph-mon[31814]: pgmap v610: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:48 smithi137 ceph-mon[31694]: pgmap v611: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:48 smithi007 ceph-mon[27906]: pgmap v611: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:48 smithi186 ceph-mon[31814]: pgmap v611: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 -- 172.21.15.7:0/806403628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa8103000 msgr2=0x7f0aa81033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/806403628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa8103000 0x7f0aa81033e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009900 tx=0x7f0a9802a480 comp rx=0 tx=0).stop 2024-04-23T15:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 -- 172.21.15.7:0/806403628 shutdown_connections 2024-04-23T15:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/806403628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa810c3d0 0x7f0aa810e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/806403628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 0x7f0aa810be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/806403628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa8103000 0x7f0aa81033e0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 -- 172.21.15.7:0/806403628 >> 172.21.15.7:0/806403628 conn(0x7f0aa80fc820 msgr2=0x7f0aa80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 -- 172.21.15.7:0/806403628 shutdown_connections 2024-04-23T15:10:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.616+0000 7f0aa7e00640 1 -- 172.21.15.7:0/806403628 wait complete. 2024-04-23T15:10:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.617+0000 7f0aa7e00640 1 Processor -- start 2024-04-23T15:10:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 -- start start 2024-04-23T15:10:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa8103000 0x7f0aa8100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 0x7f0aa8101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 0x7f0aa81016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81120b0 con 0x7f0aa810c3d0 2024-04-23T15:10:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8111f30 con 0x7f0aa8103000 2024-04-23T15:10:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8112230 con 0x7f0aa8103920 2024-04-23T15:10:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.618+0000 7f0aa7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 0x7f0aa81016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 0x7f0aa81016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47802/0 (socket says 172.21.15.7:47802) 2024-04-23T15:10:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 -- 172.21.15.7:0/3528257824 learned_addr learned my addr 172.21.15.7:0/3528257824 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa8103000 0x7f0aa8100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0a9e000640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 0x7f0aa8101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 -- 172.21.15.7:0/3528257824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 msgr2=0x7f0aa8101190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 0x7f0aa8101190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 -- 172.21.15.7:0/3528257824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa8103000 msgr2=0x7f0aa8100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa8103000 0x7f0aa8100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 -- 172.21.15.7:0/3528257824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa81a6b50 con 0x7f0aa810c3d0 2024-04-23T15:10:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0a9e000640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 0x7f0aa8101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:10:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa8103000 0x7f0aa8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:10:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.619+0000 7f0aa7400640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 0x7f0aa81016d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009fd0 tx=0x7f0aa000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.620+0000 7f0a9fe00640 1 -- 172.21.15.7:0/3528257824 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0017070 con 0x7f0aa810c3d0 2024-04-23T15:10:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.620+0000 7f0a9fe00640 1 -- 172.21.15.7:0/3528257824 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aa0003e20 con 0x7f0aa810c3d0 2024-04-23T15:10:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.620+0000 7f0a9fe00640 1 -- 172.21.15.7:0/3528257824 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0010460 con 0x7f0aa810c3d0 2024-04-23T15:10:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.620+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa81a6e40 con 0x7f0aa810c3d0 2024-04-23T15:10:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.620+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa81a7360 con 0x7f0aa810c3d0 2024-04-23T15:10:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.624+0000 7f0a9fe00640 1 -- 172.21.15.7:0/3528257824 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0aa0003970 con 0x7f0aa810c3d0 2024-04-23T15:10:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 Processor -- start 2024-04-23T15:10:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 -- start start 2024-04-23T15:10:49.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f2467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f251060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f253990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55908f1ac900 con 0x55908f2463c0 2024-04-23T15:10:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55908f152f20 con 0x55908f2515a0 2024-04-23T15:10:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.625+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55908f1a88c0 con 0x55908f246ce0 2024-04-23T15:10:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f2467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f2467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47810/0 (socket says 172.21.15.7:47810) 2024-04-23T15:10:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 -- 172.21.15.7:0/4261039533 learned_addr learned my addr 172.21.15.7:0/4261039533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f251060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 -- 172.21.15.7:0/4261039533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 msgr2=0x55908f251060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f251060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 -- 172.21.15.7:0/4261039533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 msgr2=0x55908f253990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f253990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9e000640 1 -- 172.21.15.7:0/4261039533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55908f177e10 con 0x55908f2463c0 2024-04-23T15:10:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.626+0000 7f0a9fe00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0a8c0a3d90 0x7f0a8c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.627+0000 7f0a9e000640 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f2467a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009d60 tx=0x7f0a900137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48432b334286e676 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.627+0000 7f0a9fe00640 1 -- 172.21.15.7:0/3528257824 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7f0aa00d0a00 con 0x7f0aa810c3d0 2024-04-23T15:10:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.627+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0a8c0a3d90 0x7f0a8c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.627+0000 7f0a97e00640 1 -- 172.21.15.7:0/4261039533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90009e50 con 0x55908f2463c0 2024-04-23T15:10:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.627+0000 7f0a97e00640 1 -- 172.21.15.7:0/4261039533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a90017030 con 0x55908f2463c0 2024-04-23T15:10:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.627+0000 7f0a97e00640 1 -- 172.21.15.7:0/4261039533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900116a0 con 0x55908f2463c0 2024-04-23T15:10:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 -- 172.21.15.7:0/4261039533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 msgr2=0x55908f2467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0a8c0a3d90 0x7f0a8c0a6250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a98000c00 tx=0x7f0a98005a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f2467a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009d60 tx=0x7f0a900137d0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 -- 172.21.15.7:0/4261039533 shutdown_connections 2024-04-23T15:10:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f253990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f251060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/4261039533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f2467a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 -- 172.21.15.7:0/4261039533 >> 172.21.15.7:0/4261039533 conn(0x55908f2428d0 msgr2=0x55908f242cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 -- 172.21.15.7:0/4261039533 shutdown_connections 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.628+0000 7f0ab07cd740 1 -- 172.21.15.7:0/4261039533 wait complete. 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.629+0000 7f0ab07cd740 1 -- start start 2024-04-23T15:10:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.629+0000 7f0ab07cd740 1 Processor -- start 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2463c0 0x55908f24e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 0x55908f24eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f24f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55908f2540e0 con 0x55908f246ce0 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55908f1662c0 con 0x55908f2515a0 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55908f254260 con 0x55908f2463c0 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0ab07cd740 10 client.0 _ll_register_callbacks cb 0x55908eebea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 0x55908f24eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 0x55908f24eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47820/0 (socket says 172.21.15.7:47820) 2024-04-23T15:10:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0a9e000640 1 -- 172.21.15.7:0/1092942697 learned_addr learned my addr 172.21.15.7:0/1092942697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2463c0 0x55908f24e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.630+0000 7f0aa7400640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f24f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a9e000640 1 -- 172.21.15.7:0/1092942697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2463c0 msgr2=0x55908f24e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a9e000640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2463c0 0x55908f24e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a9e000640 1 -- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 msgr2=0x55908f24f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a9e000640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f24f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a9e000640 1 -- 172.21.15.7:0/1092942697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908f176fd0 con 0x55908f246ce0 2024-04-23T15:10:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a9e000640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 0x55908f24eb70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000fdc0 tx=0x7f0a90005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a12a69af4c4085 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a94c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a94c00640 1 -- 172.21.15.7:0/1092942697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90009e50 con 0x55908f246ce0 2024-04-23T15:10:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0a94c00640 1 -- 172.21.15.7:0/1092942697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7f0a9000f440 con 0x55908f246ce0 2024-04-23T15:10:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.631+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a90017030 con 0x55908f246ce0 2024-04-23T15:10:49.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0a94c00640 1 -- 172.21.15.7:0/1092942697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0a9000f6c0 con 0x55908f246ce0 2024-04-23T15:10:49.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 10 client.17217 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:49.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55908eebf210 con 0x55908f246ce0 2024-04-23T15:10:49.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0a94c00640 1 -- 172.21.15.7:0/1092942697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a90017030 con 0x55908f246ce0 2024-04-23T15:10:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0a94c00640 1 -- 172.21.15.7:0/1092942697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0a90011440 con 0x55908f246ce0 2024-04-23T15:10:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 10 client.17217 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 10 client.17217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 20 client.17217 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f261670 0x55908f263a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 4 client.17217 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:10:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.632+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55908f1ba320 con 0x55908f261670 2024-04-23T15:10:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.633+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f261670 0x55908f263a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.634+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f261670 0x55908f263a60 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42cc06c8b673da92 server_cookie=cdfaaaa4cfcb2678 in_seq=0 out_seq=0 2024-04-23T15:10:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.634+0000 7f0a94c00640 10 client.17217 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0a94c00640 1 -- 172.21.15.7:0/1092942697 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55908f1ba320 con 0x55908f261670 2024-04-23T15:10:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0a94c00640 10 client.17217 handle_command_reply: tid=0 2024-04-23T15:10:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 client.17217 shutdown 2024-04-23T15:10:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 msgr2=0x55908f24eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 0x55908f24eb70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000fdc0 tx=0x7f0a90005600 comp rx=0 tx=0).stop 2024-04-23T15:10:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 shutdown_connections 2024-04-23T15:10:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f261670 0x55908f263a60 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f24f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f246ce0 0x55908f24eb70 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/1092942697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2463c0 0x55908f24e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0a94c00640 0 client.17217 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.637+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 >> 172.21.15.7:0/1092942697 conn(0x55908f2428d0 msgr2=0x55908f248600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.638+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 shutdown_connections 2024-04-23T15:10:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.638+0000 7f0ab07cd740 1 -- 172.21.15.7:0/1092942697 wait complete. 2024-04-23T15:10:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.638+0000 7f0ab07cd740 20 client.17217 trim_cache size 0 max 16384 2024-04-23T15:10:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 Processor -- start 2024-04-23T15:10:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 -- start start 2024-04-23T15:10:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f250cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f246ce0 0x55908f25d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2515a0 0x55908f24f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b1480 con 0x55908f2463c0 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b2fc0 con 0x55908f246ce0 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.657+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b1b50 con 0x55908f2515a0 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f250cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f250cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47822/0 (socket says 172.21.15.7:47822) 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 -- 172.21.15.7:0/2043949723 learned_addr learned my addr 172.21.15.7:0/2043949723 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa7400640 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2515a0 0x55908f24f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0a9e000640 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f246ce0 0x55908f25d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 -- 172.21.15.7:0/2043949723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2515a0 msgr2=0x55908f24f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2515a0 0x55908f24f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 -- 172.21.15.7:0/2043949723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f246ce0 msgr2=0x55908f25d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f246ce0 0x55908f25d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0aa6a00640 1 -- 172.21.15.7:0/2043949723 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55908f263dd0 con 0x55908f2463c0 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.658+0000 7f0a9e000640 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f246ce0 0x55908f25d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.659+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f250cf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0a98005ec0 tx=0x7f0a9803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa28f62ec5d50953 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.659+0000 7f0a97400640 1 -- 172.21.15.7:0/2043949723 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98056070 con 0x55908f2463c0 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.659+0000 7f0a97400640 1 -- 172.21.15.7:0/2043949723 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a98050e30 con 0x55908f2463c0 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.659+0000 7f0a97400640 1 -- 172.21.15.7:0/2043949723 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98035050 con 0x55908f2463c0 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 -- 172.21.15.7:0/2043949723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 msgr2=0x55908f250cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f250cf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0a98005ec0 tx=0x7f0a9803d000 comp rx=0 tx=0).stop 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 -- 172.21.15.7:0/2043949723 shutdown_connections 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f246ce0 0x55908f25d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f2515a0 0x55908f24f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/2043949723 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f250cf0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 -- 172.21.15.7:0/2043949723 >> 172.21.15.7:0/2043949723 conn(0x55908f2428d0 msgr2=0x55908f2505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 -- 172.21.15.7:0/2043949723 shutdown_connections 2024-04-23T15:10:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.660+0000 7f0ab07cd740 1 -- 172.21.15.7:0/2043949723 wait complete. 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 -- start start 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 Processor -- start 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f259590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f259ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f256560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b28f0 con 0x55908f2463c0 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b2220 con 0x55908f2515a0 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81af480 con 0x55908f246ce0 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.661+0000 7f0ab07cd740 10 client.0 _ll_register_callbacks cb 0x7f0a90009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f259590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f259590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47828/0 (socket says 172.21.15.7:47828) 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 -- 172.21.15.7:0/900631892 learned_addr learned my addr 172.21.15.7:0/900631892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:10:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0a9e000640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f259ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 -- 172.21.15.7:0/900631892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 msgr2=0x55908f259ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f259ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa7400640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f256560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 -- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 msgr2=0x55908f256560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f256560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.662+0000 7f0aa6a00640 1 -- 172.21.15.7:0/900631892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908ef8b620 con 0x55908f2463c0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0aa6a00640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f259590 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0a9802a9a0 tx=0x7f0a980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbaa6959932ea1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0a94c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0a94c00640 1 -- 172.21.15.7:0/900631892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9805f060 con 0x55908f2463c0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0a94c00640 1 -- 172.21.15.7:0/900631892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7f0a98004bb0 con 0x55908f2463c0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a98050e30 con 0x55908f2463c0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0a94c00640 1 -- 172.21.15.7:0/900631892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0a98056030 con 0x55908f2463c0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0ab07cd740 10 client.17223 fetch_fsmap learned FSMap version 32 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.663+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55908f2c8300 con 0x55908f2463c0 2024-04-23T15:10:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0a94c00640 1 -- 172.21.15.7:0/900631892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a98050e30 con 0x55908f2463c0 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0a94c00640 1 -- 172.21.15.7:0/900631892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0a98050220 con 0x55908f2463c0 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0ab07cd740 10 client.17223 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0ab07cd740 10 client.17223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0ab07cd740 20 client.17223 populate_metadata read hostname 'smithi007' 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f2c89c0 0x55908f2cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0ab07cd740 4 client.17223 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55908f1b4190 con 0x55908f2c89c0 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.664+0000 7f0a9e000640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f2c89c0 0x55908f2cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.665+0000 7f0a9e000640 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f2c89c0 0x55908f2cadb0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80cd97af700eb53f server_cookie=5f4e749db25bf808 in_seq=0 out_seq=0 2024-04-23T15:10:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.665+0000 7f0a94c00640 10 client.17223 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.702+0000 7f0a94c00640 1 -- 172.21.15.7:0/900631892 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55908f1b4190 con 0x55908f2c89c0 2024-04-23T15:10:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.702+0000 7f0a94c00640 10 client.17223 handle_command_reply: tid=0 2024-04-23T15:10:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.702+0000 7f0ab07cd740 1 client.17223 shutdown 2024-04-23T15:10:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 msgr2=0x55908f259590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f259590 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0a9802a9a0 tx=0x7f0a980046c0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 shutdown_connections 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55908f2c89c0 0x55908f2cadb0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55908f2515a0 0x55908f256560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55908f246ce0 0x55908f259ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 --2- 172.21.15.7:0/900631892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55908f2463c0 0x55908f259590 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0a94c00640 0 client.17223 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 >> 172.21.15.7:0/900631892 conn(0x55908f2428d0 msgr2=0x55908f25c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 shutdown_connections 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 1 -- 172.21.15.7:0/900631892 wait complete. 2024-04-23T15:10:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.703+0000 7f0ab07cd740 20 client.17223 trim_cache size 0 max 16384 2024-04-23T15:10:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:10:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:10:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:10:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.704+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0a8c0a3d90 msgr2=0x7f0a8c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.704+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0a8c0a3d90 0x7f0a8c0a6250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a98000c00 tx=0x7f0a98005a40 comp rx=0 tx=0).stop 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.704+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 msgr2=0x7f0aa81016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.704+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 0x7f0aa81016d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009fd0 tx=0x7f0aa000b260 comp rx=0 tx=0).stop 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 shutdown_connections 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0a8c0a3d90 0x7f0a8c0a6250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0aa810c3d0 0x7f0aa81016d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0aa8103920 0x7f0aa8101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 --2- 172.21.15.7:0/3528257824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa8103000 0x7f0aa8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:10:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 >> 172.21.15.7:0/3528257824 conn(0x7f0aa80fc820 msgr2=0x7f0aa80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:10:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 shutdown_connections 2024-04-23T15:10:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:10:49.705+0000 7f0aa7e00640 1 -- 172.21.15.7:0/3528257824 wait complete. 2024-04-23T15:10:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:50 smithi137 ceph-mon[31694]: pgmap v612: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:51.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:50 smithi007 ceph-mon[27906]: pgmap v612: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:51.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:50 smithi186 ceph-mon[31814]: pgmap v612: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:10:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:52 smithi137 ceph-mon[31694]: pgmap v613: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:52 smithi007 ceph-mon[27906]: pgmap v613: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:52 smithi186 ceph-mon[31814]: pgmap v613: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:10:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:54 smithi137 ceph-mon[31694]: pgmap v614: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:10:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:54 smithi007 ceph-mon[27906]: pgmap v614: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:10:55.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:54 smithi186 ceph-mon[31814]: pgmap v614: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:10:58.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:57 smithi137 ceph-mon[31694]: pgmap v615: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:10:58.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:57 smithi007 ceph-mon[27906]: pgmap v615: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:10:58.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:57 smithi186 ceph-mon[31814]: pgmap v615: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:11:00.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:10:59 smithi137 ceph-mon[31694]: pgmap v616: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:00.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:10:59 smithi007 ceph-mon[27906]: pgmap v616: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:00.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:10:59 smithi186 ceph-mon[31814]: pgmap v616: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:02.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:01 smithi186 ceph-mon[31814]: pgmap v617: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:02.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:01 smithi137 ceph-mon[31694]: pgmap v617: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:02.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:01 smithi007 ceph-mon[27906]: pgmap v617: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.861+0000 7fdb34e00640 1 -- 172.21.15.7:0/2980137209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104e00 msgr2=0x7fdb30108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.861+0000 7fdb34e00640 1 --2- 172.21.15.7:0/2980137209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104e00 0x7fdb30108e40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009900 tx=0x7fdb1c02a410 comp rx=0 tx=0).stop 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 -- 172.21.15.7:0/2980137209 shutdown_connections 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 --2- 172.21.15.7:0/2980137209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb30109520 0x7fdb301110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 --2- 172.21.15.7:0/2980137209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104e00 0x7fdb30108e40 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 --2- 172.21.15.7:0/2980137209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb30104450 0x7fdb30104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 -- 172.21.15.7:0/2980137209 >> 172.21.15.7:0/2980137209 conn(0x7fdb300ffcf0 msgr2=0x7fdb30102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 -- 172.21.15.7:0/2980137209 shutdown_connections 2024-04-23T15:11:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.862+0000 7fdb34e00640 1 -- 172.21.15.7:0/2980137209 wait complete. 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 Processor -- start 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 -- start start 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 0x7fdb301a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb30109520 0x7fdb301a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb3019a770 0x7fdb3019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301144b0 con 0x7fdb30104450 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30114330 con 0x7fdb3019a770 2024-04-23T15:11:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.863+0000 7fdb34e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30114630 con 0x7fdb30109520 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 0x7fdb301a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 0x7fdb301a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54212/0 (socket says 172.21.15.7:54212) 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 -- 172.21.15.7:0/3608188148 learned_addr learned my addr 172.21.15.7:0/3608188148 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2d400640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb30109520 0x7fdb301a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 -- 172.21.15.7:0/3608188148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb30109520 msgr2=0x7fdb301a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb30109520 0x7fdb301a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 -- 172.21.15.7:0/3608188148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb3019a770 msgr2=0x7fdb3019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb3019a770 0x7fdb3019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.864+0000 7fdb2de00640 1 -- 172.21.15.7:0/3608188148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3019b370 con 0x7fdb30104450 2024-04-23T15:11:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.865+0000 7fdb2de00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 0x7fdb301a06b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000d770 tx=0x7fdb2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.865+0000 7fdb26a00640 1 -- 172.21.15.7:0/3608188148 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20017070 con 0x7fdb30104450 2024-04-23T15:11:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.865+0000 7fdb26a00640 1 -- 172.21.15.7:0/3608188148 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb200054d0 con 0x7fdb30104450 2024-04-23T15:11:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.865+0000 7fdb26a00640 1 -- 172.21.15.7:0/3608188148 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20004cf0 con 0x7fdb30104450 2024-04-23T15:11:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.865+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb301a7450 con 0x7fdb30104450 2024-04-23T15:11:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.865+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb301a7800 con 0x7fdb30104450 2024-04-23T15:11:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 Processor -- start 2024-04-23T15:11:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 -- start start 2024-04-23T15:11:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb26a00640 1 -- 172.21.15.7:0/3608188148 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdb20004e90 con 0x7fdb30104450 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c6f4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6ff390 0x55721c701780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55721c65a900 con 0x55721c6f4ad0 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55721c600f20 con 0x55721c6ff390 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.869+0000 7fdb37c08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55721c6568c0 con 0x55721c6f41b0 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54222/0 (socket says 172.21.15.7:54222) 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 -- 172.21.15.7:0/3817326855 learned_addr learned my addr 172.21.15.7:0/3817326855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2e800640 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c6f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2d400640 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6ff390 0x55721c701780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 -- 172.21.15.7:0/3817326855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 msgr2=0x55721c6f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c6f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 -- 172.21.15.7:0/3817326855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6ff390 msgr2=0x55721c701780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.870+0000 7fdb2de00640 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6ff390 0x55721c701780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb2de00640 1 -- 172.21.15.7:0/3817326855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721c625e10 con 0x55721c6f4ad0 2024-04-23T15:11:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb2d400640 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6ff390 0x55721c701780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb2de00640 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fee50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fdb200cd940 tx=0x7fdb200d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a231043ff76e2b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb26a00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb140a3e40 0x7fdb140a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb26a00640 1 -- 172.21.15.7:0/3608188148 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7fdb200d06c0 con 0x7fdb30104450 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb1b400640 1 -- 172.21.15.7:0/3817326855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200df070 con 0x55721c6f4ad0 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb1b400640 1 -- 172.21.15.7:0/3817326855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb20009c30 con 0x55721c6f4ad0 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb1b400640 1 -- 172.21.15.7:0/3817326855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200984f0 con 0x55721c6f4ad0 2024-04-23T15:11:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.871+0000 7fdb2e800640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb140a3e40 0x7fdb140a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.872+0000 7fdb2e800640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb140a3e40 0x7fdb140a6300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb28005c40 tx=0x7fdb28009560 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.872+0000 7fdb37c08740 1 -- 172.21.15.7:0/3817326855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 msgr2=0x55721c6fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.872+0000 7fdb37c08740 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fee50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fdb200cd940 tx=0x7fdb200d8670 comp rx=0 tx=0).stop 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 -- 172.21.15.7:0/3817326855 shutdown_connections 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6ff390 0x55721c701780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fee50 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 --2- 172.21.15.7:0/3817326855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c6f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 -- 172.21.15.7:0/3817326855 >> 172.21.15.7:0/3817326855 conn(0x55721c6f06c0 msgr2=0x55721c6f0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 -- 172.21.15.7:0/3817326855 shutdown_connections 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 -- 172.21.15.7:0/3817326855 wait complete. 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 -- start start 2024-04-23T15:11:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.873+0000 7fdb37c08740 1 Processor -- start 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c6fc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6ff390 0x55721c6fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55721c701fc0 con 0x55721c6f4ad0 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55721c6142c0 con 0x55721c6f41b0 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55721c702140 con 0x55721c6ff390 2024-04-23T15:11:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb37c08740 10 client.0 _ll_register_callbacks cb 0x55721c36ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb2d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb2d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54228/0 (socket says 172.21.15.7:54228) 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb2d400640 1 -- 172.21.15.7:0/1899168702 learned_addr learned my addr 172.21.15.7:0/1899168702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.874+0000 7fdb2de00640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c6fc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2e800640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6ff390 0x55721c6fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2d400640 1 -- 172.21.15.7:0/1899168702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6ff390 msgr2=0x55721c6fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2d400640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6ff390 0x55721c6fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2d400640 1 -- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 msgr2=0x55721c6fc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2d400640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c6fc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2d400640 1 -- 172.21.15.7:0/1899168702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55721c624fd0 con 0x55721c6f4ad0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb2d400640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fc880 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009900 tx=0x7fdb1c0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55503b2e377b450d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.875+0000 7fdb0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb0fe00640 1 -- 172.21.15.7:0/1899168702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c035030 con 0x55721c6f4ad0 2024-04-23T15:11:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb0fe00640 1 -- 172.21.15.7:0/1899168702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7fdb1c0048c0 con 0x55721c6f4ad0 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55721c668320 con 0x55721c6f4ad0 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb0fe00640 1 -- 172.21.15.7:0/1899168702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdb1c005d50 con 0x55721c6f4ad0 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb37c08740 10 client.17235 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55721c36d210 con 0x55721c6f4ad0 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.876+0000 7fdb0fe00640 1 -- 172.21.15.7:0/1899168702 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55721c668320 con 0x55721c6f4ad0 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb0fe00640 1 -- 172.21.15.7:0/1899168702 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdb1c0314a0 con 0x55721c6f4ad0 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb37c08740 10 client.17235 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb37c08740 10 client.17235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb37c08740 20 client.17235 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c70f540 0x55721c711930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb37c08740 4 client.17235 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55721c662190 con 0x55721c70f540 2024-04-23T15:11:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.877+0000 7fdb2de00640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c70f540 0x55721c711930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.879+0000 7fdb2de00640 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c70f540 0x55721c711930 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22e60165c934c3f server_cookie=263ff5f5495a225a in_seq=0 out_seq=0 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.879+0000 7fdb0fe00640 10 client.17235 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.880+0000 7fdb0fe00640 1 -- 172.21.15.7:0/1899168702 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55721c662190 con 0x55721c70f540 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.880+0000 7fdb0fe00640 10 client.17235 handle_command_reply: tid=0 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.880+0000 7fdb37c08740 1 client.17235 shutdown 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 msgr2=0x55721c6fc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fc880 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009900 tx=0x7fdb1c0052d0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 shutdown_connections 2024-04-23T15:11:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c70f540 0x55721c711930 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6ff390 0x55721c6fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6f4ad0 0x55721c6fc880 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1899168702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c6fc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 >> 172.21.15.7:0/1899168702 conn(0x55721c6f06c0 msgr2=0x55721c6ef840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb0fe00640 0 client.17235 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 shutdown_connections 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 1 -- 172.21.15.7:0/1899168702 wait complete. 2024-04-23T15:11:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.881+0000 7fdb37c08740 20 client.17235 trim_cache size 0 max 16384 2024-04-23T15:11:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.900+0000 7fdb37c08740 1 Processor -- start 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 -- start start 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c70ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f4ad0 0x55721c717220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c717760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301b1480 con 0x55721c6ff390 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301b2fc0 con 0x55721c6f41b0 2024-04-23T15:11:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb37c08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301b1b50 con 0x55721c6f4ad0 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb2e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c717760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb2e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c717760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54234/0 (socket says 172.21.15.7:54234) 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.901+0000 7fdb2e800640 1 -- 172.21.15.7:0/1526038565 learned_addr learned my addr 172.21.15.7:0/1526038565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2de00640 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c70ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2d400640 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f4ad0 0x55721c717220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2e800640 1 -- 172.21.15.7:0/1526038565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f4ad0 msgr2=0x55721c717220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2e800640 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f4ad0 0x55721c717220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2e800640 1 -- 172.21.15.7:0/1526038565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 msgr2=0x55721c70ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2e800640 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c70ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2e800640 1 -- 172.21.15.7:0/1526038565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721c439620 con 0x55721c6ff390 2024-04-23T15:11:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.902+0000 7fdb2e800640 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c717760 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fdb280127a0 tx=0x7fdb28014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da2ad2ecfa57ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.903+0000 7fdb1aa00640 1 -- 172.21.15.7:0/1526038565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28012e60 con 0x55721c6ff390 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.903+0000 7fdb1aa00640 1 -- 172.21.15.7:0/1526038565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb2801fdf0 con 0x55721c6ff390 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.903+0000 7fdb1aa00640 1 -- 172.21.15.7:0/1526038565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb280283d0 con 0x55721c6ff390 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 -- 172.21.15.7:0/1526038565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 msgr2=0x55721c717760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c717760 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fdb280127a0 tx=0x7fdb28014000 comp rx=0 tx=0).stop 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 -- 172.21.15.7:0/1526038565 shutdown_connections 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c717760 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f4ad0 0x55721c717220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 --2- 172.21.15.7:0/1526038565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f41b0 0x55721c70ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 -- 172.21.15.7:0/1526038565 >> 172.21.15.7:0/1526038565 conn(0x55721c6f06c0 msgr2=0x55721c6f7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 -- 172.21.15.7:0/1526038565 shutdown_connections 2024-04-23T15:11:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 -- 172.21.15.7:0/1526038565 wait complete. 2024-04-23T15:11:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.904+0000 7fdb37c08740 1 -- start start 2024-04-23T15:11:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 Processor -- start 2024-04-23T15:11:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c707390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f4ad0 0x55721c7078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c6f8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301b28f0 con 0x55721c6ff390 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301b2220 con 0x55721c6f4ad0 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb301af480 con 0x55721c6f41b0 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.905+0000 7fdb37c08740 10 client.0 _ll_register_callbacks cb 0x7fdb1c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c6f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c6f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54242/0 (socket says 172.21.15.7:54242) 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 -- 172.21.15.7:0/2217959631 learned_addr learned my addr 172.21.15.7:0/2217959631 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2d400640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f4ad0 0x55721c7078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2de00640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c707390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 -- 172.21.15.7:0/2217959631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 msgr2=0x55721c707390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c707390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 -- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f4ad0 msgr2=0x55721c7078d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f4ad0 0x55721c7078d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.906+0000 7fdb2e800640 1 -- 172.21.15.7:0/2217959631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55721c6f8d80 con 0x55721c6ff390 2024-04-23T15:11:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb2e800640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c6f8690 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fdb28012770 tx=0x7fdb28020910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62bec3ea29a1436 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb0fe00640 1 -- 172.21.15.7:0/2217959631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28037030 con 0x55721c6ff390 2024-04-23T15:11:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb2801fdf0 con 0x55721c6ff390 2024-04-23T15:11:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb0fe00640 1 -- 172.21.15.7:0/2217959631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9467+0+0 (secure 0 0 0) 0x7fdb2802e050 con 0x55721c6ff390 2024-04-23T15:11:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb0fe00640 1 -- 172.21.15.7:0/2217959631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdb28041050 con 0x55721c6ff390 2024-04-23T15:11:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb37c08740 10 client.17241 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.907+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55721c775480 con 0x55721c6ff390 2024-04-23T15:11:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb0fe00640 1 -- 172.21.15.7:0/2217959631 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb2801fdf0 con 0x55721c6ff390 2024-04-23T15:11:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb0fe00640 1 -- 172.21.15.7:0/2217959631 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdb2800f040 con 0x55721c6ff390 2024-04-23T15:11:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb37c08740 10 client.17241 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb37c08740 10 client.17241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb37c08740 20 client.17241 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb37c08740 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c775b60 0x55721c777f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb37c08740 4 client.17241 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.908+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55721c5de4b0 con 0x55721c775b60 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.909+0000 7fdb2de00640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c775b60 0x55721c777f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.910+0000 7fdb0fe00640 10 client.17241 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.910+0000 7fdb2de00640 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c775b60 0x55721c777f80 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a90f7d7acbb2af83 server_cookie=1539a116a0176b6d in_seq=0 out_seq=0 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.975+0000 7fdb0fe00640 1 -- 172.21.15.7:0/2217959631 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55721c5de4b0 con 0x55721c775b60 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.975+0000 7fdb0fe00640 10 client.17241 handle_command_reply: tid=0 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.975+0000 7fdb37c08740 1 client.17241 shutdown 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 msgr2=0x55721c6f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c6f8690 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fdb28012770 tx=0x7fdb28020910 comp rx=0 tx=0).stop 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 shutdown_connections 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55721c775b60 0x55721c777f80 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55721c6f4ad0 0x55721c7078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55721c6ff390 0x55721c6f8690 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 --2- 172.21.15.7:0/2217959631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55721c6f41b0 0x55721c707390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb0fe00640 0 client.17241 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 >> 172.21.15.7:0/2217959631 conn(0x55721c6f06c0 msgr2=0x55721c6fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 shutdown_connections 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 1 -- 172.21.15.7:0/2217959631 wait complete. 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.976+0000 7fdb37c08740 20 client.17241 trim_cache size 0 max 16384 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:11:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb140a3e40 msgr2=0x7fdb140a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb140a3e40 0x7fdb140a6300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb28005c40 tx=0x7fdb28009560 comp rx=0 tx=0).stop 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 msgr2=0x7fdb301a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 0x7fdb301a06b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000d770 tx=0x7fdb2000dc30 comp rx=0 tx=0).stop 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 shutdown_connections 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb140a3e40 0x7fdb140a6300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb3019a770 0x7fdb3019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb30109520 0x7fdb301a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 --2- 172.21.15.7:0/3608188148 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb30104450 0x7fdb301a06b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 >> 172.21.15.7:0/3608188148 conn(0x7fdb300ffcf0 msgr2=0x7fdb301010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 shutdown_connections 2024-04-23T15:11:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:02.977+0000 7fdb34e00640 1 -- 172.21.15.7:0/3608188148 wait complete. 2024-04-23T15:11:04.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:03 smithi007 ceph-mon[27906]: pgmap v618: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 36 op/s 2024-04-23T15:11:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:03 smithi007 ceph-mon[27906]: osdmap e119: 12 total, 12 up, 12 in 2024-04-23T15:11:04.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:03 smithi186 ceph-mon[31814]: pgmap v618: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 36 op/s 2024-04-23T15:11:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:03 smithi186 ceph-mon[31814]: osdmap e119: 12 total, 12 up, 12 in 2024-04-23T15:11:04.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:03 smithi137 ceph-mon[31694]: pgmap v618: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 36 op/s 2024-04-23T15:11:04.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:03 smithi137 ceph-mon[31694]: osdmap e119: 12 total, 12 up, 12 in 2024-04-23T15:11:06.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:05 smithi007 ceph-mon[27906]: pgmap v620: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.6 MiB/s wr, 32 op/s 2024-04-23T15:11:06.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:05 smithi186 ceph-mon[31814]: pgmap v620: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.6 MiB/s wr, 32 op/s 2024-04-23T15:11:06.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:05 smithi137 ceph-mon[31694]: pgmap v620: 129 pgs: 129 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.6 MiB/s wr, 32 op/s 2024-04-23T15:11:08.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:07 smithi007 ceph-mon[27906]: pgmap v621: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:11:08.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:07 smithi186 ceph-mon[31814]: pgmap v621: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:11:08.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:07 smithi137 ceph-mon[31694]: pgmap v621: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:11:10.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:09 smithi007 ceph-mon[27906]: pgmap v622: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:11:10.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:11:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:09 smithi186 ceph-mon[31814]: pgmap v622: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:11:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:11:10.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:09 smithi137 ceph-mon[31694]: pgmap v622: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:11:10.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:11:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:11 smithi186 ceph-mon[31814]: osdmap e120: 12 total, 12 up, 12 in 2024-04-23T15:11:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:11 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:11:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:11 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:11:11.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:11 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:11:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:11 smithi137 ceph-mon[31694]: osdmap e120: 12 total, 12 up, 12 in 2024-04-23T15:11:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:11 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:11:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:11 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:11:11.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:11 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:11:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:11 smithi007 ceph-mon[27906]: osdmap e120: 12 total, 12 up, 12 in 2024-04-23T15:11:12.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:11 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:11:12.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:11 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:11:12.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:11 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:11:12.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:12 smithi186 ceph-mon[31814]: pgmap v624: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-04-23T15:11:12.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:12 smithi137 ceph-mon[31694]: pgmap v624: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-04-23T15:11:13.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:12 smithi007 ceph-mon[27906]: pgmap v624: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 12 op/s 2024-04-23T15:11:14.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:14 smithi007 ceph-mon[27906]: pgmap v625: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:14.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:14 smithi137 ceph-mon[31694]: pgmap v625: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:14 smithi186 ceph-mon[31814]: pgmap v625: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 -- 172.21.15.7:0/686430836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 msgr2=0x7f8aac10eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 --2- 172.21.15.7:0/686430836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac10eef0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009ca0 tx=0x7f8aa402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 -- 172.21.15.7:0/686430836 shutdown_connections 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 --2- 172.21.15.7:0/686430836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac10eef0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 --2- 172.21.15.7:0/686430836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8aac102c00 0x7f8aac106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 --2- 172.21.15.7:0/686430836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aac102250 0x7f8aac102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 -- 172.21.15.7:0/686430836 >> 172.21.15.7:0/686430836 conn(0x7f8aac079490 msgr2=0x7f8aac0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 -- 172.21.15.7:0/686430836 shutdown_connections 2024-04-23T15:11:16.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.132+0000 7f8ab3000640 1 -- 172.21.15.7:0/686430836 wait complete. 2024-04-23T15:11:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.133+0000 7f8ab3000640 1 Processor -- start 2024-04-23T15:11:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.133+0000 7f8ab3000640 1 -- start start 2024-04-23T15:11:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aac102250 0x7f8aac1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac1a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab3000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8aac19a750 0x7f8aac19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac112290 con 0x7f8aac107320 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac112110 con 0x7f8aac102250 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab3000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac112410 con 0x7f8aac19a750 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac1a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac1a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42854/0 (socket says 172.21.15.7:42854) 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 -- 172.21.15.7:0/906048054 learned_addr learned my addr 172.21.15.7:0/906048054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aabe00640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aac102250 0x7f8aac1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8ab1000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8aac19a750 0x7f8aac19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 -- 172.21.15.7:0/906048054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8aac19a750 msgr2=0x7f8aac19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8aac19a750 0x7f8aac19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 -- 172.21.15.7:0/906048054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aac102250 msgr2=0x7f8aac1a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.134+0000 7f8aa3400640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aac102250 0x7f8aac1a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8aa3400640 1 -- 172.21.15.7:0/906048054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac19b350 con 0x7f8aac107320 2024-04-23T15:11:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8aa3400640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac1a0bd0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400d740 tx=0x7f8a9400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8aa9600640 1 -- 172.21.15.7:0/906048054 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94017070 con 0x7f8aac107320 2024-04-23T15:11:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8aa9600640 1 -- 172.21.15.7:0/906048054 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a9400de50 con 0x7f8aac107320 2024-04-23T15:11:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8aa9600640 1 -- 172.21.15.7:0/906048054 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004d60 con 0x7f8aac107320 2024-04-23T15:11:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac1a7430 con 0x7f8aac107320 2024-04-23T15:11:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.135+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac1a7830 con 0x7f8aac107320 2024-04-23T15:11:16.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.139+0000 7f8aa9600640 1 -- 172.21.15.7:0/906048054 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8a94004f00 con 0x7f8aac107320 2024-04-23T15:11:16.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 Processor -- start 2024-04-23T15:11:16.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 -- start start 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x55754913c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x557549146e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x557549149780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5575490a2900 con 0x55754913c1b0 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557549048f20 con 0x557549147390 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.140+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55754909e8c0 con 0x55754913cad0 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x55754913c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x55754913c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42856/0 (socket says 172.21.15.7:42856) 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 -- 172.21.15.7:0/2624623075 learned_addr learned my addr 172.21.15.7:0/2624623075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x557549146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8aa3400640 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x557549149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 -- 172.21.15.7:0/2624623075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 msgr2=0x557549146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x557549146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 -- 172.21.15.7:0/2624623075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 msgr2=0x557549149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x557549149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8ab1000640 1 -- 172.21.15.7:0/2624623075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754906de10 con 0x55754913c1b0 2024-04-23T15:11:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.141+0000 7f8aa9600640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8a900a3e40 0x7f8a900a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.142+0000 7f8ab1000640 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x55754913c590 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4004ae0 tx=0x7f8aa4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca2c0b3cfa89187 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.142+0000 7f8aa9600640 1 -- 172.21.15.7:0/906048054 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f8a940d0550 con 0x7f8aac107320 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.142+0000 7f8aabe00640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8a900a3e40 0x7f8a900a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.142+0000 7f8aa1600640 1 -- 172.21.15.7:0/2624623075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4031d80 con 0x55754913c1b0 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.142+0000 7f8aa1600640 1 -- 172.21.15.7:0/2624623075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8aa4036040 con 0x55754913c1b0 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.142+0000 7f8aa1600640 1 -- 172.21.15.7:0/2624623075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40042a0 con 0x55754913c1b0 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2624623075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 msgr2=0x55754913c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8aabe00640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8a900a3e40 0x7f8a900a6300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55754913d750 tx=0x7f8a9c00d340 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x55754913c590 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4004ae0 tx=0x7f8aa4005ef0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2624623075 shutdown_connections 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x557549149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x557549146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2624623075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x55754913c590 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2624623075 >> 172.21.15.7:0/2624623075 conn(0x5575491386c0 msgr2=0x557549138aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:16.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2624623075 shutdown_connections 2024-04-23T15:11:16.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.143+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2624623075 wait complete. 2024-04-23T15:11:16.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.144+0000 7f8ab5e65740 1 -- start start 2024-04-23T15:11:16.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.144+0000 7f8ab5e65740 1 Processor -- start 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55754913c1b0 0x557549144350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557549147390 0x557549144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557549149f60 con 0x55754913cad0 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55754905c2c0 con 0x55754913c1b0 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55754914a0e0 con 0x557549147390 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8ab5e65740 10 client.0 _ll_register_callbacks cb 0x557548db4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42862/0 (socket says 172.21.15.7:42862) 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8aa3400640 1 -- 172.21.15.7:0/2059604092 learned_addr learned my addr 172.21.15.7:0/2059604092 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:16.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.145+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55754913c1b0 0x557549144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8ab1000640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557549147390 0x557549144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8aa3400640 1 -- 172.21.15.7:0/2059604092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557549147390 msgr2=0x557549144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8aa3400640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557549147390 0x557549144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8aa3400640 1 -- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55754913c1b0 msgr2=0x557549144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8aa3400640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55754913c1b0 0x557549144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8aa3400640 1 -- 172.21.15.7:0/2059604092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754906cfd0 con 0x55754913cad0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.146+0000 7f8aa3400640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549144890 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8a940cd8f0 tx=0x7f8a940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7561b5bef07ca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8a9a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8a9a000640 1 -- 172.21.15.7:0/2059604092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94020040 con 0x55754913cad0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8a9a000640 1 -- 172.21.15.7:0/2059604092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f8a940d0170 con 0x55754913cad0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aa4036040 con 0x55754913cad0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8a9a000640 1 -- 172.21.15.7:0/2059604092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8a9409c0e0 con 0x55754913cad0 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8ab5e65740 10 client.17253 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:16.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.147+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557548db5210 con 0x55754913cad0 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8a9a000640 1 -- 172.21.15.7:0/2059604092 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8aa4036040 con 0x55754913cad0 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8a9a000640 1 -- 172.21.15.7:0/2059604092 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8a940d3b70 con 0x55754913cad0 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8ab5e65740 10 client.17253 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8ab5e65740 10 client.17253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8ab5e65740 20 client.17253 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491574a0 0x557549159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8ab5e65740 4 client.17253 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.148+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575490b0320 con 0x5575491574a0 2024-04-23T15:11:16.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.149+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491574a0 0x557549159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.150+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491574a0 0x557549159890 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1e5a88891c603a server_cookie=8d8fae5971c28f1f in_seq=0 out_seq=0 2024-04-23T15:11:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.150+0000 7f8a9a000640 10 client.17253 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8a9a000640 1 -- 172.21.15.7:0/2059604092 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5575490b0320 con 0x5575491574a0 2024-04-23T15:11:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8a9a000640 10 client.17253 handle_command_reply: tid=0 2024-04-23T15:11:16.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 client.17253 shutdown 2024-04-23T15:11:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 msgr2=0x557549144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549144890 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8a940cd8f0 tx=0x7f8a940046c0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 shutdown_connections 2024-04-23T15:11:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491574a0 0x557549159890 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557549147390 0x557549144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549144890 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2059604092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55754913c1b0 0x557549144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 >> 172.21.15.7:0/2059604092 conn(0x5575491386c0 msgr2=0x55754913e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8a9a000640 0 client.17253 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 shutdown_connections 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.152+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2059604092 wait complete. 2024-04-23T15:11:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.153+0000 7f8ab5e65740 20 client.17253 trim_cache size 0 max 16384 2024-04-23T15:11:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.175+0000 7f8ab5e65740 1 Processor -- start 2024-04-23T15:11:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.175+0000 7f8ab5e65740 1 -- start start 2024-04-23T15:11:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x557549152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x55754913eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x55754915f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1b1570 con 0x55754913c1b0 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1b30b0 con 0x557549147390 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1b1c40 con 0x55754913cad0 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x557549152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x557549152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42866/0 (socket says 172.21.15.7:42866) 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8aabe00640 1 -- 172.21.15.7:0/2712385430 learned_addr learned my addr 172.21.15.7:0/2712385430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.176+0000 7f8aa3400640 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x55754913eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8ab1000640 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x55754915f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aabe00640 1 -- 172.21.15.7:0/2712385430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 msgr2=0x55754913eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x55754913eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aabe00640 1 -- 172.21.15.7:0/2712385430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 msgr2=0x55754915f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x55754915f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aabe00640 1 -- 172.21.15.7:0/2712385430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557548e81620 con 0x55754913c1b0 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aabe00640 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x557549152e20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x55754915a0f0 tx=0x7f8a9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec81a12cb32b780 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aa0c00640 1 -- 172.21.15.7:0/2712385430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c02d070 con 0x55754913c1b0 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.177+0000 7f8aa0c00640 1 -- 172.21.15.7:0/2712385430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a9c028d50 con 0x55754913c1b0 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8aa0c00640 1 -- 172.21.15.7:0/2712385430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003850 con 0x55754913c1b0 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2712385430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 msgr2=0x557549152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x557549152e20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x55754915a0f0 tx=0x7f8a9c017000 comp rx=0 tx=0).stop 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2712385430 shutdown_connections 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x55754915f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913cad0 0x55754913eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/2712385430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913c1b0 0x557549152e20 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.178+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2712385430 >> 172.21.15.7:0/2712385430 conn(0x5575491386c0 msgr2=0x557549144ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.179+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2712385430 shutdown_connections 2024-04-23T15:11:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.179+0000 7f8ab5e65740 1 -- 172.21.15.7:0/2712385430 wait complete. 2024-04-23T15:11:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.179+0000 7f8ab5e65740 1 -- start start 2024-04-23T15:11:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.179+0000 7f8ab5e65740 1 Processor -- start 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913c1b0 0x55754914f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549140da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x5575491412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1b29e0 con 0x55754913cad0 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1b2310 con 0x557549147390 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1af570 con 0x55754913c1b0 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8ab5e65740 10 client.0 _ll_register_callbacks cb 0x7f8a94009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8aa3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549140da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42878/0 (socket says 172.21.15.7:42878) 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8aa3400640 1 -- 172.21.15.7:0/3189974821 learned_addr learned my addr 172.21.15.7:0/3189974821 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.180+0000 7f8aabe00640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913c1b0 0x55754914f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8ab1000640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x5575491412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8aa3400640 1 -- 172.21.15.7:0/3189974821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913c1b0 msgr2=0x55754914f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8aa3400640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913c1b0 0x55754914f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8aa3400640 1 -- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 msgr2=0x5575491412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8aa3400640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x5575491412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8aa3400640 1 -- 172.21.15.7:0/3189974821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557549141b60 con 0x55754913cad0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8aa3400640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549140da0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009610 tx=0x7f8a940989d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67330e28f52c0e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8a9a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8a9a000640 1 -- 172.21.15.7:0/3189974821 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94014020 con 0x55754913cad0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8a9a000640 1 -- 172.21.15.7:0/3189974821 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f8a940b0b80 con 0x55754913cad0 2024-04-23T15:11:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a9c028d50 con 0x55754913cad0 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8a9a000640 1 -- 172.21.15.7:0/3189974821 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8a94082050 con 0x55754913cad0 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8ab5e65740 10 client.17259 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.181+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575491bda20 con 0x55754913cad0 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8a9a000640 1 -- 172.21.15.7:0/3189974821 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a9c028d50 con 0x55754913cad0 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8a9a000640 1 -- 172.21.15.7:0/3189974821 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8a94097e30 con 0x55754913cad0 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8ab5e65740 10 client.17259 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8ab5e65740 10 client.17259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8ab5e65740 20 client.17259 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491be040 0x5575491c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8ab5e65740 4 client.17259 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:11:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.182+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575490aa190 con 0x5575491be040 2024-04-23T15:11:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.183+0000 7f8aabe00640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491be040 0x5575491c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.184+0000 7f8a9a000640 10 client.17259 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.184+0000 7f8aabe00640 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491be040 0x5575491c0460 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944261e3534a19e2 server_cookie=77d356cc48837fc5 in_seq=0 out_seq=0 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8a9a000640 1 -- 172.21.15.7:0/3189974821 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575490aa190 con 0x5575491be040 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8a9a000640 10 client.17259 handle_command_reply: tid=0 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 client.17259 shutdown 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 msgr2=0x557549140da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549140da0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009610 tx=0x7f8a940989d0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 shutdown_connections 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5575491be040 0x5575491c0460 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557549147390 0x5575491412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55754913cad0 0x557549140da0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 --2- 172.21.15.7:0/3189974821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55754913c1b0 0x55754914f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8a9a000640 0 client.17259 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 >> 172.21.15.7:0/3189974821 conn(0x5575491386c0 msgr2=0x557549145b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.224+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 shutdown_connections 2024-04-23T15:11:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.225+0000 7f8ab5e65740 1 -- 172.21.15.7:0/3189974821 wait complete. 2024-04-23T15:11:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.225+0000 7f8ab5e65740 20 client.17259 trim_cache size 0 max 16384 2024-04-23T15:11:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:11:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:11:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:11:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8a900a3e40 msgr2=0x7f8a900a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8a900a3e40 0x7f8a900a6300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55754913d750 tx=0x7f8a9c00d340 comp rx=0 tx=0).stop 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 msgr2=0x7f8aac1a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac1a0bd0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400d740 tx=0x7f8a9400dc00 comp rx=0 tx=0).stop 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 shutdown_connections 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8a900a3e40 0x7f8a900a6300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8aac19a750 0x7f8aac19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac107320 0x7f8aac1a0bd0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 --2- 172.21.15.7:0/906048054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aac102250 0x7f8aac1a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 >> 172.21.15.7:0/906048054 conn(0x7f8aac079490 msgr2=0x7f8aac10d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 shutdown_connections 2024-04-23T15:11:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:16.226+0000 7f8ab3000640 1 -- 172.21.15.7:0/906048054 wait complete. 2024-04-23T15:11:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:16 smithi137 ceph-mon[31694]: pgmap v626: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:17.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:16 smithi007 ceph-mon[27906]: pgmap v626: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:16 smithi186 ceph-mon[31814]: pgmap v626: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:18.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:18 smithi137 ceph-mon[31694]: pgmap v627: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:11:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:18 smithi007 ceph-mon[27906]: pgmap v627: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:11:19.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:18 smithi186 ceph-mon[31814]: pgmap v627: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:11:20.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:20 smithi137 ceph-mon[31694]: pgmap v628: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:11:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:20 smithi007 ceph-mon[27906]: pgmap v628: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:11:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:20 smithi186 ceph-mon[31814]: pgmap v628: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:11:22.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:22 smithi137 ceph-mon[31694]: pgmap v629: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:23.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:22 smithi007 ceph-mon[27906]: pgmap v629: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:22 smithi186 ceph-mon[31814]: pgmap v629: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:11:24.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:24 smithi137 ceph-mon[31694]: pgmap v630: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:11:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:24 smithi007 ceph-mon[27906]: pgmap v630: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:11:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:24 smithi186 ceph-mon[31814]: pgmap v630: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:11:26.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:26 smithi137 ceph-mon[31694]: pgmap v631: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:11:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:26 smithi007 ceph-mon[27906]: pgmap v631: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:11:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:26 smithi186 ceph-mon[31814]: pgmap v631: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:11:28.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:28 smithi137 ceph-mon[31694]: pgmap v632: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:11:29.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:28 smithi007 ceph-mon[27906]: pgmap v632: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:11:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:28 smithi186 ceph-mon[31814]: pgmap v632: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:11:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 -- 172.21.15.7:0/940184092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 msgr2=0x7f16f4102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 --2- 172.21.15.7:0/940184092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f4102450 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009900 tx=0x7f16e802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 -- 172.21.15.7:0/940184092 shutdown_connections 2024-04-23T15:11:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 --2- 172.21.15.7:0/940184092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f4102a20 0x7f16f4106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 --2- 172.21.15.7:0/940184092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4107140 0x7f16f410ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 --2- 172.21.15.7:0/940184092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f4102450 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 -- 172.21.15.7:0/940184092 >> 172.21.15.7:0/940184092 conn(0x7f16f40fd950 msgr2=0x7f16f40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 -- 172.21.15.7:0/940184092 shutdown_connections 2024-04-23T15:11:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.385+0000 7f16fa600640 1 -- 172.21.15.7:0/940184092 wait complete. 2024-04-23T15:11:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.386+0000 7f16fa600640 1 Processor -- start 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 -- start start 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f41a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4107140 0x7f16f41a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f419a6f0 0x7f16f419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41120b0 con 0x7f16f4102070 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4111f30 con 0x7f16f419a6f0 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16fa600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4112230 con 0x7f16f4107140 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16f9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f41a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16f9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f41a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56526/0 (socket says 172.21.15.7:56526) 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.387+0000 7f16f9200640 1 -- 172.21.15.7:0/4252614953 learned_addr learned my addr 172.21.15.7:0/4252614953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f3e00640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4107140 0x7f16f41a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9c00640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f419a6f0 0x7f16f419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9200640 1 -- 172.21.15.7:0/4252614953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4107140 msgr2=0x7f16f41a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9200640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4107140 0x7f16f41a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9200640 1 -- 172.21.15.7:0/4252614953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f419a6f0 msgr2=0x7f16f419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9200640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f419a6f0 0x7f16f419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9200640 1 -- 172.21.15.7:0/4252614953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f419b2f0 con 0x7f16f4102070 2024-04-23T15:11:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.388+0000 7f16f9200640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f41a0630 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005940 tx=0x7f16e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.389+0000 7f16f1600640 1 -- 172.21.15.7:0/4252614953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e803f030 con 0x7f16f4102070 2024-04-23T15:11:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.389+0000 7f16f1600640 1 -- 172.21.15.7:0/4252614953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e8003aa0 con 0x7f16f4102070 2024-04-23T15:11:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.389+0000 7f16f1600640 1 -- 172.21.15.7:0/4252614953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8035070 con 0x7f16f4102070 2024-04-23T15:11:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.389+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f419b580 con 0x7f16f4102070 2024-04-23T15:11:29.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.389+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41a7710 con 0x7f16f4102070 2024-04-23T15:11:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.393+0000 7f16f1600640 1 -- 172.21.15.7:0/4252614953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f16e8042030 con 0x7f16f4102070 2024-04-23T15:11:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.393+0000 7f16fe5fd740 1 Processor -- start 2024-04-23T15:11:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.393+0000 7f16fe5fd740 1 -- start start 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b0766347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076641990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b07659a900 con 0x55b0766343c0 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b076540f20 con 0x55b07663f5a0 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b0765968c0 con 0x55b076634ce0 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16f9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b0766347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16f9c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b0766347a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56534/0 (socket says 172.21.15.7:56534) 2024-04-23T15:11:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16f9c00640 1 -- 172.21.15.7:0/3174129012 learned_addr learned my addr 172.21.15.7:0/3174129012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.394+0000 7f16f3e00640 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076641990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9200640 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f1600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3d90 0x7f16dc0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f1600640 1 -- 172.21.15.7:0/4252614953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f16e80f13a0 con 0x7f16f4102070 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9c00640 1 -- 172.21.15.7:0/3174129012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 msgr2=0x55b07663f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9c00640 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9c00640 1 -- 172.21.15.7:0/3174129012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 msgr2=0x55b076641990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9c00640 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076641990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9c00640 1 -- 172.21.15.7:0/3174129012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b076565e10 con 0x55b0766343c0 2024-04-23T15:11:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.395+0000 7f16f9c00640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3d90 0x7f16dc0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.396+0000 7f16f9c00640 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b0766347a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009fc0 tx=0x7f16ec010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e013b4c55b36c7ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.396+0000 7f16e6000640 1 -- 172.21.15.7:0/3174129012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec013e30 con 0x55b0766343c0 2024-04-23T15:11:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.396+0000 7f16e6000640 1 -- 172.21.15.7:0/3174129012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16ec01cdb0 con 0x55b0766343c0 2024-04-23T15:11:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.396+0000 7f16e6000640 1 -- 172.21.15.7:0/3174129012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec011ba0 con 0x55b0766343c0 2024-04-23T15:11:29.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.396+0000 7f16f9c00640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3d90 0x7f16dc0a6250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16ec020000 tx=0x7f16ec01d000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 -- 172.21.15.7:0/3174129012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 msgr2=0x55b0766347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b0766347a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009fc0 tx=0x7f16ec010740 comp rx=0 tx=0).stop 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 -- 172.21.15.7:0/3174129012 shutdown_connections 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076641990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/3174129012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b0766347a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 -- 172.21.15.7:0/3174129012 >> 172.21.15.7:0/3174129012 conn(0x55b0766308d0 msgr2=0x55b076630cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 -- 172.21.15.7:0/3174129012 shutdown_connections 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.397+0000 7f16fe5fd740 1 -- 172.21.15.7:0/3174129012 wait complete. 2024-04-23T15:11:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.398+0000 7f16fe5fd740 1 -- start start 2024-04-23T15:11:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.398+0000 7f16fe5fd740 1 Processor -- start 2024-04-23T15:11:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0766343c0 0x55b07663c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b07663cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b07663d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b0766420e0 con 0x55b076634ce0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b0765542c0 con 0x55b07663f5a0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b076642260 con 0x55b0766343c0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16fe5fd740 10 client.0 _ll_register_callbacks cb 0x55b0762aca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b07663cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b07663cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56546/0 (socket says 172.21.15.7:56546) 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16f3e00640 1 -- 172.21.15.7:0/622022613 learned_addr learned my addr 172.21.15.7:0/622022613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.399+0000 7f16f9c00640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b07663d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f9200640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0766343c0 0x55b07663c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f3e00640 1 -- 172.21.15.7:0/622022613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0766343c0 msgr2=0x55b07663c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f3e00640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0766343c0 0x55b07663c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f3e00640 1 -- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 msgr2=0x55b07663d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f3e00640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b07663d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f3e00640 1 -- 172.21.15.7:0/622022613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b076564fd0 con 0x55b076634ce0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16f3e00640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b07663cad0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f16e000be40 tx=0x7f16e0012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa1668cea2487f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16daa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.400+0000 7f16daa00640 1 -- 172.21.15.7:0/622022613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00035f0 con 0x55b076634ce0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16daa00640 1 -- 172.21.15.7:0/622022613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f16e0003790 con 0x55b076634ce0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ec01cdb0 con 0x55b076634ce0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16daa00640 1 -- 172.21.15.7:0/622022613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f16e0003990 con 0x55b076634ce0 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16fe5fd740 10 client.17271 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:29.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0762ad210 con 0x55b076634ce0 2024-04-23T15:11:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16daa00640 1 -- 172.21.15.7:0/622022613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16ec01cdb0 con 0x55b076634ce0 2024-04-23T15:11:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.401+0000 7f16daa00640 1 -- 172.21.15.7:0/622022613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f16e0019070 con 0x55b076634ce0 2024-04-23T15:11:29.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16fe5fd740 10 client.17271 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16fe5fd740 10 client.17271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16fe5fd740 20 client.17271 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b07664f7b0 0x55b076651bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16fe5fd740 4 client.17271 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0765a8320 con 0x55b07664f7b0 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.402+0000 7f16f9200640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b07664f7b0 0x55b076651bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.403+0000 7f16daa00640 10 client.17271 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:29.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.403+0000 7f16f9200640 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b07664f7b0 0x55b076651bc0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc81ad635939de68 server_cookie=18fb1c87382ff0f2 in_seq=0 out_seq=0 2024-04-23T15:11:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.405+0000 7f16daa00640 1 -- 172.21.15.7:0/622022613 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0765a8320 con 0x55b07664f7b0 2024-04-23T15:11:29.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.405+0000 7f16daa00640 10 client.17271 handle_command_reply: tid=0 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.405+0000 7f16fe5fd740 1 client.17271 shutdown 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 msgr2=0x55b07663cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b07663cad0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f16e000be40 tx=0x7f16e0012820 comp rx=0 tx=0).stop 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 shutdown_connections 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b07664f7b0 0x55b076651bc0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b07663d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b07663cad0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16daa00640 0 client.17271 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/622022613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0766343c0 0x55b07663c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 >> 172.21.15.7:0/622022613 conn(0x55b0766308d0 msgr2=0x55b076636600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 shutdown_connections 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 1 -- 172.21.15.7:0/622022613 wait complete. 2024-04-23T15:11:29.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.406+0000 7f16fe5fd740 20 client.17271 trim_cache size 0 max 16384 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 Processor -- start 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 -- start start 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b07663ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076636d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b1430 con 0x55b0766343c0 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b2f70 con 0x55b07663f5a0 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b1b00 con 0x55b076634ce0 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16f9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b07663ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.423+0000 7f16f9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b07663ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56550/0 (socket says 172.21.15.7:56550) 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 -- 172.21.15.7:0/708641598 learned_addr learned my addr 172.21.15.7:0/708641598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9c00640 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076636d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f3e00640 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 -- 172.21.15.7:0/708641598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 msgr2=0x55b07663cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 -- 172.21.15.7:0/708641598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 msgr2=0x55b076636d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076636d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 -- 172.21.15.7:0/708641598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b076641d00 con 0x55b0766343c0 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9c00640 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076636d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.424+0000 7f16f9200640 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b07663ecc0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ee740 tx=0x7f16e802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81ab36341863d3d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.425+0000 7f16e5600640 1 -- 172.21.15.7:0/708641598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8049040 con 0x55b0766343c0 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.425+0000 7f16e5600640 1 -- 172.21.15.7:0/708641598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e80bd630 con 0x55b0766343c0 2024-04-23T15:11:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.425+0000 7f16e5600640 1 -- 172.21.15.7:0/708641598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8003c50 con 0x55b0766343c0 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.425+0000 7f16fe5fd740 1 -- 172.21.15.7:0/708641598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 msgr2=0x55b07663ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.425+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b07663ecc0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ee740 tx=0x7f16e802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 -- 172.21.15.7:0/708641598 shutdown_connections 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b07663f5a0 0x55b076636d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b076634ce0 0x55b07663cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/708641598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0766343c0 0x55b07663ecc0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 -- 172.21.15.7:0/708641598 >> 172.21.15.7:0/708641598 conn(0x55b0766308d0 msgr2=0x55b07664a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:29.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 -- 172.21.15.7:0/708641598 shutdown_connections 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 -- 172.21.15.7:0/708641598 wait complete. 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 -- start start 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.426+0000 7f16fe5fd740 1 Processor -- start 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0766343c0 0x55b0766475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b076647b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b07663f5a0 0x55b076644590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b28a0 con 0x55b076634ce0 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b21d0 con 0x55b0766343c0 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41af430 con 0x55b07663f5a0 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16fe5fd740 10 client.0 _ll_register_callbacks cb 0x7f16e000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b076647b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b076647b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56564/0 (socket says 172.21.15.7:56564) 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.427+0000 7f16f3e00640 1 -- 172.21.15.7:0/332267327 learned_addr learned my addr 172.21.15.7:0/332267327 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f9200640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0766343c0 0x55b0766475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f9c00640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b07663f5a0 0x55b076644590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f3e00640 1 -- 172.21.15.7:0/332267327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b07663f5a0 msgr2=0x55b076644590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f3e00640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b07663f5a0 0x55b076644590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f3e00640 1 -- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0766343c0 msgr2=0x55b0766475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f3e00640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0766343c0 0x55b0766475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f3e00640 1 -- 172.21.15.7:0/332267327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b076379620 con 0x55b076634ce0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f9200640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0766343c0 0x55b0766475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16f3e00640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b076647b00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f16e0010d40 tx=0x7f16e00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28320ced3b15b009 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.428+0000 7f16daa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16daa00640 1 -- 172.21.15.7:0/332267327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00037e0 con 0x55b076634ce0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16daa00640 1 -- 172.21.15.7:0/332267327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f16e0005040 con 0x55b076634ce0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16e80bd630 con 0x55b076634ce0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16daa00640 1 -- 172.21.15.7:0/332267327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f16e003b050 con 0x55b076634ce0 2024-04-23T15:11:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16fe5fd740 10 client.17277 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0766b6500 con 0x55b076634ce0 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.429+0000 7f16daa00640 1 -- 172.21.15.7:0/332267327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e80bd630 con 0x55b076634ce0 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16daa00640 1 -- 172.21.15.7:0/332267327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f16e0019070 con 0x55b076634ce0 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16fe5fd740 10 client.17277 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16fe5fd740 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16fe5fd740 20 client.17277 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0766b6c50 0x55b0766b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16fe5fd740 4 client.17277 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0765a2190 con 0x55b0766b6c50 2024-04-23T15:11:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.430+0000 7f16f9200640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0766b6c50 0x55b0766b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.431+0000 7f16f9200640 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0766b6c50 0x55b0766b9070 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd18609ec282bb1 server_cookie=1c1ebd6bdbd163b7 in_seq=0 out_seq=0 2024-04-23T15:11:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.431+0000 7f16daa00640 10 client.17277 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.465+0000 7f16daa00640 1 -- 172.21.15.7:0/332267327 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0765a2190 con 0x55b0766b6c50 2024-04-23T15:11:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.465+0000 7f16daa00640 10 client.17277 handle_command_reply: tid=0 2024-04-23T15:11:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.465+0000 7f16fe5fd740 1 client.17277 shutdown 2024-04-23T15:11:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.465+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 msgr2=0x55b076647b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.465+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b076647b00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f16e0010d40 tx=0x7f16e00035f0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 shutdown_connections 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b0766b6c50 0x55b0766b9070 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b07663f5a0 0x55b076644590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b076634ce0 0x55b076647b00 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 --2- 172.21.15.7:0/332267327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b0766343c0 0x55b0766475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 >> 172.21.15.7:0/332267327 conn(0x55b0766308d0 msgr2=0x55b07664a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16daa00640 0 client.17277 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 shutdown_connections 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 1 -- 172.21.15.7:0/332267327 wait complete. 2024-04-23T15:11:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.466+0000 7f16fe5fd740 20 client.17277 trim_cache size 0 max 16384 2024-04-23T15:11:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:11:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:11:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:11:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3d90 msgr2=0x7f16dc0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3d90 0x7f16dc0a6250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16ec020000 tx=0x7f16ec01d000 comp rx=0 tx=0).stop 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 msgr2=0x7f16f41a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f41a0630 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005940 tx=0x7f16e8004270 comp rx=0 tx=0).stop 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 shutdown_connections 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f16dc0a3d90 0x7f16dc0a6250 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f419a6f0 0x7f16f419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4107140 0x7f16f41a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 --2- 172.21.15.7:0/4252614953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16f4102070 0x7f16f41a0630 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.467+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 >> 172.21.15.7:0/4252614953 conn(0x7f16f40fd950 msgr2=0x7f16f40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.468+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 shutdown_connections 2024-04-23T15:11:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:29.468+0000 7f16fa600640 1 -- 172.21.15.7:0/4252614953 wait complete. 2024-04-23T15:11:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:30 smithi007 ceph-mon[27906]: pgmap v633: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:11:31.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:30 smithi186 ceph-mon[31814]: pgmap v633: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:11:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:30 smithi137 ceph-mon[31694]: pgmap v633: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:11:33.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:32 smithi007 ceph-mon[27906]: pgmap v634: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:11:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:32 smithi186 ceph-mon[31814]: pgmap v634: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:11:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:32 smithi137 ceph-mon[31694]: pgmap v634: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:11:35.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:34 smithi007 ceph-mon[27906]: pgmap v635: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T15:11:35.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:34 smithi186 ceph-mon[31814]: pgmap v635: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T15:11:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:34 smithi137 ceph-mon[31694]: pgmap v635: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T15:11:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:36 smithi007 ceph-mon[27906]: pgmap v636: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:11:37.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:36 smithi186 ceph-mon[31814]: pgmap v636: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:11:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:36 smithi137 ceph-mon[31694]: pgmap v636: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:11:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:38 smithi007 ceph-mon[27906]: pgmap v637: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:11:39.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:38 smithi186 ceph-mon[31814]: pgmap v637: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:11:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:38 smithi137 ceph-mon[31694]: pgmap v637: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:11:41.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:40 smithi007 ceph-mon[27906]: pgmap v638: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:41.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:40 smithi186 ceph-mon[31814]: pgmap v638: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:40 smithi137 ceph-mon[31694]: pgmap v638: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 -- 172.21.15.7:0/3090751983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2880743a0 msgr2=0x7fa288074780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 --2- 172.21.15.7:0/3090751983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2880743a0 0x7fa288074780 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa278009900 tx=0x7fa27802a480 comp rx=0 tx=0).stop 2024-04-23T15:11:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 -- 172.21.15.7:0/3090751983 shutdown_connections 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 --2- 172.21.15.7:0/3090751983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa288112e10 0x7fa288115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 --2- 172.21.15.7:0/3090751983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa288074cc0 0x7fa2881128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 --2- 172.21.15.7:0/3090751983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2880743a0 0x7fa288074780 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.629+0000 7fa28cc00640 1 -- 172.21.15.7:0/3090751983 >> 172.21.15.7:0/3090751983 conn(0x7fa2880fd950 msgr2=0x7fa2880ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.630+0000 7fa28cc00640 1 -- 172.21.15.7:0/3090751983 shutdown_connections 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.630+0000 7fa28cc00640 1 -- 172.21.15.7:0/3090751983 wait complete. 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 Processor -- start 2024-04-23T15:11:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 -- start start 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa288074cc0 0x7fa28819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa288112e10 0x7fa28819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 0x7fa2881a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa288118700 con 0x7fa2881a3730 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa288118580 con 0x7fa288112e10 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.631+0000 7fa28cc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa288118880 con 0x7fa288074cc0 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 0x7fa2881a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 0x7fa2881a3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52160/0 (socket says 172.21.15.7:52160) 2024-04-23T15:11:42.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 -- 172.21.15.7:0/1300458182 learned_addr learned my addr 172.21.15.7:0/1300458182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa286a00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa288112e10 0x7fa28819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287400640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa288074cc0 0x7fa28819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 -- 172.21.15.7:0/1300458182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa288074cc0 msgr2=0x7fa28819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa288074cc0 0x7fa28819ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 -- 172.21.15.7:0/1300458182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa288112e10 msgr2=0x7fa28819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa288112e10 0x7fa28819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.632+0000 7fa287e00640 1 -- 172.21.15.7:0/1300458182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2881a4220 con 0x7fa2881a3730 2024-04-23T15:11:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.633+0000 7fa287e00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 0x7fa2881a3be0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa28000e9d0 tx=0x7fa28000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.633+0000 7fa27fe00640 1 -- 172.21.15.7:0/1300458182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28000cd80 con 0x7fa2881a3730 2024-04-23T15:11:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.633+0000 7fa27fe00640 1 -- 172.21.15.7:0/1300458182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa280005020 con 0x7fa2881a3730 2024-04-23T15:11:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.633+0000 7fa27fe00640 1 -- 172.21.15.7:0/1300458182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800116d0 con 0x7fa2881a3730 2024-04-23T15:11:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.633+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2881a4510 con 0x7fa2881a3730 2024-04-23T15:11:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.633+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2881abcb0 con 0x7fa2881a3730 2024-04-23T15:11:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.637+0000 7fa291077740 1 Processor -- start 2024-04-23T15:11:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.637+0000 7fa27fe00640 1 -- 172.21.15.7:0/1300458182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa2800051d0 con 0x7fa2881a3730 2024-04-23T15:11:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.637+0000 7fa291077740 1 -- start start 2024-04-23T15:11:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa291077740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x56536009d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa291077740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600a8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa291077740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x5653600aa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa291077740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x565360003900 con 0x56536009d3c0 2024-04-23T15:11:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa291077740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56535ffa9f20 con 0x5653600a85a0 2024-04-23T15:11:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa291077740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56535ffff8c0 con 0x56536009dce0 2024-04-23T15:11:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa286a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x56536009d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa286a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x56536009d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52164/0 (socket says 172.21.15.7:52164) 2024-04-23T15:11:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.638+0000 7fa286a00640 1 -- 172.21.15.7:0/1663616078 learned_addr learned my addr 172.21.15.7:0/1663616078 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa287400640 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa286a00640 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x5653600aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa286a00640 1 -- 172.21.15.7:0/1663616078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 msgr2=0x5653600a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa286a00640 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600a8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa286a00640 1 -- 172.21.15.7:0/1663616078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 msgr2=0x5653600aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa286a00640 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x5653600aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa286a00640 1 -- 172.21.15.7:0/1663616078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56535ffcee10 con 0x56536009d3c0 2024-04-23T15:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa27fe00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa26c0a3d90 0x7fa26c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.639+0000 7fa27fe00640 1 -- 172.21.15.7:0/1300458182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7fa2800d0de0 con 0x7fa2881a3730 2024-04-23T15:11:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.640+0000 7fa287400640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa26c0a3d90 0x7fa26c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.640+0000 7fa286a00640 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x56536009d7a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa274013580 tx=0x7fa27400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7276096afcf23795 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.640+0000 7fa273e00640 1 -- 172.21.15.7:0/1663616078 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274019030 con 0x56536009d3c0 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.640+0000 7fa273e00640 1 -- 172.21.15.7:0/1663616078 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2740118f0 con 0x56536009d3c0 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.640+0000 7fa273e00640 1 -- 172.21.15.7:0/1663616078 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27401d740 con 0x56536009d3c0 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 -- 172.21.15.7:0/1663616078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 msgr2=0x56536009d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa287400640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa26c0a3d90 0x7fa26c0a6250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x56536009e960 tx=0x7fa278031400 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x56536009d7a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa274013580 tx=0x7fa27400b690 comp rx=0 tx=0).stop 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 -- 172.21.15.7:0/1663616078 shutdown_connections 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x5653600aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 --2- 172.21.15.7:0/1663616078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x56536009d7a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.641+0000 7fa291077740 1 -- 172.21.15.7:0/1663616078 >> 172.21.15.7:0/1663616078 conn(0x5653600998d0 msgr2=0x565360099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.642+0000 7fa291077740 1 -- 172.21.15.7:0/1663616078 shutdown_connections 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.642+0000 7fa291077740 1 -- 172.21.15.7:0/1663616078 wait complete. 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.642+0000 7fa291077740 1 -- start start 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.642+0000 7fa291077740 1 Processor -- start 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009dce0 0x5653600a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5653600ab0e0 con 0x56536009d3c0 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56535ffbd2c0 con 0x56536009dce0 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5653600ab260 con 0x5653600a85a0 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa291077740 10 client.0 _ll_register_callbacks cb 0x56535fd15a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa287400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa287400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52178/0 (socket says 172.21.15.7:52178) 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa287400640 1 -- 172.21.15.7:0/2394051038 learned_addr learned my addr 172.21.15.7:0/2394051038 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa286a00640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009dce0 0x5653600a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.643+0000 7fa287e00640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa287400640 1 -- 172.21.15.7:0/2394051038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 msgr2=0x5653600a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa287400640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa287400640 1 -- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009dce0 msgr2=0x5653600a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa287400640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009dce0 0x5653600a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa287400640 1 -- 172.21.15.7:0/2394051038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56535ffcdfd0 con 0x56536009d3c0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa287400640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a55a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa278000c00 tx=0x7fa27802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffa08e130d56beb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa270c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.644+0000 7fa270c00640 1 -- 172.21.15.7:0/2394051038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27804c020 con 0x56536009d3c0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.645+0000 7fa270c00640 1 -- 172.21.15.7:0/2394051038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7fa278004ad0 con 0x56536009d3c0 2024-04-23T15:11:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.645+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2740118f0 con 0x56536009d3c0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.645+0000 7fa270c00640 1 -- 172.21.15.7:0/2394051038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa278057050 con 0x56536009d3c0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.645+0000 7fa291077740 10 client.17289 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.645+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56535fd16210 con 0x56536009d3c0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.645+0000 7fa270c00640 1 -- 172.21.15.7:0/2394051038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2740118f0 con 0x56536009d3c0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa270c00640 1 -- 172.21.15.7:0/2394051038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa2780324b0 con 0x56536009d3c0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa291077740 10 client.17289 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa291077740 10 client.17289 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa291077740 20 client.17289 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa291077740 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5653600b8740 0x5653600bab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa291077740 4 client.17289 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565360011320 con 0x5653600b8740 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.646+0000 7fa286a00640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5653600b8740 0x5653600bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.647+0000 7fa286a00640 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5653600b8740 0x5653600bab50 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3826d6351ad7c737 server_cookie=6b225ef28e873fbc in_seq=0 out_seq=0 2024-04-23T15:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.647+0000 7fa270c00640 10 client.17289 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.649+0000 7fa270c00640 1 -- 172.21.15.7:0/2394051038 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x565360011320 con 0x5653600b8740 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.649+0000 7fa270c00640 10 client.17289 handle_command_reply: tid=0 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.649+0000 7fa291077740 1 client.17289 shutdown 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.649+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 msgr2=0x5653600a55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a55a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa278000c00 tx=0x7fa27802a480 comp rx=0 tx=0).stop 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 shutdown_connections 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5653600b8740 0x5653600bab50 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009dce0 0x5653600a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 --2- 172.21.15.7:0/2394051038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a55a0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 >> 172.21.15.7:0/2394051038 conn(0x5653600998d0 msgr2=0x56536009f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa270c00640 0 client.17289 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 shutdown_connections 2024-04-23T15:11:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 1 -- 172.21.15.7:0/2394051038 wait complete. 2024-04-23T15:11:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.650+0000 7fa291077740 20 client.17289 trim_cache size 0 max 16384 2024-04-23T15:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 Processor -- start 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 -- start start 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x56536009fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2881b5ea0 con 0x56536009d3c0 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2881b79e0 con 0x5653600a85a0 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa291077740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2881b6570 con 0x56536009dce0 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa287400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa287400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52188/0 (socket says 172.21.15.7:52188) 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.669+0000 7fa287400640 1 -- 172.21.15.7:0/780160439 learned_addr learned my addr 172.21.15.7:0/780160439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa286a00640 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287e00640 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x56536009fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287400640 1 -- 172.21.15.7:0/780160439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 msgr2=0x5653600b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287400640 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287400640 1 -- 172.21.15.7:0/780160439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 msgr2=0x56536009fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287400640 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x56536009fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287400640 1 -- 172.21.15.7:0/780160439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653600aad00 con 0x56536009d3c0 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.670+0000 7fa287400640 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a7cd0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa278009900 tx=0x7fa278032770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a233fe797e8665 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.671+0000 7fa273400640 1 -- 172.21.15.7:0/780160439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27804c030 con 0x56536009d3c0 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.671+0000 7fa273400640 1 -- 172.21.15.7:0/780160439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa27805f020 con 0x56536009d3c0 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.671+0000 7fa273400640 1 -- 172.21.15.7:0/780160439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278035050 con 0x56536009d3c0 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.671+0000 7fa291077740 1 -- 172.21.15.7:0/780160439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 msgr2=0x5653600a7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.671+0000 7fa291077740 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a7cd0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa278009900 tx=0x7fa278032770 comp rx=0 tx=0).stop 2024-04-23T15:11:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 -- 172.21.15.7:0/780160439 shutdown_connections 2024-04-23T15:11:42.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653600a85a0 0x56536009fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56536009dce0 0x5653600b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 --2- 172.21.15.7:0/780160439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009d3c0 0x5653600a7cd0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 -- 172.21.15.7:0/780160439 >> 172.21.15.7:0/780160439 conn(0x5653600998d0 msgr2=0x5653600a5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:42.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 -- 172.21.15.7:0/780160439 shutdown_connections 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 -- 172.21.15.7:0/780160439 wait complete. 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 -- start start 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.672+0000 7fa291077740 1 Processor -- start 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009d3c0 0x5653600b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 0x5653600a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2881b7310 con 0x56536009dce0 2024-04-23T15:11:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2881b6c40 con 0x56536009d3c0 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2881b3ea0 con 0x5653600a85a0 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa291077740 10 client.0 _ll_register_callbacks cb 0x7fa27803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa286a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 0x5653600a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa286a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 0x5653600a1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52194/0 (socket says 172.21.15.7:52194) 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.673+0000 7fa286a00640 1 -- 172.21.15.7:0/2402622423 learned_addr learned my addr 172.21.15.7:0/2402622423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa287400640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009d3c0 0x5653600b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa287e00640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa286a00640 1 -- 172.21.15.7:0/2402622423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 msgr2=0x5653600a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa286a00640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa286a00640 1 -- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009d3c0 msgr2=0x5653600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa286a00640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009d3c0 0x5653600b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa286a00640 1 -- 172.21.15.7:0/2402622423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56535fde2620 con 0x56536009dce0 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa287e00640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa287400640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009d3c0 0x5653600b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa286a00640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 0x5653600a1f50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa274005ca0 tx=0x7fa27400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7d015873d57b9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa270c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa270c00640 1 -- 172.21.15.7:0/2402622423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274019040 con 0x56536009dce0 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa270c00640 1 -- 172.21.15.7:0/2402622423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7fa27402b430 con 0x56536009dce0 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.674+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27805f020 con 0x56536009dce0 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa270c00640 1 -- 172.21.15.7:0/2402622423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa274038050 con 0x56536009dce0 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 10 client.17295 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56536011eb10 con 0x56536009dce0 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa270c00640 1 -- 172.21.15.7:0/2402622423 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa27805f020 con 0x56536009dce0 2024-04-23T15:11:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa270c00640 1 -- 172.21.15.7:0/2402622423 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa274004640 con 0x56536009dce0 2024-04-23T15:11:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 10 client.17295 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 10 client.17295 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 20 client.17295 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56536011ef90 0x5653601213b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 4 client.17295 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:11:42.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.675+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56536000b190 con 0x56536011ef90 2024-04-23T15:11:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.676+0000 7fa287400640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56536011ef90 0x5653601213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.677+0000 7fa287400640 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56536011ef90 0x5653601213b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9f2663a2a64fcdf server_cookie=ba059caf24cfe53c in_seq=0 out_seq=0 2024-04-23T15:11:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.677+0000 7fa270c00640 10 client.17295 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa270c00640 1 -- 172.21.15.7:0/2402622423 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56536000b190 con 0x56536011ef90 2024-04-23T15:11:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa270c00640 10 client.17295 handle_command_reply: tid=0 2024-04-23T15:11:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 client.17295 shutdown 2024-04-23T15:11:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 msgr2=0x5653600a1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 0x5653600a1f50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa274005ca0 tx=0x7fa27400b430 comp rx=0 tx=0).stop 2024-04-23T15:11:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 shutdown_connections 2024-04-23T15:11:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56536011ef90 0x5653601213b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653600a85a0 0x5653600a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56536009dce0 0x5653600a1f50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 --2- 172.21.15.7:0/2402622423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56536009d3c0 0x5653600b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 >> 172.21.15.7:0/2402622423 conn(0x5653600998d0 msgr2=0x5653600a5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa270c00640 0 client.17295 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.712+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 shutdown_connections 2024-04-23T15:11:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.713+0000 7fa291077740 1 -- 172.21.15.7:0/2402622423 wait complete. 2024-04-23T15:11:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.713+0000 7fa291077740 20 client.17295 trim_cache size 0 max 16384 2024-04-23T15:11:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:11:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:11:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:11:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:11:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.713+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa26c0a3d90 msgr2=0x7fa26c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.713+0000 7fa28cc00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa26c0a3d90 0x7fa26c0a6250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x56536009e960 tx=0x7fa278031400 comp rx=0 tx=0).stop 2024-04-23T15:11:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.713+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 msgr2=0x7fa2881a3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.713+0000 7fa28cc00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 0x7fa2881a3be0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa28000e9d0 tx=0x7fa28000ee90 comp rx=0 tx=0).stop 2024-04-23T15:11:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 shutdown_connections 2024-04-23T15:11:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa26c0a3d90 0x7fa26c0a6250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa288112e10 0x7fa28819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2881a3730 0x7fa2881a3be0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 --2- 172.21.15.7:0/1300458182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa288074cc0 0x7fa28819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 >> 172.21.15.7:0/1300458182 conn(0x7fa2880fd950 msgr2=0x7fa2880ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 shutdown_connections 2024-04-23T15:11:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:42.714+0000 7fa28cc00640 1 -- 172.21.15.7:0/1300458182 wait complete. 2024-04-23T15:11:43.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:42 smithi007 ceph-mon[27906]: pgmap v639: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:43.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:42 smithi186 ceph-mon[31814]: pgmap v639: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:42 smithi137 ceph-mon[31694]: pgmap v639: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:11:45.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:44 smithi007 ceph-mon[27906]: pgmap v640: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:11:45.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:44 smithi186 ceph-mon[31814]: pgmap v640: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:11:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:44 smithi137 ceph-mon[31694]: pgmap v640: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:11:46.971 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:46 smithi137 ceph-mon[31694]: pgmap v641: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-04-23T15:11:47.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:46 smithi007 ceph-mon[27906]: pgmap v641: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-04-23T15:11:47.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:46 smithi186 ceph-mon[31814]: pgmap v641: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.3 MiB/s wr, 10 op/s 2024-04-23T15:11:49.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:48 smithi007 ceph-mon[27906]: pgmap v642: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:11:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:48 smithi186 ceph-mon[31814]: pgmap v642: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:11:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:48 smithi137 ceph-mon[31694]: pgmap v642: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:11:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:50 smithi007 ceph-mon[27906]: pgmap v643: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:11:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:50 smithi186 ceph-mon[31814]: pgmap v643: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:11:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:50 smithi137 ceph-mon[31694]: pgmap v643: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:11:53.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:52 smithi007 ceph-mon[27906]: pgmap v644: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:11:53.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:52 smithi186 ceph-mon[31814]: pgmap v644: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:11:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:52 smithi137 ceph-mon[31694]: pgmap v644: 129 pgs: 129 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:11:55.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:54 smithi007 ceph-mon[27906]: pgmap v645: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:11:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:54 smithi186 ceph-mon[31814]: pgmap v645: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:11:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:54 smithi137 ceph-mon[31694]: pgmap v645: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:11:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 -- 172.21.15.7:0/1232857209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 msgr2=0x7f67681110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 --2- 172.21.15.7:0/1232857209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681110f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f6760009ca0 tx=0x7f676002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 -- 172.21.15.7:0/1232857209 shutdown_connections 2024-04-23T15:11:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 --2- 172.21.15.7:0/1232857209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681110f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 --2- 172.21.15.7:0/1232857209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6768104e00 0x7f6768108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 --2- 172.21.15.7:0/1232857209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 0x7f6768104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 -- 172.21.15.7:0/1232857209 >> 172.21.15.7:0/1232857209 conn(0x7f67680ffcf0 msgr2=0x7f6768102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 -- 172.21.15.7:0/1232857209 shutdown_connections 2024-04-23T15:11:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.869+0000 7f676f000640 1 -- 172.21.15.7:0/1232857209 wait complete. 2024-04-23T15:11:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.870+0000 7f676f000640 1 Processor -- start 2024-04-23T15:11:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 -- start start 2024-04-23T15:11:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 0x7f67681a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676819a720 0x7f676819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67681144e0 con 0x7f6768109520 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6768114360 con 0x7f6768104450 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f676f000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6768114660 con 0x7f676819a720 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f6767400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f6767400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53462/0 (socket says 172.21.15.7:53462) 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.871+0000 7f6767400640 1 -- 172.21.15.7:0/1965710320 learned_addr learned my addr 172.21.15.7:0/1965710320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767e00640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 0x7f67681a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f676d000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676819a720 0x7f676819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767400640 1 -- 172.21.15.7:0/1965710320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676819a720 msgr2=0x7f676819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767400640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676819a720 0x7f676819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767400640 1 -- 172.21.15.7:0/1965710320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 msgr2=0x7f67681a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767400640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 0x7f67681a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767400640 1 -- 172.21.15.7:0/1965710320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676819b320 con 0x7f6768109520 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767e00640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 0x7f67681a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f676d000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676819a720 0x7f676819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.872+0000 7f6767400640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681a0ba0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f675400e9f0 tx=0x7f675400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.873+0000 7f6764c00640 1 -- 172.21.15.7:0/1965710320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675400ccc0 con 0x7f6768109520 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.873+0000 7f6764c00640 1 -- 172.21.15.7:0/1965710320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67540054d0 con 0x7f6768109520 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.873+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67681a7400 con 0x7f6768109520 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.873+0000 7f6764c00640 1 -- 172.21.15.7:0/1965710320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754010430 con 0x7f6768109520 2024-04-23T15:11:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.873+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681a7800 con 0x7f6768109520 2024-04-23T15:11:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.877+0000 7f6764c00640 1 -- 172.21.15.7:0/1965710320 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6754005020 con 0x7f6768109520 2024-04-23T15:11:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.877+0000 7f6771dfe740 1 Processor -- start 2024-04-23T15:11:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.877+0000 7f6771dfe740 1 -- start start 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.877+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38c1b0 0x555dab38c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.877+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab396e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab397390 0x555dab399780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6771dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555dab2f2900 con 0x555dab38cad0 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6771dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555dab298f20 con 0x555dab397390 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6771dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555dab2ee8c0 con 0x555dab38c1b0 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab396e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab396e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53466/0 (socket says 172.21.15.7:53466) 2024-04-23T15:11:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 -- 172.21.15.7:0/2583362053 learned_addr learned my addr 172.21.15.7:0/2583362053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f676d000640 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38c1b0 0x555dab38c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767400640 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab397390 0x555dab399780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 -- 172.21.15.7:0/2583362053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38c1b0 msgr2=0x555dab38c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38c1b0 0x555dab38c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 -- 172.21.15.7:0/2583362053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab397390 msgr2=0x555dab399780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab397390 0x555dab399780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.878+0000 7f6767e00640 1 -- 172.21.15.7:0/2583362053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dab2bde10 con 0x555dab38cad0 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.879+0000 7f6767e00640 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab396e50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6758009d50 tx=0x7f67580117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d390a75c2d77de18 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.879+0000 7f675d600640 1 -- 172.21.15.7:0/2583362053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758012650 con 0x555dab38cad0 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.879+0000 7f675d600640 1 -- 172.21.15.7:0/2583362053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6758009e40 con 0x555dab38cad0 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.879+0000 7f6764c00640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f674c0a3e40 0x7f674c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.879+0000 7f675d600640 1 -- 172.21.15.7:0/2583362053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675800fbf0 con 0x555dab38cad0 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.879+0000 7f6764c00640 1 -- 172.21.15.7:0/1965710320 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f67540d0ff0 con 0x7f6768109520 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f676d000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f674c0a3e40 0x7f674c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 -- 172.21.15.7:0/2583362053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 msgr2=0x555dab396e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab396e50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6758009d50 tx=0x7f67580117b0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 -- 172.21.15.7:0/2583362053 shutdown_connections 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab397390 0x555dab399780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab396e50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2583362053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38c1b0 0x555dab38c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.880+0000 7f6771dfe740 1 -- 172.21.15.7:0/2583362053 >> 172.21.15.7:0/2583362053 conn(0x555dab3886c0 msgr2=0x555dab388aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.881+0000 7f6771dfe740 1 -- 172.21.15.7:0/2583362053 shutdown_connections 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.881+0000 7f676d000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f674c0a3e40 0x7f674c0a6300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6760004af0 tx=0x7f6760004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.881+0000 7f6771dfe740 1 -- 172.21.15.7:0/2583362053 wait complete. 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.881+0000 7f6771dfe740 1 -- start start 2024-04-23T15:11:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.881+0000 7f6771dfe740 1 Processor -- start 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab394830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab394d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555dab399fc0 con 0x555dab397390 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555dab2ac2c0 con 0x555dab38c1b0 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555dab39a140 con 0x555dab38cad0 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f6771dfe740 10 client.0 _ll_register_callbacks cb 0x555dab004a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.882+0000 7f676d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab394d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab394d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53468/0 (socket says 172.21.15.7:53468) 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 -- 172.21.15.7:0/1899594270 learned_addr learned my addr 172.21.15.7:0/1899594270 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f6767e00640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f6767400640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab394830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 -- 172.21.15.7:0/1899594270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 msgr2=0x555dab394830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab394830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 -- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 msgr2=0x555dab3942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3942f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.883+0000 7f676d000640 1 -- 172.21.15.7:0/1899594270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dab2bcfd0 con 0x555dab397390 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f676d000640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab394d70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6760031700 tx=0x7f67600095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41530b7d60e392bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6752000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6752000640 1 -- 172.21.15.7:0/1899594270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676004e070 con 0x555dab397390 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6752000640 1 -- 172.21.15.7:0/1899594270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f67600045c0 con 0x555dab397390 2024-04-23T15:11:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dab300320 con 0x555dab397390 2024-04-23T15:11:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6752000640 1 -- 172.21.15.7:0/1899594270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f67600047c0 con 0x555dab397390 2024-04-23T15:11:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6771dfe740 10 client.17307 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.884+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555dab005210 con 0x555dab397390 2024-04-23T15:11:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6752000640 1 -- 172.21.15.7:0/1899594270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x555dab300320 con 0x555dab397390 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6752000640 1 -- 172.21.15.7:0/1899594270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6760043040 con 0x555dab397390 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6771dfe740 10 client.17307 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6771dfe740 10 client.17307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6771dfe740 20 client.17307 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6771dfe740 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab3a74d0 0x555dab3a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6771dfe740 4 client.17307 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.885+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dab2fa190 con 0x555dab3a74d0 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.886+0000 7f6767e00640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab3a74d0 0x555dab3a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.887+0000 7f6752000640 10 client.17307 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.887+0000 7f6767e00640 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab3a74d0 0x555dab3a9920 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e2456c6eeeaa3bf server_cookie=49549fbb80347084 in_seq=0 out_seq=0 2024-04-23T15:11:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6752000640 1 -- 172.21.15.7:0/1899594270 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555dab2fa190 con 0x555dab3a74d0 2024-04-23T15:11:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6752000640 10 client.17307 handle_command_reply: tid=0 2024-04-23T15:11:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 client.17307 shutdown 2024-04-23T15:11:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 msgr2=0x555dab394d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab394d70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6760031700 tx=0x7f67600095c0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 shutdown_connections 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab3a74d0 0x555dab3a9920 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab394d70 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab394830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 --2- 172.21.15.7:0/1899594270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 >> 172.21.15.7:0/1899594270 conn(0x555dab3886c0 msgr2=0x555dab387840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.889+0000 7f6752000640 0 client.17307 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.890+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 shutdown_connections 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.890+0000 7f6771dfe740 1 -- 172.21.15.7:0/1899594270 wait complete. 2024-04-23T15:11:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.890+0000 7f6771dfe740 20 client.17307 trim_cache size 0 max 16384 2024-04-23T15:11:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.909+0000 7f6771dfe740 1 Processor -- start 2024-04-23T15:11:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.909+0000 7f6771dfe740 1 -- start start 2024-04-23T15:11:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab38eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab397390 0x555dab3af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6771dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67681b1540 con 0x555dab38cad0 2024-04-23T15:11:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6771dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67681b3080 con 0x555dab38c1b0 2024-04-23T15:11:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6771dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f67681b1c10 con 0x555dab397390 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab38eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab38eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53480/0 (socket says 172.21.15.7:53480) 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 -- 172.21.15.7:0/4057792786 learned_addr learned my addr 172.21.15.7:0/4057792786 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767e00640 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f676d000640 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab397390 0x555dab3af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 -- 172.21.15.7:0/4057792786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab397390 msgr2=0x555dab3af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab397390 0x555dab3af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 -- 172.21.15.7:0/4057792786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 msgr2=0x555dab3a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.910+0000 7f6767400640 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3a2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.911+0000 7f6767400640 1 -- 172.21.15.7:0/4057792786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dab0d1620 con 0x555dab38cad0 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.911+0000 7f676d000640 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab397390 0x555dab3af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.911+0000 7f6767400640 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab38eb70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f675400e9c0 tx=0x7f67540048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aaa83d6f6d74a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.911+0000 7f675cc00640 1 -- 172.21.15.7:0/4057792786 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675400ce60 con 0x555dab38cad0 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.911+0000 7f675cc00640 1 -- 172.21.15.7:0/4057792786 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67540046c0 con 0x555dab38cad0 2024-04-23T15:11:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.911+0000 7f675cc00640 1 -- 172.21.15.7:0/4057792786 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67540a0f70 con 0x555dab38cad0 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 -- 172.21.15.7:0/4057792786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 msgr2=0x555dab38eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab38eb70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f675400e9c0 tx=0x7f67540048b0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 -- 172.21.15.7:0/4057792786 shutdown_connections 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab397390 0x555dab3af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab38cad0 0x555dab38eb70 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 --2- 172.21.15.7:0/4057792786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab3a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 -- 172.21.15.7:0/4057792786 >> 172.21.15.7:0/4057792786 conn(0x555dab3886c0 msgr2=0x555dab38f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 -- 172.21.15.7:0/4057792786 shutdown_connections 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.912+0000 7f6771dfe740 1 -- 172.21.15.7:0/4057792786 wait complete. 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 -- start start 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 Processor -- start 2024-04-23T15:11:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab39a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab39a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab39add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67681b29b0 con 0x555dab397390 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67681b22e0 con 0x555dab38c1b0 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f67681af540 con 0x555dab38cad0 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.913+0000 7f6771dfe740 10 client.0 _ll_register_callbacks cb 0x7f6758005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab39add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab39add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53482/0 (socket says 172.21.15.7:53482) 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 -- 172.21.15.7:0/2566334719 learned_addr learned my addr 172.21.15.7:0/2566334719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f6767e00640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab39a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f6767400640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab39a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 -- 172.21.15.7:0/2566334719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 msgr2=0x555dab39a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab39a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 -- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 msgr2=0x555dab39a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:11:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab39a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f676d000640 1 -- 172.21.15.7:0/2566334719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dab40bcb0 con 0x555dab397390 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.914+0000 7f6767e00640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab39a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f676d000640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab39add0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f676002ade0 tx=0x7f67600454e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f2cb426a349299 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6752000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6752000640 1 -- 172.21.15.7:0/2566334719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676004e030 con 0x555dab397390 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6752000640 1 -- 172.21.15.7:0/2566334719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9467+0+0 (secure 0 0 0) 0x7f6760045e30 con 0x555dab397390 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dab2764b0 con 0x555dab397390 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6752000640 1 -- 172.21.15.7:0/2566334719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6760004620 con 0x555dab397390 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6771dfe740 10 client.17313 fetch_fsmap learned FSMap version 32 2024-04-23T15:11:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.915+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555dab40cf70 con 0x555dab397390 2024-04-23T15:11:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6752000640 1 -- 172.21.15.7:0/2566334719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x555dab2764b0 con 0x555dab397390 2024-04-23T15:11:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6752000640 1 -- 172.21.15.7:0/2566334719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6760043070 con 0x555dab397390 2024-04-23T15:11:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6771dfe740 10 client.17313 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:11:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6771dfe740 10 client.17313 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:11:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6771dfe740 20 client.17313 populate_metadata read hostname 'smithi007' 2024-04-23T15:11:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab40d740 0x555dab40fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:11:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6771dfe740 4 client.17313 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:11:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.916+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555dab2c3310 con 0x555dab40d740 2024-04-23T15:11:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.917+0000 7f6767e00640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab40d740 0x555dab40fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:11:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.917+0000 7f6767e00640 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab40d740 0x555dab40fb60 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b460c08fa683de31 server_cookie=bbedeb6c9241a278 in_seq=0 out_seq=0 2024-04-23T15:11:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.917+0000 7f6752000640 10 client.17313 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6752000640 1 -- 172.21.15.7:0/2566334719 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555dab2c3310 con 0x555dab40d740 2024-04-23T15:11:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6752000640 10 client.17313 handle_command_reply: tid=0 2024-04-23T15:11:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 client.17313 shutdown 2024-04-23T15:11:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 msgr2=0x555dab39add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab39add0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f676002ade0 tx=0x7f67600454e0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 shutdown_connections 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555dab40d740 0x555dab40fb60 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dab397390 0x555dab39add0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555dab38cad0 0x555dab39a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 --2- 172.21.15.7:0/2566334719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555dab38c1b0 0x555dab39a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 >> 172.21.15.7:0/2566334719 conn(0x555dab3886c0 msgr2=0x555dab392b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6752000640 0 client.17313 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 shutdown_connections 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.957+0000 7f6771dfe740 1 -- 172.21.15.7:0/2566334719 wait complete. 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.958+0000 7f6771dfe740 20 client.17313 trim_cache size 0 max 16384 2024-04-23T15:11:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:11:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:11:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:11:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.958+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f674c0a3e40 msgr2=0x7f674c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.958+0000 7f676f000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f674c0a3e40 0x7f674c0a6300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6760004af0 tx=0x7f6760004a40 comp rx=0 tx=0).stop 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.958+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 msgr2=0x7f67681a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.958+0000 7f676f000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681a0ba0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f675400e9f0 tx=0x7f675400eeb0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 shutdown_connections 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f674c0a3e40 0x7f674c0a6300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676819a720 0x7f676819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6768109520 0x7f67681a0ba0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 --2- 172.21.15.7:0/1965710320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6768104450 0x7f67681a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:11:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 >> 172.21.15.7:0/1965710320 conn(0x7f67680ffcf0 msgr2=0x7f6768100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:11:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 shutdown_connections 2024-04-23T15:11:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:11:55.959+0000 7f676f000640 1 -- 172.21.15.7:0/1965710320 wait complete. 2024-04-23T15:11:57.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:56 smithi007 ceph-mon[27906]: pgmap v646: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:11:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:56 smithi186 ceph-mon[31814]: pgmap v646: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:11:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:56 smithi137 ceph-mon[31694]: pgmap v646: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:11:59.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:11:58 smithi007 ceph-mon[27906]: pgmap v647: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:11:59.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:11:58 smithi186 ceph-mon[31814]: pgmap v647: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:11:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:11:58 smithi137 ceph-mon[31694]: pgmap v647: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:12:01.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:00 smithi007 ceph-mon[27906]: pgmap v648: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:01.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:00 smithi186 ceph-mon[31814]: pgmap v648: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:00 smithi137 ceph-mon[31694]: pgmap v648: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:03.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:02 smithi007 ceph-mon[27906]: pgmap v649: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:02 smithi186 ceph-mon[31814]: pgmap v649: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:02 smithi137 ceph-mon[31694]: pgmap v649: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:05.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:04 smithi007 ceph-mon[27906]: pgmap v650: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:12:05.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:04 smithi186 ceph-mon[31814]: pgmap v650: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:12:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:04 smithi137 ceph-mon[31694]: pgmap v650: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:12:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:06 smithi007 ceph-mon[27906]: pgmap v651: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 31 op/s 2024-04-23T15:12:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:06 smithi186 ceph-mon[31814]: pgmap v651: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 31 op/s 2024-04-23T15:12:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:06 smithi137 ceph-mon[31694]: pgmap v651: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 31 op/s 2024-04-23T15:12:09.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:08 smithi007 ceph-mon[27906]: pgmap v652: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:12:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:08 smithi007 ceph-mon[27906]: osdmap e121: 12 total, 12 up, 12 in 2024-04-23T15:12:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:08 smithi186 ceph-mon[31814]: pgmap v652: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:12:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:08 smithi186 ceph-mon[31814]: osdmap e121: 12 total, 12 up, 12 in 2024-04-23T15:12:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a1400640 1 -- 172.21.15.7:0/3968980509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c031880 con 0x7f06a4102a40 2024-04-23T15:12:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 -- 172.21.15.7:0/3968980509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102a40 msgr2=0x7f06a4106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 --2- 172.21.15.7:0/3968980509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102a40 0x7f06a4106a80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f068c009900 tx=0x7f068c02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 -- 172.21.15.7:0/3968980509 shutdown_connections 2024-04-23T15:12:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 --2- 172.21.15.7:0/3968980509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06a4107160 0x7f06a410ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 --2- 172.21.15.7:0/3968980509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102a40 0x7f06a4106a80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 --2- 172.21.15.7:0/3968980509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06a4102090 0x7f06a4102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 -- 172.21.15.7:0/3968980509 >> 172.21.15.7:0/3968980509 conn(0x7f06a40fd9b0 msgr2=0x7f06a40ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.113+0000 7f06a3200640 1 -- 172.21.15.7:0/3968980509 shutdown_connections 2024-04-23T15:12:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.114+0000 7f06a3200640 1 -- 172.21.15.7:0/3968980509 wait complete. 2024-04-23T15:12:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 Processor -- start 2024-04-23T15:12:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 -- start start 2024-04-23T15:12:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 0x7f06a41a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06a4107160 0x7f06a41a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06a419a620 0x7f06a419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41120d0 con 0x7f06a4102090 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4111f50 con 0x7f06a4107160 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.115+0000 7f06a3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4112250 con 0x7f06a419a620 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 0x7f06a41a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 0x7f06a41a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40668/0 (socket says 172.21.15.7:40668) 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 -- 172.21.15.7:0/563146716 learned_addr learned my addr 172.21.15.7:0/563146716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f0699400640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06a4107160 0x7f06a41a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a2800640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06a419a620 0x7f06a419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 -- 172.21.15.7:0/563146716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06a419a620 msgr2=0x7f06a419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06a419a620 0x7f06a419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 -- 172.21.15.7:0/563146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06a4107160 msgr2=0x7f06a41a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06a4107160 0x7f06a41a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 -- 172.21.15.7:0/563146716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a419b140 con 0x7f06a4102090 2024-04-23T15:12:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.116+0000 7f06a1e00640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 0x7f06a41a0470 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f069400eab0 tx=0x7f069400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.117+0000 7f069b400640 1 -- 172.21.15.7:0/563146716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069400ce40 con 0x7f06a4102090 2024-04-23T15:12:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.117+0000 7f069b400640 1 -- 172.21.15.7:0/563146716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0694011920 con 0x7f06a4102090 2024-04-23T15:12:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.117+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419b430 con 0x7f06a4102090 2024-04-23T15:12:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.117+0000 7f069b400640 1 -- 172.21.15.7:0/563146716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694010a00 con 0x7f06a4102090 2024-04-23T15:12:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.117+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41a7680 con 0x7f06a4102090 2024-04-23T15:12:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.120+0000 7f06ab81e740 1 Processor -- start 2024-04-23T15:12:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 -- start start 2024-04-23T15:12:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a574c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614a56a7900 con 0x5614a5741ce0 2024-04-23T15:12:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5614a564df20 con 0x5614a574c5a0 2024-04-23T15:12:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06ab81e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5614a56a38c0 con 0x5614a57413c0 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f069b400640 1 -- 172.21.15.7:0/563146716 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0694011ad0 con 0x7f06a4102090 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.121+0000 7f06a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a574c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a574c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40672/0 (socket says 172.21.15.7:40672) 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 -- 172.21.15.7:0/490355738 learned_addr learned my addr 172.21.15.7:0/490355738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f0699400640 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 -- 172.21.15.7:0/490355738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 msgr2=0x5614a57417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 -- 172.21.15.7:0/490355738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 msgr2=0x5614a574e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 -- 172.21.15.7:0/490355738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a5672e10 con 0x5614a5741ce0 2024-04-23T15:12:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.122+0000 7f06a1e00640 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a574c060 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f06940ce590 tx=0x7f06940d9600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5cf7bff9a896f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.123+0000 7f0693000640 1 -- 172.21.15.7:0/490355738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940d3520 con 0x5614a5741ce0 2024-04-23T15:12:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.123+0000 7f0693000640 1 -- 172.21.15.7:0/490355738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06940d9e30 con 0x5614a5741ce0 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.123+0000 7f0693000640 1 -- 172.21.15.7:0/490355738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940e0b20 con 0x5614a5741ce0 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.123+0000 7f069b400640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f06880a3d10 0x7f06880a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f069b400640 1 -- 172.21.15.7:0/563146716 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9555+0+0 (secure 0 0 0) 0x7f06940d1370 con 0x7f06a4102090 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06a2800640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f06880a3d10 0x7f06880a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 -- 172.21.15.7:0/490355738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 msgr2=0x5614a574c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a574c060 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f06940ce590 tx=0x7f06940d9600 comp rx=0 tx=0).stop 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 -- 172.21.15.7:0/490355738 shutdown_connections 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a574c060 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 --2- 172.21.15.7:0/490355738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 -- 172.21.15.7:0/490355738 >> 172.21.15.7:0/490355738 conn(0x5614a573d8d0 msgr2=0x5614a573dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 -- 172.21.15.7:0/490355738 shutdown_connections 2024-04-23T15:12:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.124+0000 7f06ab81e740 1 -- 172.21.15.7:0/490355738 wait complete. 2024-04-23T15:12:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.125+0000 7f06a2800640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f06880a3d10 0x7f06880a61d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f069c0045d0 tx=0x7f069c005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.125+0000 7f06ab81e740 1 -- start start 2024-04-23T15:12:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.125+0000 7f06ab81e740 1 Processor -- start 2024-04-23T15:12:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.125+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 0x5614a57495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.125+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a5741ce0 0x5614a5749b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06ab81e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614a574f140 con 0x5614a57413c0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06ab81e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5614a56612c0 con 0x5614a574c5a0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06ab81e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5614a574f2c0 con 0x5614a5741ce0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06ab81e740 10 client.0 _ll_register_callbacks cb 0x5614a53b9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 0x5614a57495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 0x5614a57495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40676/0 (socket says 172.21.15.7:40676) 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 -- 172.21.15.7:0/2759868118 learned_addr learned my addr 172.21.15.7:0/2759868118 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f0699400640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a5741ce0 0x5614a5749b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a2800640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 -- 172.21.15.7:0/2759868118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a5741ce0 msgr2=0x5614a5749b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a5741ce0 0x5614a5749b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 -- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 msgr2=0x5614a574a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.126+0000 7f06a1e00640 1 -- 172.21.15.7:0/2759868118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a5671fd0 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f06a1e00640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 0x5614a57495d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f0694099870 tx=0x7f06940d15f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50567022745f6a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f0687400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f0687400640 1 -- 172.21.15.7:0/2759868118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694099140 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f0687400640 1 -- 172.21.15.7:0/2759868118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9555+0+0 (secure 0 0 0) 0x7f06940ce8d0 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06940d9e30 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f0687400640 1 -- 172.21.15.7:0/2759868118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f069409c800 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f06ab81e740 10 client.17325 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.127+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5614a53ba210 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f0687400640 1 -- 172.21.15.7:0/2759868118 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06940d9e30 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f0687400640 1 -- 172.21.15.7:0/2759868118 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f069400f040 con 0x5614a57413c0 2024-04-23T15:12:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f06ab81e740 10 client.17325 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f06ab81e740 10 client.17325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f06ab81e740 20 client.17325 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a575c620 0x5614a575ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f06ab81e740 4 client.17325 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:12:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.128+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614a56b5320 con 0x5614a575c620 2024-04-23T15:12:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.129+0000 7f0699400640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a575c620 0x5614a575ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.130+0000 7f0699400640 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a575c620 0x5614a575ea10 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a03f45e8b5855c server_cookie=22a39b4abbc2a9dd in_seq=0 out_seq=0 2024-04-23T15:12:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.130+0000 7f0687400640 10 client.17325 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.131+0000 7f0687400640 1 -- 172.21.15.7:0/2759868118 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5614a56b5320 con 0x5614a575c620 2024-04-23T15:12:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.131+0000 7f0687400640 10 client.17325 handle_command_reply: tid=0 2024-04-23T15:12:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.131+0000 7f06ab81e740 1 client.17325 shutdown 2024-04-23T15:12:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 msgr2=0x5614a57495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 0x5614a57495d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f0694099870 tx=0x7f06940d15f0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 shutdown_connections 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a575c620 0x5614a575ea10 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a574a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a5741ce0 0x5614a5749b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f0687400640 0 client.17325 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2759868118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a57413c0 0x5614a57495d0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 >> 172.21.15.7:0/2759868118 conn(0x5614a573d8d0 msgr2=0x5614a573ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 shutdown_connections 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 1 -- 172.21.15.7:0/2759868118 wait complete. 2024-04-23T15:12:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.132+0000 7f06ab81e740 20 client.17325 trim_cache size 0 max 16384 2024-04-23T15:12:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.156+0000 7f06ab81e740 1 Processor -- start 2024-04-23T15:12:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 -- start start 2024-04-23T15:12:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a574bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a5761a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a5761f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41b1590 con 0x5614a5741ce0 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41b30d0 con 0x5614a574c5a0 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06ab81e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41b1c60 con 0x5614a57413c0 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f0699400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a5761a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f0699400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a5761a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40684/0 (socket says 172.21.15.7:40684) 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f0699400640 1 -- 172.21.15.7:0/441375408 learned_addr learned my addr 172.21.15.7:0/441375408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.157+0000 7f06a2800640 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a5761f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f06a1e00640 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a574bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0699400640 1 -- 172.21.15.7:0/441375408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 msgr2=0x5614a574bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0699400640 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a574bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0699400640 1 -- 172.21.15.7:0/441375408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 msgr2=0x5614a5761f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0699400640 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a5761f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0699400640 1 -- 172.21.15.7:0/441375408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a5486620 con 0x5614a5741ce0 2024-04-23T15:12:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0699400640 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a5761a30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f068c031440 tx=0x7f068c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2272505b742a71ef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.158+0000 7f0692600640 1 -- 172.21.15.7:0/441375408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c035040 con 0x5614a5741ce0 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f0692600640 1 -- 172.21.15.7:0/441375408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f068c004310 con 0x5614a5741ce0 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f0692600640 1 -- 172.21.15.7:0/441375408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c005610 con 0x5614a5741ce0 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 -- 172.21.15.7:0/441375408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 msgr2=0x5614a5761a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a5761a30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f068c031440 tx=0x7f068c005a20 comp rx=0 tx=0).stop 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 -- 172.21.15.7:0/441375408 shutdown_connections 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a5761f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a5761a30 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 --2- 172.21.15.7:0/441375408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a574bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.159+0000 7f06ab81e740 1 -- 172.21.15.7:0/441375408 >> 172.21.15.7:0/441375408 conn(0x5614a573d8d0 msgr2=0x5614a5747ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.160+0000 7f06ab81e740 1 -- 172.21.15.7:0/441375408 shutdown_connections 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.160+0000 7f06ab81e740 1 -- 172.21.15.7:0/441375408 wait complete. 2024-04-23T15:12:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.160+0000 7f06ab81e740 1 -- start start 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.160+0000 7f06ab81e740 1 Processor -- start 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a57ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a575ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41b2a00 con 0x5614a5741ce0 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41b2330 con 0x5614a574c5a0 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41af590 con 0x5614a57413c0 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06ab81e740 10 client.0 _ll_register_callbacks cb 0x7f068c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f0699400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a57ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f0699400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a57ba0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40686/0 (socket says 172.21.15.7:40686) 2024-04-23T15:12:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f0699400640 1 -- 172.21.15.7:0/2322647437 learned_addr learned my addr 172.21.15.7:0/2322647437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06a1e00640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f06a2800640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a575ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f0699400640 1 -- 172.21.15.7:0/2322647437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 msgr2=0x5614a57b9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.161+0000 7f0699400640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57b9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0699400640 1 -- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 msgr2=0x5614a575ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0699400640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a575ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0699400640 1 -- 172.21.15.7:0/2322647437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a575f430 con 0x5614a5741ce0 2024-04-23T15:12:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f06a2800640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a575ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0699400640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a57ba0a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f068c02a910 tx=0x7f068c004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6ff9acfb2379de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0687400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0687400640 1 -- 172.21.15.7:0/2322647437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c035050 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f0687400640 1 -- 172.21.15.7:0/2322647437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9555+0+0 (secure 0 0 0) 0x7f068c042040 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.162+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f068c004310 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f0687400640 1 -- 172.21.15.7:0/2322647437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f068c0035f0 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 10 client.17331 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5614a57c2320 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f0687400640 1 -- 172.21.15.7:0/2322647437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f068c004310 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f0687400640 1 -- 172.21.15.7:0/2322647437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f068c053030 con 0x5614a5741ce0 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 10 client.17331 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 10 client.17331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 20 client.17331 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a57c2ac0 0x5614a57c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 4 client.17331 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:12:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.163+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614a56af190 con 0x5614a57c2ac0 2024-04-23T15:12:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.164+0000 7f06a1e00640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a57c2ac0 0x5614a57c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:08 smithi137 ceph-mon[31694]: pgmap v652: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:12:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:08 smithi137 ceph-mon[31694]: osdmap e121: 12 total, 12 up, 12 in 2024-04-23T15:12:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.165+0000 7f0687400640 10 client.17331 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.165+0000 7f06a1e00640 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a57c2ac0 0x5614a57c4ee0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369311cd08a0ce3 server_cookie=64ffb39e8ad5b729 in_seq=0 out_seq=0 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f0687400640 1 -- 172.21.15.7:0/2322647437 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614a56af190 con 0x5614a57c2ac0 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f0687400640 10 client.17331 handle_command_reply: tid=0 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 client.17331 shutdown 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 msgr2=0x5614a57ba0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a57ba0a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f068c02a910 tx=0x7f068c004130 comp rx=0 tx=0).stop 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 shutdown_connections 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5614a57c2ac0 0x5614a57c4ee0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5614a574c5a0 0x5614a575ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614a5741ce0 0x5614a57ba0a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f0687400640 0 client.17331 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 --2- 172.21.15.7:0/2322647437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614a57413c0 0x5614a57b9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 >> 172.21.15.7:0/2322647437 conn(0x5614a573d8d0 msgr2=0x5614a573c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 shutdown_connections 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.195+0000 7f06ab81e740 1 -- 172.21.15.7:0/2322647437 wait complete. 2024-04-23T15:12:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.196+0000 7f06ab81e740 20 client.17331 trim_cache size 0 max 16384 2024-04-23T15:12:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:12:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:12:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:12:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:12:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.196+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f06880a3d10 msgr2=0x7f06880a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.196+0000 7f06a3200640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f06880a3d10 0x7f06880a61d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f069c0045d0 tx=0x7f069c005f90 comp rx=0 tx=0).stop 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.196+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 msgr2=0x7f06a41a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.196+0000 7f06a3200640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 0x7f06a41a0470 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f069400eab0 tx=0x7f069400ef70 comp rx=0 tx=0).stop 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 shutdown_connections 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f06880a3d10 0x7f06880a61d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06a4107160 0x7f06a41a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06a419a620 0x7f06a419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 --2- 172.21.15.7:0/563146716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06a4102090 0x7f06a41a0470 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 >> 172.21.15.7:0/563146716 conn(0x7f06a40fd9b0 msgr2=0x7f06a40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 shutdown_connections 2024-04-23T15:12:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:09.197+0000 7f06a3200640 1 -- 172.21.15.7:0/563146716 wait complete. 2024-04-23T15:12:11.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:10 smithi007 ceph-mon[27906]: pgmap v654: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:12:11.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:10 smithi186 ceph-mon[31814]: pgmap v654: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:12:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:10 smithi137 ceph-mon[31694]: pgmap v654: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:12:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:11 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:12:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:11 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:12:12.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:11 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:12:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:12 smithi186 ceph-mon[31814]: pgmap v655: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:12:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:12 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:12 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:12 smithi137 ceph-mon[31694]: pgmap v655: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:12:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:12 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:12 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:12 smithi007 ceph-mon[27906]: pgmap v655: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:12:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:12 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:12 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:14 smithi186 ceph-mon[31814]: pgmap v656: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-04-23T15:12:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:14 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:14 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:14 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:14 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.137 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:14 smithi007 ceph-mon[27906]: pgmap v656: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-04-23T15:12:15.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:14 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:14 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:14 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:14 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:14 smithi137 ceph-mon[31694]: pgmap v656: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-04-23T15:12:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:14 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:14 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:14 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:14 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: pgmap v657: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: osdmap e122: 12 total, 12 up, 12 in 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: pgmap v657: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-04-23T15:12:16.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: osdmap e122: 12 total, 12 up, 12 in 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: pgmap v657: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:12:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:12:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: osdmap e122: 12 total, 12 up, 12 in 2024-04-23T15:12:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:16.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:12:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:12:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:12:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:12:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:12:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:12:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:12:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:12:18.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:18 smithi007 ceph-mon[27906]: pgmap v659: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 18 op/s 2024-04-23T15:12:18.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:18 smithi186 ceph-mon[31814]: pgmap v659: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 18 op/s 2024-04-23T15:12:18.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:18 smithi137 ceph-mon[31694]: pgmap v659: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 18 op/s 2024-04-23T15:12:20.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:20 smithi007 ceph-mon[27906]: pgmap v660: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-04-23T15:12:20.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:20 smithi186 ceph-mon[31814]: pgmap v660: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-04-23T15:12:20.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:20 smithi137 ceph-mon[31694]: pgmap v660: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-04-23T15:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 -- 172.21.15.7:0/4146821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754104450 msgr2=0x7ff754104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 --2- 172.21.15.7:0/4146821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754104450 0x7ff754104830 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ff744009900 tx=0x7ff74402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 -- 172.21.15.7:0/4146821462 shutdown_connections 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 --2- 172.21.15.7:0/4146821462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff754109520 0x7ff7541110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 --2- 172.21.15.7:0/4146821462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff754104e00 0x7ff754108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 --2- 172.21.15.7:0/4146821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754104450 0x7ff754104830 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 -- 172.21.15.7:0/4146821462 >> 172.21.15.7:0/4146821462 conn(0x7ff7540ffcf0 msgr2=0x7ff754102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 -- 172.21.15.7:0/4146821462 shutdown_connections 2024-04-23T15:12:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.356+0000 7ff759200640 1 -- 172.21.15.7:0/4146821462 wait complete. 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.357+0000 7ff759200640 1 Processor -- start 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.357+0000 7ff759200640 1 -- start start 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff759200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff754104450 0x7ff7541a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff759200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 0x7ff7541a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff759200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff75419a760 0x7ff75419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff759200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff754114480 con 0x7ff754109520 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff759200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff754114300 con 0x7ff75419a760 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff759200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff754114600 con 0x7ff754104450 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff751400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 0x7ff7541a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff751400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 0x7ff7541a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34478/0 (socket says 172.21.15.7:34478) 2024-04-23T15:12:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff751400640 1 -- 172.21.15.7:0/1744883874 learned_addr learned my addr 172.21.15.7:0/1744883874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.358+0000 7ff752800640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff75419a760 0x7ff75419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751e00640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff754104450 0x7ff7541a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751400640 1 -- 172.21.15.7:0/1744883874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff754104450 msgr2=0x7ff7541a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751400640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff754104450 0x7ff7541a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751400640 1 -- 172.21.15.7:0/1744883874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff75419a760 msgr2=0x7ff75419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751400640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff75419a760 0x7ff75419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751400640 1 -- 172.21.15.7:0/1744883874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75419b360 con 0x7ff754109520 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff751400640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 0x7ff7541a0b90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00d740 tx=0x7ff73c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff74aa00640 1 -- 172.21.15.7:0/1744883874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c017070 con 0x7ff754109520 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7541a73f0 con 0x7ff754109520 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.359+0000 7ff74aa00640 1 -- 172.21.15.7:0/1744883874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff73c00de50 con 0x7ff754109520 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.360+0000 7ff74aa00640 1 -- 172.21.15.7:0/1744883874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004d60 con 0x7ff754109520 2024-04-23T15:12:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.360+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7541a77a0 con 0x7ff754109520 2024-04-23T15:12:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.363+0000 7ff75c01b740 1 Processor -- start 2024-04-23T15:12:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.363+0000 7ff75c01b740 1 -- start start 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff74aa00640 1 -- 172.21.15.7:0/1744883874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff73c004f00 con 0x7ff754109520 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a67c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a686e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a689780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff75c01b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d37a5e2900 con 0x55d37a67c1b0 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff75c01b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d37a588f20 con 0x55d37a687390 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff75c01b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d37a5de8c0 con 0x55d37a67cad0 2024-04-23T15:12:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff752800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a67c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff752800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a67c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34484/0 (socket says 172.21.15.7:34484) 2024-04-23T15:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.364+0000 7ff752800640 1 -- 172.21.15.7:0/2346542267 learned_addr learned my addr 172.21.15.7:0/2346542267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff751e00640 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a686e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff751400640 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a689780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff752800640 1 -- 172.21.15.7:0/2346542267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 msgr2=0x55d37a686e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff752800640 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a686e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff752800640 1 -- 172.21.15.7:0/2346542267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 msgr2=0x55d37a689780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff752800640 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a689780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff752800640 1 -- 172.21.15.7:0/2346542267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d37a5ade10 con 0x55d37a67c1b0 2024-04-23T15:12:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff751400640 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a689780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.365+0000 7ff752800640 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a67c590 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff74c007dd0 tx=0x7ff74c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a6c7d5327a85fc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.366+0000 7ff74aa00640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7340a3dc0 0x7ff7340a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.366+0000 7ff743400640 1 -- 172.21.15.7:0/2346542267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c014070 con 0x55d37a67c1b0 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.366+0000 7ff743400640 1 -- 172.21.15.7:0/2346542267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff74c004d20 con 0x55d37a67c1b0 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.366+0000 7ff743400640 1 -- 172.21.15.7:0/2346542267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c010790 con 0x55d37a67c1b0 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.366+0000 7ff74aa00640 1 -- 172.21.15.7:0/1744883874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7ff73c0d0690 con 0x7ff754109520 2024-04-23T15:12:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.366+0000 7ff751e00640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7340a3dc0 0x7ff7340a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 -- 172.21.15.7:0/2346542267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 msgr2=0x55d37a67c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a67c590 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff74c007dd0 tx=0x7ff74c00e720 comp rx=0 tx=0).stop 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 -- 172.21.15.7:0/2346542267 shutdown_connections 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a689780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a686e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 --2- 172.21.15.7:0/2346542267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a67c590 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 -- 172.21.15.7:0/2346542267 >> 172.21.15.7:0/2346542267 conn(0x55d37a6786c0 msgr2=0x55d37a678aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 -- 172.21.15.7:0/2346542267 shutdown_connections 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff751e00640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7340a3dc0 0x7ff7340a6280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff744031440 tx=0x7ff744005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.367+0000 7ff75c01b740 1 -- 172.21.15.7:0/2346542267 wait complete. 2024-04-23T15:12:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.368+0000 7ff75c01b740 1 -- start start 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.368+0000 7ff75c01b740 1 Processor -- start 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a6842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a67cad0 0x55d37a684830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a687390 0x55d37a684d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d37a689fc0 con 0x55d37a67c1b0 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d37a59c2c0 con 0x55d37a67cad0 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d37a68a140 con 0x55d37a687390 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff75c01b740 10 client.0 _ll_register_callbacks cb 0x55d37a2f4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff751e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a6842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff751e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a6842f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34488/0 (socket says 172.21.15.7:34488) 2024-04-23T15:12:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.369+0000 7ff751e00640 1 -- 172.21.15.7:0/3556138664 learned_addr learned my addr 172.21.15.7:0/3556138664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751400640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a67cad0 0x55d37a684830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff752800640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a687390 0x55d37a684d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751e00640 1 -- 172.21.15.7:0/3556138664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a687390 msgr2=0x55d37a684d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751e00640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a687390 0x55d37a684d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751e00640 1 -- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a67cad0 msgr2=0x55d37a684830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751e00640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a67cad0 0x55d37a684830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751e00640 1 -- 172.21.15.7:0/3556138664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d37a5acfd0 con 0x55d37a67c1b0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751400640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a67cad0 0x55d37a684830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff751e00640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a6842f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff744032fd0 tx=0x7ff744009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ab27ed3aebde35 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.370+0000 7ff73be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.371+0000 7ff73be00640 1 -- 172.21.15.7:0/3556138664 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74404b030 con 0x55d37a67c1b0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.371+0000 7ff73be00640 1 -- 172.21.15.7:0/3556138664 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7ff744003b40 con 0x55d37a67c1b0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.371+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff74c004d20 con 0x55d37a67c1b0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.371+0000 7ff73be00640 1 -- 172.21.15.7:0/3556138664 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff744058050 con 0x55d37a67c1b0 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.371+0000 7ff75c01b740 10 client.17343 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.371+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d37a2f5210 con 0x55d37a67c1b0 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff73be00640 1 -- 172.21.15.7:0/3556138664 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff74c004d20 con 0x55d37a67c1b0 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff73be00640 1 -- 172.21.15.7:0/3556138664 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff74403b430 con 0x55d37a67c1b0 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff75c01b740 10 client.17343 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff75c01b740 10 client.17343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff75c01b740 20 client.17343 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a697450 0x55d37a699840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff75c01b740 4 client.17343 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.372+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d37a5f0320 con 0x55d37a697450 2024-04-23T15:12:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.373+0000 7ff751400640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a697450 0x55d37a699840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.374+0000 7ff73be00640 10 client.17343 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.374+0000 7ff751400640 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a697450 0x55d37a699840 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11da1659427a9656 server_cookie=3dd7242677b0e95c in_seq=0 out_seq=0 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff73be00640 1 -- 172.21.15.7:0/3556138664 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d37a5f0320 con 0x55d37a697450 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff73be00640 10 client.17343 handle_command_reply: tid=0 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 client.17343 shutdown 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 msgr2=0x55d37a6842f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a6842f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff744032fd0 tx=0x7ff744009260 comp rx=0 tx=0).stop 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 shutdown_connections 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a697450 0x55d37a699840 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a67cad0 0x55d37a684830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a687390 0x55d37a684d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3556138664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a6842f0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff73be00640 0 client.17343 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 >> 172.21.15.7:0/3556138664 conn(0x55d37a6786c0 msgr2=0x55d37a67e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 shutdown_connections 2024-04-23T15:12:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 1 -- 172.21.15.7:0/3556138664 wait complete. 2024-04-23T15:12:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.376+0000 7ff75c01b740 20 client.17343 trim_cache size 0 max 16384 2024-04-23T15:12:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.401+0000 7ff75c01b740 1 Processor -- start 2024-04-23T15:12:22.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.401+0000 7ff75c01b740 1 -- start start 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.401+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a692e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a67eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a6849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff75c01b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541b1490 con 0x55d37a67c1b0 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff75c01b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541b2fd0 con 0x55d37a687390 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff75c01b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541b1b60 con 0x55d37a67cad0 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff751e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a692e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff751e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a692e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34496/0 (socket says 172.21.15.7:34496) 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff751e00640 1 -- 172.21.15.7:0/3683190101 learned_addr learned my addr 172.21.15.7:0/3683190101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff751400640 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a67eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.402+0000 7ff752800640 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a6849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.403+0000 7ff751e00640 1 -- 172.21.15.7:0/3683190101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 msgr2=0x55d37a67eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.403+0000 7ff751e00640 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a67eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.403+0000 7ff751e00640 1 -- 172.21.15.7:0/3683190101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 msgr2=0x55d37a6849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.403+0000 7ff751e00640 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a6849c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.403+0000 7ff751e00640 1 -- 172.21.15.7:0/3683190101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d37a3c1620 con 0x55d37a67c1b0 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.403+0000 7ff751e00640 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a692e80 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff744000c00 tx=0x7ff74403be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e909361b135cf46 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.404+0000 7ff742a00640 1 -- 172.21.15.7:0/3683190101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744061070 con 0x55d37a67c1b0 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.404+0000 7ff742a00640 1 -- 172.21.15.7:0/3683190101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff74403b630 con 0x55d37a67c1b0 2024-04-23T15:12:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.404+0000 7ff742a00640 1 -- 172.21.15.7:0/3683190101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74404b040 con 0x55d37a67c1b0 2024-04-23T15:12:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 -- 172.21.15.7:0/3683190101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 msgr2=0x55d37a692e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a692e80 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff744000c00 tx=0x7ff74403be90 comp rx=0 tx=0).stop 2024-04-23T15:12:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 -- 172.21.15.7:0/3683190101 shutdown_connections 2024-04-23T15:12:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a6849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67cad0 0x55d37a67eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3683190101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67c1b0 0x55d37a692e80 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 -- 172.21.15.7:0/3683190101 >> 172.21.15.7:0/3683190101 conn(0x55d37a6786c0 msgr2=0x55d37a6842b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 -- 172.21.15.7:0/3683190101 shutdown_connections 2024-04-23T15:12:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.405+0000 7ff75c01b740 1 -- 172.21.15.7:0/3683190101 wait complete. 2024-04-23T15:12:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.406+0000 7ff75c01b740 1 -- start start 2024-04-23T15:12:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.406+0000 7ff75c01b740 1 Processor -- start 2024-04-23T15:12:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67c1b0 0x55d37a68f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 0x55d37a68aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a68af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541b2900 con 0x55d37a67cad0 2024-04-23T15:12:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541b2230 con 0x55d37a687390 2024-04-23T15:12:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541af490 con 0x55d37a67c1b0 2024-04-23T15:12:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.407+0000 7ff75c01b740 10 client.0 _ll_register_callbacks cb 0x7ff744009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 0x55d37a68aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 0x55d37a68aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34508/0 (socket says 172.21.15.7:34508) 2024-04-23T15:12:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 -- 172.21.15.7:0/3612979581 learned_addr learned my addr 172.21.15.7:0/3612979581 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff752800640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a68af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751e00640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67c1b0 0x55d37a68f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 -- 172.21.15.7:0/3612979581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67c1b0 msgr2=0x55d37a68f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67c1b0 0x55d37a68f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 -- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 msgr2=0x55d37a68af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a68af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.408+0000 7ff751400640 1 -- 172.21.15.7:0/3612979581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d37a68b6b0 con 0x55d37a67cad0 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.409+0000 7ff751400640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 0x55d37a68aa30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff73c09c1b0 tx=0x7ff73c00d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bcd12927a03f0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.409+0000 7ff73be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.409+0000 7ff73be00640 1 -- 172.21.15.7:0/3612979581 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c020040 con 0x55d37a67cad0 2024-04-23T15:12:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.409+0000 7ff73be00640 1 -- 172.21.15.7:0/3612979581 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7ff73c0cdc50 con 0x55d37a67cad0 2024-04-23T15:12:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.409+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff74403b630 con 0x55d37a67cad0 2024-04-23T15:12:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.410+0000 7ff73be00640 1 -- 172.21.15.7:0/3612979581 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff73c0cde50 con 0x55d37a67cad0 2024-04-23T15:12:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.410+0000 7ff75c01b740 10 client.17349 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:22.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.410+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d37a6fd940 con 0x55d37a67cad0 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.410+0000 7ff73be00640 1 -- 172.21.15.7:0/3612979581 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff74403b630 con 0x55d37a67cad0 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.410+0000 7ff73be00640 1 -- 172.21.15.7:0/3612979581 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff73c0a0170 con 0x55d37a67cad0 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.411+0000 7ff75c01b740 10 client.17349 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.411+0000 7ff75c01b740 10 client.17349 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.411+0000 7ff75c01b740 20 client.17349 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.411+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a6fe0c0 0x55d37a7004e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:22.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.411+0000 7ff75c01b740 4 client.17349 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:12:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.411+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d37a5ea190 con 0x55d37a6fe0c0 2024-04-23T15:12:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.412+0000 7ff751e00640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a6fe0c0 0x55d37a7004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.413+0000 7ff751e00640 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a6fe0c0 0x55d37a7004e0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61a21af62ca95980 server_cookie=ce9ec7aa7a155b37 in_seq=0 out_seq=0 2024-04-23T15:12:22.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.413+0000 7ff73be00640 10 client.17349 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.449+0000 7ff73be00640 1 -- 172.21.15.7:0/3612979581 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d37a5ea190 con 0x55d37a6fe0c0 2024-04-23T15:12:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.449+0000 7ff73be00640 10 client.17349 handle_command_reply: tid=0 2024-04-23T15:12:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 client.17349 shutdown 2024-04-23T15:12:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 msgr2=0x55d37a68aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 0x55d37a68aa30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff73c09c1b0 tx=0x7ff73c00d6c0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 shutdown_connections 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d37a6fe0c0 0x55d37a7004e0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d37a687390 0x55d37a68af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d37a67cad0 0x55d37a68aa30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 --2- 172.21.15.7:0/3612979581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d37a67c1b0 0x55d37a68f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 >> 172.21.15.7:0/3612979581 conn(0x55d37a6786c0 msgr2=0x55d37a684290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff73be00640 0 client.17349 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 shutdown_connections 2024-04-23T15:12:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.450+0000 7ff75c01b740 1 -- 172.21.15.7:0/3612979581 wait complete. 2024-04-23T15:12:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.451+0000 7ff75c01b740 20 client.17349 trim_cache size 0 max 16384 2024-04-23T15:12:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:12:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:12:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:12:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:12:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7340a3dc0 msgr2=0x7ff7340a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7340a3dc0 0x7ff7340a6280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff744031440 tx=0x7ff744005a20 comp rx=0 tx=0).stop 2024-04-23T15:12:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 msgr2=0x7ff7541a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 0x7ff7541a0b90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00d740 tx=0x7ff73c00dc00 comp rx=0 tx=0).stop 2024-04-23T15:12:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 shutdown_connections 2024-04-23T15:12:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7340a3dc0 0x7ff7340a6280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff75419a760 0x7ff75419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff754109520 0x7ff7541a0b90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 --2- 172.21.15.7:0/1744883874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff754104450 0x7ff7541a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 >> 172.21.15.7:0/1744883874 conn(0x7ff7540ffcf0 msgr2=0x7ff754102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 shutdown_connections 2024-04-23T15:12:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:22.452+0000 7ff759200640 1 -- 172.21.15.7:0/1744883874 wait complete. 2024-04-23T15:12:22.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:22 smithi007 ceph-mon[27906]: pgmap v661: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-04-23T15:12:22.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:22 smithi186 ceph-mon[31814]: pgmap v661: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-04-23T15:12:22.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:22 smithi137 ceph-mon[31694]: pgmap v661: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-04-23T15:12:24.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:24 smithi007 ceph-mon[27906]: pgmap v662: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-04-23T15:12:24.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:24 smithi186 ceph-mon[31814]: pgmap v662: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-04-23T15:12:24.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:24 smithi137 ceph-mon[31694]: pgmap v662: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-04-23T15:12:26.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:26 smithi007 ceph-mon[27906]: pgmap v663: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-04-23T15:12:26.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:26 smithi186 ceph-mon[31814]: pgmap v663: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-04-23T15:12:26.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:26 smithi137 ceph-mon[31694]: pgmap v663: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 13 op/s 2024-04-23T15:12:28.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:28 smithi007 ceph-mon[27906]: pgmap v664: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 20 op/s 2024-04-23T15:12:28.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:28 smithi186 ceph-mon[31814]: pgmap v664: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 20 op/s 2024-04-23T15:12:28.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:28 smithi137 ceph-mon[31694]: pgmap v664: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 20 op/s 2024-04-23T15:12:30.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:30 smithi007 ceph-mon[27906]: pgmap v665: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:30.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:30 smithi186 ceph-mon[31814]: pgmap v665: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:30.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:30 smithi137 ceph-mon[31694]: pgmap v665: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:32.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:32 smithi007 ceph-mon[27906]: pgmap v666: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:32.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:32 smithi186 ceph-mon[31814]: pgmap v666: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:32.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:32 smithi137 ceph-mon[31694]: pgmap v666: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:12:34.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:34 smithi007 ceph-mon[27906]: pgmap v667: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:12:34.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:34 smithi186 ceph-mon[31814]: pgmap v667: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:12:34.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:34 smithi137 ceph-mon[31694]: pgmap v667: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:12:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 -- 172.21.15.7:0/3423363815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105410c430 msgr2=0x7f105410e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 --2- 172.21.15.7:0/3423363815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105410c430 0x7f105410e880 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f104c009ca0 tx=0x7f104c02a950 comp rx=0 tx=0).stop 2024-04-23T15:12:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 -- 172.21.15.7:0/3423363815 shutdown_connections 2024-04-23T15:12:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 --2- 172.21.15.7:0/3423363815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054103980 0x7f105410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 --2- 172.21.15.7:0/3423363815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105410c430 0x7f105410e880 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 --2- 172.21.15.7:0/3423363815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1054103060 0x7f1054103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 -- 172.21.15.7:0/3423363815 >> 172.21.15.7:0/3423363815 conn(0x7f10540fc820 msgr2=0x7f10540fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 -- 172.21.15.7:0/3423363815 shutdown_connections 2024-04-23T15:12:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.608+0000 7f1053200640 1 -- 172.21.15.7:0/3423363815 wait complete. 2024-04-23T15:12:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.609+0000 7f1053200640 1 Processor -- start 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.609+0000 7f1053200640 1 -- start start 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1053200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054103060 0x7f10541985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1053200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 0x7f1054198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1053200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105410c430 0x7f105419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1053200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1054112060 con 0x7f1054103980 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1053200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1054111ee0 con 0x7f1054103060 2024-04-23T15:12:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1053200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f10541121e0 con 0x7f105410c430 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1051400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 0x7f1054198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1051400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 0x7f1054198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47594/0 (socket says 172.21.15.7:47594) 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1051400640 1 -- 172.21.15.7:0/2669892127 learned_addr learned my addr 172.21.15.7:0/2669892127 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.610+0000 7f1051e00640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054103060 0x7f10541985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1052800640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105410c430 0x7f105419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1051400640 1 -- 172.21.15.7:0/2669892127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105410c430 msgr2=0x7f105419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1051400640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105410c430 0x7f105419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1051400640 1 -- 172.21.15.7:0/2669892127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054103060 msgr2=0x7f10541985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1051400640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054103060 0x7f10541985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1051400640 1 -- 172.21.15.7:0/2669892127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105419d5b0 con 0x7f1054103980 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1052800640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105410c430 0x7f105419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.611+0000 7f1051400640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 0x7f1054198b00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f104000d950 tx=0x7f104000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.612+0000 7f104aa00640 1 -- 172.21.15.7:0/2669892127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040017030 con 0x7f1054103980 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.612+0000 7f104aa00640 1 -- 172.21.15.7:0/2669892127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1040004020 con 0x7f1054103980 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.612+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105419d8a0 con 0x7f1054103980 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.612+0000 7f104aa00640 1 -- 172.21.15.7:0/2669892127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400047a0 con 0x7f1054103980 2024-04-23T15:12:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.612+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541a5130 con 0x7f1054103980 2024-04-23T15:12:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.616+0000 7f105ba1e740 1 Processor -- start 2024-04-23T15:12:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.616+0000 7f105ba1e740 1 -- start start 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b230bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230c0f0 0x55f1b2316470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2318da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f105ba1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1b226d900 con 0x55f1b230b7d0 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f105ba1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2213f20 con 0x55f1b230c0f0 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f105ba1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f1b22698c0 con 0x55f1b23169b0 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f104aa00640 1 -- 172.21.15.7:0/2669892127 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f10400041d0 con 0x7f1054103980 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f1052800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b230bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f1052800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b230bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47604/0 (socket says 172.21.15.7:47604) 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.617+0000 7f1052800640 1 -- 172.21.15.7:0/2677879987 learned_addr learned my addr 172.21.15.7:0/2677879987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1051e00640 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230c0f0 0x55f1b2316470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1051400640 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2318da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1052800640 1 -- 172.21.15.7:0/2677879987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 msgr2=0x55f1b2318da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1052800640 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2318da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1052800640 1 -- 172.21.15.7:0/2677879987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230c0f0 msgr2=0x55f1b2316470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1052800640 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230c0f0 0x55f1b2316470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1052800640 1 -- 172.21.15.7:0/2677879987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b2238e10 con 0x55f1b230b7d0 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1051400640 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2318da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:12:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.618+0000 7f1052800640 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b230bbb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f104c02fdf0 tx=0x7f104c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaf57db18a61fac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.619+0000 7f103f000640 1 -- 172.21.15.7:0/2677879987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c034040 con 0x55f1b230b7d0 2024-04-23T15:12:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.619+0000 7f103f000640 1 -- 172.21.15.7:0/2677879987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f104c003e20 con 0x55f1b230b7d0 2024-04-23T15:12:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.619+0000 7f103f000640 1 -- 172.21.15.7:0/2677879987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0043c0 con 0x55f1b230b7d0 2024-04-23T15:12:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.619+0000 7f104aa00640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f10380a3d90 0x7f10380a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.619+0000 7f104aa00640 1 -- 172.21.15.7:0/2669892127 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f10400d0540 con 0x7f1054103980 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f1051e00640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f10380a3d90 0x7f10380a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 -- 172.21.15.7:0/2677879987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 msgr2=0x55f1b230bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b230bbb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f104c02fdf0 tx=0x7f104c009a20 comp rx=0 tx=0).stop 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 -- 172.21.15.7:0/2677879987 shutdown_connections 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230c0f0 0x55f1b2316470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2318da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2677879987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b230bbb0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 -- 172.21.15.7:0/2677879987 >> 172.21.15.7:0/2677879987 conn(0x55f1b2307ce0 msgr2=0x55f1b23080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.620+0000 7f105ba1e740 1 -- 172.21.15.7:0/2677879987 shutdown_connections 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.621+0000 7f105ba1e740 1 -- 172.21.15.7:0/2677879987 wait complete. 2024-04-23T15:12:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.621+0000 7f1051e00640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f10380a3d90 0x7f10380a6250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f1b230cd70 tx=0x7f104400b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.621+0000 7f105ba1e740 1 -- start start 2024-04-23T15:12:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.621+0000 7f105ba1e740 1 Processor -- start 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b23161b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b230c0f0 0x55f1b230f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b23169b0 0x55f1b230fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2319580 con 0x55f1b230b7d0 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1b22272c0 con 0x55f1b23169b0 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2319700 con 0x55f1b230c0f0 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f105ba1e740 10 client.0 _ll_register_callbacks cb 0x55f1b1f7fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.622+0000 7f1051e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b23161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b23161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47610/0 (socket says 172.21.15.7:47610) 2024-04-23T15:12:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 -- 172.21.15.7:0/2239152338 learned_addr learned my addr 172.21.15.7:0/2239152338 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051400640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b230c0f0 0x55f1b230f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1052800640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b23169b0 0x55f1b230fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 -- 172.21.15.7:0/2239152338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b230c0f0 msgr2=0x55f1b230f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b230c0f0 0x55f1b230f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 -- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b23169b0 msgr2=0x55f1b230fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b23169b0 0x55f1b230fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 -- 172.21.15.7:0/2239152338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b2237fd0 con 0x55f1b230b7d0 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1051e00640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b23161b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1044003d40 tx=0x7f10440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da26230712f62547 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.623+0000 7f1033400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f1033400640 1 -- 172.21.15.7:0/2239152338 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104401b660 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f1033400640 1 -- 172.21.15.7:0/2239152338 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f104401b800 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104c003e20 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f1033400640 1 -- 172.21.15.7:0/2239152338 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f104401ba00 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f105ba1e740 10 client.17361 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f1b1f80210 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.624+0000 7f1033400640 1 -- 172.21.15.7:0/2239152338 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f104c003e20 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f1033400640 1 -- 172.21.15.7:0/2239152338 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1044024070 con 0x55f1b230b7d0 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f105ba1e740 10 client.17361 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f105ba1e740 10 client.17361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f105ba1e740 20 client.17361 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b232ae30 0x55f1b232d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f105ba1e740 4 client.17361 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:12:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.625+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1b227b320 con 0x55f1b232ae30 2024-04-23T15:12:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.626+0000 7f1051400640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b232ae30 0x55f1b232d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.626+0000 7f1051400640 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b232ae30 0x55f1b232d280 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbc91444cdab95 server_cookie=f20bf6af16b4a600 in_seq=0 out_seq=0 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.626+0000 7f1033400640 10 client.17361 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.628+0000 7f1033400640 1 -- 172.21.15.7:0/2239152338 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1b227b320 con 0x55f1b232ae30 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.628+0000 7f1033400640 10 client.17361 handle_command_reply: tid=0 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.628+0000 7f105ba1e740 1 client.17361 shutdown 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 msgr2=0x55f1b23161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b23161b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1044003d40 tx=0x7f10440046c0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 shutdown_connections 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b232ae30 0x55f1b232d280 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b23169b0 0x55f1b230fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b230c0f0 0x55f1b230f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 --2- 172.21.15.7:0/2239152338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230b7d0 0x55f1b23161b0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 >> 172.21.15.7:0/2239152338 conn(0x55f1b2307ce0 msgr2=0x55f1b230d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f1033400640 0 client.17361 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 shutdown_connections 2024-04-23T15:12:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 1 -- 172.21.15.7:0/2239152338 wait complete. 2024-04-23T15:12:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.629+0000 7f105ba1e740 20 client.17361 trim_cache size 0 max 16384 2024-04-23T15:12:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.648+0000 7f105ba1e740 1 Processor -- start 2024-04-23T15:12:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.648+0000 7f105ba1e740 1 -- start start 2024-04-23T15:12:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b2303210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b230da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2313420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f105ba1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10541ad090 con 0x55f1b230c0f0 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f105ba1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10541aebd0 con 0x55f1b230b7d0 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f105ba1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f10541ad760 con 0x55f1b23169b0 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f1051400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b230da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f1051400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b230da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47622/0 (socket says 172.21.15.7:47622) 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f1051400640 1 -- 172.21.15.7:0/1617934302 learned_addr learned my addr 172.21.15.7:0/1617934302 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f1051e00640 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b2303210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.649+0000 7f1052800640 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2313420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f1051400640 1 -- 172.21.15.7:0/1617934302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 msgr2=0x55f1b2313420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f1051400640 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2313420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f1051400640 1 -- 172.21.15.7:0/1617934302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 msgr2=0x55f1b2303210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f1051400640 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b2303210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f1051400640 1 -- 172.21.15.7:0/1617934302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b230bf20 con 0x55f1b230c0f0 2024-04-23T15:12:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f1051400640 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b230da10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f10400cdee0 tx=0x7f10400d2a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f0de1e0d4be5a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f103e600640 1 -- 172.21.15.7:0/1617934302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104009c830 con 0x55f1b230c0f0 2024-04-23T15:12:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f103e600640 1 -- 172.21.15.7:0/1617934302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f104009c130 con 0x55f1b230c0f0 2024-04-23T15:12:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.650+0000 7f103e600640 1 -- 172.21.15.7:0/1617934302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400987a0 con 0x55f1b230c0f0 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 -- 172.21.15.7:0/1617934302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 msgr2=0x55f1b230da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b230da10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f10400cdee0 tx=0x7f10400d2a50 comp rx=0 tx=0).stop 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 -- 172.21.15.7:0/1617934302 shutdown_connections 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2313420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b230da10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1617934302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b2303210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.651+0000 7f105ba1e740 1 -- 172.21.15.7:0/1617934302 >> 172.21.15.7:0/1617934302 conn(0x55f1b2307ce0 msgr2=0x55f1b2312d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.652+0000 7f105ba1e740 1 -- 172.21.15.7:0/1617934302 shutdown_connections 2024-04-23T15:12:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.652+0000 7f105ba1e740 1 -- 172.21.15.7:0/1617934302 wait complete. 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.652+0000 7f105ba1e740 1 -- start start 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.652+0000 7f105ba1e740 1 Processor -- start 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b238a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b238ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2323320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10541ae500 con 0x55f1b230c0f0 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10541ade30 con 0x55f1b230b7d0 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f10541ab090 con 0x55f1b23169b0 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f105ba1e740 10 client.0 _ll_register_callbacks cb 0x7f1044004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f1051400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b238ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f1051400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b238ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47628/0 (socket says 172.21.15.7:47628) 2024-04-23T15:12:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f1051400640 1 -- 172.21.15.7:0/1139211485 learned_addr learned my addr 172.21.15.7:0/1139211485 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.653+0000 7f1051e00640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b238a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1052800640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2323320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051400640 1 -- 172.21.15.7:0/1139211485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 msgr2=0x55f1b2323320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051400640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2323320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051400640 1 -- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 msgr2=0x55f1b238a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051400640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b238a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051400640 1 -- 172.21.15.7:0/1139211485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b204c620 con 0x55f1b230c0f0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051e00640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b238a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1051400640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b238ac50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f1040005170 tx=0x7f10400a0170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde3096231714001 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1033400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1033400640 1 -- 172.21.15.7:0/1139211485 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400b9020 con 0x55f1b230c0f0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1033400640 1 -- 172.21.15.7:0/1139211485 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f10400987a0 con 0x55f1b230c0f0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104009c130 con 0x55f1b230c0f0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.654+0000 7f1033400640 1 -- 172.21.15.7:0/1139211485 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f10400a4da0 con 0x55f1b230c0f0 2024-04-23T15:12:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 10 client.17367 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f1b2391cf0 con 0x55f1b230c0f0 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f1033400640 1 -- 172.21.15.7:0/1139211485 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f104009c130 con 0x55f1b230c0f0 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f1033400640 1 -- 172.21.15.7:0/1139211485 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f10400bc040 con 0x55f1b230c0f0 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 10 client.17367 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 10 client.17367 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 20 client.17367 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b2392410 0x55f1b2394830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 4 client.17367 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:12:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.655+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1b2327fe0 con 0x55f1b2392410 2024-04-23T15:12:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.656+0000 7f1051e00640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b2392410 0x55f1b2394830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.657+0000 7f1051e00640 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b2392410 0x55f1b2394830 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9af9fad0b7c7aaa server_cookie=22ef2dcffd955542 in_seq=0 out_seq=0 2024-04-23T15:12:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.657+0000 7f1033400640 10 client.17367 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:35.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.691+0000 7f1033400640 1 -- 172.21.15.7:0/1139211485 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1b2327fe0 con 0x55f1b2392410 2024-04-23T15:12:35.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.691+0000 7f1033400640 10 client.17367 handle_command_reply: tid=0 2024-04-23T15:12:35.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.691+0000 7f105ba1e740 1 client.17367 shutdown 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.691+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 msgr2=0x55f1b238ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b238ac50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f1040005170 tx=0x7f10400a0170 comp rx=0 tx=0).stop 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 shutdown_connections 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1b2392410 0x55f1b2394830 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1b23169b0 0x55f1b2323320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b230c0f0 0x55f1b238ac50 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f1033400640 0 client.17367 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 --2- 172.21.15.7:0/1139211485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1b230b7d0 0x55f1b238a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 >> 172.21.15.7:0/1139211485 conn(0x55f1b2307ce0 msgr2=0x55f1b2312d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 shutdown_connections 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 1 -- 172.21.15.7:0/1139211485 wait complete. 2024-04-23T15:12:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.692+0000 7f105ba1e740 20 client.17367 trim_cache size 0 max 16384 2024-04-23T15:12:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:12:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:12:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:12:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f10380a3d90 msgr2=0x7f10380a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f10380a3d90 0x7f10380a6250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f1b230cd70 tx=0x7f104400b390 comp rx=0 tx=0).stop 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 msgr2=0x7f1054198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 0x7f1054198b00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f104000d950 tx=0x7f104000de10 comp rx=0 tx=0).stop 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 shutdown_connections 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f10380a3d90 0x7f10380a6250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105410c430 0x7f105419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1054103980 0x7f1054198b00 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 --2- 172.21.15.7:0/2669892127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054103060 0x7f10541985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 >> 172.21.15.7:0/2669892127 conn(0x7f10540fc820 msgr2=0x7f10540fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.693+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 shutdown_connections 2024-04-23T15:12:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:35.694+0000 7f1053200640 1 -- 172.21.15.7:0/2669892127 wait complete. 2024-04-23T15:12:36.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:36 smithi007 ceph-mon[27906]: pgmap v668: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:12:36.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:36 smithi186 ceph-mon[31814]: pgmap v668: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:12:36.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:36 smithi137 ceph-mon[31694]: pgmap v668: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:12:38.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:38 smithi007 ceph-mon[27906]: pgmap v669: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:12:38.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:38 smithi186 ceph-mon[31814]: pgmap v669: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:12:38.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:38 smithi137 ceph-mon[31694]: pgmap v669: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:12:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:40 smithi007 ceph-mon[27906]: pgmap v670: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:40.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:40 smithi186 ceph-mon[31814]: pgmap v670: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:40.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:40 smithi137 ceph-mon[31694]: pgmap v670: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:42.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:42 smithi007 ceph-mon[27906]: pgmap v671: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:42.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:42 smithi186 ceph-mon[31814]: pgmap v671: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:42.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:42 smithi137 ceph-mon[31694]: pgmap v671: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:44 smithi007 ceph-mon[27906]: pgmap v672: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:12:44.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:44 smithi186 ceph-mon[31814]: pgmap v672: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:12:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:44 smithi137 ceph-mon[31694]: pgmap v672: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:12:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:46 smithi137 ceph-mon[31694]: pgmap v673: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:12:47.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:46 smithi007 ceph-mon[27906]: pgmap v673: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:12:47.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:46 smithi186 ceph-mon[31814]: pgmap v673: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:12:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3514705307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc1042a0 msgr2=0x7f7cdc104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3514705307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc1042a0 0x7f7cdc104680 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009900 tx=0x7f7cd002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3514705307 shutdown_connections 2024-04-23T15:12:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3514705307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cdc104c50 0x7f7cdc108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3514705307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cdc109370 0x7f7cdc110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3514705307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc1042a0 0x7f7cdc104680 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3514705307 >> 172.21.15.7:0/3514705307 conn(0x7f7cdc0ffae0 msgr2=0x7f7cdc101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3514705307 shutdown_connections 2024-04-23T15:12:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.850+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3514705307 wait complete. 2024-04-23T15:12:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.851+0000 7f7ce2e00640 1 Processor -- start 2024-04-23T15:12:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 -- start start 2024-04-23T15:12:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cdc1042a0 0x7f7cdc1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cdc109370 0x7f7cdc1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 0x7f7cdc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc114330 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1141b0 con 0x7f7cdc109370 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1144b0 con 0x7f7cdc1042a0 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.852+0000 7f7ce2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 0x7f7cdc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 0x7f7cdc19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50250/0 (socket says 172.21.15.7:50250) 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 -- 172.21.15.7:0/3397852450 learned_addr learned my addr 172.21.15.7:0/3397852450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce1000640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cdc109370 0x7f7cdc1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cdc1042a0 0x7f7cdc1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 -- 172.21.15.7:0/3397852450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cdc1042a0 msgr2=0x7f7cdc1a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cdc1042a0 0x7f7cdc1a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 -- 172.21.15.7:0/3397852450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cdc109370 msgr2=0x7f7cdc1a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cdc109370 0x7f7cdc1a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 -- 172.21.15.7:0/3397852450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc19b2b0 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.853+0000 7f7ce2400640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 0x7f7cdc19ab30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400eaa0 tx=0x7f7cd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.854+0000 7f7cda000640 1 -- 172.21.15.7:0/3397852450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400cdb0 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.854+0000 7f7cda000640 1 -- 172.21.15.7:0/3397852450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cd4005020 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.854+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc1a7390 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.854+0000 7f7cda000640 1 -- 172.21.15.7:0/3397852450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40116d0 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.854+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1a77f0 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.858+0000 7f7ce726e740 1 Processor -- start 2024-04-23T15:12:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.858+0000 7f7cda000640 1 -- 172.21.15.7:0/3397852450 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7cd40051d0 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.858+0000 7f7ce726e740 1 -- start start 2024-04-23T15:12:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cbc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce726e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564d37c22900 con 0x564d37cc75a0 2024-04-23T15:12:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce726e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d37bc8f20 con 0x564d37cbcce0 2024-04-23T15:12:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce726e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564d37c1e8c0 con 0x564d37cbc3c0 2024-04-23T15:12:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50254/0 (socket says 172.21.15.7:50254) 2024-04-23T15:12:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.859+0000 7f7ce1000640 1 -- 172.21.15.7:0/1168244046 learned_addr learned my addr 172.21.15.7:0/1168244046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1000640 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cbc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1000640 1 -- 172.21.15.7:0/1168244046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 msgr2=0x564d37cbc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1000640 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cbc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7cda000640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cc40a3d90 0x7f7cc40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1000640 1 -- 172.21.15.7:0/1168244046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 msgr2=0x564d37cc7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1000640 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce1000640 1 -- 172.21.15.7:0/1168244046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d37bede10 con 0x564d37cc75a0 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7cda000640 1 -- 172.21.15.7:0/3397852450 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f7cd40d0d70 con 0x7f7cdc19a6b0 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.860+0000 7f7ce2400640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cc40a3d90 0x7f7cc40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.861+0000 7f7ce1000640 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc9990 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8014990 tx=0x7f7cc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373a2f6cbd173875 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.861+0000 7f7ccea00640 1 -- 172.21.15.7:0/1168244046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80142d0 con 0x564d37cc75a0 2024-04-23T15:12:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.861+0000 7f7ccea00640 1 -- 172.21.15.7:0/1168244046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cc800fc10 con 0x564d37cc75a0 2024-04-23T15:12:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.861+0000 7f7ccea00640 1 -- 172.21.15.7:0/1168244046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8012950 con 0x564d37cc75a0 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 -- 172.21.15.7:0/1168244046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 msgr2=0x564d37cc9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce2400640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cc40a3d90 0x7f7cc40a6250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40092f0 tx=0x7f7cd400cf50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc9990 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8014990 tx=0x7f7cc800c490 comp rx=0 tx=0).stop 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 -- 172.21.15.7:0/1168244046 shutdown_connections 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc9990 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 --2- 172.21.15.7:0/1168244046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cbc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 -- 172.21.15.7:0/1168244046 >> 172.21.15.7:0/1168244046 conn(0x564d37cb88d0 msgr2=0x564d37cb8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 -- 172.21.15.7:0/1168244046 shutdown_connections 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.862+0000 7f7ce726e740 1 -- 172.21.15.7:0/1168244046 wait complete. 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.863+0000 7f7ce726e740 1 -- start start 2024-04-23T15:12:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.863+0000 7f7ce726e740 1 Processor -- start 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.863+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.863+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.863+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce726e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564d37cca0e0 con 0x564d37cc75a0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce726e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d37bdc2c0 con 0x564d37cbcce0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce726e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564d37cca260 con 0x564d37cbc3c0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce726e740 10 client.0 _ll_register_callbacks cb 0x564d37934a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50266/0 (socket says 172.21.15.7:50266) 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 -- 172.21.15.7:0/2725261066 learned_addr learned my addr 172.21.15.7:0/2725261066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 -- 172.21.15.7:0/2725261066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 msgr2=0x564d37cc4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 -- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 msgr2=0x564d37cc4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.864+0000 7f7ce1000640 1 -- 172.21.15.7:0/2725261066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d37becfd0 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc50c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8014fd0 tx=0x7f7cc8014560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e49d7658a93e365 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7cc3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7cc3400640 1 -- 172.21.15.7:0/2725261066 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800fdc0 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7cc3400640 1 -- 172.21.15.7:0/2725261066 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f7cc800f760 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cc800fc10 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7cc3400640 1 -- 172.21.15.7:0/2725261066 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7cc800f960 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7ce726e740 10 client.17379 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.865+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564d37935210 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7cc3400640 1 -- 172.21.15.7:0/2725261066 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cc800fc10 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7cc3400640 1 -- 172.21.15.7:0/2725261066 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7cc8012b50 con 0x564d37cc75a0 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7ce726e740 10 client.17379 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7ce726e740 10 client.17379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7ce726e740 20 client.17379 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37cd76a0 0x564d37cd9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7ce726e740 4 client.17379 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.866+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d37c30320 con 0x564d37cd76a0 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.867+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37cd76a0 0x564d37cd9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.868+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37cd76a0 0x564d37cd9a90 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5deb42d68936be16 server_cookie=12d34d1d918ab7fd in_seq=0 out_seq=0 2024-04-23T15:12:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.868+0000 7f7cc3400640 10 client.17379 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7cc3400640 1 -- 172.21.15.7:0/2725261066 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564d37c30320 con 0x564d37cd76a0 2024-04-23T15:12:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7cc3400640 10 client.17379 handle_command_reply: tid=0 2024-04-23T15:12:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 client.17379 shutdown 2024-04-23T15:12:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 msgr2=0x564d37cc50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc50c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8014fd0 tx=0x7f7cc8014560 comp rx=0 tx=0).stop 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 shutdown_connections 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37cd76a0 0x564d37cd9a90 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc75a0 0x564d37cc50c0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2725261066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 >> 172.21.15.7:0/2725261066 conn(0x564d37cb88d0 msgr2=0x564d37cbe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7cc3400640 0 client.17379 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 shutdown_connections 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 1 -- 172.21.15.7:0/2725261066 wait complete. 2024-04-23T15:12:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.870+0000 7f7ce726e740 20 client.17379 trim_cache size 0 max 16384 2024-04-23T15:12:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.888+0000 7f7ce726e740 1 Processor -- start 2024-04-23T15:12:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.888+0000 7f7ce726e740 1 -- start start 2024-04-23T15:12:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37cbed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce726e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b1550 con 0x564d37cc3df0 2024-04-23T15:12:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce726e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b3090 con 0x564d37cbcce0 2024-04-23T15:12:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce726e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b1c20 con 0x564d37cbc3c0 2024-04-23T15:12:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37cbed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37cbed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50276/0 (socket says 172.21.15.7:50276) 2024-04-23T15:12:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce1000640 1 -- 172.21.15.7:0/2806498672 learned_addr learned my addr 172.21.15.7:0/2806498672 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.889+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 -- 172.21.15.7:0/2806498672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 msgr2=0x564d37cc6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 -- 172.21.15.7:0/2806498672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 msgr2=0x564d37cc50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 -- 172.21.15.7:0/2806498672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d37a01620 con 0x564d37cc3df0 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7ce1000640 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37cbed50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8003760 tx=0x7f7cc80037e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619ceaeb0393d54d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.890+0000 7f7cce000640 1 -- 172.21.15.7:0/2806498672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800c950 con 0x564d37cc3df0 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.891+0000 7f7cce000640 1 -- 172.21.15.7:0/2806498672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cc8024070 con 0x564d37cc3df0 2024-04-23T15:12:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.891+0000 7f7cce000640 1 -- 172.21.15.7:0/2806498672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8003cc0 con 0x564d37cc3df0 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.891+0000 7f7ce726e740 1 -- 172.21.15.7:0/2806498672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 msgr2=0x564d37cbed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.891+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37cbed50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8003760 tx=0x7f7cc80037e0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 -- 172.21.15.7:0/2806498672 shutdown_connections 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbcce0 0x564d37cc50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37cbed50 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 --2- 172.21.15.7:0/2806498672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbc3c0 0x564d37cc6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 -- 172.21.15.7:0/2806498672 >> 172.21.15.7:0/2806498672 conn(0x564d37cb88d0 msgr2=0x564d37cb7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 -- 172.21.15.7:0/2806498672 shutdown_connections 2024-04-23T15:12:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 -- 172.21.15.7:0/2806498672 wait complete. 2024-04-23T15:12:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.892+0000 7f7ce726e740 1 -- start start 2024-04-23T15:12:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 Processor -- start 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbc3c0 0x564d37ccf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbcce0 0x564d37ccad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37ccb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b29c0 con 0x564d37cc3df0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b22f0 con 0x564d37cbc3c0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1af550 con 0x564d37cbcce0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce726e740 10 client.0 _ll_register_callbacks cb 0x7f7cd0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.893+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37ccb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37ccb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50292/0 (socket says 172.21.15.7:50292) 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 -- 172.21.15.7:0/492265554 learned_addr learned my addr 172.21.15.7:0/492265554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbc3c0 0x564d37ccf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbcce0 0x564d37ccad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 -- 172.21.15.7:0/492265554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbcce0 msgr2=0x564d37ccad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbcce0 0x564d37ccad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 -- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbc3c0 msgr2=0x564d37ccf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbc3c0 0x564d37ccf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 -- 172.21.15.7:0/492265554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d37ccba80 con 0x564d37cc3df0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7ce1000640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37ccb280 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80037b0 tx=0x7f7cc80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a748ca449b6879 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.894+0000 7f7cc3400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7cc3400640 1 -- 172.21.15.7:0/492265554 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800fb00 con 0x564d37cc3df0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7cc3400640 1 -- 172.21.15.7:0/492265554 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f7cc800fca0 con 0x564d37cc3df0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cc8024070 con 0x564d37cc3df0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7cc3400640 1 -- 172.21.15.7:0/492265554 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7cc8005020 con 0x564d37cc3df0 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7ce726e740 10 client.17385 fetch_fsmap learned FSMap version 32 2024-04-23T15:12:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564d37d3d910 con 0x564d37cc3df0 2024-04-23T15:12:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.895+0000 7f7cc3400640 1 -- 172.21.15.7:0/492265554 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cc8024070 con 0x564d37cc3df0 2024-04-23T15:12:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7cc3400640 1 -- 172.21.15.7:0/492265554 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7cc8044040 con 0x564d37cc3df0 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7ce726e740 10 client.17385 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7ce726e740 10 client.17385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7ce726e740 20 client.17385 populate_metadata read hostname 'smithi007' 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7ce726e740 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37d3dec0 0x564d37d402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7ce726e740 4 client.17385 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.896+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d37c2a190 con 0x564d37d3dec0 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.897+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37d3dec0 0x564d37d402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.897+0000 7f7ce1a00640 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37d3dec0 0x564d37d402b0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fd387693170e5c4 server_cookie=db9803c1c3e0cdd1 in_seq=0 out_seq=0 2024-04-23T15:12:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.898+0000 7f7cc3400640 10 client.17385 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:48.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:48 smithi137 ceph-mon[31694]: pgmap v674: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7cc3400640 1 -- 172.21.15.7:0/492265554 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d37c2a190 con 0x564d37d3dec0 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7cc3400640 10 client.17385 handle_command_reply: tid=0 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 client.17385 shutdown 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 msgr2=0x564d37ccb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37ccb280 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80037b0 tx=0x7f7cc80038a0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 shutdown_connections 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564d37d3dec0 0x564d37d402b0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d37cc3df0 0x564d37ccb280 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564d37cbcce0 0x564d37ccad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 --2- 172.21.15.7:0/492265554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d37cbc3c0 0x564d37ccf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 >> 172.21.15.7:0/492265554 conn(0x564d37cb88d0 msgr2=0x564d37cc2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.937+0000 7f7cc3400640 0 client.17385 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.938+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 shutdown_connections 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.938+0000 7f7ce726e740 1 -- 172.21.15.7:0/492265554 wait complete. 2024-04-23T15:12:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.938+0000 7f7ce726e740 20 client.17385 trim_cache size 0 max 16384 2024-04-23T15:12:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:12:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:12:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:12:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cc40a3d90 msgr2=0x7f7cc40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cc40a3d90 0x7f7cc40a6250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40092f0 tx=0x7f7cd400cf50 comp rx=0 tx=0).stop 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 msgr2=0x7f7cdc19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 0x7f7cdc19ab30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400eaa0 tx=0x7f7cd400ef60 comp rx=0 tx=0).stop 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 shutdown_connections 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cc40a3d90 0x7f7cc40a6250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cdc109370 0x7f7cdc1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc19a6b0 0x7f7cdc19ab30 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 --2- 172.21.15.7:0/3397852450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cdc1042a0 0x7f7cdc1a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:12:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 >> 172.21.15.7:0/3397852450 conn(0x7f7cdc0ffae0 msgr2=0x7f7cdc100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:12:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 shutdown_connections 2024-04-23T15:12:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:12:48.939+0000 7f7ce2e00640 1 -- 172.21.15.7:0/3397852450 wait complete. 2024-04-23T15:12:49.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:48 smithi007 ceph-mon[27906]: pgmap v674: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:12:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:48 smithi186 ceph-mon[31814]: pgmap v674: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:12:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:50 smithi137 ceph-mon[31694]: pgmap v675: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:12:51.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:50 smithi007 ceph-mon[27906]: pgmap v675: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:12:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:50 smithi186 ceph-mon[31814]: pgmap v675: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:12:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:52 smithi137 ceph-mon[31694]: pgmap v676: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:12:53.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:52 smithi007 ceph-mon[27906]: pgmap v676: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:12:53.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:52 smithi186 ceph-mon[31814]: pgmap v676: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:12:54.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:54 smithi137 ceph-mon[31694]: pgmap v677: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:12:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:54 smithi007 ceph-mon[27906]: pgmap v677: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:12:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:54 smithi186 ceph-mon[31814]: pgmap v677: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:12:57.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:56 smithi007 ceph-mon[27906]: pgmap v678: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:56 smithi186 ceph-mon[31814]: pgmap v678: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:56 smithi137 ceph-mon[31694]: pgmap v678: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:12:59.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:12:58 smithi007 ceph-mon[27906]: pgmap v679: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:12:59.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:12:58 smithi186 ceph-mon[31814]: pgmap v679: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:12:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:12:58 smithi137 ceph-mon[31694]: pgmap v679: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:13:01.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:00 smithi007 ceph-mon[27906]: pgmap v680: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:01.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:00 smithi186 ceph-mon[31814]: pgmap v680: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:00 smithi137 ceph-mon[31694]: pgmap v680: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:02.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.094+0000 7f2d0fe00640 1 -- 172.21.15.7:0/4239123876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 msgr2=0x7f2d1010e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.094+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/4239123876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d1010e880 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009ca0 tx=0x7f2d0802a950 comp rx=0 tx=0).stop 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 -- 172.21.15.7:0/4239123876 shutdown_connections 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/4239123876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d101038e0 0x7f2d1010bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/4239123876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d1010e880 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/4239123876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d10102fc0 0x7f2d101033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 -- 172.21.15.7:0/4239123876 >> 172.21.15.7:0/4239123876 conn(0x7f2d100fc820 msgr2=0x7f2d100fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 -- 172.21.15.7:0/4239123876 shutdown_connections 2024-04-23T15:13:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.095+0000 7f2d0fe00640 1 -- 172.21.15.7:0/4239123876 wait complete. 2024-04-23T15:13:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.096+0000 7f2d0fe00640 1 Processor -- start 2024-04-23T15:13:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.096+0000 7f2d0fe00640 1 -- start start 2024-04-23T15:13:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.096+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d10102fc0 0x7f2d10100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.096+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d101038e0 0x7f2d10101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.096+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d10101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10112070 con 0x7f2d1010c3e0 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10111ef0 con 0x7f2d101038e0 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101121f0 con 0x7f2d10102fc0 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d10101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d10101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46802/0 (socket says 172.21.15.7:46802) 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 -- 172.21.15.7:0/273195996 learned_addr learned my addr 172.21.15.7:0/273195996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:02.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d10102fc0 0x7f2d10100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0e000640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d101038e0 0x7f2d10101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 -- 172.21.15.7:0/273195996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d10102fc0 msgr2=0x7f2d10100c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d10102fc0 0x7f2d10100c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 -- 172.21.15.7:0/273195996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d101038e0 msgr2=0x7f2d10101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d101038e0 0x7f2d10101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.097+0000 7f2d0f400640 1 -- 172.21.15.7:0/273195996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d101a6b10 con 0x7f2d1010c3e0 2024-04-23T15:13:02.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.098+0000 7f2d0f400640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d10101690 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2d0802ae70 tx=0x7f2d0802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:02.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.098+0000 7f2d07400640 1 -- 172.21.15.7:0/273195996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08034040 con 0x7f2d1010c3e0 2024-04-23T15:13:02.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.098+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d101a6da0 con 0x7f2d1010c3e0 2024-04-23T15:13:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.098+0000 7f2d07400640 1 -- 172.21.15.7:0/273195996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d080308f0 con 0x7f2d1010c3e0 2024-04-23T15:13:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.098+0000 7f2d07400640 1 -- 172.21.15.7:0/273195996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d080047f0 con 0x7f2d1010c3e0 2024-04-23T15:13:02.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.099+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d101a7280 con 0x7f2d1010c3e0 2024-04-23T15:13:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.103+0000 7f2d18a33740 1 Processor -- start 2024-04-23T15:13:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.103+0000 7f2d07400640 1 -- 172.21.15.7:0/273195996 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2d08037020 con 0x7f2d1010c3e0 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 -- start start 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 0x55e57ff637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff6e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff6e5a0 0x55e57ff70990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e57fec9900 con 0x55e57ff633c0 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e57fe6ff20 con 0x55e57ff63ce0 2024-04-23T15:13:02.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d18a33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e57fec58c0 con 0x55e57ff6e5a0 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.104+0000 7f2d0e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 0x55e57ff637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 0x55e57ff637a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46814/0 (socket says 172.21.15.7:46814) 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 -- 172.21.15.7:0/3062114020 learned_addr learned my addr 172.21.15.7:0/3062114020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff6e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff6e5a0 0x55e57ff70990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 -- 172.21.15.7:0/3062114020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff6e5a0 msgr2=0x55e57ff70990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff6e5a0 0x55e57ff70990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 -- 172.21.15.7:0/3062114020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 msgr2=0x55e57ff6e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff6e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d0e000640 1 -- 172.21.15.7:0/3062114020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57fe94e10 con 0x55e57ff633c0 2024-04-23T15:13:02.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.105+0000 7f2d07400640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2cf40a3d10 0x7f2cf40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.106+0000 7f2d07400640 1 -- 172.21.15.7:0/273195996 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f2d080f1b90 con 0x7f2d1010c3e0 2024-04-23T15:13:02.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.106+0000 7f2d0e000640 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 0x55e57ff637a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0058c0 tx=0x7f2cfc00b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b388c434e1f7396 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.106+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2cf40a3d10 0x7f2cf40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.106+0000 7f2cfbe00640 1 -- 172.21.15.7:0/3062114020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc019030 con 0x55e57ff633c0 2024-04-23T15:13:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.106+0000 7f2cfbe00640 1 -- 172.21.15.7:0/3062114020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2cfc005bf0 con 0x55e57ff633c0 2024-04-23T15:13:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.106+0000 7f2cfbe00640 1 -- 172.21.15.7:0/3062114020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc01d690 con 0x55e57ff633c0 2024-04-23T15:13:02.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 -- 172.21.15.7:0/3062114020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 msgr2=0x55e57ff637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2cf40a3d10 0x7f2cf40a61d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55e57ff64960 tx=0x7f2d0000b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 0x55e57ff637a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0058c0 tx=0x7f2cfc00b620 comp rx=0 tx=0).stop 2024-04-23T15:13:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 -- 172.21.15.7:0/3062114020 shutdown_connections 2024-04-23T15:13:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff6e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff6e5a0 0x55e57ff70990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 --2- 172.21.15.7:0/3062114020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff633c0 0x55e57ff637a0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 -- 172.21.15.7:0/3062114020 >> 172.21.15.7:0/3062114020 conn(0x55e57ff5f8d0 msgr2=0x55e57ff5fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:02.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.107+0000 7f2d18a33740 1 -- 172.21.15.7:0/3062114020 shutdown_connections 2024-04-23T15:13:02.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.108+0000 7f2d18a33740 1 -- 172.21.15.7:0/3062114020 wait complete. 2024-04-23T15:13:02.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.108+0000 7f2d18a33740 1 -- start start 2024-04-23T15:13:02.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.108+0000 7f2d18a33740 1 Processor -- start 2024-04-23T15:13:02.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff6b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 0x55e57ff6bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e57ff710e0 con 0x55e57ff63ce0 2024-04-23T15:13:02.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e57fe832c0 con 0x55e57ff6e5a0 2024-04-23T15:13:02.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e57ff71260 con 0x55e57ff633c0 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d18a33740 10 client.0 _ll_register_callbacks cb 0x55e57fbdba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d0e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 0x55e57ff6bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d0e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 0x55e57ff6bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46828/0 (socket says 172.21.15.7:46828) 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d0e000640 1 -- 172.21.15.7:0/2461867718 learned_addr learned my addr 172.21.15.7:0/2461867718 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff6b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.109+0000 7f2d0f400640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0e000640 1 -- 172.21.15.7:0/2461867718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 msgr2=0x55e57ff6b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0e000640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff6b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0e000640 1 -- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff6e5a0 msgr2=0x55e57ff6c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0e000640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0e000640 1 -- 172.21.15.7:0/2461867718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e57fe93fd0 con 0x55e57ff63ce0 2024-04-23T15:13:02.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0f400640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:02.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d0e000640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 0x55e57ff6bae0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc011f30 tx=0x7f2cfc0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6334b4362575679d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:02.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2cf8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:02.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2cf8c00640 1 -- 172.21.15.7:0/2461867718 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc019040 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2cf8c00640 1 -- 172.21.15.7:0/2461867718 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f2cfc0046c0 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.110+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e57fed7320 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2cf8c00640 1 -- 172.21.15.7:0/2461867718 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2cfc0048c0 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 10 client.17397 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e57fbdc210 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2cf8c00640 1 -- 172.21.15.7:0/2461867718 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e57fed7320 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2cf8c00640 1 -- 172.21.15.7:0/2461867718 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2cfc025020 con 0x55e57ff63ce0 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 10 client.17397 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 10 client.17397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 20 client.17397 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ff7e600 0x55e57ff809f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 4 client.17397 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:13:02.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.111+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e57fed1190 con 0x55e57ff7e600 2024-04-23T15:13:02.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.112+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ff7e600 0x55e57ff809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.113+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ff7e600 0x55e57ff809f0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffba6244cc2d8f65 server_cookie=bf93065d9cc4c2df in_seq=0 out_seq=0 2024-04-23T15:13:02.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.113+0000 7f2cf8c00640 10 client.17397 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2cf8c00640 1 -- 172.21.15.7:0/2461867718 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e57fed1190 con 0x55e57ff7e600 2024-04-23T15:13:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2cf8c00640 10 client.17397 handle_command_reply: tid=0 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 client.17397 shutdown 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 msgr2=0x55e57ff6bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 0x55e57ff6bae0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc011f30 tx=0x7f2cfc0052f0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 shutdown_connections 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ff7e600 0x55e57ff809f0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff63ce0 0x55e57ff6bae0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 --2- 172.21.15.7:0/2461867718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff6b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 >> 172.21.15.7:0/2461867718 conn(0x55e57ff5f8d0 msgr2=0x55e57ff65650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.115+0000 7f2cf8c00640 0 client.17397 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.116+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 shutdown_connections 2024-04-23T15:13:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.116+0000 7f2d18a33740 1 -- 172.21.15.7:0/2461867718 wait complete. 2024-04-23T15:13:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.116+0000 7f2d18a33740 20 client.17397 trim_cache size 0 max 16384 2024-04-23T15:13:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.134+0000 7f2d18a33740 1 Processor -- start 2024-04-23T15:13:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.134+0000 7f2d18a33740 1 -- start start 2024-04-23T15:13:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff633c0 0x55e57ff6dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff63ce0 0x55e57ff7a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d18a33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101b13f0 con 0x55e57ff6e5a0 2024-04-23T15:13:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d18a33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101b2f30 con 0x55e57ff633c0 2024-04-23T15:13:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d18a33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101b1ac0 con 0x55e57ff63ce0 2024-04-23T15:13:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46844/0 (socket says 172.21.15.7:46844) 2024-04-23T15:13:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d0f400640 1 -- 172.21.15.7:0/4186052646 learned_addr learned my addr 172.21.15.7:0/4186052646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d0e000640 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff63ce0 0x55e57ff7a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.135+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff633c0 0x55e57ff6dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2d0f400640 1 -- 172.21.15.7:0/4186052646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff63ce0 msgr2=0x55e57ff7a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2d0f400640 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff63ce0 0x55e57ff7a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2d0f400640 1 -- 172.21.15.7:0/4186052646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff633c0 msgr2=0x55e57ff6dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2d0f400640 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff633c0 0x55e57ff6dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2d0f400640 1 -- 172.21.15.7:0/4186052646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57fca8620 con 0x55e57ff6e5a0 2024-04-23T15:13:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2d0f400640 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6bc70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006010 tx=0x7f2d080bd600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1c3632afe7466c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2cfb400640 1 -- 172.21.15.7:0/4186052646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0802c040 con 0x55e57ff6e5a0 2024-04-23T15:13:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2cfb400640 1 -- 172.21.15.7:0/4186052646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d08004040 con 0x55e57ff6e5a0 2024-04-23T15:13:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.136+0000 7f2cfb400640 1 -- 172.21.15.7:0/4186052646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d080ef150 con 0x55e57ff6e5a0 2024-04-23T15:13:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 -- 172.21.15.7:0/4186052646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 msgr2=0x55e57ff6bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6bc70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006010 tx=0x7f2d080bd600 comp rx=0 tx=0).stop 2024-04-23T15:13:02.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 -- 172.21.15.7:0/4186052646 shutdown_connections 2024-04-23T15:13:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ff6bc70 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff63ce0 0x55e57ff7a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4186052646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff633c0 0x55e57ff6dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 -- 172.21.15.7:0/4186052646 >> 172.21.15.7:0/4186052646 conn(0x55e57ff5f8d0 msgr2=0x55e57ff6b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 -- 172.21.15.7:0/4186052646 shutdown_connections 2024-04-23T15:13:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.137+0000 7f2d18a33740 1 -- 172.21.15.7:0/4186052646 wait complete. 2024-04-23T15:13:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.138+0000 7f2d18a33740 1 -- start start 2024-04-23T15:13:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.138+0000 7f2d18a33740 1 Processor -- start 2024-04-23T15:13:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.138+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.138+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff71cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d18a33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ffe2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d18a33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101b2860 con 0x55e57ff6e5a0 2024-04-23T15:13:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d18a33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101b2190 con 0x55e57ff63ce0 2024-04-23T15:13:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d18a33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101af3f0 con 0x55e57ff633c0 2024-04-23T15:13:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d18a33740 10 client.0 _ll_register_callbacks cb 0x7f2d00004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ffe2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ffe2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46846/0 (socket says 172.21.15.7:46846) 2024-04-23T15:13:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 -- 172.21.15.7:0/4036866815 learned_addr learned my addr 172.21.15.7:0/4036866815 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0e000640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff71cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 -- 172.21.15.7:0/4036866815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 msgr2=0x55e57ff71770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff71770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 -- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 msgr2=0x55e57ff71cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.139+0000 7f2d0f400640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff71cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2d0f400640 1 -- 172.21.15.7:0/4036866815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e57ffe2ed0 con 0x55e57ff6e5a0 2024-04-23T15:13:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2d0f400640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ffe2990 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2d080c5f70 tx=0x7f2d080ba150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5538dc7d3b4552cb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2cf8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2cf8c00640 1 -- 172.21.15.7:0/4036866815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0802c040 con 0x55e57ff6e5a0 2024-04-23T15:13:02.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2cf8c00640 1 -- 172.21.15.7:0/4036866815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9467+0+0 (secure 0 0 0) 0x7f2d080bda90 con 0x55e57ff6e5a0 2024-04-23T15:13:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e57fe4d4b0 con 0x55e57ff6e5a0 2024-04-23T15:13:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2cf8c00640 1 -- 172.21.15.7:0/4036866815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2d080bdf30 con 0x55e57ff6e5a0 2024-04-23T15:13:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2d18a33740 10 client.17403 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.140+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e57ffe4190 con 0x55e57ff6e5a0 2024-04-23T15:13:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2cf8c00640 1 -- 172.21.15.7:0/4036866815 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e57fe4d4b0 con 0x55e57ff6e5a0 2024-04-23T15:13:02.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2cf8c00640 1 -- 172.21.15.7:0/4036866815 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2d080c6010 con 0x55e57ff6e5a0 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2d18a33740 10 client.17403 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2d18a33740 10 client.17403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2d18a33740 20 client.17403 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ffe48d0 0x55e57ffe6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2d18a33740 4 client.17403 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.141+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e57fe9a310 con 0x55e57ffe48d0 2024-04-23T15:13:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.142+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ffe48d0 0x55e57ffe6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.143+0000 7f2d0ea00640 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ffe48d0 0x55e57ffe6cf0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3839ea4be3e169e server_cookie=890bd013a8e67841 in_seq=0 out_seq=0 2024-04-23T15:13:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.143+0000 7f2cf8c00640 10 client.17403 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2cf8c00640 1 -- 172.21.15.7:0/4036866815 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e57fe9a310 con 0x55e57ffe48d0 2024-04-23T15:13:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2cf8c00640 10 client.17403 handle_command_reply: tid=0 2024-04-23T15:13:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 client.17403 shutdown 2024-04-23T15:13:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 msgr2=0x55e57ffe2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ffe2990 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2d080c5f70 tx=0x7f2d080ba150 comp rx=0 tx=0).stop 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 shutdown_connections 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e57ffe48d0 0x55e57ffe6cf0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e57ff63ce0 0x55e57ff71cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e57ff6e5a0 0x55e57ffe2990 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 --2- 172.21.15.7:0/4036866815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57ff633c0 0x55e57ff71770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 >> 172.21.15.7:0/4036866815 conn(0x55e57ff5f8d0 msgr2=0x55e57ff65600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2cf8c00640 0 client.17403 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 shutdown_connections 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.186+0000 7f2d18a33740 1 -- 172.21.15.7:0/4036866815 wait complete. 2024-04-23T15:13:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.187+0000 7f2d18a33740 20 client.17403 trim_cache size 0 max 16384 2024-04-23T15:13:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:13:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:13:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:13:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:13:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2cf40a3d10 msgr2=0x7f2cf40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2cf40a3d10 0x7f2cf40a61d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55e57ff64960 tx=0x7f2d0000b390 comp rx=0 tx=0).stop 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 msgr2=0x7f2d10101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d10101690 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2d0802ae70 tx=0x7f2d0802f5d0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 shutdown_connections 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2cf40a3d10 0x7f2cf40a61d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d101038e0 0x7f2d10101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1010c3e0 0x7f2d10101690 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 --2- 172.21.15.7:0/273195996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d10102fc0 0x7f2d10100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 >> 172.21.15.7:0/273195996 conn(0x7f2d100fc820 msgr2=0x7f2d100fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 shutdown_connections 2024-04-23T15:13:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:02.188+0000 7f2d0fe00640 1 -- 172.21.15.7:0/273195996 wait complete. 2024-04-23T15:13:03.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:02 smithi007 ceph-mon[27906]: pgmap v681: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:02 smithi186 ceph-mon[31814]: pgmap v681: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:02 smithi137 ceph-mon[31694]: pgmap v681: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:04.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:03 smithi007 ceph-mon[27906]: osdmap e123: 12 total, 12 up, 12 in 2024-04-23T15:13:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:03 smithi186 ceph-mon[31814]: osdmap e123: 12 total, 12 up, 12 in 2024-04-23T15:13:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:03 smithi137 ceph-mon[31694]: osdmap e123: 12 total, 12 up, 12 in 2024-04-23T15:13:05.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:04 smithi007 ceph-mon[27906]: pgmap v683: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 33 op/s 2024-04-23T15:13:05.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:04 smithi186 ceph-mon[31814]: pgmap v683: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 33 op/s 2024-04-23T15:13:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:04 smithi137 ceph-mon[31694]: pgmap v683: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 33 op/s 2024-04-23T15:13:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:06 smithi007 ceph-mon[27906]: pgmap v684: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 33 op/s 2024-04-23T15:13:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:06 smithi186 ceph-mon[31814]: pgmap v684: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 33 op/s 2024-04-23T15:13:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:06 smithi137 ceph-mon[31694]: pgmap v684: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 33 op/s 2024-04-23T15:13:09.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:08 smithi007 ceph-mon[27906]: pgmap v685: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:13:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:08 smithi186 ceph-mon[31814]: pgmap v685: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:13:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:08 smithi137 ceph-mon[31694]: pgmap v685: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:13:11.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:10 smithi007 ceph-mon[27906]: pgmap v686: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:13:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:10 smithi007 ceph-mon[27906]: osdmap e124: 12 total, 12 up, 12 in 2024-04-23T15:13:11.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:10 smithi186 ceph-mon[31814]: pgmap v686: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:13:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:10 smithi186 ceph-mon[31814]: osdmap e124: 12 total, 12 up, 12 in 2024-04-23T15:13:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:10 smithi137 ceph-mon[31694]: pgmap v686: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:13:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:10 smithi137 ceph-mon[31694]: osdmap e124: 12 total, 12 up, 12 in 2024-04-23T15:13:13.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:12 smithi007 ceph-mon[27906]: pgmap v688: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-04-23T15:13:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:12 smithi186 ceph-mon[31814]: pgmap v688: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-04-23T15:13:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:12 smithi137 ceph-mon[31694]: pgmap v688: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 12 op/s 2024-04-23T15:13:15.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:14 smithi007 ceph-mon[27906]: pgmap v689: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:13:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:14 smithi186 ceph-mon[31814]: pgmap v689: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:13:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:14 smithi137 ceph-mon[31694]: pgmap v689: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.337+0000 7f2a48e00640 1 -- 172.21.15.7:0/1816954203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 msgr2=0x7f2a44102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.337+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1816954203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a44102670 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009900 tx=0x7f2a3402a410 comp rx=0 tx=0).stop 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.337+0000 7f2a48e00640 1 -- 172.21.15.7:0/1816954203 shutdown_connections 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.337+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1816954203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a44102c40 0x7f2a44106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.337+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1816954203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a44107360 0x7f2a4410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.337+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1816954203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a44102670 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.338+0000 7f2a48e00640 1 -- 172.21.15.7:0/1816954203 >> 172.21.15.7:0/1816954203 conn(0x7f2a440fdab0 msgr2=0x7f2a440ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.338+0000 7f2a48e00640 1 -- 172.21.15.7:0/1816954203 shutdown_connections 2024-04-23T15:13:15.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.338+0000 7f2a48e00640 1 -- 172.21.15.7:0/1816954203 wait complete. 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.339+0000 7f2a48e00640 1 Processor -- start 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.339+0000 7f2a48e00640 1 -- start start 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.339+0000 7f2a48e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a441a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.339+0000 7f2a48e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a44107360 0x7f2a441a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a48e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a4419a840 0x7f2a4419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a48e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441122a0 con 0x7f2a44102290 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a48e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44112120 con 0x7f2a44107360 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a48e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44112420 con 0x7f2a4419a840 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a441a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a441a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55904/0 (socket says 172.21.15.7:55904) 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 -- 172.21.15.7:0/1513157450 learned_addr learned my addr 172.21.15.7:0/1513157450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41400640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a44107360 0x7f2a441a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 -- 172.21.15.7:0/1513157450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a4419a840 msgr2=0x7f2a4419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a4419a840 0x7f2a4419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 -- 172.21.15.7:0/1513157450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a44107360 msgr2=0x7f2a441a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a44107360 0x7f2a441a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.340+0000 7f2a41e00640 1 -- 172.21.15.7:0/1513157450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4419b3d0 con 0x7f2a44102290 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.341+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a441a0680 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005940 tx=0x7f2a34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.341+0000 7f2a3aa00640 1 -- 172.21.15.7:0/1513157450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3403f030 con 0x7f2a44102290 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.341+0000 7f2a3aa00640 1 -- 172.21.15.7:0/1513157450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a34003aa0 con 0x7f2a44102290 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.341+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4419b660 con 0x7f2a44102290 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.341+0000 7f2a3aa00640 1 -- 172.21.15.7:0/1513157450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34035070 con 0x7f2a44102290 2024-04-23T15:13:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.341+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a441a77f0 con 0x7f2a44102290 2024-04-23T15:13:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.345+0000 7f2a4bc02740 1 Processor -- start 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.345+0000 7f2a4bc02740 1 -- start start 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.345+0000 7f2a3aa00640 1 -- 172.21.15.7:0/1513157450 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2a34042030 con 0x7f2a44102290 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.345+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.345+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977babe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.345+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558977b07900 con 0x558977bac390 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558977aadf20 con 0x558977ba11b0 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558977b038c0 con 0x558977ba1ad0 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55920/0 (socket says 172.21.15.7:55920) 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a41400640 1 -- 172.21.15.7:0/1252771443 learned_addr learned my addr 172.21.15.7:0/1252771443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a42800640 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.346+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977babe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41400640 1 -- 172.21.15.7:0/1252771443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 msgr2=0x558977babe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41400640 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977babe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41400640 1 -- 172.21.15.7:0/1252771443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 msgr2=0x558977ba1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41400640 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41400640 1 -- 172.21.15.7:0/1252771443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558977ad2e10 con 0x558977bac390 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977babe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a3aa00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2a280a3e40 0x7f2a280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a41400640 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bae780 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000bc10 tx=0x7f2a3000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74798321d93c0d8c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a3aa00640 1 -- 172.21.15.7:0/1513157450 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f2a340f13d0 con 0x7f2a44102290 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.347+0000 7f2a42800640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2a280a3e40 0x7f2a280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.348+0000 7f2a2f400640 1 -- 172.21.15.7:0/1252771443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30015070 con 0x558977bac390 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.348+0000 7f2a2f400640 1 -- 172.21.15.7:0/1252771443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a3001a910 con 0x558977bac390 2024-04-23T15:13:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.348+0000 7f2a2f400640 1 -- 172.21.15.7:0/1252771443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a300118e0 con 0x558977bac390 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.348+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1252771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 msgr2=0x558977bae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.348+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bae780 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000bc10 tx=0x7f2a3000f730 comp rx=0 tx=0).stop 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.348+0000 7f2a42800640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2a280a3e40 0x7f2a280a6300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c005c40 tx=0x7f2a3c009560 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1252771443 shutdown_connections 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bae780 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977babe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1252771443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1252771443 >> 172.21.15.7:0/1252771443 conn(0x558977b9d6c0 msgr2=0x558977b9daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1252771443 shutdown_connections 2024-04-23T15:13:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1252771443 wait complete. 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.349+0000 7f2a4bc02740 1 -- start start 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 Processor -- start 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558977baefc0 con 0x558977ba1ad0 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558977ac12c0 con 0x558977ba11b0 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558977baf140 con 0x558977bac390 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a4bc02740 10 client.0 _ll_register_callbacks cb 0x558977819a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55924/0 (socket says 172.21.15.7:55924) 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.350+0000 7f2a41400640 1 -- 172.21.15.7:0/1053709823 learned_addr learned my addr 172.21.15.7:0/1053709823 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a42800640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41400640 1 -- 172.21.15.7:0/1053709823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 msgr2=0x558977ba9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41400640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41400640 1 -- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 msgr2=0x558977ba9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41400640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41400640 1 -- 172.21.15.7:0/1053709823 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558977ad1fd0 con 0x558977ba1ad0 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a41400640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba98b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000bf40 tx=0x7f2a3000b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f75afa2f0ee16e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:15.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.351+0000 7f2a23e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:15.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a23e00640 1 -- 172.21.15.7:0/1053709823 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30015070 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a3001a910 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a23e00640 1 -- 172.21.15.7:0/1053709823 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f2a3001a670 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a23e00640 1 -- 172.21.15.7:0/1053709823 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2a3001aac0 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a4bc02740 10 client.17415 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55897781a210 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.352+0000 7f2a23e00640 1 -- 172.21.15.7:0/1053709823 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a3001a910 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a23e00640 1 -- 172.21.15.7:0/1053709823 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2a30004950 con 0x558977ba1ad0 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a4bc02740 10 client.17415 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a4bc02740 10 client.17415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a4bc02740 20 client.17415 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977bbc410 0x558977bbe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a4bc02740 4 client.17415 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.353+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558977b15320 con 0x558977bbc410 2024-04-23T15:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.354+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977bbc410 0x558977bbe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.354+0000 7f2a41e00640 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977bbc410 0x558977bbe800 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d829f0bbf2631ed server_cookie=e2d15b7db2596592 in_seq=0 out_seq=0 2024-04-23T15:13:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.354+0000 7f2a23e00640 10 client.17415 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.356+0000 7f2a23e00640 1 -- 172.21.15.7:0/1053709823 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558977b15320 con 0x558977bbc410 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.356+0000 7f2a23e00640 10 client.17415 handle_command_reply: tid=0 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.356+0000 7f2a4bc02740 1 client.17415 shutdown 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 msgr2=0x558977ba98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba98b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000bf40 tx=0x7f2a3000b750 comp rx=0 tx=0).stop 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 shutdown_connections 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977bbc410 0x558977bbe800 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba98b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a23e00640 0 client.17415 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/1053709823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 >> 172.21.15.7:0/1053709823 conn(0x558977b9d6c0 msgr2=0x558977b9c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 shutdown_connections 2024-04-23T15:13:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 1 -- 172.21.15.7:0/1053709823 wait complete. 2024-04-23T15:13:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.357+0000 7f2a4bc02740 20 client.17415 trim_cache size 0 max 16384 2024-04-23T15:13:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.373+0000 7f2a4bc02740 1 Processor -- start 2024-04-23T15:13:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.373+0000 7f2a4bc02740 1 -- start start 2024-04-23T15:13:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977bb7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977b9c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bc3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b1510 con 0x558977bac390 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b3050 con 0x558977ba11b0 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b1be0 con 0x558977ba1ad0 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a42800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bc3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a42800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bc3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55938/0 (socket says 172.21.15.7:55938) 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a42800640 1 -- 172.21.15.7:0/3285563703 learned_addr learned my addr 172.21.15.7:0/3285563703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.374+0000 7f2a41e00640 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977bb7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a41400640 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977b9c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a42800640 1 -- 172.21.15.7:0/3285563703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 msgr2=0x558977b9c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a42800640 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977b9c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a42800640 1 -- 172.21.15.7:0/3285563703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 msgr2=0x558977bb7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a42800640 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977bb7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a42800640 1 -- 172.21.15.7:0/3285563703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589778e6620 con 0x558977bac390 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a42800640 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bc3f70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c012770 tx=0x7f2a3c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7230634e44cf9d91 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.375+0000 7f2a2ea00640 1 -- 172.21.15.7:0/3285563703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c004d20 con 0x558977bac390 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a2ea00640 1 -- 172.21.15.7:0/3285563703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a3c01eaa0 con 0x558977bac390 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a2ea00640 1 -- 172.21.15.7:0/3285563703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0056f0 con 0x558977bac390 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a4bc02740 1 -- 172.21.15.7:0/3285563703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 msgr2=0x558977bc3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bc3f70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c012770 tx=0x7f2a3c014000 comp rx=0 tx=0).stop 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a4bc02740 1 -- 172.21.15.7:0/3285563703 shutdown_connections 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977bac390 0x558977bc3f70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977ba1ad0 0x558977b9c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.376+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/3285563703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977bb7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.377+0000 7f2a4bc02740 1 -- 172.21.15.7:0/3285563703 >> 172.21.15.7:0/3285563703 conn(0x558977b9d6c0 msgr2=0x558977b9bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:15.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.377+0000 7f2a4bc02740 1 -- 172.21.15.7:0/3285563703 shutdown_connections 2024-04-23T15:13:15.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.377+0000 7f2a4bc02740 1 -- 172.21.15.7:0/3285563703 wait complete. 2024-04-23T15:13:15.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.377+0000 7f2a4bc02740 1 -- start start 2024-04-23T15:13:15.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.377+0000 7f2a4bc02740 1 Processor -- start 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b2980 con 0x558977ba1ad0 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b22b0 con 0x558977ba11b0 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441af510 con 0x558977bac390 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a4bc02740 10 client.0 _ll_register_callbacks cb 0x7f2a3c009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55940/0 (socket says 172.21.15.7:55940) 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a41400640 1 -- 172.21.15.7:0/553917411 learned_addr learned my addr 172.21.15.7:0/553917411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.378+0000 7f2a41e00640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a42800640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a41400640 1 -- 172.21.15.7:0/553917411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 msgr2=0x558977ba6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a41400640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a41400640 1 -- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 msgr2=0x558977ba5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a41400640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a41400640 1 -- 172.21.15.7:0/553917411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558977c217e0 con 0x558977ba1ad0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a42800640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a41400640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba64e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2a30000c00 tx=0x7f2a3000bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe2da68ed599ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a23e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a23e00640 1 -- 172.21.15.7:0/553917411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30037060 con 0x558977ba1ad0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a3c01eaa0 con 0x558977ba1ad0 2024-04-23T15:13:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.379+0000 7f2a23e00640 1 -- 172.21.15.7:0/553917411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f2a3001a880 con 0x558977ba1ad0 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a23e00640 1 -- 172.21.15.7:0/553917411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2a3003e050 con 0x558977ba1ad0 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 10 client.17421 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558977c22a30 con 0x558977ba1ad0 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a23e00640 1 -- 172.21.15.7:0/553917411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a3c01eaa0 con 0x558977ba1ad0 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a23e00640 1 -- 172.21.15.7:0/553917411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2a30004fb0 con 0x558977ba1ad0 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 10 client.17421 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 10 client.17421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 20 client.17421 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977c230c0 0x558977c254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 4 client.17421 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:13:15.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.380+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558977b0f190 con 0x558977c230c0 2024-04-23T15:13:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.381+0000 7f2a41e00640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977c230c0 0x558977c254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.382+0000 7f2a41e00640 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977c230c0 0x558977c254e0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cd951f2cbfc42d server_cookie=22fa144814ab5bfd in_seq=0 out_seq=0 2024-04-23T15:13:15.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.382+0000 7f2a23e00640 10 client.17421 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a23e00640 1 -- 172.21.15.7:0/553917411 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558977b0f190 con 0x558977c230c0 2024-04-23T15:13:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a23e00640 10 client.17421 handle_command_reply: tid=0 2024-04-23T15:13:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 client.17421 shutdown 2024-04-23T15:13:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 msgr2=0x558977ba64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba64e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2a30000c00 tx=0x7f2a3000bba0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 shutdown_connections 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558977c230c0 0x558977c254e0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558977bac390 0x558977ba6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558977ba1ad0 0x558977ba64e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 --2- 172.21.15.7:0/553917411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558977ba11b0 0x558977ba5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 >> 172.21.15.7:0/553917411 conn(0x558977b9d6c0 msgr2=0x558977b9c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.419+0000 7f2a23e00640 0 client.17421 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.420+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 shutdown_connections 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.420+0000 7f2a4bc02740 1 -- 172.21.15.7:0/553917411 wait complete. 2024-04-23T15:13:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.420+0000 7f2a4bc02740 20 client.17421 trim_cache size 0 max 16384 2024-04-23T15:13:15.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:13:15.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:13:15.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:13:15.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2a280a3e40 msgr2=0x7f2a280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2a280a3e40 0x7f2a280a6300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c005c40 tx=0x7f2a3c009560 comp rx=0 tx=0).stop 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 msgr2=0x7f2a441a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a441a0680 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005940 tx=0x7f2a34004270 comp rx=0 tx=0).stop 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 shutdown_connections 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2a280a3e40 0x7f2a280a6300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a44107360 0x7f2a441a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a4419a840 0x7f2a4419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 --2- 172.21.15.7:0/1513157450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a44102290 0x7f2a441a0680 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:15.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 >> 172.21.15.7:0/1513157450 conn(0x7f2a440fdab0 msgr2=0x7f2a440ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 shutdown_connections 2024-04-23T15:13:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:15.421+0000 7f2a48e00640 1 -- 172.21.15.7:0/1513157450 wait complete. 2024-04-23T15:13:17.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:16 smithi007 ceph-mon[27906]: pgmap v690: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:13:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:16 smithi186 ceph-mon[31814]: pgmap v690: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:13:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:16 smithi137 ceph-mon[31694]: pgmap v690: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 16 op/s 2024-04-23T15:13:18.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:13:18.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:13:18.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:13:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:18 smithi007 ceph-mon[27906]: pgmap v691: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:13:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:13:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:13:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:13:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:18 smithi186 ceph-mon[31814]: pgmap v691: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:13:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:13:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:13:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:13:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:18 smithi137 ceph-mon[31694]: pgmap v691: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:13:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:13:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:13:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:13:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:20 smithi007 ceph-mon[27906]: pgmap v692: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:13:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:20 smithi186 ceph-mon[31814]: pgmap v692: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:13:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:20 smithi137 ceph-mon[31694]: pgmap v692: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:13:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:22 smithi007 ceph-mon[27906]: pgmap v693: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:13:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:22 smithi186 ceph-mon[31814]: pgmap v693: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:13:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:22 smithi137 ceph-mon[31694]: pgmap v693: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:13:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:24 smithi007 ceph-mon[27906]: pgmap v694: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:13:25.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:24 smithi186 ceph-mon[31814]: pgmap v694: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:13:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:24 smithi137 ceph-mon[31694]: pgmap v694: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:13:27.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:26 smithi007 ceph-mon[27906]: pgmap v695: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:13:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:26 smithi186 ceph-mon[31814]: pgmap v695: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:13:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:26 smithi137 ceph-mon[31694]: pgmap v695: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:13:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 -- 172.21.15.7:0/286685638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 msgr2=0x7f9ecc102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/286685638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc102660 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009900 tx=0x7f9ebc02a410 comp rx=0 tx=0).stop 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 -- 172.21.15.7:0/286685638 shutdown_connections 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/286685638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ecc102c30 0x7f9ecc106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/286685638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ecc107350 0x7f9ecc10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/286685638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc102660 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.587+0000 7f9ed2c00640 1 -- 172.21.15.7:0/286685638 >> 172.21.15.7:0/286685638 conn(0x7f9ecc079490 msgr2=0x7f9ecc0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.588+0000 7f9ed2c00640 1 -- 172.21.15.7:0/286685638 shutdown_connections 2024-04-23T15:13:28.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.588+0000 7f9ed2c00640 1 -- 172.21.15.7:0/286685638 wait complete. 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 Processor -- start 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 -- start start 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc1a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ecc107350 0x7f9ecc1a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ecc19a830 0x7f9ecc19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1122c0 con 0x7f9ecc102280 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc112140 con 0x7f9ecc107350 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.589+0000 7f9ed2c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc112440 con 0x7f9ecc19a830 2024-04-23T15:13:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc1a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc1a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58400/0 (socket says 172.21.15.7:58400) 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2869138502 learned_addr learned my addr 172.21.15.7:0/2869138502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ec3400640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ecc107350 0x7f9ecc1a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ed0c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ecc19a830 0x7f9ecc19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2869138502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ecc19a830 msgr2=0x7f9ecc19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ecc19a830 0x7f9ecc19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2869138502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ecc107350 msgr2=0x7f9ecc1a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ecc107350 0x7f9ecc1a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.590+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2869138502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc19b3c0 con 0x7f9ecc102280 2024-04-23T15:13:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.591+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc1a06c0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005940 tx=0x7f9ebc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.591+0000 7f9ec9600640 1 -- 172.21.15.7:0/2869138502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc03f030 con 0x7f9ecc102280 2024-04-23T15:13:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.591+0000 7f9ec9600640 1 -- 172.21.15.7:0/2869138502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ebc003aa0 con 0x7f9ecc102280 2024-04-23T15:13:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.591+0000 7f9ec9600640 1 -- 172.21.15.7:0/2869138502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc035070 con 0x7f9ecc102280 2024-04-23T15:13:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.591+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc19b650 con 0x7f9ecc102280 2024-04-23T15:13:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.591+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc1a7800 con 0x7f9ecc102280 2024-04-23T15:13:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.595+0000 7f9ec9600640 1 -- 172.21.15.7:0/2869138502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f9ebc042030 con 0x7f9ecc102280 2024-04-23T15:13:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.596+0000 7f9ed5bb7740 1 Processor -- start 2024-04-23T15:13:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.596+0000 7f9ed5bb7740 1 -- start start 2024-04-23T15:13:28.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.596+0000 7f9ec9600640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9eac0a3dc0 0x7f9eac0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ec9600640 1 -- 172.21.15.7:0/2869138502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f9ebc0f10a0 con 0x7f9ecc102280 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 0x561d249b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b2ad0 0x561d249bce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed0c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9eac0a3dc0 0x7f9eac0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561d24918900 con 0x561d249b21b0 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d248bef20 con 0x561d249b2ad0 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561d249148c0 con 0x561d249bd390 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 0x561d249b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 0x561d249b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58404/0 (socket says 172.21.15.7:58404) 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.597+0000 7f9ecbe00640 1 -- 172.21.15.7:0/3252456724 learned_addr learned my addr 172.21.15.7:0/3252456724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ec3400640 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b2ad0 0x561d249bce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ecbe00640 1 -- 172.21.15.7:0/3252456724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 msgr2=0x561d249bf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ecbe00640 1 -- 172.21.15.7:0/3252456724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b2ad0 msgr2=0x561d249bce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b2ad0 0x561d249bce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ecbe00640 1 -- 172.21.15.7:0/3252456724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d248e3e10 con 0x561d249b21b0 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ec3400640 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b2ad0 0x561d249bce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ed0c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9eac0a3dc0 0x7f9eac0a6280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40092f0 tx=0x7f9ec4009890 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 0x561d249b2590 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005d00 tx=0x7f9ebc0bc6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157ee786a7291814 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ec1200640 1 -- 172.21.15.7:0/3252456724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc049040 con 0x561d249b21b0 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ec1200640 1 -- 172.21.15.7:0/3252456724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ebc0dbe50 con 0x561d249b21b0 2024-04-23T15:13:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.598+0000 7f9ec1200640 1 -- 172.21.15.7:0/3252456724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ee6c0 con 0x561d249b21b0 2024-04-23T15:13:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3252456724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 msgr2=0x561d249b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 0x561d249b2590 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005d00 tx=0x7f9ebc0bc6b0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3252456724 shutdown_connections 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b2ad0 0x561d249bce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3252456724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b21b0 0x561d249b2590 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.599+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3252456724 >> 172.21.15.7:0/3252456724 conn(0x561d249ae6c0 msgr2=0x561d249aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.600+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3252456724 shutdown_connections 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.600+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3252456724 wait complete. 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.600+0000 7f9ed5bb7740 1 -- start start 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.600+0000 7f9ed5bb7740 1 Processor -- start 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249ba860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561d24918900 con 0x561d249b2ad0 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d248d22c0 con 0x561d249b21b0 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561d249bfd80 con 0x561d249bd390 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ed5bb7740 10 client.0 _ll_register_callbacks cb 0x561d2462aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ec3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ec3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249ba860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58408/0 (socket says 172.21.15.7:58408) 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.601+0000 7f9ec3400640 1 -- 172.21.15.7:0/1136754219 learned_addr learned my addr 172.21.15.7:0/1136754219 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ed0c00640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ec3400640 1 -- 172.21.15.7:0/1136754219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 msgr2=0x561d249bada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ec3400640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ec3400640 1 -- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 msgr2=0x561d249ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ec3400640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ec3400640 1 -- 172.21.15.7:0/1136754219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d248e2fd0 con 0x561d249b2ad0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9ec3400640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249ba860 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4010450 tx=0x7f9eb4010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf391e53210aa20a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.602+0000 7f9eb9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9eb9600640 1 -- 172.21.15.7:0/1136754219 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4004440 con 0x561d249b2ad0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9eb9600640 1 -- 172.21.15.7:0/1136754219 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f9eb40035f0 con 0x561d249b2ad0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ebc0dbe50 con 0x561d249b2ad0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9eb9600640 1 -- 172.21.15.7:0/1136754219 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9eb4024050 con 0x561d249b2ad0 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9ed5bb7740 10 client.17433 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561d2462b210 con 0x561d249b2ad0 2024-04-23T15:13:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9eb9600640 1 -- 172.21.15.7:0/1136754219 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ebc0dbe50 con 0x561d249b2ad0 2024-04-23T15:13:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.603+0000 7f9eb9600640 1 -- 172.21.15.7:0/1136754219 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb400f040 con 0x561d249b2ad0 2024-04-23T15:13:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ed5bb7740 10 client.17433 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ed5bb7740 10 client.17433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ed5bb7740 20 client.17433 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d249cd120 0x561d249cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ed5bb7740 4 client.17433 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:13:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d24926320 con 0x561d249cd120 2024-04-23T15:13:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.604+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d249cd120 0x561d249cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.605+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d249cd120 0x561d249cf550 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3dd7f2bb6221d0 server_cookie=a638fdd736611cd7 in_seq=0 out_seq=0 2024-04-23T15:13:28.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.605+0000 7f9eb9600640 10 client.17433 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.607+0000 7f9eb9600640 1 -- 172.21.15.7:0/1136754219 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561d24926320 con 0x561d249cd120 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.607+0000 7f9eb9600640 10 client.17433 handle_command_reply: tid=0 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.607+0000 7f9ed5bb7740 1 client.17433 shutdown 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.607+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 msgr2=0x561d249ba860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.607+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249ba860 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4010450 tx=0x7f9eb4010910 comp rx=0 tx=0).stop 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 shutdown_connections 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d249cd120 0x561d249cf550 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249bada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249ba860 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1136754219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9eb9600640 0 client.17433 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 >> 172.21.15.7:0/1136754219 conn(0x561d249ae6c0 msgr2=0x561d249b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 shutdown_connections 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1136754219 wait complete. 2024-04-23T15:13:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.608+0000 7f9ed5bb7740 20 client.17433 trim_cache size 0 max 16384 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.631+0000 7f9ed5bb7740 1 Processor -- start 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 -- start start 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1b15d0 con 0x561d249b2ad0 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1b3110 con 0x561d249b21b0 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1b1ca0 con 0x561d249bd390 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ec3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ec3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249d4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58414/0 (socket says 172.21.15.7:58414) 2024-04-23T15:13:28.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.632+0000 7f9ec3400640 1 -- 172.21.15.7:0/1224019580 learned_addr learned my addr 172.21.15.7:0/1224019580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ed0c00640 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ec3400640 1 -- 172.21.15.7:0/1224019580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 msgr2=0x561d249d53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ec3400640 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249d53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ec3400640 1 -- 172.21.15.7:0/1224019580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 msgr2=0x561d249c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ec3400640 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ec3400640 1 -- 172.21.15.7:0/1224019580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d246f7620 con 0x561d249b2ad0 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.633+0000 7f9ec3400640 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249d4e60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400eb40 tx=0x7f9eb4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b822d0230ce22a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.634+0000 7f9ebbe00640 1 -- 172.21.15.7:0/1224019580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4012e40 con 0x561d249b2ad0 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.634+0000 7f9ebbe00640 1 -- 172.21.15.7:0/1224019580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9eb402c030 con 0x561d249b2ad0 2024-04-23T15:13:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.634+0000 7f9ebbe00640 1 -- 172.21.15.7:0/1224019580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011070 con 0x561d249b2ad0 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.634+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1224019580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 msgr2=0x561d249d4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.634+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249d4e60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400eb40 tx=0x7f9eb4005710 comp rx=0 tx=0).stop 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1224019580 shutdown_connections 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249bd390 0x561d249d53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249d4e60 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/1224019580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249b21b0 0x561d249c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1224019580 >> 172.21.15.7:0/1224019580 conn(0x561d249ae6c0 msgr2=0x561d249b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1224019580 shutdown_connections 2024-04-23T15:13:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/1224019580 wait complete. 2024-04-23T15:13:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 -- start start 2024-04-23T15:13:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.635+0000 7f9ed5bb7740 1 Processor -- start 2024-04-23T15:13:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249b21b0 0x561d249c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249bd390 0x561d249c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1b2a40 con 0x561d249b2ad0 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1b2370 con 0x561d249bd390 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc1af5d0 con 0x561d249b21b0 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ed5bb7740 10 client.0 _ll_register_callbacks cb 0x7f9eb400e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ec3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ec3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249c10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58430/0 (socket says 172.21.15.7:58430) 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.636+0000 7f9ec3400640 1 -- 172.21.15.7:0/3356250717 learned_addr learned my addr 172.21.15.7:0/3356250717 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ed0c00640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249bd390 0x561d249c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249b21b0 0x561d249c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ec3400640 1 -- 172.21.15.7:0/3356250717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249b21b0 msgr2=0x561d249c0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ec3400640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249b21b0 0x561d249c0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ec3400640 1 -- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249bd390 msgr2=0x561d249c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ec3400640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249bd390 0x561d249c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ec3400640 1 -- 172.21.15.7:0/3356250717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d24a32880 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9ec3400640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249c10b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4012a90 tx=0x7f9eb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b7bd9f5926db7d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9eb9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.637+0000 7f9eb9600640 1 -- 172.21.15.7:0/3356250717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40102d0 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9eb9600640 1 -- 172.21.15.7:0/3356250717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f9eb4012510 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb402c030 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9eb9600640 1 -- 172.21.15.7:0/3356250717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9eb403f050 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9ed5bb7740 10 client.17439 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561d24a33b50 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9eb9600640 1 -- 172.21.15.7:0/3356250717 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9eb402c030 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.638+0000 7f9eb9600640 1 -- 172.21.15.7:0/3356250717 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb4003a70 con 0x561d249b2ad0 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ed5bb7740 10 client.17439 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ed5bb7740 10 client.17439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ed5bb7740 20 client.17439 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d24a34240 0x561d24a36660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ed5bb7740 4 client.17439 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:13:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d24920190 con 0x561d24a34240 2024-04-23T15:13:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.639+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d24a34240 0x561d24a36660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.640+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d24a34240 0x561d24a36660 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a5d462759dee7cd server_cookie=860496f5169556d5 in_seq=0 out_seq=0 2024-04-23T15:13:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.640+0000 7f9eb9600640 10 client.17439 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:28.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.675+0000 7f9eb9600640 1 -- 172.21.15.7:0/3356250717 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d24920190 con 0x561d24a34240 2024-04-23T15:13:28.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.675+0000 7f9eb9600640 10 client.17439 handle_command_reply: tid=0 2024-04-23T15:13:28.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.675+0000 7f9ed5bb7740 1 client.17439 shutdown 2024-04-23T15:13:28.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.675+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 msgr2=0x561d249c10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.675+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249c10b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4012a90 tx=0x7f9eb40042f0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 shutdown_connections 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561d24a34240 0x561d24a36660 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d249bd390 0x561d249c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9eb9600640 0 client.17439 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d249b2ad0 0x561d249c10b0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 --2- 172.21.15.7:0/3356250717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d249b21b0 0x561d249c0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 >> 172.21.15.7:0/3356250717 conn(0x561d249ae6c0 msgr2=0x561d249acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:28.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 shutdown_connections 2024-04-23T15:13:28.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 1 -- 172.21.15.7:0/3356250717 wait complete. 2024-04-23T15:13:28.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.676+0000 7f9ed5bb7740 20 client.17439 trim_cache size 0 max 16384 2024-04-23T15:13:28.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:13:28.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:13:28.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:13:28.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9eac0a3dc0 msgr2=0x7f9eac0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9eac0a3dc0 0x7f9eac0a6280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40092f0 tx=0x7f9ec4009890 comp rx=0 tx=0).stop 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 msgr2=0x7f9ecc1a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc1a06c0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005940 tx=0x7f9ebc004270 comp rx=0 tx=0).stop 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 shutdown_connections 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9eac0a3dc0 0x7f9eac0a6280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ecc107350 0x7f9ecc1a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ecc19a830 0x7f9ecc19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 --2- 172.21.15.7:0/2869138502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc102280 0x7f9ecc1a06c0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 >> 172.21.15.7:0/2869138502 conn(0x7f9ecc079490 msgr2=0x7f9ecc0ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 shutdown_connections 2024-04-23T15:13:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:28.677+0000 7f9ed2c00640 1 -- 172.21.15.7:0/2869138502 wait complete. 2024-04-23T15:13:29.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:28 smithi007 ceph-mon[27906]: pgmap v696: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:13:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:28 smithi186 ceph-mon[31814]: pgmap v696: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:13:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:28 smithi137 ceph-mon[31694]: pgmap v696: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:13:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:30 smithi007 ceph-mon[27906]: pgmap v697: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:13:31.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:30 smithi186 ceph-mon[31814]: pgmap v697: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:13:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:30 smithi137 ceph-mon[31694]: pgmap v697: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:13:33.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:32 smithi007 ceph-mon[27906]: pgmap v698: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:13:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:32 smithi186 ceph-mon[31814]: pgmap v698: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:13:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:32 smithi137 ceph-mon[31694]: pgmap v698: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:13:35.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:34 smithi007 ceph-mon[27906]: pgmap v699: 129 pgs: 129 active+clean; 5.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:13:35.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:34 smithi186 ceph-mon[31814]: pgmap v699: 129 pgs: 129 active+clean; 5.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:13:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:34 smithi137 ceph-mon[31694]: pgmap v699: 129 pgs: 129 active+clean; 5.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:13:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:36 smithi007 ceph-mon[27906]: pgmap v700: 129 pgs: 129 active+clean; 5.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:37.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:36 smithi186 ceph-mon[31814]: pgmap v700: 129 pgs: 129 active+clean; 5.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:36 smithi137 ceph-mon[31694]: pgmap v700: 129 pgs: 129 active+clean; 5.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:13:39.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:38 smithi186 ceph-mon[31814]: pgmap v701: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:38 smithi137 ceph-mon[31694]: pgmap v701: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:38 smithi007 ceph-mon[27906]: pgmap v701: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:41.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:40 smithi186 ceph-mon[31814]: pgmap v702: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:13:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:40 smithi137 ceph-mon[31694]: pgmap v702: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:13:41.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:40 smithi007 ceph-mon[27906]: pgmap v702: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:13:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 -- 172.21.15.7:0/2683080870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 msgr2=0x7f05e410e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2683080870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e410e880 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009ca0 tx=0x7f05dc02a950 comp rx=0 tx=0).stop 2024-04-23T15:13:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 -- 172.21.15.7:0/2683080870 shutdown_connections 2024-04-23T15:13:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2683080870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4103980 0x7f05e410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2683080870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e410e880 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2683080870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4103060 0x7f05e4103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 -- 172.21.15.7:0/2683080870 >> 172.21.15.7:0/2683080870 conn(0x7f05e40fc820 msgr2=0x7f05e40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 -- 172.21.15.7:0/2683080870 shutdown_connections 2024-04-23T15:13:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.834+0000 7f05e3e00640 1 -- 172.21.15.7:0/2683080870 wait complete. 2024-04-23T15:13:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.835+0000 7f05e3e00640 1 Processor -- start 2024-04-23T15:13:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 -- start start 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4103060 0x7f05e419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4103980 0x7f05e419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4112090 con 0x7f05e410c430 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4111f10 con 0x7f05e4103980 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.836+0000 7f05e3e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4112210 con 0x7f05e4103060 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58806/0 (socket says 172.21.15.7:58806) 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 -- 172.21.15.7:0/2495365065 learned_addr learned my addr 172.21.15.7:0/2495365065 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4103060 0x7f05e419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e2000640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4103980 0x7f05e419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 -- 172.21.15.7:0/2495365065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4103060 msgr2=0x7f05e419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4103060 0x7f05e419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 -- 172.21.15.7:0/2495365065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4103980 msgr2=0x7f05e419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4103980 0x7f05e419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.837+0000 7f05e3400640 1 -- 172.21.15.7:0/2495365065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e419f740 con 0x7f05e410c430 2024-04-23T15:13:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.838+0000 7f05e3400640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e419f010 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009dc0 tx=0x7f05dc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.838+0000 7f05db400640 1 -- 172.21.15.7:0/2495365065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc034040 con 0x7f05e410c430 2024-04-23T15:13:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.838+0000 7f05db400640 1 -- 172.21.15.7:0/2495365065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05dc030850 con 0x7f05e410c430 2024-04-23T15:13:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.838+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e419f9d0 con 0x7f05e410c430 2024-04-23T15:13:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.838+0000 7f05db400640 1 -- 172.21.15.7:0/2495365065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0047f0 con 0x7f05e410c430 2024-04-23T15:13:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.838+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41a72c0 con 0x7f05e410c430 2024-04-23T15:13:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.843+0000 7f05ec3f7740 1 Processor -- start 2024-04-23T15:13:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.843+0000 7f05db400640 1 -- 172.21.15.7:0/2495365065 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f05dc037020 con 0x7f05e410c430 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.843+0000 7f05ec3f7740 1 -- start start 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cde3c0 0x564af0cde7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 0x564af0ce9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ceb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564af0c44900 con 0x564af0cdece0 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564af0beaf20 con 0x564af0ce95a0 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564af0c408c0 con 0x564af0cde3c0 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 0x564af0ce9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 0x564af0ce9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58816/0 (socket says 172.21.15.7:58816) 2024-04-23T15:13:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05e2a00640 1 -- 172.21.15.7:0/2270565370 learned_addr learned my addr 172.21.15.7:0/2270565370 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05e2000640 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cde3c0 0x564af0cde7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.844+0000 7f05e2000640 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ceb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05e2a00640 1 -- 172.21.15.7:0/2270565370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cde3c0 msgr2=0x564af0cde7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cde3c0 0x564af0cde7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05e2a00640 1 -- 172.21.15.7:0/2270565370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 msgr2=0x564af0ceb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ceb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05e2a00640 1 -- 172.21.15.7:0/2270565370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af0c0fe10 con 0x564af0cdece0 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 0x564af0ce9060 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f05d400bd10 tx=0x7f05d40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d21b35f6a887a1c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05db400640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f05c80a3d90 0x7f05c80a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.845+0000 7f05db400640 1 -- 172.21.15.7:0/2495365065 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f05dc0f1a90 con 0x7f05e410c430 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.846+0000 7f05cf400640 1 -- 172.21.15.7:0/2270565370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4004030 con 0x564af0cdece0 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.846+0000 7f05e2000640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f05c80a3d90 0x7f05c80a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.846+0000 7f05cf400640 1 -- 172.21.15.7:0/2270565370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d40035f0 con 0x564af0cdece0 2024-04-23T15:13:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.846+0000 7f05cf400640 1 -- 172.21.15.7:0/2270565370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011770 con 0x564af0cdece0 2024-04-23T15:13:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2270565370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 msgr2=0x564af0ce9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 0x564af0ce9060 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f05d400bd10 tx=0x7f05d40107a0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05e2000640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f05c80a3d90 0x7f05c80a6250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x564af0cdbcf0 tx=0x7f05d00046c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2270565370 shutdown_connections 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ceb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cdece0 0x564af0ce9060 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2270565370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cde3c0 0x564af0cde7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2270565370 >> 172.21.15.7:0/2270565370 conn(0x564af0cda8d0 msgr2=0x564af0cdacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2270565370 shutdown_connections 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.847+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2270565370 wait complete. 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.848+0000 7f05ec3f7740 1 -- start start 2024-04-23T15:13:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.848+0000 7f05ec3f7740 1 Processor -- start 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.848+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0cde3c0 0x564af0ce65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.848+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.848+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 0x564af0ce7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564af0cec140 con 0x564af0ce95a0 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564af0bfe2c0 con 0x564af0cde3c0 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564af0cec2c0 con 0x564af0cdece0 2024-04-23T15:13:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05ec3f7740 10 client.0 _ll_register_callbacks cb 0x564af0956a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 0x564af0ce7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 0x564af0ce7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58824/0 (socket says 172.21.15.7:58824) 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e3400640 1 -- 172.21.15.7:0/2882001278 learned_addr learned my addr 172.21.15.7:0/2882001278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0cde3c0 0x564af0ce65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e2000640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e3400640 1 -- 172.21.15.7:0/2882001278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 msgr2=0x564af0ce6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.849+0000 7f05e3400640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05e3400640 1 -- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0cde3c0 msgr2=0x564af0ce65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05e3400640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0cde3c0 0x564af0ce65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05e3400640 1 -- 172.21.15.7:0/2882001278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af0c0efd0 con 0x564af0ce95a0 2024-04-23T15:13:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0cde3c0 0x564af0ce65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:13:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05e2000640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05e3400640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 0x564af0ce7070 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0ba100 tx=0x7f05dc0bd150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d094997ed583c227 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.850+0000 7f05c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05c3e00640 1 -- 172.21.15.7:0/2882001278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc02c040 con 0x564af0ce95a0 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05c3e00640 1 -- 172.21.15.7:0/2882001278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f05dc0b9da0 con 0x564af0ce95a0 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d40035f0 con 0x564af0ce95a0 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05c3e00640 1 -- 172.21.15.7:0/2882001278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f05dc0bde30 con 0x564af0ce95a0 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05ec3f7740 10 client.17451 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564af0957210 con 0x564af0ce95a0 2024-04-23T15:13:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05c3e00640 1 -- 172.21.15.7:0/2882001278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d40035f0 con 0x564af0ce95a0 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05c3e00640 1 -- 172.21.15.7:0/2882001278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f05dc0c5f10 con 0x564af0ce95a0 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05ec3f7740 10 client.17451 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.852+0000 7f05ec3f7740 10 client.17451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.853+0000 7f05ec3f7740 20 client.17451 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.853+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0cf9770 0x564af0cfbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.853+0000 7f05ec3f7740 4 client.17451 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.853+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564af0c52320 con 0x564af0cf9770 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.853+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0cf9770 0x564af0cfbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.854+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0cf9770 0x564af0cfbbc0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce42620a175ed8f3 server_cookie=303a2f67b7145f2f in_seq=0 out_seq=0 2024-04-23T15:13:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.854+0000 7f05c3e00640 10 client.17451 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.856+0000 7f05c3e00640 1 -- 172.21.15.7:0/2882001278 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564af0c52320 con 0x564af0cf9770 2024-04-23T15:13:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.856+0000 7f05c3e00640 10 client.17451 handle_command_reply: tid=0 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.856+0000 7f05ec3f7740 1 client.17451 shutdown 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.856+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 msgr2=0x564af0ce7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.856+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 0x564af0ce7070 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0ba100 tx=0x7f05dc0bd150 comp rx=0 tx=0).stop 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 shutdown_connections 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0cf9770 0x564af0cfbbc0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0ce95a0 0x564af0ce7070 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2882001278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0cde3c0 0x564af0ce65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 >> 172.21.15.7:0/2882001278 conn(0x564af0cda8d0 msgr2=0x564af0cd9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05c3e00640 0 client.17451 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 shutdown_connections 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2882001278 wait complete. 2024-04-23T15:13:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.857+0000 7f05ec3f7740 20 client.17451 trim_cache size 0 max 16384 2024-04-23T15:13:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 Processor -- start 2024-04-23T15:13:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 -- start start 2024-04-23T15:13:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0ce8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0cda210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0cf5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41b1310 con 0x564af0cde3c0 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41b2e50 con 0x564af0ce95a0 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.876+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41b19e0 con 0x564af0cdece0 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0ce8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0ce8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58834/0 (socket says 172.21.15.7:58834) 2024-04-23T15:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 -- 172.21.15.7:0/4215234586 learned_addr learned my addr 172.21.15.7:0/4215234586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2000640 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0cda210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 -- 172.21.15.7:0/4215234586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 msgr2=0x564af0cda210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e3400640 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0cf5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0cda210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 -- 172.21.15.7:0/4215234586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 msgr2=0x564af0cf5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0cf5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2a00640 1 -- 172.21.15.7:0/4215234586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af0ce55a0 con 0x564af0cde3c0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.877+0000 7f05e2000640 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0cda210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.878+0000 7f05e2a00640 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0ce8d20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f05d400baa0 tx=0x7f05d400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c07e9c0871cb81 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.878+0000 7f05cea00640 1 -- 172.21.15.7:0/4215234586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d402f070 con 0x564af0cde3c0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.878+0000 7f05cea00640 1 -- 172.21.15.7:0/4215234586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d402a100 con 0x564af0cde3c0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.878+0000 7f05cea00640 1 -- 172.21.15.7:0/4215234586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4003850 con 0x564af0cde3c0 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 -- 172.21.15.7:0/4215234586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 msgr2=0x564af0ce8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0ce8d20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f05d400baa0 tx=0x7f05d400b690 comp rx=0 tx=0).stop 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 -- 172.21.15.7:0/4215234586 shutdown_connections 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0cf5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0cda210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/4215234586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0ce8d20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 -- 172.21.15.7:0/4215234586 >> 172.21.15.7:0/4215234586 conn(0x564af0cda8d0 msgr2=0x564af0cdacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 -- 172.21.15.7:0/4215234586 shutdown_connections 2024-04-23T15:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.879+0000 7f05ec3f7740 1 -- 172.21.15.7:0/4215234586 wait complete. 2024-04-23T15:13:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 -- start start 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 Processor -- start 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0cf1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ce3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41b2780 con 0x564af0cde3c0 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41b20b0 con 0x564af0ce95a0 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41af310 con 0x564af0cdece0 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.880+0000 7f05ec3f7740 10 client.0 _ll_register_callbacks cb 0x7f05dc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0cf1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0cf1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58842/0 (socket says 172.21.15.7:58842) 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 -- 172.21.15.7:0/2513670315 learned_addr learned my addr 172.21.15.7:0/2513670315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2000640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e3400640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ce3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 -- 172.21.15.7:0/2513670315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 msgr2=0x564af0ce30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 -- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 msgr2=0x564af0ce3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ce3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 -- 172.21.15.7:0/2513670315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af0a23620 con 0x564af0cde3c0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e3400640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ce3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05e2a00640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0cf1b70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b7f0 tx=0x7f05d400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bed9db06a97818 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.881+0000 7f05c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.882+0000 7f05c3e00640 1 -- 172.21.15.7:0/2513670315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d402f070 con 0x564af0cde3c0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.882+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d402a100 con 0x564af0cde3c0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.882+0000 7f05c3e00640 1 -- 172.21.15.7:0/2513670315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7f05d402a2b0 con 0x564af0cde3c0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.882+0000 7f05c3e00640 1 -- 172.21.15.7:0/2513670315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f05d4005680 con 0x564af0cde3c0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.882+0000 7f05ec3f7740 10 client.17457 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.882+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564af0d5fc10 con 0x564af0cde3c0 2024-04-23T15:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05c3e00640 1 -- 172.21.15.7:0/2513670315 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d402a100 con 0x564af0cde3c0 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05c3e00640 1 -- 172.21.15.7:0/2513670315 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f05d4011440 con 0x564af0cde3c0 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05ec3f7740 10 client.17457 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05ec3f7740 10 client.17457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05ec3f7740 20 client.17457 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0d60090 0x564af0d62480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05ec3f7740 4 client.17457 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564af0c4c190 con 0x564af0d60090 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.883+0000 7f05e2000640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0d60090 0x564af0d62480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.885+0000 7f05e2000640 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0d60090 0x564af0d62480 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d337dbfaa3cada4 server_cookie=3150bd7192488d31 in_seq=0 out_seq=0 2024-04-23T15:13:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.885+0000 7f05c3e00640 10 client.17457 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:41.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05c3e00640 1 -- 172.21.15.7:0/2513670315 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564af0c4c190 con 0x564af0d60090 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05c3e00640 10 client.17457 handle_command_reply: tid=0 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05ec3f7740 1 client.17457 shutdown 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 msgr2=0x564af0cf1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0cf1b70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f05d400b7f0 tx=0x7f05d400be80 comp rx=0 tx=0).stop 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 shutdown_connections 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.924+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564af0d60090 0x564af0d62480 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564af0ce95a0 0x564af0ce3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05c3e00640 0 client.17457 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564af0cdece0 0x564af0ce30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 1 --2- 172.21.15.7:0/2513670315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564af0cde3c0 0x564af0cf1b70 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 >> 172.21.15.7:0/2513670315 conn(0x564af0cda8d0 msgr2=0x564af0ce65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:41.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 shutdown_connections 2024-04-23T15:13:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 1 -- 172.21.15.7:0/2513670315 wait complete. 2024-04-23T15:13:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.925+0000 7f05ec3f7740 20 client.17457 trim_cache size 0 max 16384 2024-04-23T15:13:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:13:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:13:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:13:41.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f05c80a3d90 msgr2=0x7f05c80a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f05c80a3d90 0x7f05c80a6250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x564af0cdbcf0 tx=0x7f05d00046c0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 msgr2=0x7f05e419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e419f010 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009dc0 tx=0x7f05dc003f10 comp rx=0 tx=0).stop 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 shutdown_connections 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f05c80a3d90 0x7f05c80a6250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4103980 0x7f05e419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05e410c430 0x7f05e419f010 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 --2- 172.21.15.7:0/2495365065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4103060 0x7f05e419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 >> 172.21.15.7:0/2495365065 conn(0x7f05e40fc820 msgr2=0x7f05e4100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 shutdown_connections 2024-04-23T15:13:41.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:41.926+0000 7f05e3e00640 1 -- 172.21.15.7:0/2495365065 wait complete. 2024-04-23T15:13:43.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:42 smithi186 ceph-mon[31814]: pgmap v703: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:13:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:42 smithi137 ceph-mon[31694]: pgmap v703: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:13:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:42 smithi007 ceph-mon[27906]: pgmap v703: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:13:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:44 smithi186 ceph-mon[31814]: pgmap v704: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:44 smithi137 ceph-mon[31694]: pgmap v704: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:44 smithi007 ceph-mon[27906]: pgmap v704: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:47.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:46 smithi007 ceph-mon[27906]: pgmap v705: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:13:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:46 smithi137 ceph-mon[31694]: pgmap v705: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:13:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:46 smithi186 ceph-mon[31814]: pgmap v705: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:13:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:48 smithi137 ceph-mon[31694]: pgmap v706: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:13:49.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:48 smithi007 ceph-mon[27906]: pgmap v706: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:13:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:48 smithi186 ceph-mon[31814]: pgmap v706: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:13:50.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:49 smithi137 ceph-mon[31694]: pgmap v707: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:50.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:49 smithi007 ceph-mon[27906]: pgmap v707: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:50.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:49 smithi186 ceph-mon[31814]: pgmap v707: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:52.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:51 smithi007 ceph-mon[27906]: pgmap v708: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:52.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:51 smithi186 ceph-mon[31814]: pgmap v708: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:52.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:51 smithi137 ceph-mon[31694]: pgmap v708: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:54.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:53 smithi007 ceph-mon[27906]: pgmap v709: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:54.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:53 smithi186 ceph-mon[31814]: pgmap v709: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:54.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:53 smithi137 ceph-mon[31694]: pgmap v709: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:13:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 -- 172.21.15.7:0/367309938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406a830 msgr2=0x7feb9406ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 --2- 172.21.15.7:0/367309938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406a830 0x7feb9406ac90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7feb80009900 tx=0x7feb8002a480 comp rx=0 tx=0).stop 2024-04-23T15:13:55.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 -- 172.21.15.7:0/367309938 shutdown_connections 2024-04-23T15:13:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 --2- 172.21.15.7:0/367309938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9406b1d0 0x7feb9410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 --2- 172.21.15.7:0/367309938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406a830 0x7feb9406ac90 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 --2- 172.21.15.7:0/367309938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 0x7feb94108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 -- 172.21.15.7:0/367309938 >> 172.21.15.7:0/367309938 conn(0x7feb94076d00 msgr2=0x7feb94077110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 -- 172.21.15.7:0/367309938 shutdown_connections 2024-04-23T15:13:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.105+0000 7feb9c200640 1 -- 172.21.15.7:0/367309938 wait complete. 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.106+0000 7feb9c200640 1 Processor -- start 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 -- start start 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9406a830 0x7feb941a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 0x7feb941a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 0x7feb9419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb94112280 con 0x7feb9406b1d0 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feb94112100 con 0x7feb94108190 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb9c200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feb94112400 con 0x7feb9406a830 2024-04-23T15:13:55.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.107+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 0x7feb941a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 0x7feb941a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34862/0 (socket says 172.21.15.7:34862) 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 -- 172.21.15.7:0/1152591056 learned_addr learned my addr 172.21.15.7:0/1152591056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb99800640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9406a830 0x7feb941a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb9a200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 0x7feb9419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 -- 172.21.15.7:0/1152591056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9406a830 msgr2=0x7feb941a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9406a830 0x7feb941a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 -- 172.21.15.7:0/1152591056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 msgr2=0x7feb9419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 0x7feb9419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb98e00640 1 -- 172.21.15.7:0/1152591056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9419afa0 con 0x7feb9406b1d0 2024-04-23T15:13:55.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.108+0000 7feb9a200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 0x7feb9419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:13:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.109+0000 7feb98e00640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 0x7feb941a0b60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7feb80005ab0 tx=0x7feb80003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.109+0000 7feb92000640 1 -- 172.21.15.7:0/1152591056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8003f070 con 0x7feb9406b1d0 2024-04-23T15:13:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.109+0000 7feb92000640 1 -- 172.21.15.7:0/1152591056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb80031d60 con 0x7feb9406b1d0 2024-04-23T15:13:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.109+0000 7feb92000640 1 -- 172.21.15.7:0/1152591056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80035030 con 0x7feb9406b1d0 2024-04-23T15:13:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.109+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9419b230 con 0x7feb9406b1d0 2024-04-23T15:13:55.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.109+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb941a73c0 con 0x7feb9406b1d0 2024-04-23T15:13:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.113+0000 7feb9f197740 1 Processor -- start 2024-04-23T15:13:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.113+0000 7feb9f197740 1 -- start start 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.113+0000 7feb9f197740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff24d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.113+0000 7feb9f197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff257e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9f197740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff25a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9f197740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5650ff1b3900 con 0x5650ff258390 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9f197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5650ff159f20 con 0x5650ff24dad0 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9f197740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5650ff1af8c0 con 0x5650ff24d1b0 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb92000640 1 -- 172.21.15.7:0/1152591056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7feb80042070 con 0x7feb9406b1d0 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9a200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff24d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff25a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9a200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff24d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:36462/0 (socket says 172.21.15.7:36462) 2024-04-23T15:13:55.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb9a200640 1 -- 172.21.15.7:0/2439687607 learned_addr learned my addr 172.21.15.7:0/2439687607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.114+0000 7feb99800640 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff257e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb9a200640 1 -- 172.21.15.7:0/2439687607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 msgr2=0x5650ff257e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb9a200640 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff257e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb9a200640 1 -- 172.21.15.7:0/2439687607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 msgr2=0x5650ff25a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb9a200640 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff25a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb9a200640 1 -- 172.21.15.7:0/2439687607 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650ff17ee10 con 0x5650ff24d1b0 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb98e00640 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff25a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb9a200640 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff24d590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009fb0 tx=0x7feb8c010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2e23433f61d7e4e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.115+0000 7feb92000640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feb7c0a3e40 0x7feb7c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.116+0000 7feb92000640 1 -- 172.21.15.7:0/1152591056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7feb800f1120 con 0x7feb9406b1d0 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.116+0000 7feb99800640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feb7c0a3e40 0x7feb7c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.116+0000 7feb86a00640 1 -- 172.21.15.7:0/2439687607 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c016070 con 0x5650ff24d1b0 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.116+0000 7feb86a00640 1 -- 172.21.15.7:0/2439687607 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb8c012bc0 con 0x5650ff24d1b0 2024-04-23T15:13:55.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.116+0000 7feb86a00640 1 -- 172.21.15.7:0/2439687607 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011ba0 con 0x5650ff24d1b0 2024-04-23T15:13:55.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 -- 172.21.15.7:0/2439687607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 msgr2=0x5650ff24d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff24d590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009fb0 tx=0x7feb8c010800 comp rx=0 tx=0).stop 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb99800640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feb7c0a3e40 0x7feb7c0a6300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5650ff24e750 tx=0x7feb8800b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 -- 172.21.15.7:0/2439687607 shutdown_connections 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff257e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff25a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 --2- 172.21.15.7:0/2439687607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff24d590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 -- 172.21.15.7:0/2439687607 >> 172.21.15.7:0/2439687607 conn(0x5650ff2496c0 msgr2=0x5650ff249aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 -- 172.21.15.7:0/2439687607 shutdown_connections 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.117+0000 7feb9f197740 1 -- 172.21.15.7:0/2439687607 wait complete. 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.118+0000 7feb9f197740 1 -- start start 2024-04-23T15:13:55.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.118+0000 7feb9f197740 1 Processor -- start 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.118+0000 7feb9f197740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff2552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.118+0000 7feb9f197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff2557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.118+0000 7feb9f197740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff255d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.118+0000 7feb9f197740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5650ff25afc0 con 0x5650ff258390 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9f197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5650ff16d2c0 con 0x5650ff24dad0 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9f197740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5650ff25b140 con 0x5650ff24d1b0 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9f197740 10 client.0 _ll_register_callbacks cb 0x5650feec5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:55.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff255d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff255d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34880/0 (socket says 172.21.15.7:34880) 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 -- 172.21.15.7:0/1688805584 learned_addr learned my addr 172.21.15.7:0/1688805584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb99800640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff2552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb98e00640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff2557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 -- 172.21.15.7:0/1688805584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 msgr2=0x5650ff2552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff2552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 -- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 msgr2=0x5650ff2557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff2557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb9a200640 1 -- 172.21.15.7:0/1688805584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650ff17dfd0 con 0x5650ff258390 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.119+0000 7feb98e00640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff2557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.120+0000 7feb9a200640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff255d30 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a010 tx=0x7feb8c011450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b941153bdc3359 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.120+0000 7feb7b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:55.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.120+0000 7feb7b400640 1 -- 172.21.15.7:0/1688805584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c016040 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.120+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb8c012bc0 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.120+0000 7feb7b400640 1 -- 172.21.15.7:0/1688805584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7feb8c012510 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb7b400640 1 -- 172.21.15.7:0/1688805584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7feb8c031050 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb9f197740 10 client.17469 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5650feec6210 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb7b400640 1 -- 172.21.15.7:0/1688805584 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb8c012bc0 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb7b400640 1 -- 172.21.15.7:0/1688805584 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7feb8c02c030 con 0x5650ff258390 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb9f197740 10 client.17469 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.121+0000 7feb9f197740 10 client.17469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.122+0000 7feb9f197740 20 client.17469 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.122+0000 7feb9f197740 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff268360 0x5650ff26a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.122+0000 7feb9f197740 4 client.17469 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:13:55.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.122+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650ff1c1320 con 0x5650ff268360 2024-04-23T15:13:55.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.122+0000 7feb99800640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff268360 0x5650ff26a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.123+0000 7feb99800640 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff268360 0x5650ff26a750 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4bbc39db367364 server_cookie=ed6562af80d3a4d in_seq=0 out_seq=0 2024-04-23T15:13:55.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.123+0000 7feb7b400640 10 client.17469 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb7b400640 1 -- 172.21.15.7:0/1688805584 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5650ff1c1320 con 0x5650ff268360 2024-04-23T15:13:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb7b400640 10 client.17469 handle_command_reply: tid=0 2024-04-23T15:13:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 client.17469 shutdown 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 msgr2=0x5650ff255d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff255d30 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a010 tx=0x7feb8c011450 comp rx=0 tx=0).stop 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 shutdown_connections 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff268360 0x5650ff26a750 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24dad0 0x5650ff2557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff258390 0x5650ff255d30 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 --2- 172.21.15.7:0/1688805584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff24d1b0 0x5650ff2552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 >> 172.21.15.7:0/1688805584 conn(0x5650ff2496c0 msgr2=0x5650ff24f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.125+0000 7feb7b400640 0 client.17469 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.126+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 shutdown_connections 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.126+0000 7feb9f197740 1 -- 172.21.15.7:0/1688805584 wait complete. 2024-04-23T15:13:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.126+0000 7feb9f197740 20 client.17469 trim_cache size 0 max 16384 2024-04-23T15:13:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.148+0000 7feb9f197740 1 Processor -- start 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 -- start start 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff263e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff255b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff26fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb941b1530 con 0x5650ff24dad0 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feb941b3070 con 0x5650ff24d1b0 2024-04-23T15:13:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb9f197740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feb941b1c00 con 0x5650ff258390 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff255b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff255b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34892/0 (socket says 172.21.15.7:34892) 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.149+0000 7feb98e00640 1 -- 172.21.15.7:0/2434932924 learned_addr learned my addr 172.21.15.7:0/2434932924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb9a200640 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff26fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb99800640 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff263e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb98e00640 1 -- 172.21.15.7:0/2434932924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 msgr2=0x5650ff26fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb98e00640 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff26fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb98e00640 1 -- 172.21.15.7:0/2434932924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 msgr2=0x5650ff263e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb98e00640 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff263e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb98e00640 1 -- 172.21.15.7:0/2434932924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650fef92620 con 0x5650ff24dad0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.150+0000 7feb98e00640 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff255b50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7feb800bc9b0 tx=0x7feb80031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718a4a919623bf44 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.151+0000 7feb86000640 1 -- 172.21.15.7:0/2434932924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80049040 con 0x5650ff24dad0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.151+0000 7feb86000640 1 -- 172.21.15.7:0/2434932924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb800bd3b0 con 0x5650ff24dad0 2024-04-23T15:13:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.151+0000 7feb86000640 1 -- 172.21.15.7:0/2434932924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800c5920 con 0x5650ff24dad0 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.151+0000 7feb9f197740 1 -- 172.21.15.7:0/2434932924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 msgr2=0x5650ff255b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff255b50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7feb800bc9b0 tx=0x7feb80031400 comp rx=0 tx=0).stop 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 -- 172.21.15.7:0/2434932924 shutdown_connections 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff26fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff255b50 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 --2- 172.21.15.7:0/2434932924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff263e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 -- 172.21.15.7:0/2434932924 >> 172.21.15.7:0/2434932924 conn(0x5650ff2496c0 msgr2=0x5650ff248840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 -- 172.21.15.7:0/2434932924 shutdown_connections 2024-04-23T15:13:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 -- 172.21.15.7:0/2434932924 wait complete. 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 -- start start 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.152+0000 7feb9f197740 1 Processor -- start 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff260150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff260690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff25b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb941b29a0 con 0x5650ff24dad0 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feb941b22d0 con 0x5650ff24d1b0 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feb941af530 con 0x5650ff258390 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb9f197740 10 client.0 _ll_register_callbacks cb 0x7feb800f4aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff260690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb98e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff260690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34900/0 (socket says 172.21.15.7:34900) 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.153+0000 7feb98e00640 1 -- 172.21.15.7:0/2160929329 learned_addr learned my addr 172.21.15.7:0/2160929329 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb9a200640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff25b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb99800640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff260150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb98e00640 1 -- 172.21.15.7:0/2160929329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 msgr2=0x5650ff25b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb98e00640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff25b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb98e00640 1 -- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 msgr2=0x5650ff260150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb98e00640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff260150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb98e00640 1 -- 172.21.15.7:0/2160929329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650ff25bd50 con 0x5650ff24dad0 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb98e00640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff260690 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7feb8002aa40 tx=0x7feb8002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe0a079690e5b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb7b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb7b400640 1 -- 172.21.15.7:0/2160929329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800bc7f0 con 0x5650ff24dad0 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb7b400640 1 -- 172.21.15.7:0/2160929329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 9467+0+0 (secure 0 0 0) 0x7feb800ee6e0 con 0x5650ff24dad0 2024-04-23T15:13:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.154+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb800bd3b0 con 0x5650ff24dad0 2024-04-23T15:13:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb7b400640 1 -- 172.21.15.7:0/2160929329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7feb800bc610 con 0x5650ff24dad0 2024-04-23T15:13:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 10 client.17475 fetch_fsmap learned FSMap version 32 2024-04-23T15:13:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5650ff2d68b0 con 0x5650ff24dad0 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb7b400640 1 -- 172.21.15.7:0/2160929329 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb800bd3b0 con 0x5650ff24dad0 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb7b400640 1 -- 172.21.15.7:0/2160929329 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7feb8004c060 con 0x5650ff24dad0 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 10 client.17475 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 10 client.17475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 20 client.17475 populate_metadata read hostname 'smithi007' 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff2d6da0 0x5650ff2d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 4 client.17475 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.155+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5650ff1bb190 con 0x5650ff2d6da0 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.156+0000 7feb99800640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff2d6da0 0x5650ff2d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.157+0000 7feb99800640 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff2d6da0 0x5650ff2d9190 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e95d85b05098984 server_cookie=9e2cff7ebfc517b in_seq=0 out_seq=0 2024-04-23T15:13:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.157+0000 7feb7b400640 10 client.17475 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.189+0000 7feb7b400640 1 -- 172.21.15.7:0/2160929329 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5650ff1bb190 con 0x5650ff2d6da0 2024-04-23T15:13:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.189+0000 7feb7b400640 10 client.17475 handle_command_reply: tid=0 2024-04-23T15:13:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.189+0000 7feb9f197740 1 client.17475 shutdown 2024-04-23T15:13:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.189+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 msgr2=0x5650ff260690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.189+0000 7feb9f197740 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff260690 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7feb8002aa40 tx=0x7feb8002a480 comp rx=0 tx=0).stop 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 shutdown_connections 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5650ff2d6da0 0x5650ff2d9190 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650ff258390 0x5650ff25b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5650ff24dad0 0x5650ff260690 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 --2- 172.21.15.7:0/2160929329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5650ff24d1b0 0x5650ff260150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb7b400640 0 client.17475 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 >> 172.21.15.7:0/2160929329 conn(0x5650ff2496c0 msgr2=0x5650ff255830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 shutdown_connections 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 1 -- 172.21.15.7:0/2160929329 wait complete. 2024-04-23T15:13:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.190+0000 7feb9f197740 20 client.17475 trim_cache size 0 max 16384 2024-04-23T15:13:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:13:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:13:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:13:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feb7c0a3e40 msgr2=0x7feb7c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feb7c0a3e40 0x7feb7c0a6300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5650ff24e750 tx=0x7feb8800b390 comp rx=0 tx=0).stop 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 msgr2=0x7feb941a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 0x7feb941a0b60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7feb80005ab0 tx=0x7feb80003cd0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 shutdown_connections 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feb7c0a3e40 0x7feb7c0a6300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb94108190 0x7feb9419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb9406b1d0 0x7feb941a0b60 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 --2- 172.21.15.7:0/1152591056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9406a830 0x7feb941a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 >> 172.21.15.7:0/1152591056 conn(0x7feb94076d00 msgr2=0x7feb9410d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.191+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 shutdown_connections 2024-04-23T15:13:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:13:55.192+0000 7feb9c200640 1 -- 172.21.15.7:0/1152591056 wait complete. 2024-04-23T15:13:56.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:56 smithi007 ceph-mon[27906]: pgmap v710: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:56.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:56 smithi186 ceph-mon[31814]: pgmap v710: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:56.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:56 smithi137 ceph-mon[31694]: pgmap v710: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:13:58.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:13:58 smithi007 ceph-mon[27906]: pgmap v711: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:13:58.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:13:58 smithi186 ceph-mon[31814]: pgmap v711: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:13:58.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:13:58 smithi137 ceph-mon[31694]: pgmap v711: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:14:00.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:00 smithi007 ceph-mon[27906]: pgmap v712: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:00.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:00 smithi186 ceph-mon[31814]: pgmap v712: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:00.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:00 smithi137 ceph-mon[31694]: pgmap v712: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:02.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:02 smithi007 ceph-mon[27906]: pgmap v713: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:02.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:02 smithi186 ceph-mon[31814]: pgmap v713: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:02.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:02 smithi137 ceph-mon[31694]: pgmap v713: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:04.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:04 smithi007 ceph-mon[27906]: pgmap v714: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:14:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:04 smithi007 ceph-mon[27906]: osdmap e125: 12 total, 12 up, 12 in 2024-04-23T15:14:04.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:04 smithi186 ceph-mon[31814]: pgmap v714: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:14:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:04 smithi186 ceph-mon[31814]: osdmap e125: 12 total, 12 up, 12 in 2024-04-23T15:14:04.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:04 smithi137 ceph-mon[31694]: pgmap v714: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:14:04.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:04 smithi137 ceph-mon[31694]: osdmap e125: 12 total, 12 up, 12 in 2024-04-23T15:14:06.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:06 smithi007 ceph-mon[27906]: pgmap v716: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:14:06.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:06 smithi186 ceph-mon[31814]: pgmap v716: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:14:06.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:06 smithi137 ceph-mon[31694]: pgmap v716: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:14:08.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:08 smithi007 ceph-mon[27906]: pgmap v717: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 -- 172.21.15.7:0/2366716128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c1061b0 msgr2=0x7fd66c106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 --2- 172.21.15.7:0/2366716128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c1061b0 0x7fd66c106640 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd664009ca0 tx=0x7fd66402a940 comp rx=0 tx=0).stop 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 -- 172.21.15.7:0/2366716128 shutdown_connections 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 --2- 172.21.15.7:0/2366716128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 0x7fd66c105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 --2- 172.21.15.7:0/2366716128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c1061b0 0x7fd66c106640 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 --2- 172.21.15.7:0/2366716128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd66c100db0 0x7fd66c101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 -- 172.21.15.7:0/2366716128 >> 172.21.15.7:0/2366716128 conn(0x7fd66c0fc820 msgr2=0x7fd66c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:08.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 -- 172.21.15.7:0/2366716128 shutdown_connections 2024-04-23T15:14:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.352+0000 7fd673000640 1 -- 172.21.15.7:0/2366716128 wait complete. 2024-04-23T15:14:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.353+0000 7fd673000640 1 Processor -- start 2024-04-23T15:14:08.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 -- start start 2024-04-23T15:14:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 0x7fd66c1a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 0x7fd66c1a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd66c1061b0 0x7fd66c19ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1186d0 con 0x7fd66c100db0 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c118550 con 0x7fd66c1016d0 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd673000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c118850 con 0x7fd66c1061b0 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.354+0000 7fd671c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 0x7fd66c1a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 0x7fd66c1a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46448/0 (socket says 172.21.15.7:46448) 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 -- 172.21.15.7:0/2522875675 learned_addr learned my addr 172.21.15.7:0/2522875675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671200640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 0x7fd66c1a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd672600640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd66c1061b0 0x7fd66c19ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 -- 172.21.15.7:0/2522875675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd66c1061b0 msgr2=0x7fd66c19ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd66c1061b0 0x7fd66c19ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 -- 172.21.15.7:0/2522875675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 msgr2=0x7fd66c1a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 0x7fd66c1a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671c00640 1 -- 172.21.15.7:0/2522875675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c19f1b0 con 0x7fd66c100db0 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.355+0000 7fd671200640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 0x7fd66c1a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.356+0000 7fd671c00640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 0x7fd66c1a4880 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d770 tx=0x7fd66000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.356+0000 7fd66a000640 1 -- 172.21.15.7:0/2522875675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660017070 con 0x7fd66c100db0 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.356+0000 7fd66a000640 1 -- 172.21.15.7:0/2522875675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6600054d0 con 0x7fd66c100db0 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.356+0000 7fd66a000640 1 -- 172.21.15.7:0/2522875675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660004cf0 con 0x7fd66c100db0 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.356+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c19f4a0 con 0x7fd66c100db0 2024-04-23T15:14:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.356+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66c1ab740 con 0x7fd66c100db0 2024-04-23T15:14:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.360+0000 7fd67740e740 1 Processor -- start 2024-04-23T15:14:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.360+0000 7fd67740e740 1 -- start start 2024-04-23T15:14:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.360+0000 7fd66a000640 1 -- 172.21.15.7:0/2522875675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd660004e90 con 0x7fd66c100db0 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd67740e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953953c0 0x55b7953957a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd67740e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd67740e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953a05a0 0x55b7953a2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd67740e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7952fb900 con 0x55b795395ce0 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd67740e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b7952a1f20 con 0x55b7953953c0 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd67740e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b7952f78c0 con 0x55b7953a05a0 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd671c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd671c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46464/0 (socket says 172.21.15.7:46464) 2024-04-23T15:14:08.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd671c00640 1 -- 172.21.15.7:0/369190709 learned_addr learned my addr 172.21.15.7:0/369190709 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.361+0000 7fd672600640 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953953c0 0x55b7953957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671200640 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953a05a0 0x55b7953a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671c00640 1 -- 172.21.15.7:0/369190709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953a05a0 msgr2=0x55b7953a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671c00640 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953a05a0 0x55b7953a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671c00640 1 -- 172.21.15.7:0/369190709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953953c0 msgr2=0x55b7953957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671c00640 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953953c0 0x55b7953957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671c00640 1 -- 172.21.15.7:0/369190709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7952c6e10 con 0x55b795395ce0 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd672600640 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953953c0 0x55b7953957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd671c00640 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a0060 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd6600cd940 tx=0x7fd6600d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd9a3c2ebb9915e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:08.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.362+0000 7fd66a000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd6540a3d90 0x7fd6540a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:08 smithi186 ceph-mon[31814]: pgmap v717: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.363+0000 7fd65ea00640 1 -- 172.21.15.7:0/369190709 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6600df070 con 0x55b795395ce0 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.363+0000 7fd66a000640 1 -- 172.21.15.7:0/2522875675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9555+0+0 (secure 0 0 0) 0x7fd6600d0720 con 0x7fd66c100db0 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.363+0000 7fd65ea00640 1 -- 172.21.15.7:0/369190709 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd660009c30 con 0x55b795395ce0 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.363+0000 7fd672600640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd6540a3d90 0x7fd6540a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.363+0000 7fd65ea00640 1 -- 172.21.15.7:0/369190709 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6600984f0 con 0x55b795395ce0 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 -- 172.21.15.7:0/369190709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 msgr2=0x55b7953a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd672600640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd6540a3d90 0x7fd6540a6250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd664004af0 tx=0x7fd664004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a0060 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd6600cd940 tx=0x7fd6600d8670 comp rx=0 tx=0).stop 2024-04-23T15:14:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 -- 172.21.15.7:0/369190709 shutdown_connections 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953a05a0 0x55b7953a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a0060 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 --2- 172.21.15.7:0/369190709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953953c0 0x55b7953957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 -- 172.21.15.7:0/369190709 >> 172.21.15.7:0/369190709 conn(0x55b7953918d0 msgr2=0x55b795391cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 -- 172.21.15.7:0/369190709 shutdown_connections 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.364+0000 7fd67740e740 1 -- 172.21.15.7:0/369190709 wait complete. 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 -- start start 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 Processor -- start 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b79539dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7953a3140 con 0x55b7953a05a0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b7952b52c0 con 0x55b795395ce0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b7953a32c0 con 0x55b7953953c0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.365+0000 7fd67740e740 10 client.0 _ll_register_callbacks cb 0x55b79500da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46480/0 (socket says 172.21.15.7:46480) 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 -- 172.21.15.7:0/148830349 learned_addr learned my addr 172.21.15.7:0/148830349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd671c00640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd671200640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b79539dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 -- 172.21.15.7:0/148830349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 msgr2=0x55b79539d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 -- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 msgr2=0x55b79539dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b79539dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.366+0000 7fd672600640 1 -- 172.21.15.7:0/148830349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7952c5fd0 con 0x55b7953a05a0 2024-04-23T15:14:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd672600640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539e0f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd664003f20 tx=0x7fd66402a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a416789d6e39e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd653400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd653400640 1 -- 172.21.15.7:0/148830349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664034040 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b795309320 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd653400640 1 -- 172.21.15.7:0/148830349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 9555+0+0 (secure 0 0 0) 0x7fd664030b40 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd653400640 1 -- 172.21.15.7:0/148830349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd66402f640 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd67740e740 10 client.17487 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.367+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b79500e210 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd653400640 1 -- 172.21.15.7:0/148830349 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55b795309320 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd653400640 1 -- 172.21.15.7:0/148830349 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd66402f070 con 0x55b7953a05a0 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd67740e740 10 client.17487 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd67740e740 10 client.17487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd67740e740 20 client.17487 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd67740e740 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b7953b0870 0x55b7953b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd67740e740 4 client.17487 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:14:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.368+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b795303190 con 0x55b7953b0870 2024-04-23T15:14:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.369+0000 7fd671c00640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b7953b0870 0x55b7953b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.370+0000 7fd653400640 10 client.17487 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.370+0000 7fd671c00640 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b7953b0870 0x55b7953b2c60 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f9ce965cecc01bf server_cookie=67190b3a9dfde068 in_seq=0 out_seq=0 2024-04-23T15:14:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd653400640 1 -- 172.21.15.7:0/148830349 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b795303190 con 0x55b7953b0870 2024-04-23T15:14:08.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd653400640 10 client.17487 handle_command_reply: tid=0 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 client.17487 shutdown 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 msgr2=0x55b79539e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539e0f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd664003f20 tx=0x7fd66402a940 comp rx=0 tx=0).stop 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 shutdown_connections 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b7953b0870 0x55b7953b2c60 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b79539dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539e0f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 --2- 172.21.15.7:0/148830349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 >> 172.21.15.7:0/148830349 conn(0x55b7953918d0 msgr2=0x55b795397650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd653400640 0 client.17487 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 shutdown_connections 2024-04-23T15:14:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.372+0000 7fd67740e740 1 -- 172.21.15.7:0/148830349 wait complete. 2024-04-23T15:14:08.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.373+0000 7fd67740e740 20 client.17487 trim_cache size 0 max 16384 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 Processor -- start 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 -- start start 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b795397dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1b5900 con 0x55b7953a05a0 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1b7440 con 0x55b795395ce0 2024-04-23T15:14:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.391+0000 7fd67740e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1b5fd0 con 0x55b7953953c0 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46492/0 (socket says 172.21.15.7:46492) 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 -- 172.21.15.7:0/2261169121 learned_addr learned my addr 172.21.15.7:0/2261169121 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd671200640 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b795397dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd671c00640 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 -- 172.21.15.7:0/2261169121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 msgr2=0x55b79539fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 -- 172.21.15.7:0/2261169121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 msgr2=0x55b795397dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b795397dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.392+0000 7fd672600640 1 -- 172.21.15.7:0/2261169121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7950da620 con 0x55b7953a05a0 2024-04-23T15:14:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.393+0000 7fd672600640 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539dd40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd66402f800 tx=0x7fd664005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fb0bac858c5844 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.393+0000 7fd65e000640 1 -- 172.21.15.7:0/2261169121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664030a10 con 0x55b7953a05a0 2024-04-23T15:14:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.393+0000 7fd65e000640 1 -- 172.21.15.7:0/2261169121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd66404d070 con 0x55b7953a05a0 2024-04-23T15:14:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.393+0000 7fd65e000640 1 -- 172.21.15.7:0/2261169121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6640041b0 con 0x55b7953a05a0 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 -- 172.21.15.7:0/2261169121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 msgr2=0x55b79539dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539dd40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd66402f800 tx=0x7fd664005d20 comp rx=0 tx=0).stop 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 -- 172.21.15.7:0/2261169121 shutdown_connections 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b795395ce0 0x55b795397dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b7953a05a0 0x55b79539dd40 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 --2- 172.21.15.7:0/2261169121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b79539fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 -- 172.21.15.7:0/2261169121 >> 172.21.15.7:0/2261169121 conn(0x55b7953918d0 msgr2=0x55b79539d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 -- 172.21.15.7:0/2261169121 shutdown_connections 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 -- 172.21.15.7:0/2261169121 wait complete. 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.394+0000 7fd67740e740 1 -- start start 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 Processor -- start 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b7953a4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953a05a0 0x55b795415de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1b6d70 con 0x55b795395ce0 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1b66a0 con 0x55b7953a05a0 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c1b3900 con 0x55b7953953c0 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd67740e740 10 client.0 _ll_register_callbacks cb 0x7fd664009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd671200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd671200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46508/0 (socket says 172.21.15.7:46508) 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.395+0000 7fd671200640 1 -- 172.21.15.7:0/1930601829 learned_addr learned my addr 172.21.15.7:0/1930601829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd672600640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953a05a0 0x55b795415de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671c00640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b7953a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671200640 1 -- 172.21.15.7:0/1930601829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 msgr2=0x55b7953a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671200640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b7953a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671200640 1 -- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953a05a0 msgr2=0x55b795415de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671200640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953a05a0 0x55b795415de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671200640 1 -- 172.21.15.7:0/1930601829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7954163f0 con 0x55b795395ce0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671c00640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b7953a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd671200640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a4d50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd66c1051a0 tx=0x7fd658003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44446000b9208b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd653400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd653400640 1 -- 172.21.15.7:0/1930601829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658021060 con 0x55b795395ce0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd653400640 1 -- 172.21.15.7:0/1930601829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 9555+0+0 (secure 0 0 0) 0x7fd658013ce0 con 0x55b795395ce0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.396+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd66404d070 con 0x55b795395ce0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd653400640 1 -- 172.21.15.7:0/1930601829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd658028050 con 0x55b795395ce0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 10 client.17493 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b795417790 con 0x55b795395ce0 2024-04-23T15:14:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd653400640 1 -- 172.21.15.7:0/1930601829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd66404d070 con 0x55b795395ce0 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd653400640 1 -- 172.21.15.7:0/1930601829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd65801c4a0 con 0x55b795395ce0 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 10 client.17493 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 10 client.17493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 20 client.17493 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b795417f70 0x55b79541a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 4 client.17493 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.397+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b79527f4b0 con 0x55b795417f70 2024-04-23T15:14:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.398+0000 7fd671c00640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b795417f70 0x55b79541a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.399+0000 7fd671c00640 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b795417f70 0x55b79541a390 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe53a60652272864 server_cookie=135aa956fcdccda7 in_seq=0 out_seq=0 2024-04-23T15:14:08.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.399+0000 7fd653400640 10 client.17493 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:08.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:08 smithi137 ceph-mon[31694]: pgmap v717: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-04-23T15:14:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.431+0000 7fd653400640 1 -- 172.21.15.7:0/1930601829 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b79527f4b0 con 0x55b795417f70 2024-04-23T15:14:08.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.431+0000 7fd653400640 10 client.17493 handle_command_reply: tid=0 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.431+0000 7fd67740e740 1 client.17493 shutdown 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 msgr2=0x55b7953a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a4d50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd66c1051a0 tx=0x7fd658003e60 comp rx=0 tx=0).stop 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 shutdown_connections 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b795417f70 0x55b79541a390 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7953a05a0 0x55b795415de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b795395ce0 0x55b7953a4d50 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd653400640 0 client.17493 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 --2- 172.21.15.7:0/1930601829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7953953c0 0x55b7953a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 >> 172.21.15.7:0/1930601829 conn(0x55b7953918d0 msgr2=0x55b79539dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 shutdown_connections 2024-04-23T15:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 1 -- 172.21.15.7:0/1930601829 wait complete. 2024-04-23T15:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.432+0000 7fd67740e740 20 client.17493 trim_cache size 0 max 16384 2024-04-23T15:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:14:08.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd6540a3d90 msgr2=0x7fd6540a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd6540a3d90 0x7fd6540a6250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd664004af0 tx=0x7fd664004a40 comp rx=0 tx=0).stop 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 msgr2=0x7fd66c1a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 0x7fd66c1a4880 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d770 tx=0x7fd66000dc30 comp rx=0 tx=0).stop 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 shutdown_connections 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd6540a3d90 0x7fd6540a6250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c1016d0 0x7fd66c1a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd66c1061b0 0x7fd66c19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.433+0000 7fd673000640 1 --2- 172.21.15.7:0/2522875675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd66c100db0 0x7fd66c1a4880 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.434+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 >> 172.21.15.7:0/2522875675 conn(0x7fd66c0fc820 msgr2=0x7fd66c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.434+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 shutdown_connections 2024-04-23T15:14:08.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:08.434+0000 7fd673000640 1 -- 172.21.15.7:0/2522875675 wait complete. 2024-04-23T15:14:10.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:10 smithi007 ceph-mon[27906]: pgmap v718: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-04-23T15:14:10.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:10 smithi186 ceph-mon[31814]: pgmap v718: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-04-23T15:14:10.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:10 smithi137 ceph-mon[31694]: pgmap v718: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 33 op/s 2024-04-23T15:14:12.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:11 smithi007 ceph-mon[27906]: osdmap e126: 12 total, 12 up, 12 in 2024-04-23T15:14:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:11 smithi186 ceph-mon[31814]: osdmap e126: 12 total, 12 up, 12 in 2024-04-23T15:14:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:11 smithi137 ceph-mon[31694]: osdmap e126: 12 total, 12 up, 12 in 2024-04-23T15:14:13.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:12 smithi007 ceph-mon[27906]: pgmap v720: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 7 op/s 2024-04-23T15:14:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:12 smithi186 ceph-mon[31814]: pgmap v720: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 7 op/s 2024-04-23T15:14:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:12 smithi137 ceph-mon[31694]: pgmap v720: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 7 op/s 2024-04-23T15:14:15.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:14 smithi007 ceph-mon[27906]: pgmap v721: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:14:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:14 smithi186 ceph-mon[31814]: pgmap v721: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:14:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:14 smithi137 ceph-mon[31694]: pgmap v721: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:14:16.970 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:16 smithi137 ceph-mon[31694]: pgmap v722: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:14:17.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:16 smithi007 ceph-mon[27906]: pgmap v722: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:14:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:16 smithi186 ceph-mon[31814]: pgmap v722: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:14:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:18 smithi007 ceph-mon[27906]: pgmap v723: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:14:19.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:18 smithi186 ceph-mon[31814]: pgmap v723: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:14:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:18 smithi137 ceph-mon[31694]: pgmap v723: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:14:20.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:14:20.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:14:20.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:14:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:20 smithi007 ceph-mon[27906]: pgmap v724: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:14:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:14:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:14:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:14:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:20 smithi186 ceph-mon[31814]: pgmap v724: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:14:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:14:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:14:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:14:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:20 smithi137 ceph-mon[31694]: pgmap v724: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 15 op/s 2024-04-23T15:14:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:14:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:14:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 -- 172.21.15.7:0/1999874052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8974109350 msgr2=0x7f8974110f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 --2- 172.21.15.7:0/1999874052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8974109350 0x7f8974110f20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f896c009ca0 tx=0x7f896c02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 -- 172.21.15.7:0/1999874052 shutdown_connections 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 --2- 172.21.15.7:0/1999874052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8974109350 0x7f8974110f20 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 --2- 172.21.15.7:0/1999874052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974104c30 0x7f8974108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 --2- 172.21.15.7:0/1999874052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8974104280 0x7f8974104660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 -- 172.21.15.7:0/1999874052 >> 172.21.15.7:0/1999874052 conn(0x7f89740ffb20 msgr2=0x7f8974101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 -- 172.21.15.7:0/1999874052 shutdown_connections 2024-04-23T15:14:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.609+0000 7f8973e00640 1 -- 172.21.15.7:0/1999874052 wait complete. 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.610+0000 7f8973e00640 1 Processor -- start 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.610+0000 7f8973e00640 1 -- start start 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8974104280 0x7f89741a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974109350 0x7f89741a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 0x7f897419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8974114310 con 0x7f897419a650 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8974114190 con 0x7f8974104280 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8974114490 con 0x7f8974109350 2024-04-23T15:14:21.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 0x7f897419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 0x7f897419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55544/0 (socket says 172.21.15.7:55544) 2024-04-23T15:14:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8973400640 1 -- 172.21.15.7:0/1932168336 learned_addr learned my addr 172.21.15.7:0/1932168336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f8972a00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8974104280 0x7f89741a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.611+0000 7f896a000640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974109350 0x7f89741a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f8973400640 1 -- 172.21.15.7:0/1932168336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974109350 msgr2=0x7f89741a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f8973400640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974109350 0x7f89741a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f8973400640 1 -- 172.21.15.7:0/1932168336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8974104280 msgr2=0x7f89741a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f8973400640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8974104280 0x7f89741a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f8973400640 1 -- 172.21.15.7:0/1932168336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897419b170 con 0x7f897419a650 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f896a000640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974109350 0x7f89741a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f8973400640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 0x7f897419ab00 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f896c031040 tx=0x7f896c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.612+0000 7f896be00640 1 -- 172.21.15.7:0/1932168336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c003ce0 con 0x7f897419a650 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.613+0000 7f896be00640 1 -- 172.21.15.7:0/1932168336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f896c0044f0 con 0x7f897419a650 2024-04-23T15:14:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.613+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897419b400 con 0x7f897419a650 2024-04-23T15:14:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.613+0000 7f896be00640 1 -- 172.21.15.7:0/1932168336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c030c90 con 0x7f897419a650 2024-04-23T15:14:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.613+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89741a7650 con 0x7f897419a650 2024-04-23T15:14:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.616+0000 7f897cbc6740 1 Processor -- start 2024-04-23T15:14:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.616+0000 7f896be00640 1 -- 172.21.15.7:0/1932168336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f896c0046a0 con 0x7f897419a650 2024-04-23T15:14:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.616+0000 7f897cbc6740 1 -- start start 2024-04-23T15:14:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c70ce0 0x558a65c7b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c7d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f897cbc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558a65bd6900 con 0x558a65c703c0 2024-04-23T15:14:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f897cbc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a65b7cf20 con 0x558a65c70ce0 2024-04-23T15:14:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f897cbc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558a65bd28c0 con 0x558a65c7b5a0 2024-04-23T15:14:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f896a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f896a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55552/0 (socket says 172.21.15.7:55552) 2024-04-23T15:14:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f896a000640 1 -- 172.21.15.7:0/3306786402 learned_addr learned my addr 172.21.15.7:0/3306786402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.617+0000 7f8972a00640 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c70ce0 0x558a65c7b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f896a000640 1 -- 172.21.15.7:0/3306786402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 msgr2=0x558a65c7d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f896a000640 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c7d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f896a000640 1 -- 172.21.15.7:0/3306786402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c70ce0 msgr2=0x558a65c7b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f896a000640 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c70ce0 0x558a65c7b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f896a000640 1 -- 172.21.15.7:0/3306786402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a65ba1e10 con 0x558a65c703c0 2024-04-23T15:14:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f896a000640 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c707a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f895c00bcd0 tx=0x7f895c011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88da58514a85610 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f8963e00640 1 -- 172.21.15.7:0/3306786402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c005020 con 0x558a65c703c0 2024-04-23T15:14:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f8963e00640 1 -- 172.21.15.7:0/3306786402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f895c0047a0 con 0x558a65c703c0 2024-04-23T15:14:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.618+0000 7f8963e00640 1 -- 172.21.15.7:0/3306786402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c012650 con 0x558a65c703c0 2024-04-23T15:14:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.619+0000 7f896be00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f89540a3d90 0x7f89540a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.619+0000 7f896be00640 1 -- 172.21.15.7:0/1932168336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f896c0f20e0 con 0x7f897419a650 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.619+0000 7f8972a00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f89540a3d90 0x7f89540a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.619+0000 7f897cbc6740 1 -- 172.21.15.7:0/3306786402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 msgr2=0x558a65c707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.619+0000 7f897cbc6740 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c707a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f895c00bcd0 tx=0x7f895c011750 comp rx=0 tx=0).stop 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 -- 172.21.15.7:0/3306786402 shutdown_connections 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c70ce0 0x558a65c7b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c7d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 --2- 172.21.15.7:0/3306786402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c707a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 -- 172.21.15.7:0/3306786402 >> 172.21.15.7:0/3306786402 conn(0x558a65c6c8d0 msgr2=0x558a65c6ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 -- 172.21.15.7:0/3306786402 shutdown_connections 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 -- 172.21.15.7:0/3306786402 wait complete. 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f8972a00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f89540a3d90 0x7f89540a6250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x558a65c71960 tx=0x7f896400b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 -- start start 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.620+0000 7f897cbc6740 1 Processor -- start 2024-04-23T15:14:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c78570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c78ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c7b5a0 0x558a65c78ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558a65c7e140 con 0x558a65c703c0 2024-04-23T15:14:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a65b902c0 con 0x558a65c7b5a0 2024-04-23T15:14:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558a65c7e2c0 con 0x558a65c70ce0 2024-04-23T15:14:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f897cbc6740 10 client.0 _ll_register_callbacks cb 0x558a658e8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f8972a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c78570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f8972a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c78570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55556/0 (socket says 172.21.15.7:55556) 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.621+0000 7f8972a00640 1 -- 172.21.15.7:0/86183620 learned_addr learned my addr 172.21.15.7:0/86183620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f896a000640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c78ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8973400640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c7b5a0 0x558a65c78ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8972a00640 1 -- 172.21.15.7:0/86183620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 msgr2=0x558a65c78ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8972a00640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c78ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8972a00640 1 -- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c7b5a0 msgr2=0x558a65c78ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8972a00640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c7b5a0 0x558a65c78ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8972a00640 1 -- 172.21.15.7:0/86183620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a65ba0fd0 con 0x558a65c703c0 2024-04-23T15:14:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8972a00640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c78570 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8964003ec0 tx=0x7f89640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516308ccb4228ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8960c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.622+0000 7f8960c00640 1 -- 172.21.15.7:0/86183620 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896401b890 con 0x558a65c703c0 2024-04-23T15:14:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f8960c00640 1 -- 172.21.15.7:0/86183620 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f896401ba30 con 0x558a65c703c0 2024-04-23T15:14:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f895c0047a0 con 0x558a65c703c0 2024-04-23T15:14:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f8960c00640 1 -- 172.21.15.7:0/86183620 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f896401bc30 con 0x558a65c703c0 2024-04-23T15:14:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f897cbc6740 10 client.17505 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558a658e9210 con 0x558a65c703c0 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f8960c00640 1 -- 172.21.15.7:0/86183620 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f895c0047a0 con 0x558a65c703c0 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.623+0000 7f8960c00640 1 -- 172.21.15.7:0/86183620 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8964024020 con 0x558a65c703c0 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f897cbc6740 10 client.17505 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f897cbc6740 10 client.17505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f897cbc6740 20 client.17505 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f897cbc6740 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65c8b7f0 0x558a65c8dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f897cbc6740 4 client.17505 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:14:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a65be4320 con 0x558a65c8b7f0 2024-04-23T15:14:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.624+0000 7f896a000640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65c8b7f0 0x558a65c8dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.626+0000 7f896a000640 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65c8b7f0 0x558a65c8dc00 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7491050f678424cb server_cookie=3dcc99ec0fe9468e in_seq=0 out_seq=0 2024-04-23T15:14:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.626+0000 7f8960c00640 10 client.17505 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.627+0000 7f8960c00640 1 -- 172.21.15.7:0/86183620 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a65be4320 con 0x558a65c8b7f0 2024-04-23T15:14:21.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.627+0000 7f8960c00640 10 client.17505 handle_command_reply: tid=0 2024-04-23T15:14:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 client.17505 shutdown 2024-04-23T15:14:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 msgr2=0x558a65c78570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c78570 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8964003ec0 tx=0x7f89640046c0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 shutdown_connections 2024-04-23T15:14:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65c8b7f0 0x558a65c8dc00 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c7b5a0 0x558a65c78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c78ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 --2- 172.21.15.7:0/86183620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c703c0 0x558a65c78570 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f8960c00640 0 client.17505 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 >> 172.21.15.7:0/86183620 conn(0x558a65c6c8d0 msgr2=0x558a65c72650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 shutdown_connections 2024-04-23T15:14:21.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 1 -- 172.21.15.7:0/86183620 wait complete. 2024-04-23T15:14:21.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.628+0000 7f897cbc6740 20 client.17505 trim_cache size 0 max 16384 2024-04-23T15:14:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 Processor -- start 2024-04-23T15:14:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 -- start start 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c6c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c72d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 0x558a65c93510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89741b1430 con 0x558a65c7b5a0 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89741b2f70 con 0x558a65c703c0 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.647+0000 7f897cbc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f89741b1b00 con 0x558a65c70ce0 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 0x558a65c93510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 0x558a65c93510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55558/0 (socket says 172.21.15.7:55558) 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 -- 172.21.15.7:0/386563603 learned_addr learned my addr 172.21.15.7:0/386563603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8972a00640 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c6c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f896a000640 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c72d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 -- 172.21.15.7:0/386563603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 msgr2=0x558a65c72d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c72d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 -- 172.21.15.7:0/386563603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 msgr2=0x558a65c6c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c6c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 -- 172.21.15.7:0/386563603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a659b5620 con 0x558a65c7b5a0 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.648+0000 7f8973400640 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 0x558a65c93510 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f896c006010 tx=0x7f896c0bd7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72011e8686f36390 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.649+0000 7f8963400640 1 -- 172.21.15.7:0/386563603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0bdd80 con 0x558a65c7b5a0 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.649+0000 7f8963400640 1 -- 172.21.15.7:0/386563603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f896c036040 con 0x558a65c7b5a0 2024-04-23T15:14:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.649+0000 7f8963400640 1 -- 172.21.15.7:0/386563603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0ba3f0 con 0x558a65c7b5a0 2024-04-23T15:14:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 -- 172.21.15.7:0/386563603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 msgr2=0x558a65c93510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 0x558a65c93510 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f896c006010 tx=0x7f896c0bd7d0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 -- 172.21.15.7:0/386563603 shutdown_connections 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c7b5a0 0x558a65c93510 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c70ce0 0x558a65c72d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 --2- 172.21.15.7:0/386563603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c6c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 -- 172.21.15.7:0/386563603 >> 172.21.15.7:0/386563603 conn(0x558a65c6c8d0 msgr2=0x558a65c7a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 -- 172.21.15.7:0/386563603 shutdown_connections 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 -- 172.21.15.7:0/386563603 wait complete. 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 -- start start 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.650+0000 7f897cbc6740 1 Processor -- start 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 0x558a65c75a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c75f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89741b28a0 con 0x558a65c70ce0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89741b21d0 con 0x558a65c703c0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f89741af430 con 0x558a65c7b5a0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f897cbc6740 10 client.0 _ll_register_callbacks cb 0x7f8964004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f896a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 0x558a65c75a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.651+0000 7f896a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 0x558a65c75a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55572/0 (socket says 172.21.15.7:55572) 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 -- 172.21.15.7:0/2609650920 learned_addr learned my addr 172.21.15.7:0/2609650920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f8972a00640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f8973400640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c75f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 -- 172.21.15.7:0/2609650920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 msgr2=0x558a65c75f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c75f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 -- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 msgr2=0x558a65c754c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c754c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 -- 172.21.15.7:0/2609650920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a65cf0fd0 con 0x558a65c70ce0 2024-04-23T15:14:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f896a000640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 0x558a65c75a00 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f895c000c00 tx=0x7f895c00b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8f412fadc7398f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.652+0000 7f8960c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f8960c00640 1 -- 172.21.15.7:0/2609650920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c00bdc0 con 0x558a65c70ce0 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f8960c00640 1 -- 172.21.15.7:0/2609650920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f895c005210 con 0x558a65c70ce0 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f896c036040 con 0x558a65c70ce0 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f8960c00640 1 -- 172.21.15.7:0/2609650920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f895c03a050 con 0x558a65c70ce0 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f897cbc6740 10 client.17511 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558a65cf2320 con 0x558a65c70ce0 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.653+0000 7f8960c00640 1 -- 172.21.15.7:0/2609650920 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f896c036040 con 0x558a65c70ce0 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f8960c00640 1 -- 172.21.15.7:0/2609650920 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f895c004930 con 0x558a65c70ce0 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f897cbc6740 10 client.17511 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f897cbc6740 10 client.17511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f897cbc6740 20 client.17511 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f897cbc6740 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65cf28e0 0x558a65cf4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f897cbc6740 4 client.17511 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:14:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a65bde190 con 0x558a65cf28e0 2024-04-23T15:14:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.654+0000 7f8972a00640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65cf28e0 0x558a65cf4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.656+0000 7f8972a00640 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65cf28e0 0x558a65cf4d00 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff9c51dce1426c8 server_cookie=6152adb8f0cd4ce7 in_seq=0 out_seq=0 2024-04-23T15:14:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.656+0000 7f8960c00640 10 client.17511 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f8960c00640 1 -- 172.21.15.7:0/2609650920 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a65bde190 con 0x558a65cf28e0 2024-04-23T15:14:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f8960c00640 10 client.17511 handle_command_reply: tid=0 2024-04-23T15:14:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 client.17511 shutdown 2024-04-23T15:14:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 msgr2=0x558a65c75a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 0x558a65c75a00 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f895c000c00 tx=0x7f895c00b9c0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 shutdown_connections 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558a65cf28e0 0x558a65cf4d00 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a65c7b5a0 0x558a65c75f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558a65c70ce0 0x558a65c75a00 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 --2- 172.21.15.7:0/2609650920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a65c703c0 0x558a65c754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 >> 172.21.15.7:0/2609650920 conn(0x558a65c6c8d0 msgr2=0x558a65c78510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.686+0000 7f8960c00640 0 client.17511 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.687+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 shutdown_connections 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.687+0000 7f897cbc6740 1 -- 172.21.15.7:0/2609650920 wait complete. 2024-04-23T15:14:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.687+0000 7f897cbc6740 20 client.17511 trim_cache size 0 max 16384 2024-04-23T15:14:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:14:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:14:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:14:21.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f89540a3d90 msgr2=0x7f89540a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f89540a3d90 0x7f89540a6250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x558a65c71960 tx=0x7f896400b390 comp rx=0 tx=0).stop 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 msgr2=0x7f897419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 0x7f897419ab00 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f896c031040 tx=0x7f896c003970 comp rx=0 tx=0).stop 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 shutdown_connections 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f89540a3d90 0x7f89540a6250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f897419a650 0x7f897419ab00 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8974109350 0x7f89741a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 --2- 172.21.15.7:0/1932168336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8974104280 0x7f89741a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 >> 172.21.15.7:0/1932168336 conn(0x7f89740ffb20 msgr2=0x7f8974101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 shutdown_connections 2024-04-23T15:14:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:21.688+0000 7f8973e00640 1 -- 172.21.15.7:0/1932168336 wait complete. 2024-04-23T15:14:23.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:22 smithi007 ceph-mon[27906]: pgmap v725: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-04-23T15:14:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:22 smithi186 ceph-mon[31814]: pgmap v725: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-04-23T15:14:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:22 smithi137 ceph-mon[31694]: pgmap v725: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-04-23T15:14:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:24 smithi007 ceph-mon[27906]: pgmap v726: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:24 smithi186 ceph-mon[31814]: pgmap v726: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:24 smithi137 ceph-mon[31694]: pgmap v726: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:27.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:26 smithi007 ceph-mon[27906]: pgmap v727: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:14:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:26 smithi186 ceph-mon[31814]: pgmap v727: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:14:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:26 smithi137 ceph-mon[31694]: pgmap v727: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:14:29.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:28 smithi007 ceph-mon[27906]: pgmap v728: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:28 smithi186 ceph-mon[31814]: pgmap v728: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:28 smithi137 ceph-mon[31694]: pgmap v728: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:30 smithi007 ceph-mon[27906]: pgmap v729: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:14:31.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:30 smithi186 ceph-mon[31814]: pgmap v729: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:14:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:30 smithi137 ceph-mon[31694]: pgmap v729: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:14:33.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:32 smithi007 ceph-mon[27906]: pgmap v730: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:14:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:32 smithi186 ceph-mon[31814]: pgmap v730: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:14:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:32 smithi137 ceph-mon[31694]: pgmap v730: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.841+0000 7ff611800640 1 -- 172.21.15.7:0/893864825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c074cd0 msgr2=0x7ff60c10e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.841+0000 7ff611800640 1 --2- 172.21.15.7:0/893864825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c074cd0 0x7ff60c10e1a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009900 tx=0x7ff5f402a480 comp rx=0 tx=0).stop 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 -- 172.21.15.7:0/893864825 shutdown_connections 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 --2- 172.21.15.7:0/893864825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c10e6e0 0x7ff60c110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 --2- 172.21.15.7:0/893864825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c074cd0 0x7ff60c10e1a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 --2- 172.21.15.7:0/893864825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff60c0743b0 0x7ff60c074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 -- 172.21.15.7:0/893864825 >> 172.21.15.7:0/893864825 conn(0x7ff60c0fd950 msgr2=0x7ff60c0ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 -- 172.21.15.7:0/893864825 shutdown_connections 2024-04-23T15:14:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.842+0000 7ff611800640 1 -- 172.21.15.7:0/893864825 wait complete. 2024-04-23T15:14:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.843+0000 7ff611800640 1 Processor -- start 2024-04-23T15:14:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.843+0000 7ff611800640 1 -- start start 2024-04-23T15:14:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.843+0000 7ff611800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 0x7ff60c1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.843+0000 7ff611800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c074cd0 0x7ff60c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.843+0000 7ff611800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff60c10e6e0 0x7ff60c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff611800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c114280 con 0x7ff60c0743b0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff611800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c114100 con 0x7ff60c074cd0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff611800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c114400 con 0x7ff60c10e6e0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 0x7ff60c1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 0x7ff60c1a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60854/0 (socket says 172.21.15.7:60854) 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 -- 172.21.15.7:0/1104789041 learned_addr learned my addr 172.21.15.7:0/1104789041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff610e00640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff60c10e6e0 0x7ff60c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 -- 172.21.15.7:0/1104789041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff60c10e6e0 msgr2=0x7ff60c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff60c10e6e0 0x7ff60c19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff603400640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c074cd0 0x7ff60c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 -- 172.21.15.7:0/1104789041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c074cd0 msgr2=0x7ff60c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c074cd0 0x7ff60c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff60be00640 1 -- 172.21.15.7:0/1104789041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60c19afd0 con 0x7ff60c0743b0 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.844+0000 7ff603400640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c074cd0 0x7ff60c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:14:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.845+0000 7ff60be00640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 0x7ff60c1a0650 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00d950 tx=0x7ff5fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.845+0000 7ff609600640 1 -- 172.21.15.7:0/1104789041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc017070 con 0x7ff60c0743b0 2024-04-23T15:14:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.845+0000 7ff609600640 1 -- 172.21.15.7:0/1104789041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5fc009c30 con 0x7ff60c0743b0 2024-04-23T15:14:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.845+0000 7ff609600640 1 -- 172.21.15.7:0/1104789041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00f620 con 0x7ff60c0743b0 2024-04-23T15:14:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.845+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60c19b2c0 con 0x7ff60c0743b0 2024-04-23T15:14:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.845+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60c1a75d0 con 0x7ff60c0743b0 2024-04-23T15:14:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.849+0000 7ff609600640 1 -- 172.21.15.7:0/1104789041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff5fc0109a0 con 0x7ff60c0743b0 2024-04-23T15:14:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 Processor -- start 2024-04-23T15:14:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 -- start start 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d457a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d50060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d52990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8e2cab900 con 0x55e8e2d453c0 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e8e2c51f20 con 0x55e8e2d45ce0 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.850+0000 7ff615c3a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e8e2ca78c0 con 0x55e8e2d505a0 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60862/0 (socket says 172.21.15.7:60862) 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 -- 172.21.15.7:0/3443155283 learned_addr learned my addr 172.21.15.7:0/3443155283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff609600640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff5ec0a3d10 0x7ff5ec0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff603400640 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d52990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff60be00640 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d50060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff609600640 1 -- 172.21.15.7:0/1104789041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7ff5fc0d0860 con 0x7ff60c0743b0 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff5ec0a3d10 0x7ff5ec0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 -- 172.21.15.7:0/3443155283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 msgr2=0x55e8e2d52990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d52990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 -- 172.21.15.7:0/3443155283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 msgr2=0x55e8e2d50060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d50060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.851+0000 7ff610e00640 1 -- 172.21.15.7:0/3443155283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e2c76e10 con 0x55e8e2d453c0 2024-04-23T15:14:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.852+0000 7ff610e00640 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d457a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff604013840 tx=0x7ff604013d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1bbd056fc24be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.852+0000 7ff601600640 1 -- 172.21.15.7:0/3443155283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604013250 con 0x55e8e2d453c0 2024-04-23T15:14:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.852+0000 7ff601600640 1 -- 172.21.15.7:0/3443155283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff604003e20 con 0x55e8e2d453c0 2024-04-23T15:14:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.852+0000 7ff601600640 1 -- 172.21.15.7:0/3443155283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040047d0 con 0x55e8e2d453c0 2024-04-23T15:14:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 -- 172.21.15.7:0/3443155283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 msgr2=0x55e8e2d457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff610e00640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff5ec0a3d10 0x7ff5ec0a61d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff604020000 tx=0x7ff60401e000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d457a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff604013840 tx=0x7ff604013d00 comp rx=0 tx=0).stop 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 -- 172.21.15.7:0/3443155283 shutdown_connections 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d50060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d52990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3443155283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d457a0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.853+0000 7ff615c3a740 1 -- 172.21.15.7:0/3443155283 >> 172.21.15.7:0/3443155283 conn(0x55e8e2d418d0 msgr2=0x55e8e2d41cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.854+0000 7ff615c3a740 1 -- 172.21.15.7:0/3443155283 shutdown_connections 2024-04-23T15:14:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.854+0000 7ff615c3a740 1 -- 172.21.15.7:0/3443155283 wait complete. 2024-04-23T15:14:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.854+0000 7ff615c3a740 1 -- start start 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.854+0000 7ff615c3a740 1 Processor -- start 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e8e2d530e0 con 0x55e8e2d453c0 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e8e2c652c0 con 0x55e8e2d505a0 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e8e2d53260 con 0x55e8e2d45ce0 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff615c3a740 10 client.0 _ll_register_callbacks cb 0x55e8e29bda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff60be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff60be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60874/0 (socket says 172.21.15.7:60874) 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.855+0000 7ff60be00640 1 -- 172.21.15.7:0/3531893304 learned_addr learned my addr 172.21.15.7:0/3531893304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff610e00640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff603400640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff60be00640 1 -- 172.21.15.7:0/3531893304 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d45ce0 msgr2=0x55e8e2d4da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff60be00640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff60be00640 1 -- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 msgr2=0x55e8e2d4dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff60be00640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff60be00640 1 -- 172.21.15.7:0/3531893304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e2c75fd0 con 0x55e8e2d453c0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff603400640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff60be00640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4d520 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0988b0 tx=0x7ff5fc020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0ff78b544c6acf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.856+0000 7ff5fa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff5fa000640 1 -- 172.21.15.7:0/3531893304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc020040 con 0x55e8e2d453c0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff5fa000640 1 -- 172.21.15.7:0/3531893304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7ff5fc09b8a0 con 0x55e8e2d453c0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff604003e20 con 0x55e8e2d453c0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff5fa000640 1 -- 172.21.15.7:0/3531893304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff5fc0ce080 con 0x55e8e2d453c0 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff615c3a740 10 client.17523 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e8e29be210 con 0x55e8e2d453c0 2024-04-23T15:14:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.857+0000 7ff5fa000640 1 -- 172.21.15.7:0/3531893304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff604003e20 con 0x55e8e2d453c0 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff5fa000640 1 -- 172.21.15.7:0/3531893304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff5fc0d0ce0 con 0x55e8e2d453c0 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff615c3a740 10 client.17523 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff615c3a740 10 client.17523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff615c3a740 20 client.17523 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2d60600 0x55e8e2d62a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff615c3a740 4 client.17523 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8e2cb9320 con 0x55e8e2d60600 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.858+0000 7ff603400640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2d60600 0x55e8e2d62a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.859+0000 7ff603400640 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2d60600 0x55e8e2d62a10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df31fae717da72da server_cookie=6605916d57088166 in_seq=0 out_seq=0 2024-04-23T15:14:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.859+0000 7ff5fa000640 10 client.17523 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.861+0000 7ff5fa000640 1 -- 172.21.15.7:0/3531893304 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e8e2cb9320 con 0x55e8e2d60600 2024-04-23T15:14:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.861+0000 7ff5fa000640 10 client.17523 handle_command_reply: tid=0 2024-04-23T15:14:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.861+0000 7ff615c3a740 1 client.17523 shutdown 2024-04-23T15:14:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 msgr2=0x55e8e2d4d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4d520 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0988b0 tx=0x7ff5fc020e80 comp rx=0 tx=0).stop 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 shutdown_connections 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2d60600 0x55e8e2d62a10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3531893304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4d520 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 >> 172.21.15.7:0/3531893304 conn(0x55e8e2d418d0 msgr2=0x55e8e2d47650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff5fa000640 0 client.17523 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 shutdown_connections 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 1 -- 172.21.15.7:0/3531893304 wait complete. 2024-04-23T15:14:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.862+0000 7ff615c3a740 20 client.17523 trim_cache size 0 max 16384 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 Processor -- start 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 -- start start 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d47d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c1b1580 con 0x55e8e2d453c0 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c1b30c0 con 0x55e8e2d45ce0 2024-04-23T15:14:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.879+0000 7ff615c3a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c1b1c50 con 0x55e8e2d505a0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60884/0 (socket says 172.21.15.7:60884) 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 -- 172.21.15.7:0/3480719771 learned_addr learned my addr 172.21.15.7:0/3480719771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff610e00640 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff603400640 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d47d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 -- 172.21.15.7:0/3480719771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 msgr2=0x55e8e2d4dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 -- 172.21.15.7:0/3480719771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 msgr2=0x55e8e2d47d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d47d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.880+0000 7ff60be00640 1 -- 172.21.15.7:0/3480719771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e2d52d00 con 0x55e8e2d453c0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.881+0000 7ff60be00640 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4fc50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0058c0 tx=0x7ff5fc0d0be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be9af0ae6210187 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.881+0000 7ff600c00640 1 -- 172.21.15.7:0/3480719771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0b4070 con 0x55e8e2d453c0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.881+0000 7ff600c00640 1 -- 172.21.15.7:0/3480719771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5fc009de0 con 0x55e8e2d453c0 2024-04-23T15:14:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.881+0000 7ff600c00640 1 -- 172.21.15.7:0/3480719771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0cde80 con 0x55e8e2d453c0 2024-04-23T15:14:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 -- 172.21.15.7:0/3480719771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 msgr2=0x55e8e2d4fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4fc50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0058c0 tx=0x7ff5fc0d0be0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 -- 172.21.15.7:0/3480719771 shutdown_connections 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d47d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d505a0 0x55e8e2d4dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 --2- 172.21.15.7:0/3480719771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4fc50 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 -- 172.21.15.7:0/3480719771 >> 172.21.15.7:0/3480719771 conn(0x55e8e2d418d0 msgr2=0x55e8e2d4d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 -- 172.21.15.7:0/3480719771 shutdown_connections 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.882+0000 7ff615c3a740 1 -- 172.21.15.7:0/3480719771 wait complete. 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 -- start start 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 Processor -- start 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2dc5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c1b29f0 con 0x55e8e2d45ce0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c1b2320 con 0x55e8e2d505a0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff60c1af580 con 0x55e8e2d453c0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.883+0000 7ff615c3a740 10 client.0 _ll_register_callbacks cb 0x7ff5fc0986f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60894/0 (socket says 172.21.15.7:60894) 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 -- 172.21.15.7:0/4278291439 learned_addr learned my addr 172.21.15.7:0/4278291439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff60be00640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 -- 172.21.15.7:0/4278291439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d453c0 msgr2=0x55e8e2d4a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff610e00640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2dc5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 -- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 msgr2=0x55e8e2dc5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2dc5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 -- 172.21.15.7:0/4278291439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e2a8a620 con 0x55e8e2d45ce0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff603400640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4ae90 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4032fd0 tx=0x7ff5f40041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f23507892659cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.884+0000 7ff5fa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.885+0000 7ff5fa000640 1 -- 172.21.15.7:0/4278291439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4035040 con 0x55e8e2d45ce0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.885+0000 7ff5fa000640 1 -- 172.21.15.7:0/4278291439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7ff5f4005240 con 0x55e8e2d45ce0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.885+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5fc009de0 con 0x55e8e2d45ce0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.885+0000 7ff5fa000640 1 -- 172.21.15.7:0/4278291439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff5f4005440 con 0x55e8e2d45ce0 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.885+0000 7ff615c3a740 10 client.17529 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.885+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e8e2dc72c0 con 0x55e8e2d45ce0 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff5fa000640 1 -- 172.21.15.7:0/4278291439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5fc009de0 con 0x55e8e2d45ce0 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff5fa000640 1 -- 172.21.15.7:0/4278291439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff5f4045070 con 0x55e8e2d45ce0 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff615c3a740 10 client.17529 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff615c3a740 10 client.17529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff615c3a740 20 client.17529 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff615c3a740 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2dc7a70 0x55e8e2dc9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff615c3a740 4 client.17529 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.886+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8e2cb3190 con 0x55e8e2dc7a70 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.887+0000 7ff60be00640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2dc7a70 0x55e8e2dc9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.888+0000 7ff60be00640 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2dc7a70 0x55e8e2dc9e90 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5afa0725bdefe6e7 server_cookie=cc3a444b59cdc24d in_seq=0 out_seq=0 2024-04-23T15:14:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.888+0000 7ff5fa000640 10 client.17529 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.918+0000 7ff5fa000640 1 -- 172.21.15.7:0/4278291439 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8e2cb3190 con 0x55e8e2dc7a70 2024-04-23T15:14:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.918+0000 7ff5fa000640 10 client.17529 handle_command_reply: tid=0 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.918+0000 7ff615c3a740 1 client.17529 shutdown 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.918+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 msgr2=0x55e8e2d4ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.918+0000 7ff615c3a740 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4ae90 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4032fd0 tx=0x7ff5f40041f0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 shutdown_connections 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e8e2dc7a70 0x55e8e2dc9e90 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e8e2d505a0 0x55e8e2dc5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e8e2d45ce0 0x55e8e2d4ae90 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 --2- 172.21.15.7:0/4278291439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e8e2d453c0 0x55e8e2d4a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff5fa000640 0 client.17529 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 >> 172.21.15.7:0/4278291439 conn(0x55e8e2d418d0 msgr2=0x55e8e2d4dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 shutdown_connections 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 1 -- 172.21.15.7:0/4278291439 wait complete. 2024-04-23T15:14:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.919+0000 7ff615c3a740 20 client.17529 trim_cache size 0 max 16384 2024-04-23T15:14:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:14:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:14:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:14:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff5ec0a3d10 msgr2=0x7ff5ec0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff5ec0a3d10 0x7ff5ec0a61d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff604020000 tx=0x7ff60401e000 comp rx=0 tx=0).stop 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 msgr2=0x7ff60c1a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 0x7ff60c1a0650 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00d950 tx=0x7ff5fc00de10 comp rx=0 tx=0).stop 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 shutdown_connections 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff5ec0a3d10 0x7ff5ec0a61d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff60c074cd0 0x7ff60c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff60c10e6e0 0x7ff60c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 --2- 172.21.15.7:0/1104789041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff60c0743b0 0x7ff60c1a0650 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 >> 172.21.15.7:0/1104789041 conn(0x7ff60c0fd950 msgr2=0x7ff60c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 shutdown_connections 2024-04-23T15:14:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:34.920+0000 7ff611800640 1 -- 172.21.15.7:0/1104789041 wait complete. 2024-04-23T15:14:35.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:34 smithi007 ceph-mon[27906]: pgmap v731: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:35.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:34 smithi186 ceph-mon[31814]: pgmap v731: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:34 smithi137 ceph-mon[31694]: pgmap v731: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:37.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:36 smithi007 ceph-mon[27906]: pgmap v732: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:14:37.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:36 smithi186 ceph-mon[31814]: pgmap v732: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:14:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:36 smithi137 ceph-mon[31694]: pgmap v732: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:14:39.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:38 smithi007 ceph-mon[27906]: pgmap v733: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:14:39.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:38 smithi186 ceph-mon[31814]: pgmap v733: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:14:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:38 smithi137 ceph-mon[31694]: pgmap v733: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:14:41.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:40 smithi007 ceph-mon[27906]: pgmap v734: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:14:41.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:40 smithi186 ceph-mon[31814]: pgmap v734: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:14:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:40 smithi137 ceph-mon[31694]: pgmap v734: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:14:43.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:42 smithi007 ceph-mon[27906]: pgmap v735: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:14:43.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:42 smithi186 ceph-mon[31814]: pgmap v735: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:14:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:42 smithi137 ceph-mon[31694]: pgmap v735: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:14:45.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:44 smithi007 ceph-mon[27906]: pgmap v736: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:45.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:44 smithi186 ceph-mon[31814]: pgmap v736: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:44 smithi137 ceph-mon[31694]: pgmap v736: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:47.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:46 smithi007 ceph-mon[27906]: pgmap v737: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:46 smithi186 ceph-mon[31814]: pgmap v737: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:46 smithi137 ceph-mon[31694]: pgmap v737: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:14:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 -- 172.21.15.7:0/2937807508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 msgr2=0x7f5e2c10ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 --2- 172.21.15.7:0/2937807508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c10ed20 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009ca0 tx=0x7f5e2402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 -- 172.21.15.7:0/2937807508 shutdown_connections 2024-04-23T15:14:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 --2- 172.21.15.7:0/2937807508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c102a30 0x7f5e2c106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 --2- 172.21.15.7:0/2937807508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c10ed20 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 --2- 172.21.15.7:0/2937807508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 0x7f5e2c102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 -- 172.21.15.7:0/2937807508 >> 172.21.15.7:0/2937807508 conn(0x7f5e2c0fd940 msgr2=0x7f5e2c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 -- 172.21.15.7:0/2937807508 shutdown_connections 2024-04-23T15:14:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.077+0000 7f5e31000640 1 -- 172.21.15.7:0/2937807508 wait complete. 2024-04-23T15:14:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.078+0000 7f5e31000640 1 Processor -- start 2024-04-23T15:14:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.078+0000 7f5e31000640 1 -- start start 2024-04-23T15:14:48.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e31000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 0x7f5e2c1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e31000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e31000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c19a6e0 0x7f5e2c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e31000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1120c0 con 0x7f5e2c107150 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e31000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c111f40 con 0x7f5e2c19a6e0 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e31000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c112240 con 0x7f5e2c102080 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c1a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35240/0 (socket says 172.21.15.7:35240) 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.079+0000 7f5e2aa00640 1 -- 172.21.15.7:0/2925971572 learned_addr learned my addr 172.21.15.7:0/2925971572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2b400640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 0x7f5e2c1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2be00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c19a6e0 0x7f5e2c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2aa00640 1 -- 172.21.15.7:0/2925971572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 msgr2=0x7f5e2c1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 0x7f5e2c1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2aa00640 1 -- 172.21.15.7:0/2925971572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c19a6e0 msgr2=0x7f5e2c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c19a6e0 0x7f5e2c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2aa00640 1 -- 172.21.15.7:0/2925971572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c19b2e0 con 0x7f5e2c107150 2024-04-23T15:14:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2b400640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 0x7f5e2c1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:14:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c1a0b60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800d770 tx=0x7f5e1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.080+0000 7f5e23e00640 1 -- 172.21.15.7:0/2925971572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18017070 con 0x7f5e2c107150 2024-04-23T15:14:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.081+0000 7f5e23e00640 1 -- 172.21.15.7:0/2925971572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e18009c30 con 0x7f5e2c107150 2024-04-23T15:14:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.081+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c1a73c0 con 0x7f5e2c107150 2024-04-23T15:14:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.081+0000 7f5e23e00640 1 -- 172.21.15.7:0/2925971572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800f620 con 0x7f5e2c107150 2024-04-23T15:14:48.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.081+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c1a77c0 con 0x7f5e2c107150 2024-04-23T15:14:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.085+0000 7f5e23e00640 1 -- 172.21.15.7:0/2925971572 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5e1801a070 con 0x7f5e2c107150 2024-04-23T15:14:48.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.085+0000 7f5e35422740 1 Processor -- start 2024-04-23T15:14:48.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.085+0000 7f5e35422740 1 -- start start 2024-04-23T15:14:48.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.085+0000 7f5e35422740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa85f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.085+0000 7f5e35422740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85ff060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e35422740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 0x563fa8601990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e35422740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563fa855a900 con 0x563fa85ff5a0 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e35422740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563fa8500f20 con 0x563fa85f4ce0 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e35422740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563fa85568c0 con 0x563fa85f43c0 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 0x563fa8601990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 0x563fa8601990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35244/0 (socket says 172.21.15.7:35244) 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e2aa00640 1 -- 172.21.15.7:0/93132672 learned_addr learned my addr 172.21.15.7:0/93132672 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e2be00640 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa85f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.086+0000 7f5e2b400640 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2aa00640 1 -- 172.21.15.7:0/93132672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 msgr2=0x563fa85f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa85f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e23e00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5e100a3d10 0x7f5e100a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2aa00640 1 -- 172.21.15.7:0/93132672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 msgr2=0x563fa85ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85ff060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2aa00640 1 -- 172.21.15.7:0/93132672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa8525e10 con 0x563fa85ff5a0 2024-04-23T15:14:48.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e23e00640 1 -- 172.21.15.7:0/2925971572 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f5e180d0760 con 0x7f5e2c107150 2024-04-23T15:14:48.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2be00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5e100a3d10 0x7f5e100a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 0x563fa8601990 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cd9e0 tx=0x7f5e180d6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3080942bd3a6a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e20c00640 1 -- 172.21.15.7:0/93132672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18021070 con 0x563fa85ff5a0 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e20c00640 1 -- 172.21.15.7:0/93132672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e180b1690 con 0x563fa85ff5a0 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.087+0000 7f5e20c00640 1 -- 172.21.15.7:0/93132672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18096e60 con 0x563fa85ff5a0 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.088+0000 7f5e35422740 1 -- 172.21.15.7:0/93132672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 msgr2=0x563fa8601990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.088+0000 7f5e2be00640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5e100a3d10 0x7f5e100a61d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005cc0 tx=0x7f5e24031b20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.088+0000 7f5e35422740 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 0x563fa8601990 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cd9e0 tx=0x7f5e180d6f40 comp rx=0 tx=0).stop 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 -- 172.21.15.7:0/93132672 shutdown_connections 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85ff5a0 0x563fa8601990 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 --2- 172.21.15.7:0/93132672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa85f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 -- 172.21.15.7:0/93132672 >> 172.21.15.7:0/93132672 conn(0x563fa85f08d0 msgr2=0x563fa85f0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 -- 172.21.15.7:0/93132672 shutdown_connections 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 -- 172.21.15.7:0/93132672 wait complete. 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 -- start start 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.089+0000 7f5e35422740 1 Processor -- start 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85fc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85ff5a0 0x563fa85fd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563fa8601ff0 con 0x563fa85f43c0 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563fa85142c0 con 0x563fa85f4ce0 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563fa8602170 con 0x563fa85ff5a0 2024-04-23T15:14:48.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e35422740 10 client.0 _ll_register_callbacks cb 0x563fa826ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:48.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e2b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e2b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85fc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35252/0 (socket says 172.21.15.7:35252) 2024-04-23T15:14:48.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e2b400640 1 -- 172.21.15.7:0/2247516266 learned_addr learned my addr 172.21.15.7:0/2247516266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:48.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.090+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2be00640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85ff5a0 0x563fa85fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2b400640 1 -- 172.21.15.7:0/2247516266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85ff5a0 msgr2=0x563fa85fd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2b400640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85ff5a0 0x563fa85fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2b400640 1 -- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 msgr2=0x563fa85fcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2b400640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85fcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2b400640 1 -- 172.21.15.7:0/2247516266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa8524fd0 con 0x563fa85f43c0 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e2b400640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85fc680 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00bf80 tx=0x7f5e1c011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b396a74f812cd0e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e15600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e15600640 1 -- 172.21.15.7:0/2247516266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c005220 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e15600640 1 -- 172.21.15.7:0/2247516266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f5e1c0053c0 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.091+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563fa8568320 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.092+0000 7f5e15600640 1 -- 172.21.15.7:0/2247516266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5e1c0055c0 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.092+0000 7f5e35422740 10 client.17541 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.092+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563fa826d210 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.092+0000 7f5e15600640 1 -- 172.21.15.7:0/2247516266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x563fa8568320 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.092+0000 7f5e15600640 1 -- 172.21.15.7:0/2247516266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5e1c0129d0 con 0x563fa85f43c0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e35422740 10 client.17541 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e35422740 10 client.17541 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e35422740 20 client.17541 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e35422740 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa860f870 0x563fa8611c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e35422740 4 client.17541 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fa8562190 con 0x563fa860f870 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.093+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa860f870 0x563fa8611c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.094+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa860f870 0x563fa8611c60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc975d7d38b514c server_cookie=bea303bf860d263d in_seq=0 out_seq=0 2024-04-23T15:14:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.094+0000 7f5e15600640 10 client.17541 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e15600640 1 -- 172.21.15.7:0/2247516266 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563fa8562190 con 0x563fa860f870 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e15600640 10 client.17541 handle_command_reply: tid=0 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 client.17541 shutdown 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 msgr2=0x563fa85fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85fc680 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00bf80 tx=0x7f5e1c011870 comp rx=0 tx=0).stop 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 shutdown_connections 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa860f870 0x563fa8611c60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85ff5a0 0x563fa85fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 --2- 172.21.15.7:0/2247516266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85fc680 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 >> 172.21.15.7:0/2247516266 conn(0x563fa85f08d0 msgr2=0x563fa85f6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.096+0000 7f5e15600640 0 client.17541 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.097+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 shutdown_connections 2024-04-23T15:14:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.097+0000 7f5e35422740 1 -- 172.21.15.7:0/2247516266 wait complete. 2024-04-23T15:14:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.097+0000 7f5e35422740 20 client.17541 trim_cache size 0 max 16384 2024-04-23T15:14:48.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.113+0000 7f5e35422740 1 Processor -- start 2024-04-23T15:14:48.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.113+0000 7f5e35422740 1 -- start start 2024-04-23T15:14:48.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e35422740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f08d0 0x563fa85fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e35422740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85f0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e35422740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e35422740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1b1510 con 0x563fa85f43c0 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e35422740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1b3050 con 0x563fa85f4ce0 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e35422740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1b1be0 con 0x563fa85f08d0 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85f0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35268/0 (socket says 172.21.15.7:35268) 2024-04-23T15:14:48.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 -- 172.21.15.7:0/1184247634 learned_addr learned my addr 172.21.15.7:0/1184247634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2b400640 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f08d0 0x563fa85fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 -- 172.21.15.7:0/1184247634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f08d0 msgr2=0x563fa85fedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2be00640 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f08d0 0x563fa85fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 -- 172.21.15.7:0/1184247634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 msgr2=0x563fa85f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.114+0000 7f5e2aa00640 1 -- 172.21.15.7:0/1184247634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa8339620 con 0x563fa85f43c0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.115+0000 7f5e2be00640 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.115+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85f0210 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5e18098cc0 tx=0x7f5e180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2387d618c7d31453 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.115+0000 7f5e17e00640 1 -- 172.21.15.7:0/1184247634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18096e60 con 0x563fa85f43c0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.115+0000 7f5e17e00640 1 -- 172.21.15.7:0/1184247634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e1809c9f0 con 0x563fa85f43c0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.115+0000 7f5e17e00640 1 -- 172.21.15.7:0/1184247634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18021040 con 0x563fa85f43c0 2024-04-23T15:14:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 -- 172.21.15.7:0/1184247634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 msgr2=0x563fa85f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85f0210 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5e18098cc0 tx=0x7f5e180057f0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 -- 172.21.15.7:0/1184247634 shutdown_connections 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f4ce0 0x563fa85f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f43c0 0x563fa85f0210 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 --2- 172.21.15.7:0/1184247634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f08d0 0x563fa85fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 -- 172.21.15.7:0/1184247634 >> 172.21.15.7:0/1184247634 conn(0x563fa85ebe60 msgr2=0x563fa85fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 -- 172.21.15.7:0/1184247634 shutdown_connections 2024-04-23T15:14:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.116+0000 7f5e35422740 1 -- 172.21.15.7:0/1184247634 wait complete. 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 -- start start 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 Processor -- start 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f08d0 0x563fa8607aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa8602e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 0x563fa8603550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1b2980 con 0x563fa85f4ce0 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1b22b0 con 0x563fa85f08d0 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c1af510 con 0x563fa85f43c0 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.117+0000 7f5e35422740 10 client.0 _ll_register_callbacks cb 0x7f5e1c00b4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 0x563fa8603550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 0x563fa8603550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35284/0 (socket says 172.21.15.7:35284) 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 -- 172.21.15.7:0/1531576653 learned_addr learned my addr 172.21.15.7:0/1531576653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2aa00640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa8602e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2b400640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f08d0 0x563fa8607aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 -- 172.21.15.7:0/1531576653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 msgr2=0x563fa8602e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa8602e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 -- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f08d0 msgr2=0x563fa8607aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f08d0 0x563fa8607aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2be00640 1 -- 172.21.15.7:0/1531576653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa8674da0 con 0x563fa85f4ce0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.118+0000 7f5e2b400640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f08d0 0x563fa8607aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e2be00640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 0x563fa8603550 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f5e2402ade0 tx=0x7f5e2402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42cda6888bd61b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e15600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e15600640 1 -- 172.21.15.7:0/1531576653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24057060 con 0x563fa85f4ce0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e15600640 1 -- 172.21.15.7:0/1531576653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f5e24003c40 con 0x563fa85f4ce0 2024-04-23T15:14:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e1809c9f0 con 0x563fa85f4ce0 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e15600640 1 -- 172.21.15.7:0/1531576653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5e2405e050 con 0x563fa85f4ce0 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e35422740 10 client.17547 fetch_fsmap learned FSMap version 32 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.119+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563fa8675e60 con 0x563fa85f4ce0 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e15600640 1 -- 172.21.15.7:0/1531576653 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e1809c9f0 con 0x563fa85f4ce0 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e15600640 1 -- 172.21.15.7:0/1531576653 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5e24030820 con 0x563fa85f4ce0 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e35422740 10 client.17547 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e35422740 10 client.17547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e35422740 20 client.17547 populate_metadata read hostname 'smithi007' 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e35422740 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa85ff5a0 0x563fa8678620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e35422740 4 client.17547 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:14:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.120+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fa84de4b0 con 0x563fa85ff5a0 2024-04-23T15:14:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.121+0000 7f5e2b400640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa85ff5a0 0x563fa8678620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:14:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.122+0000 7f5e2b400640 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa85ff5a0 0x563fa8678620 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a783212805e1c694 server_cookie=9fddb270a867d731 in_seq=0 out_seq=0 2024-04-23T15:14:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.122+0000 7f5e15600640 10 client.17547 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:48.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e15600640 1 -- 172.21.15.7:0/1531576653 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fa84de4b0 con 0x563fa85ff5a0 2024-04-23T15:14:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e15600640 10 client.17547 handle_command_reply: tid=0 2024-04-23T15:14:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 client.17547 shutdown 2024-04-23T15:14:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 msgr2=0x563fa8603550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 0x563fa8603550 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f5e2402ade0 tx=0x7f5e2402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 shutdown_connections 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563fa85ff5a0 0x563fa8678620 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fa85f4ce0 0x563fa8603550 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fa85f43c0 0x563fa8602e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 --2- 172.21.15.7:0/1531576653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563fa85f08d0 0x563fa8607aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 >> 172.21.15.7:0/1531576653 conn(0x563fa85ebe60 msgr2=0x563fa85ef200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.186+0000 7f5e15600640 0 client.17547 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:14:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.187+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 shutdown_connections 2024-04-23T15:14:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.187+0000 7f5e35422740 1 -- 172.21.15.7:0/1531576653 wait complete. 2024-04-23T15:14:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.187+0000 7f5e35422740 20 client.17547 trim_cache size 0 max 16384 2024-04-23T15:14:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:14:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:14:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:14:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5e100a3d10 msgr2=0x7f5e100a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5e100a3d10 0x7f5e100a61d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005cc0 tx=0x7f5e24031b20 comp rx=0 tx=0).stop 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 msgr2=0x7f5e2c1a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c1a0b60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800d770 tx=0x7f5e1800dc30 comp rx=0 tx=0).stop 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 shutdown_connections 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5e100a3d10 0x7f5e100a61d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e2c19a6e0 0x7f5e2c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e2c107150 0x7f5e2c1a0b60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 --2- 172.21.15.7:0/2925971572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e2c102080 0x7f5e2c1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:14:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.188+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 >> 172.21.15.7:0/2925971572 conn(0x7f5e2c0fd940 msgr2=0x7f5e2c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:14:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.189+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 shutdown_connections 2024-04-23T15:14:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:14:48.189+0000 7f5e31000640 1 -- 172.21.15.7:0/2925971572 wait complete. 2024-04-23T15:14:49.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:48 smithi007 ceph-mon[27906]: pgmap v738: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:48 smithi186 ceph-mon[31814]: pgmap v738: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:48 smithi137 ceph-mon[31694]: pgmap v738: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:51.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:50 smithi007 ceph-mon[27906]: pgmap v739: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:14:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:50 smithi186 ceph-mon[31814]: pgmap v739: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:14:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:50 smithi137 ceph-mon[31694]: pgmap v739: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:14:53.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:52 smithi186 ceph-mon[31814]: pgmap v740: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:14:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:52 smithi137 ceph-mon[31694]: pgmap v740: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:14:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:52 smithi007 ceph-mon[27906]: pgmap v740: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:14:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:54 smithi186 ceph-mon[31814]: pgmap v741: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:54 smithi137 ceph-mon[31694]: pgmap v741: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:54 smithi007 ceph-mon[27906]: pgmap v741: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:14:57.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:56 smithi186 ceph-mon[31814]: pgmap v742: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:14:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:56 smithi137 ceph-mon[31694]: pgmap v742: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:14:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:56 smithi007 ceph-mon[27906]: pgmap v742: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:14:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:14:58 smithi186 ceph-mon[31814]: pgmap v743: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:14:58 smithi137 ceph-mon[31694]: pgmap v743: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:14:59.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:14:58 smithi007 ceph-mon[27906]: pgmap v743: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:15:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:00 smithi137 ceph-mon[31694]: pgmap v744: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:00 smithi007 ceph-mon[27906]: pgmap v744: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 -- 172.21.15.7:0/2076879119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf4104c50 msgr2=0x7f5cf4108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 --2- 172.21.15.7:0/2076879119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf4104c50 0x7f5cf4108c90 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009ca0 tx=0x7f5cdc02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 -- 172.21.15.7:0/2076879119 shutdown_connections 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 --2- 172.21.15.7:0/2076879119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 0x7f5cf4110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 --2- 172.21.15.7:0/2076879119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf4104c50 0x7f5cf4108c90 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 --2- 172.21.15.7:0/2076879119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf41042a0 0x7f5cf4104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 -- 172.21.15.7:0/2076879119 >> 172.21.15.7:0/2076879119 conn(0x7f5cf40ffae0 msgr2=0x7f5cf4101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 -- 172.21.15.7:0/2076879119 shutdown_connections 2024-04-23T15:15:01.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.359+0000 7f5cf9400640 1 -- 172.21.15.7:0/2076879119 wait complete. 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.360+0000 7f5cf9400640 1 Processor -- start 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.360+0000 7f5cf9400640 1 -- start start 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.360+0000 7f5cf9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 0x7f5cf41a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 0x7f5cf41a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf419a770 0x7f5cf419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41142b0 con 0x7f5cf41042a0 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4114130 con 0x7f5cf4109370 2024-04-23T15:15:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf9400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4114430 con 0x7f5cf419a770 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 0x7f5cf41a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 0x7f5cf41a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46134/0 (socket says 172.21.15.7:46134) 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 -- 172.21.15.7:0/3447389407 learned_addr learned my addr 172.21.15.7:0/3447389407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf419a770 0x7f5cf419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5ceb400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 0x7f5cf41a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 -- 172.21.15.7:0/3447389407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf419a770 msgr2=0x7f5cf419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf419a770 0x7f5cf419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 -- 172.21.15.7:0/3447389407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 msgr2=0x7f5cf41a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 0x7f5cf41a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf3e00640 1 -- 172.21.15.7:0/3447389407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf419b370 con 0x7f5cf41042a0 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5ceb400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 0x7f5cf41a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.361+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf419a770 0x7f5cf419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.362+0000 7f5cf3e00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 0x7f5cf41a0660 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400d770 tx=0x7f5ce400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.362+0000 7f5cf1600640 1 -- 172.21.15.7:0/3447389407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5cf41042a0 2024-04-23T15:15:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.362+0000 7f5cf1600640 1 -- 172.21.15.7:0/3447389407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ce40054d0 con 0x7f5cf41042a0 2024-04-23T15:15:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.362+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf41a7400 con 0x7f5cf41042a0 2024-04-23T15:15:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.362+0000 7f5cf1600640 1 -- 172.21.15.7:0/3447389407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4004cf0 con 0x7f5cf41042a0 2024-04-23T15:15:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.362+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf41a77b0 con 0x7f5cf41042a0 2024-04-23T15:15:01.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:00 smithi186 ceph-mon[31814]: pgmap v744: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.366+0000 7f5cfd825740 1 Processor -- start 2024-04-23T15:15:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 -- start start 2024-04-23T15:15:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cf1600640 1 -- 172.21.15.7:0/3447389407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5ce4004e90 con 0x7f5cf41042a0 2024-04-23T15:15:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x55865343b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343bce0 0x558653446060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534465a0 0x558653448990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5586533a1900 con 0x55865343b3c0 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558653347f20 con 0x5586534465a0 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cfd825740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55865339d8c0 con 0x55865343bce0 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.367+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x55865343b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x55865343b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46136/0 (socket says 172.21.15.7:46136) 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 -- 172.21.15.7:0/864944604 learned_addr learned my addr 172.21.15.7:0/864944604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf3e00640 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343bce0 0x558653446060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5ceb400640 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534465a0 0x558653448990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 -- 172.21.15.7:0/864944604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343bce0 msgr2=0x558653446060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343bce0 0x558653446060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 -- 172.21.15.7:0/864944604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534465a0 msgr2=0x558653448990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534465a0 0x558653448990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 -- 172.21.15.7:0/864944604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865336ce10 con 0x55865343b3c0 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.368+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x55865343b7a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009b50 tx=0x7f5cec00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94a5db61d774c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.369+0000 7f5ce9200640 1 -- 172.21.15.7:0/864944604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec016070 con 0x55865343b3c0 2024-04-23T15:15:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.369+0000 7f5ce9200640 1 -- 172.21.15.7:0/864944604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5cec009e40 con 0x55865343b3c0 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.369+0000 7f5ce9200640 1 -- 172.21.15.7:0/864944604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec010790 con 0x55865343b3c0 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.369+0000 7f5cf1600640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5cd80a3d10 0x7f5cd80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.369+0000 7f5cf1600640 1 -- 172.21.15.7:0/3447389407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f5ce40d0340 con 0x7f5cf41042a0 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.369+0000 7f5cf3e00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5cd80a3d10 0x7f5cd80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 -- 172.21.15.7:0/864944604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 msgr2=0x55865343b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x55865343b7a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009b50 tx=0x7f5cec00e6c0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 -- 172.21.15.7:0/864944604 shutdown_connections 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534465a0 0x558653448990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343bce0 0x558653446060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 --2- 172.21.15.7:0/864944604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x55865343b7a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 -- 172.21.15.7:0/864944604 >> 172.21.15.7:0/864944604 conn(0x5586534378d0 msgr2=0x558653437cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cf3e00640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5cd80a3d10 0x7f5cd80a61d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40cd790 tx=0x7f5ce40d0610 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 -- 172.21.15.7:0/864944604 shutdown_connections 2024-04-23T15:15:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.370+0000 7f5cfd825740 1 -- 172.21.15.7:0/864944604 wait complete. 2024-04-23T15:15:01.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.371+0000 7f5cfd825740 1 -- start start 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.371+0000 7f5cfd825740 1 Processor -- start 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.371+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x558653443690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343bce0 0x558653443bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534465a0 0x558653444110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cfd825740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5586534490e0 con 0x55865343b3c0 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cfd825740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55865335b2c0 con 0x55865343bce0 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cfd825740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558653449260 con 0x5586534465a0 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cfd825740 10 client.0 _ll_register_callbacks cb 0x5586530b3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x558653443690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x558653443690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46140/0 (socket says 172.21.15.7:46140) 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cf8a00640 1 -- 172.21.15.7:0/2409709048 learned_addr learned my addr 172.21.15.7:0/2409709048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5ceb400640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343bce0 0x558653443bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.372+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534465a0 0x558653444110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5cf8a00640 1 -- 172.21.15.7:0/2409709048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534465a0 msgr2=0x558653444110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534465a0 0x558653444110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5cf8a00640 1 -- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343bce0 msgr2=0x558653443bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343bce0 0x558653443bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5cf8a00640 1 -- 172.21.15.7:0/2409709048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865336bfd0 con 0x55865343b3c0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x558653443690 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x558653432960 tx=0x7f5cec005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee8f0ef82a39875 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5ce1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5ce1600640 1 -- 172.21.15.7:0/2409709048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec016070 con 0x55865343b3c0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.373+0000 7f5ce1600640 1 -- 172.21.15.7:0/2409709048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f5cec004b00 con 0x55865343b3c0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.374+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586533af320 con 0x55865343b3c0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.374+0000 7f5ce1600640 1 -- 172.21.15.7:0/2409709048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5cec031050 con 0x55865343b3c0 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.374+0000 7f5cfd825740 10 client.17559 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.374+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5586530b4210 con 0x55865343b3c0 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.374+0000 7f5ce1600640 1 -- 172.21.15.7:0/2409709048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5586533af320 con 0x55865343b3c0 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.374+0000 7f5ce1600640 1 -- 172.21.15.7:0/2409709048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5cec00f040 con 0x55865343b3c0 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5cfd825740 10 client.17559 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5cfd825740 10 client.17559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5cfd825740 20 client.17559 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5cfd825740 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558653456680 0x558653458a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5cfd825740 4 client.17559 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:15:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586533a9190 con 0x558653456680 2024-04-23T15:15:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.375+0000 7f5ceb400640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558653456680 0x558653458a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.376+0000 7f5ceb400640 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558653456680 0x558653458a70 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=393233b1b8f7c56c server_cookie=30e5b76daf44c39b in_seq=0 out_seq=0 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.376+0000 7f5ce1600640 10 client.17559 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.378+0000 7f5ce1600640 1 -- 172.21.15.7:0/2409709048 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5586533a9190 con 0x558653456680 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.378+0000 7f5ce1600640 10 client.17559 handle_command_reply: tid=0 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.378+0000 7f5cfd825740 1 client.17559 shutdown 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.378+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 msgr2=0x558653443690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.378+0000 7f5cfd825740 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x558653443690 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x558653432960 tx=0x7f5cec005e50 comp rx=0 tx=0).stop 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 shutdown_connections 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558653456680 0x558653458a70 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343bce0 0x558653443bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534465a0 0x558653444110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 --2- 172.21.15.7:0/2409709048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343b3c0 0x558653443690 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5ce1600640 0 client.17559 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 >> 172.21.15.7:0/2409709048 conn(0x5586534378d0 msgr2=0x55865343d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 shutdown_connections 2024-04-23T15:15:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 1 -- 172.21.15.7:0/2409709048 wait complete. 2024-04-23T15:15:01.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.379+0000 7f5cfd825740 20 client.17559 trim_cache size 0 max 16384 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 Processor -- start 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 -- start start 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534378d0 0x558653445dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343b3c0 0x558653437210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653442f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41b1570 con 0x55865343bce0 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41b30b0 con 0x55865343b3c0 2024-04-23T15:15:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.396+0000 7f5cfd825740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41b1c40 con 0x5586534378d0 2024-04-23T15:15:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653442f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653442f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46148/0 (socket says 172.21.15.7:46148) 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 -- 172.21.15.7:0/4019588103 learned_addr learned my addr 172.21.15.7:0/4019588103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5ceb400640 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343b3c0 0x558653437210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534378d0 0x558653445dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 -- 172.21.15.7:0/4019588103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534378d0 msgr2=0x558653445dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534378d0 0x558653445dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 -- 172.21.15.7:0/4019588103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343b3c0 msgr2=0x558653437210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343b3c0 0x558653437210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.397+0000 7f5cf8a00640 1 -- 172.21.15.7:0/4019588103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558653180620 con 0x55865343bce0 2024-04-23T15:15:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.398+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653442f70 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5cec010430 tx=0x7f5cec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3cf018847cbcce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.398+0000 7f5ce3e00640 1 -- 172.21.15.7:0/4019588103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec016040 con 0x55865343bce0 2024-04-23T15:15:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.398+0000 7f5ce3e00640 1 -- 172.21.15.7:0/4019588103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5cec005540 con 0x55865343bce0 2024-04-23T15:15:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.398+0000 7f5ce3e00640 1 -- 172.21.15.7:0/4019588103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec024040 con 0x55865343bce0 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 -- 172.21.15.7:0/4019588103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 msgr2=0x558653442f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653442f70 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5cec010430 tx=0x7f5cec001e70 comp rx=0 tx=0).stop 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 -- 172.21.15.7:0/4019588103 shutdown_connections 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55865343b3c0 0x558653437210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653442f70 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 --2- 172.21.15.7:0/4019588103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586534378d0 0x558653445dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 -- 172.21.15.7:0/4019588103 >> 172.21.15.7:0/4019588103 conn(0x55865343dae0 msgr2=0x558653443ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:01.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 -- 172.21.15.7:0/4019588103 shutdown_connections 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.399+0000 7f5cfd825740 1 -- 172.21.15.7:0/4019588103 wait complete. 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 -- start start 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 Processor -- start 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534378d0 0x55865344e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343b3c0 0x55865344eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653449b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41b29e0 con 0x55865343bce0 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41b2310 con 0x5586534378d0 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41af570 con 0x55865343b3c0 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.400+0000 7f5cfd825740 10 client.0 _ll_register_callbacks cb 0x7f5cec0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653449b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653449b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46158/0 (socket says 172.21.15.7:46158) 2024-04-23T15:15:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 -- 172.21.15.7:0/1386965445 learned_addr learned my addr 172.21.15.7:0/1386965445 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5ceb400640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343b3c0 0x55865344eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534378d0 0x55865344e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 -- 172.21.15.7:0/1386965445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343b3c0 msgr2=0x55865344eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343b3c0 0x55865344eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 -- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534378d0 msgr2=0x55865344e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534378d0 0x55865344e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5cf8a00640 1 -- 172.21.15.7:0/1386965445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865344a330 con 0x55865343bce0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.401+0000 7f5ceb400640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343b3c0 0x55865344eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5cf8a00640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653449b30 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f5cec02b6c0 tx=0x7f5cec009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e9f61c62958a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5ce1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5ce1600640 1 -- 172.21.15.7:0/1386965445 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec016040 con 0x55865343bce0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cec005540 con 0x55865343bce0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5ce1600640 1 -- 172.21.15.7:0/1386965445 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9467+0+0 (secure 0 0 0) 0x7f5cec004b00 con 0x55865343bce0 2024-04-23T15:15:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5ce1600640 1 -- 172.21.15.7:0/1386965445 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5cec00ebc0 con 0x55865343bce0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5cfd825740 10 client.17565 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.402+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5586534c4e90 con 0x55865343bce0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5ce1600640 1 -- 172.21.15.7:0/1386965445 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5cec005540 con 0x55865343bce0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5ce1600640 1 -- 172.21.15.7:0/1386965445 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5cec011590 con 0x55865343bce0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5cfd825740 10 client.17565 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5cfd825740 10 client.17565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5cfd825740 20 client.17565 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5cfd825740 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586534465a0 0x5586534c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5cfd825740 4 client.17565 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.403+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586533254b0 con 0x5586534465a0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.404+0000 7f5ceb400640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586534465a0 0x5586534c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.405+0000 7f5ceb400640 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586534465a0 0x5586534c7570 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b93a99b687aed92 server_cookie=7ee6aeadba1352b6 in_seq=0 out_seq=0 2024-04-23T15:15:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.405+0000 7f5ce1600640 10 client.17565 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.435+0000 7f5ce1600640 1 -- 172.21.15.7:0/1386965445 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586533254b0 con 0x5586534465a0 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.435+0000 7f5ce1600640 10 client.17565 handle_command_reply: tid=0 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 client.17565 shutdown 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 msgr2=0x558653449b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653449b30 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f5cec02b6c0 tx=0x7f5cec009550 comp rx=0 tx=0).stop 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 shutdown_connections 2024-04-23T15:15:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5586534465a0 0x5586534c7570 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55865343bce0 0x558653449b30 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55865343b3c0 0x55865344eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 --2- 172.21.15.7:0/1386965445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5586534378d0 0x55865344e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 >> 172.21.15.7:0/1386965445 conn(0x55865343dae0 msgr2=0x558653436200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5ce1600640 0 client.17565 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 shutdown_connections 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 1 -- 172.21.15.7:0/1386965445 wait complete. 2024-04-23T15:15:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.436+0000 7f5cfd825740 20 client.17565 trim_cache size 0 max 16384 2024-04-23T15:15:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:15:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:15:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:15:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:15:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5cd80a3d10 msgr2=0x7f5cd80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5cd80a3d10 0x7f5cd80a61d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40cd790 tx=0x7f5ce40d0610 comp rx=0 tx=0).stop 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 msgr2=0x7f5cf41a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 0x7f5cf41a0660 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400d770 tx=0x7f5ce400dc30 comp rx=0 tx=0).stop 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 shutdown_connections 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5cd80a3d10 0x7f5cd80a61d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf4109370 0x7f5cf41a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cf419a770 0x7f5cf419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 --2- 172.21.15.7:0/3447389407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf41042a0 0x7f5cf41a0660 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.437+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 >> 172.21.15.7:0/3447389407 conn(0x7f5cf40ffae0 msgr2=0x7f5cf4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.438+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 shutdown_connections 2024-04-23T15:15:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:01.438+0000 7f5cf9400640 1 -- 172.21.15.7:0/3447389407 wait complete. 2024-04-23T15:15:03.167 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:02 smithi186 ceph-mon[31814]: pgmap v745: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:02 smithi137 ceph-mon[31694]: pgmap v745: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:02 smithi007 ceph-mon[27906]: pgmap v745: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:03 smithi137 ceph-mon[31694]: osdmap e127: 12 total, 12 up, 12 in 2024-04-23T15:15:04.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:03 smithi007 ceph-mon[27906]: osdmap e127: 12 total, 12 up, 12 in 2024-04-23T15:15:04.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:03 smithi186 ceph-mon[31814]: osdmap e127: 12 total, 12 up, 12 in 2024-04-23T15:15:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:04 smithi137 ceph-mon[31694]: pgmap v747: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:15:05.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:04 smithi007 ceph-mon[27906]: pgmap v747: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:15:05.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:04 smithi186 ceph-mon[31814]: pgmap v747: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:15:06.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:05 smithi007 ceph-mon[27906]: pgmap v748: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:15:06.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:05 smithi186 ceph-mon[31814]: pgmap v748: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:15:06.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:05 smithi137 ceph-mon[31694]: pgmap v748: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:15:08.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:08 smithi007 ceph-mon[27906]: pgmap v749: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:15:08.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:08 smithi186 ceph-mon[31814]: pgmap v749: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:15:08.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:08 smithi137 ceph-mon[31694]: pgmap v749: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:15:10.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:10 smithi007 ceph-mon[27906]: pgmap v750: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:15:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:10 smithi186 ceph-mon[31814]: pgmap v750: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:15:10.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:10 smithi137 ceph-mon[31694]: pgmap v750: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:15:12.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:11 smithi007 ceph-mon[27906]: osdmap e128: 12 total, 12 up, 12 in 2024-04-23T15:15:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:11 smithi186 ceph-mon[31814]: osdmap e128: 12 total, 12 up, 12 in 2024-04-23T15:15:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:11 smithi137 ceph-mon[31694]: osdmap e128: 12 total, 12 up, 12 in 2024-04-23T15:15:13.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:12 smithi007 ceph-mon[27906]: pgmap v752: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-04-23T15:15:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:12 smithi186 ceph-mon[31814]: pgmap v752: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-04-23T15:15:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:12 smithi137 ceph-mon[31694]: pgmap v752: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 -- 172.21.15.7:0/1376828384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd0108fb0 msgr2=0x7fcfd01154c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/1376828384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd0108fb0 0x7fcfd01154c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009cd0 tx=0x7fcfc802a8f0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 -- 172.21.15.7:0/1376828384 shutdown_connections 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/1376828384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd0108fb0 0x7fcfd01154c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/1376828384 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd01085f0 0x7fcfd0108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/1376828384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 0x7fcfd010ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 -- 172.21.15.7:0/1376828384 >> 172.21.15.7:0/1376828384 conn(0x7fcfd0076590 msgr2=0x7fcfd00789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:14.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 -- 172.21.15.7:0/1376828384 shutdown_connections 2024-04-23T15:15:14.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.588+0000 7fcfd6a00640 1 -- 172.21.15.7:0/1376828384 wait complete. 2024-04-23T15:15:14.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 Processor -- start 2024-04-23T15:15:14.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 -- start start 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 0x7fcfd01a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd0108fb0 0x7fcfd01a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 0x7fcfd019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd0118880 con 0x7fcfd01085f0 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd0118700 con 0x7fcfd010e690 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.590+0000 7fcfd6a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd0118a00 con 0x7fcfd0108fb0 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 0x7fcfd01a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 0x7fcfd01a4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57888/0 (socket says 172.21.15.7:57888) 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 -- 172.21.15.7:0/356385651 learned_addr learned my addr 172.21.15.7:0/356385651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcf400640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd0108fb0 0x7fcfd01a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 0x7fcfd019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 -- 172.21.15.7:0/356385651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd0108fb0 msgr2=0x7fcfd01a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd0108fb0 0x7fcfd01a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 -- 172.21.15.7:0/356385651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 msgr2=0x7fcfd019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 0x7fcfd019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfcfe00640 1 -- 172.21.15.7:0/356385651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd019f440 con 0x7fcfd01085f0 2024-04-23T15:15:14.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.591+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 0x7fcfd019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.592+0000 7fcfcfe00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 0x7fcfd01a4a70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000d770 tx=0x7fcfc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.592+0000 7fcfccc00640 1 -- 172.21.15.7:0/356385651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0017070 con 0x7fcfd01085f0 2024-04-23T15:15:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.592+0000 7fcfccc00640 1 -- 172.21.15.7:0/356385651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfc0009c30 con 0x7fcfd01085f0 2024-04-23T15:15:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.592+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd019f730 con 0x7fcfd01085f0 2024-04-23T15:15:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.592+0000 7fcfccc00640 1 -- 172.21.15.7:0/356385651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0003d00 con 0x7fcfd01085f0 2024-04-23T15:15:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.592+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd01ab9f0 con 0x7fcfd01085f0 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 Processor -- start 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfccc00640 1 -- 172.21.15.7:0/356385651 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fcfc0003ea0 con 0x7fcfd01085f0 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 -- start start 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffd9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd9ad0 0x55571ffe3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571ffe6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55571ff3f900 con 0x55571ffd91b0 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55571fee5f20 con 0x55571ffd9ad0 2024-04-23T15:15:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.596+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55571ff3b8c0 con 0x55571ffe4390 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffd9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffd9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57890/0 (socket says 172.21.15.7:57890) 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 -- 172.21.15.7:0/64205571 learned_addr learned my addr 172.21.15.7:0/64205571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfcf400640 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571ffe6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfcfe00640 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd9ad0 0x55571ffe3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 -- 172.21.15.7:0/64205571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 msgr2=0x55571ffe6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571ffe6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 -- 172.21.15.7:0/64205571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd9ad0 msgr2=0x55571ffe3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd9ad0 0x55571ffe3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.597+0000 7fcfd4a00640 1 -- 172.21.15.7:0/64205571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55571ff0ae10 con 0x55571ffd91b0 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffd9590 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8005fa0 tx=0x7fcfc8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d043deaaf01b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfccc00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcfb40a3e40 0x7fcfb40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfc5200640 1 -- 172.21.15.7:0/64205571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8030860 con 0x55571ffd91b0 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfc5200640 1 -- 172.21.15.7:0/64205571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfc8036070 con 0x55571ffd91b0 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfc5200640 1 -- 172.21.15.7:0/64205571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8004460 con 0x55571ffd91b0 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfccc00640 1 -- 172.21.15.7:0/356385651 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7fcfc00d08e0 con 0x7fcfd01085f0 2024-04-23T15:15:14.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.598+0000 7fcfcfe00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcfb40a3e40 0x7fcfb40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 -- 172.21.15.7:0/64205571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 msgr2=0x55571ffd9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffd9590 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8005fa0 tx=0x7fcfc8005fd0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfcfe00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcfb40a3e40 0x7fcfb40a6300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55571ffda750 tx=0x7fcfc0098040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 -- 172.21.15.7:0/64205571 shutdown_connections 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd9ad0 0x55571ffe3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571ffe6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/64205571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffd9590 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 -- 172.21.15.7:0/64205571 >> 172.21.15.7:0/64205571 conn(0x55571ffd56c0 msgr2=0x55571ffd5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:14.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.599+0000 7fcfd99d6740 1 -- 172.21.15.7:0/64205571 shutdown_connections 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.600+0000 7fcfd99d6740 1 -- 172.21.15.7:0/64205571 wait complete. 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.600+0000 7fcfd99d6740 1 -- start start 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.600+0000 7fcfd99d6740 1 Processor -- start 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffe12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571ffe17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffe4390 0x55571ffe1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55571ffe6f60 con 0x55571ffd91b0 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55571fef92c0 con 0x55571ffe4390 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55571ffe70e0 con 0x55571ffd9ad0 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd99d6740 10 client.0 _ll_register_callbacks cb 0x55571fc51a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffe12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffe12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57896/0 (socket says 172.21.15.7:57896) 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.601+0000 7fcfd4a00640 1 -- 172.21.15.7:0/2972427631 learned_addr learned my addr 172.21.15.7:0/2972427631 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:14.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfcf400640 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571ffe17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfd4a00640 1 -- 172.21.15.7:0/2972427631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 msgr2=0x55571ffe17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571ffe17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfd4a00640 1 -- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffe4390 msgr2=0x55571ffe1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffe4390 0x55571ffe1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfd4a00640 1 -- 172.21.15.7:0/2972427631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55571ff09fd0 con 0x55571ffd91b0 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffe12b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8004120 tx=0x7fcfc80306b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cad6bf7a89dd09 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:14.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfbd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.602+0000 7fcfbd600640 1 -- 172.21.15.7:0/2972427631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8054060 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc8036070 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfbd600640 1 -- 172.21.15.7:0/2972427631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7fcfc8003970 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfbd600640 1 -- 172.21.15.7:0/2972427631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcfc8030af0 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfd99d6740 10 client.17577 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55571fc52210 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfbd600640 1 -- 172.21.15.7:0/2972427631 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfc8036070 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.603+0000 7fcfbd600640 1 -- 172.21.15.7:0/2972427631 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fcfc80314d0 con 0x55571ffd91b0 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfd99d6740 10 client.17577 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfd99d6740 10 client.17577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfd99d6740 20 client.17577 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55571fff42a0 0x55571fff6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfd99d6740 4 client.17577 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:15:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55571ff4d320 con 0x55571fff42a0 2024-04-23T15:15:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.604+0000 7fcfcf400640 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55571fff42a0 0x55571fff6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.605+0000 7fcfcf400640 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55571fff42a0 0x55571fff6690 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa909d176e344272 server_cookie=bef745c6bc31d199 in_seq=0 out_seq=0 2024-04-23T15:15:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.605+0000 7fcfbd600640 10 client.17577 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:14.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.607+0000 7fcfbd600640 1 -- 172.21.15.7:0/2972427631 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55571ff4d320 con 0x55571fff42a0 2024-04-23T15:15:14.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.607+0000 7fcfbd600640 10 client.17577 handle_command_reply: tid=0 2024-04-23T15:15:14.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.607+0000 7fcfd99d6740 1 client.17577 shutdown 2024-04-23T15:15:14.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.607+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 msgr2=0x55571ffe12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.607+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffe12b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8004120 tx=0x7fcfc80306b0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 shutdown_connections 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55571fff42a0 0x55571fff6690 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffe4390 0x55571ffe1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571ffe17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/2972427631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd91b0 0x55571ffe12b0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 >> 172.21.15.7:0/2972427631 conn(0x55571ffd56c0 msgr2=0x55571ffdb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfbd600640 0 client.17577 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 shutdown_connections 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 1 -- 172.21.15.7:0/2972427631 wait complete. 2024-04-23T15:15:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.608+0000 7fcfd99d6740 20 client.17577 trim_cache size 0 max 16384 2024-04-23T15:15:14.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.631+0000 7fcfd99d6740 1 Processor -- start 2024-04-23T15:15:14.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.631+0000 7fcfd99d6740 1 -- start start 2024-04-23T15:15:14.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.631+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571fff9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 0x55571ffde550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01b5a20 con 0x55571ffe4390 2024-04-23T15:15:14.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01b7560 con 0x55571ffd91b0 2024-04-23T15:15:14.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01b60f0 con 0x55571ffd9ad0 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 0x55571ffde550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 0x55571ffde550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57904/0 (socket says 172.21.15.7:57904) 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd4a00640 1 -- 172.21.15.7:0/3197806108 learned_addr learned my addr 172.21.15.7:0/3197806108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.632+0000 7fcfcf400640 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571fff9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfd4a00640 1 -- 172.21.15.7:0/3197806108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 msgr2=0x55571fff9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571fff9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfd4a00640 1 -- 172.21.15.7:0/3197806108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 msgr2=0x55571fff96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfd4a00640 1 -- 172.21.15.7:0/3197806108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55571fd1e620 con 0x55571ffe4390 2024-04-23T15:15:14.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 0x55571ffde550 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fcfc802afd0 tx=0x7fcfc8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b737b91279d2bff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:14.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfbfe00640 1 -- 172.21.15.7:0/3197806108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8030af0 con 0x55571ffe4390 2024-04-23T15:15:14.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfbfe00640 1 -- 172.21.15.7:0/3197806108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfc8036050 con 0x55571ffe4390 2024-04-23T15:15:14.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.633+0000 7fcfbfe00640 1 -- 172.21.15.7:0/3197806108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8004150 con 0x55571ffe4390 2024-04-23T15:15:14.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 -- 172.21.15.7:0/3197806108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 msgr2=0x55571ffde550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 0x55571ffde550 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fcfc802afd0 tx=0x7fcfc8009a20 comp rx=0 tx=0).stop 2024-04-23T15:15:14.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 -- 172.21.15.7:0/3197806108 shutdown_connections 2024-04-23T15:15:14.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffe4390 0x55571ffde550 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffd9ad0 0x55571fff9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/3197806108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 -- 172.21.15.7:0/3197806108 >> 172.21.15.7:0/3197806108 conn(0x55571ffd56c0 msgr2=0x55571ffefbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 -- 172.21.15.7:0/3197806108 shutdown_connections 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.634+0000 7fcfd99d6740 1 -- 172.21.15.7:0/3197806108 wait complete. 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 -- start start 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 Processor -- start 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 0x55571fff9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571fff7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01b6e90 con 0x55571ffd9ad0 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01b67c0 con 0x55571ffd91b0 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01b3a20 con 0x55571ffe4390 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.635+0000 7fcfd99d6740 10 client.0 _ll_register_callbacks cb 0x7fcfc8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:14.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 0x55571fff9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 0x55571fff9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57908/0 (socket says 172.21.15.7:57908) 2024-04-23T15:15:14.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 -- 172.21.15.7:0/469236758 learned_addr learned my addr 172.21.15.7:0/469236758 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 -- 172.21.15.7:0/469236758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 msgr2=0x55571fff7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571fff7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 -- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 msgr2=0x55571fff94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.636+0000 7fcfcf400640 1 -- 172.21.15.7:0/469236758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55571fff8170 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfcf400640 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 0x55571fff9a00 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x55571ffd6ae0 tx=0x7fcfb801b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8507e0c77c8a5f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfbd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfbd600640 1 -- 172.21.15.7:0/469236758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb801bdc0 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfbd600640 1 -- 172.21.15.7:0/469236758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7fcfb8012980 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc8036050 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfbd600640 1 -- 172.21.15.7:0/469236758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcfb802b050 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfd99d6740 10 client.17583 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.637+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55572005b070 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfbd600640 1 -- 172.21.15.7:0/469236758 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfc8036050 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfbd600640 1 -- 172.21.15.7:0/469236758 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fcfb8004730 con 0x55571ffd9ad0 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfd99d6740 10 client.17583 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfd99d6740 10 client.17583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfd99d6740 20 client.17583 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55572005b870 0x55572005dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfd99d6740 4 client.17583 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.638+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55571ff47190 con 0x55572005b870 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.639+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55572005b870 0x55572005dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.640+0000 7fcfd4a00640 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55572005b870 0x55572005dcb0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=481d35f64b0fcbad server_cookie=d6e708cb584c1a40 in_seq=0 out_seq=0 2024-04-23T15:15:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.640+0000 7fcfbd600640 10 client.17583 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfbd600640 1 -- 172.21.15.7:0/469236758 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55571ff47190 con 0x55572005b870 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfbd600640 10 client.17583 handle_command_reply: tid=0 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 client.17583 shutdown 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 msgr2=0x55571fff9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 0x55571fff9a00 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x55571ffd6ae0 tx=0x7fcfb801b600 comp rx=0 tx=0).stop 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 shutdown_connections 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55572005b870 0x55572005dcb0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55571ffe4390 0x55571fff7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55571ffd9ad0 0x55571fff9a00 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 --2- 172.21.15.7:0/469236758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55571ffd91b0 0x55571fff94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 >> 172.21.15.7:0/469236758 conn(0x55571ffd56c0 msgr2=0x55571ffef330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfbd600640 0 client.17583 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 shutdown_connections 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.674+0000 7fcfd99d6740 1 -- 172.21.15.7:0/469236758 wait complete. 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.675+0000 7fcfd99d6740 20 client.17583 trim_cache size 0 max 16384 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:15:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:15:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:15:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.675+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcfb40a3e40 msgr2=0x7fcfb40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.675+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcfb40a3e40 0x7fcfb40a6300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55571ffda750 tx=0x7fcfc0098040 comp rx=0 tx=0).stop 2024-04-23T15:15:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.675+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 msgr2=0x7fcfd01a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:14.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.675+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 0x7fcfd01a4a70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000d770 tx=0x7fcfc000dc30 comp rx=0 tx=0).stop 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 shutdown_connections 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcfb40a3e40 0x7fcfb40a6300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd010e690 0x7fcfd019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd0108fb0 0x7fcfd01a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 --2- 172.21.15.7:0/356385651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfd01085f0 0x7fcfd01a4a70 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 >> 172.21.15.7:0/356385651 conn(0x7fcfd0076590 msgr2=0x7fcfd0077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 shutdown_connections 2024-04-23T15:15:14.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:14.676+0000 7fcfd6a00640 1 -- 172.21.15.7:0/356385651 wait complete. 2024-04-23T15:15:15.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:14 smithi007 ceph-mon[27906]: pgmap v753: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:14 smithi186 ceph-mon[31814]: pgmap v753: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:14 smithi137 ceph-mon[31694]: pgmap v753: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:17.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:16 smithi007 ceph-mon[27906]: pgmap v754: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:16 smithi186 ceph-mon[31814]: pgmap v754: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:16 smithi137 ceph-mon[31694]: pgmap v754: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:18 smithi007 ceph-mon[27906]: pgmap v755: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:15:19.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:18 smithi186 ceph-mon[31814]: pgmap v755: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:15:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:18 smithi137 ceph-mon[31694]: pgmap v755: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:15:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:20 smithi007 ceph-mon[27906]: pgmap v756: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:15:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:20 smithi186 ceph-mon[31814]: pgmap v756: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:15:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:20 smithi137 ceph-mon[31694]: pgmap v756: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:15:22.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:15:22.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:15:22.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:15:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:22 smithi007 ceph-mon[27906]: pgmap v757: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-04-23T15:15:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:15:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:15:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:15:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:22 smithi186 ceph-mon[31814]: pgmap v757: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-04-23T15:15:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:15:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:15:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:15:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:22 smithi137 ceph-mon[31694]: pgmap v757: 129 pgs: 129 active+clean; 6.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-04-23T15:15:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:15:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:15:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:15:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:24 smithi007 ceph-mon[27906]: pgmap v758: 129 pgs: 129 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:15:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:24 smithi186 ceph-mon[31814]: pgmap v758: 129 pgs: 129 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:15:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:24 smithi137 ceph-mon[31694]: pgmap v758: 129 pgs: 129 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:15:27.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:26 smithi007 ceph-mon[27906]: pgmap v759: 129 pgs: 129 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:15:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:26 smithi186 ceph-mon[31814]: pgmap v759: 129 pgs: 129 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:15:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:26 smithi137 ceph-mon[31694]: pgmap v759: 129 pgs: 129 active+clean; 6.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 -- 172.21.15.7:0/3846803664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 msgr2=0x7f1e141011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3846803664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141011f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009900 tx=0x7f1e0802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 -- 172.21.15.7:0/3846803664 shutdown_connections 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3846803664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e14101730 0x7f1e1410e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3846803664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e1410e9c0 0x7f1e14110db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3846803664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141011f0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 -- 172.21.15.7:0/3846803664 >> 172.21.15.7:0/3846803664 conn(0x7f1e14078080 msgr2=0x7f1e14078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 -- 172.21.15.7:0/3846803664 shutdown_connections 2024-04-23T15:15:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.829+0000 7f1e1c000640 1 -- 172.21.15.7:0/3846803664 wait complete. 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.830+0000 7f1e1c000640 1 Processor -- start 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.830+0000 7f1e1c000640 1 -- start start 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1c000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e14101730 0x7f1e141a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1c000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e1410e9c0 0x7f1e1419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14114480 con 0x7f1e14100e10 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1c000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14114300 con 0x7f1e1410e9c0 2024-04-23T15:15:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1c000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14114600 con 0x7f1e14101730 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e19600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e19600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33598/0 (socket says 172.21.15.7:33598) 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e19600640 1 -- 172.21.15.7:0/3486814465 learned_addr learned my addr 172.21.15.7:0/3486814465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e1a000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e1410e9c0 0x7f1e1419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e18c00640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e14101730 0x7f1e141a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e19600640 1 -- 172.21.15.7:0/3486814465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e14101730 msgr2=0x7f1e141a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.831+0000 7f1e19600640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e14101730 0x7f1e141a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e19600640 1 -- 172.21.15.7:0/3486814465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e1410e9c0 msgr2=0x7f1e1419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e19600640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e1410e9c0 0x7f1e1419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e19600640 1 -- 172.21.15.7:0/3486814465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1419b060 con 0x7f1e14100e10 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e19600640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141a0730 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005940 tx=0x7f1e080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e12000640 1 -- 172.21.15.7:0/3486814465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0803f030 con 0x7f1e14100e10 2024-04-23T15:15:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1419b2f0 con 0x7f1e14100e10 2024-04-23T15:15:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e12000640 1 -- 172.21.15.7:0/3486814465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e08003cb0 con 0x7f1e14100e10 2024-04-23T15:15:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.832+0000 7f1e12000640 1 -- 172.21.15.7:0/3486814465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08035070 con 0x7f1e14100e10 2024-04-23T15:15:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.833+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e141a75f0 con 0x7f1e14100e10 2024-04-23T15:15:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.836+0000 7f1e1ee33740 1 Processor -- start 2024-04-23T15:15:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.836+0000 7f1e1ee33740 1 -- start start 2024-04-23T15:15:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 0x55c12c3e8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3f3390 0x55c12c3f5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c12c34e900 con 0x55c12c3e8ad0 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c12c2f4f20 con 0x55c12c3e81b0 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c12c34a8c0 con 0x55c12c3f3390 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e12000640 1 -- 172.21.15.7:0/3486814465 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1e08042030 con 0x7f1e14100e10 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.837+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 0x55c12c3e8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 0x55c12c3e8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:55304/0 (socket says 172.21.15.7:55304) 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 -- 172.21.15.7:0/424341089 learned_addr learned my addr 172.21.15.7:0/424341089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e18c00640 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3f3390 0x55c12c3f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e19600640 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 -- 172.21.15.7:0/424341089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3f3390 msgr2=0x55c12c3f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3f3390 0x55c12c3f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 -- 172.21.15.7:0/424341089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 msgr2=0x55c12c3f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e1a000640 1 -- 172.21.15.7:0/424341089 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12c319e10 con 0x55c12c3e81b0 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.838+0000 7f1e19600640 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.839+0000 7f1e1a000640 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 0x55c12c3e8590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c007dc0 tx=0x7f1e0c00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff4bd415998920c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.839+0000 7f1e12000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1dfc0a3dc0 0x7f1dfc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.839+0000 7f1e06600640 1 -- 172.21.15.7:0/424341089 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c014070 con 0x55c12c3e81b0 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.840+0000 7f1e06600640 1 -- 172.21.15.7:0/424341089 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e0c019b10 con 0x55c12c3e81b0 2024-04-23T15:15:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.840+0000 7f1e12000640 1 -- 172.21.15.7:0/3486814465 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f1e080f14e0 con 0x7f1e14100e10 2024-04-23T15:15:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.840+0000 7f1e19600640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1dfc0a3dc0 0x7f1dfc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.840+0000 7f1e06600640 1 -- 172.21.15.7:0/424341089 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c010c20 con 0x55c12c3e81b0 2024-04-23T15:15:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 -- 172.21.15.7:0/424341089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 msgr2=0x55c12c3e8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 0x55c12c3e8590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c007dc0 tx=0x7f1e0c00e720 comp rx=0 tx=0).stop 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e19600640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1dfc0a3dc0 0x7f1dfc0a6280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e080ee930 tx=0x7f1e080f70e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 -- 172.21.15.7:0/424341089 shutdown_connections 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3f3390 0x55c12c3f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/424341089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e81b0 0x55c12c3e8590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 -- 172.21.15.7:0/424341089 >> 172.21.15.7:0/424341089 conn(0x55c12c3e46c0 msgr2=0x55c12c3e4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 -- 172.21.15.7:0/424341089 shutdown_connections 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.841+0000 7f1e1ee33740 1 -- 172.21.15.7:0/424341089 wait complete. 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 -- start start 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 Processor -- start 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 0x55c12c3f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c12c3f5fc0 con 0x55c12c3f3390 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c12c3082c0 con 0x55c12c3e8ad0 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.842+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c12c3f6140 con 0x55c12c3e81b0 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.843+0000 7f1e1ee33740 10 client.0 _ll_register_callbacks cb 0x55c12c060a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.843+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 0x55c12c3f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.843+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 0x55c12c3f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33614/0 (socket says 172.21.15.7:33614) 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.843+0000 7f1e1a000640 1 -- 172.21.15.7:0/3738348857 learned_addr learned my addr 172.21.15.7:0/3738348857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.843+0000 7f1e18c00640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.843+0000 7f1e1a000640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1a000640 1 -- 172.21.15.7:0/3738348857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 msgr2=0x55c12c3f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1a000640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1a000640 1 -- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e8ad0 msgr2=0x55c12c3f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1a000640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1a000640 1 -- 172.21.15.7:0/3738348857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12c318fd0 con 0x55c12c3f3390 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1a000640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 0x55c12c3f0e30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0108a0 tx=0x7f1e0c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62fc473fb58dd30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1dfaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1dfaa00640 1 -- 172.21.15.7:0/3738348857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c014040 con 0x55c12c3f3390 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1dfaa00640 1 -- 172.21.15.7:0/3738348857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f1e0c004a40 con 0x55c12c3f3390 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.844+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e0c019b10 con 0x55c12c3f3390 2024-04-23T15:15:27.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.845+0000 7f1dfaa00640 1 -- 172.21.15.7:0/3738348857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1e0c032050 con 0x55c12c3f3390 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.845+0000 7f1e1ee33740 10 client.17595 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.845+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c12c061210 con 0x55c12c3f3390 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.845+0000 7f1dfaa00640 1 -- 172.21.15.7:0/3738348857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e0c019b10 con 0x55c12c3f3390 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.845+0000 7f1dfaa00640 1 -- 172.21.15.7:0/3738348857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1e0c01bce0 con 0x55c12c3f3390 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e1ee33740 10 client.17595 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e1ee33740 10 client.17595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e1ee33740 20 client.17595 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c4034b0 0x55c12c4058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e1ee33740 4 client.17595 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c12c35c320 con 0x55c12c4034b0 2024-04-23T15:15:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.846+0000 7f1e18c00640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c4034b0 0x55c12c4058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.848+0000 7f1e18c00640 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c4034b0 0x55c12c4058a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cb4d1f8140bfc server_cookie=c32fb5d555d9e745 in_seq=0 out_seq=0 2024-04-23T15:15:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.848+0000 7f1dfaa00640 10 client.17595 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1dfaa00640 1 -- 172.21.15.7:0/3738348857 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c12c35c320 con 0x55c12c4034b0 2024-04-23T15:15:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1dfaa00640 10 client.17595 handle_command_reply: tid=0 2024-04-23T15:15:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 client.17595 shutdown 2024-04-23T15:15:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 msgr2=0x55c12c3f0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 0x55c12c3f0e30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0108a0 tx=0x7f1e0c005bd0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 shutdown_connections 2024-04-23T15:15:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c4034b0 0x55c12c4058a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3e8ad0 0x55c12c3f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3f3390 0x55c12c3f0e30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/3738348857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1dfaa00640 0 client.17595 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 >> 172.21.15.7:0/3738348857 conn(0x55c12c3e46c0 msgr2=0x55c12c3ea440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 shutdown_connections 2024-04-23T15:15:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.850+0000 7f1e1ee33740 1 -- 172.21.15.7:0/3738348857 wait complete. 2024-04-23T15:15:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.851+0000 7f1e1ee33740 20 client.17595 trim_cache size 0 max 16384 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.873+0000 7f1e1ee33740 1 Processor -- start 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 -- start start 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c40af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c40b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c3ed690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141b1570 con 0x55c12c3e8ad0 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141b30b0 con 0x55c12c3f3390 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141b1c40 con 0x55c12c3e81b0 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c40b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c40b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33618/0 (socket says 172.21.15.7:33618) 2024-04-23T15:15:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.874+0000 7f1e18c00640 1 -- 172.21.15.7:0/2704241668 learned_addr learned my addr 172.21.15.7:0/2704241668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e1a000640 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c40af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e18c00640 1 -- 172.21.15.7:0/2704241668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 msgr2=0x55c12c40af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e18c00640 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c40af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e1a000640 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c3ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e18c00640 1 -- 172.21.15.7:0/2704241668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 msgr2=0x55c12c3ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e18c00640 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c3ed690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e18c00640 1 -- 172.21.15.7:0/2704241668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12c3f5af0 con 0x55c12c3e8ad0 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e18c00640 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c40b4d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1e1419c0d0 tx=0x7f1e000118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfad9ddefffc3563 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.875+0000 7f1e05c00640 1 -- 172.21.15.7:0/2704241668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000042f0 con 0x55c12c3e8ad0 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.876+0000 7f1e05c00640 1 -- 172.21.15.7:0/2704241668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e00021070 con 0x55c12c3e8ad0 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.876+0000 7f1e05c00640 1 -- 172.21.15.7:0/2704241668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00003c30 con 0x55c12c3e8ad0 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.876+0000 7f1e1ee33740 1 -- 172.21.15.7:0/2704241668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 msgr2=0x55c12c40b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.876+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c40b4d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1e1419c0d0 tx=0x7f1e000118d0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 -- 172.21.15.7:0/2704241668 shutdown_connections 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c3ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c40b4d0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/2704241668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c40af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 -- 172.21.15.7:0/2704241668 >> 172.21.15.7:0/2704241668 conn(0x55c12c3e46c0 msgr2=0x55c12c3e3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 -- 172.21.15.7:0/2704241668 shutdown_connections 2024-04-23T15:15:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 -- 172.21.15.7:0/2704241668 wait complete. 2024-04-23T15:15:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 -- start start 2024-04-23T15:15:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.877+0000 7f1e1ee33740 1 Processor -- start 2024-04-23T15:15:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c468800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141b29e0 con 0x55c12c3e8ad0 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141b2310 con 0x55c12c3f3390 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141af570 con 0x55c12c3e81b0 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e1ee33740 10 client.0 _ll_register_callbacks cb 0x7f1e080f4ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3ed9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33622/0 (socket says 172.21.15.7:33622) 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.878+0000 7f1e18c00640 1 -- 172.21.15.7:0/1139702935 learned_addr learned my addr 172.21.15.7:0/1139702935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e1a000640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e1a000640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c468800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e18c00640 1 -- 172.21.15.7:0/1139702935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 msgr2=0x55c12c3ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e18c00640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e18c00640 1 -- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 msgr2=0x55c12c468800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e18c00640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c468800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e18c00640 1 -- 172.21.15.7:0/1139702935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c12c12d620 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e1a000640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1e18c00640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3ed9c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1e00014040 tx=0x7f1e00004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6977174e7137ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.879+0000 7f1dfaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1dfaa00640 1 -- 172.21.15.7:0/1139702935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0001c7c0 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1dfaa00640 1 -- 172.21.15.7:0/1139702935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f1e000035f0 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e00021070 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1dfaa00640 1 -- 172.21.15.7:0/1139702935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1e00037050 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1e1ee33740 10 client.17601 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c12c469d10 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.880+0000 7f1dfaa00640 1 -- 172.21.15.7:0/1139702935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e00021070 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1dfaa00640 1 -- 172.21.15.7:0/1139702935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1e00025630 con 0x55c12c3e8ad0 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1ee33740 10 client.17601 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1ee33740 10 client.17601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1ee33740 20 client.17601 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c46a470 0x55c12c46c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1ee33740 4 client.17601 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c12c356190 con 0x55c12c46a470 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.881+0000 7f1e1a000640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c46a470 0x55c12c46c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.882+0000 7f1e1a000640 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c46a470 0x55c12c46c890 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d875c4b4d74903 server_cookie=53f17bf4d63d9086 in_seq=0 out_seq=0 2024-04-23T15:15:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.882+0000 7f1dfaa00640 10 client.17601 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:27.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.912+0000 7f1dfaa00640 1 -- 172.21.15.7:0/1139702935 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c12c356190 con 0x55c12c46a470 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.912+0000 7f1dfaa00640 10 client.17601 handle_command_reply: tid=0 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.912+0000 7f1e1ee33740 1 client.17601 shutdown 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.912+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 msgr2=0x55c12c3ed9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.912+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3ed9c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f1e00014040 tx=0x7f1e00004200 comp rx=0 tx=0).stop 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 shutdown_connections 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c12c46a470 0x55c12c46c890 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c12c3f3390 0x55c12c468800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c12c3e8ad0 0x55c12c3ed9c0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 --2- 172.21.15.7:0/1139702935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c12c3e81b0 0x55c12c3ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 >> 172.21.15.7:0/1139702935 conn(0x55c12c3e46c0 msgr2=0x55c12c3f0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1dfaa00640 0 client.17601 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 shutdown_connections 2024-04-23T15:15:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 1 -- 172.21.15.7:0/1139702935 wait complete. 2024-04-23T15:15:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.913+0000 7f1e1ee33740 20 client.17601 trim_cache size 0 max 16384 2024-04-23T15:15:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:15:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:15:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:15:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1dfc0a3dc0 msgr2=0x7f1dfc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1dfc0a3dc0 0x7f1dfc0a6280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e080ee930 tx=0x7f1e080f70e0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 msgr2=0x7f1e141a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141a0730 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005940 tx=0x7f1e080042f0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 shutdown_connections 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1dfc0a3dc0 0x7f1dfc0a6280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e1410e9c0 0x7f1e1419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e14101730 0x7f1e141a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 --2- 172.21.15.7:0/3486814465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e14100e10 0x7f1e141a0730 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 >> 172.21.15.7:0/3486814465 conn(0x7f1e14078080 msgr2=0x7f1e1410ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 shutdown_connections 2024-04-23T15:15:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:27.914+0000 7f1e1c000640 1 -- 172.21.15.7:0/3486814465 wait complete. 2024-04-23T15:15:29.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:28 smithi007 ceph-mon[27906]: pgmap v760: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:15:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:28 smithi186 ceph-mon[31814]: pgmap v760: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:15:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:28 smithi137 ceph-mon[31694]: pgmap v760: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:15:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:30 smithi007 ceph-mon[27906]: pgmap v761: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:31.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:30 smithi186 ceph-mon[31814]: pgmap v761: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:30 smithi137 ceph-mon[31694]: pgmap v761: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:33.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:32 smithi007 ceph-mon[27906]: pgmap v762: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:32 smithi186 ceph-mon[31814]: pgmap v762: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:32 smithi137 ceph-mon[31694]: pgmap v762: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:35.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:34 smithi007 ceph-mon[27906]: pgmap v763: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:35.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:34 smithi186 ceph-mon[31814]: pgmap v763: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:34 smithi137 ceph-mon[31694]: pgmap v763: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:37.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:36 smithi007 ceph-mon[27906]: pgmap v764: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:37.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:36 smithi186 ceph-mon[31814]: pgmap v764: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:36 smithi137 ceph-mon[31694]: pgmap v764: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:39.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:38 smithi007 ceph-mon[27906]: pgmap v765: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:15:39.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:38 smithi186 ceph-mon[31814]: pgmap v765: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:15:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:38 smithi137 ceph-mon[31694]: pgmap v765: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:15:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 -- 172.21.15.7:0/3224013332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 msgr2=0x7fdd2810e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/3224013332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd2810e880 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009ca0 tx=0x7fdd2002a950 comp rx=0 tx=0).stop 2024-04-23T15:15:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 -- 172.21.15.7:0/3224013332 shutdown_connections 2024-04-23T15:15:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/3224013332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd281038e0 0x7fdd2810bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/3224013332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd2810e880 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/3224013332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd28102fc0 0x7fdd281033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 -- 172.21.15.7:0/3224013332 >> 172.21.15.7:0/3224013332 conn(0x7fdd280fc820 msgr2=0x7fdd280fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 -- 172.21.15.7:0/3224013332 shutdown_connections 2024-04-23T15:15:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.071+0000 7fdd2ce00640 1 -- 172.21.15.7:0/3224013332 wait complete. 2024-04-23T15:15:41.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.072+0000 7fdd2ce00640 1 Processor -- start 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.072+0000 7fdd2ce00640 1 -- start start 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.072+0000 7fdd2ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd28102fc0 0x7fdd28100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd2ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd281038e0 0x7fdd28101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd2ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd28101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd2ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281120c0 con 0x7fdd2810c3e0 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd2ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28111f40 con 0x7fdd28102fc0 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd2ce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28112240 con 0x7fdd281038e0 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd28101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd28101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46674/0 (socket says 172.21.15.7:46674) 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd27e00640 1 -- 172.21.15.7:0/472718414 learned_addr learned my addr 172.21.15.7:0/472718414 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd27400640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd28102fc0 0x7fdd28100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.073+0000 7fdd26a00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd281038e0 0x7fdd28101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27e00640 1 -- 172.21.15.7:0/472718414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd281038e0 msgr2=0x7fdd28101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27e00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd281038e0 0x7fdd28101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27e00640 1 -- 172.21.15.7:0/472718414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd28102fc0 msgr2=0x7fdd28100c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27e00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd28102fc0 0x7fdd28100c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27e00640 1 -- 172.21.15.7:0/472718414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd281a6ae0 con 0x7fdd2810c3e0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27400640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd28102fc0 0x7fdd28100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd27e00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd28101690 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009dc0 tx=0x7fdd20003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd1fe00640 1 -- 172.21.15.7:0/472718414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20034040 con 0x7fdd2810c3e0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd281a6d70 con 0x7fdd2810c3e0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd1fe00640 1 -- 172.21.15.7:0/472718414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd20030850 con 0x7fdd2810c3e0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.074+0000 7fdd1fe00640 1 -- 172.21.15.7:0/472718414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd200047f0 con 0x7fdd2810c3e0 2024-04-23T15:15:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.075+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd281a72b0 con 0x7fdd2810c3e0 2024-04-23T15:15:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd1fe00640 1 -- 172.21.15.7:0/472718414 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdd20037020 con 0x7fdd2810c3e0 2024-04-23T15:15:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 Processor -- start 2024-04-23T15:15:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 -- start start 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07c3c0 0x556bfc07c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07cce0 0x556bfc087060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc089990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556bfbfe2900 con 0x556bfc0875a0 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556bfbf88f20 con 0x556bfc07c3c0 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.079+0000 7fdd311c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556bfbfde8c0 con 0x556bfc07cce0 2024-04-23T15:15:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc089990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc089990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46682/0 (socket says 172.21.15.7:46682) 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 -- 172.21.15.7:0/2516399880 learned_addr learned my addr 172.21.15.7:0/2516399880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd27400640 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07cce0 0x556bfc087060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07c3c0 0x556bfc07c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 -- 172.21.15.7:0/2516399880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07cce0 msgr2=0x556bfc087060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07cce0 0x556bfc087060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 -- 172.21.15.7:0/2516399880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07c3c0 msgr2=0x556bfc07c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07c3c0 0x556bfc07c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.080+0000 7fdd26a00640 1 -- 172.21.15.7:0/2516399880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bfbfade10 con 0x556bfc0875a0 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd1fe00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd0c0a3dc0 0x7fdd0c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd26a00640 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc089990 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fdd14013510 tx=0x7fdd1400c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130d8fe5f28e9fae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd1fe00640 1 -- 172.21.15.7:0/472718414 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7fdd200f1ab0 con 0x7fdd2810c3e0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd27400640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd0c0a3dc0 0x7fdd0c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd1cc00640 1 -- 172.21.15.7:0/2516399880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14019030 con 0x556bfc0875a0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd1cc00640 1 -- 172.21.15.7:0/2516399880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd14011950 con 0x556bfc0875a0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.081+0000 7fdd1cc00640 1 -- 172.21.15.7:0/2516399880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400f910 con 0x556bfc0875a0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 -- 172.21.15.7:0/2516399880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 msgr2=0x556bfc089990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc089990 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fdd14013510 tx=0x7fdd1400c5c0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd27400640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd0c0a3dc0 0x7fdd0c0a6280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556bfc07d960 tx=0x7fdd1800b5a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 -- 172.21.15.7:0/2516399880 shutdown_connections 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc089990 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07cce0 0x556bfc087060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 --2- 172.21.15.7:0/2516399880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07c3c0 0x556bfc07c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.082+0000 7fdd311c9740 1 -- 172.21.15.7:0/2516399880 >> 172.21.15.7:0/2516399880 conn(0x556bfc0788d0 msgr2=0x556bfc078cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.083+0000 7fdd311c9740 1 -- 172.21.15.7:0/2516399880 shutdown_connections 2024-04-23T15:15:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.083+0000 7fdd311c9740 1 -- 172.21.15.7:0/2516399880 wait complete. 2024-04-23T15:15:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.083+0000 7fdd311c9740 1 -- start start 2024-04-23T15:15:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.083+0000 7fdd311c9740 1 Processor -- start 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc084690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 0x556bfc084bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc0875a0 0x556bfc085110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556bfc08a0e0 con 0x556bfc07cce0 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556bfbf9c2c0 con 0x556bfc0875a0 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556bfc08a260 con 0x556bfc07c3c0 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd311c9740 10 client.0 _ll_register_callbacks cb 0x556bfbcf4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 0x556bfc084bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 0x556bfc084bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46684/0 (socket says 172.21.15.7:46684) 2024-04-23T15:15:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd26a00640 1 -- 172.21.15.7:0/1262145520 learned_addr learned my addr 172.21.15.7:0/1262145520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:41.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:40 smithi007 ceph-mon[27906]: pgmap v766: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.084+0000 7fdd27e00640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc0875a0 0x556bfc085110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd27400640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc084690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd26a00640 1 -- 172.21.15.7:0/1262145520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 msgr2=0x556bfc084690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd26a00640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc084690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd26a00640 1 -- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc0875a0 msgr2=0x556bfc085110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd26a00640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc0875a0 0x556bfc085110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd26a00640 1 -- 172.21.15.7:0/1262145520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bfbfacfd0 con 0x556bfc07cce0 2024-04-23T15:15:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd26a00640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 0x556bfc084bd0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fdd14001eb0 tx=0x7fdd1400c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a3959f40db3e13 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.085+0000 7fdd11600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd11600640 1 -- 172.21.15.7:0/1262145520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14019040 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd11600640 1 -- 172.21.15.7:0/1262145520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7fdd14011720 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd14011950 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd11600640 1 -- 172.21.15.7:0/1262145520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd14031050 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd311c9740 10 client.17613 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556bfbcf5210 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.086+0000 7fdd11600640 1 -- 172.21.15.7:0/1262145520 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd14011950 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd11600640 1 -- 172.21.15.7:0/1262145520 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdd14027030 con 0x556bfc07cce0 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd311c9740 10 client.17613 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd311c9740 10 client.17613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd311c9740 20 client.17613 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc097760 0x556bfc099b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd311c9740 4 client.17613 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:15:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.087+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bfbff0320 con 0x556bfc097760 2024-04-23T15:15:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.088+0000 7fdd27400640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc097760 0x556bfc099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.089+0000 7fdd27400640 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc097760 0x556bfc099b50 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329bb1baccf4c844 server_cookie=63fa99efa337bc87 in_seq=0 out_seq=0 2024-04-23T15:15:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.089+0000 7fdd11600640 10 client.17613 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.090+0000 7fdd11600640 1 -- 172.21.15.7:0/1262145520 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556bfbff0320 con 0x556bfc097760 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.090+0000 7fdd11600640 10 client.17613 handle_command_reply: tid=0 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.090+0000 7fdd311c9740 1 client.17613 shutdown 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 msgr2=0x556bfc084bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 0x556bfc084bd0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fdd14001eb0 tx=0x7fdd1400c350 comp rx=0 tx=0).stop 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 shutdown_connections 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc097760 0x556bfc099b50 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc0875a0 0x556bfc085110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc07cce0 0x556bfc084bd0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1262145520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc084690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 >> 172.21.15.7:0/1262145520 conn(0x556bfc0788d0 msgr2=0x556bfc07e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd11600640 0 client.17613 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 shutdown_connections 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 1 -- 172.21.15.7:0/1262145520 wait complete. 2024-04-23T15:15:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.091+0000 7fdd311c9740 20 client.17613 trim_cache size 0 max 16384 2024-04-23T15:15:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.109+0000 7fdd311c9740 1 Processor -- start 2024-04-23T15:15:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.109+0000 7fdd311c9740 1 -- start start 2024-04-23T15:15:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc078210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc07ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc092cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd311c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281b1380 con 0x556bfc0875a0 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd311c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281b2ec0 con 0x556bfc07cce0 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd311c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281b1a50 con 0x556bfc07c3c0 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc092cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc092cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46698/0 (socket says 172.21.15.7:46698) 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd27e00640 1 -- 172.21.15.7:0/1638499587 learned_addr learned my addr 172.21.15.7:0/1638499587 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd27400640 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc078210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.110+0000 7fdd26a00640 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc07ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd27e00640 1 -- 172.21.15.7:0/1638499587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 msgr2=0x556bfc078210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd27e00640 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc078210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd27e00640 1 -- 172.21.15.7:0/1638499587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 msgr2=0x556bfc07ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd27e00640 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc07ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd27e00640 1 -- 172.21.15.7:0/1638499587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bfbdc1620 con 0x556bfc0875a0 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd27e00640 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc092cb0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdd20044000 tx=0x7fdd200bd0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f810499f0a65758c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd13e00640 1 -- 172.21.15.7:0/1638499587 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2002c040 con 0x556bfc0875a0 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd13e00640 1 -- 172.21.15.7:0/1638499587 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd200bde50 con 0x556bfc0875a0 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.111+0000 7fdd13e00640 1 -- 172.21.15.7:0/1638499587 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd200bbae0 con 0x556bfc0875a0 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 -- 172.21.15.7:0/1638499587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 msgr2=0x556bfc092cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc092cb0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdd20044000 tx=0x7fdd200bd0b0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 -- 172.21.15.7:0/1638499587 shutdown_connections 2024-04-23T15:15:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc07ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc092cb0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 --2- 172.21.15.7:0/1638499587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc078210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 -- 172.21.15.7:0/1638499587 >> 172.21.15.7:0/1638499587 conn(0x556bfc0788d0 msgr2=0x556bfc0925a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 -- 172.21.15.7:0/1638499587 shutdown_connections 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.112+0000 7fdd311c9740 1 -- 172.21.15.7:0/1638499587 wait complete. 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 -- start start 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 Processor -- start 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc09c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc09cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc099c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281b27f0 con 0x556bfc0875a0 2024-04-23T15:15:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281b2120 con 0x556bfc07cce0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281af380 con 0x556bfc07c3c0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.113+0000 7fdd311c9740 10 client.0 _ll_register_callbacks cb 0x7fdd1800b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc099c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc099c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46704/0 (socket says 172.21.15.7:46704) 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 -- 172.21.15.7:0/3807680421 learned_addr learned my addr 172.21.15.7:0/3807680421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27400640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc09c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd26a00640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc09cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 -- 172.21.15.7:0/3807680421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 msgr2=0x556bfc09c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc09c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 -- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 msgr2=0x556bfc09cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc09cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd27e00640 1 -- 172.21.15.7:0/3807680421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bfc09a480 con 0x556bfc0875a0 2024-04-23T15:15:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.114+0000 7fdd26a00640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc09cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd27e00640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc099c50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fdd200bd450 tx=0x7fdd200095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99b765c7484fbf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd11600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd11600640 1 -- 172.21.15.7:0/3807680421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2002c040 con 0x556bfc0875a0 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd11600640 1 -- 172.21.15.7:0/3807680421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7fdd200b9dc0 con 0x556bfc0875a0 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd200bde50 con 0x556bfc0875a0 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd11600640 1 -- 172.21.15.7:0/3807680421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd200c1b00 con 0x556bfc0875a0 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd311c9740 10 client.17619 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.115+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556bfc0fd550 con 0x556bfc0875a0 2024-04-23T15:15:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:40 smithi186 ceph-mon[31814]: pgmap v766: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd11600640 1 -- 172.21.15.7:0/3807680421 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd200bde50 con 0x556bfc0875a0 2024-04-23T15:15:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd11600640 1 -- 172.21.15.7:0/3807680421 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdd200c5f30 con 0x556bfc0875a0 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd311c9740 10 client.17619 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd311c9740 10 client.17619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd311c9740 20 client.17619 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd311c9740 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc0fd980 0x556bfc0ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd311c9740 4 client.17619 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.116+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556bfbfea190 con 0x556bfc0fd980 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.117+0000 7fdd27400640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc0fd980 0x556bfc0ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.117+0000 7fdd27400640 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc0fd980 0x556bfc0ffd70 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35055c9711eec255 server_cookie=366480e0a7011f22 in_seq=0 out_seq=0 2024-04-23T15:15:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.117+0000 7fdd11600640 10 client.17619 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd11600640 1 -- 172.21.15.7:0/3807680421 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556bfbfea190 con 0x556bfc0fd980 2024-04-23T15:15:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd11600640 10 client.17619 handle_command_reply: tid=0 2024-04-23T15:15:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd311c9740 1 client.17619 shutdown 2024-04-23T15:15:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 msgr2=0x556bfc099c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd311c9740 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc099c50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fdd200bd450 tx=0x7fdd200095c0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 shutdown_connections 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.149+0000 7fdd311c9740 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556bfc0fd980 0x556bfc0ffd70 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556bfc07cce0 0x556bfc09cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556bfc0875a0 0x556bfc099c50 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd11600640 0 client.17619 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 1 --2- 172.21.15.7:0/3807680421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556bfc07c3c0 0x556bfc09c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 >> 172.21.15.7:0/3807680421 conn(0x556bfc0788d0 msgr2=0x556bfc084ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:41.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 shutdown_connections 2024-04-23T15:15:41.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 1 -- 172.21.15.7:0/3807680421 wait complete. 2024-04-23T15:15:41.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.150+0000 7fdd311c9740 20 client.17619 trim_cache size 0 max 16384 2024-04-23T15:15:41.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:15:41.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:15:41.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:15:41.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd0c0a3dc0 msgr2=0x7fdd0c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd0c0a3dc0 0x7fdd0c0a6280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556bfc07d960 tx=0x7fdd1800b5a0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 msgr2=0x7fdd28101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd28101690 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009dc0 tx=0x7fdd20003f10 comp rx=0 tx=0).stop 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 shutdown_connections 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd0c0a3dc0 0x7fdd0c0a6280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd2810c3e0 0x7fdd28101690 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd281038e0 0x7fdd28101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 --2- 172.21.15.7:0/472718414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd28102fc0 0x7fdd28100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 >> 172.21.15.7:0/472718414 conn(0x7fdd280fc820 msgr2=0x7fdd280fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.151+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 shutdown_connections 2024-04-23T15:15:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:41.152+0000 7fdd2ce00640 1 -- 172.21.15.7:0/472718414 wait complete. 2024-04-23T15:15:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:40 smithi137 ceph-mon[31694]: pgmap v766: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:43.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:42 smithi007 ceph-mon[27906]: pgmap v767: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:43.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:42 smithi186 ceph-mon[31814]: pgmap v767: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:42 smithi137 ceph-mon[31694]: pgmap v767: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:15:45.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:44 smithi186 ceph-mon[31814]: pgmap v768: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 21 op/s 2024-04-23T15:15:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:44 smithi137 ceph-mon[31694]: pgmap v768: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 21 op/s 2024-04-23T15:15:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:44 smithi007 ceph-mon[27906]: pgmap v768: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 21 op/s 2024-04-23T15:15:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:46 smithi186 ceph-mon[31814]: pgmap v769: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:15:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:46 smithi137 ceph-mon[31694]: pgmap v769: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:15:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:46 smithi007 ceph-mon[27906]: pgmap v769: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:15:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:48 smithi186 ceph-mon[31814]: pgmap v770: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:49.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:48 smithi007 ceph-mon[27906]: pgmap v770: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:48 smithi137 ceph-mon[31694]: pgmap v770: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:51.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:50 smithi137 ceph-mon[31694]: pgmap v771: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:15:51.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:50 smithi007 ceph-mon[27906]: pgmap v771: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:15:51.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:50 smithi186 ceph-mon[31814]: pgmap v771: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:15:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:52 smithi137 ceph-mon[31694]: pgmap v772: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:15:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:52 smithi007 ceph-mon[27906]: pgmap v772: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:15:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:52 smithi186 ceph-mon[31814]: pgmap v772: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 -- 172.21.15.7:0/363883626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d010e650 msgr2=0x7f87d0110aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 --2- 172.21.15.7:0/363883626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d010e650 0x7f87d0110aa0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009ca0 tx=0x7f87c802a950 comp rx=0 tx=0).stop 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 -- 172.21.15.7:0/363883626 shutdown_connections 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 --2- 172.21.15.7:0/363883626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d010e650 0x7f87d0110aa0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 --2- 172.21.15.7:0/363883626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074d50 0x7f87d010e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 --2- 172.21.15.7:0/363883626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d0074430 0x7f87d0074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 -- 172.21.15.7:0/363883626 >> 172.21.15.7:0/363883626 conn(0x7f87d00fd980 msgr2=0x7f87d00ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 -- 172.21.15.7:0/363883626 shutdown_connections 2024-04-23T15:15:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.303+0000 7f87cf200640 1 -- 172.21.15.7:0/363883626 wait complete. 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.304+0000 7f87cf200640 1 Processor -- start 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.304+0000 7f87cf200640 1 -- start start 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cf200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074430 0x7f87d01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cf200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 0x7f87d01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d010e650 0x7f87d019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cf200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0114280 con 0x7f87d0074d50 2024-04-23T15:15:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0114100 con 0x7f87d010e650 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cf200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0114400 con 0x7f87d0074430 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 0x7f87d01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 0x7f87d01a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59606/0 (socket says 172.21.15.7:59606) 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cd400640 1 -- 172.21.15.7:0/2048734468 learned_addr learned my addr 172.21.15.7:0/2048734468 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cde00640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074430 0x7f87d01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87ce800640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d010e650 0x7f87d019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.305+0000 7f87cd400640 1 -- 172.21.15.7:0/2048734468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074430 msgr2=0x7f87d01a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cd400640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074430 0x7f87d01a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cd400640 1 -- 172.21.15.7:0/2048734468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d010e650 msgr2=0x7f87d019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cd400640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d010e650 0x7f87d019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cd400640 1 -- 172.21.15.7:0/2048734468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d019af00 con 0x7f87d0074d50 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87ce800640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d010e650 0x7f87d019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cde00640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074430 0x7f87d01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cd400640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 0x7f87d01a0ac0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d770 tx=0x7f87b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87c6a00640 1 -- 172.21.15.7:0/2048734468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8017070 con 0x7f87d0074d50 2024-04-23T15:15:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87c6a00640 1 -- 172.21.15.7:0/2048734468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87b80054d0 con 0x7f87d0074d50 2024-04-23T15:15:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87c6a00640 1 -- 172.21.15.7:0/2048734468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004cf0 con 0x7f87d0074d50 2024-04-23T15:15:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.306+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d019b1f0 con 0x7f87d0074d50 2024-04-23T15:15:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.307+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d01a7500 con 0x7f87d0074d50 2024-04-23T15:15:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.311+0000 7f87d7fb5740 1 Processor -- start 2024-04-23T15:15:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 -- start start 2024-04-23T15:15:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87c6a00640 1 -- 172.21.15.7:0/2048734468 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f87b8004e90 con 0x7f87d0074d50 2024-04-23T15:15:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e44060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e46990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f724d9f900 con 0x55f724e393c0 2024-04-23T15:15:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f724d45f20 con 0x55f724e39ce0 2024-04-23T15:15:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.312+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f724d9b8c0 con 0x55f724e445a0 2024-04-23T15:15:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e397a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59610/0 (socket says 172.21.15.7:59610) 2024-04-23T15:15:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 -- 172.21.15.7:0/3184006046 learned_addr learned my addr 172.21.15.7:0/3184006046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87cde00640 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e44060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87cd400640 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e46990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 -- 172.21.15.7:0/3184006046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 msgr2=0x55f724e46990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e46990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 -- 172.21.15.7:0/3184006046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 msgr2=0x55f724e44060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e44060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.313+0000 7f87ce800640 1 -- 172.21.15.7:0/3184006046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f724d6ae10 con 0x55f724e393c0 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.314+0000 7f87cde00640 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e44060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.314+0000 7f87ce800640 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e397a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f87c802fdc0 tx=0x7f87c8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c3b529dc473211 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.314+0000 7f87bf400640 1 -- 172.21.15.7:0/3184006046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8034050 con 0x55f724e393c0 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.314+0000 7f87bf400640 1 -- 172.21.15.7:0/3184006046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87c8003e20 con 0x55f724e393c0 2024-04-23T15:15:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.314+0000 7f87bf400640 1 -- 172.21.15.7:0/3184006046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8004400 con 0x55f724e393c0 2024-04-23T15:15:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.315+0000 7f87c6a00640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f87b40a3d10 0x7f87b40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.315+0000 7f87c6a00640 1 -- 172.21.15.7:0/2048734468 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f87b80d0610 con 0x7f87d0074d50 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.315+0000 7f87cde00640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f87b40a3d10 0x7f87b40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.315+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3184006046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 msgr2=0x55f724e397a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.315+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e397a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f87c802fdc0 tx=0x7f87c8009a20 comp rx=0 tx=0).stop 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3184006046 shutdown_connections 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e44060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e46990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3184006046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e397a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3184006046 >> 172.21.15.7:0/3184006046 conn(0x55f724e358d0 msgr2=0x55f724e35cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3184006046 shutdown_connections 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3184006046 wait complete. 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.316+0000 7f87cde00640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f87b40a3d10 0x7f87b40a61d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f87c0005b60 tx=0x7f87c00093d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.317+0000 7f87d7fb5740 1 -- start start 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.317+0000 7f87d7fb5740 1 Processor -- start 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e41510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e41a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e41f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f724e47110 con 0x55f724e393c0 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f724d592c0 con 0x55f724e39ce0 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f724e47290 con 0x55f724e445a0 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87d7fb5740 10 client.0 _ll_register_callbacks cb 0x55f724ab1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e41510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e41510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59614/0 (socket says 172.21.15.7:59614) 2024-04-23T15:15:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87cde00640 1 -- 172.21.15.7:0/3658006082 learned_addr learned my addr 172.21.15.7:0/3658006082 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87cd400640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e41a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.318+0000 7f87ce800640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e41f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87cde00640 1 -- 172.21.15.7:0/3658006082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 msgr2=0x55f724e41f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87cde00640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e41f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87cde00640 1 -- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 msgr2=0x55f724e41a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87cde00640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e41a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87cde00640 1 -- 172.21.15.7:0/3658006082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f724d69fd0 con 0x55f724e393c0 2024-04-23T15:15:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87cde00640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e41510 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009ab0 tx=0x7f87c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827c6662e05c515c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.319+0000 7f87b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87b3e00640 1 -- 172.21.15.7:0/3658006082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0023070 con 0x55f724e393c0 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87b3e00640 1 -- 172.21.15.7:0/3658006082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f87c001f860 con 0x55f724e393c0 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87c8003e20 con 0x55f724e393c0 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87b3e00640 1 -- 172.21.15.7:0/3658006082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f87c002f050 con 0x55f724e393c0 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87d7fb5740 10 client.17631 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f724ab2210 con 0x55f724e393c0 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.320+0000 7f87b3e00640 1 -- 172.21.15.7:0/3658006082 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87c8003e20 con 0x55f724e393c0 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87b3e00640 1 -- 172.21.15.7:0/3658006082 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f87c000f040 con 0x55f724e393c0 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87d7fb5740 10 client.17631 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87d7fb5740 10 client.17631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87d7fb5740 20 client.17631 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724e54640 0x55f724e56a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87d7fb5740 4 client.17631 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:15:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.321+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f724dad320 con 0x55f724e54640 2024-04-23T15:15:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.322+0000 7f87cd400640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724e54640 0x55f724e56a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.323+0000 7f87cd400640 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724e54640 0x55f724e56a90 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3ecae4c9fa88f5 server_cookie=ac708559ecc65816 in_seq=0 out_seq=0 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.323+0000 7f87b3e00640 10 client.17631 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.325+0000 7f87b3e00640 1 -- 172.21.15.7:0/3658006082 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f724dad320 con 0x55f724e54640 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.325+0000 7f87b3e00640 10 client.17631 handle_command_reply: tid=0 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.325+0000 7f87d7fb5740 1 client.17631 shutdown 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.325+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 msgr2=0x55f724e41510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e41510 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009ab0 tx=0x7f87c0004730 comp rx=0 tx=0).stop 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 shutdown_connections 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724e54640 0x55f724e56a90 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e39ce0 0x55f724e41a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e445a0 0x55f724e41f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/3658006082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e393c0 0x55f724e41510 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 >> 172.21.15.7:0/3658006082 conn(0x55f724e358d0 msgr2=0x55f724e3b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87b3e00640 0 client.17631 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 shutdown_connections 2024-04-23T15:15:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 1 -- 172.21.15.7:0/3658006082 wait complete. 2024-04-23T15:15:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.326+0000 7f87d7fb5740 20 client.17631 trim_cache size 0 max 16384 2024-04-23T15:15:54.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.349+0000 7f87d7fb5740 1 Processor -- start 2024-04-23T15:15:54.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.349+0000 7f87d7fb5740 1 -- start start 2024-04-23T15:15:54.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724e4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724e3bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e5c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01b1450 con 0x55f724e39ce0 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01b2f90 con 0x55f724e445a0 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01b1b20 con 0x55f724e5c3a0 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724e4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724e4ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59628/0 (socket says 172.21.15.7:59628) 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87cde00640 1 -- 172.21.15.7:0/2439881925 learned_addr learned my addr 172.21.15.7:0/2439881925 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.350+0000 7f87cd400640 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724e3bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87cde00640 1 -- 172.21.15.7:0/2439881925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 msgr2=0x55f724e5c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87cde00640 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e5c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87cde00640 1 -- 172.21.15.7:0/2439881925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 msgr2=0x55f724e3bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87cde00640 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724e3bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87cde00640 1 -- 172.21.15.7:0/2439881925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f724b7e620 con 0x55f724e39ce0 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87cde00640 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724e4ffd0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f87c00094b0 tx=0x7f87c0010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb590eec5a64b6f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.351+0000 7f87bea00640 1 -- 172.21.15.7:0/2439881925 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0037030 con 0x55f724e39ce0 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.352+0000 7f87bea00640 1 -- 172.21.15.7:0/2439881925 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87c001fb10 con 0x55f724e39ce0 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.352+0000 7f87bea00640 1 -- 172.21.15.7:0/2439881925 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0023050 con 0x55f724e39ce0 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.352+0000 7f87d7fb5740 1 -- 172.21.15.7:0/2439881925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 msgr2=0x55f724e4ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.352+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724e4ffd0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f87c00094b0 tx=0x7f87c0010c20 comp rx=0 tx=0).stop 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 -- 172.21.15.7:0/2439881925 shutdown_connections 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724e3bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e5c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/2439881925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724e4ffd0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 -- 172.21.15.7:0/2439881925 >> 172.21.15.7:0/2439881925 conn(0x55f724e358d0 msgr2=0x55f724e34a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 -- 172.21.15.7:0/2439881925 shutdown_connections 2024-04-23T15:15:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 -- 172.21.15.7:0/2439881925 wait complete. 2024-04-23T15:15:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 -- start start 2024-04-23T15:15:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.353+0000 7f87d7fb5740 1 Processor -- start 2024-04-23T15:15:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724ebc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724ebcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e486d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01b28c0 con 0x55f724e39ce0 2024-04-23T15:15:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01b21f0 con 0x55f724e445a0 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01af450 con 0x55f724e5c3a0 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87d7fb5740 10 client.0 _ll_register_callbacks cb 0x7f87c0016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724ebc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87cde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724ebc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59630/0 (socket says 172.21.15.7:59630) 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.354+0000 7f87cde00640 1 -- 172.21.15.7:0/1173067782 learned_addr learned my addr 172.21.15.7:0/1173067782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87ce800640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87cde00640 1 -- 172.21.15.7:0/1173067782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 msgr2=0x55f724e486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87cde00640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87cde00640 1 -- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 msgr2=0x55f724ebcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87cde00640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724ebcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87cde00640 1 -- 172.21.15.7:0/1173067782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f724e48dc0 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87ce800640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87cde00640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724ebc730 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f87c00093a0 tx=0x7f87c0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47cb2aa5b7b590d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87b3e00640 1 -- 172.21.15.7:0/1173067782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0040030 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87b3e00640 1 -- 172.21.15.7:0/1173067782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f87c0011090 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.355+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87c001fb10 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87b3e00640 1 -- 172.21.15.7:0/1173067782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f87c004d050 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 10 client.17637 fetch_fsmap learned FSMap version 32 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f724ec3ee0 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87b3e00640 1 -- 172.21.15.7:0/1173067782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87c001fb10 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87b3e00640 1 -- 172.21.15.7:0/1173067782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f87c0028650 con 0x55f724e39ce0 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 10 client.17637 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 10 client.17637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:15:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 20 client.17637 populate_metadata read hostname 'smithi007' 2024-04-23T15:15:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724ec44f0 0x55f724ec6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:15:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 4 client.17637 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:15:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.356+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f724da7190 con 0x55f724ec44f0 2024-04-23T15:15:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.357+0000 7f87cd400640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724ec44f0 0x55f724ec6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:15:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.358+0000 7f87cd400640 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724ec44f0 0x55f724ec6910 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=681f28588aa8a621 server_cookie=1d7a0a6ef89e30f9 in_seq=0 out_seq=0 2024-04-23T15:15:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.358+0000 7f87b3e00640 10 client.17637 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87b3e00640 1 -- 172.21.15.7:0/1173067782 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f724da7190 con 0x55f724ec44f0 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87b3e00640 10 client.17637 handle_command_reply: tid=0 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 client.17637 shutdown 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 msgr2=0x55f724ebc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724ebc730 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f87c00093a0 tx=0x7f87c0011cf0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 shutdown_connections 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f724ec44f0 0x55f724ec6910 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f724e445a0 0x55f724ebcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f724e5c3a0 0x55f724e486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 --2- 172.21.15.7:0/1173067782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f724e39ce0 0x55f724ebc730 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 >> 172.21.15.7:0/1173067782 conn(0x55f724e358d0 msgr2=0x55f724e5b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87b3e00640 0 client.17637 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.385+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 shutdown_connections 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.386+0000 7f87d7fb5740 1 -- 172.21.15.7:0/1173067782 wait complete. 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.386+0000 7f87d7fb5740 20 client.17637 trim_cache size 0 max 16384 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:15:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:15:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.386+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f87b40a3d10 msgr2=0x7f87b40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.386+0000 7f87cf200640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f87b40a3d10 0x7f87b40a61d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f87c0005b60 tx=0x7f87c00093d0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 msgr2=0x7f87d01a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:15:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 0x7f87d01a0ac0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d770 tx=0x7f87b800dc30 comp rx=0 tx=0).stop 2024-04-23T15:15:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 shutdown_connections 2024-04-23T15:15:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f87b40a3d10 0x7f87b40a61d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87d010e650 0x7f87d019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87d0074d50 0x7f87d01a0ac0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 --2- 172.21.15.7:0/2048734468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87d0074430 0x7f87d01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:15:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 >> 172.21.15.7:0/2048734468 conn(0x7f87d00fd980 msgr2=0x7f87d00fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:15:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 shutdown_connections 2024-04-23T15:15:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:15:54.387+0000 7f87cf200640 1 -- 172.21.15.7:0/2048734468 wait complete. 2024-04-23T15:15:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:54 smithi137 ceph-mon[31694]: pgmap v773: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:54 smithi007 ceph-mon[27906]: pgmap v773: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:55.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:54 smithi186 ceph-mon[31814]: pgmap v773: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:56 smithi137 ceph-mon[31694]: pgmap v774: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:56 smithi007 ceph-mon[27906]: pgmap v774: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:57.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:56 smithi186 ceph-mon[31814]: pgmap v774: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:15:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:15:58 smithi137 ceph-mon[31694]: pgmap v775: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:59.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:15:58 smithi007 ceph-mon[27906]: pgmap v775: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:15:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:15:58 smithi186 ceph-mon[31814]: pgmap v775: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:16:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:00 smithi137 ceph-mon[31694]: pgmap v776: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:16:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:00 smithi007 ceph-mon[27906]: pgmap v776: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:16:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:00 smithi186 ceph-mon[31814]: pgmap v776: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:16:02.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:01 smithi007 ceph-mon[27906]: pgmap v777: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:16:02.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:01 smithi186 ceph-mon[31814]: pgmap v777: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:16:02.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:01 smithi137 ceph-mon[31694]: pgmap v777: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:16:04.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:04 smithi007 ceph-mon[27906]: pgmap v778: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.6 MiB/s wr, 35 op/s 2024-04-23T15:16:04.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:04 smithi186 ceph-mon[31814]: pgmap v778: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.6 MiB/s wr, 35 op/s 2024-04-23T15:16:04.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:04 smithi137 ceph-mon[31694]: pgmap v778: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.6 MiB/s wr, 35 op/s 2024-04-23T15:16:06.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:06 smithi007 ceph-mon[27906]: pgmap v779: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 30 op/s 2024-04-23T15:16:06.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:06 smithi186 ceph-mon[31814]: pgmap v779: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 30 op/s 2024-04-23T15:16:06.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:06 smithi137 ceph-mon[31694]: pgmap v779: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 30 op/s 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 -- 172.21.15.7:0/3543001094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f671410e4d0 msgr2=0x7f671410e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 --2- 172.21.15.7:0/3543001094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f671410e4d0 0x7f671410e8b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6704009930 tx=0x7f670402a420 comp rx=0 tx=0).stop 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 -- 172.21.15.7:0/3543001094 shutdown_connections 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 --2- 172.21.15.7:0/3543001094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108ec0 0x7f6714115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 --2- 172.21.15.7:0/3543001094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6714108540 0x7f6714108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 --2- 172.21.15.7:0/3543001094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f671410e4d0 0x7f671410e8b0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 -- 172.21.15.7:0/3543001094 >> 172.21.15.7:0/3543001094 conn(0x7f6714077de0 msgr2=0x7f6714106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 -- 172.21.15.7:0/3543001094 shutdown_connections 2024-04-23T15:16:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.539+0000 7f6713e00640 1 -- 172.21.15.7:0/3543001094 wait complete. 2024-04-23T15:16:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.540+0000 7f6713e00640 1 Processor -- start 2024-04-23T15:16:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 -- start start 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108540 0x7f67141a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 0x7f67141a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f671410e4d0 0x7f671419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67141186f0 con 0x7f6714108ec0 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6714118570 con 0x7f6714108540 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.541+0000 7f6713e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6714118870 con 0x7f671410e4d0 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 0x7f67141a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 0x7f67141a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60880/0 (socket says 172.21.15.7:60880) 2024-04-23T15:16:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 -- 172.21.15.7:0/4037243385 learned_addr learned my addr 172.21.15.7:0/4037243385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712a00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108540 0x7f67141a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6713400640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f671410e4d0 0x7f671419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 -- 172.21.15.7:0/4037243385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f671410e4d0 msgr2=0x7f671419ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f671410e4d0 0x7f671419ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 -- 172.21.15.7:0/4037243385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108540 msgr2=0x7f67141a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108540 0x7f67141a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712000640 1 -- 172.21.15.7:0/4037243385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671419f210 con 0x7f6714108ec0 2024-04-23T15:16:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.542+0000 7f6712a00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108540 0x7f67141a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:16:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.543+0000 7f6712000640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 0x7f67141a4e20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f670000e9f0 tx=0x7f670000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.543+0000 7f670b400640 1 -- 172.21.15.7:0/4037243385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000cd80 con 0x7f6714108ec0 2024-04-23T15:16:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.543+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671419f500 con 0x7f6714108ec0 2024-04-23T15:16:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.543+0000 7f670b400640 1 -- 172.21.15.7:0/4037243385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67000054d0 con 0x7f6714108ec0 2024-04-23T15:16:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.543+0000 7f670b400640 1 -- 172.21.15.7:0/4037243385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700010490 con 0x7f6714108ec0 2024-04-23T15:16:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.543+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67141ab7a0 con 0x7f6714108ec0 2024-04-23T15:16:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.547+0000 7f671c982740 1 Processor -- start 2024-04-23T15:16:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.547+0000 7f671c982740 1 -- start start 2024-04-23T15:16:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f671c982740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 0x55b046fcc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f671c982740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fccce0 0x55b046fd7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f671c982740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f671c982740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b046f32900 con 0x55b046fcc3c0 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f671c982740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b046ed8f20 con 0x55b046fd75a0 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f671c982740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b046f2e8c0 con 0x55b046fccce0 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 0x55b046fcc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 0x55b046fcc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60888/0 (socket says 172.21.15.7:60888) 2024-04-23T15:16:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 -- 172.21.15.7:0/2787234213 learned_addr learned my addr 172.21.15.7:0/2787234213 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6712a00640 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fccce0 0x55b046fd7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 -- 172.21.15.7:0/2787234213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fccce0 msgr2=0x55b046fd7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fccce0 0x55b046fd7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 -- 172.21.15.7:0/2787234213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 msgr2=0x55b046fd9990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd9990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.548+0000 7f6713400640 1 -- 172.21.15.7:0/2787234213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b046efde10 con 0x55b046fcc3c0 2024-04-23T15:16:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.549+0000 7f6713400640 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 0x55b046fcc7a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f670c009f40 tx=0x7f670c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317a3e8ddb597519 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.549+0000 7f670b400640 1 -- 172.21.15.7:0/4037243385 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6700005020 con 0x7f6714108ec0 2024-04-23T15:16:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.549+0000 7f66ffe00640 1 -- 172.21.15.7:0/2787234213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c003b70 con 0x55b046fcc3c0 2024-04-23T15:16:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.549+0000 7f66ffe00640 1 -- 172.21.15.7:0/2787234213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f670c003d10 con 0x55b046fcc3c0 2024-04-23T15:16:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.549+0000 7f66ffe00640 1 -- 172.21.15.7:0/2787234213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c0118a0 con 0x55b046fcc3c0 2024-04-23T15:16:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 -- 172.21.15.7:0/2787234213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 msgr2=0x55b046fcc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 0x55b046fcc7a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f670c009f40 tx=0x7f670c010860 comp rx=0 tx=0).stop 2024-04-23T15:16:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 -- 172.21.15.7:0/2787234213 shutdown_connections 2024-04-23T15:16:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fccce0 0x55b046fd7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 --2- 172.21.15.7:0/2787234213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fcc3c0 0x55b046fcc7a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 -- 172.21.15.7:0/2787234213 >> 172.21.15.7:0/2787234213 conn(0x55b046fc88d0 msgr2=0x55b046fc8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.550+0000 7f671c982740 1 -- 172.21.15.7:0/2787234213 shutdown_connections 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.551+0000 7f671c982740 1 -- 172.21.15.7:0/2787234213 wait complete. 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.551+0000 7f670b400640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f66f80a3ca0 0x7f66f80a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.551+0000 7f671c982740 1 -- start start 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.551+0000 7f670b400640 1 -- 172.21.15.7:0/4037243385 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f67000d0fe0 con 0x7f6714108ec0 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.551+0000 7f6713400640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f66f80a3ca0 0x7f66f80a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.551+0000 7f671c982740 1 Processor -- start 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fccce0 0x55b046fd4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 0x55b046fd50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b046fda0e0 con 0x55b046fd75a0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b046eec2c0 con 0x55b046fccce0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b046fda260 con 0x55b046fcc3c0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f671c982740 10 client.0 _ll_register_callbacks cb 0x55b046c44a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f6713400640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f66f80a3ca0 0x7f66f80a6160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f670c006010 tx=0x7f670c005bd0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f6713400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 0x55b046fd50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f6713400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 0x55b046fd50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60894/0 (socket says 172.21.15.7:60894) 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.552+0000 7f6713400640 1 -- 172.21.15.7:0/2700777699 learned_addr learned my addr 172.21.15.7:0/2700777699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6712a00640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6712000640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fccce0 0x55b046fd4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6713400640 1 -- 172.21.15.7:0/2700777699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 msgr2=0x55b046fd4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6713400640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6713400640 1 -- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fccce0 msgr2=0x55b046fd4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6713400640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fccce0 0x55b046fd4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6713400640 1 -- 172.21.15.7:0/2700777699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b046efcfd0 con 0x55b046fd75a0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f6713400640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 0x55b046fd50c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f670c004710 tx=0x7f670c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f609b0aa15d060 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.553+0000 7f66fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.554+0000 7f66fcc00640 1 -- 172.21.15.7:0/2700777699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c036060 con 0x55b046fd75a0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.554+0000 7f66fcc00640 1 -- 172.21.15.7:0/2700777699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f670c031410 con 0x55b046fd75a0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.554+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f670c003d10 con 0x55b046fd75a0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.554+0000 7f66fcc00640 1 -- 172.21.15.7:0/2700777699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f670c03d050 con 0x55b046fd75a0 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.554+0000 7f671c982740 10 client.17649 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.554+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b046c45210 con 0x55b046fd75a0 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f66fcc00640 1 -- 172.21.15.7:0/2700777699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f670c003d10 con 0x55b046fd75a0 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f66fcc00640 1 -- 172.21.15.7:0/2700777699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f670c026530 con 0x55b046fd75a0 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f671c982740 10 client.17649 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f671c982740 10 client.17649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f671c982740 20 client.17649 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f671c982740 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b046fe7740 0x55b046fe9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f671c982740 4 client.17649 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:16:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.555+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b046f40320 con 0x55b046fe7740 2024-04-23T15:16:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.556+0000 7f6712a00640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b046fe7740 0x55b046fe9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.557+0000 7f6712a00640 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b046fe7740 0x55b046fe9b30 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31e6ca3a0632d940 server_cookie=9770169ba1fa8254 in_seq=0 out_seq=0 2024-04-23T15:16:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.557+0000 7f66fcc00640 10 client.17649 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.558+0000 7f66fcc00640 1 -- 172.21.15.7:0/2700777699 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b046f40320 con 0x55b046fe7740 2024-04-23T15:16:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.558+0000 7f66fcc00640 10 client.17649 handle_command_reply: tid=0 2024-04-23T15:16:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.558+0000 7f671c982740 1 client.17649 shutdown 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 msgr2=0x55b046fd50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 0x55b046fd50c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f670c004710 tx=0x7f670c010860 comp rx=0 tx=0).stop 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 shutdown_connections 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b046fe7740 0x55b046fe9b30 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fccce0 0x55b046fd4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fd75a0 0x55b046fd50c0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 --2- 172.21.15.7:0/2700777699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 >> 172.21.15.7:0/2700777699 conn(0x55b046fc88d0 msgr2=0x55b046fce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f66fcc00640 0 client.17649 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 shutdown_connections 2024-04-23T15:16:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 1 -- 172.21.15.7:0/2700777699 wait complete. 2024-04-23T15:16:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.559+0000 7f671c982740 20 client.17649 trim_cache size 0 max 16384 2024-04-23T15:16:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 Processor -- start 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 -- start start 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fc8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67141b58d0 con 0x55b046fccce0 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67141b7410 con 0x55b046fd75a0 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f671c982740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f67141b5fa0 con 0x55b046fcc3c0 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.577+0000 7f6712000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fc8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fc8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60908/0 (socket says 172.21.15.7:60908) 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 -- 172.21.15.7:0/1828756183 learned_addr learned my addr 172.21.15.7:0/1828756183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712a00640 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6713400640 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 -- 172.21.15.7:0/1828756183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 msgr2=0x55b046fd6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 -- 172.21.15.7:0/1828756183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 msgr2=0x55b046fd4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 -- 172.21.15.7:0/1828756183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b046d11620 con 0x55b046fccce0 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.578+0000 7f6712000640 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fc8210 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f670009c8b0 tx=0x7f670009c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c8a12ff47ad502 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.579+0000 7f66ff400640 1 -- 172.21.15.7:0/1828756183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700005680 con 0x55b046fccce0 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.579+0000 7f66ff400640 1 -- 172.21.15.7:0/1828756183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f670009d2b0 con 0x55b046fccce0 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.579+0000 7f66ff400640 1 -- 172.21.15.7:0/1828756183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000bd0b0 con 0x55b046fccce0 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 -- 172.21.15.7:0/1828756183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 msgr2=0x55b046fc8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fc8210 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f670009c8b0 tx=0x7f670009c7b0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 -- 172.21.15.7:0/1828756183 shutdown_connections 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fd4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fc8210 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 --2- 172.21.15.7:0/1828756183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fd6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 -- 172.21.15.7:0/1828756183 >> 172.21.15.7:0/1828756183 conn(0x55b046fc88d0 msgr2=0x55b046fce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 -- 172.21.15.7:0/1828756183 shutdown_connections 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 -- 172.21.15.7:0/1828756183 wait complete. 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.580+0000 7f671c982740 1 -- start start 2024-04-23T15:16:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 Processor -- start 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fdf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fdf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fda710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67141b6d40 con 0x55b046fccce0 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67141b6670 con 0x55b046fd75a0 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f67141b38d0 con 0x55b046fcc3c0 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f671c982740 10 client.0 _ll_register_callbacks cb 0x7f670c009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f6712000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fdf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f6712000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fdf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60924/0 (socket says 172.21.15.7:60924) 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.581+0000 7f6712000640 1 -- 172.21.15.7:0/2922002634 learned_addr learned my addr 172.21.15.7:0/2922002634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6713400640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fda710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712a00640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fdf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712000640 1 -- 172.21.15.7:0/2922002634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 msgr2=0x55b046fdf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712000640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fdf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712000640 1 -- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 msgr2=0x55b046fda710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712000640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fda710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712000640 1 -- 172.21.15.7:0/2922002634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b046fdaea0 con 0x55b046fccce0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6713400640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fda710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f6712000640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fdf7e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6700099580 tx=0x7f67000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6215baa478cbcde8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f66fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.582+0000 7f66fcc00640 1 -- 172.21.15.7:0/2922002634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670009cbb0 con 0x55b046fccce0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f66fcc00640 1 -- 172.21.15.7:0/2922002634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 9467+0+0 (secure 0 0 0) 0x7f67000ce5e0 con 0x55b046fccce0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f670009d2b0 con 0x55b046fccce0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f66fcc00640 1 -- 172.21.15.7:0/2922002634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f67000a0f60 con 0x55b046fccce0 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 10 client.17655 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b04704d420 con 0x55b046fccce0 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f66fcc00640 1 -- 172.21.15.7:0/2922002634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f670009d2b0 con 0x55b046fccce0 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f66fcc00640 1 -- 172.21.15.7:0/2922002634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6700098990 con 0x55b046fccce0 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 10 client.17655 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 10 client.17655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 20 client.17655 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b04704db10 0x55b04704ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 4 client.17655 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.583+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b046f3a190 con 0x55b04704db10 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.584+0000 7f6712a00640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b04704db10 0x55b04704ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.585+0000 7f6712a00640 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b04704db10 0x55b04704ff30 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3262c3061a5928b7 server_cookie=ab4c60799974cc85 in_seq=0 out_seq=0 2024-04-23T15:16:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.585+0000 7f66fcc00640 10 client.17655 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.616+0000 7f66fcc00640 1 -- 172.21.15.7:0/2922002634 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b046f3a190 con 0x55b04704db10 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.616+0000 7f66fcc00640 10 client.17655 handle_command_reply: tid=0 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.616+0000 7f671c982740 1 client.17655 shutdown 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 msgr2=0x55b046fdf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fdf7e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6700099580 tx=0x7f67000047c0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 shutdown_connections 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b04704db10 0x55b04704ff30 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b046fd75a0 0x55b046fda710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b046fccce0 0x55b046fdf7e0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 --2- 172.21.15.7:0/2922002634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b046fcc3c0 0x55b046fdf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f66fcc00640 0 client.17655 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 >> 172.21.15.7:0/2922002634 conn(0x55b046fc88d0 msgr2=0x55b046fc7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 shutdown_connections 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 1 -- 172.21.15.7:0/2922002634 wait complete. 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.617+0000 7f671c982740 20 client.17655 trim_cache size 0 max 16384 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:16:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:16:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f66f80a3ca0 msgr2=0x7f66f80a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f66f80a3ca0 0x7f66f80a6160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f670c006010 tx=0x7f670c005bd0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 msgr2=0x7f67141a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 0x7f67141a4e20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f670000e9f0 tx=0x7f670000edf0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 shutdown_connections 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f66f80a3ca0 0x7f66f80a6160 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f671410e4d0 0x7f671419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6714108ec0 0x7f67141a4e20 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 --2- 172.21.15.7:0/4037243385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714108540 0x7f67141a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.618+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 >> 172.21.15.7:0/4037243385 conn(0x7f6714077de0 msgr2=0x7f6714078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.619+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 shutdown_connections 2024-04-23T15:16:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:07.619+0000 7f6713e00640 1 -- 172.21.15.7:0/4037243385 wait complete. 2024-04-23T15:16:08.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:08 smithi186 ceph-mon[31814]: pgmap v780: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 36 op/s 2024-04-23T15:16:08.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:08 smithi137 ceph-mon[31694]: pgmap v780: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 36 op/s 2024-04-23T15:16:08.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:08 smithi007 ceph-mon[27906]: pgmap v780: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 36 op/s 2024-04-23T15:16:09.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:09 smithi186 ceph-mon[31814]: osdmap e129: 12 total, 12 up, 12 in 2024-04-23T15:16:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:09 smithi137 ceph-mon[31694]: osdmap e129: 12 total, 12 up, 12 in 2024-04-23T15:16:09.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:09 smithi007 ceph-mon[27906]: osdmap e129: 12 total, 12 up, 12 in 2024-04-23T15:16:10.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:10 smithi186 ceph-mon[31814]: pgmap v782: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T15:16:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:10 smithi137 ceph-mon[31694]: pgmap v782: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T15:16:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:10 smithi007 ceph-mon[27906]: pgmap v782: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T15:16:12.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:12 smithi137 ceph-mon[31694]: pgmap v783: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T15:16:12.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:12 smithi007 ceph-mon[27906]: pgmap v783: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T15:16:12.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:12 smithi186 ceph-mon[31814]: pgmap v783: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 33 op/s 2024-04-23T15:16:14.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:14 smithi137 ceph-mon[31694]: pgmap v784: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:16:14.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:14 smithi007 ceph-mon[27906]: pgmap v784: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:16:14.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:14 smithi186 ceph-mon[31814]: pgmap v784: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:16:17.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:16 smithi007 ceph-mon[27906]: pgmap v785: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:16:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:16 smithi007 ceph-mon[27906]: osdmap e130: 12 total, 12 up, 12 in 2024-04-23T15:16:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:16 smithi186 ceph-mon[31814]: pgmap v785: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:16:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:16 smithi186 ceph-mon[31814]: osdmap e130: 12 total, 12 up, 12 in 2024-04-23T15:16:17.121 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:16 smithi137 ceph-mon[31694]: pgmap v785: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:16:17.121 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:16 smithi137 ceph-mon[31694]: osdmap e130: 12 total, 12 up, 12 in 2024-04-23T15:16:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:18 smithi007 ceph-mon[27906]: pgmap v787: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 18 op/s 2024-04-23T15:16:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:18 smithi186 ceph-mon[31814]: pgmap v787: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 18 op/s 2024-04-23T15:16:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:18 smithi137 ceph-mon[31694]: pgmap v787: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 18 op/s 2024-04-23T15:16:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 -- 172.21.15.7:0/3568851759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c104c60 msgr2=0x7fee5c108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 --2- 172.21.15.7:0/3568851759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c104c60 0x7fee5c108ca0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fee48009900 tx=0x7fee4802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 -- 172.21.15.7:0/3568851759 shutdown_connections 2024-04-23T15:16:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 --2- 172.21.15.7:0/3568851759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c109380 0x7fee5c110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 --2- 172.21.15.7:0/3568851759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c104c60 0x7fee5c108ca0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 --2- 172.21.15.7:0/3568851759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1042b0 0x7fee5c104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 -- 172.21.15.7:0/3568851759 >> 172.21.15.7:0/3568851759 conn(0x7fee5c0ffb10 msgr2=0x7fee5c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 -- 172.21.15.7:0/3568851759 shutdown_connections 2024-04-23T15:16:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.776+0000 7fee62c00640 1 -- 172.21.15.7:0/3568851759 wait complete. 2024-04-23T15:16:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.777+0000 7fee62c00640 1 Processor -- start 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.777+0000 7fee62c00640 1 -- start start 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1042b0 0x7fee5c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c109380 0x7fee5c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 0x7fee5c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c114370 con 0x7fee5c19a630 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1141f0 con 0x7fee5c1042b0 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1144f0 con 0x7fee5c109380 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 0x7fee5c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 0x7fee5c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38780/0 (socket says 172.21.15.7:38780) 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee62200640 1 -- 172.21.15.7:0/3536973364 learned_addr learned my addr 172.21.15.7:0/3536973364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee61800640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1042b0 0x7fee5c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.778+0000 7fee60e00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c109380 0x7fee5c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62200640 1 -- 172.21.15.7:0/3536973364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c109380 msgr2=0x7fee5c1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62200640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c109380 0x7fee5c1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62200640 1 -- 172.21.15.7:0/3536973364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1042b0 msgr2=0x7fee5c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62200640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1042b0 0x7fee5c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62200640 1 -- 172.21.15.7:0/3536973364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c19b230 con 0x7fee5c19a630 2024-04-23T15:16:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62200640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 0x7fee5c19aab0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fee5400b970 tx=0x7fee5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee5a000640 1 -- 172.21.15.7:0/3536973364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54019070 con 0x7fee5c19a630 2024-04-23T15:16:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee5a000640 1 -- 172.21.15.7:0/3536973364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee54014440 con 0x7fee5c19a630 2024-04-23T15:16:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c1a7310 con 0x7fee5c19a630 2024-04-23T15:16:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.779+0000 7fee5a000640 1 -- 172.21.15.7:0/3536973364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540075d0 con 0x7fee5c19a630 2024-04-23T15:16:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.780+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c1a76c0 con 0x7fee5c19a630 2024-04-23T15:16:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.783+0000 7fee67015740 1 Processor -- start 2024-04-23T15:16:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.784+0000 7fee5a000640 1 -- 172.21.15.7:0/3536973364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fee5401c070 con 0x7fee5c19a630 2024-04-23T15:16:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.784+0000 7fee67015740 1 -- start start 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee67015740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 0x563d4d6c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee67015740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee67015740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee67015740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563d4d62f900 con 0x563d4d6c93c0 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee67015740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563d4d5d5f20 con 0x563d4d6d45a0 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee67015740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563d4d62b8c0 con 0x563d4d6c9ce0 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 0x563d4d6c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 0x563d4d6c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38786/0 (socket says 172.21.15.7:38786) 2024-04-23T15:16:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee60e00640 1 -- 172.21.15.7:0/1426078939 learned_addr learned my addr 172.21.15.7:0/1426078939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.785+0000 7fee61800640 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 -- 172.21.15.7:0/1426078939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 msgr2=0x563d4d6d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 -- 172.21.15.7:0/1426078939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 msgr2=0x563d4d6d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 -- 172.21.15.7:0/1426078939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d4d5fae10 con 0x563d4d6c93c0 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee5a000640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee440a3d10 0x7fee440a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee60e00640 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 0x563d4d6c97a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fee48005ab0 tx=0x7fee48009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cabad49c34e6b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee5a000640 1 -- 172.21.15.7:0/3536973364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7fee540d0130 con 0x7fee5c19a630 2024-04-23T15:16:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.786+0000 7fee61800640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee440a3d10 0x7fee440a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.787+0000 7fee4ea00640 1 -- 172.21.15.7:0/1426078939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48043070 con 0x563d4d6c93c0 2024-04-23T15:16:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.787+0000 7fee4ea00640 1 -- 172.21.15.7:0/1426078939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee480047a0 con 0x563d4d6c93c0 2024-04-23T15:16:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.787+0000 7fee4ea00640 1 -- 172.21.15.7:0/1426078939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48035050 con 0x563d4d6c93c0 2024-04-23T15:16:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 -- 172.21.15.7:0/1426078939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 msgr2=0x563d4d6c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee61800640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee440a3d10 0x7fee440a61d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x563d4d6ca960 tx=0x7fee5000c4b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 0x563d4d6c97a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fee48005ab0 tx=0x7fee48009560 comp rx=0 tx=0).stop 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 -- 172.21.15.7:0/1426078939 shutdown_connections 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 --2- 172.21.15.7:0/1426078939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c93c0 0x563d4d6c97a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 -- 172.21.15.7:0/1426078939 >> 172.21.15.7:0/1426078939 conn(0x563d4d6c58d0 msgr2=0x563d4d6c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 -- 172.21.15.7:0/1426078939 shutdown_connections 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 -- 172.21.15.7:0/1426078939 wait complete. 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.788+0000 7fee67015740 1 -- start start 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 Processor -- start 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c93c0 0x563d4d6d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563d4d6d7080 con 0x563d4d6c9ce0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563d4d5e92c0 con 0x563d4d6d45a0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563d4d6d7200 con 0x563d4d6c93c0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.789+0000 7fee67015740 10 client.0 _ll_register_callbacks cb 0x563d4d341a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38794/0 (socket says 172.21.15.7:38794) 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 -- 172.21.15.7:0/719482214 learned_addr learned my addr 172.21.15.7:0/719482214 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee61800640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c93c0 0x563d4d6d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee62200640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 -- 172.21.15.7:0/719482214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c93c0 msgr2=0x563d4d6d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c93c0 0x563d4d6d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 -- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 msgr2=0x563d4d6d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.790+0000 7fee60e00640 1 -- 172.21.15.7:0/719482214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d4d5f9fd0 con 0x563d4d6c9ce0 2024-04-23T15:16:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee60e00640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d1ba0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fee48005ec0 tx=0x7fee4802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22f6971c4ac94eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee43400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee43400640 1 -- 172.21.15.7:0/719482214 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4804b020 con 0x563d4d6c9ce0 2024-04-23T15:16:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee43400640 1 -- 172.21.15.7:0/719482214 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7fee48005430 con 0x563d4d6c9ce0 2024-04-23T15:16:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee480047a0 con 0x563d4d6c9ce0 2024-04-23T15:16:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee43400640 1 -- 172.21.15.7:0/719482214 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fee48056050 con 0x563d4d6c9ce0 2024-04-23T15:16:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee67015740 10 client.17667 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.791+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563d4d342210 con 0x563d4d6c9ce0 2024-04-23T15:16:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee43400640 1 -- 172.21.15.7:0/719482214 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee480047a0 con 0x563d4d6c9ce0 2024-04-23T15:16:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee43400640 1 -- 172.21.15.7:0/719482214 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fee48031630 con 0x563d4d6c9ce0 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee67015740 10 client.17667 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee67015740 10 client.17667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee67015740 20 client.17667 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee67015740 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d6e45c0 0x563d4d6e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee67015740 4 client.17667 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.792+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d4d63d320 con 0x563d4d6e45c0 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.793+0000 7fee61800640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d6e45c0 0x563d4d6e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.794+0000 7fee61800640 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d6e45c0 0x563d4d6e69b0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1c4326e088bdc9 server_cookie=cfb7b33d0bd56c30 in_seq=0 out_seq=0 2024-04-23T15:16:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.794+0000 7fee43400640 10 client.17667 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee43400640 1 -- 172.21.15.7:0/719482214 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563d4d63d320 con 0x563d4d6e45c0 2024-04-23T15:16:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee43400640 10 client.17667 handle_command_reply: tid=0 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 client.17667 shutdown 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 msgr2=0x563d4d6d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d1ba0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fee48005ec0 tx=0x7fee4802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 shutdown_connections 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d6e45c0 0x563d4d6e69b0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6d45a0 0x563d4d6d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6d1ba0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 --2- 172.21.15.7:0/719482214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c93c0 0x563d4d6d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 >> 172.21.15.7:0/719482214 conn(0x563d4d6c58d0 msgr2=0x563d4d6cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.796+0000 7fee43400640 0 client.17667 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.797+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 shutdown_connections 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.797+0000 7fee67015740 1 -- 172.21.15.7:0/719482214 wait complete. 2024-04-23T15:16:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.797+0000 7fee67015740 20 client.17667 trim_cache size 0 max 16384 2024-04-23T15:16:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.813+0000 7fee67015740 1 Processor -- start 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.813+0000 7fee67015740 1 -- start start 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee67015740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee67015740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee67015740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 0x563d4d6ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee67015740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1b1290 con 0x563d4d6d45a0 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee67015740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1b2dd0 con 0x563d4d6c93c0 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee67015740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1b1960 con 0x563d4d6c9ce0 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee62200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 0x563d4d6ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee62200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 0x563d4d6ec4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38808/0 (socket says 172.21.15.7:38808) 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee62200640 1 -- 172.21.15.7:0/2936599128 learned_addr learned my addr 172.21.15.7:0/2936599128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.814+0000 7fee61800640 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee60e00640 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee62200640 1 -- 172.21.15.7:0/2936599128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 msgr2=0x563d4d6ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee62200640 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee62200640 1 -- 172.21.15.7:0/2936599128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 msgr2=0x563d4d6e0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee62200640 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6e0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee62200640 1 -- 172.21.15.7:0/2936599128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d4d40e620 con 0x563d4d6d45a0 2024-04-23T15:16:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee61800640 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:16:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee62200640 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 0x563d4d6ec4e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fee5409bad0 tx=0x7fee540bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bd1aed5b730d0a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee4e000640 1 -- 172.21.15.7:0/2936599128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540b5070 con 0x563d4d6d45a0 2024-04-23T15:16:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee4e000640 1 -- 172.21.15.7:0/2936599128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee540a0180 con 0x563d4d6d45a0 2024-04-23T15:16:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.815+0000 7fee4e000640 1 -- 172.21.15.7:0/2936599128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540cd860 con 0x563d4d6d45a0 2024-04-23T15:16:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 -- 172.21.15.7:0/2936599128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 msgr2=0x563d4d6ec4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 0x563d4d6ec4e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fee5409bad0 tx=0x7fee540bc040 comp rx=0 tx=0).stop 2024-04-23T15:16:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 -- 172.21.15.7:0/2936599128 shutdown_connections 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6d45a0 0x563d4d6ec4e0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 --2- 172.21.15.7:0/2936599128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 -- 172.21.15.7:0/2936599128 >> 172.21.15.7:0/2936599128 conn(0x563d4d6c58d0 msgr2=0x563d4d6cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.816+0000 7fee67015740 1 -- 172.21.15.7:0/2936599128 shutdown_connections 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.817+0000 7fee67015740 1 -- 172.21.15.7:0/2936599128 wait complete. 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.817+0000 7fee67015740 1 -- start start 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.817+0000 7fee67015740 1 Processor -- start 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6d45a0 0x563d4d6cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1b2700 con 0x563d4d6c9ce0 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1b2030 con 0x563d4d6c93c0 2024-04-23T15:16:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1af290 con 0x563d4d6d45a0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee67015740 10 client.0 _ll_register_callbacks cb 0x7fee5000c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38818/0 (socket says 172.21.15.7:38818) 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 -- 172.21.15.7:0/1761015092 learned_addr learned my addr 172.21.15.7:0/1761015092 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee62200640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6d45a0 0x563d4d6cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee61800640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 -- 172.21.15.7:0/1761015092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6d45a0 msgr2=0x563d4d6cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6d45a0 0x563d4d6cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 -- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 msgr2=0x563d4d6ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.818+0000 7fee60e00640 1 -- 172.21.15.7:0/1761015092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d4d749970 con 0x563d4d6c9ce0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.819+0000 7fee60e00640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ce9c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fee48031a80 tx=0x7fee4802aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca0ca090ddda244 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.819+0000 7fee43400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.819+0000 7fee43400640 1 -- 172.21.15.7:0/1761015092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4805f060 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.819+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee540a0180 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.819+0000 7fee43400640 1 -- 172.21.15.7:0/1761015092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7fee480314a0 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.819+0000 7fee43400640 1 -- 172.21.15.7:0/1761015092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fee48066050 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 10 client.17673 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563d4d74ac60 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee43400640 1 -- 172.21.15.7:0/1761015092 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee540a0180 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee43400640 1 -- 172.21.15.7:0/1761015092 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fee48003a10 con 0x563d4d6c9ce0 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 10 client.17673 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 10 client.17673 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 20 client.17673 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d74b380 0x563d4d74d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 4 client.17673 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.820+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563d4d637190 con 0x563d4d74b380 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.821+0000 7fee61800640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d74b380 0x563d4d74d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.822+0000 7fee61800640 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d74b380 0x563d4d74d7a0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14eee89e4e4f914 server_cookie=12b97add537d3163 in_seq=0 out_seq=0 2024-04-23T15:16:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.822+0000 7fee43400640 10 client.17673 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.854+0000 7fee43400640 1 -- 172.21.15.7:0/1761015092 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563d4d637190 con 0x563d4d74b380 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.854+0000 7fee43400640 10 client.17673 handle_command_reply: tid=0 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.854+0000 7fee67015740 1 client.17673 shutdown 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.854+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 msgr2=0x563d4d6ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.854+0000 7fee67015740 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ce9c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fee48031a80 tx=0x7fee4802aaf0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 shutdown_connections 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563d4d74b380 0x563d4d74d7a0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4d6d45a0 0x563d4d6cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563d4d6c9ce0 0x563d4d6ce9c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 --2- 172.21.15.7:0/1761015092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563d4d6c93c0 0x563d4d6ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee43400640 0 client.17673 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 >> 172.21.15.7:0/1761015092 conn(0x563d4d6c58d0 msgr2=0x563d4d6cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 shutdown_connections 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 1 -- 172.21.15.7:0/1761015092 wait complete. 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.855+0000 7fee67015740 20 client.17673 trim_cache size 0 max 16384 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:16:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:16:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee440a3d10 msgr2=0x7fee440a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee440a3d10 0x7fee440a61d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x563d4d6ca960 tx=0x7fee5000c4b0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 msgr2=0x7fee5c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 0x7fee5c19aab0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fee5400b970 tx=0x7fee5400be30 comp rx=0 tx=0).stop 2024-04-23T15:16:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 shutdown_connections 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee440a3d10 0x7fee440a61d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee5c19a630 0x7fee5c19aab0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c109380 0x7fee5c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 --2- 172.21.15.7:0/3536973364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c1042b0 0x7fee5c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.856+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 >> 172.21.15.7:0/3536973364 conn(0x7fee5c0ffb10 msgr2=0x7fee5c101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.857+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 shutdown_connections 2024-04-23T15:16:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:20.857+0000 7fee62c00640 1 -- 172.21.15.7:0/3536973364 wait complete. 2024-04-23T15:16:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:20 smithi007 ceph-mon[27906]: pgmap v788: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:16:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:20 smithi186 ceph-mon[31814]: pgmap v788: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:16:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:20 smithi137 ceph-mon[31694]: pgmap v788: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:16:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:22 smithi007 ceph-mon[27906]: pgmap v789: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:16:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:16:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:22 smithi186 ceph-mon[31814]: pgmap v789: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:16:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:16:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:22 smithi137 ceph-mon[31694]: pgmap v789: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:16:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:16:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:24 smithi007 ceph-mon[27906]: pgmap v790: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:16:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:24 smithi186 ceph-mon[31814]: pgmap v790: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:16:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:24 smithi137 ceph-mon[31694]: pgmap v790: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:16:27.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:26 smithi007 ceph-mon[27906]: pgmap v791: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:16:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:26 smithi186 ceph-mon[31814]: pgmap v791: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:16:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:26 smithi137 ceph-mon[31694]: pgmap v791: 129 pgs: 129 active+clean; 6.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:16:29.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:28 smithi007 ceph-mon[27906]: pgmap v792: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.1 MiB/s wr, 20 op/s 2024-04-23T15:16:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:28 smithi186 ceph-mon[31814]: pgmap v792: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.1 MiB/s wr, 20 op/s 2024-04-23T15:16:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:28 smithi137 ceph-mon[31694]: pgmap v792: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.1 MiB/s wr, 20 op/s 2024-04-23T15:16:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:30 smithi007 ceph-mon[27906]: pgmap v793: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:16:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:16:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:16:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:30 smithi186 ceph-mon[31814]: pgmap v793: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:16:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:16:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:16:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:30 smithi137 ceph-mon[31694]: pgmap v793: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:16:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:16:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:16:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:16:33.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:32 smithi007 ceph-mon[27906]: pgmap v794: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:16:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:32 smithi186 ceph-mon[31814]: pgmap v794: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:16:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:32 smithi137 ceph-mon[31694]: pgmap v794: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:16:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 -- 172.21.15.7:0/3511093778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf740743d0 msgr2=0x7faf740747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 --2- 172.21.15.7:0/3511093778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf740743d0 0x7faf740747b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7faf64009900 tx=0x7faf6402a480 comp rx=0 tx=0).stop 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 -- 172.21.15.7:0/3511093778 shutdown_connections 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 --2- 172.21.15.7:0/3511093778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7410e6c0 0x7faf74110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 --2- 172.21.15.7:0/3511093778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 0x7faf7410e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 --2- 172.21.15.7:0/3511093778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf740743d0 0x7faf740747b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 -- 172.21.15.7:0/3511093778 >> 172.21.15.7:0/3511093778 conn(0x7faf740fd950 msgr2=0x7faf740ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 -- 172.21.15.7:0/3511093778 shutdown_connections 2024-04-23T15:16:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.014+0000 7faf73200640 1 -- 172.21.15.7:0/3511093778 wait complete. 2024-04-23T15:16:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 Processor -- start 2024-04-23T15:16:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 -- start start 2024-04-23T15:16:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf740743d0 0x7faf741a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 0x7faf741a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 0x7faf7419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf74114300 con 0x7faf7410e6c0 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf74114180 con 0x7faf740743d0 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.016+0000 7faf73200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faf74114480 con 0x7faf74074cf0 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 0x7faf7419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 0x7faf7419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36502/0 (socket says 172.21.15.7:36502) 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 -- 172.21.15.7:0/2776656225 learned_addr learned my addr 172.21.15.7:0/2776656225 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf71e00640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf740743d0 0x7faf741a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf71400640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 0x7faf741a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 -- 172.21.15.7:0/2776656225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 msgr2=0x7faf741a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 0x7faf741a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 -- 172.21.15.7:0/2776656225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf740743d0 msgr2=0x7faf741a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf740743d0 0x7faf741a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf72800640 1 -- 172.21.15.7:0/2776656225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7419b000 con 0x7faf7410e6c0 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf71400640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 0x7faf741a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.017+0000 7faf71e00640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf740743d0 0x7faf741a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.018+0000 7faf72800640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 0x7faf7419a740 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009fd0 tx=0x7faf6c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.018+0000 7faf6aa00640 1 -- 172.21.15.7:0/2776656225 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c004d20 con 0x7faf7410e6c0 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.018+0000 7faf6aa00640 1 -- 172.21.15.7:0/2776656225 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf6c005020 con 0x7faf7410e6c0 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.018+0000 7faf6aa00640 1 -- 172.21.15.7:0/2776656225 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0116b0 con 0x7faf7410e6c0 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.018+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7419b2f0 con 0x7faf7410e6c0 2024-04-23T15:16:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.018+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf741a75b0 con 0x7faf7410e6c0 2024-04-23T15:16:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.023+0000 7faf7bdde740 1 Processor -- start 2024-04-23T15:16:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.023+0000 7faf6aa00640 1 -- 172.21.15.7:0/2776656225 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7faf6c0051d0 con 0x7faf7410e6c0 2024-04-23T15:16:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.023+0000 7faf7bdde740 1 -- start start 2024-04-23T15:16:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc81ce0 0x55616bc8c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc8e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf7bdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55616bbe7900 con 0x55616bc813c0 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf7bdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55616bb8df20 con 0x55616bc8c5a0 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf7bdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55616bbe38c0 con 0x55616bc81ce0 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf71400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf71400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc817a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36512/0 (socket says 172.21.15.7:36512) 2024-04-23T15:16:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf71400640 1 -- 172.21.15.7:0/2320730846 learned_addr learned my addr 172.21.15.7:0/2320730846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf71e00640 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc81ce0 0x55616bc8c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.024+0000 7faf71400640 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc8e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf71400640 1 -- 172.21.15.7:0/2320730846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc81ce0 msgr2=0x55616bc8c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf71400640 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc81ce0 0x55616bc8c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf71400640 1 -- 172.21.15.7:0/2320730846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 msgr2=0x55616bc8e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf71400640 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc8e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf71400640 1 -- 172.21.15.7:0/2320730846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55616bbb2e10 con 0x55616bc813c0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf71400640 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc817a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7faf600135e0 tx=0x7faf600097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23811c1854b30ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf6aa00640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faf580a3d90 0x7faf580a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf5f400640 1 -- 172.21.15.7:0/2320730846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60011470 con 0x55616bc813c0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.025+0000 7faf6aa00640 1 -- 172.21.15.7:0/2776656225 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7faf6c0d0e20 con 0x7faf7410e6c0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.026+0000 7faf5f400640 1 -- 172.21.15.7:0/2320730846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf6000f950 con 0x55616bc813c0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.026+0000 7faf5f400640 1 -- 172.21.15.7:0/2320730846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60010630 con 0x55616bc813c0 2024-04-23T15:16:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.026+0000 7faf71e00640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faf580a3d90 0x7faf580a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.026+0000 7faf7bdde740 1 -- 172.21.15.7:0/2320730846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 msgr2=0x55616bc817a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.026+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc817a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7faf600135e0 tx=0x7faf600097d0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf71e00640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faf580a3d90 0x7faf580a6250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faf64031440 tx=0x7faf640058d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 -- 172.21.15.7:0/2320730846 shutdown_connections 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc8e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc81ce0 0x55616bc8c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2320730846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc817a0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 -- 172.21.15.7:0/2320730846 >> 172.21.15.7:0/2320730846 conn(0x55616bc7d8d0 msgr2=0x55616bc7dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 -- 172.21.15.7:0/2320730846 shutdown_connections 2024-04-23T15:16:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 -- 172.21.15.7:0/2320730846 wait complete. 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.027+0000 7faf7bdde740 1 -- start start 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 Processor -- start 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc89480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc81ce0 0x55616bc899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc89f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55616bc8f140 con 0x55616bc813c0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55616bba12c0 con 0x55616bc81ce0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55616bc8f2c0 con 0x55616bc8c5a0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf7bdde740 10 client.0 _ll_register_callbacks cb 0x55616b8f9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.028+0000 7faf71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc89480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc89480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36522/0 (socket says 172.21.15.7:36522) 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 -- 172.21.15.7:0/2380638955 learned_addr learned my addr 172.21.15.7:0/2380638955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71400640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc81ce0 0x55616bc899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf72800640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc89f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 -- 172.21.15.7:0/2380638955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 msgr2=0x55616bc89f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc89f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 -- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc81ce0 msgr2=0x55616bc899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc81ce0 0x55616bc899c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 -- 172.21.15.7:0/2380638955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55616bbb1fd0 con 0x55616bc813c0 2024-04-23T15:16:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf71e00640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc89480 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7faf64009900 tx=0x7faf64009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de3cb93f5065790 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.029+0000 7faf53e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf53e00640 1 -- 172.21.15.7:0/2380638955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6404b030 con 0x55616bc813c0 2024-04-23T15:16:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf6000f950 con 0x55616bc813c0 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf53e00640 1 -- 172.21.15.7:0/2380638955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7faf64003ac0 con 0x55616bc813c0 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf53e00640 1 -- 172.21.15.7:0/2380638955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faf64058050 con 0x55616bc813c0 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf7bdde740 10 client.17685 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55616b8fa210 con 0x55616bc813c0 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.030+0000 7faf53e00640 1 -- 172.21.15.7:0/2380638955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf6000f950 con 0x55616bc813c0 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf53e00640 1 -- 172.21.15.7:0/2380638955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7faf64047b30 con 0x55616bc813c0 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf7bdde740 10 client.17685 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf7bdde740 10 client.17685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf7bdde740 20 client.17685 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bc9c760 0x55616bc9ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf7bdde740 4 client.17685 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.031+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55616bbf5320 con 0x55616bc9c760 2024-04-23T15:16:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.032+0000 7faf71400640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bc9c760 0x55616bc9ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.033+0000 7faf71400640 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bc9c760 0x55616bc9ebd0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6ae2b0dee63649f server_cookie=9de51361dd26762 in_seq=0 out_seq=0 2024-04-23T15:16:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.033+0000 7faf53e00640 10 client.17685 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.034+0000 7faf53e00640 1 -- 172.21.15.7:0/2380638955 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55616bbf5320 con 0x55616bc9c760 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.034+0000 7faf53e00640 10 client.17685 handle_command_reply: tid=0 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 client.17685 shutdown 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 msgr2=0x55616bc89480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc89480 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7faf64009900 tx=0x7faf64009260 comp rx=0 tx=0).stop 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 shutdown_connections 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bc9c760 0x55616bc9ebd0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc81ce0 0x55616bc899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc89f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2380638955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc813c0 0x55616bc89480 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 >> 172.21.15.7:0/2380638955 conn(0x55616bc7d8d0 msgr2=0x55616bc83600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf53e00640 0 client.17685 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 shutdown_connections 2024-04-23T15:16:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 1 -- 172.21.15.7:0/2380638955 wait complete. 2024-04-23T15:16:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.035+0000 7faf7bdde740 20 client.17685 trim_cache size 0 max 16384 2024-04-23T15:16:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 Processor -- start 2024-04-23T15:16:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 -- start start 2024-04-23T15:16:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc813c0 0x55616bc98110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 0x55616bc83d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc885e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf741b1410 con 0x55616bc81ce0 2024-04-23T15:16:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf741b2f50 con 0x55616bc813c0 2024-04-23T15:16:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf7bdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faf741b1ae0 con 0x55616bc8c5a0 2024-04-23T15:16:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf71400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 0x55616bc83d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf71400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 0x55616bc83d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36534/0 (socket says 172.21.15.7:36534) 2024-04-23T15:16:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.056+0000 7faf71400640 1 -- 172.21.15.7:0/729360349 learned_addr learned my addr 172.21.15.7:0/729360349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71e00640 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc813c0 0x55616bc98110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf72800640 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc885e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71400640 1 -- 172.21.15.7:0/729360349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 msgr2=0x55616bc885e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71400640 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc885e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71400640 1 -- 172.21.15.7:0/729360349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc813c0 msgr2=0x55616bc98110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71400640 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc813c0 0x55616bc98110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71400640 1 -- 172.21.15.7:0/729360349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55616b9c6620 con 0x55616bc81ce0 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf72800640 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc885e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf71400640 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 0x55616bc83d80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7faf60009380 tx=0x7faf60009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2adbdce8e9683e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.057+0000 7faf5ea00640 1 -- 172.21.15.7:0/729360349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60005240 con 0x55616bc81ce0 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf5ea00640 1 -- 172.21.15.7:0/729360349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf600132e0 con 0x55616bc81ce0 2024-04-23T15:16:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf5ea00640 1 -- 172.21.15.7:0/729360349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6002d0d0 con 0x55616bc81ce0 2024-04-23T15:16:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 -- 172.21.15.7:0/729360349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 msgr2=0x55616bc83d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 0x55616bc83d80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7faf60009380 tx=0x7faf60009530 comp rx=0 tx=0).stop 2024-04-23T15:16:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 -- 172.21.15.7:0/729360349 shutdown_connections 2024-04-23T15:16:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc8c5a0 0x55616bc885e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc81ce0 0x55616bc83d80 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 --2- 172.21.15.7:0/729360349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc813c0 0x55616bc98110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.058+0000 7faf7bdde740 1 -- 172.21.15.7:0/729360349 >> 172.21.15.7:0/729360349 conn(0x55616bc7d8d0 msgr2=0x55616bc7c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.059+0000 7faf7bdde740 1 -- 172.21.15.7:0/729360349 shutdown_connections 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.059+0000 7faf7bdde740 1 -- 172.21.15.7:0/729360349 wait complete. 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.059+0000 7faf7bdde740 1 -- start start 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.059+0000 7faf7bdde740 1 Processor -- start 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc813c0 0x55616bc860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 0x55616bd01d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf741b2880 con 0x55616bc86b30 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf741b21b0 con 0x55616bc8c5a0 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faf741af410 con 0x55616bc813c0 2024-04-23T15:16:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf7bdde740 10 client.0 _ll_register_callbacks cb 0x7faf60005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 0x55616bd01d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 0x55616bd01d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36538/0 (socket says 172.21.15.7:36538) 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 -- 172.21.15.7:0/2080471314 learned_addr learned my addr 172.21.15.7:0/2080471314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf71400640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf71e00640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc813c0 0x55616bc860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 -- 172.21.15.7:0/2080471314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc813c0 msgr2=0x55616bc860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc813c0 0x55616bc860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 -- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 msgr2=0x55616bc865f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.060+0000 7faf72800640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc865f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf72800640 1 -- 172.21.15.7:0/2080471314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55616bd02290 con 0x55616bc86b30 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf71e00640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc813c0 0x55616bc860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf72800640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 0x55616bd01d50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7faf6c020000 tx=0x7faf6c09d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915977724bfe7f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf53e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf53e00640 1 -- 172.21.15.7:0/2080471314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c01f040 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf600132e0 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf53e00640 1 -- 172.21.15.7:0/2080471314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7faf6c0bbb70 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf53e00640 1 -- 172.21.15.7:0/2080471314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faf6c0a5620 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf7bdde740 10 client.17691 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.061+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55616bd033e0 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf53e00640 1 -- 172.21.15.7:0/2080471314 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf600132e0 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf53e00640 1 -- 172.21.15.7:0/2080471314 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7faf6c09dce0 con 0x55616bc86b30 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf7bdde740 10 client.17691 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf7bdde740 10 client.17691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf7bdde740 20 client.17691 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bd03b00 0x55616bd05ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf7bdde740 4 client.17691 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:16:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.062+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55616bbef190 con 0x55616bd03b00 2024-04-23T15:16:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.063+0000 7faf71e00640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bd03b00 0x55616bd05ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.064+0000 7faf71e00640 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bd03b00 0x55616bd05ef0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9926553862b2f478 server_cookie=79a3a38f66017aff in_seq=0 out_seq=0 2024-04-23T15:16:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.064+0000 7faf53e00640 10 client.17691 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf53e00640 1 -- 172.21.15.7:0/2080471314 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55616bbef190 con 0x55616bd03b00 2024-04-23T15:16:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf53e00640 10 client.17691 handle_command_reply: tid=0 2024-04-23T15:16:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 client.17691 shutdown 2024-04-23T15:16:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 msgr2=0x55616bd01d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 0x55616bd01d50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7faf6c020000 tx=0x7faf6c09d0b0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 shutdown_connections 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55616bd03b00 0x55616bd05ef0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55616bc8c5a0 0x55616bc865f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55616bc86b30 0x55616bd01d50 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 --2- 172.21.15.7:0/2080471314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55616bc813c0 0x55616bc860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 >> 172.21.15.7:0/2080471314 conn(0x55616bc7d8d0 msgr2=0x55616bc89420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf53e00640 0 client.17691 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.091+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 shutdown_connections 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.092+0000 7faf7bdde740 1 -- 172.21.15.7:0/2080471314 wait complete. 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.092+0000 7faf7bdde740 20 client.17691 trim_cache size 0 max 16384 2024-04-23T15:16:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:16:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:16:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:16:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:16:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.092+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faf580a3d90 msgr2=0x7faf580a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.092+0000 7faf73200640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faf580a3d90 0x7faf580a6250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faf64031440 tx=0x7faf640058d0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.092+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 msgr2=0x7faf7419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.092+0000 7faf73200640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 0x7faf7419a740 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009fd0 tx=0x7faf6c00ee60 comp rx=0 tx=0).stop 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 shutdown_connections 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7faf580a3d90 0x7faf580a6250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf7410e6c0 0x7faf7419a740 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf74074cf0 0x7faf741a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 --2- 172.21.15.7:0/2776656225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf740743d0 0x7faf741a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 >> 172.21.15.7:0/2776656225 conn(0x7faf740fd950 msgr2=0x7faf740fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 shutdown_connections 2024-04-23T15:16:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:34.093+0000 7faf73200640 1 -- 172.21.15.7:0/2776656225 wait complete. 2024-04-23T15:16:35.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:34 smithi007 ceph-mon[27906]: pgmap v795: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T15:16:35.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:34 smithi186 ceph-mon[31814]: pgmap v795: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T15:16:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:34 smithi137 ceph-mon[31694]: pgmap v795: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T15:16:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:36 smithi007 ceph-mon[27906]: pgmap v796: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-04-23T15:16:37.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:36 smithi186 ceph-mon[31814]: pgmap v796: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-04-23T15:16:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:36 smithi137 ceph-mon[31694]: pgmap v796: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 11 op/s 2024-04-23T15:16:39.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:38 smithi007 ceph-mon[27906]: pgmap v797: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T15:16:39.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:38 smithi186 ceph-mon[31814]: pgmap v797: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T15:16:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:38 smithi137 ceph-mon[31694]: pgmap v797: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.4 MiB/s wr, 19 op/s 2024-04-23T15:16:41.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:40 smithi007 ceph-mon[27906]: pgmap v798: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:16:41.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:40 smithi186 ceph-mon[31814]: pgmap v798: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:16:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:40 smithi137 ceph-mon[31694]: pgmap v798: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:16:43.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:42 smithi007 ceph-mon[27906]: pgmap v799: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:16:43.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:42 smithi186 ceph-mon[31814]: pgmap v799: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:16:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:42 smithi137 ceph-mon[31694]: pgmap v799: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:16:45.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:44 smithi007 ceph-mon[27906]: pgmap v800: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:16:45.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:44 smithi186 ceph-mon[31814]: pgmap v800: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:16:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:44 smithi137 ceph-mon[31694]: pgmap v800: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:16:47.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:46 smithi007 ceph-mon[27906]: pgmap v801: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:16:47.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:46 smithi186 ceph-mon[31814]: pgmap v801: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:16:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:46 smithi137 ceph-mon[31694]: pgmap v801: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 -- 172.21.15.7:0/2545961991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 msgr2=0x7f708410e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 --2- 172.21.15.7:0/2545961991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f708410e1a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7070009900 tx=0x7f707002a480 comp rx=0 tx=0).stop 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 -- 172.21.15.7:0/2545961991 shutdown_connections 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 --2- 172.21.15.7:0/2545961991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708410e6e0 0x7f7084110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 --2- 172.21.15.7:0/2545961991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f708410e1a0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 --2- 172.21.15.7:0/2545961991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70840743b0 0x7f7084074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 -- 172.21.15.7:0/2545961991 >> 172.21.15.7:0/2545961991 conn(0x7f70840fd950 msgr2=0x7f70840ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 -- 172.21.15.7:0/2545961991 shutdown_connections 2024-04-23T15:16:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.250+0000 7f708ac00640 1 -- 172.21.15.7:0/2545961991 wait complete. 2024-04-23T15:16:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.251+0000 7f708ac00640 1 Processor -- start 2024-04-23T15:16:47.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 -- start start 2024-04-23T15:16:47.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70840743b0 0x7f70841a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f70841a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f708410e6e0 0x7f708419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70841142f0 con 0x7f7084074cd0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7084114170 con 0x7f708410e6e0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.252+0000 7f708ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7084114470 con 0x7f70840743b0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f70841a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f70841a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38784/0 (socket says 172.21.15.7:38784) 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 -- 172.21.15.7:0/4283483943 learned_addr learned my addr 172.21.15.7:0/4283483943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7089800640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70840743b0 0x7f70841a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 -- 172.21.15.7:0/4283483943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70840743b0 msgr2=0x7f70841a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70840743b0 0x7f70841a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f708a200640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f708410e6e0 0x7f708419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 -- 172.21.15.7:0/4283483943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f708410e6e0 msgr2=0x7f708419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f708410e6e0 0x7f708419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.253+0000 7f7088e00640 1 -- 172.21.15.7:0/4283483943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708419af70 con 0x7f7084074cd0 2024-04-23T15:16:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.254+0000 7f7088e00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f70841a0b30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7070005ab0 tx=0x7f7070003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.254+0000 7f7082000640 1 -- 172.21.15.7:0/4283483943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707003f070 con 0x7f7084074cd0 2024-04-23T15:16:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.254+0000 7f7082000640 1 -- 172.21.15.7:0/4283483943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7070031d60 con 0x7f7084074cd0 2024-04-23T15:16:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.254+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708419b200 con 0x7f7084074cd0 2024-04-23T15:16:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.254+0000 7f7082000640 1 -- 172.21.15.7:0/4283483943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070035030 con 0x7f7084074cd0 2024-04-23T15:16:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.254+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70841a7570 con 0x7f7084074cd0 2024-04-23T15:16:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 Processor -- start 2024-04-23T15:16:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 -- start start 2024-04-23T15:16:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a78060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d6929d3900 con 0x55d692a6d3c0 2024-04-23T15:16:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d692979f20 con 0x55d692a6dce0 2024-04-23T15:16:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708f18f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d6929cf8c0 con 0x55d692a785a0 2024-04-23T15:16:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.258+0000 7f708a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a6d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38798/0 (socket says 172.21.15.7:38798) 2024-04-23T15:16:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f7082000640 1 -- 172.21.15.7:0/4283483943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7070042070 con 0x7f7084074cd0 2024-04-23T15:16:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 -- 172.21.15.7:0/2054869018 learned_addr learned my addr 172.21.15.7:0/2054869018 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f7089800640 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a78060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 -- 172.21.15.7:0/2054869018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 msgr2=0x55d692a7a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 -- 172.21.15.7:0/2054869018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 msgr2=0x55d692a78060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a78060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.259+0000 7f708a200640 1 -- 172.21.15.7:0/2054869018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69299ee10 con 0x55d692a6d3c0 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.260+0000 7f708a200640 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a6d7a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f707c009ab0 tx=0x7f707c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e58894533e3409 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.260+0000 7f7076a00640 1 -- 172.21.15.7:0/2054869018 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c016070 con 0x55d692a6d3c0 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.260+0000 7f7076a00640 1 -- 172.21.15.7:0/2054869018 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f707c00ecb0 con 0x55d692a6d3c0 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.260+0000 7f7076a00640 1 -- 172.21.15.7:0/2054869018 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c010650 con 0x55d692a6d3c0 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f7082000640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f706c0a3d90 0x7f706c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f7082000640 1 -- 172.21.15.7:0/4283483943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7f70700f1170 con 0x7f7084074cd0 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f7089800640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f706c0a3d90 0x7f706c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 -- 172.21.15.7:0/2054869018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 msgr2=0x55d692a6d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a6d7a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f707c009ab0 tx=0x7f707c009f70 comp rx=0 tx=0).stop 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 -- 172.21.15.7:0/2054869018 shutdown_connections 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a78060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 --2- 172.21.15.7:0/2054869018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a6d7a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 -- 172.21.15.7:0/2054869018 >> 172.21.15.7:0/2054869018 conn(0x55d692a698d0 msgr2=0x55d692a69cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 -- 172.21.15.7:0/2054869018 shutdown_connections 2024-04-23T15:16:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.261+0000 7f708f18f740 1 -- 172.21.15.7:0/2054869018 wait complete. 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.262+0000 7f7089800640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f706c0a3d90 0x7f706c0a6250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55d692a6e960 tx=0x7f7078009580 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.262+0000 7f708f18f740 1 -- start start 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.262+0000 7f708f18f740 1 Processor -- start 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a75b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a76060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d692a7b0e0 con 0x55d692a6d3c0 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d69298d2c0 con 0x55d692a6dce0 2024-04-23T15:16:47.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d692a7b260 con 0x55d692a785a0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f708f18f740 10 client.0 _ll_register_callbacks cb 0x55d6926e5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f7089800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f7089800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a755e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38812/0 (socket says 172.21.15.7:38812) 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f7089800640 1 -- 172.21.15.7:0/2932207075 learned_addr learned my addr 172.21.15.7:0/2932207075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.263+0000 7f7088e00640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a75b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f708a200640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a76060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7089800640 1 -- 172.21.15.7:0/2932207075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 msgr2=0x55d692a76060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7089800640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a76060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7089800640 1 -- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 msgr2=0x55d692a75b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7089800640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a75b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7089800640 1 -- 172.21.15.7:0/2932207075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d69299dfd0 con 0x55d692a6d3c0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7088e00640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a75b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f7089800640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a755e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7078003ec0 tx=0x7f7078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e51ddc308648ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.264+0000 7f706b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:47.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f706b400640 1 -- 172.21.15.7:0/2932207075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078024020 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f706b400640 1 -- 172.21.15.7:0/2932207075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7f7078012920 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707c00ecb0 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f706b400640 1 -- 172.21.15.7:0/2932207075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f707802f050 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f708f18f740 10 client.17703 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d6926e6210 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.265+0000 7f706b400640 1 -- 172.21.15.7:0/2932207075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f707c00ecb0 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f706b400640 1 -- 172.21.15.7:0/2932207075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f707800f040 con 0x55d692a6d3c0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f708f18f740 10 client.17703 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f708f18f740 10 client.17703 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f708f18f740 20 client.17703 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f708f18f740 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692a88820 0x55d692a8ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f708f18f740 4 client.17703 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6929e1320 con 0x55d692a88820 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.266+0000 7f7088e00640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692a88820 0x55d692a8ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.267+0000 7f7088e00640 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692a88820 0x55d692a8ac10 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53883058561c9f5d server_cookie=16e305a54983ab78 in_seq=0 out_seq=0 2024-04-23T15:16:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.267+0000 7f706b400640 10 client.17703 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.270+0000 7f706b400640 1 -- 172.21.15.7:0/2932207075 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d6929e1320 con 0x55d692a88820 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.270+0000 7f706b400640 10 client.17703 handle_command_reply: tid=0 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.270+0000 7f708f18f740 1 client.17703 shutdown 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.270+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 msgr2=0x55d692a755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a755e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7078003ec0 tx=0x7f7078004a40 comp rx=0 tx=0).stop 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 shutdown_connections 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692a88820 0x55d692a8ac10 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a75b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a76060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 --2- 172.21.15.7:0/2932207075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a755e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 >> 172.21.15.7:0/2932207075 conn(0x55d692a698d0 msgr2=0x55d692a6f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f706b400640 0 client.17703 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 shutdown_connections 2024-04-23T15:16:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 1 -- 172.21.15.7:0/2932207075 wait complete. 2024-04-23T15:16:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.271+0000 7f708f18f740 20 client.17703 trim_cache size 0 max 16384 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 Processor -- start 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 -- start start 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a77d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a84080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70841b14e0 con 0x55d692a6d3c0 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70841b3020 con 0x55d692a6dce0 2024-04-23T15:16:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.297+0000 7f708f18f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70841b1bb0 con 0x55d692a785a0 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a77d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a77d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38826/0 (socket says 172.21.15.7:38826) 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 -- 172.21.15.7:0/149156592 learned_addr learned my addr 172.21.15.7:0/149156592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f708a200640 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7088e00640 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a84080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 -- 172.21.15.7:0/149156592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 msgr2=0x55d692a708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 -- 172.21.15.7:0/149156592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 msgr2=0x55d692a84080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a84080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.298+0000 7f7089800640 1 -- 172.21.15.7:0/149156592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d692a7ad00 con 0x55d692a6d3c0 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.299+0000 7f7089800640 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a77d10 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7078000f80 tx=0x7f7078005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1181e5a60810a798 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:47.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.299+0000 7f7076000640 1 -- 172.21.15.7:0/149156592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078024040 con 0x55d692a6d3c0 2024-04-23T15:16:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.299+0000 7f7076000640 1 -- 172.21.15.7:0/149156592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7078016070 con 0x55d692a6d3c0 2024-04-23T15:16:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.299+0000 7f7076000640 1 -- 172.21.15.7:0/149156592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078012b00 con 0x55d692a6d3c0 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 -- 172.21.15.7:0/149156592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 msgr2=0x55d692a77d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a77d10 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7078000f80 tx=0x7f7078005b70 comp rx=0 tx=0).stop 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 -- 172.21.15.7:0/149156592 shutdown_connections 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a84080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 --2- 172.21.15.7:0/149156592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a77d10 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 -- 172.21.15.7:0/149156592 >> 172.21.15.7:0/149156592 conn(0x55d692a698d0 msgr2=0x55d692a75e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 -- 172.21.15.7:0/149156592 shutdown_connections 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.300+0000 7f708f18f740 1 -- 172.21.15.7:0/149156592 wait complete. 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 -- start start 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 Processor -- start 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a7c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70841b2950 con 0x55d692a6d3c0 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70841b2280 con 0x55d692a6dce0 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70841af4e0 con 0x55d692a785a0 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.301+0000 7f708f18f740 10 client.0 _ll_register_callbacks cb 0x7f7078009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a7c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38828/0 (socket says 172.21.15.7:38828) 2024-04-23T15:16:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 -- 172.21.15.7:0/2624313462 learned_addr learned my addr 172.21.15.7:0/2624313462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:16:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f708a200640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7088e00640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a7c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 -- 172.21.15.7:0/2624313462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 msgr2=0x55d692a7cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 -- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 msgr2=0x55d692a7c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:16:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a7c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7089800640 1 -- 172.21.15.7:0/2624313462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6927b2620 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.302+0000 7f7088e00640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a7c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f7089800640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a7c100 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7078009710 tx=0x7f7078012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02fdf954d429192 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f706b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f706b400640 1 -- 172.21.15.7:0/2624313462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078020630 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f706b400640 1 -- 172.21.15.7:0/2624313462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7f70780207d0 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7078016070 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f706b400640 1 -- 172.21.15.7:0/2624313462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7078051050 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f708f18f740 10 client.17709 fetch_fsmap learned FSMap version 32 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.303+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d692aeefd0 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f706b400640 1 -- 172.21.15.7:0/2624313462 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7078016070 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f706b400640 1 -- 172.21.15.7:0/2624313462 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7078033400 con 0x55d692a6d3c0 2024-04-23T15:16:47.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f708f18f740 10 client.17709 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f708f18f740 10 client.17709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f708f18f740 20 client.17709 populate_metadata read hostname 'smithi007' 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f708f18f740 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692aef620 0x55d692af1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f708f18f740 4 client.17709 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.304+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6929db190 con 0x55d692aef620 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.305+0000 7f7088e00640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692aef620 0x55d692af1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.306+0000 7f7088e00640 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692aef620 0x55d692af1a10 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ebd4c7820dbe0a5 server_cookie=49306d69effe3050 in_seq=0 out_seq=0 2024-04-23T15:16:47.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.306+0000 7f706b400640 10 client.17709 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f706b400640 1 -- 172.21.15.7:0/2624313462 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d6929db190 con 0x55d692aef620 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f706b400640 10 client.17709 handle_command_reply: tid=0 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f708f18f740 1 client.17709 shutdown 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 msgr2=0x55d692a7c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f708f18f740 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a7c100 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7078009710 tx=0x7f7078012c10 comp rx=0 tx=0).stop 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 shutdown_connections 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f708f18f740 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d692aef620 0x55d692af1a10 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.338+0000 7f708f18f740 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d692a6dce0 0x55d692a7c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f708f18f740 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d692a785a0 0x55d692a7cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f708f18f740 1 --2- 172.21.15.7:0/2624313462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d692a6d3c0 0x55d692a7c100 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f706b400640 0 client.17709 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 >> 172.21.15.7:0/2624313462 conn(0x55d692a698d0 msgr2=0x55d692a76c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 shutdown_connections 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f708f18f740 1 -- 172.21.15.7:0/2624313462 wait complete. 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.339+0000 7f708f18f740 20 client.17709 trim_cache size 0 max 16384 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:16:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:16:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:16:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f706c0a3d90 msgr2=0x7f706c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f706c0a3d90 0x7f706c0a6250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55d692a6e960 tx=0x7f7078009580 comp rx=0 tx=0).stop 2024-04-23T15:16:47.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 msgr2=0x7f70841a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f70841a0b30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7070005ab0 tx=0x7f7070003cd0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 shutdown_connections 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f706c0a3d90 0x7f706c0a6250 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f708410e6e0 0x7f708419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7084074cd0 0x7f70841a0b30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 --2- 172.21.15.7:0/4283483943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70840743b0 0x7f70841a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 >> 172.21.15.7:0/4283483943 conn(0x7f70840fd950 msgr2=0x7f70840fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 shutdown_connections 2024-04-23T15:16:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:16:47.340+0000 7f708ac00640 1 -- 172.21.15.7:0/4283483943 wait complete. 2024-04-23T15:16:49.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:48 smithi007 ceph-mon[27906]: pgmap v802: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:16:49.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:48 smithi186 ceph-mon[31814]: pgmap v802: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:16:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:48 smithi137 ceph-mon[31694]: pgmap v802: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:16:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:50 smithi186 ceph-mon[31814]: pgmap v803: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:16:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:50 smithi137 ceph-mon[31694]: pgmap v803: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:16:51.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:50 smithi007 ceph-mon[27906]: pgmap v803: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:16:53.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:52 smithi007 ceph-mon[27906]: pgmap v804: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:16:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:52 smithi186 ceph-mon[31814]: pgmap v804: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:16:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:52 smithi137 ceph-mon[31694]: pgmap v804: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:16:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:54 smithi186 ceph-mon[31814]: pgmap v805: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:16:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:54 smithi137 ceph-mon[31694]: pgmap v805: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:16:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:54 smithi007 ceph-mon[27906]: pgmap v805: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:16:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:56 smithi186 ceph-mon[31814]: pgmap v806: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:16:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:56 smithi137 ceph-mon[31694]: pgmap v806: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:16:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:56 smithi007 ceph-mon[27906]: pgmap v806: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:16:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:16:58 smithi137 ceph-mon[31694]: pgmap v807: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:16:59.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:16:58 smithi007 ceph-mon[27906]: pgmap v807: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:16:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:16:58 smithi186 ceph-mon[31814]: pgmap v807: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:17:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 -- 172.21.15.7:0/3407508424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f365010e730 msgr2=0x7f3650110b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 --2- 172.21.15.7:0/3407508424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f365010e730 0x7f3650110b20 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3648009ca0 tx=0x7f364802a8c0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 -- 172.21.15.7:0/3407508424 shutdown_connections 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 --2- 172.21.15.7:0/3407508424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f365010e730 0x7f3650110b20 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 --2- 172.21.15.7:0/3407508424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3650101530 0x7f365010e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 --2- 172.21.15.7:0/3407508424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3650100b80 0x7f3650100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.502+0000 7f364f200640 1 -- 172.21.15.7:0/3407508424 >> 172.21.15.7:0/3407508424 conn(0x7f36500fc820 msgr2=0x7f36500fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.503+0000 7f364f200640 1 -- 172.21.15.7:0/3407508424 shutdown_connections 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.503+0000 7f364f200640 1 -- 172.21.15.7:0/3407508424 wait complete. 2024-04-23T15:17:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 Processor -- start 2024-04-23T15:17:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 -- start start 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 0x7f3650102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3650101530 0x7f36501033a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f365010e730 0x7f36501038e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3650114280 con 0x7f3650100b80 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3650114100 con 0x7f365010e730 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.504+0000 7f364f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3650114400 con 0x7f3650101530 2024-04-23T15:17:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 0x7f3650102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 0x7f3650102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55738/0 (socket says 172.21.15.7:55738) 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 -- 172.21.15.7:0/3549221326 learned_addr learned my addr 172.21.15.7:0/3549221326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364e800640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f365010e730 0x7f36501038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 -- 172.21.15.7:0/3549221326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3650101530 msgr2=0x7f36501033a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3650101530 0x7f36501033a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 -- 172.21.15.7:0/3549221326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f365010e730 msgr2=0x7f36501038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f365010e730 0x7f36501038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.505+0000 7f364de00640 1 -- 172.21.15.7:0/3549221326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36501aae80 con 0x7f3650100b80 2024-04-23T15:17:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.506+0000 7f364de00640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 0x7f3650102e60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f364000d950 tx=0x7f364000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.506+0000 7f3646a00640 1 -- 172.21.15.7:0/3549221326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640017070 con 0x7f3650100b80 2024-04-23T15:17:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.506+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36501ab170 con 0x7f3650100b80 2024-04-23T15:17:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.506+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36501ab710 con 0x7f3650100b80 2024-04-23T15:17:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.507+0000 7f3646a00640 1 -- 172.21.15.7:0/3549221326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3640009c30 con 0x7f3650100b80 2024-04-23T15:17:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.507+0000 7f3646a00640 1 -- 172.21.15.7:0/3549221326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364000f620 con 0x7f3650100b80 2024-04-23T15:17:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.511+0000 7f3657b76740 1 Processor -- start 2024-04-23T15:17:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.511+0000 7f3657b76740 1 -- start start 2024-04-23T15:17:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f3657b76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08f03c0 0x558aa08f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f3657b76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f3657b76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 0x558aa08fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f3657b76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558aa0856900 con 0x558aa08fb5a0 2024-04-23T15:17:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f3657b76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558aa07fcf20 con 0x558aa08f03c0 2024-04-23T15:17:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f3657b76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558aa08528c0 con 0x558aa08f0ce0 2024-04-23T15:17:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.512+0000 7f364d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 0x558aa08fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 0x558aa08fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55750/0 (socket says 172.21.15.7:55750) 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 -- 172.21.15.7:0/834006181 learned_addr learned my addr 172.21.15.7:0/834006181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364e800640 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08f03c0 0x558aa08f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 -- 172.21.15.7:0/834006181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 msgr2=0x558aa08fb060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08fb060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 -- 172.21.15.7:0/834006181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08f03c0 msgr2=0x558aa08f07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08f03c0 0x558aa08f07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f364d400640 1 -- 172.21.15.7:0/834006181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa0821e10 con 0x558aa08fb5a0 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.513+0000 7f3646a00640 1 -- 172.21.15.7:0/3549221326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f364000f7c0 con 0x7f3650100b80 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.514+0000 7f364d400640 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 0x558aa08fd990 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f363c00ba20 tx=0x7f363c00bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b8ce69790e5e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.514+0000 7f363b000640 1 -- 172.21.15.7:0/834006181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c016070 con 0x558aa08fb5a0 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.514+0000 7f363b000640 1 -- 172.21.15.7:0/834006181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f363c0054d0 con 0x558aa08fb5a0 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.514+0000 7f363b000640 1 -- 172.21.15.7:0/834006181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c004da0 con 0x558aa08fb5a0 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3646a00640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f36340a3de0 0x7f36340a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 -- 172.21.15.7:0/834006181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 msgr2=0x558aa08fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 0x558aa08fd990 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f363c00ba20 tx=0x7f363c00bee0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3646a00640 1 -- 172.21.15.7:0/3549221326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7f36400d06c0 con 0x7f3650100b80 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 -- 172.21.15.7:0/834006181 shutdown_connections 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08fb5a0 0x558aa08fd990 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 --2- 172.21.15.7:0/834006181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08f03c0 0x558aa08f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 -- 172.21.15.7:0/834006181 >> 172.21.15.7:0/834006181 conn(0x558aa08ec8d0 msgr2=0x558aa08eccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f364e800640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f36340a3de0 0x7f36340a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.515+0000 7f3657b76740 1 -- 172.21.15.7:0/834006181 shutdown_connections 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.516+0000 7f3657b76740 1 -- 172.21.15.7:0/834006181 wait complete. 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.516+0000 7f3657b76740 1 -- start start 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.516+0000 7f364e800640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f36340a3de0 0x7f36340a62a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f364802ae30 tx=0x7f364802adc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.516+0000 7f3657b76740 1 Processor -- start 2024-04-23T15:17:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08f8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558aa08fe140 con 0x558aa08f03c0 2024-04-23T15:17:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558aa08102c0 con 0x558aa08fb5a0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558aa08fe2c0 con 0x558aa08f0ce0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f3657b76740 10 client.0 _ll_register_callbacks cb 0x558aa0568a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55752/0 (socket says 172.21.15.7:55752) 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 -- 172.21.15.7:0/1660164574 learned_addr learned my addr 172.21.15.7:0/1660164574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 -- 172.21.15.7:0/1660164574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 msgr2=0x558aa08f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 -- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 msgr2=0x558aa08f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.517+0000 7f364de00640 1 -- 172.21.15.7:0/1660164574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa0820fd0 con 0x558aa08f03c0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f364de00640 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08f8570 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f36400ce060 tx=0x7f364009ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e22d31ce81b3ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f362f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f362f400640 1 -- 172.21.15.7:0/1660164574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640020040 con 0x558aa08f03c0 2024-04-23T15:17:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f362f400640 1 -- 172.21.15.7:0/1660164574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7f36400b5660 con 0x558aa08f03c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f363c0054d0 con 0x558aa08f03c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f362f400640 1 -- 172.21.15.7:0/1660164574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f36400a0660 con 0x558aa08f03c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f3657b76740 10 client.17721 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.518+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558aa0569210 con 0x558aa08f03c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f362f400640 1 -- 172.21.15.7:0/1660164574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f363c0054d0 con 0x558aa08f03c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f362f400640 1 -- 172.21.15.7:0/1660164574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f36400a0120 con 0x558aa08f03c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f3657b76740 10 client.17721 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f3657b76740 10 client.17721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f3657b76740 20 client.17721 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f3657b76740 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa090b8c0 0x558aa090dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f3657b76740 4 client.17721 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.519+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aa0864320 con 0x558aa090b8c0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.520+0000 7f364d400640 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa090b8c0 0x558aa090dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.520+0000 7f364d400640 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa090b8c0 0x558aa090dd10 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81d775a0c97b729f server_cookie=8312a8aaefb652c6 in_seq=0 out_seq=0 2024-04-23T15:17:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.520+0000 7f362f400640 10 client.17721 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.522+0000 7f362f400640 1 -- 172.21.15.7:0/1660164574 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558aa0864320 con 0x558aa090b8c0 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.522+0000 7f362f400640 10 client.17721 handle_command_reply: tid=0 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.522+0000 7f3657b76740 1 client.17721 shutdown 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 msgr2=0x558aa08f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08f8570 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f36400ce060 tx=0x7f364009ca70 comp rx=0 tx=0).stop 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 shutdown_connections 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa090b8c0 0x558aa090dd10 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 --2- 172.21.15.7:0/1660164574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08f8570 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 >> 172.21.15.7:0/1660164574 conn(0x558aa08ec8d0 msgr2=0x558aa08eba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f362f400640 0 client.17721 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 shutdown_connections 2024-04-23T15:17:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 1 -- 172.21.15.7:0/1660164574 wait complete. 2024-04-23T15:17:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.523+0000 7f3657b76740 20 client.17721 trim_cache size 0 max 16384 2024-04-23T15:17:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 Processor -- start 2024-04-23T15:17:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 -- start start 2024-04-23T15:17:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08faca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa0907170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa0913620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f363000feb0 con 0x558aa08f03c0 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36300119f0 con 0x558aa08fb5a0 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.541+0000 7f3657b76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3630010580 con 0x558aa08f0ce0 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08faca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08faca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55758/0 (socket says 172.21.15.7:55758) 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 -- 172.21.15.7:0/1073677946 learned_addr learned my addr 172.21.15.7:0/1073677946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364e800640 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa0913620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 -- 172.21.15.7:0/1073677946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 msgr2=0x558aa0907170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa0907170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 -- 172.21.15.7:0/1073677946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 msgr2=0x558aa0913620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa0913620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 -- 172.21.15.7:0/1073677946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa0635620 con 0x558aa08f03c0 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364e800640 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa0913620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f364de00640 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08faca0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f364009c240 tx=0x7f3640005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e0d920041d8c0c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.542+0000 7f363a600640 1 -- 172.21.15.7:0/1073677946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640015070 con 0x558aa08f03c0 2024-04-23T15:17:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f363a600640 1 -- 172.21.15.7:0/1073677946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f36400a4f20 con 0x558aa08f03c0 2024-04-23T15:17:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f363a600640 1 -- 172.21.15.7:0/1073677946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640020070 con 0x558aa08f03c0 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f3657b76740 1 -- 172.21.15.7:0/1073677946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 msgr2=0x558aa08faca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f3657b76740 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08faca0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f364009c240 tx=0x7f3640005880 comp rx=0 tx=0).stop 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f3657b76740 1 -- 172.21.15.7:0/1073677946 shutdown_connections 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f3657b76740 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa0913620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f3657b76740 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa0907170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.543+0000 7f3657b76740 1 --2- 172.21.15.7:0/1073677946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08faca0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.544+0000 7f3657b76740 1 -- 172.21.15.7:0/1073677946 >> 172.21.15.7:0/1073677946 conn(0x558aa08ec8d0 msgr2=0x558aa08eccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.544+0000 7f3657b76740 1 -- 172.21.15.7:0/1073677946 shutdown_connections 2024-04-23T15:17:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.544+0000 7f3657b76740 1 -- 172.21.15.7:0/1073677946 wait complete. 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.544+0000 7f3657b76740 1 -- start start 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.544+0000 7f3657b76740 1 Processor -- start 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08ff190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08ffc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3630011320 con 0x558aa08f03c0 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3630010c50 con 0x558aa08fb5a0 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f363000deb0 con 0x558aa08f0ce0 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f3657b76740 10 client.0 _ll_register_callbacks cb 0x7f364000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f364de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08ff190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55764/0 (socket says 172.21.15.7:55764) 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.545+0000 7f364de00640 1 -- 172.21.15.7:0/20128251 learned_addr learned my addr 172.21.15.7:0/20128251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364e800640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08ffc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364de00640 1 -- 172.21.15.7:0/20128251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 msgr2=0x558aa08ff6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364de00640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364de00640 1 -- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 msgr2=0x558aa08ffc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364de00640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08ffc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364de00640 1 -- 172.21.15.7:0/20128251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa0970f90 con 0x558aa08f03c0 2024-04-23T15:17:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364e800640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08ffc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f364de00640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08ff190 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3640098710 tx=0x7f364009c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899da15e71265985 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.546+0000 7f362f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.547+0000 7f362f400640 1 -- 172.21.15.7:0/20128251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364007d070 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.547+0000 7f362f400640 1 -- 172.21.15.7:0/20128251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 9467+0+0 (secure 0 0 0) 0x7f364009b700 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.547+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36400a4f20 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.547+0000 7f362f400640 1 -- 172.21.15.7:0/20128251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f36400a6030 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.547+0000 7f3657b76740 10 client.17727 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.547+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558aa0970f90 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f362f400640 1 -- 172.21.15.7:0/20128251 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f36400a4f20 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f362f400640 1 -- 172.21.15.7:0/20128251 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f36400a17f0 con 0x558aa08f03c0 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f3657b76740 10 client.17727 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f3657b76740 10 client.17727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f3657b76740 20 client.17727 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f3657b76740 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa09724a0 0x558aa0974890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f3657b76740 4 client.17727 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.548+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558aa085e190 con 0x558aa09724a0 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.549+0000 7f364d400640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa09724a0 0x558aa0974890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.550+0000 7f364d400640 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa09724a0 0x558aa0974890 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64dc57ee68b1e47f server_cookie=5b91f7aaa9ef7cf5 in_seq=0 out_seq=0 2024-04-23T15:17:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.550+0000 7f362f400640 10 client.17727 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.709+0000 7f362f400640 1 -- 172.21.15.7:0/20128251 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558aa085e190 con 0x558aa09724a0 2024-04-23T15:17:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.709+0000 7f362f400640 10 client.17727 handle_command_reply: tid=0 2024-04-23T15:17:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.709+0000 7f3657b76740 1 client.17727 shutdown 2024-04-23T15:17:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 msgr2=0x558aa08ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08ff190 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3640098710 tx=0x7f364009c430 comp rx=0 tx=0).stop 2024-04-23T15:17:00.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 shutdown_connections 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558aa09724a0 0x558aa0974890 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558aa08fb5a0 0x558aa08ffc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558aa08f0ce0 0x558aa08ff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 --2- 172.21.15.7:0/20128251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558aa08f03c0 0x558aa08ff190 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 >> 172.21.15.7:0/20128251 conn(0x558aa08ec8d0 msgr2=0x558aa08eb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.710+0000 7f362f400640 0 client.17727 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.711+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 shutdown_connections 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.711+0000 7f3657b76740 1 -- 172.21.15.7:0/20128251 wait complete. 2024-04-23T15:17:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.711+0000 7f3657b76740 20 client.17727 trim_cache size 0 max 16384 2024-04-23T15:17:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:17:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:17:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:17:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.712+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f36340a3de0 msgr2=0x7f36340a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.712+0000 7f364f200640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f36340a3de0 0x7f36340a62a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f364802ae30 tx=0x7f364802adc0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.712+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 msgr2=0x7f3650102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.712+0000 7f364f200640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 0x7f3650102e60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f364000d950 tx=0x7f364000de10 comp rx=0 tx=0).stop 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 shutdown_connections 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f36340a3de0 0x7f36340a62a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f365010e730 0x7f36501038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3650101530 0x7f36501033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 --2- 172.21.15.7:0/3549221326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650100b80 0x7f3650102e60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 >> 172.21.15.7:0/3549221326 conn(0x7f36500fc820 msgr2=0x7f36500fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 shutdown_connections 2024-04-23T15:17:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:00.713+0000 7f364f200640 1 -- 172.21.15.7:0/3549221326 wait complete. 2024-04-23T15:17:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:00 smithi137 ceph-mon[31694]: pgmap v808: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:17:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:00 smithi007 ceph-mon[27906]: pgmap v808: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:17:01.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:00 smithi186 ceph-mon[31814]: pgmap v808: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:17:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:02 smithi137 ceph-mon[31694]: pgmap v809: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:17:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:02 smithi007 ceph-mon[27906]: pgmap v809: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:17:03.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:02 smithi186 ceph-mon[31814]: pgmap v809: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:17:05.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:04 smithi186 ceph-mon[31814]: pgmap v810: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 37 op/s 2024-04-23T15:17:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:04 smithi137 ceph-mon[31694]: pgmap v810: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 37 op/s 2024-04-23T15:17:05.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:04 smithi007 ceph-mon[27906]: pgmap v810: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 37 op/s 2024-04-23T15:17:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:06 smithi137 ceph-mon[31694]: pgmap v811: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 29 op/s 2024-04-23T15:17:07.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:06 smithi007 ceph-mon[27906]: pgmap v811: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 29 op/s 2024-04-23T15:17:07.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:06 smithi186 ceph-mon[31814]: pgmap v811: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 29 op/s 2024-04-23T15:17:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:08 smithi137 ceph-mon[31694]: pgmap v812: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:17:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:08 smithi137 ceph-mon[31694]: osdmap e131: 12 total, 12 up, 12 in 2024-04-23T15:17:09.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:08 smithi007 ceph-mon[27906]: pgmap v812: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:17:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:08 smithi007 ceph-mon[27906]: osdmap e131: 12 total, 12 up, 12 in 2024-04-23T15:17:09.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:08 smithi186 ceph-mon[31814]: pgmap v812: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:17:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:08 smithi186 ceph-mon[31814]: osdmap e131: 12 total, 12 up, 12 in 2024-04-23T15:17:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:10 smithi137 ceph-mon[31694]: pgmap v814: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:17:11.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:10 smithi007 ceph-mon[27906]: pgmap v814: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:17:11.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:10 smithi186 ceph-mon[31814]: pgmap v814: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:17:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:11 smithi007 ceph-mon[27906]: pgmap v815: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:17:12.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:11 smithi186 ceph-mon[31814]: pgmap v815: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:17:12.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:11 smithi137 ceph-mon[31694]: pgmap v815: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:17:13.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 -- 172.21.15.7:0/925308663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798104c50 msgr2=0x7f8798108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 --2- 172.21.15.7:0/925308663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798104c50 0x7f8798108c90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f8784009900 tx=0x7f878402a410 comp rx=0 tx=0).stop 2024-04-23T15:17:13.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 -- 172.21.15.7:0/925308663 shutdown_connections 2024-04-23T15:17:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 --2- 172.21.15.7:0/925308663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8798109370 0x7f8798110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 --2- 172.21.15.7:0/925308663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798104c50 0x7f8798108c90 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 --2- 172.21.15.7:0/925308663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87981042a0 0x7f8798104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 -- 172.21.15.7:0/925308663 >> 172.21.15.7:0/925308663 conn(0x7f87980ffae0 msgr2=0x7f8798101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 -- 172.21.15.7:0/925308663 shutdown_connections 2024-04-23T15:17:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.885+0000 7f879ce00640 1 -- 172.21.15.7:0/925308663 wait complete. 2024-04-23T15:17:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.887+0000 7f879ce00640 1 Processor -- start 2024-04-23T15:17:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.887+0000 7f879ce00640 1 -- start start 2024-04-23T15:17:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.887+0000 7f879ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87981042a0 0x7f87981a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.887+0000 7f879ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 0x7f87981a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.887+0000 7f879ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f879819a770 0x7f879819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f879ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87981142b0 con 0x7f8798109370 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f879ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8798114130 con 0x7f879819a770 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f879ce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8798114430 con 0x7f87981042a0 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 0x7f87981a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 0x7f87981a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42356/0 (socket says 172.21.15.7:42356) 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 -- 172.21.15.7:0/881944098 learned_addr learned my addr 172.21.15.7:0/881944098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8797400640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87981042a0 0x7f87981a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8797e00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f879819a770 0x7f879819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 -- 172.21.15.7:0/881944098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87981042a0 msgr2=0x7f87981a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87981042a0 0x7f87981a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 -- 172.21.15.7:0/881944098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f879819a770 msgr2=0x7f879819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f879819a770 0x7f879819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8796a00640 1 -- 172.21.15.7:0/881944098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879819b370 con 0x7f8798109370 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.888+0000 7f8797e00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f879819a770 0x7f879819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.889+0000 7f8796a00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 0x7f87981a0ba0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f8784004040 tx=0x7f8784004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.889+0000 7f878fe00640 1 -- 172.21.15.7:0/881944098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878403f030 con 0x7f8798109370 2024-04-23T15:17:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.889+0000 7f878fe00640 1 -- 172.21.15.7:0/881944098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8784003aa0 con 0x7f8798109370 2024-04-23T15:17:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.889+0000 7f878fe00640 1 -- 172.21.15.7:0/881944098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784035070 con 0x7f8798109370 2024-04-23T15:17:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.889+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879819b600 con 0x7f8798109370 2024-04-23T15:17:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.889+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87981a76a0 con 0x7f8798109370 2024-04-23T15:17:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.893+0000 7f87a1271740 1 Processor -- start 2024-04-23T15:17:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.893+0000 7f87a1271740 1 -- start start 2024-04-23T15:17:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f878fe00640 1 -- 172.21.15.7:0/881944098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8784042030 con 0x7f8798109370 2024-04-23T15:17:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f87a1271740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724d3c0 0x55ffd724d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f87a1271740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724dce0 0x55ffd7258060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f87a1271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f87a1271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ffd71b3900 con 0x55ffd72585a0 2024-04-23T15:17:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f87a1271740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ffd7159f20 con 0x55ffd724d3c0 2024-04-23T15:17:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f87a1271740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ffd71af8c0 con 0x55ffd724dce0 2024-04-23T15:17:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f8796a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f8796a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42370/0 (socket says 172.21.15.7:42370) 2024-04-23T15:17:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f8796a00640 1 -- 172.21.15.7:0/3662047643 learned_addr learned my addr 172.21.15.7:0/3662047643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f8797e00640 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724d3c0 0x55ffd724d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.894+0000 7f8797400640 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724dce0 0x55ffd7258060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.895+0000 7f8796a00640 1 -- 172.21.15.7:0/3662047643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724dce0 msgr2=0x55ffd7258060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.895+0000 7f8796a00640 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724dce0 0x55ffd7258060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.895+0000 7f8796a00640 1 -- 172.21.15.7:0/3662047643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724d3c0 msgr2=0x55ffd724d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.895+0000 7f8796a00640 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724d3c0 0x55ffd724d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.895+0000 7f8796a00640 1 -- 172.21.15.7:0/3662047643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd717ee10 con 0x55ffd72585a0 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.895+0000 7f8796a00640 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725a990 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f87840ee310 tx=0x7f87840f93b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749bac095e0a571a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.896+0000 7f878cc00640 1 -- 172.21.15.7:0/3662047643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87840f9810 con 0x55ffd72585a0 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.896+0000 7f878cc00640 1 -- 172.21.15.7:0/3662047643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87840fe030 con 0x55ffd72585a0 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.896+0000 7f878cc00640 1 -- 172.21.15.7:0/3662047643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87840f1db0 con 0x55ffd72585a0 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.896+0000 7f878fe00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f877c0a3d90 0x7f877c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.896+0000 7f878fe00640 1 -- 172.21.15.7:0/881944098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9555+0+0 (secure 0 0 0) 0x7f87840f10f0 con 0x7f8798109370 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.896+0000 7f8797e00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f877c0a3d90 0x7f877c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 -- 172.21.15.7:0/3662047643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 msgr2=0x55ffd725a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725a990 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f87840ee310 tx=0x7f87840f93b0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 -- 172.21.15.7:0/3662047643 shutdown_connections 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725a990 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724dce0 0x55ffd7258060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 --2- 172.21.15.7:0/3662047643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724d3c0 0x55ffd724d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 -- 172.21.15.7:0/3662047643 >> 172.21.15.7:0/3662047643 conn(0x55ffd72498d0 msgr2=0x55ffd7249cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f8797e00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f877c0a3d90 0x7f877c0a6250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8790005fd0 tx=0x7f8790009680 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 -- 172.21.15.7:0/3662047643 shutdown_connections 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.897+0000 7f87a1271740 1 -- 172.21.15.7:0/3662047643 wait complete. 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.898+0000 7f87a1271740 1 -- start start 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.898+0000 7f87a1271740 1 Processor -- start 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7255500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 0x55ffd7255a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd72585a0 0x55ffd7255f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ffd725af90 con 0x55ffd724dce0 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ffd716d2c0 con 0x55ffd72585a0 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ffd725b110 con 0x55ffd724d3c0 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f87a1271740 10 client.0 _ll_register_callbacks cb 0x55ffd6ec5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f8796a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 0x55ffd7255a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f8796a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 0x55ffd7255a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42382/0 (socket says 172.21.15.7:42382) 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f8796a00640 1 -- 172.21.15.7:0/370260770 learned_addr learned my addr 172.21.15.7:0/370260770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f8797e00640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd72585a0 0x55ffd7255f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.899+0000 7f8797400640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7255500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8796a00640 1 -- 172.21.15.7:0/370260770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 msgr2=0x55ffd7255500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8796a00640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7255500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8796a00640 1 -- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd72585a0 msgr2=0x55ffd7255f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8796a00640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd72585a0 0x55ffd7255f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8796a00640 1 -- 172.21.15.7:0/370260770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd717dfd0 con 0x55ffd724dce0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8796a00640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 0x55ffd7255a40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8784031440 tx=0x7f878402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf0ed995d3ca65f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8781600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8781600640 1 -- 172.21.15.7:0/370260770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784049030 con 0x55ffd724dce0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f8781600640 1 -- 172.21.15.7:0/370260770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 9555+0+0 (secure 0 0 0) 0x7f87840baf20 con 0x55ffd724dce0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.900+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87840fe030 con 0x55ffd724dce0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f8781600640 1 -- 172.21.15.7:0/370260770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f87840b8ec0 con 0x55ffd724dce0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 10 client.17739 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ffd6ec6210 con 0x55ffd724dce0 2024-04-23T15:17:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f8781600640 1 -- 172.21.15.7:0/370260770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87840fe030 con 0x55ffd724dce0 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f8781600640 1 -- 172.21.15.7:0/370260770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f87840f4350 con 0x55ffd724dce0 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 10 client.17739 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 10 client.17739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 20 client.17739 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd7268260 0x55ffd726a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 4 client.17739 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:17:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.901+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffd71c1320 con 0x55ffd7268260 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.902+0000 7f8797400640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd7268260 0x55ffd726a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.903+0000 7f8797400640 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd7268260 0x55ffd726a650 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def0b35c1d5fa369 server_cookie=e2ff0db7a1c29885 in_seq=0 out_seq=0 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.903+0000 7f8781600640 10 client.17739 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.905+0000 7f8781600640 1 -- 172.21.15.7:0/370260770 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ffd71c1320 con 0x55ffd7268260 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.905+0000 7f8781600640 10 client.17739 handle_command_reply: tid=0 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.905+0000 7f87a1271740 1 client.17739 shutdown 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.905+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 msgr2=0x55ffd7255a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.905+0000 7f87a1271740 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 0x55ffd7255a40 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8784031440 tx=0x7f878402a410 comp rx=0 tx=0).stop 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 shutdown_connections 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd7268260 0x55ffd726a650 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd72585a0 0x55ffd7255f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd724dce0 0x55ffd7255a40 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 --2- 172.21.15.7:0/370260770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7255500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 >> 172.21.15.7:0/370260770 conn(0x55ffd72498d0 msgr2=0x55ffd7248a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f8781600640 0 client.17739 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 shutdown_connections 2024-04-23T15:17:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 1 -- 172.21.15.7:0/370260770 wait complete. 2024-04-23T15:17:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.906+0000 7f87a1271740 20 client.17739 trim_cache size 0 max 16384 2024-04-23T15:17:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.926+0000 7f87a1271740 1 Processor -- start 2024-04-23T15:17:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.926+0000 7f87a1271740 1 -- start start 2024-04-23T15:17:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f87a1271740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7263cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f87a1271740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd724fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f87a1271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd726fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f87a1271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87981b15e0 con 0x55ffd72585a0 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f87a1271740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87981b3120 con 0x55ffd724dce0 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f87a1271740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87981b1cb0 con 0x55ffd724d3c0 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f8797e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd726fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f8797e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd726fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42388/0 (socket says 172.21.15.7:42388) 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.927+0000 7f8797e00640 1 -- 172.21.15.7:0/1838198487 learned_addr learned my addr 172.21.15.7:0/1838198487 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8796a00640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd724fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797400640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7263cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797e00640 1 -- 172.21.15.7:0/1838198487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 msgr2=0x55ffd7263cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797e00640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7263cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797e00640 1 -- 172.21.15.7:0/1838198487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 msgr2=0x55ffd724fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797e00640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd724fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797e00640 1 -- 172.21.15.7:0/1838198487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd6f92620 con 0x55ffd72585a0 2024-04-23T15:17:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797400640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7263cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8796a00640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd724fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8797e00640 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd726fd90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8790012830 tx=0x7f8790014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab411b97d1fbb39 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.928+0000 7f8783e00640 1 -- 172.21.15.7:0/1838198487 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790020bb0 con 0x55ffd72585a0 2024-04-23T15:17:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f8783e00640 1 -- 172.21.15.7:0/1838198487 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8790020d50 con 0x55ffd72585a0 2024-04-23T15:17:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f8783e00640 1 -- 172.21.15.7:0/1838198487 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879001b600 con 0x55ffd72585a0 2024-04-23T15:17:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 -- 172.21.15.7:0/1838198487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 msgr2=0x55ffd726fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd726fd90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8790012830 tx=0x7f8790014000 comp rx=0 tx=0).stop 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 -- 172.21.15.7:0/1838198487 shutdown_connections 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd724fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd726fd90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 --2- 172.21.15.7:0/1838198487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd7263cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.929+0000 7f87a1271740 1 -- 172.21.15.7:0/1838198487 >> 172.21.15.7:0/1838198487 conn(0x55ffd72498d0 msgr2=0x55ffd7248a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.930+0000 7f87a1271740 1 -- 172.21.15.7:0/1838198487 shutdown_connections 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.930+0000 7f87a1271740 1 -- 172.21.15.7:0/1838198487 wait complete. 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.930+0000 7f87a1271740 1 -- start start 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.930+0000 7f87a1271740 1 Processor -- start 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd725bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd725c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87981b2a50 con 0x55ffd72585a0 2024-04-23T15:17:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87981b2380 con 0x55ffd724dce0 2024-04-23T15:17:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87981af5e0 con 0x55ffd724d3c0 2024-04-23T15:17:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f87a1271740 10 client.0 _ll_register_callbacks cb 0x7f8790009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f8797e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f8797e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42402/0 (socket says 172.21.15.7:42402) 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f8797e00640 1 -- 172.21.15.7:0/2185390500 learned_addr learned my addr 172.21.15.7:0/2185390500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f8796a00640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd725c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.931+0000 7f8797400640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd725bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8797e00640 1 -- 172.21.15.7:0/2185390500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 msgr2=0x55ffd725bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8797e00640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd725bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8797e00640 1 -- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 msgr2=0x55ffd725c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8797e00640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd725c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8797e00640 1 -- 172.21.15.7:0/2185390500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd72d5e10 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8797e00640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725c6a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f8790012800 tx=0x7f8790012590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931b0aecdc6ad1f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8781600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8781600640 1 -- 172.21.15.7:0/2185390500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790037020 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f8781600640 1 -- 172.21.15.7:0/2185390500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 9555+0+0 (secure 0 0 0) 0x7f8790004a40 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.932+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8790020d50 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f8781600640 1 -- 172.21.15.7:0/2185390500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8790042050 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 10 client.17745 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ffd72d7030 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f8781600640 1 -- 172.21.15.7:0/2185390500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8790020d50 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f8781600640 1 -- 172.21.15.7:0/2185390500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8790027070 con 0x55ffd72585a0 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 10 client.17745 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 10 client.17745 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 20 client.17745 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd72d7770 0x55ffd72d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 4 client.17745 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:17:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.933+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffd71bb190 con 0x55ffd72d7770 2024-04-23T15:17:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.934+0000 7f8797400640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd72d7770 0x55ffd72d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.935+0000 7f8797400640 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd72d7770 0x55ffd72d9b90 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65b47f5ac359d03a server_cookie=a50da6ac323ee836 in_seq=0 out_seq=0 2024-04-23T15:17:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.935+0000 7f8781600640 10 client.17745 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.974+0000 7f8781600640 1 -- 172.21.15.7:0/2185390500 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffd71bb190 con 0x55ffd72d7770 2024-04-23T15:17:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f8781600640 10 client.17745 handle_command_reply: tid=0 2024-04-23T15:17:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 client.17745 shutdown 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 msgr2=0x55ffd725c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725c6a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f8790012800 tx=0x7f8790012590 comp rx=0 tx=0).stop 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 shutdown_connections 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd72d7770 0x55ffd72d9b90 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd724dce0 0x55ffd725c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd72585a0 0x55ffd725c6a0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 --2- 172.21.15.7:0/2185390500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd724d3c0 0x55ffd725bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f8781600640 0 client.17745 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 >> 172.21.15.7:0/2185390500 conn(0x55ffd72498d0 msgr2=0x55ffd7255440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 shutdown_connections 2024-04-23T15:17:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 1 -- 172.21.15.7:0/2185390500 wait complete. 2024-04-23T15:17:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.975+0000 7f87a1271740 20 client.17745 trim_cache size 0 max 16384 2024-04-23T15:17:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:17:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:17:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:17:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:17:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f877c0a3d90 msgr2=0x7f877c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f877c0a3d90 0x7f877c0a6250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8790005fd0 tx=0x7f8790009680 comp rx=0 tx=0).stop 2024-04-23T15:17:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 msgr2=0x7f87981a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 0x7f87981a0ba0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f8784004040 tx=0x7f8784004070 comp rx=0 tx=0).stop 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 shutdown_connections 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f877c0a3d90 0x7f877c0a6250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f879819a770 0x7f879819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8798109370 0x7f87981a0ba0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 --2- 172.21.15.7:0/881944098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87981042a0 0x7f87981a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.976+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 >> 172.21.15.7:0/881944098 conn(0x7f87980ffae0 msgr2=0x7f8798100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.977+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 shutdown_connections 2024-04-23T15:17:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:13.977+0000 7f879ce00640 1 -- 172.21.15.7:0/881944098 wait complete. 2024-04-23T15:17:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:14 smithi186 ceph-mon[31814]: pgmap v816: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:17:14.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:14 smithi137 ceph-mon[31694]: pgmap v816: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:17:14.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:14 smithi007 ceph-mon[27906]: pgmap v816: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:17:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:16 smithi007 ceph-mon[27906]: pgmap v817: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:17:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:16 smithi007 ceph-mon[27906]: osdmap e132: 12 total, 12 up, 12 in 2024-04-23T15:17:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:16 smithi186 ceph-mon[31814]: pgmap v817: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:17:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:16 smithi186 ceph-mon[31814]: osdmap e132: 12 total, 12 up, 12 in 2024-04-23T15:17:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:16 smithi137 ceph-mon[31694]: pgmap v817: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:17:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:16 smithi137 ceph-mon[31694]: osdmap e132: 12 total, 12 up, 12 in 2024-04-23T15:17:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:18 smithi007 ceph-mon[27906]: pgmap v819: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.3 MiB/s wr, 17 op/s 2024-04-23T15:17:19.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:18 smithi186 ceph-mon[31814]: pgmap v819: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.3 MiB/s wr, 17 op/s 2024-04-23T15:17:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:18 smithi137 ceph-mon[31694]: pgmap v819: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.3 MiB/s wr, 17 op/s 2024-04-23T15:17:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:20 smithi007 ceph-mon[27906]: pgmap v820: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:20 smithi186 ceph-mon[31814]: pgmap v820: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:20 smithi137 ceph-mon[31694]: pgmap v820: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:23.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:22 smithi007 ceph-mon[27906]: pgmap v821: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:22 smithi186 ceph-mon[31814]: pgmap v821: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:22 smithi137 ceph-mon[31694]: pgmap v821: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:24 smithi007 ceph-mon[27906]: pgmap v822: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:24 smithi186 ceph-mon[31814]: pgmap v822: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:25.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:24 smithi137 ceph-mon[31694]: pgmap v822: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:27.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:26 smithi007 ceph-mon[27906]: pgmap v823: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:26 smithi186 ceph-mon[31814]: pgmap v823: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 -- 172.21.15.7:0/1895151782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0080742d0 msgr2=0x7ff0080746b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 --2- 172.21.15.7:0/1895151782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0080742d0 0x7ff0080746b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7feffc009900 tx=0x7feffc02a480 comp rx=0 tx=0).stop 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 -- 172.21.15.7:0/1895151782 shutdown_connections 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 --2- 172.21.15.7:0/1895151782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff008074bf0 0x7ff00810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 --2- 172.21.15.7:0/1895151782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff00810e8f0 0x7ff008110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 --2- 172.21.15.7:0/1895151782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0080742d0 0x7ff0080746b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 -- 172.21.15.7:0/1895151782 >> 172.21.15.7:0/1895151782 conn(0x7ff008079490 msgr2=0x7ff0080798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 -- 172.21.15.7:0/1895151782 shutdown_connections 2024-04-23T15:17:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.127+0000 7ff00f800640 1 -- 172.21.15.7:0/1895151782 wait complete. 2024-04-23T15:17:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.128+0000 7ff00f800640 1 Processor -- start 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.128+0000 7ff00f800640 1 -- start start 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00f800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0080742d0 0x7ff0081a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 0x7ff0081a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff00810e8f0 0x7ff00819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff008114500 con 0x7ff008074bf0 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff008114380 con 0x7ff00810e8f0 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00f800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff008114680 con 0x7ff0080742d0 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 0x7ff0081a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff007e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 0x7ff0081a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53726/0 (socket says 172.21.15.7:53726) 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff007e00640 1 -- 172.21.15.7:0/1100631625 learned_addr learned my addr 172.21.15.7:0/1100631625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00ce00640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0080742d0 0x7ff0081a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff00d800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff00810e8f0 0x7ff00819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.129+0000 7ff007e00640 1 -- 172.21.15.7:0/1100631625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0080742d0 msgr2=0x7ff0081a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff007e00640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0080742d0 0x7ff0081a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff007e00640 1 -- 172.21.15.7:0/1100631625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff00810e8f0 msgr2=0x7ff00819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff007e00640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff00810e8f0 0x7ff00819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff007e00640 1 -- 172.21.15.7:0/1100631625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00819afb0 con 0x7ff008074bf0 2024-04-23T15:17:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff007e00640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 0x7ff0081a0b60 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7feff400d950 tx=0x7feff400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff005600640 1 -- 172.21.15.7:0/1100631625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4017070 con 0x7ff008074bf0 2024-04-23T15:17:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff005600640 1 -- 172.21.15.7:0/1100631625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feff4009c30 con 0x7ff008074bf0 2024-04-23T15:17:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff005600640 1 -- 172.21.15.7:0/1100631625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff400f620 con 0x7ff008074bf0 2024-04-23T15:17:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.130+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00819b2a0 con 0x7ff008074bf0 2024-04-23T15:17:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.131+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0081a7470 con 0x7ff008074bf0 2024-04-23T15:17:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 Processor -- start 2024-04-23T15:17:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 -- start start 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ecf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3edc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d8b3e35900 con 0x55d8b3eda390 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8b3ddbf20 con 0x55d8b3ecfad0 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.134+0000 7ff012648740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8b3e318c0 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.135+0000 7ff005600640 1 -- 172.21.15.7:0/1100631625 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7feff40109a0 con 0x7ff008074bf0 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.135+0000 7ff00d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ecf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.135+0000 7ff00ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.135+0000 7ff00d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ecf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:33810/0 (socket says 172.21.15.7:33810) 2024-04-23T15:17:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.135+0000 7ff00d800640 1 -- 172.21.15.7:0/3780657194 learned_addr learned my addr 172.21.15.7:0/3780657194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.135+0000 7ff007e00640 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3edc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.136+0000 7ff00d800640 1 -- 172.21.15.7:0/3780657194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 msgr2=0x55d8b3ed9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.136+0000 7ff00d800640 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.136+0000 7ff00d800640 1 -- 172.21.15.7:0/3780657194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 msgr2=0x55d8b3edc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.136+0000 7ff00d800640 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3edc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.136+0000 7ff00d800640 1 -- 172.21.15.7:0/3780657194 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b3e00e10 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.136+0000 7ff007e00640 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3edc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7ff00d800640 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ecf590 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e20 tx=0x7ff000010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc89416bfc2f3da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7ff005600640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feff00a3e40 0x7feff00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7feffa000640 1 -- 172.21.15.7:0/3780657194 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000016070 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7feffa000640 1 -- 172.21.15.7:0/3780657194 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff000004d20 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7feffa000640 1 -- 172.21.15.7:0/3780657194 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000012720 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7ff005600640 1 -- 172.21.15.7:0/1100631625 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7feff40d0880 con 0x7ff008074bf0 2024-04-23T15:17:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.137+0000 7ff00ce00640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feff00a3e40 0x7feff00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 -- 172.21.15.7:0/3780657194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 msgr2=0x55d8b3ecf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ecf590 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e20 tx=0x7ff000010740 comp rx=0 tx=0).stop 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff00ce00640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feff00a3e40 0x7feff00a6300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feffc000c00 tx=0x7feffc005b50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 -- 172.21.15.7:0/3780657194 shutdown_connections 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3edc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 --2- 172.21.15.7:0/3780657194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ecf590 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 -- 172.21.15.7:0/3780657194 >> 172.21.15.7:0/3780657194 conn(0x55d8b3ecb6c0 msgr2=0x55d8b3ecbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.138+0000 7ff012648740 1 -- 172.21.15.7:0/3780657194 shutdown_connections 2024-04-23T15:17:27.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.139+0000 7ff012648740 1 -- 172.21.15.7:0/3780657194 wait complete. 2024-04-23T15:17:27.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.139+0000 7ff012648740 1 -- start start 2024-04-23T15:17:27.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.139+0000 7ff012648740 1 Processor -- start 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ed7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3eda390 0x55d8b3ed7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d8b3edcfc0 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8b3def2c0 con 0x55d8b3ecfad0 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8b3edd140 con 0x55d8b3eda390 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff012648740 10 client.0 _ll_register_callbacks cb 0x55d8b3b47a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff00ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ed7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff00ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ed7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53734/0 (socket says 172.21.15.7:53734) 2024-04-23T15:17:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff00ce00640 1 -- 172.21.15.7:0/4015110877 learned_addr learned my addr 172.21.15.7:0/4015110877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.140+0000 7ff007e00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00d800640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3eda390 0x55d8b3ed7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00ce00640 1 -- 172.21.15.7:0/4015110877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3eda390 msgr2=0x55d8b3ed7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00ce00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3eda390 0x55d8b3ed7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00ce00640 1 -- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 msgr2=0x55d8b3ed7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00ce00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00ce00640 1 -- 172.21.15.7:0/4015110877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b3dfffd0 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff007e00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7ff00ce00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ed7300 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7feffc0096c0 tx=0x7feffc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f193c81874202a84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.141+0000 7fefeea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7fefeea00640 1 -- 172.21.15.7:0/4015110877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc04d070 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7fefeea00640 1 -- 172.21.15.7:0/4015110877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7feffc0037f0 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff000004d20 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7fefeea00640 1 -- 172.21.15.7:0/4015110877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7feffc059050 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7ff012648740 10 client.17757 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d8b3b48210 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.142+0000 7fefeea00640 1 -- 172.21.15.7:0/4015110877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff000004d20 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7fefeea00640 1 -- 172.21.15.7:0/4015110877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7feffc032900 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7ff012648740 10 client.17757 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7ff012648740 10 client.17757 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7ff012648740 20 client.17757 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7ff012648740 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3eea4b0 0x55d8b3eec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7ff012648740 4 client.17757 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:17:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.143+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8b3e43320 con 0x55d8b3eea4b0 2024-04-23T15:17:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.144+0000 7ff007e00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3eea4b0 0x55d8b3eec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.145+0000 7ff007e00640 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3eea4b0 0x55d8b3eec8e0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c68487af33d3987 server_cookie=f917a0941803f86c in_seq=0 out_seq=0 2024-04-23T15:17:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.145+0000 7fefeea00640 10 client.17757 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7fefeea00640 1 -- 172.21.15.7:0/4015110877 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8b3e43320 con 0x55d8b3eea4b0 2024-04-23T15:17:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7fefeea00640 10 client.17757 handle_command_reply: tid=0 2024-04-23T15:17:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 client.17757 shutdown 2024-04-23T15:17:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 msgr2=0x55d8b3ed7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ed7300 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7feffc0096c0 tx=0x7feffc009260 comp rx=0 tx=0).stop 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 shutdown_connections 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3eea4b0 0x55d8b3eec8e0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3eda390 0x55d8b3ed7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 --2- 172.21.15.7:0/4015110877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ed7300 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.147+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 >> 172.21.15.7:0/4015110877 conn(0x55d8b3ecb6c0 msgr2=0x55d8b3ed13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.148+0000 7fefeea00640 0 client.17757 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.148+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 shutdown_connections 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.148+0000 7ff012648740 1 -- 172.21.15.7:0/4015110877 wait complete. 2024-04-23T15:17:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.148+0000 7ff012648740 20 client.17757 trim_cache size 0 max 16384 2024-04-23T15:17:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:26 smithi137 ceph-mon[31694]: pgmap v823: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-04-23T15:17:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 Processor -- start 2024-04-23T15:17:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 -- start start 2024-04-23T15:17:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3eda390 0x55d8b3eca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b1670 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b31b0 con 0x55d8b3eda390 2024-04-23T15:17:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.170+0000 7ff012648740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b1d40 con 0x55d8b3ecfad0 2024-04-23T15:17:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53738/0 (socket says 172.21.15.7:53738) 2024-04-23T15:17:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 -- 172.21.15.7:0/1235082650 learned_addr learned my addr 172.21.15.7:0/1235082650 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00d800640 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3eda390 0x55d8b3eca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff007e00640 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 -- 172.21.15.7:0/1235082650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecfad0 msgr2=0x55d8b3ed1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 -- 172.21.15.7:0/1235082650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3eda390 msgr2=0x55d8b3eca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3eda390 0x55d8b3eca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00ce00640 1 -- 172.21.15.7:0/1235082650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b3c14620 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.171+0000 7ff00d800640 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3eda390 0x55d8b3eca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.172+0000 7ff00ce00640 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee5e80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7feffc009900 tx=0x7feffc02ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4177270b656d33ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.172+0000 7feff9600640 1 -- 172.21.15.7:0/1235082650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc04d070 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.172+0000 7feff9600640 1 -- 172.21.15.7:0/1235082650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feffc049450 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.172+0000 7feff9600640 1 -- 172.21.15.7:0/1235082650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc035040 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 -- 172.21.15.7:0/1235082650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 msgr2=0x55d8b3ee5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee5e80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7feffc009900 tx=0x7feffc02ab60 comp rx=0 tx=0).stop 2024-04-23T15:17:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 -- 172.21.15.7:0/1235082650 shutdown_connections 2024-04-23T15:17:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3eda390 0x55d8b3eca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 --2- 172.21.15.7:0/1235082650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee5e80 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 -- 172.21.15.7:0/1235082650 >> 172.21.15.7:0/1235082650 conn(0x55d8b3ecb6c0 msgr2=0x55d8b3ec9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 -- 172.21.15.7:0/1235082650 shutdown_connections 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.173+0000 7ff012648740 1 -- 172.21.15.7:0/1235082650 wait complete. 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 -- start start 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 Processor -- start 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3ed3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b2ae0 con 0x55d8b3eda390 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b2410 con 0x55d8b3ecfad0 2024-04-23T15:17:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081af670 con 0x55d8b3ecf1b0 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.174+0000 7ff012648740 10 client.0 _ll_register_callbacks cb 0x7feffc0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3ed3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3ed3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53740/0 (socket says 172.21.15.7:53740) 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 -- 172.21.15.7:0/2388583679 learned_addr learned my addr 172.21.15.7:0/2388583679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00ce00640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff007e00640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 -- 172.21.15.7:0/2388583679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 msgr2=0x55d8b3ee2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 -- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 msgr2=0x55d8b3ed3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 -- 172.21.15.7:0/2388583679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b3ed4400 con 0x55d8b3eda390 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00ce00640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff007e00640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.175+0000 7ff00d800640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3ed3ec0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e20 tx=0x7ff000012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e22e091cf3a57d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7fefeea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7fefeea00640 1 -- 172.21.15.7:0/2388583679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000026020 con 0x55d8b3eda390 2024-04-23T15:17:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7fefeea00640 1 -- 172.21.15.7:0/2388583679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7ff000012c80 con 0x55d8b3eda390 2024-04-23T15:17:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feffc049450 con 0x55d8b3eda390 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7fefeea00640 1 -- 172.21.15.7:0/2388583679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff000031050 con 0x55d8b3eda390 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7ff012648740 10 client.17763 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d8b3f506c0 con 0x55d8b3eda390 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.176+0000 7fefeea00640 1 -- 172.21.15.7:0/2388583679 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feffc049450 con 0x55d8b3eda390 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7fefeea00640 1 -- 172.21.15.7:0/2388583679 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff00000f040 con 0x55d8b3eda390 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff012648740 10 client.17763 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff012648740 10 client.17763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff012648740 20 client.17763 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff012648740 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3f50b80 0x55d8b3f52fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff012648740 4 client.17763 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8b3e3d190 con 0x55d8b3f50b80 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.177+0000 7ff00ce00640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3f50b80 0x55d8b3f52fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.178+0000 7ff00ce00640 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3f50b80 0x55d8b3f52fa0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ff240bdf34a4dd server_cookie=5edfecb502dc733c in_seq=0 out_seq=0 2024-04-23T15:17:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.178+0000 7fefeea00640 10 client.17763 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7fefeea00640 1 -- 172.21.15.7:0/2388583679 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8b3e3d190 con 0x55d8b3f50b80 2024-04-23T15:17:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7fefeea00640 10 client.17763 handle_command_reply: tid=0 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 client.17763 shutdown 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 msgr2=0x55d8b3ed3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3ed3ec0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e20 tx=0x7ff000012680 comp rx=0 tx=0).stop 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 shutdown_connections 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8b3f50b80 0x55d8b3f52fa0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8b3ecfad0 0x55d8b3ed3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8b3eda390 0x55d8b3ed3ec0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7fefeea00640 0 client.17763 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.211+0000 7ff012648740 1 --2- 172.21.15.7:0/2388583679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8b3ecf1b0 0x55d8b3ee2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.212+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 >> 172.21.15.7:0/2388583679 conn(0x55d8b3ecb6c0 msgr2=0x55d8b3ed7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.212+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 shutdown_connections 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.212+0000 7ff012648740 1 -- 172.21.15.7:0/2388583679 wait complete. 2024-04-23T15:17:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.212+0000 7ff012648740 20 client.17763 trim_cache size 0 max 16384 2024-04-23T15:17:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:17:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:17:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:17:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feff00a3e40 msgr2=0x7feff00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feff00a3e40 0x7feff00a6300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feffc000c00 tx=0x7feffc005b50 comp rx=0 tx=0).stop 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 msgr2=0x7ff0081a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 0x7ff0081a0b60 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7feff400d950 tx=0x7feff400de10 comp rx=0 tx=0).stop 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 shutdown_connections 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7feff00a3e40 0x7feff00a6300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff00810e8f0 0x7ff00819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff008074bf0 0x7ff0081a0b60 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 --2- 172.21.15.7:0/1100631625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0080742d0 0x7ff0081a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 >> 172.21.15.7:0/1100631625 conn(0x7ff008079490 msgr2=0x7ff0080feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 shutdown_connections 2024-04-23T15:17:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:27.213+0000 7ff00f800640 1 -- 172.21.15.7:0/1100631625 wait complete. 2024-04-23T15:17:29.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:28 smithi007 ceph-mon[27906]: pgmap v824: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:17:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:28 smithi186 ceph-mon[31814]: pgmap v824: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:17:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:28 smithi137 ceph-mon[31694]: pgmap v824: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:17:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:30 smithi007 ceph-mon[27906]: pgmap v825: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:17:31.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:30 smithi186 ceph-mon[31814]: pgmap v825: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:17:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:30 smithi137 ceph-mon[31694]: pgmap v825: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:17:32.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:31 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:17:32.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:31 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:17:32.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:31 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:17:33.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:32 smithi007 ceph-mon[27906]: pgmap v826: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:17:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:32 smithi186 ceph-mon[31814]: pgmap v826: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:17:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:32 smithi137 ceph-mon[31694]: pgmap v826: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:17:34.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:34 smithi137 ceph-mon[31694]: pgmap v827: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:34.972 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:34 smithi186 ceph-mon[31814]: pgmap v827: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:35.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:34 smithi007 ceph-mon[27906]: pgmap v827: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:37.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:36 smithi007 ceph-mon[27906]: pgmap v828: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:37.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:36 smithi186 ceph-mon[31814]: pgmap v828: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:37.113 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:36 smithi137 ceph-mon[31694]: pgmap v828: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: pgmap v829: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:17:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: pgmap v829: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:17:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: pgmap v829: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:17:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:17:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 -- 172.21.15.7:0/4163438463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 msgr2=0x7ff734111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 --2- 172.21.15.7:0/4163438463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff734111100 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009ca0 tx=0x7ff72c02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 -- 172.21.15.7:0/4163438463 shutdown_connections 2024-04-23T15:17:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 --2- 172.21.15.7:0/4163438463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff734111100 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 --2- 172.21.15.7:0/4163438463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff734104e10 0x7ff734108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 --2- 172.21.15.7:0/4163438463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff734104460 0x7ff734104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 -- 172.21.15.7:0/4163438463 >> 172.21.15.7:0/4163438463 conn(0x7ff7340ffd00 msgr2=0x7ff734102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.365+0000 7ff73a200640 1 -- 172.21.15.7:0/4163438463 shutdown_connections 2024-04-23T15:17:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.366+0000 7ff73a200640 1 -- 172.21.15.7:0/4163438463 wait complete. 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 Processor -- start 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 -- start start 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff734104460 0x7ff7341a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff7341a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff73419a750 0x7ff73419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341144f0 con 0x7ff734109530 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff734114370 con 0x7ff734104460 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.367+0000 7ff73a200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff734114670 con 0x7ff73419a750 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff7341a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff7341a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45944/0 (socket says 172.21.15.7:45944) 2024-04-23T15:17:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 -- 172.21.15.7:0/2163574669 learned_addr learned my addr 172.21.15.7:0/2163574669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff733400640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff734104460 0x7ff7341a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff733e00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff73419a750 0x7ff73419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 -- 172.21.15.7:0/2163574669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff73419a750 msgr2=0x7ff73419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff73419a750 0x7ff73419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 -- 172.21.15.7:0/2163574669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff734104460 msgr2=0x7ff7341a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff734104460 0x7ff7341a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.368+0000 7ff72aa00640 1 -- 172.21.15.7:0/2163574669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73419b350 con 0x7ff734109530 2024-04-23T15:17:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.369+0000 7ff72aa00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff7341a0bd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00d740 tx=0x7ff71c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.369+0000 7ff730c00640 1 -- 172.21.15.7:0/2163574669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c017070 con 0x7ff734109530 2024-04-23T15:17:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.369+0000 7ff730c00640 1 -- 172.21.15.7:0/2163574669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff71c00de50 con 0x7ff734109530 2024-04-23T15:17:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.369+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7341a7430 con 0x7ff734109530 2024-04-23T15:17:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.369+0000 7ff730c00640 1 -- 172.21.15.7:0/2163574669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c004d60 con 0x7ff734109530 2024-04-23T15:17:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.369+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7341a7830 con 0x7ff734109530 2024-04-23T15:17:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.373+0000 7ff730c00640 1 -- 172.21.15.7:0/2163574669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff71c004f00 con 0x7ff734109530 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.373+0000 7ff73cf8f740 1 Processor -- start 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.373+0000 7ff73cf8f740 1 -- start start 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c1c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c26e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c29780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6b82900 con 0x55a7a6c27390 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6b28f20 con 0x55a7a6c1c1b0 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6b7e8c0 con 0x55a7a6c1cad0 2024-04-23T15:17:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c29780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c29780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45956/0 (socket says 172.21.15.7:45956) 2024-04-23T15:17:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff72aa00640 1 -- 172.21.15.7:0/2579163220 learned_addr learned my addr 172.21.15.7:0/2579163220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff733e00640 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c1c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.374+0000 7ff733400640 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c26e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff72aa00640 1 -- 172.21.15.7:0/2579163220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1cad0 msgr2=0x55a7a6c26e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff72aa00640 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c26e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff72aa00640 1 -- 172.21.15.7:0/2579163220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1c1b0 msgr2=0x55a7a6c1c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff72aa00640 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c1c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff72aa00640 1 -- 172.21.15.7:0/2579163220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a6b4de10 con 0x55a7a6c27390 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff733e00640 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c1c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff730c00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7140a3e40 0x7ff7140a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff730c00640 1 -- 172.21.15.7:0/2163574669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7ff71c0d0560 con 0x7ff734109530 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff72aa00640 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c29780 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0cd7e0 tx=0x7ff71c0d6b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eab7247190a0048 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff733e00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7140a3e40 0x7ff7140a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.375+0000 7ff723e00640 1 -- 172.21.15.7:0/2579163220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c020070 con 0x55a7a6c27390 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.376+0000 7ff723e00640 1 -- 172.21.15.7:0/2579163220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff71c0046c0 con 0x55a7a6c27390 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.376+0000 7ff723e00640 1 -- 172.21.15.7:0/2579163220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c09bc30 con 0x55a7a6c27390 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.376+0000 7ff73cf8f740 1 -- 172.21.15.7:0/2579163220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 msgr2=0x55a7a6c29780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.376+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c29780 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0cd7e0 tx=0x7ff71c0d6b30 comp rx=0 tx=0).stop 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.376+0000 7ff733e00640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7140a3e40 0x7ff7140a6300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005fe0 tx=0x7ff72c02f310 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 -- 172.21.15.7:0/2579163220 shutdown_connections 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c29780 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c26e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/2579163220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c1c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 -- 172.21.15.7:0/2579163220 >> 172.21.15.7:0/2579163220 conn(0x55a7a6c186c0 msgr2=0x55a7a6c18aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 -- 172.21.15.7:0/2579163220 shutdown_connections 2024-04-23T15:17:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 -- 172.21.15.7:0/2579163220 wait complete. 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 -- start start 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.377+0000 7ff73cf8f740 1 Processor -- start 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c243a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c248e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c27390 0x55a7a6c24e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6c29fc0 con 0x55a7a6c1cad0 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6b3c2c0 con 0x55a7a6c27390 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6c2a140 con 0x55a7a6c1c1b0 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff73cf8f740 10 client.0 _ll_register_callbacks cb 0x55a7a6894a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c248e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45968/0 (socket says 172.21.15.7:45968) 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.378+0000 7ff72aa00640 1 -- 172.21.15.7:0/3333844049 learned_addr learned my addr 172.21.15.7:0/3333844049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff733400640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff733e00640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c27390 0x55a7a6c24e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff72aa00640 1 -- 172.21.15.7:0/3333844049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 msgr2=0x55a7a6c243a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff72aa00640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c243a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff72aa00640 1 -- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c27390 msgr2=0x55a7a6c24e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff72aa00640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c27390 0x55a7a6c24e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff72aa00640 1 -- 172.21.15.7:0/3333844049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a6b4cfd0 con 0x55a7a6c1cad0 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff733e00640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c27390 0x55a7a6c24e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff72aa00640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c248e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0d65f0 tx=0x7ff71c09bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a9bdaea7247f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff720c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff720c00640 1 -- 172.21.15.7:0/3333844049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0b5060 con 0x55a7a6c1cad0 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff720c00640 1 -- 172.21.15.7:0/3333844049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7ff71c0a0170 con 0x55a7a6c1cad0 2024-04-23T15:17:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.379+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7a6b90320 con 0x55a7a6c1cad0 2024-04-23T15:17:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff720c00640 1 -- 172.21.15.7:0/3333844049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff71c020040 con 0x55a7a6c1cad0 2024-04-23T15:17:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 10 client.17775 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a7a6895210 con 0x55a7a6c1cad0 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff720c00640 1 -- 172.21.15.7:0/3333844049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a7a6b90320 con 0x55a7a6c1cad0 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff720c00640 1 -- 172.21.15.7:0/3333844049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff71c0cdb20 con 0x55a7a6c1cad0 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 10 client.17775 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 10 client.17775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 20 client.17775 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c37420 0x55a7a6c39810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 4 client.17775 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.380+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7a6b8a190 con 0x55a7a6c37420 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.381+0000 7ff733400640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c37420 0x55a7a6c39810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.382+0000 7ff733400640 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c37420 0x55a7a6c39810 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=197ea87d2ed54895 server_cookie=fd5bb0e328096248 in_seq=0 out_seq=0 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.382+0000 7ff720c00640 10 client.17775 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.384+0000 7ff720c00640 1 -- 172.21.15.7:0/3333844049 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a7a6b8a190 con 0x55a7a6c37420 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.384+0000 7ff720c00640 10 client.17775 handle_command_reply: tid=0 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.384+0000 7ff73cf8f740 1 client.17775 shutdown 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.384+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 msgr2=0x55a7a6c248e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.384+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c248e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0d65f0 tx=0x7ff71c09bec0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 shutdown_connections 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c37420 0x55a7a6c39810 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c27390 0x55a7a6c24e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c248e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/3333844049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c243a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff720c00640 0 client.17775 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 >> 172.21.15.7:0/3333844049 conn(0x55a7a6c186c0 msgr2=0x55a7a6c1e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 shutdown_connections 2024-04-23T15:17:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 1 -- 172.21.15.7:0/3333844049 wait complete. 2024-04-23T15:17:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.385+0000 7ff73cf8f740 20 client.17775 trim_cache size 0 max 16384 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.402+0000 7ff73cf8f740 1 Processor -- start 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 -- start start 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c3edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c3f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b14f0 con 0x55a7a6c27390 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b3030 con 0x55a7a6c1cad0 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b1bc0 con 0x55a7a6c1c1b0 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff733e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c3f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff733e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c3f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45970/0 (socket says 172.21.15.7:45970) 2024-04-23T15:17:40.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.403+0000 7ff733e00640 1 -- 172.21.15.7:0/752540136 learned_addr learned my addr 172.21.15.7:0/752540136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733400640 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff72aa00640 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c3edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733e00640 1 -- 172.21.15.7:0/752540136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 msgr2=0x55a7a6c17fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733e00640 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c17fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733e00640 1 -- 172.21.15.7:0/752540136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 msgr2=0x55a7a6c3edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733e00640 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c3edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733e00640 1 -- 172.21.15.7:0/752540136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a6c39b80 con 0x55a7a6c27390 2024-04-23T15:17:40.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733400640 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c17fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.404+0000 7ff733e00640 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c3f310 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff72c035000 tx=0x7ff72c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3535acfdd9429cb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.405+0000 7ff723400640 1 -- 172.21.15.7:0/752540136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c003a30 con 0x55a7a6c27390 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.405+0000 7ff723400640 1 -- 172.21.15.7:0/752540136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff72c036040 con 0x55a7a6c27390 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.405+0000 7ff723400640 1 -- 172.21.15.7:0/752540136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c030820 con 0x55a7a6c27390 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.405+0000 7ff73cf8f740 1 -- 172.21.15.7:0/752540136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 msgr2=0x55a7a6c3f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.405+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c3f310 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff72c035000 tx=0x7ff72c040000 comp rx=0 tx=0).stop 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 -- 172.21.15.7:0/752540136 shutdown_connections 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c3edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c3f310 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/752540136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c17fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 -- 172.21.15.7:0/752540136 >> 172.21.15.7:0/752540136 conn(0x55a7a6c186c0 msgr2=0x55a7a6c25bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:40.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 -- 172.21.15.7:0/752540136 shutdown_connections 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 -- 172.21.15.7:0/752540136 wait complete. 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 -- start start 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.406+0000 7ff73cf8f740 1 Processor -- start 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c21270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c217b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c21cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b2960 con 0x55a7a6c27390 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b2290 con 0x55a7a6c1cad0 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341af4f0 con 0x55a7a6c1c1b0 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff73cf8f740 10 client.0 _ll_register_callbacks cb 0x7ff71c0d6520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:40.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff733e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c21cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff733e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c21cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45984/0 (socket says 172.21.15.7:45984) 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.407+0000 7ff733e00640 1 -- 172.21.15.7:0/796546583 learned_addr learned my addr 172.21.15.7:0/796546583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733400640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c21270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff72aa00640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733e00640 1 -- 172.21.15.7:0/796546583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 msgr2=0x55a7a6c21270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733e00640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c21270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733e00640 1 -- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 msgr2=0x55a7a6c217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733e00640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733e00640 1 -- 172.21.15.7:0/796546583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a6961620 con 0x55a7a6c27390 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff733e00640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c21cf0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff72c052040 tx=0x7ff72c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c1623acb2c02fa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.408+0000 7ff720c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.409+0000 7ff720c00640 1 -- 172.21.15.7:0/796546583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c05c020 con 0x55a7a6c27390 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.409+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72c036040 con 0x55a7a6c27390 2024-04-23T15:17:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.409+0000 7ff720c00640 1 -- 172.21.15.7:0/796546583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7ff72c0043d0 con 0x55a7a6c27390 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.409+0000 7ff720c00640 1 -- 172.21.15.7:0/796546583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff72c0305c0 con 0x55a7a6c27390 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.409+0000 7ff73cf8f740 10 client.17781 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.409+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a7a6c9d940 con 0x55a7a6c27390 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff720c00640 1 -- 172.21.15.7:0/796546583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff72c036040 con 0x55a7a6c27390 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff720c00640 1 -- 172.21.15.7:0/796546583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff72c044040 con 0x55a7a6c27390 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff73cf8f740 10 client.17781 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff73cf8f740 10 client.17781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff73cf8f740 20 client.17781 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c9e000 0x55a7a6ca0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff73cf8f740 4 client.17781 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:17:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.410+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7a6b064b0 con 0x55a7a6c9e000 2024-04-23T15:17:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.411+0000 7ff733400640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c9e000 0x55a7a6ca0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.412+0000 7ff733400640 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c9e000 0x55a7a6ca0420 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f800ce6c1a2ffe server_cookie=b394d563923a5ea8 in_seq=0 out_seq=0 2024-04-23T15:17:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.412+0000 7ff720c00640 10 client.17781 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff720c00640 1 -- 172.21.15.7:0/796546583 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7a6b064b0 con 0x55a7a6c9e000 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff720c00640 10 client.17781 handle_command_reply: tid=0 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 client.17781 shutdown 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 msgr2=0x55a7a6c21cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c21cf0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff72c052040 tx=0x7ff72c003f90 comp rx=0 tx=0).stop 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 shutdown_connections 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a7a6c9e000 0x55a7a6ca0420 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7a6c1cad0 0x55a7a6c217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7a6c27390 0x55a7a6c21cf0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 --2- 172.21.15.7:0/796546583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7a6c1c1b0 0x55a7a6c21270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 >> 172.21.15.7:0/796546583 conn(0x55a7a6c186c0 msgr2=0x55a7a6c26460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.438+0000 7ff720c00640 0 client.17781 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.439+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 shutdown_connections 2024-04-23T15:17:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.439+0000 7ff73cf8f740 1 -- 172.21.15.7:0/796546583 wait complete. 2024-04-23T15:17:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.439+0000 7ff73cf8f740 20 client.17781 trim_cache size 0 max 16384 2024-04-23T15:17:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:17:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:17:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:17:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7140a3e40 msgr2=0x7ff7140a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7140a3e40 0x7ff7140a6300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005fe0 tx=0x7ff72c02f310 comp rx=0 tx=0).stop 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 msgr2=0x7ff7341a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff7341a0bd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00d740 tx=0x7ff71c00dc00 comp rx=0 tx=0).stop 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 shutdown_connections 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7140a3e40 0x7ff7140a6300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff73419a750 0x7ff73419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff734109530 0x7ff7341a0bd0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 --2- 172.21.15.7:0/2163574669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff734104460 0x7ff7341a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 >> 172.21.15.7:0/2163574669 conn(0x7ff7340ffd00 msgr2=0x7ff734101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.440+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 shutdown_connections 2024-04-23T15:17:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:40.441+0000 7ff73a200640 1 -- 172.21.15.7:0/2163574669 wait complete. 2024-04-23T15:17:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:40 smithi137 ceph-mon[31694]: pgmap v830: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:41.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:40 smithi007 ceph-mon[27906]: pgmap v830: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:40 smithi186 ceph-mon[31814]: pgmap v830: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:42 smithi007 ceph-mon[27906]: pgmap v831: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:42 smithi186 ceph-mon[31814]: pgmap v831: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:42 smithi137 ceph-mon[31694]: pgmap v831: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:17:44.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:43 smithi007 ceph-mon[27906]: pgmap v832: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 21 op/s 2024-04-23T15:17:44.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:43 smithi186 ceph-mon[31814]: pgmap v832: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 21 op/s 2024-04-23T15:17:44.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:43 smithi137 ceph-mon[31694]: pgmap v832: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 21 op/s 2024-04-23T15:17:46.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:46 smithi137 ceph-mon[31694]: pgmap v833: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:17:46.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:46 smithi007 ceph-mon[27906]: pgmap v833: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:17:46.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:46 smithi186 ceph-mon[31814]: pgmap v833: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-04-23T15:17:48.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:48 smithi137 ceph-mon[31694]: pgmap v834: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:17:48.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:48 smithi007 ceph-mon[27906]: pgmap v834: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:17:48.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:48 smithi186 ceph-mon[31814]: pgmap v834: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:17:50.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:50 smithi007 ceph-mon[27906]: pgmap v835: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:17:50.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:50 smithi137 ceph-mon[31694]: pgmap v835: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:17:50.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:50 smithi186 ceph-mon[31814]: pgmap v835: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:17:52.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:52 smithi137 ceph-mon[31694]: pgmap v836: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:17:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:52 smithi007 ceph-mon[27906]: pgmap v836: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:17:52.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:52 smithi186 ceph-mon[31814]: pgmap v836: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:17:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 -- 172.21.15.7:0/2536551381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c10e4d0 msgr2=0x7f088c10e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 --2- 172.21.15.7:0/2536551381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c10e4d0 0x7f088c10e8b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0880009930 tx=0x7f088002a420 comp rx=0 tx=0).stop 2024-04-23T15:17:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 -- 172.21.15.7:0/2536551381 shutdown_connections 2024-04-23T15:17:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 --2- 172.21.15.7:0/2536551381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f088c108ec0 0x7f088c115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 --2- 172.21.15.7:0/2536551381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108540 0x7f088c108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 --2- 172.21.15.7:0/2536551381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c10e4d0 0x7f088c10e8b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 -- 172.21.15.7:0/2536551381 >> 172.21.15.7:0/2536551381 conn(0x7f088c077de0 msgr2=0x7f088c106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 -- 172.21.15.7:0/2536551381 shutdown_connections 2024-04-23T15:17:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.607+0000 7f0892e00640 1 -- 172.21.15.7:0/2536551381 wait complete. 2024-04-23T15:17:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.608+0000 7f0892e00640 1 Processor -- start 2024-04-23T15:17:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.608+0000 7f0892e00640 1 -- start start 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0892e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 0x7f088c1a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0892e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108ec0 0x7f088c1a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0892e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f088c10e4d0 0x7f088c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0892e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f088c118680 con 0x7f088c108540 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0892e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f088c118500 con 0x7f088c10e4d0 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0892e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f088c118800 con 0x7f088c108ec0 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0891a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 0x7f088c1a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0891a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 0x7f088c1a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34158/0 (socket says 172.21.15.7:34158) 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.609+0000 7f0891a00640 1 -- 172.21.15.7:0/414685406 learned_addr learned my addr 172.21.15.7:0/414685406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891000640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108ec0 0x7f088c1a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0892400640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f088c10e4d0 0x7f088c19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891a00640 1 -- 172.21.15.7:0/414685406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108ec0 msgr2=0x7f088c1a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891a00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108ec0 0x7f088c1a4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891a00640 1 -- 172.21.15.7:0/414685406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f088c10e4d0 msgr2=0x7f088c19ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891a00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f088c10e4d0 0x7f088c19ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891a00640 1 -- 172.21.15.7:0/414685406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c19f1e0 con 0x7f088c108540 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891000640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108ec0 0x7f088c1a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.610+0000 7f0891a00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 0x7f088c1a48b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f0880004770 tx=0x7f08800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.611+0000 7f088a000640 1 -- 172.21.15.7:0/414685406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088003f070 con 0x7f088c108540 2024-04-23T15:17:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.611+0000 7f088a000640 1 -- 172.21.15.7:0/414685406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f088003b460 con 0x7f088c108540 2024-04-23T15:17:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.611+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088c19f470 con 0x7f088c108540 2024-04-23T15:17:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.611+0000 7f088a000640 1 -- 172.21.15.7:0/414685406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880035070 con 0x7f088c108540 2024-04-23T15:17:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.611+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088c1ab770 con 0x7f088c108540 2024-04-23T15:17:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.615+0000 7f088a000640 1 -- 172.21.15.7:0/414685406 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f088003b610 con 0x7f088c108540 2024-04-23T15:17:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.615+0000 7f08971b8740 1 Processor -- start 2024-04-23T15:17:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.615+0000 7f08971b8740 1 -- start start 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f08971b8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be0b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f08971b8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be16060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f08971b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be18990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f08971b8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56404bd71900 con 0x56404be0b3c0 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f08971b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56404bd17f20 con 0x56404be165a0 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f08971b8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56404bd6d8c0 con 0x56404be0bce0 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be0b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be0b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34164/0 (socket says 172.21.15.7:34164) 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.616+0000 7f0892400640 1 -- 172.21.15.7:0/3158072010 learned_addr learned my addr 172.21.15.7:0/3158072010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0891a00640 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be16060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0891000640 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be18990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0892400640 1 -- 172.21.15.7:0/3158072010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 msgr2=0x56404be16060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0892400640 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be16060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0892400640 1 -- 172.21.15.7:0/3158072010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 msgr2=0x56404be18990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0892400640 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be18990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0892400640 1 -- 172.21.15.7:0/3158072010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404bd3ce10 con 0x56404be0b3c0 2024-04-23T15:17:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0891000640 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be18990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:17:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f088a000640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08740a3d10 0x7f08740a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f0892400640 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be0b7a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f0884009e60 tx=0x7f0884010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39da2b395d2fa9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.617+0000 7f088a000640 1 -- 172.21.15.7:0/414685406 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7f08800f0ca0 con 0x7f088c108540 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.618+0000 7f087ea00640 1 -- 172.21.15.7:0/3158072010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884016070 con 0x56404be0b3c0 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.618+0000 7f087ea00640 1 -- 172.21.15.7:0/3158072010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0884004d20 con 0x56404be0b3c0 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.618+0000 7f0891a00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08740a3d10 0x7f08740a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.618+0000 7f087ea00640 1 -- 172.21.15.7:0/3158072010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840126e0 con 0x56404be0b3c0 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 -- 172.21.15.7:0/3158072010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 msgr2=0x56404be0b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f0891a00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08740a3d10 0x7f08740a61d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x56404be0c960 tx=0x7f088002a420 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be0b7a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f0884009e60 tx=0x7f0884010740 comp rx=0 tx=0).stop 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 -- 172.21.15.7:0/3158072010 shutdown_connections 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be18990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be16060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 --2- 172.21.15.7:0/3158072010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be0b7a0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 -- 172.21.15.7:0/3158072010 >> 172.21.15.7:0/3158072010 conn(0x56404be078d0 msgr2=0x56404be07cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 -- 172.21.15.7:0/3158072010 shutdown_connections 2024-04-23T15:17:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 -- 172.21.15.7:0/3158072010 wait complete. 2024-04-23T15:17:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.619+0000 7f08971b8740 1 -- start start 2024-04-23T15:17:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 Processor -- start 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0b3c0 0x56404be135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0bce0 0x56404be13b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be14040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56404be19170 con 0x56404be165a0 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56404bd2b2c0 con 0x56404be0bce0 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.620+0000 7f08971b8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56404be192f0 con 0x56404be0b3c0 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f08971b8740 10 client.0 _ll_register_callbacks cb 0x56404ba83a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be14040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be14040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34178/0 (socket says 172.21.15.7:34178) 2024-04-23T15:17:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 -- 172.21.15.7:0/782436169 learned_addr learned my addr 172.21.15.7:0/782436169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0891000640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0bce0 0x56404be13b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0b3c0 0x56404be135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 -- 172.21.15.7:0/782436169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0b3c0 msgr2=0x56404be135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0b3c0 0x56404be135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 -- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0bce0 msgr2=0x56404be13b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0bce0 0x56404be13b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.621+0000 7f0892400640 1 -- 172.21.15.7:0/782436169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56404bd3bfd0 con 0x56404be165a0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f0892400640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be14040 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f0884005f40 tx=0x7f0884005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b968c69635fe721 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f0873400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f0873400640 1 -- 172.21.15.7:0/782436169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088401e070 con 0x56404be165a0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f0873400640 1 -- 172.21.15.7:0/782436169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7f0884012810 con 0x56404be165a0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0884004d20 con 0x56404be165a0 2024-04-23T15:17:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f0873400640 1 -- 172.21.15.7:0/782436169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0884030050 con 0x56404be165a0 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f08971b8740 10 client.17793 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.622+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56404ba84210 con 0x56404be165a0 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f0873400640 1 -- 172.21.15.7:0/782436169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0884004d20 con 0x56404be165a0 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f0873400640 1 -- 172.21.15.7:0/782436169 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f088400f040 con 0x56404be165a0 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f08971b8740 10 client.17793 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f08971b8740 10 client.17793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f08971b8740 20 client.17793 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f08971b8740 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be26590 0x56404be28980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f08971b8740 4 client.17793 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.623+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56404bd7f320 con 0x56404be26590 2024-04-23T15:17:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.624+0000 7f0891000640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be26590 0x56404be28980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.625+0000 7f0891000640 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be26590 0x56404be28980 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e19647721c03b67c server_cookie=4c9dacdad5095d7e in_seq=0 out_seq=0 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.625+0000 7f0873400640 10 client.17793 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f0873400640 1 -- 172.21.15.7:0/782436169 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56404bd7f320 con 0x56404be26590 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f0873400640 10 client.17793 handle_command_reply: tid=0 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 client.17793 shutdown 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 msgr2=0x56404be14040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be14040 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f0884005f40 tx=0x7f0884005b00 comp rx=0 tx=0).stop 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 shutdown_connections 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be26590 0x56404be28980 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0bce0 0x56404be13b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be14040 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 --2- 172.21.15.7:0/782436169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0b3c0 0x56404be135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 >> 172.21.15.7:0/782436169 conn(0x56404be078d0 msgr2=0x56404be0d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f0873400640 0 client.17793 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.627+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 shutdown_connections 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.628+0000 7f08971b8740 1 -- 172.21.15.7:0/782436169 wait complete. 2024-04-23T15:17:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.628+0000 7f08971b8740 20 client.17793 trim_cache size 0 max 16384 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 Processor -- start 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 -- start start 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be14df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be12d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be0dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1b58f0 con 0x56404be0b3c0 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1b7430 con 0x56404be165a0 2024-04-23T15:17:53.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f08971b8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1b5fc0 con 0x56404be0bce0 2024-04-23T15:17:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.647+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be14df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be14df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34188/0 (socket says 172.21.15.7:34188) 2024-04-23T15:17:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 -- 172.21.15.7:0/2186652147 learned_addr learned my addr 172.21.15.7:0/2186652147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:53.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0891000640 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be12d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 -- 172.21.15.7:0/2186652147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 msgr2=0x56404be12d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be12d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 -- 172.21.15.7:0/2186652147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 msgr2=0x56404be0dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be0dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 -- 172.21.15.7:0/2186652147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56404be15ca0 con 0x56404be0b3c0 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.648+0000 7f0892400640 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be14df0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f0884009e60 tx=0x7f0884005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4339f1a616fd3e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.649+0000 7f087e000640 1 -- 172.21.15.7:0/2186652147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088401e070 con 0x56404be0b3c0 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.649+0000 7f087e000640 1 -- 172.21.15.7:0/2186652147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0884010c40 con 0x56404be0b3c0 2024-04-23T15:17:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.649+0000 7f087e000640 1 -- 172.21.15.7:0/2186652147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884016040 con 0x56404be0b3c0 2024-04-23T15:17:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.649+0000 7f08971b8740 1 -- 172.21.15.7:0/2186652147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 msgr2=0x56404be14df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be14df0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f0884009e60 tx=0x7f0884005fd0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 -- 172.21.15.7:0/2186652147 shutdown_connections 2024-04-23T15:17:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be165a0 0x56404be0dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be12d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 --2- 172.21.15.7:0/2186652147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be0b3c0 0x56404be14df0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 -- 172.21.15.7:0/2186652147 >> 172.21.15.7:0/2186652147 conn(0x56404be078d0 msgr2=0x56404be13e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 -- 172.21.15.7:0/2186652147 shutdown_connections 2024-04-23T15:17:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 -- 172.21.15.7:0/2186652147 wait complete. 2024-04-23T15:17:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.650+0000 7f08971b8740 1 -- start start 2024-04-23T15:17:53.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 Processor -- start 2024-04-23T15:17:53.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0b3c0 0x56404be1e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be1eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be0fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1b6d60 con 0x56404be165a0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1b6690 con 0x56404be0b3c0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f088c1b38f0 con 0x56404be0bce0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f08971b8740 10 client.0 _ll_register_callbacks cb 0x7f0884009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be0fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f0892400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be0fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34192/0 (socket says 172.21.15.7:34192) 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.651+0000 7f0892400640 1 -- 172.21.15.7:0/1564047411 learned_addr learned my addr 172.21.15.7:0/1564047411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0b3c0 0x56404be1e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0891000640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be1eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 -- 172.21.15.7:0/1564047411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 msgr2=0x56404be1eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be1eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 -- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0b3c0 msgr2=0x56404be1e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0b3c0 0x56404be1e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 -- 172.21.15.7:0/1564047411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56404bb50620 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0891000640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be1eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0892400640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be0fdf0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f08840129a0 tx=0x7f0884005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2feeaa2afc4c5dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.652+0000 7f0873400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f0873400640 1 -- 172.21.15.7:0/1564047411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088401e070 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0884010c40 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f0873400640 1 -- 172.21.15.7:0/1564047411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9467+0+0 (secure 0 0 0) 0x7f0884012c40 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f0873400640 1 -- 172.21.15.7:0/1564047411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0884039040 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f08971b8740 10 client.17799 fetch_fsmap learned FSMap version 32 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56404be8c290 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f0873400640 1 -- 172.21.15.7:0/1564047411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0884010c40 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.653+0000 7f0873400640 1 -- 172.21.15.7:0/1564047411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f088402a980 con 0x56404be165a0 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f08971b8740 10 client.17799 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f08971b8740 10 client.17799 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f08971b8740 20 client.17799 populate_metadata read hostname 'smithi007' 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f08971b8740 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be8c990 0x56404be8edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:17:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f08971b8740 4 client.17799 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:17:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56404bd79190 con 0x56404be8c990 2024-04-23T15:17:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.654+0000 7f0891000640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be8c990 0x56404be8edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:17:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.655+0000 7f0891000640 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be8c990 0x56404be8edb0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f75ac15cf1468e0 server_cookie=91c2493e8da6889f in_seq=0 out_seq=0 2024-04-23T15:17:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.655+0000 7f0873400640 10 client.17799 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.688+0000 7f0873400640 1 -- 172.21.15.7:0/1564047411 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56404bd79190 con 0x56404be8c990 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.688+0000 7f0873400640 10 client.17799 handle_command_reply: tid=0 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.688+0000 7f08971b8740 1 client.17799 shutdown 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.688+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 msgr2=0x56404be0fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.688+0000 7f08971b8740 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be0fdf0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f08840129a0 tx=0x7f0884005f60 comp rx=0 tx=0).stop 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 shutdown_connections 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56404be8c990 0x56404be8edb0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56404be165a0 0x56404be0fdf0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56404be0bce0 0x56404be1eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 --2- 172.21.15.7:0/1564047411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56404be0b3c0 0x56404be1e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f0873400640 0 client.17799 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:17:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 >> 172.21.15.7:0/1564047411 conn(0x56404be078d0 msgr2=0x56404be13580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 shutdown_connections 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 1 -- 172.21.15.7:0/1564047411 wait complete. 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.689+0000 7f08971b8740 20 client.17799 trim_cache size 0 max 16384 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:17:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08740a3d10 msgr2=0x7f08740a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08740a3d10 0x7f08740a61d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x56404be0c960 tx=0x7f088002a420 comp rx=0 tx=0).stop 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 msgr2=0x7f088c1a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 0x7f088c1a48b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f0880004770 tx=0x7f08800042f0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 shutdown_connections 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08740a3d10 0x7f08740a61d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f088c10e4d0 0x7f088c19ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088c108ec0 0x7f088c1a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 --2- 172.21.15.7:0/414685406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f088c108540 0x7f088c1a48b0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:17:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 >> 172.21.15.7:0/414685406 conn(0x7f088c077de0 msgr2=0x7f088c0784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:17:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 shutdown_connections 2024-04-23T15:17:53.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:17:53.690+0000 7f0892e00640 1 -- 172.21.15.7:0/414685406 wait complete. 2024-04-23T15:17:54.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:54 smithi137 ceph-mon[31694]: pgmap v837: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:54.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:54 smithi007 ceph-mon[27906]: pgmap v837: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:54.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:54 smithi186 ceph-mon[31814]: pgmap v837: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:17:56.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:56 smithi137 ceph-mon[31694]: pgmap v838: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:17:56.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:56 smithi007 ceph-mon[27906]: pgmap v838: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:17:56.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:56 smithi186 ceph-mon[31814]: pgmap v838: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:17:58.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:17:58 smithi137 ceph-mon[31694]: pgmap v839: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:17:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:17:58 smithi007 ceph-mon[27906]: pgmap v839: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:17:58.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:17:58 smithi186 ceph-mon[31814]: pgmap v839: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:00.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:00 smithi137 ceph-mon[31694]: pgmap v840: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:18:00.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:00 smithi007 ceph-mon[27906]: pgmap v840: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:18:00.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:00 smithi186 ceph-mon[31814]: pgmap v840: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:18:02.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:02 smithi007 ceph-mon[27906]: pgmap v841: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:18:02.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:02 smithi186 ceph-mon[31814]: pgmap v841: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:18:02.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:02 smithi137 ceph-mon[31694]: pgmap v841: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:18:04.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:04 smithi007 ceph-mon[27906]: pgmap v842: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:18:04.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:04 smithi007 ceph-mon[27906]: osdmap e133: 12 total, 12 up, 12 in 2024-04-23T15:18:04.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:04 smithi186 ceph-mon[31814]: pgmap v842: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:18:04.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:04 smithi186 ceph-mon[31814]: osdmap e133: 12 total, 12 up, 12 in 2024-04-23T15:18:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:04 smithi137 ceph-mon[31694]: pgmap v842: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:18:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:04 smithi137 ceph-mon[31694]: osdmap e133: 12 total, 12 up, 12 in 2024-04-23T15:18:06.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:06 smithi007 ceph-mon[27906]: pgmap v844: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 35 op/s 2024-04-23T15:18:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:06 smithi186 ceph-mon[31814]: pgmap v844: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 35 op/s 2024-04-23T15:18:06.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:06 smithi137 ceph-mon[31694]: pgmap v844: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 35 op/s 2024-04-23T15:18:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 -- 172.21.15.7:0/3023675230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94104c50 msgr2=0x7fdb94108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 --2- 172.21.15.7:0/3023675230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94104c50 0x7fdb94108c90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009900 tx=0x7fdb7c02a410 comp rx=0 tx=0).stop 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 -- 172.21.15.7:0/3023675230 shutdown_connections 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 --2- 172.21.15.7:0/3023675230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb94109370 0x7fdb94110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 --2- 172.21.15.7:0/3023675230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94104c50 0x7fdb94108c90 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 --2- 172.21.15.7:0/3023675230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb941042a0 0x7fdb94104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.855+0000 7fdb93e00640 1 -- 172.21.15.7:0/3023675230 >> 172.21.15.7:0/3023675230 conn(0x7fdb940ffae0 msgr2=0x7fdb94101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.856+0000 7fdb93e00640 1 -- 172.21.15.7:0/3023675230 shutdown_connections 2024-04-23T15:18:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.856+0000 7fdb93e00640 1 -- 172.21.15.7:0/3023675230 wait complete. 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.857+0000 7fdb93e00640 1 Processor -- start 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.857+0000 7fdb93e00640 1 -- start start 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.857+0000 7fdb93e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb941042a0 0x7fdb941a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.857+0000 7fdb93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 0x7fdb941a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.857+0000 7fdb93e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9419a6c0 0x7fdb9419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb93e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94114300 con 0x7fdb94109370 2024-04-23T15:18:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb93e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94114180 con 0x7fdb9419a6c0 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb93e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94114480 con 0x7fdb941042a0 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 0x7fdb941a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 0x7fdb941a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39432/0 (socket says 172.21.15.7:39432) 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 -- 172.21.15.7:0/92795702 learned_addr learned my addr 172.21.15.7:0/92795702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb92a00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb941042a0 0x7fdb941a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb93400640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9419a6c0 0x7fdb9419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 -- 172.21.15.7:0/92795702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb941042a0 msgr2=0x7fdb941a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb941042a0 0x7fdb941a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 -- 172.21.15.7:0/92795702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9419a6c0 msgr2=0x7fdb9419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9419a6c0 0x7fdb9419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.858+0000 7fdb8a000640 1 -- 172.21.15.7:0/92795702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9419b2c0 con 0x7fdb94109370 2024-04-23T15:18:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.859+0000 7fdb8a000640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 0x7fdb941a0af0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005ab0 tx=0x7fdb7c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.859+0000 7fdb98a00640 1 -- 172.21.15.7:0/92795702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c03f070 con 0x7fdb94109370 2024-04-23T15:18:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.859+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9419b550 con 0x7fdb94109370 2024-04-23T15:18:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.859+0000 7fdb98a00640 1 -- 172.21.15.7:0/92795702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb7c031d60 con 0x7fdb94109370 2024-04-23T15:18:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.859+0000 7fdb98a00640 1 -- 172.21.15.7:0/92795702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c035030 con 0x7fdb94109370 2024-04-23T15:18:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.860+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941a7640 con 0x7fdb94109370 2024-04-23T15:18:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.863+0000 7fdb9cc5a740 1 Processor -- start 2024-04-23T15:18:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.863+0000 7fdb9cc5a740 1 -- start start 2024-04-23T15:18:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8cc3c0 0x55e80a8cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8d75a0 0x55e80a8d9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e80a832900 con 0x55e80a8ccce0 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e80a7d8f20 con 0x55e80a8d75a0 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e80a82e8c0 con 0x55e80a8cc3c0 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb98a00640 1 -- 172.21.15.7:0/92795702 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdb7c042070 con 0x7fdb94109370 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb92a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb92a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39448/0 (socket says 172.21.15.7:39448) 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb92a00640 1 -- 172.21.15.7:0/2359774058 learned_addr learned my addr 172.21.15.7:0/2359774058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb93400640 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8cc3c0 0x55e80a8cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.864+0000 7fdb8a000640 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8d75a0 0x55e80a8d9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb92a00640 1 -- 172.21.15.7:0/2359774058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8cc3c0 msgr2=0x55e80a8cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb92a00640 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8cc3c0 0x55e80a8cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb92a00640 1 -- 172.21.15.7:0/2359774058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8d75a0 msgr2=0x55e80a8d9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb92a00640 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8d75a0 0x55e80a8d9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb92a00640 1 -- 172.21.15.7:0/2359774058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80a7fde10 con 0x55e80a8ccce0 2024-04-23T15:18:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb92a00640 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d7060 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400dcb0 tx=0x7fdb8400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60faba6a55dfcc5c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb83e00640 1 -- 172.21.15.7:0/2359774058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84011440 con 0x55e80a8ccce0 2024-04-23T15:18:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb83e00640 1 -- 172.21.15.7:0/2359774058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb84011a90 con 0x55e80a8ccce0 2024-04-23T15:18:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.865+0000 7fdb83e00640 1 -- 172.21.15.7:0/2359774058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8401ba10 con 0x55e80a8ccce0 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.866+0000 7fdb98a00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb740a3d10 0x7fdb740a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.866+0000 7fdb98a00640 1 -- 172.21.15.7:0/92795702 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9555+0+0 (secure 0 0 0) 0x7fdb7c0f11b0 con 0x7fdb94109370 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.866+0000 7fdb93400640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb740a3d10 0x7fdb740a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.866+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/2359774058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 msgr2=0x55e80a8d7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.866+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d7060 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400dcb0 tx=0x7fdb8400f730 comp rx=0 tx=0).stop 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/2359774058 shutdown_connections 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8d75a0 0x55e80a8d9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d7060 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/2359774058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8cc3c0 0x55e80a8cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/2359774058 >> 172.21.15.7:0/2359774058 conn(0x55e80a8c88d0 msgr2=0x55e80a8c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/2359774058 shutdown_connections 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/2359774058 wait complete. 2024-04-23T15:18:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb93400640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb740a3d10 0x7fdb740a61d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0092f0 tx=0x7fdb8c009280 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.867+0000 7fdb9cc5a740 1 -- start start 2024-04-23T15:18:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 Processor -- start 2024-04-23T15:18:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8ccce0 0x55e80a8d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e80a8da140 con 0x55e80a8cc3c0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e80a7ec2c0 con 0x55e80a8ccce0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e80a8da2c0 con 0x55e80a8d75a0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.868+0000 7fdb9cc5a740 10 client.0 _ll_register_callbacks cb 0x55e80a544a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39462/0 (socket says 172.21.15.7:39462) 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 -- 172.21.15.7:0/1769733805 learned_addr learned my addr 172.21.15.7:0/1769733805 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb8a000640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8ccce0 0x55e80a8d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb93400640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 -- 172.21.15.7:0/1769733805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 msgr2=0x55e80a8d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8d4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 -- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8ccce0 msgr2=0x55e80a8d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8ccce0 0x55e80a8d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 -- 172.21.15.7:0/1769733805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e80a7fcfd0 con 0x55e80a8cc3c0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb93400640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb92a00640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d4540 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fdb8401b450 tx=0x7fdb8401b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d869140853a3926e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.869+0000 7fdb80c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.870+0000 7fdb80c00640 1 -- 172.21.15.7:0/1769733805 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84004450 con 0x55e80a8cc3c0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.870+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb84011a90 con 0x55e80a8cc3c0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.870+0000 7fdb80c00640 1 -- 172.21.15.7:0/1769733805 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 9555+0+0 (secure 0 0 0) 0x7fdb84011440 con 0x55e80a8cc3c0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.870+0000 7fdb80c00640 1 -- 172.21.15.7:0/1769733805 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdb84032050 con 0x55e80a8cc3c0 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.870+0000 7fdb9cc5a740 10 client.17811 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.870+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e80a545210 con 0x55e80a8cc3c0 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb80c00640 1 -- 172.21.15.7:0/1769733805 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb84011a90 con 0x55e80a8cc3c0 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb80c00640 1 -- 172.21.15.7:0/1769733805 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdb8402d030 con 0x55e80a8cc3c0 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb9cc5a740 10 client.17811 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb9cc5a740 10 client.17811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb9cc5a740 20 client.17811 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a8e7640 0x55e80a8e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb9cc5a740 4 client.17811 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.871+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e80a840320 con 0x55e80a8e7640 2024-04-23T15:18:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.872+0000 7fdb8a000640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a8e7640 0x55e80a8e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.872+0000 7fdb8a000640 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a8e7640 0x55e80a8e9a30 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf6f66d5f7efc2b server_cookie=e339507602c15f52 in_seq=0 out_seq=0 2024-04-23T15:18:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.872+0000 7fdb80c00640 10 client.17811 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.874+0000 7fdb80c00640 1 -- 172.21.15.7:0/1769733805 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e80a840320 con 0x55e80a8e7640 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.874+0000 7fdb80c00640 10 client.17811 handle_command_reply: tid=0 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.874+0000 7fdb9cc5a740 1 client.17811 shutdown 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 msgr2=0x55e80a8d4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d4540 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fdb8401b450 tx=0x7fdb8401b520 comp rx=0 tx=0).stop 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 shutdown_connections 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a8e7640 0x55e80a8e9a30 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8ccce0 0x55e80a8d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/1769733805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d4540 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 >> 172.21.15.7:0/1769733805 conn(0x55e80a8c88d0 msgr2=0x55e80a8c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb80c00640 0 client.17811 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 shutdown_connections 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/1769733805 wait complete. 2024-04-23T15:18:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.875+0000 7fdb9cc5a740 20 client.17811 trim_cache size 0 max 16384 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 Processor -- start 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 -- start start 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941b15c0 con 0x55e80a8ccce0 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941b3100 con 0x55e80a8cc3c0 2024-04-23T15:18:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.894+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941b1c90 con 0x55e80a8d75a0 2024-04-23T15:18:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39472/0 (socket says 172.21.15.7:39472) 2024-04-23T15:18:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 -- 172.21.15.7:0/4192656852 learned_addr learned my addr 172.21.15.7:0/4192656852 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb92a00640 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb93400640 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 -- 172.21.15.7:0/4192656852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 msgr2=0x55e80a8ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 -- 172.21.15.7:0/4192656852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 msgr2=0x55e80a8d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 -- 172.21.15.7:0/4192656852 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80a611620 con 0x55e80a8ccce0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb92a00640 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.895+0000 7fdb8a000640 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d3e20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0b9140 tx=0x7fdb7c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47c33a8fa5adaf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.896+0000 7fdb83400640 1 -- 172.21.15.7:0/4192656852 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c049040 con 0x55e80a8ccce0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.896+0000 7fdb83400640 1 -- 172.21.15.7:0/4192656852 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb7c0bd3e0 con 0x55e80a8ccce0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.896+0000 7fdb83400640 1 -- 172.21.15.7:0/4192656852 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0b9350 con 0x55e80a8ccce0 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.896+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/4192656852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 msgr2=0x55e80a8d3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.896+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d3e20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0b9140 tx=0x7fdb7c009260 comp rx=0 tx=0).stop 2024-04-23T15:18:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/4192656852 shutdown_connections 2024-04-23T15:18:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8d3e20 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/4192656852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/4192656852 >> 172.21.15.7:0/4192656852 conn(0x55e80a8c88d0 msgr2=0x55e80a8d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/4192656852 shutdown_connections 2024-04-23T15:18:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/4192656852 wait complete. 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 -- start start 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.897+0000 7fdb9cc5a740 1 Processor -- start 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8db280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941b2a30 con 0x55e80a8ccce0 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941b2360 con 0x55e80a8cc3c0 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941af5c0 con 0x55e80a8d75a0 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb9cc5a740 10 client.0 _ll_register_callbacks cb 0x7fdb84015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb8a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb8a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8dad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39480/0 (socket says 172.21.15.7:39480) 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb8a000640 1 -- 172.21.15.7:0/3710575512 learned_addr learned my addr 172.21.15.7:0/3710575512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.898+0000 7fdb92a00640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb8a000640 1 -- 172.21.15.7:0/3710575512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 msgr2=0x55e80a8db280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb8a000640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb8a000640 1 -- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 msgr2=0x55e80a8df9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb8a000640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8df9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb8a000640 1 -- 172.21.15.7:0/3710575512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e80a8dbab0 con 0x55e80a8ccce0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb92a00640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb8a000640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8dad40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0b96b0 tx=0x7fdb7c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b2cd8d0d015b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb80c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb80c00640 1 -- 172.21.15.7:0/3710575512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c049070 con 0x55e80a8ccce0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb80c00640 1 -- 172.21.15.7:0/3710575512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 9555+0+0 (secure 0 0 0) 0x7fdb7c03b560 con 0x55e80a8ccce0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb7c0bd3e0 con 0x55e80a8ccce0 2024-04-23T15:18:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb80c00640 1 -- 172.21.15.7:0/3710575512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c0bc640 con 0x55e80a8ccce0 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb9cc5a740 10 client.17817 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.899+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e80a94d8a0 con 0x55e80a8ccce0 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb80c00640 1 -- 172.21.15.7:0/3710575512 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb7c0bd3e0 con 0x55e80a8ccce0 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb80c00640 1 -- 172.21.15.7:0/3710575512 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdb7c04c060 con 0x55e80a8ccce0 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb9cc5a740 10 client.17817 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb9cc5a740 10 client.17817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb9cc5a740 20 client.17817 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a94dfc0 0x55e80a9503e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb9cc5a740 4 client.17817 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.900+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e80a83a190 con 0x55e80a94dfc0 2024-04-23T15:18:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.901+0000 7fdb92a00640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a94dfc0 0x55e80a9503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.902+0000 7fdb92a00640 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a94dfc0 0x55e80a9503e0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b6eaf2cd1a991e server_cookie=21a1bdd37ce4bf6f in_seq=0 out_seq=0 2024-04-23T15:18:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.902+0000 7fdb80c00640 10 client.17817 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.934+0000 7fdb80c00640 1 -- 172.21.15.7:0/3710575512 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e80a83a190 con 0x55e80a94dfc0 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb80c00640 10 client.17817 handle_command_reply: tid=0 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 client.17817 shutdown 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 msgr2=0x55e80a8dad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8dad40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0b96b0 tx=0x7fdb7c02a410 comp rx=0 tx=0).stop 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 shutdown_connections 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e80a94dfc0 0x55e80a9503e0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e80a8d75a0 0x55e80a8db280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e80a8ccce0 0x55e80a8dad40 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb80c00640 0 client.17817 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 --2- 172.21.15.7:0/3710575512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e80a8cc3c0 0x55e80a8df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 >> 172.21.15.7:0/3710575512 conn(0x55e80a8c88d0 msgr2=0x55e80a8d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 shutdown_connections 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.935+0000 7fdb9cc5a740 1 -- 172.21.15.7:0/3710575512 wait complete. 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.936+0000 7fdb9cc5a740 20 client.17817 trim_cache size 0 max 16384 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:18:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.936+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb740a3d10 msgr2=0x7fdb740a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.936+0000 7fdb93e00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb740a3d10 0x7fdb740a61d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0092f0 tx=0x7fdb8c009280 comp rx=0 tx=0).stop 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.936+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 msgr2=0x7fdb941a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.936+0000 7fdb93e00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 0x7fdb941a0af0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005ab0 tx=0x7fdb7c003cd0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 shutdown_connections 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb740a3d10 0x7fdb740a61d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9419a6c0 0x7fdb9419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb94109370 0x7fdb941a0af0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 --2- 172.21.15.7:0/92795702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb941042a0 0x7fdb941a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 >> 172.21.15.7:0/92795702 conn(0x7fdb940ffae0 msgr2=0x7fdb94100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 shutdown_connections 2024-04-23T15:18:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:06.937+0000 7fdb93e00640 1 -- 172.21.15.7:0/92795702 wait complete. 2024-04-23T15:18:08.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:08 smithi007 ceph-mon[27906]: pgmap v845: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:18:08.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:08 smithi186 ceph-mon[31814]: pgmap v845: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:18:08.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:08 smithi137 ceph-mon[31694]: pgmap v845: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:18:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:10 smithi007 ceph-mon[27906]: pgmap v846: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:18:10.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:10 smithi186 ceph-mon[31814]: pgmap v846: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:18:10.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:10 smithi137 ceph-mon[31694]: pgmap v846: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:18:12.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:11 smithi007 ceph-mon[27906]: osdmap e134: 12 total, 12 up, 12 in 2024-04-23T15:18:12.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:11 smithi186 ceph-mon[31814]: osdmap e134: 12 total, 12 up, 12 in 2024-04-23T15:18:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:11 smithi137 ceph-mon[31694]: osdmap e134: 12 total, 12 up, 12 in 2024-04-23T15:18:13.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:12 smithi007 ceph-mon[27906]: pgmap v848: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 7 op/s 2024-04-23T15:18:13.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:12 smithi186 ceph-mon[31814]: pgmap v848: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 7 op/s 2024-04-23T15:18:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:12 smithi137 ceph-mon[31694]: pgmap v848: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 7 op/s 2024-04-23T15:18:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:14 smithi007 ceph-mon[27906]: pgmap v849: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 16 op/s 2024-04-23T15:18:15.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:14 smithi186 ceph-mon[31814]: pgmap v849: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 16 op/s 2024-04-23T15:18:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:14 smithi137 ceph-mon[31694]: pgmap v849: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 16 op/s 2024-04-23T15:18:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:16 smithi007 ceph-mon[27906]: pgmap v850: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.1 MiB/s wr, 16 op/s 2024-04-23T15:18:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:16 smithi186 ceph-mon[31814]: pgmap v850: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.1 MiB/s wr, 16 op/s 2024-04-23T15:18:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:16 smithi137 ceph-mon[31694]: pgmap v850: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.1 MiB/s wr, 16 op/s 2024-04-23T15:18:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:18 smithi007 ceph-mon[27906]: pgmap v851: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 18 op/s 2024-04-23T15:18:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:18 smithi186 ceph-mon[31814]: pgmap v851: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 18 op/s 2024-04-23T15:18:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:18 smithi137 ceph-mon[31694]: pgmap v851: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 18 op/s 2024-04-23T15:18:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 -- 172.21.15.7:0/4049857050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf810a850 msgr2=0x7f6cf81111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 --2- 172.21.15.7:0/4049857050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf810a850 0x7f6cf81111d0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009cd0 tx=0x7f6cf002a8f0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 -- 172.21.15.7:0/4049857050 shutdown_connections 2024-04-23T15:18:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 --2- 172.21.15.7:0/4049857050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf810a850 0x7f6cf81111d0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 --2- 172.21.15.7:0/4049857050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cf8100cf0 0x7f6cf810a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 --2- 172.21.15.7:0/4049857050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf8100340 0x7f6cf8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.091+0000 7f6cffe00640 1 -- 172.21.15.7:0/4049857050 >> 172.21.15.7:0/4049857050 conn(0x7f6cf8077000 msgr2=0x7f6cf80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.092+0000 7f6cffe00640 1 -- 172.21.15.7:0/4049857050 shutdown_connections 2024-04-23T15:18:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.092+0000 7f6cffe00640 1 -- 172.21.15.7:0/4049857050 wait complete. 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 Processor -- start 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 -- start start 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 0x7f6cf81a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf810a850 0x7f6cf81a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cf819a730 0x7f6cf819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8114530 con 0x7f6cf8100340 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81143b0 con 0x7f6cf810a850 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.093+0000 7f6cffe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81146b0 con 0x7f6cf819a730 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 0x7f6cf81a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 0x7f6cf81a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60958/0 (socket says 172.21.15.7:60958) 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 -- 172.21.15.7:0/2285425571 learned_addr learned my addr 172.21.15.7:0/2285425571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfca00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf810a850 0x7f6cf81a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfde00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cf819a730 0x7f6cf819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 -- 172.21.15.7:0/2285425571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cf819a730 msgr2=0x7f6cf819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cf819a730 0x7f6cf819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 -- 172.21.15.7:0/2285425571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf810a850 msgr2=0x7f6cf81a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf810a850 0x7f6cf81a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.094+0000 7f6cfd400640 1 -- 172.21.15.7:0/2285425571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf819b330 con 0x7f6cf8100340 2024-04-23T15:18:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.095+0000 7f6cfd400640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 0x7f6cf81a0670 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00e9f0 tx=0x7f6cec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.095+0000 7f6cf6000640 1 -- 172.21.15.7:0/2285425571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00cd80 con 0x7f6cf8100340 2024-04-23T15:18:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.095+0000 7f6cf6000640 1 -- 172.21.15.7:0/2285425571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cec0108e0 con 0x7f6cf8100340 2024-04-23T15:18:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.095+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81a7410 con 0x7f6cf8100340 2024-04-23T15:18:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.095+0000 7f6cf6000640 1 -- 172.21.15.7:0/2285425571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec018920 con 0x7f6cf8100340 2024-04-23T15:18:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.095+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a7810 con 0x7f6cf8100340 2024-04-23T15:18:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.099+0000 7f6d02d9e740 1 Processor -- start 2024-04-23T15:18:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.099+0000 7f6cf6000640 1 -- 172.21.15.7:0/2285425571 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6cec010a90 con 0x7f6cf8100340 2024-04-23T15:18:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.099+0000 7f6d02d9e740 1 -- start start 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.099+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691be590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.099+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55be69124900 con 0x55be691be1b0 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55be690caf20 con 0x55be691c9390 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55be691208c0 con 0x55be691bead0 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691be590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60960/0 (socket says 172.21.15.7:60960) 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 -- 172.21.15.7:0/416059858 learned_addr learned my addr 172.21.15.7:0/416059858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfca00640 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfd400640 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 -- 172.21.15.7:0/416059858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 msgr2=0x55be691c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 -- 172.21.15.7:0/416059858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 msgr2=0x55be691cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.100+0000 7f6cfde00640 1 -- 172.21.15.7:0/416059858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be690efe10 con 0x55be691be1b0 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.101+0000 7f6cf6000640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6ce00a3dc0 0x7f6ce00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.101+0000 7f6cfde00640 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691be590 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0035000 tx=0x7f6cf0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6985eb908842bdc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.101+0000 7f6cf6000640 1 -- 172.21.15.7:0/2285425571 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7f6cec0d1060 con 0x7f6cf8100340 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.101+0000 7f6cfd400640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6ce00a3dc0 0x7f6ce00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.101+0000 7f6cea600640 1 -- 172.21.15.7:0/416059858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0030620 con 0x55be691be1b0 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.102+0000 7f6cea600640 1 -- 172.21.15.7:0/416059858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cf0036040 con 0x55be691be1b0 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.102+0000 7f6cea600640 1 -- 172.21.15.7:0/416059858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0004380 con 0x55be691be1b0 2024-04-23T15:18:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.102+0000 7f6d02d9e740 1 -- 172.21.15.7:0/416059858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 msgr2=0x55be691be590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.102+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691be590 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0035000 tx=0x7f6cf0005ef0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.102+0000 7f6cfd400640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6ce00a3dc0 0x7f6ce00a6280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55be691bf750 tx=0x7f6cec000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 -- 172.21.15.7:0/416059858 shutdown_connections 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/416059858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691be590 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 -- 172.21.15.7:0/416059858 >> 172.21.15.7:0/416059858 conn(0x55be691ba6c0 msgr2=0x55be691baaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 -- 172.21.15.7:0/416059858 shutdown_connections 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 -- 172.21.15.7:0/416059858 wait complete. 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.103+0000 7f6d02d9e740 1 -- start start 2024-04-23T15:18:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 Processor -- start 2024-04-23T15:18:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55be691cbf60 con 0x55be691bead0 2024-04-23T15:18:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55be690de2c0 con 0x55be691c9390 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55be691cc0e0 con 0x55be691be1b0 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.104+0000 7f6d02d9e740 10 client.0 _ll_register_callbacks cb 0x55be68e36a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60962/0 (socket says 172.21.15.7:60962) 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 -- 172.21.15.7:0/646187389 learned_addr learned my addr 172.21.15.7:0/646187389 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfde00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfde00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 -- 172.21.15.7:0/646187389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 msgr2=0x55be691c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 -- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 msgr2=0x55be691c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 -- 172.21.15.7:0/646187389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be690eefd0 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfde00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cfca00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c6880 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4013490 tx=0x7f6ce4013950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbbceed3f2ece42 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.105+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.106+0000 7f6cdea00640 1 -- 172.21.15.7:0/646187389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4020060 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.106+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf0036040 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.106+0000 7f6cdea00640 1 -- 172.21.15.7:0/646187389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7f6ce4004460 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.106+0000 7f6cdea00640 1 -- 172.21.15.7:0/646187389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6ce4027050 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.106+0000 7f6d02d9e740 10 client.17829 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.106+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55be68e37210 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6cdea00640 1 -- 172.21.15.7:0/646187389 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cf0036040 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6cdea00640 1 -- 172.21.15.7:0/646187389 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6ce401a030 con 0x55be691bead0 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6d02d9e740 10 client.17829 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6d02d9e740 10 client.17829 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6d02d9e740 20 client.17829 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be691d9540 0x55be691db950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6d02d9e740 4 client.17829 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:18:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.107+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be69132320 con 0x55be691d9540 2024-04-23T15:18:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.108+0000 7f6cfde00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be691d9540 0x55be691db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.109+0000 7f6cfde00640 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be691d9540 0x55be691db950 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429c503d3e3fb38e server_cookie=29f5c026625decf8 in_seq=0 out_seq=0 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.109+0000 7f6cdea00640 10 client.17829 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6cdea00640 1 -- 172.21.15.7:0/646187389 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55be69132320 con 0x55be691d9540 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6cdea00640 10 client.17829 handle_command_reply: tid=0 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 client.17829 shutdown 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 msgr2=0x55be691c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c6880 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4013490 tx=0x7f6ce4013950 comp rx=0 tx=0).stop 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 shutdown_connections 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be691d9540 0x55be691db950 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c6880 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/646187389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 >> 172.21.15.7:0/646187389 conn(0x55be691ba6c0 msgr2=0x55be691c03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6cdea00640 0 client.17829 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 shutdown_connections 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.111+0000 7f6d02d9e740 1 -- 172.21.15.7:0/646187389 wait complete. 2024-04-23T15:18:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.112+0000 7f6d02d9e740 20 client.17829 trim_cache size 0 max 16384 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 Processor -- start 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 -- start start 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691e1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81b15f0 con 0x55be691bead0 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81b3130 con 0x55be691c9390 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.130+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81b1cc0 con 0x55be691be1b0 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60972/0 (socket says 172.21.15.7:60972) 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 -- 172.21.15.7:0/3763468589 learned_addr learned my addr 172.21.15.7:0/3763468589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfde00640 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfde00640 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 -- 172.21.15.7:0/3763468589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 msgr2=0x55be691d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691d4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 -- 172.21.15.7:0/3763468589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 msgr2=0x55be691e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691e1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.131+0000 7f6cfca00640 1 -- 172.21.15.7:0/3763468589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be691b5ea0 con 0x55be691bead0 2024-04-23T15:18:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.132+0000 7f6cfca00640 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c0b70 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400f470 tx=0x7f6ce4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd33eefae45c311 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.132+0000 7f6ce9c00640 1 -- 172.21.15.7:0/3763468589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4014e60 con 0x55be691bead0 2024-04-23T15:18:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.132+0000 7f6ce9c00640 1 -- 172.21.15.7:0/3763468589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ce4030070 con 0x55be691bead0 2024-04-23T15:18:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.132+0000 7f6ce9c00640 1 -- 172.21.15.7:0/3763468589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4003d50 con 0x55be691bead0 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 -- 172.21.15.7:0/3763468589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 msgr2=0x55be691c0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c0b70 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400f470 tx=0x7f6ce4011cb0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 -- 172.21.15.7:0/3763468589 shutdown_connections 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be691e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691bead0 0x55be691c0b70 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/3763468589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691be1b0 0x55be691d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 -- 172.21.15.7:0/3763468589 >> 172.21.15.7:0/3763468589 conn(0x55be691ba6c0 msgr2=0x55be691c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 -- 172.21.15.7:0/3763468589 shutdown_connections 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.133+0000 7f6d02d9e740 1 -- 172.21.15.7:0/3763468589 wait complete. 2024-04-23T15:18:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.134+0000 7f6d02d9e740 1 -- start start 2024-04-23T15:18:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.134+0000 7f6d02d9e740 1 Processor -- start 2024-04-23T15:18:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be69237b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81b2a60 con 0x55be691be1b0 2024-04-23T15:18:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81b2390 con 0x55be691c9390 2024-04-23T15:18:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81af5f0 con 0x55be691bead0 2024-04-23T15:18:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6d02d9e740 10 client.0 _ll_register_callbacks cb 0x7f6ce4009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60976/0 (socket says 172.21.15.7:60976) 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6cfde00640 1 -- 172.21.15.7:0/1015748667 learned_addr learned my addr 172.21.15.7:0/1015748667 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.135+0000 7f6cfca00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be69237b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 -- 172.21.15.7:0/1015748667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 msgr2=0x55be691ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 -- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 msgr2=0x55be69237b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be69237b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 -- 172.21.15.7:0/1015748667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be68f03620 con 0x55be691be1b0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cfde00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691cc5c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009430 tx=0x7f6ce4009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8419f2837756eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cdea00640 1 -- 172.21.15.7:0/1015748667 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf004a040 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6cdea00640 1 -- 172.21.15.7:0/1015748667 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7f6cf0003b70 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.136+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce4030070 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6cdea00640 1 -- 172.21.15.7:0/1015748667 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0003d70 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 10 client.17835 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55be6923f340 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6cdea00640 1 -- 172.21.15.7:0/1015748667 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ce4030070 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6cdea00640 1 -- 172.21.15.7:0/1015748667 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6cf00045f0 con 0x55be691be1b0 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 10 client.17835 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 10 client.17835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 20 client.17835 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be6923f6d0 0x55be69241ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 4 client.17835 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:18:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.137+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55be6912c190 con 0x55be6923f6d0 2024-04-23T15:18:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.138+0000 7f6cfca00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be6923f6d0 0x55be69241ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.139+0000 7f6cfca00640 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be6923f6d0 0x55be69241ac0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4996fda28970ca8e server_cookie=3a5b7199a99163ad in_seq=0 out_seq=0 2024-04-23T15:18:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.139+0000 7f6cdea00640 10 client.17835 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.179+0000 7f6cdea00640 1 -- 172.21.15.7:0/1015748667 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55be6912c190 con 0x55be6923f6d0 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.179+0000 7f6cdea00640 10 client.17835 handle_command_reply: tid=0 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.179+0000 7f6d02d9e740 1 client.17835 shutdown 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 msgr2=0x55be691cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691cc5c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009430 tx=0x7f6ce4009b90 comp rx=0 tx=0).stop 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 shutdown_connections 2024-04-23T15:18:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55be6923f6d0 0x55be69241ac0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be691c9390 0x55be69237b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55be691bead0 0x55be691ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 --2- 172.21.15.7:0/1015748667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be691be1b0 0x55be691cc5c0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 >> 172.21.15.7:0/1015748667 conn(0x55be691ba6c0 msgr2=0x55be691b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6cdea00640 0 client.17835 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 shutdown_connections 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 1 -- 172.21.15.7:0/1015748667 wait complete. 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.180+0000 7f6d02d9e740 20 client.17835 trim_cache size 0 max 16384 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:18:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:18:20.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:18:20.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:18:20.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.181+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6ce00a3dc0 msgr2=0x7f6ce00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.181+0000 7f6cffe00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6ce00a3dc0 0x7f6ce00a6280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55be691bf750 tx=0x7f6cec000bc0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.181+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 msgr2=0x7f6cf81a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.181+0000 7f6cffe00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 0x7f6cf81a0670 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00e9f0 tx=0x7f6cec00eeb0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 shutdown_connections 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f6ce00a3dc0 0x7f6ce00a6280 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf810a850 0x7f6cf81a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cf819a730 0x7f6cf819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 --2- 172.21.15.7:0/2285425571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6cf8100340 0x7f6cf81a0670 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 >> 172.21.15.7:0/2285425571 conn(0x7f6cf8077000 msgr2=0x7f6cf8108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 shutdown_connections 2024-04-23T15:18:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:20.182+0000 7f6cffe00640 1 -- 172.21.15.7:0/2285425571 wait complete. 2024-04-23T15:18:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:20 smithi007 ceph-mon[27906]: pgmap v852: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 18 op/s 2024-04-23T15:18:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:20 smithi186 ceph-mon[31814]: pgmap v852: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 18 op/s 2024-04-23T15:18:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:20 smithi137 ceph-mon[31694]: pgmap v852: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 18 op/s 2024-04-23T15:18:23.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:22 smithi007 ceph-mon[27906]: pgmap v853: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.9 MiB/s wr, 18 op/s 2024-04-23T15:18:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:22 smithi186 ceph-mon[31814]: pgmap v853: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.9 MiB/s wr, 18 op/s 2024-04-23T15:18:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:22 smithi137 ceph-mon[31694]: pgmap v853: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.9 MiB/s wr, 18 op/s 2024-04-23T15:18:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:24 smithi007 ceph-mon[27906]: pgmap v854: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 23 op/s 2024-04-23T15:18:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:24 smithi186 ceph-mon[31814]: pgmap v854: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 23 op/s 2024-04-23T15:18:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:24 smithi137 ceph-mon[31694]: pgmap v854: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 23 op/s 2024-04-23T15:18:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:26 smithi186 ceph-mon[31814]: pgmap v855: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:18:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:26 smithi137 ceph-mon[31694]: pgmap v855: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:18:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:26 smithi007 ceph-mon[27906]: pgmap v855: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:18:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:28 smithi186 ceph-mon[31814]: pgmap v856: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:18:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:28 smithi137 ceph-mon[31694]: pgmap v856: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:18:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:28 smithi007 ceph-mon[27906]: pgmap v856: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:18:31.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:30 smithi186 ceph-mon[31814]: pgmap v857: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:18:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:30 smithi137 ceph-mon[31694]: pgmap v857: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:18:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:30 smithi007 ceph-mon[27906]: pgmap v857: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:18:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:32 smithi186 ceph-mon[31814]: pgmap v858: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:18:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:32 smithi137 ceph-mon[31694]: pgmap v858: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:18:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:32 smithi007 ceph-mon[27906]: pgmap v858: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 -- 172.21.15.7:0/2148110303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 msgr2=0x7fa9d8101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 --2- 172.21.15.7:0/2148110303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d8101190 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009900 tx=0x7fa9c802a470 comp rx=0 tx=0).stop 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 -- 172.21.15.7:0/2148110303 shutdown_connections 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 --2- 172.21.15.7:0/2148110303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 0x7fa9d8106640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 --2- 172.21.15.7:0/2148110303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9d81016d0 0x7fa9d8105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 --2- 172.21.15.7:0/2148110303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d8101190 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 -- 172.21.15.7:0/2148110303 >> 172.21.15.7:0/2148110303 conn(0x7fa9d80fc820 msgr2=0x7fa9d80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 -- 172.21.15.7:0/2148110303 shutdown_connections 2024-04-23T15:18:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.336+0000 7fa9dda00640 1 -- 172.21.15.7:0/2148110303 wait complete. 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.337+0000 7fa9dda00640 1 Processor -- start 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.337+0000 7fa9dda00640 1 -- start start 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9dda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d81a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9dda00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9d81016d0 0x7fa9d81a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9dda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 0x7fa9d819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9dda00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81186b0 con 0x7fa9d8100db0 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9dda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8118530 con 0x7fa9d81061b0 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9dda00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8118830 con 0x7fa9d81016d0 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d81a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d81a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55166/0 (socket says 172.21.15.7:55166) 2024-04-23T15:18:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.338+0000 7fa9d7e00640 1 -- 172.21.15.7:0/686224525 learned_addr learned my addr 172.21.15.7:0/686224525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9dd000640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 0x7fa9d819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9d81016d0 0x7fa9d81a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9d7e00640 1 -- 172.21.15.7:0/686224525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9d81016d0 msgr2=0x7fa9d81a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9d81016d0 0x7fa9d81a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9d7e00640 1 -- 172.21.15.7:0/686224525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 msgr2=0x7fa9d819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 0x7fa9d819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9d7e00640 1 -- 172.21.15.7:0/686224525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d819f150 con 0x7fa9d8100db0 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9dd000640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 0x7fa9d819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.339+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d81a4820 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005ab0 tx=0x7fa9c8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.340+0000 7fa9d5600640 1 -- 172.21.15.7:0/686224525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c803f070 con 0x7fa9d8100db0 2024-04-23T15:18:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.340+0000 7fa9d5600640 1 -- 172.21.15.7:0/686224525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c8031d60 con 0x7fa9d8100db0 2024-04-23T15:18:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.340+0000 7fa9d5600640 1 -- 172.21.15.7:0/686224525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8035030 con 0x7fa9d8100db0 2024-04-23T15:18:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.340+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d819f3e0 con 0x7fa9d8100db0 2024-04-23T15:18:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.340+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d81ab6e0 con 0x7fa9d8100db0 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.344+0000 7fa9e1d89740 1 Processor -- start 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.344+0000 7fa9e1d89740 1 -- start start 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.344+0000 7fa9d5600640 1 -- 172.21.15.7:0/686224525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa9c8042070 con 0x7fa9d8100db0 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79a1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79a15a0 0x5612a79a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5612a78fc900 con 0x5612a7996ce0 2024-04-23T15:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5612a78a2f20 con 0x5612a79963c0 2024-04-23T15:18:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5612a78f88c0 con 0x5612a79a15a0 2024-04-23T15:18:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79a1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55176/0 (socket says 172.21.15.7:55176) 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9d7e00640 1 -- 172.21.15.7:0/1478545108 learned_addr learned my addr 172.21.15.7:0/1478545108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9dd000640 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.345+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79a15a0 0x5612a79a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d7e00640 1 -- 172.21.15.7:0/1478545108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79a15a0 msgr2=0x5612a79a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79a15a0 0x5612a79a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d7e00640 1 -- 172.21.15.7:0/1478545108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 msgr2=0x5612a79967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d7e00640 1 -- 172.21.15.7:0/1478545108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a78c7e10 con 0x5612a7996ce0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9dd000640 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79a1060 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80ee480 tx=0x7fa9c80f9490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e533e0454cc5e02f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.346+0000 7fa9d5600640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9bc0a3d90 0x7fa9bc0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.347+0000 7fa9d5600640 1 -- 172.21.15.7:0/686224525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7fa9c80f1170 con 0x7fa9d8100db0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.347+0000 7fa9dd000640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9bc0a3d90 0x7fa9bc0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.347+0000 7fa9cd600640 1 -- 172.21.15.7:0/1478545108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80b9000 con 0x5612a7996ce0 2024-04-23T15:18:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.347+0000 7fa9cd600640 1 -- 172.21.15.7:0/1478545108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c80fe030 con 0x5612a7996ce0 2024-04-23T15:18:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.347+0000 7fa9cd600640 1 -- 172.21.15.7:0/1478545108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80bc6c0 con 0x5612a7996ce0 2024-04-23T15:18:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1478545108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 msgr2=0x5612a79a1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9dd000640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9bc0a3d90 0x7fa9bc0a6250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0005fd0 tx=0x7fa9d0009990 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79a1060 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80ee480 tx=0x7fa9c80f9490 comp rx=0 tx=0).stop 2024-04-23T15:18:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1478545108 shutdown_connections 2024-04-23T15:18:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79a15a0 0x5612a79a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79a1060 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1478545108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1478545108 >> 172.21.15.7:0/1478545108 conn(0x5612a79928d0 msgr2=0x5612a7992cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1478545108 shutdown_connections 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.348+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1478545108 wait complete. 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 -- start start 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 Processor -- start 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 0x5612a799e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a799f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5612a79a3f90 con 0x5612a79963c0 2024-04-23T15:18:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5612a78b62c0 con 0x5612a79a15a0 2024-04-23T15:18:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5612a79a4110 con 0x5612a7996ce0 2024-04-23T15:18:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.349+0000 7fa9e1d89740 10 client.0 _ll_register_callbacks cb 0x5612a760ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 0x5612a799e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 0x5612a799e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55182/0 (socket says 172.21.15.7:55182) 2024-04-23T15:18:33.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 -- 172.21.15.7:0/2430426845 learned_addr learned my addr 172.21.15.7:0/2430426845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9dd000640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a799f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 -- 172.21.15.7:0/2430426845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 msgr2=0x5612a799eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 -- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 msgr2=0x5612a799f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a799f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 -- 172.21.15.7:0/2430426845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a78c6fd0 con 0x5612a79963c0 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9dd000640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a799f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.350+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 0x5612a799e580 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80c54a0 tx=0x7fa9c8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7754a6ecd01be95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9c6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9c6000640 1 -- 172.21.15.7:0/2430426845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8049070 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9c6000640 1 -- 172.21.15.7:0/2430426845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7fa9c80ee790 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c80fe030 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9c6000640 1 -- 172.21.15.7:0/2430426845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa9c80bc8a0 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9e1d89740 10 client.17847 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5612a760f210 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.351+0000 7fa9c6000640 1 -- 172.21.15.7:0/2430426845 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c80fe030 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9c6000640 1 -- 172.21.15.7:0/2430426845 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa9c804c060 con 0x5612a79963c0 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9e1d89740 10 client.17847 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9e1d89740 10 client.17847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9e1d89740 20 client.17847 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a79b12f0 0x5612a79b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9e1d89740 4 client.17847 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:18:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612a790a320 con 0x5612a79b12f0 2024-04-23T15:18:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.352+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a79b12f0 0x5612a79b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.354+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a79b12f0 0x5612a79b36e0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bd216e9cc7624e5 server_cookie=69bcc31ea86ab705 in_seq=0 out_seq=0 2024-04-23T15:18:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.354+0000 7fa9c6000640 10 client.17847 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.355+0000 7fa9c6000640 1 -- 172.21.15.7:0/2430426845 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5612a790a320 con 0x5612a79b12f0 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.355+0000 7fa9c6000640 10 client.17847 handle_command_reply: tid=0 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.355+0000 7fa9e1d89740 1 client.17847 shutdown 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 msgr2=0x5612a799e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 0x5612a799e580 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80c54a0 tx=0x7fa9c8009260 comp rx=0 tx=0).stop 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 shutdown_connections 2024-04-23T15:18:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a79b12f0 0x5612a79b36e0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a799f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2430426845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79963c0 0x5612a799e580 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 >> 172.21.15.7:0/2430426845 conn(0x5612a79928d0 msgr2=0x5612a7998650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9c6000640 0 client.17847 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 shutdown_connections 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2430426845 wait complete. 2024-04-23T15:18:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.356+0000 7fa9e1d89740 20 client.17847 trim_cache size 0 max 16384 2024-04-23T15:18:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 Processor -- start 2024-04-23T15:18:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 -- start start 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79963c0 0x5612a7998d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a79b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81b57f0 con 0x5612a7996ce0 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81b7330 con 0x5612a79a15a0 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.373+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81b5ec0 con 0x5612a79963c0 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55198/0 (socket says 172.21.15.7:55198) 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 -- 172.21.15.7:0/1571163165 learned_addr learned my addr 172.21.15.7:0/1571163165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79963c0 0x5612a7998d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 -- 172.21.15.7:0/1571163165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79963c0 msgr2=0x5612a7998d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79963c0 0x5612a7998d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 -- 172.21.15.7:0/1571163165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 msgr2=0x5612a79b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a79b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 -- 172.21.15.7:0/1571163165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a798e000 con 0x5612a7996ce0 2024-04-23T15:18:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.374+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79acb80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0005e10 tx=0x7fa9c0005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264ee442f19ceef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.375+0000 7fa9ccc00640 1 -- 172.21.15.7:0/1571163165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c001f020 con 0x5612a7996ce0 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.375+0000 7fa9ccc00640 1 -- 172.21.15.7:0/1571163165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c0012e10 con 0x5612a7996ce0 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.375+0000 7fa9ccc00640 1 -- 172.21.15.7:0/1571163165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0011d90 con 0x5612a7996ce0 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.375+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1571163165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 msgr2=0x5612a79acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.375+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79acb80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0005e10 tx=0x7fa9c0005870 comp rx=0 tx=0).stop 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1571163165 shutdown_connections 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79a15a0 0x5612a79b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a7996ce0 0x5612a79acb80 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/1571163165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a79963c0 0x5612a7998d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1571163165 >> 172.21.15.7:0/1571163165 conn(0x5612a79928d0 msgr2=0x5612a7991a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1571163165 shutdown_connections 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 -- 172.21.15.7:0/1571163165 wait complete. 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 -- start start 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.376+0000 7fa9e1d89740 1 Processor -- start 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 0x5612a799b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81b6c60 con 0x5612a79a15a0 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81b6590 con 0x5612a79963c0 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81b37f0 con 0x5612a7996ce0 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9e1d89740 10 client.0 _ll_register_callbacks cb 0x7fa9c80f4f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9dd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 0x5612a799b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9dd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 0x5612a799b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55212/0 (socket says 172.21.15.7:55212) 2024-04-23T15:18:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.377+0000 7fa9dd000640 1 -- 172.21.15.7:0/2623271324 learned_addr learned my addr 172.21.15.7:0/2623271324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9cfe00640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9dd000640 1 -- 172.21.15.7:0/2623271324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 msgr2=0x5612a799b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9dd000640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9dd000640 1 -- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 msgr2=0x5612a79a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9dd000640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9dd000640 1 -- 172.21.15.7:0/2623271324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a76db620 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9dd000640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 0x5612a799b550 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00095f0 tx=0x7fa9d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdc059f847c999c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9c6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.378+0000 7fa9c6000640 1 -- 172.21.15.7:0/2623271324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00109e0 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c0012e10 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9c6000640 1 -- 172.21.15.7:0/2623271324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7fa9d0010b80 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9c6000640 1 -- 172.21.15.7:0/2623271324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa9d0033050 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9e1d89740 10 client.17853 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5612a7a17360 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9c6000640 1 -- 172.21.15.7:0/2623271324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c0012e10 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.379+0000 7fa9c6000640 1 -- 172.21.15.7:0/2623271324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa9d000f040 con 0x5612a79a15a0 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9e1d89740 10 client.17853 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9e1d89740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9e1d89740 20 client.17853 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a7a17b60 0x5612a7a19f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9e1d89740 4 client.17853 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612a7904190 con 0x5612a7a17b60 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.380+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a7a17b60 0x5612a7a19f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.381+0000 7fa9d7e00640 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a7a17b60 0x5612a7a19f80 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2b30cf1e7656f8 server_cookie=2097dff92383cdb5 in_seq=0 out_seq=0 2024-04-23T15:18:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.381+0000 7fa9c6000640 10 client.17853 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.416+0000 7fa9c6000640 1 -- 172.21.15.7:0/2623271324 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5612a7904190 con 0x5612a7a17b60 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.416+0000 7fa9c6000640 10 client.17853 handle_command_reply: tid=0 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.416+0000 7fa9e1d89740 1 client.17853 shutdown 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.416+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 msgr2=0x5612a799b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.416+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 0x5612a799b550 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00095f0 tx=0x7fa9d0004ab0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 shutdown_connections 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5612a7a17b60 0x5612a7a19f80 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5612a79a15a0 0x5612a799b550 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5612a7996ce0 0x5612a799b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 --2- 172.21.15.7:0/2623271324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612a79963c0 0x5612a79a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9c6000640 0 client.17853 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 >> 172.21.15.7:0/2623271324 conn(0x5612a79928d0 msgr2=0x5612a7991200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 shutdown_connections 2024-04-23T15:18:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 1 -- 172.21.15.7:0/2623271324 wait complete. 2024-04-23T15:18:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.417+0000 7fa9e1d89740 20 client.17853 trim_cache size 0 max 16384 2024-04-23T15:18:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:18:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:18:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:18:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9bc0a3d90 msgr2=0x7fa9bc0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9bc0a3d90 0x7fa9bc0a6250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0005fd0 tx=0x7fa9d0009990 comp rx=0 tx=0).stop 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 msgr2=0x7fa9d81a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d81a4820 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005ab0 tx=0x7fa9c8003cd0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 shutdown_connections 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9bc0a3d90 0x7fa9bc0a6250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d81061b0 0x7fa9d819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9d81016d0 0x7fa9d81a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 --2- 172.21.15.7:0/686224525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9d8100db0 0x7fa9d81a4820 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.418+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 >> 172.21.15.7:0/686224525 conn(0x7fa9d80fc820 msgr2=0x7fa9d80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.419+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 shutdown_connections 2024-04-23T15:18:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:33.419+0000 7fa9dda00640 1 -- 172.21.15.7:0/686224525 wait complete. 2024-04-23T15:18:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:34 smithi137 ceph-mon[31694]: pgmap v859: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:34 smithi007 ceph-mon[27906]: pgmap v859: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:34 smithi186 ceph-mon[31814]: pgmap v859: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:37.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:36 smithi186 ceph-mon[31814]: pgmap v860: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:18:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:36 smithi137 ceph-mon[31694]: pgmap v860: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:18:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:36 smithi007 ceph-mon[27906]: pgmap v860: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:18:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:38 smithi137 ceph-mon[31694]: pgmap v861: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:38 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:18:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:38 smithi007 ceph-mon[27906]: pgmap v861: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:38 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:18:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:38 smithi186 ceph-mon[31814]: pgmap v861: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:38 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:18:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:40 smithi137 ceph-mon[31694]: pgmap v862: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:18:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:40 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:18:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:40 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:18:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:40 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:18:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:40 smithi007 ceph-mon[27906]: pgmap v862: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:18:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:40 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:18:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:40 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:18:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:40 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:18:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:40 smithi186 ceph-mon[31814]: pgmap v862: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:18:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:40 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:18:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:40 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:18:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:40 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:18:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:42 smithi137 ceph-mon[31694]: pgmap v863: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:18:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:42 smithi007 ceph-mon[27906]: pgmap v863: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:18:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:42 smithi186 ceph-mon[31814]: pgmap v863: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:18:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:44 smithi137 ceph-mon[31694]: pgmap v864: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:18:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:44 smithi007 ceph-mon[27906]: pgmap v864: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:18:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:44 smithi186 ceph-mon[31814]: pgmap v864: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:18:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 -- 172.21.15.7:0/2529924007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 msgr2=0x7fbb1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2529924007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1810ea90 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009ca0 tx=0x7fbb1002a950 comp rx=0 tx=0).stop 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 -- 172.21.15.7:0/2529924007 shutdown_connections 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2529924007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 0x7fbb1810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2529924007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1810ea90 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2529924007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb18103290 0x7fbb18103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 -- 172.21.15.7:0/2529924007 >> 172.21.15.7:0/2529924007 conn(0x7fbb18078010 msgr2=0x7fbb18078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 -- 172.21.15.7:0/2529924007 shutdown_connections 2024-04-23T15:18:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.584+0000 7fbb1f600640 1 -- 172.21.15.7:0/2529924007 wait complete. 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 Processor -- start 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 -- start start 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb18103290 0x7fbb181a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 0x7fbb181a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18112280 con 0x7fbb1810c660 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18112100 con 0x7fbb18103bb0 2024-04-23T15:18:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.586+0000 7fbb1f600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18112400 con 0x7fbb18103290 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40842/0 (socket says 172.21.15.7:40842) 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 -- 172.21.15.7:0/2944029640 learned_addr learned my addr 172.21.15.7:0/2944029640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb18103290 0x7fbb181a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb17e00640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 0x7fbb181a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 -- 172.21.15.7:0/2944029640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb18103290 msgr2=0x7fbb181a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb18103290 0x7fbb181a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 -- 172.21.15.7:0/2944029640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 msgr2=0x7fbb181a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 0x7fbb181a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb1d600640 1 -- 172.21.15.7:0/2944029640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1819af50 con 0x7fbb1810c660 2024-04-23T15:18:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.587+0000 7fbb17e00640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 0x7fbb181a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:18:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.588+0000 7fbb1d600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1819a780 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbb10004af0 tx=0x7fbb1002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.588+0000 7fbb15600640 1 -- 172.21.15.7:0/2944029640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10034040 con 0x7fbb1810c660 2024-04-23T15:18:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.588+0000 7fbb15600640 1 -- 172.21.15.7:0/2944029640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb1002fe80 con 0x7fbb1810c660 2024-04-23T15:18:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.588+0000 7fbb15600640 1 -- 172.21.15.7:0/2944029640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10004670 con 0x7fbb1810c660 2024-04-23T15:18:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.588+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1819b1e0 con 0x7fbb1810c660 2024-04-23T15:18:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.588+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb181a7460 con 0x7fbb1810c660 2024-04-23T15:18:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.592+0000 7fbb22398740 1 Processor -- start 2024-04-23T15:18:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.592+0000 7fbb15600640 1 -- 172.21.15.7:0/2944029640 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbb10037020 con 0x7fbb1810c660 2024-04-23T15:18:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.592+0000 7fbb22398740 1 -- start start 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb22398740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c131b0 0x55ad28c13590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb22398740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c13ad0 0x55ad28c1de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb22398740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c20780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb22398740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ad28b79900 con 0x55ad28c1e390 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb22398740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ad28b1ff20 con 0x55ad28c131b0 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb22398740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ad28b758c0 con 0x55ad28c13ad0 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c20780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c20780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40850/0 (socket says 172.21.15.7:40850) 2024-04-23T15:18:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb17e00640 1 -- 172.21.15.7:0/1526456499 learned_addr learned my addr 172.21.15.7:0/1526456499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.593+0000 7fbb17e00640 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c131b0 0x55ad28c13590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c13ad0 0x55ad28c1de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb15600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb000a3e40 0x7fbb000a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb17e00640 1 -- 172.21.15.7:0/1526456499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c13ad0 msgr2=0x55ad28c1de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb17e00640 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c13ad0 0x55ad28c1de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb17e00640 1 -- 172.21.15.7:0/1526456499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c131b0 msgr2=0x55ad28c13590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb17e00640 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c131b0 0x55ad28c13590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb17e00640 1 -- 172.21.15.7:0/1526456499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad28b44e10 con 0x55ad28c1e390 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb15600640 1 -- 172.21.15.7:0/2944029640 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7fbb100f1940 con 0x7fbb1810c660 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.594+0000 7fbb1d600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb000a3e40 0x7fbb000a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.595+0000 7fbb17e00640 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c20780 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbb040149b0 tx=0x7fbb0400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a20485c325cad1a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.595+0000 7fbb09c00640 1 -- 172.21.15.7:0/1526456499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb040142d0 con 0x55ad28c1e390 2024-04-23T15:18:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.595+0000 7fbb09c00640 1 -- 172.21.15.7:0/1526456499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb0400f760 con 0x55ad28c1e390 2024-04-23T15:18:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.595+0000 7fbb09c00640 1 -- 172.21.15.7:0/1526456499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04003850 con 0x55ad28c1e390 2024-04-23T15:18:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 -- 172.21.15.7:0/1526456499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 msgr2=0x55ad28c20780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb1d600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb000a3e40 0x7fbb000a6300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbb100c5d60 tx=0x7fbb100093d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c20780 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbb040149b0 tx=0x7fbb0400c4d0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 -- 172.21.15.7:0/1526456499 shutdown_connections 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c20780 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c13ad0 0x55ad28c1de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 --2- 172.21.15.7:0/1526456499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c131b0 0x55ad28c13590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 -- 172.21.15.7:0/1526456499 >> 172.21.15.7:0/1526456499 conn(0x55ad28c0f6c0 msgr2=0x55ad28c0faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 -- 172.21.15.7:0/1526456499 shutdown_connections 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.596+0000 7fbb22398740 1 -- 172.21.15.7:0/1526456499 wait complete. 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 -- start start 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 Processor -- start 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c1b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 0x55ad28c1b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c1e390 0x55ad28c1bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ad28c20f60 con 0x55ad28c13ad0 2024-04-23T15:18:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ad28b332c0 con 0x55ad28c1e390 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.597+0000 7fbb22398740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ad28c210e0 con 0x55ad28c131b0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb22398740 10 client.0 _ll_register_callbacks cb 0x55ad2888ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 0x55ad28c1b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 0x55ad28c1b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40860/0 (socket says 172.21.15.7:40860) 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 -- 172.21.15.7:0/3123214664 learned_addr learned my addr 172.21.15.7:0/3123214664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c1b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c1e390 0x55ad28c1bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 -- 172.21.15.7:0/3123214664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 msgr2=0x55ad28c1b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c1b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 -- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c1e390 msgr2=0x55ad28c1bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c1e390 0x55ad28c1bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb1cc00640 1 -- 172.21.15.7:0/3123214664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad28b43fd0 con 0x55ad28c13ad0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.598+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c1e390 0x55ad28c1bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 0x55ad28c1b8a0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c012740 tx=0x7fbb0c012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2785cca2e49fb3d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbafe000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbafe000640 1 -- 172.21.15.7:0/3123214664 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00f920 con 0x55ad28c13ad0 2024-04-23T15:18:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb0400f760 con 0x55ad28c13ad0 2024-04-23T15:18:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbafe000640 1 -- 172.21.15.7:0/3123214664 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7fbb0c00fac0 con 0x55ad28c13ad0 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbafe000640 1 -- 172.21.15.7:0/3123214664 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbb0c00fcc0 con 0x55ad28c13ad0 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbb22398740 10 client.17865 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.599+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ad2888c210 con 0x55ad28c13ad0 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbafe000640 1 -- 172.21.15.7:0/3123214664 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb0400f760 con 0x55ad28c13ad0 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbafe000640 1 -- 172.21.15.7:0/3123214664 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbb0c01c420 con 0x55ad28c13ad0 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbb22398740 10 client.17865 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbb22398740 10 client.17865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbb22398740 20 client.17865 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbb22398740 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c2e5c0 0x55ad28c309b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbb22398740 4 client.17865 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:18:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.600+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad28b87320 con 0x55ad28c2e5c0 2024-04-23T15:18:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.601+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c2e5c0 0x55ad28c309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.602+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c2e5c0 0x55ad28c309b0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=204b7c247658f2d4 server_cookie=3672cacd7af6830d in_seq=0 out_seq=0 2024-04-23T15:18:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.602+0000 7fbafe000640 10 client.17865 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.603+0000 7fbafe000640 1 -- 172.21.15.7:0/3123214664 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ad28b87320 con 0x55ad28c2e5c0 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.603+0000 7fbafe000640 10 client.17865 handle_command_reply: tid=0 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.603+0000 7fbb22398740 1 client.17865 shutdown 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 msgr2=0x55ad28c1b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 0x55ad28c1b8a0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c012740 tx=0x7fbb0c012c00 comp rx=0 tx=0).stop 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 shutdown_connections 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c2e5c0 0x55ad28c309b0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c1e390 0x55ad28c1bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c13ad0 0x55ad28c1b8a0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 --2- 172.21.15.7:0/3123214664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c1b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 >> 172.21.15.7:0/3123214664 conn(0x55ad28c0f6c0 msgr2=0x55ad28c153f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbafe000640 0 client.17865 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 shutdown_connections 2024-04-23T15:18:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 1 -- 172.21.15.7:0/3123214664 wait complete. 2024-04-23T15:18:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.604+0000 7fbb22398740 20 client.17865 trim_cache size 0 max 16384 2024-04-23T15:18:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 Processor -- start 2024-04-23T15:18:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 -- start start 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 0x55ad28c29e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c15b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c1e390 0x55ad28c0e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b14e0 con 0x55ad28c131b0 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b3020 con 0x55ad28c13ad0 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.621+0000 7fbb22398740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b1bb0 con 0x55ad28c1e390 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 0x55ad28c29e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 0x55ad28c29e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40874/0 (socket says 172.21.15.7:40874) 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 -- 172.21.15.7:0/3121477349 learned_addr learned my addr 172.21.15.7:0/3121477349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c15b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 -- 172.21.15.7:0/3121477349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c1e390 msgr2=0x55ad28c0e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c1e390 0x55ad28c0e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 -- 172.21.15.7:0/3121477349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 msgr2=0x55ad28c15b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c15b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.622+0000 7fbb17e00640 1 -- 172.21.15.7:0/3121477349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad28c0aea0 con 0x55ad28c131b0 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.623+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 0x55ad28c29e20 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbb040149b0 tx=0x7fbb0400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea0bccb5b1378dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.623+0000 7fbb09200640 1 -- 172.21.15.7:0/3121477349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0402e070 con 0x55ad28c131b0 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.623+0000 7fbb09200640 1 -- 172.21.15.7:0/3121477349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb04025070 con 0x55ad28c131b0 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.623+0000 7fbb09200640 1 -- 172.21.15.7:0/3121477349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04028290 con 0x55ad28c131b0 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 -- 172.21.15.7:0/3121477349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 msgr2=0x55ad28c29e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 0x55ad28c29e20 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbb040149b0 tx=0x7fbb0400c4d0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 -- 172.21.15.7:0/3121477349 shutdown_connections 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c15b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c1e390 0x55ad28c0e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 --2- 172.21.15.7:0/3121477349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c131b0 0x55ad28c29e20 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 -- 172.21.15.7:0/3121477349 >> 172.21.15.7:0/3121477349 conn(0x55ad28c0f6c0 msgr2=0x55ad28c0dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 -- 172.21.15.7:0/3121477349 shutdown_connections 2024-04-23T15:18:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.624+0000 7fbb22398740 1 -- 172.21.15.7:0/3121477349 wait complete. 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 -- start start 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 Processor -- start 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c26640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c219b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b2950 con 0x55ad28c1e390 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b2280 con 0x55ad28c13ad0 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181af4e0 con 0x55ad28c131b0 2024-04-23T15:18:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.625+0000 7fbb22398740 10 client.0 _ll_register_callbacks cb 0x7fbb0c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c21ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40888/0 (socket says 172.21.15.7:40888) 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 -- 172.21.15.7:0/3611129802 learned_addr learned my addr 172.21.15.7:0/3611129802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c26640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 -- 172.21.15.7:0/3611129802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 msgr2=0x55ad28c26640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c26640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 -- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 msgr2=0x55ad28c219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.626+0000 7fbb17e00640 1 -- 172.21.15.7:0/3611129802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad28958620 con 0x55ad28c1e390 2024-04-23T15:18:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.627+0000 7fbb17e00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c21ef0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbb040057a0 tx=0x7fbb04005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a637023c3219599 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.627+0000 7fbafe000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.627+0000 7fbafe000640 1 -- 172.21.15.7:0/3611129802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0402e020 con 0x55ad28c1e390 2024-04-23T15:18:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.627+0000 7fbafe000640 1 -- 172.21.15.7:0/3611129802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7fbb0400f730 con 0x55ad28c1e390 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.627+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb04025070 con 0x55ad28c1e390 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbafe000640 1 -- 172.21.15.7:0/3611129802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbb0400f930 con 0x55ad28c1e390 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbb22398740 10 client.17871 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ad28c948c0 con 0x55ad28c1e390 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbafe000640 1 -- 172.21.15.7:0/3611129802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb04025070 con 0x55ad28c1e390 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbafe000640 1 -- 172.21.15.7:0/3611129802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbb04003c90 con 0x55ad28c1e390 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbb22398740 10 client.17871 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbb22398740 10 client.17871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbb22398740 20 client.17871 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.628+0000 7fbb22398740 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c94d10 0x55ad28c97130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.629+0000 7fbb22398740 4 client.17871 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:18:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.629+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad28b81190 con 0x55ad28c94d10 2024-04-23T15:18:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.629+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c94d10 0x55ad28c97130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.630+0000 7fbb1cc00640 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c94d10 0x55ad28c97130 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb7c1100ae95cb5 server_cookie=7dcd3c186315b1de in_seq=0 out_seq=0 2024-04-23T15:18:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.630+0000 7fbafe000640 10 client.17871 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.661+0000 7fbafe000640 1 -- 172.21.15.7:0/3611129802 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad28b81190 con 0x55ad28c94d10 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.661+0000 7fbafe000640 10 client.17871 handle_command_reply: tid=0 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.661+0000 7fbb22398740 1 client.17871 shutdown 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 msgr2=0x55ad28c21ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c21ef0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbb040057a0 tx=0x7fbb04005d10 comp rx=0 tx=0).stop 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 shutdown_connections 2024-04-23T15:18:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ad28c94d10 0x55ad28c97130 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ad28c13ad0 0x55ad28c219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ad28c1e390 0x55ad28c21ef0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbafe000640 0 client.17871 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 --2- 172.21.15.7:0/3611129802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad28c131b0 0x55ad28c26640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 >> 172.21.15.7:0/3611129802 conn(0x55ad28c0f6c0 msgr2=0x55ad28c0e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 shutdown_connections 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.662+0000 7fbb22398740 1 -- 172.21.15.7:0/3611129802 wait complete. 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.663+0000 7fbb22398740 20 client.17871 trim_cache size 0 max 16384 2024-04-23T15:18:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.663+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb000a3e40 msgr2=0x7fbb000a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.663+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb000a3e40 0x7fbb000a6300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbb100c5d60 tx=0x7fbb100093d0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.663+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 msgr2=0x7fbb1819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.663+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1819a780 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbb10004af0 tx=0x7fbb1002f5d0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 shutdown_connections 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb000a3e40 0x7fbb000a6300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb18103bb0 0x7fbb181a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb1810c660 0x7fbb1819a780 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 --2- 172.21.15.7:0/2944029640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb18103290 0x7fbb181a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 >> 172.21.15.7:0/2944029640 conn(0x7fbb18078010 msgr2=0x7fbb181084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 shutdown_connections 2024-04-23T15:18:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:46.664+0000 7fbb1f600640 1 -- 172.21.15.7:0/2944029640 wait complete. 2024-04-23T15:18:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:46 smithi137 ceph-mon[31694]: pgmap v865: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:46 smithi007 ceph-mon[27906]: pgmap v865: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:18:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:46 smithi186 ceph-mon[31814]: pgmap v865: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:18:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:48 smithi137 ceph-mon[31694]: pgmap v866: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:49.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:48 smithi007 ceph-mon[27906]: pgmap v866: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:48 smithi186 ceph-mon[31814]: pgmap v866: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:51.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:50 smithi007 ceph-mon[27906]: pgmap v867: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:18:51.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:50 smithi186 ceph-mon[31814]: pgmap v867: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:18:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:50 smithi137 ceph-mon[31694]: pgmap v867: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:18:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:52 smithi007 ceph-mon[27906]: pgmap v868: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:18:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:52 smithi186 ceph-mon[31814]: pgmap v868: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:18:53.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:52 smithi137 ceph-mon[31694]: pgmap v868: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:18:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:54 smithi007 ceph-mon[27906]: pgmap v869: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:54 smithi186 ceph-mon[31814]: pgmap v869: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:54 smithi137 ceph-mon[31694]: pgmap v869: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:18:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:56 smithi007 ceph-mon[27906]: pgmap v870: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:18:57.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:56 smithi186 ceph-mon[31814]: pgmap v870: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:18:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:56 smithi137 ceph-mon[31694]: pgmap v870: 129 pgs: 129 active+clean; 7.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:18:58.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:18:57 smithi007 ceph-mon[27906]: pgmap v871: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:58.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:18:57 smithi186 ceph-mon[31814]: pgmap v871: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:58.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:18:57 smithi137 ceph-mon[31694]: pgmap v871: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:18:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 -- 172.21.15.7:0/4145760648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f4410c3e0 msgr2=0x7f5f4410e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 --2- 172.21.15.7:0/4145760648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f4410c3e0 0x7f5f4410e880 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009900 tx=0x7f5f3c02a480 comp rx=0 tx=0).stop 2024-04-23T15:18:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 -- 172.21.15.7:0/4145760648 shutdown_connections 2024-04-23T15:18:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 --2- 172.21.15.7:0/4145760648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f4410c3e0 0x7f5f4410e880 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 --2- 172.21.15.7:0/4145760648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f441038e0 0x7f5f4410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 --2- 172.21.15.7:0/4145760648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f44102fc0 0x7f5f441033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 -- 172.21.15.7:0/4145760648 >> 172.21.15.7:0/4145760648 conn(0x7f5f440fc820 msgr2=0x7f5f440fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 -- 172.21.15.7:0/4145760648 shutdown_connections 2024-04-23T15:18:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.826+0000 7f5f43e00640 1 -- 172.21.15.7:0/4145760648 wait complete. 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.827+0000 7f5f43e00640 1 Processor -- start 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 -- start start 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 0x7f5f441a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f441038e0 0x7f5f441a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4410c3e0 0x7f5f4419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f44112050 con 0x7f5f44102fc0 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f44111ed0 con 0x7f5f441038e0 2024-04-23T15:18:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f43e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5f441121d0 con 0x7f5f4410c3e0 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.828+0000 7f5f42a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 0x7f5f441a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 0x7f5f441a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54072/0 (socket says 172.21.15.7:54072) 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 -- 172.21.15.7:0/1903298611 learned_addr learned my addr 172.21.15.7:0/1903298611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42000640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f441038e0 0x7f5f441a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f43400640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4410c3e0 0x7f5f4419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 -- 172.21.15.7:0/1903298611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4410c3e0 msgr2=0x7f5f4419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4410c3e0 0x7f5f4419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 -- 172.21.15.7:0/1903298611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f441038e0 msgr2=0x7f5f441a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f441038e0 0x7f5f441a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.829+0000 7f5f42a00640 1 -- 172.21.15.7:0/1903298611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4419ad90 con 0x7f5f44102fc0 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.830+0000 7f5f42a00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 0x7f5f441a0410 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400ebc0 tx=0x7f5f3400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.830+0000 7f5f3b400640 1 -- 172.21.15.7:0/1903298611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34010630 con 0x7f5f44102fc0 2024-04-23T15:18:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.830+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4419b080 con 0x7f5f44102fc0 2024-04-23T15:18:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.830+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441a72d0 con 0x7f5f44102fc0 2024-04-23T15:18:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.830+0000 7f5f3b400640 1 -- 172.21.15.7:0/1903298611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f34010c80 con 0x7f5f44102fc0 2024-04-23T15:18:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.830+0000 7f5f3b400640 1 -- 172.21.15.7:0/1903298611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34018b30 con 0x7f5f44102fc0 2024-04-23T15:18:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.834+0000 7f5f3b400640 1 -- 172.21.15.7:0/1903298611 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f5f34018cd0 con 0x7f5f44102fc0 2024-04-23T15:18:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.834+0000 7f5f4c7b6740 1 Processor -- start 2024-04-23T15:18:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 -- start start 2024-04-23T15:18:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 0x55e68df877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df87ce0 0x55e68df92060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df94990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e68deed900 con 0x55e68df873c0 2024-04-23T15:18:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e68de93f20 con 0x55e68df925a0 2024-04-23T15:18:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e68dee98c0 con 0x55e68df87ce0 2024-04-23T15:18:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.835+0000 7f5f43400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 0x55e68df877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 0x55e68df877a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54080/0 (socket says 172.21.15.7:54080) 2024-04-23T15:18:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 -- 172.21.15.7:0/2780607516 learned_addr learned my addr 172.21.15.7:0/2780607516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f3b400640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5f280a3d90 0x7f5f280a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f42a00640 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df87ce0 0x55e68df92060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f42000640 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df94990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 -- 172.21.15.7:0/2780607516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df87ce0 msgr2=0x55e68df92060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df87ce0 0x55e68df92060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 -- 172.21.15.7:0/2780607516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 msgr2=0x55e68df94990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df94990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f3b400640 1 -- 172.21.15.7:0/1903298611 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7f5f340d1120 con 0x7f5f44102fc0 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 -- 172.21.15.7:0/2780607516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68deb8e10 con 0x55e68df873c0 2024-04-23T15:18:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.836+0000 7f5f43400640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5f280a3d90 0x7f5f280a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.837+0000 7f5f43400640 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 0x55e68df877a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009900 tx=0x7f5f3c032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e071564ce1759a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.837+0000 7f5f33e00640 1 -- 172.21.15.7:0/2780607516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c04c070 con 0x55e68df873c0 2024-04-23T15:18:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.837+0000 7f5f33e00640 1 -- 172.21.15.7:0/2780607516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f3c031760 con 0x55e68df873c0 2024-04-23T15:18:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.837+0000 7f5f33e00640 1 -- 172.21.15.7:0/2780607516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c035070 con 0x55e68df873c0 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/2780607516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 msgr2=0x55e68df877a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 0x55e68df877a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009900 tx=0x7f5f3c032ba0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f43400640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5f280a3d90 0x7f5f280a6250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c049000 tx=0x7f5f3c04a000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/2780607516 shutdown_connections 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df94990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df87ce0 0x55e68df92060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/2780607516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df873c0 0x55e68df877a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.838+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/2780607516 >> 172.21.15.7:0/2780607516 conn(0x55e68df838d0 msgr2=0x55e68df83cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.839+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/2780607516 shutdown_connections 2024-04-23T15:18:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.839+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/2780607516 wait complete. 2024-04-23T15:18:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.839+0000 7f5f4c7b6740 1 -- start start 2024-04-23T15:18:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.839+0000 7f5f4c7b6740 1 Processor -- start 2024-04-23T15:18:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e68df950e0 con 0x55e68df87ce0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e68dea72c0 con 0x55e68df925a0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e68df95260 con 0x55e68df873c0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f4c7b6740 10 client.0 _ll_register_callbacks cb 0x55e68dbffa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f42000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f42000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54096/0 (socket says 172.21.15.7:54096) 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.840+0000 7f5f42000640 1 -- 172.21.15.7:0/3727760504 learned_addr learned my addr 172.21.15.7:0/3727760504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f43400640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42a00640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42000640 1 -- 172.21.15.7:0/3727760504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 msgr2=0x55e68df8f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42000640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42000640 1 -- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 msgr2=0x55e68df8ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42000640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42000640 1 -- 172.21.15.7:0/3727760504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e68deb7fd0 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f42000640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8fa80 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00b900 tx=0x7f5f2c00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c330dfb36e9c9b72 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.841+0000 7f5f30c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f30c00640 1 -- 172.21.15.7:0/3727760504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c005020 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f30c00640 1 -- 172.21.15.7:0/3727760504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7f5f2c0051c0 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f3c031760 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f30c00640 1 -- 172.21.15.7:0/3727760504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5f2c023050 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f4c7b6740 10 client.17883 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e68dc00210 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.842+0000 7f5f30c00640 1 -- 172.21.15.7:0/3727760504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f3c031760 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f30c00640 1 -- 172.21.15.7:0/3727760504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5f2c019030 con 0x55e68df87ce0 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f4c7b6740 10 client.17883 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f4c7b6740 10 client.17883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f4c7b6740 20 client.17883 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68dfa27a0 0x55e68dfa4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f4c7b6740 4 client.17883 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:18:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e68defb320 con 0x55e68dfa27a0 2024-04-23T15:18:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.843+0000 7f5f42a00640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68dfa27a0 0x55e68dfa4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.844+0000 7f5f30c00640 10 client.17883 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.844+0000 7f5f42a00640 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68dfa27a0 0x55e68dfa4bd0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=422718fc2117774c server_cookie=fdb5893d3bb7faa8 in_seq=0 out_seq=0 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.846+0000 7f5f30c00640 1 -- 172.21.15.7:0/3727760504 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e68defb320 con 0x55e68dfa27a0 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.846+0000 7f5f30c00640 10 client.17883 handle_command_reply: tid=0 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.846+0000 7f5f4c7b6740 1 client.17883 shutdown 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 msgr2=0x55e68df8fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8fa80 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00b900 tx=0x7f5f2c00bdc0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 shutdown_connections 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68dfa27a0 0x55e68dfa4bd0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8fa80 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f30c00640 0 client.17883 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3727760504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 >> 172.21.15.7:0/3727760504 conn(0x55e68df838d0 msgr2=0x55e68df89600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 shutdown_connections 2024-04-23T15:18:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3727760504 wait complete. 2024-04-23T15:18:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.847+0000 7f5f4c7b6740 20 client.17883 trim_cache size 0 max 16384 2024-04-23T15:18:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 Processor -- start 2024-04-23T15:18:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 -- start start 2024-04-23T15:18:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df91c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df9e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2000ff10 con 0x55e68df87ce0 2024-04-23T15:18:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20011a50 con 0x55e68df925a0 2024-04-23T15:18:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.866+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5f200105e0 con 0x55e68df873c0 2024-04-23T15:18:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df9e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df9e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54104/0 (socket says 172.21.15.7:54104) 2024-04-23T15:18:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 -- 172.21.15.7:0/3582900720 learned_addr learned my addr 172.21.15.7:0/3582900720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f43400640 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42a00640 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df91c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 -- 172.21.15.7:0/3582900720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 msgr2=0x55e68df91c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df91c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 -- 172.21.15.7:0/3582900720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 msgr2=0x55e68df8fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 -- 172.21.15.7:0/3582900720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68df87b10 con 0x55e68df87ce0 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f43400640 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.867+0000 7f5f42000640 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df9e110 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c011600 tx=0x7f5f2c004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5be9c93f33cbc94 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.868+0000 7f5f33400640 1 -- 172.21.15.7:0/3582900720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c003de0 con 0x55e68df87ce0 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.868+0000 7f5f33400640 1 -- 172.21.15.7:0/3582900720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f2c02c070 con 0x55e68df87ce0 2024-04-23T15:18:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.868+0000 7f5f33400640 1 -- 172.21.15.7:0/3582900720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c011c90 con 0x55e68df87ce0 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.868+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3582900720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 msgr2=0x55e68df9e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.868+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df9e110 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c011600 tx=0x7f5f2c004350 comp rx=0 tx=0).stop 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3582900720 shutdown_connections 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68df8fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df9e110 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/3582900720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3582900720 >> 172.21.15.7:0/3582900720 conn(0x55e68df838d0 msgr2=0x55e68df8f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3582900720 shutdown_connections 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/3582900720 wait complete. 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 -- start start 2024-04-23T15:18:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.869+0000 7f5f4c7b6740 1 Processor -- start 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68e010560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20011380 con 0x55e68df87ce0 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20010cb0 con 0x55e68df925a0 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2000df10 con 0x55e68df873c0 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f4c7b6740 10 client.0 _ll_register_callbacks cb 0x7f5f2c005af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f42000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f42000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54110/0 (socket says 172.21.15.7:54110) 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f42000640 1 -- 172.21.15.7:0/1945609971 learned_addr learned my addr 172.21.15.7:0/1945609971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.870+0000 7f5f42a00640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f42000640 1 -- 172.21.15.7:0/1945609971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 msgr2=0x55e68df8c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f43400640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68e010560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f42000640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f42000640 1 -- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 msgr2=0x55e68e010560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f42000640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68e010560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f42000640 1 -- 172.21.15.7:0/1945609971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e68dccc620 con 0x55e68df87ce0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f43400640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68e010560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f42000640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8ce80 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00be00 tx=0x7f5f2c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62c0ec5344f243d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f30c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f30c00640 1 -- 172.21.15.7:0/1945609971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c011a80 con 0x55e68df87ce0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f30c00640 1 -- 172.21.15.7:0/1945609971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 9467+0+0 (secure 0 0 0) 0x7f5f2c011c20 con 0x55e68df87ce0 2024-04-23T15:18:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.871+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f2c02c070 con 0x55e68df87ce0 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f30c00640 1 -- 172.21.15.7:0/1945609971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5f2c011e20 con 0x55e68df87ce0 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 10 client.17889 fetch_fsmap learned FSMap version 32 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e68e011b00 con 0x55e68df87ce0 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f30c00640 1 -- 172.21.15.7:0/1945609971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f2c02c070 con 0x55e68df87ce0 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f30c00640 1 -- 172.21.15.7:0/1945609971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5f2c019040 con 0x55e68df87ce0 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 10 client.17889 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 10 client.17889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 20 client.17889 populate_metadata read hostname 'smithi007' 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68e0120c0 0x55e68e0144e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 4 client.17889 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.872+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e68def5190 con 0x55e68e0120c0 2024-04-23T15:18:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.873+0000 7f5f42a00640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68e0120c0 0x55e68e0144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:18:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.874+0000 7f5f30c00640 10 client.17889 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.874+0000 7f5f42a00640 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68e0120c0 0x55e68e0144e0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77d173fed123816 server_cookie=5b394e28b193879 in_seq=0 out_seq=0 2024-04-23T15:18:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f30c00640 1 -- 172.21.15.7:0/1945609971 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e68def5190 con 0x55e68e0120c0 2024-04-23T15:18:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f30c00640 10 client.17889 handle_command_reply: tid=0 2024-04-23T15:18:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 client.17889 shutdown 2024-04-23T15:18:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 msgr2=0x55e68df8ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8ce80 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00be00 tx=0x7f5f2c0042e0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 shutdown_connections 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e68e0120c0 0x55e68e0144e0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e68df925a0 0x55e68e010560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e68df87ce0 0x55e68df8ce80 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 --2- 172.21.15.7:0/1945609971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e68df873c0 0x55e68df8c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f30c00640 0 client.17889 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 >> 172.21.15.7:0/1945609971 conn(0x55e68df838d0 msgr2=0x55e68df8da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 shutdown_connections 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 1 -- 172.21.15.7:0/1945609971 wait complete. 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.906+0000 7f5f4c7b6740 20 client.17889 trim_cache size 0 max 16384 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:18:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:18:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:18:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:18:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5f280a3d90 msgr2=0x7f5f280a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5f280a3d90 0x7f5f280a6250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c049000 tx=0x7f5f3c04a000 comp rx=0 tx=0).stop 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 msgr2=0x7f5f441a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 0x7f5f441a0410 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400ebc0 tx=0x7f5f3400c6a0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 shutdown_connections 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f5f280a3d90 0x7f5f280a6250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f441038e0 0x7f5f441a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4410c3e0 0x7f5f4419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 --2- 172.21.15.7:0/1903298611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f44102fc0 0x7f5f441a0410 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.907+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 >> 172.21.15.7:0/1903298611 conn(0x7f5f440fc820 msgr2=0x7f5f44101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.908+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 shutdown_connections 2024-04-23T15:18:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:18:59.908+0000 7f5f43e00640 1 -- 172.21.15.7:0/1903298611 wait complete. 2024-04-23T15:19:00.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:00 smithi137 ceph-mon[31694]: pgmap v872: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:00.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:00 smithi007 ceph-mon[27906]: pgmap v872: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:00.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:00 smithi186 ceph-mon[31814]: pgmap v872: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:02.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:02 smithi137 ceph-mon[31694]: pgmap v873: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:02.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:02 smithi007 ceph-mon[27906]: pgmap v873: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:02 smithi186 ceph-mon[31814]: pgmap v873: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:04.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:04 smithi007 ceph-mon[27906]: pgmap v874: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 39 op/s 2024-04-23T15:19:04.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:04 smithi186 ceph-mon[31814]: pgmap v874: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 39 op/s 2024-04-23T15:19:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:04 smithi137 ceph-mon[31694]: pgmap v874: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 39 op/s 2024-04-23T15:19:06.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:06 smithi007 ceph-mon[27906]: pgmap v875: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:19:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:06 smithi186 ceph-mon[31814]: pgmap v875: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:19:06.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:06 smithi137 ceph-mon[31694]: pgmap v875: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:19:08.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:08 smithi007 ceph-mon[27906]: pgmap v876: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:19:08.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:08 smithi186 ceph-mon[31814]: pgmap v876: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:19:08.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:08 smithi137 ceph-mon[31694]: pgmap v876: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:19:09.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:09 smithi007 ceph-mon[27906]: osdmap e135: 12 total, 12 up, 12 in 2024-04-23T15:19:09.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:09 smithi186 ceph-mon[31814]: osdmap e135: 12 total, 12 up, 12 in 2024-04-23T15:19:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:09 smithi137 ceph-mon[31694]: osdmap e135: 12 total, 12 up, 12 in 2024-04-23T15:19:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:10 smithi007 ceph-mon[27906]: pgmap v878: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:19:10.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:10 smithi186 ceph-mon[31814]: pgmap v878: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:19:10.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:10 smithi137 ceph-mon[31694]: pgmap v878: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:19:12.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:12 smithi007 ceph-mon[27906]: pgmap v879: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:19:12.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:12 smithi186 ceph-mon[31814]: pgmap v879: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:19:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:12 smithi137 ceph-mon[31694]: pgmap v879: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 36 op/s 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 -- 172.21.15.7:0/474148270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 msgr2=0x7f576c100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 --2- 172.21.15.7:0/474148270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c100fa0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5760009900 tx=0x7f576002a400 comp rx=0 tx=0).stop 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 -- 172.21.15.7:0/474148270 shutdown_connections 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 --2- 172.21.15.7:0/474148270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c10e770 0x7f576c110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 --2- 172.21.15.7:0/474148270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f576c101570 0x7f576c10e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 --2- 172.21.15.7:0/474148270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c100fa0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.062+0000 7f5772800640 1 -- 172.21.15.7:0/474148270 >> 172.21.15.7:0/474148270 conn(0x7f576c0fc820 msgr2=0x7f576c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.063+0000 7f5772800640 1 -- 172.21.15.7:0/474148270 shutdown_connections 2024-04-23T15:19:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.063+0000 7f5772800640 1 -- 172.21.15.7:0/474148270 wait complete. 2024-04-23T15:19:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.064+0000 7f5772800640 1 Processor -- start 2024-04-23T15:19:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.064+0000 7f5772800640 1 -- start start 2024-04-23T15:19:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.065+0000 7f5772800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.065+0000 7f5772800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c101570 0x7f576c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.065+0000 7f5772800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f576c10e770 0x7f576c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.065+0000 7f5772800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f576c1142b0 con 0x7f576c100bc0 2024-04-23T15:19:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.065+0000 7f5772800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f576c114130 con 0x7f576c101570 2024-04-23T15:19:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.065+0000 7f5772800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f576c114430 con 0x7f576c10e770 2024-04-23T15:19:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c1a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60980/0 (socket says 172.21.15.7:60980) 2024-04-23T15:19:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 -- 172.21.15.7:0/3887711977 learned_addr learned my addr 172.21.15.7:0/3887711977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5770a00640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c101570 0x7f576c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771e00640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f576c10e770 0x7f576c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 -- 172.21.15.7:0/3887711977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f576c10e770 msgr2=0x7f576c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f576c10e770 0x7f576c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 -- 172.21.15.7:0/3887711977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c101570 msgr2=0x7f576c1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c101570 0x7f576c1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5771400640 1 -- 172.21.15.7:0/3887711977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c19ad90 con 0x7f576c100bc0 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.066+0000 7f5770a00640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c101570 0x7f576c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.067+0000 7f5771400640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c1a0460 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5760006010 tx=0x7f5760004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.067+0000 7f576a000640 1 -- 172.21.15.7:0/3887711977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576003f030 con 0x7f576c100bc0 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.067+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c19b020 con 0x7f576c100bc0 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.067+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c1a7320 con 0x7f576c100bc0 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.068+0000 7f576a000640 1 -- 172.21.15.7:0/3887711977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5760003aa0 con 0x7f576c100bc0 2024-04-23T15:19:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.068+0000 7f576a000640 1 -- 172.21.15.7:0/3887711977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760049060 con 0x7f576c100bc0 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.071+0000 7f5776c2a740 1 Processor -- start 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 -- start start 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a6228617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a62286c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a62286e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6227c7900 con 0x55a6228613c0 2024-04-23T15:19:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a62276df20 con 0x55a622861ce0 2024-04-23T15:19:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5776c2a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a6227c38c0 con 0x55a62286c5a0 2024-04-23T15:19:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.072+0000 7f5771e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a6228617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a6228617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60990/0 (socket says 172.21.15.7:60990) 2024-04-23T15:19:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 -- 172.21.15.7:0/950734431 learned_addr learned my addr 172.21.15.7:0/950734431 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f576a000640 1 -- 172.21.15.7:0/3887711977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f576003b9b0 con 0x7f576c100bc0 2024-04-23T15:19:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5770a00640 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a62286e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 -- 172.21.15.7:0/950734431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 msgr2=0x55a62286e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a62286e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 -- 172.21.15.7:0/950734431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 msgr2=0x55a62286c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a62286c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5771e00640 1 -- 172.21.15.7:0/950734431 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a622792e10 con 0x55a6228613c0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.073+0000 7f5770a00640 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a62286e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.074+0000 7f5771e00640 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a6228617a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5764007d70 tx=0x7f576400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78b624bc199c55f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.074+0000 7f575e600640 1 -- 172.21.15.7:0/950734431 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764014070 con 0x55a6228613c0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.074+0000 7f575e600640 1 -- 172.21.15.7:0/950734431 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5764004d20 con 0x55a6228613c0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.074+0000 7f575e600640 1 -- 172.21.15.7:0/950734431 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57640107b0 con 0x55a6228613c0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.074+0000 7f576a000640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f57540a3d90 0x7f57540a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f576a000640 1 -- 172.21.15.7:0/3887711977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 9555+0+0 (secure 0 0 0) 0x7f57600f14e0 con 0x7f576c100bc0 2024-04-23T15:19:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5771400640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f57540a3d90 0x7f57540a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 -- 172.21.15.7:0/950734431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 msgr2=0x55a6228617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a6228617a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5764007d70 tx=0x7f576400e720 comp rx=0 tx=0).stop 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 -- 172.21.15.7:0/950734431 shutdown_connections 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a62286c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a62286e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 --2- 172.21.15.7:0/950734431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a6228617a0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.075+0000 7f5776c2a740 1 -- 172.21.15.7:0/950734431 >> 172.21.15.7:0/950734431 conn(0x55a62285d8d0 msgr2=0x55a62285dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.076+0000 7f5776c2a740 1 -- 172.21.15.7:0/950734431 shutdown_connections 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.076+0000 7f5776c2a740 1 -- 172.21.15.7:0/950734431 wait complete. 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.076+0000 7f5771400640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f57540a3d90 0x7f57540a6250 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f57600ee970 tx=0x7f576003b460 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.076+0000 7f5776c2a740 1 -- start start 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.076+0000 7f5776c2a740 1 Processor -- start 2024-04-23T15:19:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6228613c0 0x55a6228694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a622869a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 0x55a622869f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a62286f1d0 con 0x55a62286c5a0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a6227812c0 con 0x55a622861ce0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a62286f350 con 0x55a6228613c0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5776c2a740 10 client.0 _ll_register_callbacks cb 0x55a6224d9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5771e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 0x55a622869f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5771e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 0x55a622869f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32772/0 (socket says 172.21.15.7:32772) 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.077+0000 7f5771e00640 1 -- 172.21.15.7:0/697915138 learned_addr learned my addr 172.21.15.7:0/697915138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5770a00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a622869a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6228613c0 0x55a6228694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 -- 172.21.15.7:0/697915138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6228613c0 msgr2=0x55a6228694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6228613c0 0x55a6228694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 -- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 msgr2=0x55a622869a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a622869a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 -- 172.21.15.7:0/697915138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a622791fd0 con 0x55a62286c5a0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5771e00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 0x55a622869f40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5764010950 tx=0x7f5764005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b28f7841080d823 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.078+0000 7f5752a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5752a00640 1 -- 172.21.15.7:0/697915138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576401c030 con 0x55a62286c5a0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5752a00640 1 -- 172.21.15.7:0/697915138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 9555+0+0 (secure 0 0 0) 0x7f5764021070 con 0x55a62286c5a0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5764004d20 con 0x55a62286c5a0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5752a00640 1 -- 172.21.15.7:0/697915138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f576402e050 con 0x55a62286c5a0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5776c2a740 10 client.17901 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a6224da210 con 0x55a62286c5a0 2024-04-23T15:19:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.079+0000 7f5752a00640 1 -- 172.21.15.7:0/697915138 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5764004d20 con 0x55a62286c5a0 2024-04-23T15:19:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5752a00640 1 -- 172.21.15.7:0/697915138 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5764018710 con 0x55a62286c5a0 2024-04-23T15:19:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5776c2a740 10 client.17901 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5776c2a740 10 client.17901 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5776c2a740 20 client.17901 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5776c2a740 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a62287c610 0x55a62287ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5776c2a740 4 client.17901 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.080+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6227d5320 con 0x55a62287c610 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.081+0000 7f5770a00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a62287c610 0x55a62287ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.082+0000 7f5770a00640 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a62287c610 0x55a62287ea00 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7858f2bc517fe server_cookie=531c7e479adc7304 in_seq=0 out_seq=0 2024-04-23T15:19:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.082+0000 7f5752a00640 10 client.17901 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.083+0000 7f5752a00640 1 -- 172.21.15.7:0/697915138 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a6227d5320 con 0x55a62287c610 2024-04-23T15:19:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.083+0000 7f5752a00640 10 client.17901 handle_command_reply: tid=0 2024-04-23T15:19:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 client.17901 shutdown 2024-04-23T15:19:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 msgr2=0x55a622869f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 0x55a622869f40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5764010950 tx=0x7f5764005c30 comp rx=0 tx=0).stop 2024-04-23T15:19:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 shutdown_connections 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a62287c610 0x55a62287ea00 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a622869a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a62286c5a0 0x55a622869f40 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 --2- 172.21.15.7:0/697915138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6228613c0 0x55a6228694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 >> 172.21.15.7:0/697915138 conn(0x55a62285d8d0 msgr2=0x55a622863650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5752a00640 0 client.17901 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 shutdown_connections 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 1 -- 172.21.15.7:0/697915138 wait complete. 2024-04-23T15:19:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.084+0000 7f5776c2a740 20 client.17901 trim_cache size 0 max 16384 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 Processor -- start 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 -- start start 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6228613c0 0x55a622863d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 0x55a62285c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a622884280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f574c010030 con 0x55a622861ce0 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f574c011b70 con 0x55a6228613c0 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.108+0000 7f5776c2a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f574c010700 con 0x55a62286c5a0 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 0x55a62285c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 0x55a62285c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32782/0 (socket says 172.21.15.7:32782) 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 -- 172.21.15.7:0/1206137462 learned_addr learned my addr 172.21.15.7:0/1206137462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5771e00640 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6228613c0 0x55a622863d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 -- 172.21.15.7:0/1206137462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 msgr2=0x55a622884280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a622884280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 -- 172.21.15.7:0/1206137462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6228613c0 msgr2=0x55a622863d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6228613c0 0x55a622863d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 -- 172.21.15.7:0/1206137462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a62287ed70 con 0x55a622861ce0 2024-04-23T15:19:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.109+0000 7f5770a00640 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 0x55a62285c910 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f576c0ffe20 tx=0x7f575800a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f6eb7f31e4ca37 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.110+0000 7f575dc00640 1 -- 172.21.15.7:0/1206137462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758013ab0 con 0x55a622861ce0 2024-04-23T15:19:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.110+0000 7f575dc00640 1 -- 172.21.15.7:0/1206137462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5758013c50 con 0x55a622861ce0 2024-04-23T15:19:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.110+0000 7f575dc00640 1 -- 172.21.15.7:0/1206137462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57580035f0 con 0x55a622861ce0 2024-04-23T15:19:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 -- 172.21.15.7:0/1206137462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 msgr2=0x55a62285c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 0x55a62285c910 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f576c0ffe20 tx=0x7f575800a4b0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 -- 172.21.15.7:0/1206137462 shutdown_connections 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a622884280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a622861ce0 0x55a62285c910 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 --2- 172.21.15.7:0/1206137462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a6228613c0 0x55a622863d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 -- 172.21.15.7:0/1206137462 >> 172.21.15.7:0/1206137462 conn(0x55a62285d8d0 msgr2=0x55a62285c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 -- 172.21.15.7:0/1206137462 shutdown_connections 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.111+0000 7f5776c2a740 1 -- 172.21.15.7:0/1206137462 wait complete. 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 -- start start 2024-04-23T15:19:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 Processor -- start 2024-04-23T15:19:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a622870070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a6228705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a622870af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f574c0114a0 con 0x55a6228613c0 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f574c010dd0 con 0x55a622861ce0 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f574c00e030 con 0x55a62286c5a0 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.112+0000 7f5776c2a740 10 client.0 _ll_register_callbacks cb 0x7f5764007bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a622870070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a622870070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32788/0 (socket says 172.21.15.7:32788) 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 -- 172.21.15.7:0/2259963938 learned_addr learned my addr 172.21.15.7:0/2259963938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5770a00640 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a6228705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 -- 172.21.15.7:0/2259963938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 msgr2=0x55a622870af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a622870af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 -- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 msgr2=0x55a6228705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a6228705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 -- 172.21.15.7:0/2259963938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6225a6620 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5771e00640 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a622870070 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f5764007c90 tx=0x7f5764005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37ba5278743a8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.113+0000 7f5752a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5752a00640 1 -- 172.21.15.7:0/2259963938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576402b020 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5752a00640 1 -- 172.21.15.7:0/2259963938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 9555+0+0 (secure 0 0 0) 0x7f57640183e0 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5758013c50 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5752a00640 1 -- 172.21.15.7:0/2259963938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f576401c070 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5776c2a740 10 client.17907 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a6228e2c10 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5752a00640 1 -- 172.21.15.7:0/2259963938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5758013c50 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.114+0000 7f5752a00640 1 -- 172.21.15.7:0/2259963938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f5764011030 con 0x55a6228613c0 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.115+0000 7f5776c2a740 10 client.17907 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.115+0000 7f5776c2a740 10 client.17907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.115+0000 7f5776c2a740 20 client.17907 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.115+0000 7f5776c2a740 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6228e3360 0x55a6228e5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.115+0000 7f5776c2a740 4 client.17907 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:19:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.115+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a6227cf190 con 0x55a6228e3360 2024-04-23T15:19:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.116+0000 7f5770a00640 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6228e3360 0x55a6228e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.117+0000 7f5770a00640 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6228e3360 0x55a6228e5780 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9da4bd62dec1f75 server_cookie=ed578ff569fe030e in_seq=0 out_seq=0 2024-04-23T15:19:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.117+0000 7f5752a00640 10 client.17907 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5752a00640 1 -- 172.21.15.7:0/2259963938 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a6227cf190 con 0x55a6228e3360 2024-04-23T15:19:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5752a00640 10 client.17907 handle_command_reply: tid=0 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5776c2a740 1 client.17907 shutdown 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 msgr2=0x55a622870070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5776c2a740 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a622870070 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f5764007c90 tx=0x7f5764005940 comp rx=0 tx=0).stop 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 shutdown_connections 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5776c2a740 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a6228e3360 0x55a6228e5780 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.155+0000 7f5776c2a740 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a622861ce0 0x55a6228705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5776c2a740 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a62286c5a0 0x55a622870af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5776c2a740 1 --2- 172.21.15.7:0/2259963938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6228613c0 0x55a622870070 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5752a00640 0 client.17907 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 >> 172.21.15.7:0/2259963938 conn(0x55a62285d8d0 msgr2=0x55a622869d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 shutdown_connections 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5776c2a740 1 -- 172.21.15.7:0/2259963938 wait complete. 2024-04-23T15:19:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.156+0000 7f5776c2a740 20 client.17907 trim_cache size 0 max 16384 2024-04-23T15:19:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:19:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:19:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:19:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f57540a3d90 msgr2=0x7f57540a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f57540a3d90 0x7f57540a6250 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f57600ee970 tx=0x7f576003b460 comp rx=0 tx=0).stop 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 msgr2=0x7f576c1a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c1a0460 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5760006010 tx=0x7f5760004270 comp rx=0 tx=0).stop 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 shutdown_connections 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f57540a3d90 0x7f57540a6250 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f576c101570 0x7f576c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f576c10e770 0x7f576c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 --2- 172.21.15.7:0/3887711977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f576c100bc0 0x7f576c1a0460 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 >> 172.21.15.7:0/3887711977 conn(0x7f576c0fc820 msgr2=0x7f576c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 shutdown_connections 2024-04-23T15:19:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:13.157+0000 7f5772800640 1 -- 172.21.15.7:0/3887711977 wait complete. 2024-04-23T15:19:14.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:14 smithi007 ceph-mon[27906]: pgmap v880: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:19:14.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:14 smithi186 ceph-mon[31814]: pgmap v880: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:19:14.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:14 smithi137 ceph-mon[31694]: pgmap v880: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:19:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:16 smithi007 ceph-mon[27906]: pgmap v881: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:19:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:16 smithi007 ceph-mon[27906]: osdmap e136: 12 total, 12 up, 12 in 2024-04-23T15:19:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:16 smithi186 ceph-mon[31814]: pgmap v881: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:19:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:16 smithi186 ceph-mon[31814]: osdmap e136: 12 total, 12 up, 12 in 2024-04-23T15:19:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:16 smithi137 ceph-mon[31694]: pgmap v881: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-04-23T15:19:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:16 smithi137 ceph-mon[31694]: osdmap e136: 12 total, 12 up, 12 in 2024-04-23T15:19:19.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:18 smithi007 ceph-mon[27906]: pgmap v883: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:19:19.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:18 smithi186 ceph-mon[31814]: pgmap v883: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:19:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:18 smithi137 ceph-mon[31694]: pgmap v883: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:19:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:20 smithi007 ceph-mon[27906]: pgmap v884: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:19:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:20 smithi186 ceph-mon[31814]: pgmap v884: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:19:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:20 smithi137 ceph-mon[31694]: pgmap v884: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:19:23.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:22 smithi007 ceph-mon[27906]: pgmap v885: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:19:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:22 smithi186 ceph-mon[31814]: pgmap v885: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:19:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:22 smithi137 ceph-mon[31694]: pgmap v885: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:19:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:24 smithi007 ceph-mon[27906]: pgmap v886: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:19:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:24 smithi186 ceph-mon[31814]: pgmap v886: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:19:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:24 smithi137 ceph-mon[31694]: pgmap v886: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:19:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 -- 172.21.15.7:0/496494200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60101570 msgr2=0x7f0f6010e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 --2- 172.21.15.7:0/496494200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60101570 0x7f0f6010e230 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009900 tx=0x7f0f4c02a410 comp rx=0 tx=0).stop 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 -- 172.21.15.7:0/496494200 shutdown_connections 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 --2- 172.21.15.7:0/496494200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f6010e770 0x7f0f60110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 --2- 172.21.15.7:0/496494200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f60101570 0x7f0f6010e230 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 --2- 172.21.15.7:0/496494200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f60100bc0 0x7f0f60100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.312+0000 7f0f66800640 1 -- 172.21.15.7:0/496494200 >> 172.21.15.7:0/496494200 conn(0x7f0f600fc820 msgr2=0x7f0f600fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.313+0000 7f0f66800640 1 -- 172.21.15.7:0/496494200 shutdown_connections 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.313+0000 7f0f66800640 1 -- 172.21.15.7:0/496494200 wait complete. 2024-04-23T15:19:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 Processor -- start 2024-04-23T15:19:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 -- start start 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f60100bc0 0x7f0f601a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f60101570 0x7f0f601a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 0x7f0f6019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60114320 con 0x7f0f6010e770 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601141a0 con 0x7f0f60101570 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.314+0000 7f0f66800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601144a0 con 0x7f0f60100bc0 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 0x7f0f6019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 0x7f0f6019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41838/0 (socket says 172.21.15.7:41838) 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 -- 172.21.15.7:0/1438229965 learned_addr learned my addr 172.21.15.7:0/1438229965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65400640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f60100bc0 0x7f0f601a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f64a00640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f60101570 0x7f0f601a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 -- 172.21.15.7:0/1438229965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f60100bc0 msgr2=0x7f0f601a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f60100bc0 0x7f0f601a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 -- 172.21.15.7:0/1438229965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f60101570 msgr2=0x7f0f601a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f60101570 0x7f0f601a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.315+0000 7f0f65e00640 1 -- 172.21.15.7:0/1438229965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6019af60 con 0x7f0f6010e770 2024-04-23T15:19:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.316+0000 7f0f65e00640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 0x7f0f6019a6a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009fd0 tx=0x7f0f5800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.316+0000 7f0f5e000640 1 -- 172.21.15.7:0/1438229965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58004d20 con 0x7f0f6010e770 2024-04-23T15:19:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.316+0000 7f0f5e000640 1 -- 172.21.15.7:0/1438229965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f58005020 con 0x7f0f6010e770 2024-04-23T15:19:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.316+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6019b250 con 0x7f0f6010e770 2024-04-23T15:19:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.316+0000 7f0f5e000640 1 -- 172.21.15.7:0/1438229965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580116b0 con 0x7f0f6010e770 2024-04-23T15:19:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.316+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f601a7560 con 0x7f0f6010e770 2024-04-23T15:19:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.320+0000 7f0f6ac77740 1 Processor -- start 2024-04-23T15:19:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f5e000640 1 -- 172.21.15.7:0/1438229965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0f5800cb20 con 0x7f0f6010e770 2024-04-23T15:19:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 -- start start 2024-04-23T15:19:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aa21615900 con 0x55aa216ba5a0 2024-04-23T15:19:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aa215bbf20 con 0x55aa216afce0 2024-04-23T15:19:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.321+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55aa216118c0 con 0x55aa216af3c0 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.322+0000 7f0f64a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.322+0000 7f0f64a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216bc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41852/0 (socket says 172.21.15.7:41852) 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.322+0000 7f0f64a00640 1 -- 172.21.15.7:0/3498973509 learned_addr learned my addr 172.21.15.7:0/3498973509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.322+0000 7f0f65400640 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.322+0000 7f0f64a00640 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f64a00640 1 -- 172.21.15.7:0/3498973509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 msgr2=0x55aa216af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f64a00640 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f64a00640 1 -- 172.21.15.7:0/3498973509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 msgr2=0x55aa216ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f64a00640 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f64a00640 1 -- 172.21.15.7:0/3498973509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa215e0e10 con 0x55aa216ba5a0 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f5e000640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f480a3d90 0x7f0f480a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f65400640 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:19:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f5e000640 1 -- 172.21.15.7:0/1438229965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f0f580d0a30 con 0x7f0f6010e770 2024-04-23T15:19:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f64a00640 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216bc990 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c005c40 tx=0x7f0f4c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb67be6ce2acab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.323+0000 7f0f65400640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f480a3d90 0x7f0f480a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.324+0000 7f0f52600640 1 -- 172.21.15.7:0/3498973509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c035040 con 0x55aa216ba5a0 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.324+0000 7f0f52600640 1 -- 172.21.15.7:0/3498973509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f4c0040c0 con 0x55aa216ba5a0 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.324+0000 7f0f52600640 1 -- 172.21.15.7:0/3498973509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c031d90 con 0x55aa216ba5a0 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 -- 172.21.15.7:0/3498973509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 msgr2=0x55aa216bc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216bc990 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c005c40 tx=0x7f0f4c005bb0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f65400640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f480a3d90 0x7f0f480a6250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55aa216b0960 tx=0x7f0f5400b4d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 -- 172.21.15.7:0/3498973509 shutdown_connections 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216bc990 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/3498973509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 -- 172.21.15.7:0/3498973509 >> 172.21.15.7:0/3498973509 conn(0x55aa216ab8d0 msgr2=0x55aa216abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 -- 172.21.15.7:0/3498973509 shutdown_connections 2024-04-23T15:19:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.325+0000 7f0f6ac77740 1 -- 172.21.15.7:0/3498973509 wait complete. 2024-04-23T15:19:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 -- start start 2024-04-23T15:19:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 Processor -- start 2024-04-23T15:19:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 0x55aa216b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216ba5a0 0x55aa216b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aa216bd0a0 con 0x55aa216afce0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aa215cf2c0 con 0x55aa216ba5a0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.326+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55aa216bd220 con 0x55aa216af3c0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f6ac77740 10 client.0 _ll_register_callbacks cb 0x55aa21327a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f64a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 0x55aa216b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f64a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 0x55aa216b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41868/0 (socket says 172.21.15.7:41868) 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f64a00640 1 -- 172.21.15.7:0/2857428296 learned_addr learned my addr 172.21.15.7:0/2857428296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f65400640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f65e00640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216ba5a0 0x55aa216b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f64a00640 1 -- 172.21.15.7:0/2857428296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 msgr2=0x55aa216b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.327+0000 7f0f64a00640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f64a00640 1 -- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216ba5a0 msgr2=0x55aa216b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f64a00640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216ba5a0 0x55aa216b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f64a00640 1 -- 172.21.15.7:0/2857428296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa215dffd0 con 0x55aa216afce0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f64a00640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 0x55aa216b7b70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c02a930 tx=0x7f0f4c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd77ce00330eef3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f46a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f46a00640 1 -- 172.21.15.7:0/2857428296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c04d070 con 0x55aa216afce0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f46a00640 1 -- 172.21.15.7:0/2857428296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f0f4c031d10 con 0x55aa216afce0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.328+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f4c0040c0 con 0x55aa216afce0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f46a00640 1 -- 172.21.15.7:0/2857428296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c059050 con 0x55aa216afce0 2024-04-23T15:19:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f6ac77740 10 client.17919 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55aa21328210 con 0x55aa216afce0 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f46a00640 1 -- 172.21.15.7:0/2857428296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f4c0040c0 con 0x55aa216afce0 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f46a00640 1 -- 172.21.15.7:0/2857428296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0f4c03a040 con 0x55aa216afce0 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f6ac77740 10 client.17919 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.329+0000 7f0f6ac77740 10 client.17919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.330+0000 7f0f6ac77740 20 client.17919 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.330+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa216ca5f0 0x55aa216cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.330+0000 7f0f6ac77740 4 client.17919 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.330+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa21623320 con 0x55aa216ca5f0 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.330+0000 7f0f65400640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa216ca5f0 0x55aa216cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.332+0000 7f0f65400640 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa216ca5f0 0x55aa216cc9e0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b9c9a491e4c111 server_cookie=c3b8ef6a35fbcbe4 in_seq=0 out_seq=0 2024-04-23T15:19:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.332+0000 7f0f46a00640 10 client.17919 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.333+0000 7f0f46a00640 1 -- 172.21.15.7:0/2857428296 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa21623320 con 0x55aa216ca5f0 2024-04-23T15:19:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.333+0000 7f0f46a00640 10 client.17919 handle_command_reply: tid=0 2024-04-23T15:19:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.334+0000 7f0f6ac77740 1 client.17919 shutdown 2024-04-23T15:19:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 msgr2=0x55aa216b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 0x55aa216b7b70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c02a930 tx=0x7f0f4c009260 comp rx=0 tx=0).stop 2024-04-23T15:19:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 shutdown_connections 2024-04-23T15:19:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa216ca5f0 0x55aa216cc9e0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216ba5a0 0x55aa216b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216afce0 0x55aa216b7b70 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/2857428296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 >> 172.21.15.7:0/2857428296 conn(0x55aa216ab8d0 msgr2=0x55aa216b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f46a00640 0 client.17919 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 shutdown_connections 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 1 -- 172.21.15.7:0/2857428296 wait complete. 2024-04-23T15:19:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.335+0000 7f0f6ac77740 20 client.17919 trim_cache size 0 max 16384 2024-04-23T15:19:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 Processor -- start 2024-04-23T15:19:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 -- start start 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ab210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601b1400 con 0x55aa216ba5a0 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601b2f40 con 0x55aa216afce0 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.355+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601b1ad0 con 0x55aa216af3c0 2024-04-23T15:19:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41882/0 (socket says 172.21.15.7:41882) 2024-04-23T15:19:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 -- 172.21.15.7:0/4255171865 learned_addr learned my addr 172.21.15.7:0/4255171865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65400640 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f64a00640 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 -- 172.21.15.7:0/4255171865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 msgr2=0x55aa216b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 -- 172.21.15.7:0/4255171865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 msgr2=0x55aa216ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.356+0000 7f0f65e00640 1 -- 172.21.15.7:0/4255171865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa213f4620 con 0x55aa216ba5a0 2024-04-23T15:19:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.357+0000 7f0f65e00640 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216b7ed0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0f5809c320 tx=0x7f0f58098280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68552b37bdbd97ce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.357+0000 7f0f51c00640 1 -- 172.21.15.7:0/4255171865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580ba070 con 0x55aa216ba5a0 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.357+0000 7f0f51c00640 1 -- 172.21.15.7:0/4255171865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f5809c620 con 0x55aa216ba5a0 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.357+0000 7f0f51c00640 1 -- 172.21.15.7:0/4255171865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5801f040 con 0x55aa216ba5a0 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 -- 172.21.15.7:0/4255171865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 msgr2=0x55aa216b7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216b7ed0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0f5809c320 tx=0x7f0f58098280 comp rx=0 tx=0).stop 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 -- 172.21.15.7:0/4255171865 shutdown_connections 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216ba5a0 0x55aa216b7ed0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/4255171865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216af3c0 0x55aa216b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 -- 172.21.15.7:0/4255171865 >> 172.21.15.7:0/4255171865 conn(0x55aa216ab8d0 msgr2=0x55aa216b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 -- 172.21.15.7:0/4255171865 shutdown_connections 2024-04-23T15:19:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.358+0000 7f0f6ac77740 1 -- 172.21.15.7:0/4255171865 wait complete. 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 -- start start 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 Processor -- start 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 0x55aa216c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216ba5a0 0x55aa216b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601b2870 con 0x55aa216af3c0 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601b21a0 con 0x55aa216afce0 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.359+0000 7f0f6ac77740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601af400 con 0x55aa216ba5a0 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f6ac77740 10 client.0 _ll_register_callbacks cb 0x7f0f5400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 0x55aa216c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 0x55aa216c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41896/0 (socket says 172.21.15.7:41896) 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 -- 172.21.15.7:0/56144128 learned_addr learned my addr 172.21.15.7:0/56144128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65e00640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216ba5a0 0x55aa216b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f64a00640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 -- 172.21.15.7:0/56144128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216ba5a0 msgr2=0x55aa216b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216ba5a0 0x55aa216b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 -- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 msgr2=0x55aa216b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.360+0000 7f0f65400640 1 -- 172.21.15.7:0/56144128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa2172f850 con 0x55aa216af3c0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f65400640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 0x55aa216c2b10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0f54013fd0 tx=0x7f0f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae221899c89cab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f46a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f46a00640 1 -- 172.21.15.7:0/56144128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401ed80 con 0x55aa216af3c0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f46a00640 1 -- 172.21.15.7:0/56144128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f0f5402a3f0 con 0x55aa216af3c0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f5809c620 con 0x55aa216af3c0 2024-04-23T15:19:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f46a00640 1 -- 172.21.15.7:0/56144128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0f5403c050 con 0x55aa216af3c0 2024-04-23T15:19:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f6ac77740 10 client.17925 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.361+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55aa21730a30 con 0x55aa216af3c0 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f46a00640 1 -- 172.21.15.7:0/56144128 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f5809c620 con 0x55aa216af3c0 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f46a00640 1 -- 172.21.15.7:0/56144128 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0f540047a0 con 0x55aa216af3c0 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f6ac77740 10 client.17925 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f6ac77740 10 client.17925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f6ac77740 20 client.17925 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa21731190 0x55aa217335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f6ac77740 4 client.17925 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.362+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa2161d190 con 0x55aa21731190 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.363+0000 7f0f64a00640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa21731190 0x55aa217335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.364+0000 7f0f64a00640 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa21731190 0x55aa217335b0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2023d631a2ea26 server_cookie=44de175b8e27e030 in_seq=0 out_seq=0 2024-04-23T15:19:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.364+0000 7f0f46a00640 10 client.17925 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.400+0000 7f0f46a00640 1 -- 172.21.15.7:0/56144128 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa2161d190 con 0x55aa21731190 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.400+0000 7f0f46a00640 10 client.17925 handle_command_reply: tid=0 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.400+0000 7f0f6ac77740 1 client.17925 shutdown 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.400+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 msgr2=0x55aa216c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.400+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 0x55aa216c2b10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0f54013fd0 tx=0x7f0f540046c0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 shutdown_connections 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55aa21731190 0x55aa217335b0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aa216afce0 0x55aa216b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aa216ba5a0 0x55aa216b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 --2- 172.21.15.7:0/56144128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa216af3c0 0x55aa216c2b10 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f46a00640 0 client.17925 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 >> 172.21.15.7:0/56144128 conn(0x55aa216ab8d0 msgr2=0x55aa216aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 shutdown_connections 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 1 -- 172.21.15.7:0/56144128 wait complete. 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.401+0000 7f0f6ac77740 20 client.17925 trim_cache size 0 max 16384 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:19:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:19:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f480a3d90 msgr2=0x7f0f480a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f480a3d90 0x7f0f480a6250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55aa216b0960 tx=0x7f0f5400b4d0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 msgr2=0x7f0f6019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 0x7f0f6019a6a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009fd0 tx=0x7f0f5800ee60 comp rx=0 tx=0).stop 2024-04-23T15:19:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 shutdown_connections 2024-04-23T15:19:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f480a3d90 0x7f0f480a6250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f60101570 0x7f0f601a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f6010e770 0x7f0f6019a6a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 --2- 172.21.15.7:0/1438229965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f60100bc0 0x7f0f601a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.402+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 >> 172.21.15.7:0/1438229965 conn(0x7f0f600fc820 msgr2=0x7f0f600fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.403+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 shutdown_connections 2024-04-23T15:19:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:26.403+0000 7f0f66800640 1 -- 172.21.15.7:0/1438229965 wait complete. 2024-04-23T15:19:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:26 smithi186 ceph-mon[31814]: pgmap v887: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:19:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:26 smithi137 ceph-mon[31694]: pgmap v887: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:19:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:26 smithi007 ceph-mon[27906]: pgmap v887: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:19:29.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:28 smithi186 ceph-mon[31814]: pgmap v888: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 23 op/s 2024-04-23T15:19:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:28 smithi137 ceph-mon[31694]: pgmap v888: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 23 op/s 2024-04-23T15:19:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:28 smithi007 ceph-mon[27906]: pgmap v888: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 23 op/s 2024-04-23T15:19:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:30 smithi186 ceph-mon[31814]: pgmap v889: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:30 smithi137 ceph-mon[31694]: pgmap v889: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:30 smithi007 ceph-mon[27906]: pgmap v889: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:33.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:32 smithi186 ceph-mon[31814]: pgmap v890: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:32 smithi137 ceph-mon[31694]: pgmap v890: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:32 smithi007 ceph-mon[27906]: pgmap v890: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:19:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:34 smithi137 ceph-mon[31694]: pgmap v891: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:19:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:34 smithi007 ceph-mon[27906]: pgmap v891: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:19:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:34 smithi186 ceph-mon[31814]: pgmap v891: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:19:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:36 smithi137 ceph-mon[31694]: pgmap v892: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:19:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:36 smithi007 ceph-mon[27906]: pgmap v892: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:19:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:36 smithi186 ceph-mon[31814]: pgmap v892: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:19:39.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:38 smithi186 ceph-mon[31814]: pgmap v893: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:19:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:38 smithi137 ceph-mon[31694]: pgmap v893: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:19:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:38 smithi007 ceph-mon[27906]: pgmap v893: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 -- 172.21.15.7:0/2892099387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8102c30 msgr2=0x7f41f8106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 --2- 172.21.15.7:0/2892099387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8102c30 0x7f41f8106c70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009900 tx=0x7f41e402a410 comp rx=0 tx=0).stop 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 -- 172.21.15.7:0/2892099387 shutdown_connections 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 --2- 172.21.15.7:0/2892099387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8107350 0x7f41f810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 --2- 172.21.15.7:0/2892099387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8102c30 0x7f41f8106c70 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 --2- 172.21.15.7:0/2892099387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f8102280 0x7f41f8102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 -- 172.21.15.7:0/2892099387 >> 172.21.15.7:0/2892099387 conn(0x7f41f8079490 msgr2=0x7f41f80798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 -- 172.21.15.7:0/2892099387 shutdown_connections 2024-04-23T15:19:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.547+0000 7f41fec00640 1 -- 172.21.15.7:0/2892099387 wait complete. 2024-04-23T15:19:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.548+0000 7f41fec00640 1 Processor -- start 2024-04-23T15:19:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.548+0000 7f41fec00640 1 -- start start 2024-04-23T15:19:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41fec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8102280 0x7f41f8196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41fec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 0x7f41f8196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41fec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f819ae10 0x7f41f819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41fec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81100f0 con 0x7f41f8107350 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41fec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41f810ff70 con 0x7f41f819ae10 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41fec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41f8110270 con 0x7f41f8102280 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 0x7f41f8196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 0x7f41f8196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45928/0 (socket says 172.21.15.7:45928) 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.549+0000 7f41f7400640 1 -- 172.21.15.7:0/2437643829 learned_addr learned my addr 172.21.15.7:0/2437643829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7e00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8102280 0x7f41f8196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41fcc00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f819ae10 0x7f41f819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7400640 1 -- 172.21.15.7:0/2437643829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8102280 msgr2=0x7f41f8196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7400640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8102280 0x7f41f8196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7400640 1 -- 172.21.15.7:0/2437643829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f819ae10 msgr2=0x7f41f819b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7400640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f819ae10 0x7f41f819b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7400640 1 -- 172.21.15.7:0/2437643829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f819b900 con 0x7f41f8107350 2024-04-23T15:19:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.550+0000 7f41f7400640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 0x7f41f8196a90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f41e4005ab0 tx=0x7f41e4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.551+0000 7f41f4c00640 1 -- 172.21.15.7:0/2437643829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e403f070 con 0x7f41f8107350 2024-04-23T15:19:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.551+0000 7f41f4c00640 1 -- 172.21.15.7:0/2437643829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41e4031b50 con 0x7f41f8107350 2024-04-23T15:19:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.551+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f819bb90 con 0x7f41f8107350 2024-04-23T15:19:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.551+0000 7f41f4c00640 1 -- 172.21.15.7:0/2437643829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4035030 con 0x7f41f8107350 2024-04-23T15:19:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.551+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f81a3350 con 0x7f41f8107350 2024-04-23T15:19:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.554+0000 7f4201b70740 1 Processor -- start 2024-04-23T15:19:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.554+0000 7f4201b70740 1 -- start start 2024-04-23T15:19:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f4201b70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0eb1b0 0x561b7b0eb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f4201b70740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f4201b70740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0f6390 0x561b7b0f8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f4201b70740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561b7b051900 con 0x561b7b0ebad0 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f4201b70740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b7aff7f20 con 0x561b7b0f6390 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f4201b70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561b7b04d8c0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45932/0 (socket says 172.21.15.7:45932) 2024-04-23T15:19:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f41f7e00640 1 -- 172.21.15.7:0/1382442524 learned_addr learned my addr 172.21.15.7:0/1382442524 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.555+0000 7f41fcc00640 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0eb1b0 0x561b7b0eb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f7e00640 1 -- 172.21.15.7:0/1382442524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0eb1b0 msgr2=0x561b7b0eb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f7e00640 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0eb1b0 0x561b7b0eb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f7e00640 1 -- 172.21.15.7:0/1382442524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0f6390 msgr2=0x561b7b0f8780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f7e00640 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0f6390 0x561b7b0f8780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f7e00640 1 -- 172.21.15.7:0/1382442524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7b01ce10 con 0x561b7b0ebad0 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f7e00640 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5e50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f41e80114f0 tx=0x7f41e80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b128d1b2991db802 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41f4c00640 1 -- 172.21.15.7:0/2437643829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f41e4042070 con 0x7f41f8107350 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41ed200640 1 -- 172.21.15.7:0/1382442524 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e801e070 con 0x561b7b0ebad0 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41ed200640 1 -- 172.21.15.7:0/1382442524 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41e800fad0 con 0x561b7b0ebad0 2024-04-23T15:19:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.556+0000 7f41ed200640 1 -- 172.21.15.7:0/1382442524 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8019a50 con 0x561b7b0ebad0 2024-04-23T15:19:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.557+0000 7f4201b70740 1 -- 172.21.15.7:0/1382442524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 msgr2=0x561b7b0f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.557+0000 7f4201b70740 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5e50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f41e80114f0 tx=0x7f41e80119b0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 -- 172.21.15.7:0/1382442524 shutdown_connections 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0f6390 0x561b7b0f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5e50 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 --2- 172.21.15.7:0/1382442524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0eb1b0 0x561b7b0eb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 -- 172.21.15.7:0/1382442524 >> 172.21.15.7:0/1382442524 conn(0x561b7b0e76c0 msgr2=0x561b7b0e7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f41f4c00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41dc0a3dc0 0x7f41dc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 -- 172.21.15.7:0/1382442524 shutdown_connections 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f41f4c00640 1 -- 172.21.15.7:0/2437643829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f41e40f1330 con 0x7f41f8107350 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 -- 172.21.15.7:0/1382442524 wait complete. 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f41f7e00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41dc0a3dc0 0x7f41dc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.558+0000 7f4201b70740 1 -- start start 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 Processor -- start 2024-04-23T15:19:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f41f7e00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41dc0a3dc0 0x7f41dc0a6280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f41e801c040 tx=0x7f41e8005bd0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561b7b0f8fc0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b7b00b2c0 con 0x561b7b0ebad0 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561b7b0f9140 con 0x561b7b0f6390 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.559+0000 7f4201b70740 10 client.0 _ll_register_callbacks cb 0x561b7ad63a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45942/0 (socket says 172.21.15.7:45942) 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 -- 172.21.15.7:0/4166689007 learned_addr learned my addr 172.21.15.7:0/4166689007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7400640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41fcc00640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 -- 172.21.15.7:0/4166689007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 msgr2=0x561b7b0f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 -- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 msgr2=0x561b7b0f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.560+0000 7f41f7e00640 1 -- 172.21.15.7:0/4166689007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7b01bfd0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f41f7e00640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f3330 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f41e800ff40 tx=0x7f41e8019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18aaa26c729e794 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f41e1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f41e1600640 1 -- 172.21.15.7:0/4166689007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e801e040 con 0x561b7b0eb1b0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f41e1600640 1 -- 172.21.15.7:0/4166689007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f41e8019a00 con 0x561b7b0eb1b0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41e800fad0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f41e1600640 1 -- 172.21.15.7:0/4166689007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f41e803c050 con 0x561b7b0eb1b0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f4201b70740 10 client.17937 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.561+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561b7ad64210 con 0x561b7b0eb1b0 2024-04-23T15:19:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f41e1600640 1 -- 172.21.15.7:0/4166689007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41e800fad0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f41e1600640 1 -- 172.21.15.7:0/4166689007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f41e80057e0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f4201b70740 10 client.17937 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f4201b70740 10 client.17937 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f4201b70740 20 client.17937 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f4201b70740 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b1064e0 0x561b7b1088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f4201b70740 4 client.17937 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.562+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7b05f320 con 0x561b7b1064e0 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.563+0000 7f41f7400640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b1064e0 0x561b7b1088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.564+0000 7f41f7400640 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b1064e0 0x561b7b1088d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c55c56654cf4451 server_cookie=4fd48449d32173e0 in_seq=0 out_seq=0 2024-04-23T15:19:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.564+0000 7f41e1600640 10 client.17937 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f41e1600640 1 -- 172.21.15.7:0/4166689007 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561b7b05f320 con 0x561b7b1064e0 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f41e1600640 10 client.17937 handle_command_reply: tid=0 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 client.17937 shutdown 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 msgr2=0x561b7b0f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f3330 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f41e800ff40 tx=0x7f41e8019670 comp rx=0 tx=0).stop 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 shutdown_connections 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b1064e0 0x561b7b1088d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 --2- 172.21.15.7:0/4166689007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f3330 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f41e1600640 0 client.17937 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 >> 172.21.15.7:0/4166689007 conn(0x561b7b0e76c0 msgr2=0x561b7b0ed3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 shutdown_connections 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.566+0000 7f4201b70740 1 -- 172.21.15.7:0/4166689007 wait complete. 2024-04-23T15:19:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.567+0000 7f4201b70740 20 client.17937 trim_cache size 0 max 16384 2024-04-23T15:19:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.590+0000 7f4201b70740 1 Processor -- start 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 -- start start 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0eb1b0 0x561b7b101e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 0x561b7b10e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81ad0f0 con 0x561b7b0f6390 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81aec30 con 0x561b7b0eb1b0 2024-04-23T15:19:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f4201b70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81ad7c0 con 0x561b7b0ebad0 2024-04-23T15:19:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.591+0000 7f41fcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 0x561b7b10e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 0x561b7b10e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45944/0 (socket says 172.21.15.7:45944) 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 -- 172.21.15.7:0/3901425700 learned_addr learned my addr 172.21.15.7:0/3901425700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41f7400640 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41f7e00640 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0eb1b0 0x561b7b101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 -- 172.21.15.7:0/3901425700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0ebad0 msgr2=0x561b7b0f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 -- 172.21.15.7:0/3901425700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0eb1b0 msgr2=0x561b7b101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0eb1b0 0x561b7b101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.592+0000 7f41fcc00640 1 -- 172.21.15.7:0/3901425700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7ae30620 con 0x561b7b0f6390 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.593+0000 7f41fcc00640 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 0x561b7b10e150 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f41f000be40 tx=0x7f41f0017620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f347500bd3f80c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.593+0000 7f41e3e00640 1 -- 172.21.15.7:0/3901425700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f001f070 con 0x561b7b0f6390 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.593+0000 7f41e3e00640 1 -- 172.21.15.7:0/3901425700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41f001b8e0 con 0x561b7b0f6390 2024-04-23T15:19:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.593+0000 7f41e3e00640 1 -- 172.21.15.7:0/3901425700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f001aa30 con 0x561b7b0f6390 2024-04-23T15:19:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 -- 172.21.15.7:0/3901425700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 msgr2=0x561b7b10e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 0x561b7b10e150 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f41f000be40 tx=0x7f41f0017620 comp rx=0 tx=0).stop 2024-04-23T15:19:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 -- 172.21.15.7:0/3901425700 shutdown_connections 2024-04-23T15:19:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0f6390 0x561b7b10e150 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0ebad0 0x561b7b0f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 --2- 172.21.15.7:0/3901425700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0eb1b0 0x561b7b101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 -- 172.21.15.7:0/3901425700 >> 172.21.15.7:0/3901425700 conn(0x561b7b0e76c0 msgr2=0x561b7b0f4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 -- 172.21.15.7:0/3901425700 shutdown_connections 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 -- 172.21.15.7:0/3901425700 wait complete. 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.594+0000 7f4201b70740 1 -- start start 2024-04-23T15:19:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 Processor -- start 2024-04-23T15:19:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81ae560 con 0x561b7b0eb1b0 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81ade90 con 0x561b7b0ebad0 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41f81ab0f0 con 0x561b7b0f6390 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.595+0000 7f4201b70740 10 client.0 _ll_register_callbacks cb 0x7f41e801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45956/0 (socket says 172.21.15.7:45956) 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 -- 172.21.15.7:0/2101952476 learned_addr learned my addr 172.21.15.7:0/2101952476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7400640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41fcc00640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 -- 172.21.15.7:0/2101952476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 msgr2=0x561b7b0f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 -- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 msgr2=0x561b7b0f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 -- 172.21.15.7:0/2101952476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7b16bbc0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7400640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41fcc00640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41f7e00640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f01e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009de0 tx=0x7f41e80249a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf3e75cf7e8ec0a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.596+0000 7f41e1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.597+0000 7f41e1600640 1 -- 172.21.15.7:0/2101952476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e801e040 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.597+0000 7f41e1600640 1 -- 172.21.15.7:0/2101952476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f41e8011240 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.597+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41f001b8e0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.597+0000 7f41e1600640 1 -- 172.21.15.7:0/2101952476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f41e804f050 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.597+0000 7f4201b70740 10 client.17943 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.597+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561b7b16ce90 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f41e1600640 1 -- 172.21.15.7:0/2101952476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41f001b8e0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f41e1600640 1 -- 172.21.15.7:0/2101952476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f41e804b4f0 con 0x561b7b0eb1b0 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f4201b70740 10 client.17943 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f4201b70740 10 client.17943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f4201b70740 20 client.17943 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f4201b70740 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b16d5d0 0x561b7b16fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f4201b70740 4 client.17943 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.598+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b7b059190 con 0x561b7b16d5d0 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.599+0000 7f41f7400640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b16d5d0 0x561b7b16fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.599+0000 7f41f7400640 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b16d5d0 0x561b7b16fa10 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=249596fa9f807cbc server_cookie=c2ad254160205ff7 in_seq=0 out_seq=0 2024-04-23T15:19:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.599+0000 7f41e1600640 10 client.17943 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.641+0000 7f41e1600640 1 -- 172.21.15.7:0/2101952476 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b7b059190 con 0x561b7b16d5d0 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.641+0000 7f41e1600640 10 client.17943 handle_command_reply: tid=0 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.641+0000 7f4201b70740 1 client.17943 shutdown 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.641+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 msgr2=0x561b7b0f01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.641+0000 7f4201b70740 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f01e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009de0 tx=0x7f41e80249a0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 shutdown_connections 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561b7b16d5d0 0x561b7b16fa10 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b7b0ebad0 0x561b7b0f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561b7b0f6390 0x561b7b0f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 --2- 172.21.15.7:0/2101952476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561b7b0eb1b0 0x561b7b0f01e0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 >> 172.21.15.7:0/2101952476 conn(0x561b7b0e76c0 msgr2=0x561b7b0f3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f41e1600640 0 client.17943 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 shutdown_connections 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 1 -- 172.21.15.7:0/2101952476 wait complete. 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.642+0000 7f4201b70740 20 client.17943 trim_cache size 0 max 16384 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:19:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41dc0a3dc0 msgr2=0x7f41dc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41dc0a3dc0 0x7f41dc0a6280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f41e801c040 tx=0x7f41e8005bd0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 msgr2=0x7f41f8196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 0x7f41f8196a90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f41e4005ab0 tx=0x7f41e4003b90 comp rx=0 tx=0).stop 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 shutdown_connections 2024-04-23T15:19:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f41dc0a3dc0 0x7f41dc0a6280 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f819ae10 0x7f41f819b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f8107350 0x7f41f8196a90 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 --2- 172.21.15.7:0/2437643829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8102280 0x7f41f8196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 >> 172.21.15.7:0/2437643829 conn(0x7f41f8079490 msgr2=0x7f41f80ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.643+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 shutdown_connections 2024-04-23T15:19:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:39.644+0000 7f41fec00640 1 -- 172.21.15.7:0/2437643829 wait complete. 2024-04-23T15:19:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:40 smithi137 ceph-mon[31694]: pgmap v894: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:19:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:40 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:19:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:40 smithi007 ceph-mon[27906]: pgmap v894: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:19:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:40 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:19:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:40 smithi186 ceph-mon[31814]: pgmap v894: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:19:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:40 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:19:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:42 smithi137 ceph-mon[31694]: pgmap v895: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:19:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:42 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:19:43.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:42 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:19:43.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:42 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:19:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:42 smithi007 ceph-mon[27906]: pgmap v895: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:19:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:42 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:19:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:42 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:19:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:42 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:19:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:42 smithi186 ceph-mon[31814]: pgmap v895: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:19:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:42 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:19:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:42 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:19:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:42 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:19:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:44 smithi137 ceph-mon[31694]: pgmap v896: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:19:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:44 smithi007 ceph-mon[27906]: pgmap v896: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:19:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:44 smithi186 ceph-mon[31814]: pgmap v896: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:19:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:46 smithi137 ceph-mon[31694]: pgmap v897: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-04-23T15:19:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:46 smithi007 ceph-mon[27906]: pgmap v897: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-04-23T15:19:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:46 smithi186 ceph-mon[31814]: pgmap v897: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-04-23T15:19:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:48 smithi007 ceph-mon[27906]: pgmap v898: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:19:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:48 smithi186 ceph-mon[31814]: pgmap v898: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:19:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:48 smithi137 ceph-mon[31694]: pgmap v898: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:19:51.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:50 smithi007 ceph-mon[27906]: pgmap v899: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-04-23T15:19:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:50 smithi186 ceph-mon[31814]: pgmap v899: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-04-23T15:19:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:50 smithi137 ceph-mon[31694]: pgmap v899: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-04-23T15:19:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 -- 172.21.15.7:0/4070627677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c1038e0 msgr2=0x7f9c1c10bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 --2- 172.21.15.7:0/4070627677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c1038e0 0x7f9c1c10bdc0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009900 tx=0x7f9c0802a480 comp rx=0 tx=0).stop 2024-04-23T15:19:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 -- 172.21.15.7:0/4070627677 shutdown_connections 2024-04-23T15:19:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 --2- 172.21.15.7:0/4070627677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c10e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 --2- 172.21.15.7:0/4070627677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c1038e0 0x7f9c1c10bdc0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 --2- 172.21.15.7:0/4070627677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c1c102fc0 0x7f9c1c1033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 -- 172.21.15.7:0/4070627677 >> 172.21.15.7:0/4070627677 conn(0x7f9c1c0fc820 msgr2=0x7f9c1c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 -- 172.21.15.7:0/4070627677 shutdown_connections 2024-04-23T15:19:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.806+0000 7f9c21200640 1 -- 172.21.15.7:0/4070627677 wait complete. 2024-04-23T15:19:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.807+0000 7f9c21200640 1 Processor -- start 2024-04-23T15:19:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.807+0000 7f9c21200640 1 -- start start 2024-04-23T15:19:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c21200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c1c102fc0 0x7f9c1c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c21200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c1c1038e0 0x7f9c1c1a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c21200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c21200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c112070 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c21200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c111ef0 con 0x7f9c1c1038e0 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c21200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1121f0 con 0x7f9c1c102fc0 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46366/0 (socket says 172.21.15.7:46366) 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c1be00640 1 -- 172.21.15.7:0/2895539787 learned_addr learned my addr 172.21.15.7:0/2895539787 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c1c1038e0 0x7f9c1c1a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.808+0000 7f9c1b400640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c1c102fc0 0x7f9c1c1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c1be00640 1 -- 172.21.15.7:0/2895539787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c1c102fc0 msgr2=0x7f9c1c1a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c1be00640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c1c102fc0 0x7f9c1c1a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c1be00640 1 -- 172.21.15.7:0/2895539787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c1c1038e0 msgr2=0x7f9c1c1a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c1be00640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c1c1038e0 0x7f9c1c1a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c1be00640 1 -- 172.21.15.7:0/2895539787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c19afd0 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c1be00640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c19a710 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009fd0 tx=0x7f9c1400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c13e00640 1 -- 172.21.15.7:0/2895539787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14017070 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c13e00640 1 -- 172.21.15.7:0/2895539787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c14003e20 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.809+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1c19b2c0 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.810+0000 7f9c13e00640 1 -- 172.21.15.7:0/2895539787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14010460 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.810+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c1a7580 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.813+0000 7f9c13e00640 1 -- 172.21.15.7:0/2895539787 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f9c14003970 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 Processor -- start 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 -- start start 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 0x5635dc8987a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc8a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8a35a0 0x5635dc8a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5635dc7fe900 con 0x5635dc8983c0 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5635dc7a4f20 con 0x5635dc8a35a0 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c257c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5635dc7fa8c0 con 0x5635dc898ce0 2024-04-23T15:19:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.814+0000 7f9c1aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 0x5635dc8987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 0x5635dc8987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46382/0 (socket says 172.21.15.7:46382) 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 -- 172.21.15.7:0/3401157135 learned_addr learned my addr 172.21.15.7:0/3401157135 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc8a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 -- 172.21.15.7:0/3401157135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 msgr2=0x5635dc8a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc8a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 -- 172.21.15.7:0/3401157135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8a35a0 msgr2=0x5635dc8a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8a35a0 0x5635dc8a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.815+0000 7f9c1aa00640 1 -- 172.21.15.7:0/3401157135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635dc7c9e10 con 0x5635dc8983c0 2024-04-23T15:19:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c13e00640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9c000a3d10 0x7f9c000a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 0x5635dc8987a0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9c0802a9a0 tx=0x7f9c08032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24414e4fe6290f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c13e00640 1 -- 172.21.15.7:0/2895539787 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f9c140d0aa0 con 0x7f9c1c10c3e0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c1b400640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9c000a3d10 0x7f9c000a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c10c00640 1 -- 172.21.15.7:0/3401157135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08035050 con 0x5635dc8983c0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c10c00640 1 -- 172.21.15.7:0/3401157135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c08004030 con 0x5635dc8983c0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.816+0000 7f9c10c00640 1 -- 172.21.15.7:0/3401157135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c080054e0 con 0x5635dc8983c0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 -- 172.21.15.7:0/3401157135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 msgr2=0x5635dc8987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 0x5635dc8987a0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9c0802a9a0 tx=0x7f9c08032c00 comp rx=0 tx=0).stop 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c1b400640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9c000a3d10 0x7f9c000a61d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5635dc899960 tx=0x7f9c0c00b4d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 -- 172.21.15.7:0/3401157135 shutdown_connections 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8a35a0 0x5635dc8a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc8a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3401157135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8983c0 0x5635dc8987a0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 -- 172.21.15.7:0/3401157135 >> 172.21.15.7:0/3401157135 conn(0x5635dc8948d0 msgr2=0x5635dc894cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.817+0000 7f9c257c8740 1 -- 172.21.15.7:0/3401157135 shutdown_connections 2024-04-23T15:19:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.818+0000 7f9c257c8740 1 -- 172.21.15.7:0/3401157135 wait complete. 2024-04-23T15:19:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.818+0000 7f9c257c8740 1 -- start start 2024-04-23T15:19:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.818+0000 7f9c257c8740 1 Processor -- start 2024-04-23T15:19:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5635dc8a6080 con 0x5635dc8a35a0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5635dc7b82c0 con 0x5635dc898ce0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5635dc8a6200 con 0x5635dc8983c0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c257c8740 10 client.0 _ll_register_callbacks cb 0x5635dc510a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46384/0 (socket says 172.21.15.7:46384) 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1be00640 1 -- 172.21.15.7:0/3351782081 learned_addr learned my addr 172.21.15.7:0/3351782081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1be00640 1 -- 172.21.15.7:0/3351782081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 msgr2=0x5635dc8a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.819+0000 7f9c1be00640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c1be00640 1 -- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 msgr2=0x5635dc8a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c1be00640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c1be00640 1 -- 172.21.15.7:0/3351782081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635dc7c8fd0 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c1be00640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8a1040 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9c14099000 tx=0x7f9c14003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28da1e736cd59d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c05600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c05600640 1 -- 172.21.15.7:0/3351782081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14020070 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c05600640 1 -- 172.21.15.7:0/3351782081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f9c14098ca0 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c08004030 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c05600640 1 -- 172.21.15.7:0/3351782081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9c1409c630 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.820+0000 7f9c257c8740 10 client.17955 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5635dc511210 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c05600640 1 -- 172.21.15.7:0/3351782081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c08004030 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c05600640 1 -- 172.21.15.7:0/3351782081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9c14098380 con 0x5635dc8a35a0 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 10 client.17955 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 10 client.17955 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 20 client.17955 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc8b3680 0x5635dc8b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 4 client.17955 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:19:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.821+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635dc80c320 con 0x5635dc8b3680 2024-04-23T15:19:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.822+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc8b3680 0x5635dc8b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.823+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc8b3680 0x5635dc8b5a70 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b940c1a22fd0ebb0 server_cookie=91f2d6b4f4131092 in_seq=0 out_seq=0 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.823+0000 7f9c05600640 10 client.17955 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c05600640 1 -- 172.21.15.7:0/3351782081 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5635dc80c320 con 0x5635dc8b3680 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c05600640 10 client.17955 handle_command_reply: tid=0 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 client.17955 shutdown 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 msgr2=0x5635dc8a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8a1040 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9c14099000 tx=0x7f9c14003d20 comp rx=0 tx=0).stop 2024-04-23T15:19:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 shutdown_connections 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc8b3680 0x5635dc8b5a70 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8a1040 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3351782081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 >> 172.21.15.7:0/3351782081 conn(0x5635dc8948d0 msgr2=0x5635dc89a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c05600640 0 client.17955 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 shutdown_connections 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.825+0000 7f9c257c8740 1 -- 172.21.15.7:0/3351782081 wait complete. 2024-04-23T15:19:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.826+0000 7f9c257c8740 20 client.17955 trim_cache size 0 max 16384 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 Processor -- start 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 -- start start 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8bb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1b12a0 con 0x5635dc8a35a0 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1b2de0 con 0x5635dc898ce0 2024-04-23T15:19:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c257c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1b1970 con 0x5635dc8983c0 2024-04-23T15:19:52.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.845+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8bb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8bb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46398/0 (socket says 172.21.15.7:46398) 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 -- 172.21.15.7:0/422413012 learned_addr learned my addr 172.21.15.7:0/422413012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1b400640 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 -- 172.21.15.7:0/422413012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 msgr2=0x5635dc8a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 -- 172.21.15.7:0/422413012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 msgr2=0x5635dc8af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 -- 172.21.15.7:0/422413012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635dc5dd620 con 0x5635dc8a35a0 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.846+0000 7f9c1be00640 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8bb340 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9c14004990 tx=0x7f9c1409ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0aadef3e17dbee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.847+0000 7f9c07e00640 1 -- 172.21.15.7:0/422413012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14014030 con 0x5635dc8a35a0 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.847+0000 7f9c07e00640 1 -- 172.21.15.7:0/422413012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c140a52a0 con 0x5635dc8a35a0 2024-04-23T15:19:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.847+0000 7f9c07e00640 1 -- 172.21.15.7:0/422413012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14020070 con 0x5635dc8a35a0 2024-04-23T15:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 -- 172.21.15.7:0/422413012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 msgr2=0x5635dc8bb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8bb340 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9c14004990 tx=0x7f9c1409ab40 comp rx=0 tx=0).stop 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 -- 172.21.15.7:0/422413012 shutdown_connections 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc898ce0 0x5635dc8af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc8bb340 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 --2- 172.21.15.7:0/422413012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc8983c0 0x5635dc8a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 -- 172.21.15.7:0/422413012 >> 172.21.15.7:0/422413012 conn(0x5635dc8948d0 msgr2=0x5635dc89b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 -- 172.21.15.7:0/422413012 shutdown_connections 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 -- 172.21.15.7:0/422413012 wait complete. 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.848+0000 7f9c257c8740 1 -- start start 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 Processor -- start 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8983c0 0x5635dc89da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc89df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc918bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1b2710 con 0x5635dc8a35a0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1b2040 con 0x5635dc8983c0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c1af2a0 con 0x5635dc898ce0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c257c8740 10 client.0 _ll_register_callbacks cb 0x7f9c140092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc918bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c1be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc918bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46412/0 (socket says 172.21.15.7:46412) 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.849+0000 7f9c1be00640 1 -- 172.21.15.7:0/3120637184 learned_addr learned my addr 172.21.15.7:0/3120637184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8983c0 0x5635dc89da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1aa00640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc89df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1be00640 1 -- 172.21.15.7:0/3120637184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 msgr2=0x5635dc89df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1be00640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc89df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1be00640 1 -- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8983c0 msgr2=0x5635dc89da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1be00640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8983c0 0x5635dc89da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1be00640 1 -- 172.21.15.7:0/3120637184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635dc9190f0 con 0x5635dc8a35a0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c1be00640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc918bb0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9c14003ff0 tx=0x7f9c14098210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d7b91c8215cd23 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.850+0000 7f9c05600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c05600640 1 -- 172.21.15.7:0/3120637184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14014030 con 0x5635dc8a35a0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c05600640 1 -- 172.21.15.7:0/3120637184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7f9c14085b70 con 0x5635dc8a35a0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c140a52a0 con 0x5635dc8a35a0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c05600640 1 -- 172.21.15.7:0/3120637184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9c14020070 con 0x5635dc8a35a0 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c257c8740 10 client.17961 fetch_fsmap learned FSMap version 32 2024-04-23T15:19:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5635dc9190f0 con 0x5635dc8a35a0 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c05600640 1 -- 172.21.15.7:0/3120637184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c140a52a0 con 0x5635dc8a35a0 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.851+0000 7f9c05600640 1 -- 172.21.15.7:0/3120637184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9c1409ba80 con 0x5635dc8a35a0 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.852+0000 7f9c257c8740 10 client.17961 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.852+0000 7f9c257c8740 10 client.17961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.852+0000 7f9c257c8740 20 client.17961 populate_metadata read hostname 'smithi007' 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.852+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc91a6a0 0x5635dc91ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.852+0000 7f9c257c8740 4 client.17961 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.852+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635dc806190 con 0x5635dc91a6a0 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.853+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc91a6a0 0x5635dc91ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:19:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.854+0000 7f9c1b400640 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc91a6a0 0x5635dc91ca90 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae1374a64677509 server_cookie=3b4707b2fb7992d8 in_seq=0 out_seq=0 2024-04-23T15:19:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.854+0000 7f9c05600640 10 client.17961 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c05600640 1 -- 172.21.15.7:0/3120637184 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635dc806190 con 0x5635dc91a6a0 2024-04-23T15:19:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c05600640 10 client.17961 handle_command_reply: tid=0 2024-04-23T15:19:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 client.17961 shutdown 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 msgr2=0x5635dc918bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc918bb0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9c14003ff0 tx=0x7f9c14098210 comp rx=0 tx=0).stop 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 shutdown_connections 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5635dc91a6a0 0x5635dc91ca90 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635dc8a35a0 0x5635dc918bb0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635dc898ce0 0x5635dc89df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 --2- 172.21.15.7:0/3120637184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635dc8983c0 0x5635dc89da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c05600640 0 client.17961 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.889+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 >> 172.21.15.7:0/3120637184 conn(0x5635dc8948d0 msgr2=0x5635dc893200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.890+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 shutdown_connections 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.890+0000 7f9c257c8740 1 -- 172.21.15.7:0/3120637184 wait complete. 2024-04-23T15:19:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.890+0000 7f9c257c8740 20 client.17961 trim_cache size 0 max 16384 2024-04-23T15:19:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:19:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:19:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:19:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9c000a3d10 msgr2=0x7f9c000a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9c000a3d10 0x7f9c000a61d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5635dc899960 tx=0x7f9c0c00b4d0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 msgr2=0x7f9c1c19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c19a710 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009fd0 tx=0x7f9c1400b260 comp rx=0 tx=0).stop 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 shutdown_connections 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9c000a3d10 0x7f9c000a61d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c1c1038e0 0x7f9c1c1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c1c10c3e0 0x7f9c1c19a710 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 --2- 172.21.15.7:0/2895539787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c1c102fc0 0x7f9c1c1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 >> 172.21.15.7:0/2895539787 conn(0x7f9c1c0fc820 msgr2=0x7f9c1c101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 shutdown_connections 2024-04-23T15:19:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:19:52.891+0000 7f9c21200640 1 -- 172.21.15.7:0/2895539787 wait complete. 2024-04-23T15:19:53.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:52 smithi007 ceph-mon[27906]: pgmap v900: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-04-23T15:19:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:52 smithi186 ceph-mon[31814]: pgmap v900: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-04-23T15:19:53.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:52 smithi137 ceph-mon[31694]: pgmap v900: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-04-23T15:19:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:54 smithi007 ceph-mon[27906]: pgmap v901: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:19:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:54 smithi186 ceph-mon[31814]: pgmap v901: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:19:55.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:54 smithi137 ceph-mon[31694]: pgmap v901: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:19:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:56 smithi007 ceph-mon[27906]: pgmap v902: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:19:57.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:56 smithi186 ceph-mon[31814]: pgmap v902: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:19:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:56 smithi137 ceph-mon[31694]: pgmap v902: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-04-23T15:19:58.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:19:58 smithi007 ceph-mon[27906]: pgmap v903: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:19:58.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:19:58 smithi186 ceph-mon[31814]: pgmap v903: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:19:58.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:19:58 smithi137 ceph-mon[31694]: pgmap v903: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:20:00.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:00 smithi007 ceph-mon[27906]: pgmap v904: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:20:00.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T15:20:00.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:00 smithi186 ceph-mon[31814]: pgmap v904: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:20:00.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T15:20:00.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:00 smithi137 ceph-mon[31694]: pgmap v904: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:20:00.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T15:20:02.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:02 smithi007 ceph-mon[27906]: pgmap v905: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:20:02.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:02 smithi186 ceph-mon[31814]: pgmap v905: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:20:02.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:02 smithi137 ceph-mon[31694]: pgmap v905: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:20:04.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:04 smithi007 ceph-mon[27906]: pgmap v906: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.8 MiB/s wr, 36 op/s 2024-04-23T15:20:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:04 smithi186 ceph-mon[31814]: pgmap v906: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.8 MiB/s wr, 36 op/s 2024-04-23T15:20:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:04 smithi137 ceph-mon[31694]: pgmap v906: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.8 MiB/s wr, 36 op/s 2024-04-23T15:20:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1976022822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 msgr2=0x7fb5c010e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1976022822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c010e480 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009900 tx=0x7fb5ac02a410 comp rx=0 tx=0).stop 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1976022822 shutdown_connections 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1976022822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 0x7fb5c0110db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1976022822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c010e480 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1976022822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c0100e10 0x7fb5c01011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.059+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1976022822 >> 172.21.15.7:0/1976022822 conn(0x7fb5c0078080 msgr2=0x7fb5c0078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.060+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1976022822 shutdown_connections 2024-04-23T15:20:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.060+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1976022822 wait complete. 2024-04-23T15:20:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.061+0000 7fb5c7e00640 1 Processor -- start 2024-04-23T15:20:06.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.061+0000 7fb5c7e00640 1 -- start start 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c0100e10 0x7fb5c01a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c01a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 0x7fb5c019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01144f0 con 0x7fb5c0101730 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0114370 con 0x7fb5c010e9c0 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0114670 con 0x7fb5c0100e10 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c01a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c01a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46710/0 (socket says 172.21.15.7:46710) 2024-04-23T15:20:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c4a00640 1 -- 172.21.15.7:0/1081417540 learned_addr learned my addr 172.21.15.7:0/1081417540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:06.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c5400640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c0100e10 0x7fb5c01a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.062+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 0x7fb5c019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c4a00640 1 -- 172.21.15.7:0/1081417540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c0100e10 msgr2=0x7fb5c01a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c0100e10 0x7fb5c01a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c4a00640 1 -- 172.21.15.7:0/1081417540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 msgr2=0x7fb5c019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 0x7fb5c019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c4a00640 1 -- 172.21.15.7:0/1081417540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c019b000 con 0x7fb5c0101730 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 0x7fb5c019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.063+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c01a0c00 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac005ab0 tx=0x7fb5ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.064+0000 7fb5be000640 1 -- 172.21.15.7:0/1081417540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac03f070 con 0x7fb5c0101730 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.064+0000 7fb5be000640 1 -- 172.21.15.7:0/1081417540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5ac031b60 con 0x7fb5c0101730 2024-04-23T15:20:06.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.064+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c019b290 con 0x7fb5c0101730 2024-04-23T15:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.064+0000 7fb5be000640 1 -- 172.21.15.7:0/1081417540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac035030 con 0x7fb5c0101730 2024-04-23T15:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.064+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c01a7510 con 0x7fb5c0101730 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.068+0000 7fb5cac40740 1 Processor -- start 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 -- start start 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5be000640 1 -- 172.21.15.7:0/1081417540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb5ac042070 con 0x7fb5c0101730 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe28e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe298e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe29b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c6fe1f4900 con 0x55c6fe299390 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c6fe19af20 con 0x55c6fe28e1b0 2024-04-23T15:20:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5cac40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c6fe1f08c0 con 0x55c6fe28ead0 2024-04-23T15:20:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.069+0000 7fb5c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe29b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe29b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46714/0 (socket says 172.21.15.7:46714) 2024-04-23T15:20:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 -- 172.21.15.7:0/2744081230 learned_addr learned my addr 172.21.15.7:0/2744081230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe28e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c5400640 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe298e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 -- 172.21.15.7:0/2744081230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 msgr2=0x55c6fe298e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe298e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 -- 172.21.15.7:0/2744081230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 msgr2=0x55c6fe28e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe28e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.070+0000 7fb5c4a00640 1 -- 172.21.15.7:0/2744081230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6fe1bfe10 con 0x55c6fe299390 2024-04-23T15:20:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe29b780 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ee600 tx=0x7fb5ac0f9600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b65dfbaed130df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5be000640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb5a80a3e40 0x7fb5a80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5b2600640 1 -- 172.21.15.7:0/2744081230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0f3110 con 0x55c6fe299390 2024-04-23T15:20:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5b2600640 1 -- 172.21.15.7:0/2744081230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5ac0bd610 con 0x55c6fe299390 2024-04-23T15:20:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5b2600640 1 -- 172.21.15.7:0/2744081230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0d2d80 con 0x55c6fe299390 2024-04-23T15:20:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5be000640 1 -- 172.21.15.7:0/1081417540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7fb5ac0f1380 con 0x7fb5c0101730 2024-04-23T15:20:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.071+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb5a80a3e40 0x7fb5a80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.072+0000 7fb5cac40740 1 -- 172.21.15.7:0/2744081230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 msgr2=0x55c6fe29b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.072+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe29b780 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ee600 tx=0x7fb5ac0f9600 comp rx=0 tx=0).stop 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.072+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb5a80a3e40 0x7fb5a80a6300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5c006b7e0 tx=0x7fb5b8005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.072+0000 7fb5cac40740 1 -- 172.21.15.7:0/2744081230 shutdown_connections 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.072+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe29b780 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe298e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2744081230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe28e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 -- 172.21.15.7:0/2744081230 >> 172.21.15.7:0/2744081230 conn(0x55c6fe28a6c0 msgr2=0x55c6fe28aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 -- 172.21.15.7:0/2744081230 shutdown_connections 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 -- 172.21.15.7:0/2744081230 wait complete. 2024-04-23T15:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 -- start start 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.073+0000 7fb5cac40740 1 Processor -- start 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28e1b0 0x55c6fe296290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28ead0 0x55c6fe2967d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe296d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c6fe29bd80 con 0x55c6fe299390 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c6fe1ae2c0 con 0x55c6fe28ead0 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c6fe29bf00 con 0x55c6fe28e1b0 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5cac40740 10 client.0 _ll_register_callbacks cb 0x55c6fdf06a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe296d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe296d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46726/0 (socket says 172.21.15.7:46726) 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.074+0000 7fb5c5e00640 1 -- 172.21.15.7:0/1790588886 learned_addr learned my addr 172.21.15.7:0/1790588886 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28ead0 0x55c6fe2967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5400640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28e1b0 0x55c6fe296290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5e00640 1 -- 172.21.15.7:0/1790588886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28e1b0 msgr2=0x55c6fe296290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28e1b0 0x55c6fe296290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5e00640 1 -- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28ead0 msgr2=0x55c6fe2967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28ead0 0x55c6fe2967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5e00640 1 -- 172.21.15.7:0/1790588886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6fe1befd0 con 0x55c6fe299390 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe296d10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80206d0 tx=0x7fb5b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1df0f60af5c2abf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.075+0000 7fb5a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5a6a00640 1 -- 172.21.15.7:0/1790588886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b802d060 con 0x55c6fe299390 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5a6a00640 1 -- 172.21.15.7:0/1790588886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7fb5b8018030 con 0x55c6fe299390 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5ac0bd610 con 0x55c6fe299390 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5a6a00640 1 -- 172.21.15.7:0/1790588886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb5b8034050 con 0x55c6fe299390 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5cac40740 10 client.17973 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c6fdf07210 con 0x55c6fe299390 2024-04-23T15:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.076+0000 7fb5a6a00640 1 -- 172.21.15.7:0/1790588886 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5ac0bd610 con 0x55c6fe299390 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5a6a00640 1 -- 172.21.15.7:0/1790588886 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb5b80288f0 con 0x55c6fe299390 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5cac40740 10 client.17973 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5cac40740 10 client.17973 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5cac40740 20 client.17973 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5cac40740 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe2a91c0 0x55c6fe2ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5cac40740 4 client.17973 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.077+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6fe202320 con 0x55c6fe2a91c0 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.078+0000 7fb5c5400640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe2a91c0 0x55c6fe2ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.079+0000 7fb5c5400640 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe2a91c0 0x55c6fe2ab5b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad8a5f35f8f6654 server_cookie=a6d8ccef2b8c426b in_seq=0 out_seq=0 2024-04-23T15:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.079+0000 7fb5a6a00640 10 client.17973 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.080+0000 7fb5a6a00640 1 -- 172.21.15.7:0/1790588886 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c6fe202320 con 0x55c6fe2a91c0 2024-04-23T15:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.080+0000 7fb5a6a00640 10 client.17973 handle_command_reply: tid=0 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.080+0000 7fb5cac40740 1 client.17973 shutdown 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 msgr2=0x55c6fe296d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe296d10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80206d0 tx=0x7fb5b8004730 comp rx=0 tx=0).stop 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 shutdown_connections 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe2a91c0 0x55c6fe2ab5b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28ead0 0x55c6fe2967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe296d10 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 --2- 172.21.15.7:0/1790588886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28e1b0 0x55c6fe296290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5a6a00640 0 client.17973 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 >> 172.21.15.7:0/1790588886 conn(0x55c6fe28a6c0 msgr2=0x55c6fe2903f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 shutdown_connections 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 1 -- 172.21.15.7:0/1790588886 wait complete. 2024-04-23T15:20:06.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.081+0000 7fb5cac40740 20 client.17973 trim_cache size 0 max 16384 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 Processor -- start 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 -- start start 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe289fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe2b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01b15d0 con 0x55c6fe299390 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01b3110 con 0x55c6fe28e1b0 2024-04-23T15:20:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.098+0000 7fb5cac40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01b1ca0 con 0x55c6fe28ead0 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe2b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe2b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46732/0 (socket says 172.21.15.7:46732) 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 -- 172.21.15.7:0/3942003388 learned_addr learned my addr 172.21.15.7:0/3942003388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe289fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 -- 172.21.15.7:0/3942003388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 msgr2=0x55c6fe289fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe289fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 -- 172.21.15.7:0/3942003388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 msgr2=0x55c6fe2a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.099+0000 7fb5c5e00640 1 -- 172.21.15.7:0/3942003388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6fdfd3620 con 0x55c6fe299390 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.100+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe2b0ec0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8028cc0 tx=0x7fb5b8011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15441ec1816e3fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.100+0000 7fb5b1c00640 1 -- 172.21.15.7:0/3942003388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011a90 con 0x55c6fe299390 2024-04-23T15:20:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.100+0000 7fb5b1c00640 1 -- 172.21.15.7:0/3942003388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5b80099b0 con 0x55c6fe299390 2024-04-23T15:20:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.100+0000 7fb5b1c00640 1 -- 172.21.15.7:0/3942003388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b801d770 con 0x55c6fe299390 2024-04-23T15:20:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 -- 172.21.15.7:0/3942003388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 msgr2=0x55c6fe2b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe2b0ec0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8028cc0 tx=0x7fb5b8011500 comp rx=0 tx=0).stop 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 -- 172.21.15.7:0/3942003388 shutdown_connections 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe299390 0x55c6fe2b0ec0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe289fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 --2- 172.21.15.7:0/3942003388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 -- 172.21.15.7:0/3942003388 >> 172.21.15.7:0/3942003388 conn(0x55c6fe28a6c0 msgr2=0x55c6fe2903f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 -- 172.21.15.7:0/3942003388 shutdown_connections 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.101+0000 7fb5cac40740 1 -- 172.21.15.7:0/3942003388 wait complete. 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.102+0000 7fb5cac40740 1 -- start start 2024-04-23T15:20:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.102+0000 7fb5cac40740 1 Processor -- start 2024-04-23T15:20:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2930c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe293600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe299390 0x55c6fe293b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01b2a40 con 0x55c6fe28e1b0 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01b2370 con 0x55c6fe299390 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01af5d0 con 0x55c6fe28ead0 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5cac40740 10 client.0 _ll_register_callbacks cb 0x7fb5b8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5c5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5c5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2930c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46740/0 (socket says 172.21.15.7:46740) 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5c5400640 1 -- 172.21.15.7:0/2134528802 learned_addr learned my addr 172.21.15.7:0/2134528802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe293600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.103+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe299390 0x55c6fe293b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5400640 1 -- 172.21.15.7:0/2134528802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 msgr2=0x55c6fe293600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5400640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe293600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5400640 1 -- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe299390 msgr2=0x55c6fe293b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5400640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe299390 0x55c6fe293b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5400640 1 -- 172.21.15.7:0/2134528802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6fe3170a0 con 0x55c6fe28e1b0 2024-04-23T15:20:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5e00640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe299390 0x55c6fe293b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5c5400640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2930c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x55c6fe2abe30 tx=0x7fb5b4003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed4a9901c42609 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.104+0000 7fb5a6a00640 1 -- 172.21.15.7:0/2134528802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4011b70 con 0x55c6fe28e1b0 2024-04-23T15:20:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5b80099b0 con 0x55c6fe28e1b0 2024-04-23T15:20:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5a6a00640 1 -- 172.21.15.7:0/2134528802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9467+0+0 (secure 0 0 0) 0x7fb5b4011d10 con 0x55c6fe28e1b0 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5a6a00640 1 -- 172.21.15.7:0/2134528802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb5b402f050 con 0x55c6fe28e1b0 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5cac40740 10 client.17979 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c6fe3183f0 con 0x55c6fe28e1b0 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5a6a00640 1 -- 172.21.15.7:0/2134528802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5b80099b0 con 0x55c6fe28e1b0 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5a6a00640 1 -- 172.21.15.7:0/2134528802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb5b401d660 con 0x55c6fe28e1b0 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5cac40740 10 client.17979 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.105+0000 7fb5cac40740 10 client.17979 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.106+0000 7fb5cac40740 20 client.17979 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.106+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe318b50 0x55c6fe31af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.106+0000 7fb5cac40740 4 client.17979 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.106+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6fe1fc190 con 0x55c6fe318b50 2024-04-23T15:20:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.106+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe318b50 0x55c6fe31af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.107+0000 7fb5c4a00640 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe318b50 0x55c6fe31af70 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8d95293241cced server_cookie=374002f3ba047281 in_seq=0 out_seq=0 2024-04-23T15:20:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.107+0000 7fb5a6a00640 10 client.17979 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5a6a00640 1 -- 172.21.15.7:0/2134528802 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c6fe1fc190 con 0x55c6fe318b50 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5a6a00640 10 client.17979 handle_command_reply: tid=0 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 client.17979 shutdown 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 msgr2=0x55c6fe2930c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2930c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x55c6fe2abe30 tx=0x7fb5b4003d10 comp rx=0 tx=0).stop 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 shutdown_connections 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c6fe318b50 0x55c6fe31af70 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6fe299390 0x55c6fe293b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c6fe28ead0 0x55c6fe293600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5cac40740 1 --2- 172.21.15.7:0/2134528802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c6fe28e1b0 0x55c6fe2930c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.146+0000 7fb5a6a00640 0 client.17979 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.147+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 >> 172.21.15.7:0/2134528802 conn(0x55c6fe28a6c0 msgr2=0x55c6fe296250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.147+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 shutdown_connections 2024-04-23T15:20:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.147+0000 7fb5cac40740 1 -- 172.21.15.7:0/2134528802 wait complete. 2024-04-23T15:20:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.147+0000 7fb5cac40740 20 client.17979 trim_cache size 0 max 16384 2024-04-23T15:20:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:20:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:20:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:20:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb5a80a3e40 msgr2=0x7fb5a80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb5a80a3e40 0x7fb5a80a6300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5c006b7e0 tx=0x7fb5b8005f90 comp rx=0 tx=0).stop 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 msgr2=0x7fb5c01a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c01a0c00 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac005ab0 tx=0x7fb5ac003c10 comp rx=0 tx=0).stop 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 shutdown_connections 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb5a80a3e40 0x7fb5a80a6300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5c010e9c0 0x7fb5c019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5c0101730 0x7fb5c01a0c00 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 --2- 172.21.15.7:0/1081417540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c0100e10 0x7fb5c01a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 >> 172.21.15.7:0/1081417540 conn(0x7fb5c0078080 msgr2=0x7fb5c010feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 shutdown_connections 2024-04-23T15:20:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:06.148+0000 7fb5c7e00640 1 -- 172.21.15.7:0/1081417540 wait complete. 2024-04-23T15:20:06.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:06 smithi007 ceph-mon[27906]: pgmap v907: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 3.4 MiB/s wr, 31 op/s 2024-04-23T15:20:06.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:06 smithi186 ceph-mon[31814]: pgmap v907: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 3.4 MiB/s wr, 31 op/s 2024-04-23T15:20:06.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:06 smithi137 ceph-mon[31694]: pgmap v907: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 3.4 MiB/s wr, 31 op/s 2024-04-23T15:20:08.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:08 smithi007 ceph-mon[27906]: pgmap v908: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.4 MiB/s wr, 40 op/s 2024-04-23T15:20:08.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:08 smithi186 ceph-mon[31814]: pgmap v908: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.4 MiB/s wr, 40 op/s 2024-04-23T15:20:08.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:08 smithi137 ceph-mon[31694]: pgmap v908: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.4 MiB/s wr, 40 op/s 2024-04-23T15:20:09.514 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:09 smithi186 ceph-mon[31814]: osdmap e137: 12 total, 12 up, 12 in 2024-04-23T15:20:09.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:09 smithi007 ceph-mon[27906]: osdmap e137: 12 total, 12 up, 12 in 2024-04-23T15:20:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:09 smithi137 ceph-mon[31694]: osdmap e137: 12 total, 12 up, 12 in 2024-04-23T15:20:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:10 smithi007 ceph-mon[27906]: pgmap v910: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:20:10.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:10 smithi186 ceph-mon[31814]: pgmap v910: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:20:10.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:10 smithi137 ceph-mon[31694]: pgmap v910: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:20:12.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:12 smithi007 ceph-mon[27906]: pgmap v911: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:20:12.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:12 smithi186 ceph-mon[31814]: pgmap v911: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:20:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:12 smithi137 ceph-mon[31694]: pgmap v911: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:20:14.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:14 smithi007 ceph-mon[27906]: pgmap v912: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:20:14.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:14 smithi186 ceph-mon[31814]: pgmap v912: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:20:14.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:14 smithi137 ceph-mon[31694]: pgmap v912: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:20:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:16 smithi007 ceph-mon[27906]: pgmap v913: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:20:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:16 smithi007 ceph-mon[27906]: osdmap e138: 12 total, 12 up, 12 in 2024-04-23T15:20:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:16 smithi186 ceph-mon[31814]: pgmap v913: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:20:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:16 smithi186 ceph-mon[31814]: osdmap e138: 12 total, 12 up, 12 in 2024-04-23T15:20:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:16 smithi137 ceph-mon[31694]: pgmap v913: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:20:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:16 smithi137 ceph-mon[31694]: osdmap e138: 12 total, 12 up, 12 in 2024-04-23T15:20:19.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:18 smithi186 ceph-mon[31814]: pgmap v915: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.4 MiB/s wr, 14 op/s 2024-04-23T15:20:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:18 smithi137 ceph-mon[31694]: pgmap v915: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.4 MiB/s wr, 14 op/s 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 -- 172.21.15.7:0/1910295323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 msgr2=0x7f1b78102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 --2- 172.21.15.7:0/1910295323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b78102470 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009900 tx=0x7f1b6002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 -- 172.21.15.7:0/1910295323 shutdown_connections 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 --2- 172.21.15.7:0/1910295323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b78107160 0x7f1b7810ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 --2- 172.21.15.7:0/1910295323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b78102a40 0x7f1b78106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 --2- 172.21.15.7:0/1910295323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b78102470 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 -- 172.21.15.7:0/1910295323 >> 172.21.15.7:0/1910295323 conn(0x7f1b780fd950 msgr2=0x7f1b780ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 -- 172.21.15.7:0/1910295323 shutdown_connections 2024-04-23T15:20:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.301+0000 7f1b77e00640 1 -- 172.21.15.7:0/1910295323 wait complete. 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.302+0000 7f1b77e00640 1 Processor -- start 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.302+0000 7f1b77e00640 1 -- start start 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b781a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b77e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b78107160 0x7f1b781a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b77e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7819a610 0x7f1b7819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b77e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781120f0 con 0x7f1b78102090 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b77e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78111f70 con 0x7f1b7819a610 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b77e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78112270 con 0x7f1b78107160 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b781a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b781a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53450/0 (socket says 172.21.15.7:53450) 2024-04-23T15:20:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.303+0000 7f1b76a00640 1 -- 172.21.15.7:0/2744045542 learned_addr learned my addr 172.21.15.7:0/2744045542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b6e000640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b78107160 0x7f1b781a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b77400640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7819a610 0x7f1b7819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b76a00640 1 -- 172.21.15.7:0/2744045542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b78107160 msgr2=0x7f1b781a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b76a00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b78107160 0x7f1b781a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b76a00640 1 -- 172.21.15.7:0/2744045542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7819a610 msgr2=0x7f1b7819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b76a00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7819a610 0x7f1b7819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b76a00640 1 -- 172.21.15.7:0/2744045542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7819b130 con 0x7f1b78102090 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b77400640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7819a610 0x7f1b7819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.304+0000 7f1b76a00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b781a0460 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f1b60005ab0 tx=0x7f1b60003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.305+0000 7f1b6fe00640 1 -- 172.21.15.7:0/2744045542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6003f070 con 0x7f1b78102090 2024-04-23T15:20:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.305+0000 7f1b6fe00640 1 -- 172.21.15.7:0/2744045542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b60031d60 con 0x7f1b78102090 2024-04-23T15:20:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.305+0000 7f1b6fe00640 1 -- 172.21.15.7:0/2744045542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60035030 con 0x7f1b78102090 2024-04-23T15:20:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.305+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7819b3c0 con 0x7f1b78102090 2024-04-23T15:20:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.305+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b781a7560 con 0x7f1b78102090 2024-04-23T15:20:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.309+0000 7f1b80476740 1 Processor -- start 2024-04-23T15:20:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.309+0000 7f1b6fe00640 1 -- 172.21.15.7:0/2744045542 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1b60042070 con 0x7f1b78102090 2024-04-23T15:20:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.309+0000 7f1b80476740 1 -- start start 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b80476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585f3c0 0x56057585f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b80476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585fce0 0x56057586a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b80476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x56057586c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b80476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5605757c5900 con 0x56057586a5a0 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b80476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56057576bf20 con 0x56057585fce0 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b80476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5605757c18c0 con 0x56057585f3c0 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b6e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x56057586c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b6e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x56057586c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53452/0 (socket says 172.21.15.7:53452) 2024-04-23T15:20:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b6e000640 1 -- 172.21.15.7:0/1378777386 learned_addr learned my addr 172.21.15.7:0/1378777386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b76a00640 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585fce0 0x56057586a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.310+0000 7f1b77400640 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585f3c0 0x56057585f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6e000640 1 -- 172.21.15.7:0/1378777386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585f3c0 msgr2=0x56057585f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6e000640 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585f3c0 0x56057585f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6e000640 1 -- 172.21.15.7:0/1378777386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585fce0 msgr2=0x56057586a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6e000640 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585fce0 0x56057586a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6e000640 1 -- 172.21.15.7:0/1378777386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560575790e10 con 0x56057586a5a0 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b76a00640 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585fce0 0x56057586a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1b5c0a3d90 0x7f1b5c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6e000640 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x56057586c990 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800bc10 tx=0x7f1b6800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caba2ca5deb6f91 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b6fe00640 1 -- 172.21.15.7:0/2744045542 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7f1b600f1540 con 0x7f1b78102090 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b77400640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1b5c0a3d90 0x7f1b5c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.311+0000 7f1b67400640 1 -- 172.21.15.7:0/1378777386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68015070 con 0x56057586a5a0 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.312+0000 7f1b67400640 1 -- 172.21.15.7:0/1378777386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b6801a910 con 0x56057586a5a0 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.312+0000 7f1b67400640 1 -- 172.21.15.7:0/1378777386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680118e0 con 0x56057586a5a0 2024-04-23T15:20:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.312+0000 7f1b80476740 1 -- 172.21.15.7:0/1378777386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 msgr2=0x56057586c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.312+0000 7f1b80476740 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x56057586c990 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800bc10 tx=0x7f1b6800f730 comp rx=0 tx=0).stop 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.312+0000 7f1b77400640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1b5c0a3d90 0x7f1b5c0a6250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007e70 tx=0x7f1b70007850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 -- 172.21.15.7:0/1378777386 shutdown_connections 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585fce0 0x56057586a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x56057586c990 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 --2- 172.21.15.7:0/1378777386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585f3c0 0x56057585f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 -- 172.21.15.7:0/1378777386 >> 172.21.15.7:0/1378777386 conn(0x56057585b8d0 msgr2=0x56057585bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 -- 172.21.15.7:0/1378777386 shutdown_connections 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 -- 172.21.15.7:0/1378777386 wait complete. 2024-04-23T15:20:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 -- start start 2024-04-23T15:20:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.313+0000 7f1b80476740 1 Processor -- start 2024-04-23T15:20:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575867560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 0x560575867aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057586a5a0 0x560575867fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56057586d0e0 con 0x56057585fce0 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56057577f2c0 con 0x56057585f3c0 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56057586d260 con 0x56057586a5a0 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b80476740 10 client.0 _ll_register_callbacks cb 0x5605754d7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b6e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 0x560575867aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b6e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 0x560575867aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53454/0 (socket says 172.21.15.7:53454) 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.314+0000 7f1b6e000640 1 -- 172.21.15.7:0/3590801291 learned_addr learned my addr 172.21.15.7:0/3590801291 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b76a00640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575867560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b6e000640 1 -- 172.21.15.7:0/3590801291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057586a5a0 msgr2=0x560575867fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b6e000640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057586a5a0 0x560575867fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b6e000640 1 -- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 msgr2=0x560575867560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b6e000640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575867560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b6e000640 1 -- 172.21.15.7:0/3590801291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057578ffd0 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b76a00640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575867560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b6e000640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 0x560575867aa0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800b750 tx=0x7f1b6800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec64553facbc027 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.315+0000 7f1b5be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.316+0000 7f1b5be00640 1 -- 172.21.15.7:0/3590801291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68015040 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.316+0000 7f1b5be00640 1 -- 172.21.15.7:0/3590801291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7f1b6801aac0 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.316+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b6801a910 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.316+0000 7f1b5be00640 1 -- 172.21.15.7:0/3590801291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1b68031050 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.316+0000 7f1b80476740 10 client.17991 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.316+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5605754d8210 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b5be00640 1 -- 172.21.15.7:0/3590801291 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b6801a910 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b5be00640 1 -- 172.21.15.7:0/3590801291 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1b680039a0 con 0x56057585fce0 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b80476740 10 client.17991 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b80476740 10 client.17991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b80476740 20 client.17991 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b80476740 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56057587a550 0x56057587c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b80476740 4 client.17991 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:20:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.317+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605757d3320 con 0x56057587a550 2024-04-23T15:20:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.318+0000 7f1b76a00640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56057587a550 0x56057587c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.319+0000 7f1b76a00640 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56057587a550 0x56057587c940 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a3fe09266639714 server_cookie=7e2168010de29e8f in_seq=0 out_seq=0 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.319+0000 7f1b5be00640 10 client.17991 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b5be00640 1 -- 172.21.15.7:0/3590801291 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5605757d3320 con 0x56057587a550 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b5be00640 10 client.17991 handle_command_reply: tid=0 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 client.17991 shutdown 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 msgr2=0x560575867aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 0x560575867aa0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800b750 tx=0x7f1b6800b780 comp rx=0 tx=0).stop 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 shutdown_connections 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56057587a550 0x56057587c940 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057586a5a0 0x560575867fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585fce0 0x560575867aa0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 --2- 172.21.15.7:0/3590801291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575867560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 >> 172.21.15.7:0/3590801291 conn(0x56057585b8d0 msgr2=0x56057585aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b5be00640 0 client.17991 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 shutdown_connections 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.321+0000 7f1b80476740 1 -- 172.21.15.7:0/3590801291 wait complete. 2024-04-23T15:20:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.322+0000 7f1b80476740 20 client.17991 trim_cache size 0 max 16384 2024-04-23T15:20:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:18 smithi007 ceph-mon[27906]: pgmap v915: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.4 MiB/s wr, 14 op/s 2024-04-23T15:20:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 Processor -- start 2024-04-23T15:20:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 -- start start 2024-04-23T15:20:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575869c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x56057585b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x5605758760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b13e0 con 0x56057586a5a0 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b2f20 con 0x56057585f3c0 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.339+0000 7f1b80476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b1ab0 con 0x56057585fce0 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x5605758760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x5605758760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53470/0 (socket says 172.21.15.7:53470) 2024-04-23T15:20:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 -- 172.21.15.7:0/338401117 learned_addr learned my addr 172.21.15.7:0/338401117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 -- 172.21.15.7:0/338401117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 msgr2=0x56057585b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x56057585b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 -- 172.21.15.7:0/338401117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 msgr2=0x560575869c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575869c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.340+0000 7f1b77400640 1 -- 172.21.15.7:0/338401117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605755a4620 con 0x56057586a5a0 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.341+0000 7f1b77400640 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x5605758760e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007490 tx=0x7f1b70013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2027a6bd95c9cf8f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.341+0000 7f1b66a00640 1 -- 172.21.15.7:0/338401117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7001e8f0 con 0x56057586a5a0 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.341+0000 7f1b66a00640 1 -- 172.21.15.7:0/338401117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b7001c3b0 con 0x56057586a5a0 2024-04-23T15:20:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.342+0000 7f1b66a00640 1 -- 172.21.15.7:0/338401117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7001d610 con 0x56057586a5a0 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 -- 172.21.15.7:0/338401117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 msgr2=0x5605758760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x5605758760e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007490 tx=0x7f1b70013070 comp rx=0 tx=0).stop 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 -- 172.21.15.7:0/338401117 shutdown_connections 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057586a5a0 0x5605758760e0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x56057585b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 --2- 172.21.15.7:0/338401117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057585f3c0 0x560575869c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 -- 172.21.15.7:0/338401117 >> 172.21.15.7:0/338401117 conn(0x56057585b8d0 msgr2=0x560575862880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 -- 172.21.15.7:0/338401117 shutdown_connections 2024-04-23T15:20:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.343+0000 7f1b80476740 1 -- 172.21.15.7:0/338401117 wait complete. 2024-04-23T15:20:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.344+0000 7f1b80476740 1 -- start start 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.344+0000 7f1b80476740 1 Processor -- start 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 0x560575872950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x560575863e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057586a5a0 0x5605758643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b2850 con 0x56057585f3c0 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781b2180 con 0x56057586a5a0 2024-04-23T15:20:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1b781af3e0 con 0x56057585fce0 2024-04-23T15:20:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b80476740 10 client.0 _ll_register_callbacks cb 0x7f1b6800ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 0x560575872950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 0x560575872950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53482/0 (socket says 172.21.15.7:53482) 2024-04-23T15:20:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b76a00640 1 -- 172.21.15.7:0/2762391582 learned_addr learned my addr 172.21.15.7:0/2762391582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.345+0000 7f1b77400640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057586a5a0 0x5605758643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b6e000640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x560575863e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b76a00640 1 -- 172.21.15.7:0/2762391582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 msgr2=0x560575863e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b76a00640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x560575863e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b76a00640 1 -- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057586a5a0 msgr2=0x5605758643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b76a00640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057586a5a0 0x5605758643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b76a00640 1 -- 172.21.15.7:0/2762391582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560575864b80 con 0x56057585f3c0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b76a00640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 0x560575872950 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f1b60000c00 tx=0x7f1b60031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde8001bbd217e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b5be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b5be00640 1 -- 172.21.15.7:0/2762391582 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60049040 con 0x56057585f3c0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b7001c3b0 con 0x56057585f3c0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.346+0000 7f1b5be00640 1 -- 172.21.15.7:0/2762391582 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7f1b600b9740 con 0x56057585f3c0 2024-04-23T15:20:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.347+0000 7f1b5be00640 1 -- 172.21.15.7:0/2762391582 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1b600c1480 con 0x56057585f3c0 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.347+0000 7f1b80476740 10 client.17997 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.347+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5605758e0790 con 0x56057585f3c0 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.347+0000 7f1b5be00640 1 -- 172.21.15.7:0/2762391582 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b7001c3b0 con 0x56057585f3c0 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.347+0000 7f1b5be00640 1 -- 172.21.15.7:0/2762391582 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1b600eeb00 con 0x56057585f3c0 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b80476740 10 client.17997 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b80476740 10 client.17997 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b80476740 20 client.17997 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b80476740 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5605758e0eb0 0x5605758e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b80476740 4 client.17997 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605757cd190 con 0x5605758e0eb0 2024-04-23T15:20:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.348+0000 7f1b6e000640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5605758e0eb0 0x5605758e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.349+0000 7f1b5be00640 10 client.17997 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.349+0000 7f1b6e000640 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5605758e0eb0 0x5605758e32d0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1300d5bcebcb389 server_cookie=565de77a8499f819 in_seq=0 out_seq=0 2024-04-23T15:20:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b5be00640 1 -- 172.21.15.7:0/2762391582 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5605757cd190 con 0x5605758e0eb0 2024-04-23T15:20:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b5be00640 10 client.17997 handle_command_reply: tid=0 2024-04-23T15:20:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 client.17997 shutdown 2024-04-23T15:20:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 msgr2=0x560575872950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 0x560575872950 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f1b60000c00 tx=0x7f1b60031f10 comp rx=0 tx=0).stop 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 shutdown_connections 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5605758e0eb0 0x5605758e32d0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56057586a5a0 0x5605758643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56057585fce0 0x560575863e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 --2- 172.21.15.7:0/2762391582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56057585f3c0 0x560575872950 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 >> 172.21.15.7:0/2762391582 conn(0x56057585b8d0 msgr2=0x560575867500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b5be00640 0 client.17997 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.388+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 shutdown_connections 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.389+0000 7f1b80476740 1 -- 172.21.15.7:0/2762391582 wait complete. 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.389+0000 7f1b80476740 20 client.17997 trim_cache size 0 max 16384 2024-04-23T15:20:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:20:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:20:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:20:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:20:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.389+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1b5c0a3d90 msgr2=0x7f1b5c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.389+0000 7f1b77e00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1b5c0a3d90 0x7f1b5c0a6250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007e70 tx=0x7f1b70007850 comp rx=0 tx=0).stop 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.389+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 msgr2=0x7f1b781a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.389+0000 7f1b77e00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b781a0460 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f1b60005ab0 tx=0x7f1b60003cd0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 shutdown_connections 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1b5c0a3d90 0x7f1b5c0a6250 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b7819a610 0x7f1b7819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b78107160 0x7f1b781a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 --2- 172.21.15.7:0/2744045542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b78102090 0x7f1b781a0460 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 >> 172.21.15.7:0/2744045542 conn(0x7f1b780fd950 msgr2=0x7f1b780ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 shutdown_connections 2024-04-23T15:20:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:19.390+0000 7f1b77e00640 1 -- 172.21.15.7:0/2744045542 wait complete. 2024-04-23T15:20:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:20 smithi186 ceph-mon[31814]: pgmap v916: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:20:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:20 smithi137 ceph-mon[31694]: pgmap v916: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:20:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:20 smithi007 ceph-mon[27906]: pgmap v916: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:20:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:22 smithi186 ceph-mon[31814]: pgmap v917: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:20:23.137 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:22 smithi007 ceph-mon[27906]: pgmap v917: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:20:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:22 smithi137 ceph-mon[31694]: pgmap v917: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:20:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:24 smithi186 ceph-mon[31814]: pgmap v918: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:20:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:24 smithi137 ceph-mon[31694]: pgmap v918: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:20:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:24 smithi007 ceph-mon[27906]: pgmap v918: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:20:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:26 smithi137 ceph-mon[31694]: pgmap v919: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:20:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:26 smithi007 ceph-mon[27906]: pgmap v919: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:20:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:26 smithi186 ceph-mon[31814]: pgmap v919: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 17 op/s 2024-04-23T15:20:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:28 smithi137 ceph-mon[31694]: pgmap v920: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:20:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:28 smithi007 ceph-mon[27906]: pgmap v920: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:20:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:28 smithi186 ceph-mon[31814]: pgmap v920: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:20:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:30 smithi137 ceph-mon[31694]: pgmap v921: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:30 smithi007 ceph-mon[27906]: pgmap v921: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:31.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:30 smithi186 ceph-mon[31814]: pgmap v921: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 -- 172.21.15.7:0/3115611710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc1061b0 msgr2=0x7fe4dc106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3115611710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc1061b0 0x7fe4dc106640 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009ca0 tx=0x7fe4d402a940 comp rx=0 tx=0).stop 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 -- 172.21.15.7:0/3115611710 shutdown_connections 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3115611710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc1016d0 0x7fe4dc105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3115611710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc1061b0 0x7fe4dc106640 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3115611710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc100db0 0x7fe4dc101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 -- 172.21.15.7:0/3115611710 >> 172.21.15.7:0/3115611710 conn(0x7fe4dc0fc820 msgr2=0x7fe4dc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 -- 172.21.15.7:0/3115611710 shutdown_connections 2024-04-23T15:20:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.540+0000 7fe4e2600640 1 -- 172.21.15.7:0/3115611710 wait complete. 2024-04-23T15:20:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.541+0000 7fe4e2600640 1 Processor -- start 2024-04-23T15:20:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 -- start start 2024-04-23T15:20:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 0x7fe4dc1a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc1016d0 0x7fe4dc1a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc1061b0 0x7fe4dc19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1186b0 con 0x7fe4dc100db0 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc118530 con 0x7fe4dc1061b0 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc118830 con 0x7fe4dc1016d0 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 0x7fe4dc1a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 0x7fe4dc1a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50392/0 (socket says 172.21.15.7:50392) 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.542+0000 7fe4e1200640 1 -- 172.21.15.7:0/3559475378 learned_addr learned my addr 172.21.15.7:0/3559475378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc1016d0 0x7fe4dc1a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc1061b0 0x7fe4dc19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1200640 1 -- 172.21.15.7:0/3559475378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc1016d0 msgr2=0x7fe4dc1a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1200640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc1016d0 0x7fe4dc1a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1200640 1 -- 172.21.15.7:0/3559475378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc1061b0 msgr2=0x7fe4dc19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1200640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc1061b0 0x7fe4dc19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1200640 1 -- 172.21.15.7:0/3559475378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc19f170 con 0x7fe4dc100db0 2024-04-23T15:20:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.543+0000 7fe4e1200640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 0x7fe4dc1a4840 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000d950 tx=0x7fe4d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.544+0000 7fe4d9600640 1 -- 172.21.15.7:0/3559475378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0017070 con 0x7fe4dc100db0 2024-04-23T15:20:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.544+0000 7fe4d9600640 1 -- 172.21.15.7:0/3559475378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4d0009c30 con 0x7fe4dc100db0 2024-04-23T15:20:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.544+0000 7fe4d9600640 1 -- 172.21.15.7:0/3559475378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d000f620 con 0x7fe4dc100db0 2024-04-23T15:20:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.544+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc19f460 con 0x7fe4dc100db0 2024-04-23T15:20:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.544+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc1ab700 con 0x7fe4dc100db0 2024-04-23T15:20:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.548+0000 7fe4e6a15740 1 Processor -- start 2024-04-23T15:20:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.548+0000 7fe4e6a15740 1 -- start start 2024-04-23T15:20:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.548+0000 7fe4d9600640 1 -- 172.21.15.7:0/3559475378 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe4d00109a0 con 0x7fe4dc100db0 2024-04-23T15:20:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.548+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.548+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209e7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.548+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564e20942900 con 0x564e209dc3c0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564e208e8f20 con 0x564e209dcce0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564e2093e8c0 con 0x564e209e75a0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209dc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50398/0 (socket says 172.21.15.7:50398) 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e1c00640 1 -- 172.21.15.7:0/3102227382 learned_addr learned my addr 172.21.15.7:0/3102227382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4e1200640 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.549+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4e1c00640 1 -- 172.21.15.7:0/3102227382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 msgr2=0x564e209e9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4e1c00640 1 -- 172.21.15.7:0/3102227382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 msgr2=0x564e209e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209e7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4e1c00640 1 -- 172.21.15.7:0/3102227382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e2090de10 con 0x564e209dc3c0 2024-04-23T15:20:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209dc7a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4035000 tx=0x7fe4d4009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e236923350aa3dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4d9600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4c40a3d10 0x7fe4c40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.550+0000 7fe4ce000640 1 -- 172.21.15.7:0/3102227382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4034040 con 0x564e209dc3c0 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4ce000640 1 -- 172.21.15.7:0/3102227382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4d4003e20 con 0x564e209dc3c0 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4ce000640 1 -- 172.21.15.7:0/3102227382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40308a0 con 0x564e209dc3c0 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4d9600640 1 -- 172.21.15.7:0/3559475378 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7fe4d00d0860 con 0x7fe4dc100db0 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e1200640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4c40a3d10 0x7fe4c40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 -- 172.21.15.7:0/3102227382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 msgr2=0x564e209dc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209dc7a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4035000 tx=0x7fe4d4009940 comp rx=0 tx=0).stop 2024-04-23T15:20:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e1200640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4c40a3d10 0x7fe4c40a61d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00cdcb0 tx=0x7fe4d0098040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 -- 172.21.15.7:0/3102227382 shutdown_connections 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/3102227382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209dc7a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.551+0000 7fe4e6a15740 1 -- 172.21.15.7:0/3102227382 >> 172.21.15.7:0/3102227382 conn(0x564e209d88d0 msgr2=0x564e209d8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.552+0000 7fe4e6a15740 1 -- 172.21.15.7:0/3102227382 shutdown_connections 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.552+0000 7fe4e6a15740 1 -- 172.21.15.7:0/3102227382 wait complete. 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.552+0000 7fe4e6a15740 1 -- start start 2024-04-23T15:20:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.552+0000 7fe4e6a15740 1 Processor -- start 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209e4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 0x564e209e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209e75a0 0x564e209e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564e209ea020 con 0x564e209dcce0 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564e208fc2c0 con 0x564e209e75a0 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564e209ea1a0 con 0x564e209dc3c0 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4e6a15740 10 client.0 _ll_register_callbacks cb 0x564e20654a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 0x564e209e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 0x564e209e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50412/0 (socket says 172.21.15.7:50412) 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.553+0000 7fe4dbe00640 1 -- 172.21.15.7:0/2071747250 learned_addr learned my addr 172.21.15.7:0/2071747250 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209e75a0 0x564e209e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4dbe00640 1 -- 172.21.15.7:0/2071747250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 msgr2=0x564e209e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4dbe00640 1 -- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209e75a0 msgr2=0x564e209e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209e75a0 0x564e209e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4dbe00640 1 -- 172.21.15.7:0/2071747250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e2090cfd0 con 0x564e209dcce0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209e75a0 0x564e209e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 0x564e209e4b60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc1a01e0 tx=0x7fe4c80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a644095d6078039e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4c2a00640 1 -- 172.21.15.7:0/2071747250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8004220 con 0x564e209dcce0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.554+0000 7fe4c2a00640 1 -- 172.21.15.7:0/2071747250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7fe4c80043c0 con 0x564e209dcce0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.555+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d4003e20 con 0x564e209dcce0 2024-04-23T15:20:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.555+0000 7fe4c2a00640 1 -- 172.21.15.7:0/2071747250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe4c8024050 con 0x564e209dcce0 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.555+0000 7fe4e6a15740 10 client.18009 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.555+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564e20655210 con 0x564e209dcce0 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.555+0000 7fe4c2a00640 1 -- 172.21.15.7:0/2071747250 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4d4003e20 con 0x564e209dcce0 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.555+0000 7fe4c2a00640 1 -- 172.21.15.7:0/2071747250 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe4c801b6e0 con 0x564e209dcce0 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e6a15740 10 client.18009 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e6a15740 10 client.18009 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e6a15740 20 client.18009 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e209f7760 0x564e209f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e6a15740 4 client.18009 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e20950320 con 0x564e209f7760 2024-04-23T15:20:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.556+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e209f7760 0x564e209f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.557+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e209f7760 0x564e209f9b50 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b26ab5b02de6cfd server_cookie=f862bb00523f2090 in_seq=0 out_seq=0 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.557+0000 7fe4c2a00640 10 client.18009 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4c2a00640 1 -- 172.21.15.7:0/2071747250 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564e20950320 con 0x564e209f7760 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4c2a00640 10 client.18009 handle_command_reply: tid=0 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 client.18009 shutdown 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 msgr2=0x564e209e4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 0x564e209e4b60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc1a01e0 tx=0x7fe4c80117b0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 shutdown_connections 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e209f7760 0x564e209f9b50 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209e75a0 0x564e209e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dcce0 0x564e209e4b60 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/2071747250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4c2a00640 0 client.18009 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.559+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 >> 172.21.15.7:0/2071747250 conn(0x564e209d88d0 msgr2=0x564e209de650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.560+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 shutdown_connections 2024-04-23T15:20:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.560+0000 7fe4e6a15740 1 -- 172.21.15.7:0/2071747250 wait complete. 2024-04-23T15:20:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.560+0000 7fe4e6a15740 20 client.18009 trim_cache size 0 max 16384 2024-04-23T15:20:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 Processor -- start 2024-04-23T15:20:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 -- start start 2024-04-23T15:20:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209d8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1b5940 con 0x564e209dc3c0 2024-04-23T15:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1b7480 con 0x564e209dcce0 2024-04-23T15:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.579+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1b6010 con 0x564e209e75a0 2024-04-23T15:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209e6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50424/0 (socket says 172.21.15.7:50424) 2024-04-23T15:20:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 -- 172.21.15.7:0/115291520 learned_addr learned my addr 172.21.15.7:0/115291520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209d8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 -- 172.21.15.7:0/115291520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 msgr2=0x564e209e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 -- 172.21.15.7:0/115291520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 msgr2=0x564e209d8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209d8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.580+0000 7fe4e1c00640 1 -- 172.21.15.7:0/115291520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e20721620 con 0x564e209dc3c0 2024-04-23T15:20:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.581+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209e6d50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009a60 tx=0x7fe4d4009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a799bf701f6a5f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.581+0000 7fe4cd600640 1 -- 172.21.15.7:0/115291520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d402fa60 con 0x564e209dc3c0 2024-04-23T15:20:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.581+0000 7fe4cd600640 1 -- 172.21.15.7:0/115291520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4d4009b20 con 0x564e209dc3c0 2024-04-23T15:20:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.581+0000 7fe4cd600640 1 -- 172.21.15.7:0/115291520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4030bd0 con 0x564e209dc3c0 2024-04-23T15:20:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 -- 172.21.15.7:0/115291520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 msgr2=0x564e209e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209e6d50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009a60 tx=0x7fe4d4009940 comp rx=0 tx=0).stop 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 -- 172.21.15.7:0/115291520 shutdown_connections 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209d8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209e75a0 0x564e209e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/115291520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209dc3c0 0x564e209e6d50 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 -- 172.21.15.7:0/115291520 >> 172.21.15.7:0/115291520 conn(0x564e209d88d0 msgr2=0x564e209de600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 -- 172.21.15.7:0/115291520 shutdown_connections 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.582+0000 7fe4e6a15740 1 -- 172.21.15.7:0/115291520 wait complete. 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.583+0000 7fe4e6a15740 1 -- start start 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.583+0000 7fe4e6a15740 1 Processor -- start 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.583+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.583+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e6a15740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 0x564e209eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1b6db0 con 0x564e209e75a0 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1b66e0 con 0x564e209dcce0 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e6a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1b3940 con 0x564e209dc3c0 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e6a15740 10 client.0 _ll_register_callbacks cb 0x7fe4dc06a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 0x564e209eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 0x564e209eafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50440/0 (socket says 172.21.15.7:50440) 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e1c00640 1 -- 172.21.15.7:0/1298678873 learned_addr learned my addr 172.21.15.7:0/1298678873 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.584+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e1c00640 1 -- 172.21.15.7:0/1298678873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 msgr2=0x564e209ef6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209ef6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e1c00640 1 -- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 msgr2=0x564e209eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209eaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e1c00640 1 -- 172.21.15.7:0/1298678873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e209eb5e0 con 0x564e209e75a0 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e1c00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 0x564e209eafa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40308b0 tx=0x7fe4d4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f40bf44ead002e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4c2a00640 1 -- 172.21.15.7:0/1298678873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4003b80 con 0x564e209e75a0 2024-04-23T15:20:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d4009b20 con 0x564e209e75a0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.585+0000 7fe4c2a00640 1 -- 172.21.15.7:0/1298678873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7fe4d4003d20 con 0x564e209e75a0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4c2a00640 1 -- 172.21.15.7:0/1298678873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe4d402f860 con 0x564e209e75a0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 10 client.18015 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564e20a5db30 con 0x564e209e75a0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4c2a00640 1 -- 172.21.15.7:0/1298678873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4d4009b20 con 0x564e209e75a0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4c2a00640 1 -- 172.21.15.7:0/1298678873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe4d4042020 con 0x564e209e75a0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 10 client.18015 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 10 client.18015 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 20 client.18015 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e20a5ddb0 0x564e20a601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 4 client.18015 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.586+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e2094a190 con 0x564e20a5ddb0 2024-04-23T15:20:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.587+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e20a5ddb0 0x564e20a601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.588+0000 7fe4dbe00640 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e20a5ddb0 0x564e20a601a0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=679f03f452ff781 server_cookie=e5108ec9afdea33 in_seq=0 out_seq=0 2024-04-23T15:20:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.588+0000 7fe4c2a00640 10 client.18015 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.623+0000 7fe4c2a00640 1 -- 172.21.15.7:0/1298678873 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e2094a190 con 0x564e20a5ddb0 2024-04-23T15:20:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.623+0000 7fe4c2a00640 10 client.18015 handle_command_reply: tid=0 2024-04-23T15:20:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 client.18015 shutdown 2024-04-23T15:20:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 msgr2=0x564e209eafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 0x564e209eafa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40308b0 tx=0x7fe4d4000f40 comp rx=0 tx=0).stop 2024-04-23T15:20:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 shutdown_connections 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564e20a5ddb0 0x564e20a601a0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e209dcce0 0x564e209eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4c2a00640 0 client.18015 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564e209e75a0 0x564e209eafa0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 --2- 172.21.15.7:0/1298678873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e209dc3c0 0x564e209ef6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 >> 172.21.15.7:0/1298678873 conn(0x564e209d88d0 msgr2=0x564e209d7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.624+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 shutdown_connections 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.625+0000 7fe4e6a15740 1 -- 172.21.15.7:0/1298678873 wait complete. 2024-04-23T15:20:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.625+0000 7fe4e6a15740 20 client.18015 trim_cache size 0 max 16384 2024-04-23T15:20:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:20:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:20:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:20:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:20:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4c40a3d10 msgr2=0x7fe4c40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4c40a3d10 0x7fe4c40a61d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00cdcb0 tx=0x7fe4d0098040 comp rx=0 tx=0).stop 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 msgr2=0x7fe4dc1a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 0x7fe4dc1a4840 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000d950 tx=0x7fe4d000de10 comp rx=0 tx=0).stop 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 shutdown_connections 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4c40a3d10 0x7fe4c40a61d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4dc1061b0 0x7fe4dc19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc1016d0 0x7fe4dc1a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 --2- 172.21.15.7:0/3559475378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4dc100db0 0x7fe4dc1a4840 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 >> 172.21.15.7:0/3559475378 conn(0x7fe4dc0fc820 msgr2=0x7fe4dc0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 shutdown_connections 2024-04-23T15:20:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:32.626+0000 7fe4e2600640 1 -- 172.21.15.7:0/3559475378 wait complete. 2024-04-23T15:20:33.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:32 smithi137 ceph-mon[31694]: pgmap v922: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:32 smithi007 ceph-mon[27906]: pgmap v922: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:33.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:32 smithi186 ceph-mon[31814]: pgmap v922: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:34 smithi137 ceph-mon[31694]: pgmap v923: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:20:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:34 smithi007 ceph-mon[27906]: pgmap v923: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:20:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:34 smithi186 ceph-mon[31814]: pgmap v923: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:20:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:36 smithi137 ceph-mon[31694]: pgmap v924: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:20:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:36 smithi007 ceph-mon[27906]: pgmap v924: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:20:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:36 smithi186 ceph-mon[31814]: pgmap v924: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:20:39.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:38 smithi186 ceph-mon[31814]: pgmap v925: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:20:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:38 smithi137 ceph-mon[31694]: pgmap v925: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:20:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:38 smithi007 ceph-mon[27906]: pgmap v925: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:20:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:40 smithi137 ceph-mon[31694]: pgmap v926: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:40 smithi007 ceph-mon[27906]: pgmap v926: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:40 smithi186 ceph-mon[31814]: pgmap v926: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:42 smithi137 ceph-mon[31694]: pgmap v927: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:42 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:20:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:42 smithi007 ceph-mon[27906]: pgmap v927: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:42 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:20:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:42 smithi186 ceph-mon[31814]: pgmap v927: 129 pgs: 129 active+clean; 7.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:42 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:20:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:44 smithi007 ceph-mon[27906]: pgmap v928: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:20:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:44 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:44 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:44 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:44 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:44 smithi186 ceph-mon[31814]: pgmap v928: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:20:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:44 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:44 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:44 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:44 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:44 smithi137 ceph-mon[31694]: pgmap v928: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:20:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:44 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:44 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:44 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:44.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:44 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.787+0000 7fc035800640 1 -- 172.21.15.7:0/4005250262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc030107140 msgr2=0x7fc03010ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.787+0000 7fc035800640 1 --2- 172.21.15.7:0/4005250262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc030107140 0x7fc03010ed10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc028009ca0 tx=0x7fc02802a8c0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 -- 172.21.15.7:0/4005250262 shutdown_connections 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 --2- 172.21.15.7:0/4005250262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc030102a20 0x7fc030106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 --2- 172.21.15.7:0/4005250262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc030107140 0x7fc03010ed10 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 --2- 172.21.15.7:0/4005250262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc030102070 0x7fc030102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 -- 172.21.15.7:0/4005250262 >> 172.21.15.7:0/4005250262 conn(0x7fc0300fd950 msgr2=0x7fc0300ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 -- 172.21.15.7:0/4005250262 shutdown_connections 2024-04-23T15:20:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.788+0000 7fc035800640 1 -- 172.21.15.7:0/4005250262 wait complete. 2024-04-23T15:20:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.789+0000 7fc035800640 1 Processor -- start 2024-04-23T15:20:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.789+0000 7fc035800640 1 -- start start 2024-04-23T15:20:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.789+0000 7fc035800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc030102070 0x7fc0301a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc035800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc030107140 0x7fc0301a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc035800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 0x7fc03019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc035800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc030112100 con 0x7fc03019a5e0 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc035800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc030111f80 con 0x7fc030102070 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc035800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc030112280 con 0x7fc030107140 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc034e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 0x7fc03019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc034e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 0x7fc03019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58694/0 (socket says 172.21.15.7:58694) 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc034e00640 1 -- 172.21.15.7:0/909320350 learned_addr learned my addr 172.21.15.7:0/909320350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc02fe00640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc030102070 0x7fc0301a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc02f400640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc030107140 0x7fc0301a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc034e00640 1 -- 172.21.15.7:0/909320350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc030107140 msgr2=0x7fc0301a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc034e00640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc030107140 0x7fc0301a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.790+0000 7fc034e00640 1 -- 172.21.15.7:0/909320350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc030102070 msgr2=0x7fc0301a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc034e00640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc030102070 0x7fc0301a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc034e00640 1 -- 172.21.15.7:0/909320350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03019b100 con 0x7fc03019a5e0 2024-04-23T15:20:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc034e00640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 0x7fc03019aa90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc028005e30 tx=0x7fc0280093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc02cc00640 1 -- 172.21.15.7:0/909320350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028003c70 con 0x7fc03019a5e0 2024-04-23T15:20:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc02cc00640 1 -- 172.21.15.7:0/909320350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc028003e10 con 0x7fc03019a5e0 2024-04-23T15:20:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc02cc00640 1 -- 172.21.15.7:0/909320350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028030c10 con 0x7fc03019a5e0 2024-04-23T15:20:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.791+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03019b390 con 0x7fc03019a5e0 2024-04-23T15:20:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.792+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0301a75e0 con 0x7fc03019a5e0 2024-04-23T15:20:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.795+0000 7fc039dae740 1 Processor -- start 2024-04-23T15:20:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.795+0000 7fc02cc00640 1 -- 172.21.15.7:0/909320350 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc028004040 con 0x7fc03019a5e0 2024-04-23T15:20:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 -- start start 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de300b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de3016060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563de2f71900 con 0x563de300bce0 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563de2f17f20 con 0x563de300b3c0 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc039dae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563de2f6d8c0 con 0x563de30165a0 2024-04-23T15:20:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.796+0000 7fc02fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de3016060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de3016060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58702/0 (socket says 172.21.15.7:58702) 2024-04-23T15:20:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 -- 172.21.15.7:0/3426773814 learned_addr learned my addr 172.21.15.7:0/3426773814 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02f400640 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de300b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02f400640 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3018990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 -- 172.21.15.7:0/3426773814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 msgr2=0x563de3018990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3018990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 -- 172.21.15.7:0/3426773814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 msgr2=0x563de300b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de300b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02fe00640 1 -- 172.21.15.7:0/3426773814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de2f3ce10 con 0x563de300bce0 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.797+0000 7fc02cc00640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc0140a3d10 0x7fc0140a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.798+0000 7fc02fe00640 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de3016060 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc020009c90 tx=0x7fc0200117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6c441e4a2b1f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.798+0000 7fc02cc00640 1 -- 172.21.15.7:0/909320350 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7fc0280f1f30 con 0x7fc03019a5e0 2024-04-23T15:20:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.798+0000 7fc02f400640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc0140a3d10 0x7fc0140a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.798+0000 7fc025600640 1 -- 172.21.15.7:0/3426773814 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020012450 con 0x563de300bce0 2024-04-23T15:20:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.798+0000 7fc025600640 1 -- 172.21.15.7:0/3426773814 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc020012aa0 con 0x563de300bce0 2024-04-23T15:20:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.798+0000 7fc025600640 1 -- 172.21.15.7:0/3426773814 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02000fb10 con 0x563de300bce0 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 -- 172.21.15.7:0/3426773814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 msgr2=0x563de3016060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de3016060 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc020009c90 tx=0x7fc0200117b0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc02f400640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc0140a3d10 0x7fc0140a61d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x563de3008cf0 tx=0x7fc01c016040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 -- 172.21.15.7:0/3426773814 shutdown_connections 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3018990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de3016060 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 --2- 172.21.15.7:0/3426773814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de300b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 -- 172.21.15.7:0/3426773814 >> 172.21.15.7:0/3426773814 conn(0x563de30078d0 msgr2=0x563de3007cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 -- 172.21.15.7:0/3426773814 shutdown_connections 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.799+0000 7fc039dae740 1 -- 172.21.15.7:0/3426773814 wait complete. 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.800+0000 7fc039dae740 1 -- start start 2024-04-23T15:20:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.800+0000 7fc039dae740 1 Processor -- start 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 0x563de30135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300bce0 0x563de3013b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3014070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563de3019140 con 0x563de300b3c0 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563de2f2b2c0 con 0x563de300bce0 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563de30192c0 con 0x563de30165a0 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc039dae740 10 client.0 _ll_register_callbacks cb 0x563de2c83a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc02fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 0x563de30135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc02fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 0x563de30135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58706/0 (socket says 172.21.15.7:58706) 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.801+0000 7fc02fe00640 1 -- 172.21.15.7:0/1609987817 learned_addr learned my addr 172.21.15.7:0/1609987817 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02f400640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300bce0 0x563de3013b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc034e00640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3014070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02fe00640 1 -- 172.21.15.7:0/1609987817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 msgr2=0x563de3014070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02fe00640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3014070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02fe00640 1 -- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300bce0 msgr2=0x563de3013b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02fe00640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300bce0 0x563de3013b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02fe00640 1 -- 172.21.15.7:0/1609987817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de2f3bfd0 con 0x563de300b3c0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc02fe00640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 0x563de30135f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc02001c040 tx=0x7fc02000f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d648fc1c4a1ee208 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.802+0000 7fc01a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc01a000640 1 -- 172.21.15.7:0/1609987817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020029020 con 0x563de300b3c0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc01a000640 1 -- 172.21.15.7:0/1609987817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7fc020009d80 con 0x563de300b3c0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc020012aa0 con 0x563de300b3c0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc01a000640 1 -- 172.21.15.7:0/1609987817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc020034050 con 0x563de300b3c0 2024-04-23T15:20:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc039dae740 10 client.18027 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563de2c84210 con 0x563de300b3c0 2024-04-23T15:20:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.803+0000 7fc01a000640 1 -- 172.21.15.7:0/1609987817 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc020012aa0 con 0x563de300b3c0 2024-04-23T15:20:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc01a000640 1 -- 172.21.15.7:0/1609987817 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc0200046c0 con 0x563de300b3c0 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc039dae740 10 client.18027 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc039dae740 10 client.18027 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc039dae740 20 client.18027 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc039dae740 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de30266d0 0x563de3028ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc039dae740 4 client.18027 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563de2f7f320 con 0x563de30266d0 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.804+0000 7fc02f400640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de30266d0 0x563de3028ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.806+0000 7fc02f400640 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de30266d0 0x563de3028ac0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5defd3c7e0b3f6c4 server_cookie=a0ec1ec1d8009ab0 in_seq=0 out_seq=0 2024-04-23T15:20:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.806+0000 7fc01a000640 10 client.18027 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.807+0000 7fc01a000640 1 -- 172.21.15.7:0/1609987817 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563de2f7f320 con 0x563de30266d0 2024-04-23T15:20:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.807+0000 7fc01a000640 10 client.18027 handle_command_reply: tid=0 2024-04-23T15:20:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 client.18027 shutdown 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 msgr2=0x563de30135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 0x563de30135f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc02001c040 tx=0x7fc02000f9c0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 shutdown_connections 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de30266d0 0x563de3028ac0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300bce0 0x563de3013b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de3014070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 --2- 172.21.15.7:0/1609987817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300b3c0 0x563de30135f0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 >> 172.21.15.7:0/1609987817 conn(0x563de30078d0 msgr2=0x563de300d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc01a000640 0 client.18027 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 shutdown_connections 2024-04-23T15:20:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 1 -- 172.21.15.7:0/1609987817 wait complete. 2024-04-23T15:20:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.808+0000 7fc039dae740 20 client.18027 trim_cache size 0 max 16384 2024-04-23T15:20:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 Processor -- start 2024-04-23T15:20:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 -- start start 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de30220c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de302e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301b1440 con 0x563de300bce0 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301b2f80 con 0x563de300b3c0 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc039dae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301b1b10 con 0x563de30165a0 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc02f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.827+0000 7fc02f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58716/0 (socket says 172.21.15.7:58716) 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 -- 172.21.15.7:0/894076006 learned_addr learned my addr 172.21.15.7:0/894076006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02fe00640 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de30220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc034e00640 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de302e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 -- 172.21.15.7:0/894076006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 msgr2=0x563de302e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de302e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 -- 172.21.15.7:0/894076006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 msgr2=0x563de30220c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de30220c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 -- 172.21.15.7:0/894076006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de2d50620 con 0x563de300bce0 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.828+0000 7fc02f400640 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300dd80 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc030108b00 tx=0x7fc01c00c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dd7516bcf267e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.829+0000 7fc024c00640 1 -- 172.21.15.7:0/894076006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c02e070 con 0x563de300bce0 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.829+0000 7fc024c00640 1 -- 172.21.15.7:0/894076006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc01c029910 con 0x563de300bce0 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.829+0000 7fc024c00640 1 -- 172.21.15.7:0/894076006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00fbe0 con 0x563de300bce0 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.829+0000 7fc039dae740 1 -- 172.21.15.7:0/894076006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 msgr2=0x563de300dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.829+0000 7fc039dae740 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300dd80 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc030108b00 tx=0x7fc01c00c3b0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 -- 172.21.15.7:0/894076006 shutdown_connections 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de302e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300dd80 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 --2- 172.21.15.7:0/894076006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de30220c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 -- 172.21.15.7:0/894076006 >> 172.21.15.7:0/894076006 conn(0x563de30078d0 msgr2=0x563de3013e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 -- 172.21.15.7:0/894076006 shutdown_connections 2024-04-23T15:20:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 -- 172.21.15.7:0/894076006 wait complete. 2024-04-23T15:20:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 -- start start 2024-04-23T15:20:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.830+0000 7fc039dae740 1 Processor -- start 2024-04-23T15:20:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de301e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de30103a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301b28b0 con 0x563de300bce0 2024-04-23T15:20:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301b21e0 con 0x563de300b3c0 2024-04-23T15:20:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301af440 con 0x563de30165a0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc039dae740 10 client.0 _ll_register_callbacks cb 0x7fc01c00c970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc02f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc02f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58728/0 (socket says 172.21.15.7:58728) 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.831+0000 7fc02f400640 1 -- 172.21.15.7:0/2821068738 learned_addr learned my addr 172.21.15.7:0/2821068738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc034e00640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de30103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc02f400640 1 -- 172.21.15.7:0/2821068738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 msgr2=0x563de30103a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc02f400640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de30103a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc02f400640 1 -- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 msgr2=0x563de301e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc02f400640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de301e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc02f400640 1 -- 172.21.15.7:0/2821068738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de30108e0 con 0x563de300bce0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc034e00640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de30103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc02f400640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300fe60 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc01c029460 tx=0x7fc01c029490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5e28a662075f91 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.832+0000 7fc01a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.833+0000 7fc01a000640 1 -- 172.21.15.7:0/2821068738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c02e070 con 0x563de300bce0 2024-04-23T15:20:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.833+0000 7fc01a000640 1 -- 172.21.15.7:0/2821068738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7fc01c029cc0 con 0x563de300bce0 2024-04-23T15:20:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.833+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc01c029910 con 0x563de300bce0 2024-04-23T15:20:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.833+0000 7fc01a000640 1 -- 172.21.15.7:0/2821068738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc01c040050 con 0x563de300bce0 2024-04-23T15:20:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.833+0000 7fc039dae740 10 client.18033 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.833+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563de308c5e0 con 0x563de300bce0 2024-04-23T15:20:45.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:20:45.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:20:45.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc01a000640 1 -- 172.21.15.7:0/2821068738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc01c029910 con 0x563de300bce0 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc01a000640 1 -- 172.21.15.7:0/2821068738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc01c03b030 con 0x563de300bce0 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc039dae740 10 client.18033 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc039dae740 10 client.18033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc039dae740 20 client.18033 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc039dae740 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de308ccf0 0x563de308f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc039dae740 4 client.18033 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.834+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563de2f79190 con 0x563de308ccf0 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.835+0000 7fc02fe00640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de308ccf0 0x563de308f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.836+0000 7fc02fe00640 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de308ccf0 0x563de308f110 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57df7c99435df19b server_cookie=9599495baedbad97 in_seq=0 out_seq=0 2024-04-23T15:20:45.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.836+0000 7fc01a000640 10 client.18033 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:20:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:20:45.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc01a000640 1 -- 172.21.15.7:0/2821068738 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563de2f79190 con 0x563de308ccf0 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc01a000640 10 client.18033 handle_command_reply: tid=0 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 client.18033 shutdown 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 msgr2=0x563de300fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300fe60 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc01c029460 tx=0x7fc01c029490 comp rx=0 tx=0).stop 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 shutdown_connections 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563de308ccf0 0x563de308f110 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563de30165a0 0x563de30103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563de300bce0 0x563de300fe60 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 --2- 172.21.15.7:0/2821068738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563de300b3c0 0x563de301e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc01a000640 0 client.18033 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.873+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 >> 172.21.15.7:0/2821068738 conn(0x563de30078d0 msgr2=0x563de3013590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.874+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 shutdown_connections 2024-04-23T15:20:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.874+0000 7fc039dae740 1 -- 172.21.15.7:0/2821068738 wait complete. 2024-04-23T15:20:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.874+0000 7fc039dae740 20 client.18033 trim_cache size 0 max 16384 2024-04-23T15:20:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:20:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:20:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:20:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc0140a3d10 msgr2=0x7fc0140a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc0140a3d10 0x7fc0140a61d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x563de3008cf0 tx=0x7fc01c016040 comp rx=0 tx=0).stop 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 msgr2=0x7fc03019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 0x7fc03019aa90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc028005e30 tx=0x7fc0280093d0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 shutdown_connections 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc0140a3d10 0x7fc0140a61d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc03019a5e0 0x7fc03019aa90 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc030107140 0x7fc0301a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 --2- 172.21.15.7:0/909320350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc030102070 0x7fc0301a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 >> 172.21.15.7:0/909320350 conn(0x7fc0300fd950 msgr2=0x7fc0300ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 shutdown_connections 2024-04-23T15:20:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:45.875+0000 7fc035800640 1 -- 172.21.15.7:0/909320350 wait complete. 2024-04-23T15:20:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:20:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:20:45.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:20:46.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:46 smithi007 ceph-mon[27906]: pgmap v929: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:46.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:46 smithi186 ceph-mon[31814]: pgmap v929: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:46 smithi137 ceph-mon[31694]: pgmap v929: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:20:48.720 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:48 smithi137 ceph-mon[31694]: pgmap v930: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-23T15:20:48.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:48 smithi007 ceph-mon[27906]: pgmap v930: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-23T15:20:48.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:48 smithi186 ceph-mon[31814]: pgmap v930: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 22 op/s 2024-04-23T15:20:50.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:50 smithi007 ceph-mon[27906]: pgmap v931: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:20:50.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:50 smithi186 ceph-mon[31814]: pgmap v931: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:20:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:50 smithi137 ceph-mon[31694]: pgmap v931: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:20:52.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:52 smithi007 ceph-mon[27906]: pgmap v932: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:20:52.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:52 smithi186 ceph-mon[31814]: pgmap v932: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:20:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:52 smithi137 ceph-mon[31694]: pgmap v932: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:20:54.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:54 smithi007 ceph-mon[27906]: pgmap v933: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:20:54.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:54 smithi186 ceph-mon[31814]: pgmap v933: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:20:54.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:54 smithi137 ceph-mon[31694]: pgmap v933: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:20:56.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:56 smithi007 ceph-mon[27906]: pgmap v934: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:20:56.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:56 smithi186 ceph-mon[31814]: pgmap v934: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:20:56.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:56 smithi137 ceph-mon[31694]: pgmap v934: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:20:58.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:20:58 smithi007 ceph-mon[27906]: pgmap v935: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:20:58.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:20:58 smithi186 ceph-mon[31814]: pgmap v935: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:20:58.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:20:58 smithi137 ceph-mon[31694]: pgmap v935: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:20:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 -- 172.21.15.7:0/1118775274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 msgr2=0x7f048010e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 --2- 172.21.15.7:0/1118775274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048010e880 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0478009ca0 tx=0x7f047802a950 comp rx=0 tx=0).stop 2024-04-23T15:20:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 -- 172.21.15.7:0/1118775274 shutdown_connections 2024-04-23T15:20:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 --2- 172.21.15.7:0/1118775274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04801038e0 0x7f048010bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 --2- 172.21.15.7:0/1118775274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048010e880 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 --2- 172.21.15.7:0/1118775274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0480102fc0 0x7f04801033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 -- 172.21.15.7:0/1118775274 >> 172.21.15.7:0/1118775274 conn(0x7f04800fc820 msgr2=0x7f04800fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 -- 172.21.15.7:0/1118775274 shutdown_connections 2024-04-23T15:20:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.038+0000 7f047fe00640 1 -- 172.21.15.7:0/1118775274 wait complete. 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.039+0000 7f047fe00640 1 Processor -- start 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.039+0000 7f047fe00640 1 -- start start 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0480102fc0 0x7f04801a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04801038e0 0x7f04801a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04801120c0 con 0x7f048010c3e0 2024-04-23T15:20:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0480111f40 con 0x7f0480102fc0 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0480112240 con 0x7f04801038e0 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.040+0000 7f047f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048019a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38056/0 (socket says 172.21.15.7:38056) 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0480102fc0 0x7f04801a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 -- 172.21.15.7:0/2378962230 learned_addr learned my addr 172.21.15.7:0/2378962230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f0476000640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04801038e0 0x7f04801a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 -- 172.21.15.7:0/2378962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04801038e0 msgr2=0x7f04801a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04801038e0 0x7f04801a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 -- 172.21.15.7:0/2378962230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0480102fc0 msgr2=0x7f04801a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0480102fc0 0x7f04801a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.041+0000 7f047f400640 1 -- 172.21.15.7:0/2378962230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048019aef0 con 0x7f048010c3e0 2024-04-23T15:20:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.042+0000 7f047f400640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048019a7c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f0478009dc0 tx=0x7f0478003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.042+0000 7f0477e00640 1 -- 172.21.15.7:0/2378962230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478034040 con 0x7f048010c3e0 2024-04-23T15:20:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.042+0000 7f0477e00640 1 -- 172.21.15.7:0/2378962230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0478030850 con 0x7f048010c3e0 2024-04-23T15:20:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.042+0000 7f0477e00640 1 -- 172.21.15.7:0/2378962230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04780047f0 con 0x7f048010c3e0 2024-04-23T15:20:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.042+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048019b180 con 0x7f048010c3e0 2024-04-23T15:20:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.042+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048019b620 con 0x7f048010c3e0 2024-04-23T15:20:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.046+0000 7f04883ba740 1 Processor -- start 2024-04-23T15:20:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.046+0000 7f0477e00640 1 -- 172.21.15.7:0/2378962230 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0478037020 con 0x7f048010c3e0 2024-04-23T15:20:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.046+0000 7f04883ba740 1 -- start start 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f04883ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f04883ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f04883ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f04883ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e2fa64e900 con 0x55e2fa6f35a0 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f04883ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e2fa5f4f20 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f04883ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e2fa64a8c0 con 0x55e2fa6e83c0 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f0476000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f0476000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38070/0 (socket says 172.21.15.7:38070) 2024-04-23T15:20:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f0476000640 1 -- 172.21.15.7:0/1471313442 learned_addr learned my addr 172.21.15.7:0/1471313442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f047ea00640 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.047+0000 7f0476000640 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0476000640 1 -- 172.21.15.7:0/1471313442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 msgr2=0x55e2fa6e87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0476000640 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6e87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0476000640 1 -- 172.21.15.7:0/1471313442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 msgr2=0x55e2fa6f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0476000640 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0476000640 1 -- 172.21.15.7:0/1471313442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2fa619e10 con 0x55e2fa6f35a0 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f047ea00640 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0477e00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04640a3d10 0x7f04640a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0477e00640 1 -- 172.21.15.7:0/2378962230 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7f04780f1a50 con 0x7f048010c3e0 2024-04-23T15:20:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f0476000640 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f5990 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0468012470 tx=0x7f046800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938bec37c0555314 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:59.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.048+0000 7f047ea00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04640a3d10 0x7f04640a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.049+0000 7f046f400640 1 -- 172.21.15.7:0/1471313442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046801e640 con 0x55e2fa6f35a0 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.049+0000 7f046f400640 1 -- 172.21.15.7:0/1471313442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04680108e0 con 0x55e2fa6f35a0 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.049+0000 7f046f400640 1 -- 172.21.15.7:0/1471313442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046800e740 con 0x55e2fa6f35a0 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.049+0000 7f04883ba740 1 -- 172.21.15.7:0/1471313442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 msgr2=0x55e2fa6f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.049+0000 7f04883ba740 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f5990 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0468012470 tx=0x7f046800b780 comp rx=0 tx=0).stop 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.049+0000 7f047ea00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04640a3d10 0x7f04640a61d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55e2fa6e9960 tx=0x7f047000b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 -- 172.21.15.7:0/1471313442 shutdown_connections 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f5990 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 --2- 172.21.15.7:0/1471313442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 -- 172.21.15.7:0/1471313442 >> 172.21.15.7:0/1471313442 conn(0x55e2fa6e48d0 msgr2=0x55e2fa6e4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 -- 172.21.15.7:0/1471313442 shutdown_connections 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 -- 172.21.15.7:0/1471313442 wait complete. 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 -- start start 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.050+0000 7f04883ba740 1 Processor -- start 2024-04-23T15:20:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6f0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e2fa6f60e0 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e2fa6082c0 con 0x55e2fa6f35a0 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e2fa6f6260 con 0x55e2fa6e83c0 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f04883ba740 10 client.0 _ll_register_callbacks cb 0x55e2fa360a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f0476000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f0476000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38072/0 (socket says 172.21.15.7:38072) 2024-04-23T15:20:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.051+0000 7f0476000640 1 -- 172.21.15.7:0/424973454 learned_addr learned my addr 172.21.15.7:0/424973454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f047ea00640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f047f400640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0476000640 1 -- 172.21.15.7:0/424973454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 msgr2=0x55e2fa6f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0476000640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0476000640 1 -- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 msgr2=0x55e2fa6f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0476000640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0476000640 1 -- 172.21.15.7:0/424973454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2fa618fd0 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f047ea00640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f047f400640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0476000640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f0bd0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0468010710 tx=0x7f0468010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182ebbe867aaa52a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.052+0000 7f0463e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.053+0000 7f0463e00640 1 -- 172.21.15.7:0/424973454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046802d060 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.053+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04680108e0 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.053+0000 7f0463e00640 1 -- 172.21.15.7:0/424973454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7f0468004040 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.053+0000 7f0463e00640 1 -- 172.21.15.7:0/424973454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0468034050 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.053+0000 7f04883ba740 10 client.18045 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.053+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e2fa361210 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f0463e00640 1 -- 172.21.15.7:0/424973454 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04680108e0 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f0463e00640 1 -- 172.21.15.7:0/424973454 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0468027030 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f04883ba740 10 client.18045 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f04883ba740 10 client.18045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f04883ba740 20 client.18045 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f04883ba740 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa703760 0x55e2fa705b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f04883ba740 4 client.18045 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.054+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2fa65c320 con 0x55e2fa703760 2024-04-23T15:20:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.055+0000 7f047ea00640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa703760 0x55e2fa705b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.058+0000 7f047ea00640 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa703760 0x55e2fa705b50 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1877f45874e0d78 server_cookie=c0897e20034c2b3c in_seq=0 out_seq=0 2024-04-23T15:20:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.058+0000 7f0463e00640 10 client.18045 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f0463e00640 1 -- 172.21.15.7:0/424973454 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e2fa65c320 con 0x55e2fa703760 2024-04-23T15:20:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f0463e00640 10 client.18045 handle_command_reply: tid=0 2024-04-23T15:20:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 client.18045 shutdown 2024-04-23T15:20:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 msgr2=0x55e2fa6f0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f0bd0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0468010710 tx=0x7f0468010740 comp rx=0 tx=0).stop 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 shutdown_connections 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa703760 0x55e2fa705b50 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6f0bd0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 --2- 172.21.15.7:0/424973454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f0463e00640 0 client.18045 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.060+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 >> 172.21.15.7:0/424973454 conn(0x55e2fa6e48d0 msgr2=0x55e2fa6ea600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.061+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 shutdown_connections 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.061+0000 7f04883ba740 1 -- 172.21.15.7:0/424973454 wait complete. 2024-04-23T15:20:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.061+0000 7f04883ba740 20 client.18045 trim_cache size 0 max 16384 2024-04-23T15:20:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 Processor -- start 2024-04-23T15:20:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 -- start start 2024-04-23T15:20:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6ff0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ead80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04801b13a0 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04801b2ee0 con 0x55e2fa6f35a0 2024-04-23T15:20:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f04883ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f04801b1a70 con 0x55e2fa6e83c0 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.079+0000 7f0476000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38074/0 (socket says 172.21.15.7:38074) 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 -- 172.21.15.7:0/3937536335 learned_addr learned my addr 172.21.15.7:0/3937536335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f047f400640 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ead80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f047ea00640 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6ff0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 -- 172.21.15.7:0/3937536335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 msgr2=0x55e2fa6ff0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6ff0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 -- 172.21.15.7:0/3937536335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 msgr2=0x55e2fa6ead80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ead80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 -- 172.21.15.7:0/3937536335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2fa6ef640 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.080+0000 7f0476000640 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6e4cb0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f04680106e0 tx=0x7f0468003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5948bca687911dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.081+0000 7f046ea00640 1 -- 172.21.15.7:0/3937536335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046802d070 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.081+0000 7f046ea00640 1 -- 172.21.15.7:0/3937536335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f046800b680 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.081+0000 7f046ea00640 1 -- 172.21.15.7:0/3937536335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04680052d0 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 -- 172.21.15.7:0/3937536335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 msgr2=0x55e2fa6e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6e4cb0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f04680106e0 tx=0x7f0468003da0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 -- 172.21.15.7:0/3937536335 shutdown_connections 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ead80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6e4cb0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 --2- 172.21.15.7:0/3937536335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 -- 172.21.15.7:0/3937536335 >> 172.21.15.7:0/3937536335 conn(0x55e2fa6e48d0 msgr2=0x55e2fa6e3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 -- 172.21.15.7:0/3937536335 shutdown_connections 2024-04-23T15:20:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 -- 172.21.15.7:0/3937536335 wait complete. 2024-04-23T15:20:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 -- start start 2024-04-23T15:20:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.082+0000 7f04883ba740 1 Processor -- start 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6fb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ece00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04801b2810 con 0x55e2fa6f35a0 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04801b2140 con 0x55e2fa6e8ce0 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f04801af3a0 con 0x55e2fa6e83c0 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f04883ba740 10 client.0 _ll_register_callbacks cb 0x7f046800bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:20:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f047f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f047f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38076/0 (socket says 172.21.15.7:38076) 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f047f400640 1 -- 172.21.15.7:0/1563895212 learned_addr learned my addr 172.21.15.7:0/1563895212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.083+0000 7f0476000640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047ea00640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6fb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047f400640 1 -- 172.21.15.7:0/1563895212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 msgr2=0x55e2fa6fb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047f400640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6fb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047f400640 1 -- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 msgr2=0x55e2fa6fbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047f400640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6fbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047f400640 1 -- 172.21.15.7:0/1563895212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2fa42d620 con 0x55e2fa6f35a0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f047f400640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ece00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f0478030040 tx=0x7f0478004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1455b162ba8b4621 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f0463e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f0463e00640 1 -- 172.21.15.7:0/1563895212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047802c040 con 0x55e2fa6f35a0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f0463e00640 1 -- 172.21.15.7:0/1563895212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 9467+0+0 (secure 0 0 0) 0x7f04780bdb50 con 0x55e2fa6f35a0 2024-04-23T15:20:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.084+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f046800b680 con 0x55e2fa6f35a0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f0463e00640 1 -- 172.21.15.7:0/1563895212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0478004040 con 0x55e2fa6f35a0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 10 client.18051 fetch_fsmap learned FSMap version 32 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e2fa771d80 con 0x55e2fa6f35a0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f0463e00640 1 -- 172.21.15.7:0/1563895212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f046800b680 con 0x55e2fa6f35a0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f0463e00640 1 -- 172.21.15.7:0/1563895212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f04780c5ed0 con 0x55e2fa6f35a0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 10 client.18051 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 10 client.18051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 20 client.18051 populate_metadata read hostname 'smithi007' 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa772500 0x55e2fa774920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 4 client.18051 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.085+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e2fa656190 con 0x55e2fa772500 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.086+0000 7f047ea00640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa772500 0x55e2fa774920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.087+0000 7f047ea00640 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa772500 0x55e2fa774920 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cf83099a09ea2f3 server_cookie=333b308a18f35dbd in_seq=0 out_seq=0 2024-04-23T15:20:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.087+0000 7f0463e00640 10 client.18051 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.125+0000 7f0463e00640 1 -- 172.21.15.7:0/1563895212 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e2fa656190 con 0x55e2fa772500 2024-04-23T15:20:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.125+0000 7f0463e00640 10 client.18051 handle_command_reply: tid=0 2024-04-23T15:20:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 client.18051 shutdown 2024-04-23T15:20:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 msgr2=0x55e2fa6ece00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ece00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f0478030040 tx=0x7f0478004990 comp rx=0 tx=0).stop 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 shutdown_connections 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e2fa772500 0x55e2fa774920 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2fa6e8ce0 0x55e2fa6fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e2fa6f35a0 0x55e2fa6ece00 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 --2- 172.21.15.7:0/1563895212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e2fa6e83c0 0x55e2fa6fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 >> 172.21.15.7:0/1563895212 conn(0x55e2fa6e48d0 msgr2=0x55e2fa6e3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.126+0000 7f0463e00640 0 client.18051 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.127+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 shutdown_connections 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.127+0000 7f04883ba740 1 -- 172.21.15.7:0/1563895212 wait complete. 2024-04-23T15:20:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.127+0000 7f04883ba740 20 client.18051 trim_cache size 0 max 16384 2024-04-23T15:20:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:20:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:20:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:20:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04640a3d10 msgr2=0x7f04640a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04640a3d10 0x7f04640a61d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55e2fa6e9960 tx=0x7f047000b390 comp rx=0 tx=0).stop 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 msgr2=0x7f048019a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048019a7c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f0478009dc0 tx=0x7f0478003f10 comp rx=0 tx=0).stop 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 shutdown_connections 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04640a3d10 0x7f04640a61d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f048010c3e0 0x7f048019a7c0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04801038e0 0x7f04801a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 --2- 172.21.15.7:0/2378962230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0480102fc0 0x7f04801a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:20:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 >> 172.21.15.7:0/2378962230 conn(0x7f04800fc820 msgr2=0x7f0480101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:20:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 shutdown_connections 2024-04-23T15:20:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:20:59.128+0000 7f047fe00640 1 -- 172.21.15.7:0/2378962230 wait complete. 2024-04-23T15:21:00.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:00 smithi007 ceph-mon[27906]: pgmap v936: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:21:00.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:00 smithi186 ceph-mon[31814]: pgmap v936: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:21:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:00 smithi137 ceph-mon[31694]: pgmap v936: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:21:02.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:02 smithi007 ceph-mon[27906]: pgmap v937: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:21:02.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:02 smithi186 ceph-mon[31814]: pgmap v937: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:21:02.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:02 smithi137 ceph-mon[31694]: pgmap v937: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:21:04.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:04 smithi007 ceph-mon[27906]: pgmap v938: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 36 op/s 2024-04-23T15:21:04.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:04 smithi186 ceph-mon[31814]: pgmap v938: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 36 op/s 2024-04-23T15:21:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:04 smithi137 ceph-mon[31694]: pgmap v938: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 36 op/s 2024-04-23T15:21:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:06 smithi186 ceph-mon[31814]: pgmap v939: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 31 op/s 2024-04-23T15:21:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:06 smithi137 ceph-mon[31694]: pgmap v939: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 31 op/s 2024-04-23T15:21:07.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:06 smithi007 ceph-mon[27906]: pgmap v939: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 31 op/s 2024-04-23T15:21:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:08 smithi137 ceph-mon[31694]: pgmap v940: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:21:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:08 smithi137 ceph-mon[31694]: osdmap e139: 12 total, 12 up, 12 in 2024-04-23T15:21:09.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:08 smithi007 ceph-mon[27906]: pgmap v940: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:21:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:08 smithi007 ceph-mon[27906]: osdmap e139: 12 total, 12 up, 12 in 2024-04-23T15:21:09.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:08 smithi186 ceph-mon[31814]: pgmap v940: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:21:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:08 smithi186 ceph-mon[31814]: osdmap e139: 12 total, 12 up, 12 in 2024-04-23T15:21:11.166 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:10 smithi186 ceph-mon[31814]: pgmap v942: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:21:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:10 smithi137 ceph-mon[31694]: pgmap v942: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:21:11.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:10 smithi007 ceph-mon[27906]: pgmap v942: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:21:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 -- 172.21.15.7:0/2503538545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d810e690 msgr2=0x7fa7d810ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 --2- 172.21.15.7:0/2503538545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d810e690 0x7fa7d810ea70 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009930 tx=0x7fa7cc02a420 comp rx=0 tx=0).stop 2024-04-23T15:21:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 -- 172.21.15.7:0/2503538545 shutdown_connections 2024-04-23T15:21:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 --2- 172.21.15.7:0/2503538545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7d8108fb0 0x7fa7d81154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 --2- 172.21.15.7:0/2503538545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d81085f0 0x7fa7d8108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 --2- 172.21.15.7:0/2503538545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d810e690 0x7fa7d810ea70 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 -- 172.21.15.7:0/2503538545 >> 172.21.15.7:0/2503538545 conn(0x7fa7d8076590 msgr2=0x7fa7d80789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 -- 172.21.15.7:0/2503538545 shutdown_connections 2024-04-23T15:21:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.299+0000 7fa7e0800640 1 -- 172.21.15.7:0/2503538545 wait complete. 2024-04-23T15:21:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.300+0000 7fa7e0800640 1 Processor -- start 2024-04-23T15:21:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.300+0000 7fa7e0800640 1 -- start start 2024-04-23T15:21:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7e0800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 0x7fa7d819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7e0800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d8108fb0 0x7fa7d819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7e0800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7d810e690 0x7fa7d81a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7e0800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81188d0 con 0x7fa7d81085f0 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7e0800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8118750 con 0x7fa7d810e690 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7e0800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8118a50 con 0x7fa7d8108fb0 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 0x7fa7d819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 0x7fa7d819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49316/0 (socket says 172.21.15.7:49316) 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.301+0000 7fa7dde00640 1 -- 172.21.15.7:0/3507211115 learned_addr learned my addr 172.21.15.7:0/3507211115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7de800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7d810e690 0x7fa7d81a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d8108fb0 0x7fa7d819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dde00640 1 -- 172.21.15.7:0/3507211115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d8108fb0 msgr2=0x7fa7d819f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d8108fb0 0x7fa7d819f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dde00640 1 -- 172.21.15.7:0/3507211115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7d810e690 msgr2=0x7fa7d81a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7d810e690 0x7fa7d81a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dde00640 1 -- 172.21.15.7:0/3507211115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d81a3d20 con 0x7fa7d81085f0 2024-04-23T15:21:12.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.302+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 0x7fa7d819ed30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc005ab0 tx=0x7fa7cc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:12.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.303+0000 7fa7d2a00640 1 -- 172.21.15.7:0/3507211115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc03f070 con 0x7fa7d81085f0 2024-04-23T15:21:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.303+0000 7fa7d2a00640 1 -- 172.21.15.7:0/3507211115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7cc031d60 con 0x7fa7d81085f0 2024-04-23T15:21:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.303+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d81a3fb0 con 0x7fa7d81085f0 2024-04-23T15:21:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.303+0000 7fa7d2a00640 1 -- 172.21.15.7:0/3507211115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc035030 con 0x7fa7d81085f0 2024-04-23T15:21:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.303+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d81ab8a0 con 0x7fa7d81085f0 2024-04-23T15:21:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.306+0000 7fa7e37c6740 1 Processor -- start 2024-04-23T15:21:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.306+0000 7fa7e37c6740 1 -- start start 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f1c1b0 0x555fb8f1c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f26e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 0x555fb8f29780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fb8e82900 con 0x555fb8f27390 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555fb8e28f20 con 0x555fb8f1c1b0 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555fb8e7e8c0 con 0x555fb8f1cad0 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7d2a00640 1 -- 172.21.15.7:0/3507211115 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa7cc042070 con 0x7fa7d81085f0 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 0x555fb8f29780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 0x555fb8f29780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49322/0 (socket says 172.21.15.7:49322) 2024-04-23T15:21:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7dd400640 1 -- 172.21.15.7:0/3351192761 learned_addr learned my addr 172.21.15.7:0/3351192761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.307+0000 7fa7de800640 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f1c1b0 0x555fb8f1c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7dd400640 1 -- 172.21.15.7:0/3351192761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 msgr2=0x555fb8f26e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f26e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7dd400640 1 -- 172.21.15.7:0/3351192761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f1c1b0 msgr2=0x555fb8f1c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f1c1b0 0x555fb8f1c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7dd400640 1 -- 172.21.15.7:0/3351192761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb8e4de10 con 0x555fb8f27390 2024-04-23T15:21:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 0x555fb8f29780 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800bc80 tx=0x7fa7c800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97aaca803d00b1c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7c7000640 1 -- 172.21.15.7:0/3351192761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8015070 con 0x555fb8f27390 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7c7000640 1 -- 172.21.15.7:0/3351192761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7c801a910 con 0x555fb8f27390 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.308+0000 7fa7c7000640 1 -- 172.21.15.7:0/3351192761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8011870 con 0x555fb8f27390 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7d2a00640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa7c00a3e40 0x7fa7c00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7d2a00640 1 -- 172.21.15.7:0/3507211115 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 9555+0+0 (secure 0 0 0) 0x7fa7cc0f1460 con 0x7fa7d81085f0 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3351192761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 msgr2=0x555fb8f29780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 0x555fb8f29780 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800bc80 tx=0x7fa7c800f730 comp rx=0 tx=0).stop 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7de800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa7c00a3e40 0x7fa7c00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3351192761 shutdown_connections 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f27390 0x555fb8f29780 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f26e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3351192761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f1c1b0 0x555fb8f1c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.309+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3351192761 >> 172.21.15.7:0/3351192761 conn(0x555fb8f186c0 msgr2=0x555fb8f18aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.310+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3351192761 shutdown_connections 2024-04-23T15:21:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.310+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3351192761 wait complete. 2024-04-23T15:21:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.310+0000 7fa7e37c6740 1 -- start start 2024-04-23T15:21:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.310+0000 7fa7e37c6740 1 Processor -- start 2024-04-23T15:21:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7de800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa7c00a3e40 0x7fa7c00a6300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4005fd0 tx=0x7fa7d4009580 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f24930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f24e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fb8f29fc0 con 0x555fb8f1cad0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555fb8e3c2c0 con 0x555fb8f27390 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555fb8f2a140 con 0x555fb8f1c1b0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7e37c6740 10 client.0 _ll_register_callbacks cb 0x555fb8b94a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f24930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f24930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49326/0 (socket says 172.21.15.7:49326) 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.311+0000 7fa7dd400640 1 -- 172.21.15.7:0/3390851230 learned_addr learned my addr 172.21.15.7:0/3390851230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7de800640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f24e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dd400640 1 -- 172.21.15.7:0/3390851230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 msgr2=0x555fb8f243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f243f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dd400640 1 -- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 msgr2=0x555fb8f24e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f24e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dd400640 1 -- 172.21.15.7:0/3390851230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb8e4cfd0 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f24930 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80115b0 tx=0x7fa7c800bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239db66d7ff16bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.312+0000 7fa7bb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7bb400640 1 -- 172.21.15.7:0/3390851230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8015070 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c801a910 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7bb400640 1 -- 172.21.15.7:0/3390851230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 9555+0+0 (secure 0 0 0) 0x7fa7c801a6f0 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7bb400640 1 -- 172.21.15.7:0/3390851230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa7c801aac0 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7e37c6740 10 client.18063 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555fb8b95210 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.313+0000 7fa7bb400640 1 -- 172.21.15.7:0/3390851230 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7c801a910 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7bb400640 1 -- 172.21.15.7:0/3390851230 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa7c80046c0 con 0x555fb8f1cad0 2024-04-23T15:21:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7e37c6740 10 client.18063 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7e37c6740 10 client.18063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7e37c6740 20 client.18063 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f37500 0x555fb8f398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7e37c6740 4 client.18063 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.314+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fb8e90320 con 0x555fb8f37500 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.315+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f37500 0x555fb8f398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.315+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f37500 0x555fb8f398f0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0e69b410424c29 server_cookie=ebdc7201fc13bea6 in_seq=0 out_seq=0 2024-04-23T15:21:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.316+0000 7fa7bb400640 10 client.18063 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.317+0000 7fa7bb400640 1 -- 172.21.15.7:0/3390851230 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555fb8e90320 con 0x555fb8f37500 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.317+0000 7fa7bb400640 10 client.18063 handle_command_reply: tid=0 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.317+0000 7fa7e37c6740 1 client.18063 shutdown 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 msgr2=0x555fb8f24930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f24930 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80115b0 tx=0x7fa7c800bfa0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 shutdown_connections 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f37500 0x555fb8f398f0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f24e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f24930 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3390851230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 >> 172.21.15.7:0/3390851230 conn(0x555fb8f186c0 msgr2=0x555fb8f1e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7bb400640 0 client.18063 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 shutdown_connections 2024-04-23T15:21:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3390851230 wait complete. 2024-04-23T15:21:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.318+0000 7fa7e37c6740 20 client.18063 trim_cache size 0 max 16384 2024-04-23T15:21:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.337+0000 7fa7e37c6740 1 Processor -- start 2024-04-23T15:21:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 -- start start 2024-04-23T15:21:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 0x555fb8f17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f1eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f3f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b5a90 con 0x555fb8f1c1b0 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b75d0 con 0x555fb8f27390 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b6160 con 0x555fb8f1cad0 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 0x555fb8f17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 0x555fb8f17fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49336/0 (socket says 172.21.15.7:49336) 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.338+0000 7fa7dde00640 1 -- 172.21.15.7:0/3617338081 learned_addr learned my addr 172.21.15.7:0/3617338081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dd400640 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f1eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7de800640 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f3f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dde00640 1 -- 172.21.15.7:0/3617338081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 msgr2=0x555fb8f1eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f1eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dde00640 1 -- 172.21.15.7:0/3617338081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 msgr2=0x555fb8f3f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f3f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dde00640 1 -- 172.21.15.7:0/3617338081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb8c61620 con 0x555fb8f1c1b0 2024-04-23T15:21:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7dde00640 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 0x555fb8f17fc0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0bcf20 tx=0x7fa7cc031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce197a8d9d17394c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7c6600640 1 -- 172.21.15.7:0/3617338081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc049040 con 0x555fb8f1c1b0 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.339+0000 7fa7c6600640 1 -- 172.21.15.7:0/3617338081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7cc0bcf90 con 0x555fb8f1c1b0 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7c6600640 1 -- 172.21.15.7:0/3617338081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0b9600 con 0x555fb8f1c1b0 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3617338081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 msgr2=0x555fb8f17fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 0x555fb8f17fc0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0bcf20 tx=0x7fa7cc031f10 comp rx=0 tx=0).stop 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3617338081 shutdown_connections 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f3f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1cad0 0x555fb8f1eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/3617338081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1c1b0 0x555fb8f17fc0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.340+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3617338081 >> 172.21.15.7:0/3617338081 conn(0x555fb8f186c0 msgr2=0x555fb8f24c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.341+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3617338081 shutdown_connections 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.341+0000 7fa7e37c6740 1 -- 172.21.15.7:0/3617338081 wait complete. 2024-04-23T15:21:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.341+0000 7fa7e37c6740 1 -- start start 2024-04-23T15:21:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.341+0000 7fa7e37c6740 1 Processor -- start 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f2f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f20c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f21180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b6f00 con 0x555fb8f1cad0 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b6830 con 0x555fb8f27390 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81b3a90 con 0x555fb8f1c1b0 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7e37c6740 10 client.0 _ll_register_callbacks cb 0x7fa7c800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f20c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f20c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49338/0 (socket says 172.21.15.7:49338) 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7dd400640 1 -- 172.21.15.7:0/1182216083 learned_addr learned my addr 172.21.15.7:0/1182216083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7dde00640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f2f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.342+0000 7fa7de800640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f21180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7dd400640 1 -- 172.21.15.7:0/1182216083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 msgr2=0x555fb8f2f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7dd400640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f2f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7dd400640 1 -- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 msgr2=0x555fb8f21180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7dd400640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f21180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7dd400640 1 -- 172.21.15.7:0/1182216083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb8f216f0 con 0x555fb8f1cad0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7de800640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f21180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7dd400640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f20c40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c010 tx=0x7fa7c800b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f4077ace61336c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7bb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7bb400640 1 -- 172.21.15.7:0/1182216083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8015040 con 0x555fb8f1cad0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7cc0bcf90 con 0x555fb8f1cad0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.343+0000 7fa7bb400640 1 -- 172.21.15.7:0/1182216083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 9555+0+0 (secure 0 0 0) 0x7fa7c801a6f0 con 0x555fb8f1cad0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.344+0000 7fa7bb400640 1 -- 172.21.15.7:0/1182216083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa7c801a910 con 0x555fb8f1cad0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.344+0000 7fa7e37c6740 10 client.18069 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.344+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555fb8f9d6e0 con 0x555fb8f1cad0 2024-04-23T15:21:12.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.344+0000 7fa7bb400640 1 -- 172.21.15.7:0/1182216083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7cc0bcf90 con 0x555fb8f1cad0 2024-04-23T15:21:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.344+0000 7fa7bb400640 1 -- 172.21.15.7:0/1182216083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa7c80115e0 con 0x555fb8f1cad0 2024-04-23T15:21:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7e37c6740 10 client.18069 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:12.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7e37c6740 10 client.18069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7e37c6740 20 client.18069 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f9dbf0 0x555fb8fa0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7e37c6740 4 client.18069 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555fb8f39f10 con 0x555fb8f9dbf0 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.345+0000 7fa7dde00640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f9dbf0 0x555fb8fa0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.346+0000 7fa7dde00640 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f9dbf0 0x555fb8fa0010 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c67aed9047256fc server_cookie=900dfb88cbc42fe9 in_seq=0 out_seq=0 2024-04-23T15:21:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.346+0000 7fa7bb400640 10 client.18069 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.386+0000 7fa7bb400640 1 -- 172.21.15.7:0/1182216083 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555fb8f39f10 con 0x555fb8f9dbf0 2024-04-23T15:21:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.386+0000 7fa7bb400640 10 client.18069 handle_command_reply: tid=0 2024-04-23T15:21:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.386+0000 7fa7e37c6740 1 client.18069 shutdown 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 msgr2=0x555fb8f20c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f20c40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c010 tx=0x7fa7c800b520 comp rx=0 tx=0).stop 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 shutdown_connections 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555fb8f9dbf0 0x555fb8fa0010 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555fb8f27390 0x555fb8f21180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fb8f1cad0 0x555fb8f20c40 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 --2- 172.21.15.7:0/1182216083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555fb8f1c1b0 0x555fb8f2f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 >> 172.21.15.7:0/1182216083 conn(0x555fb8f186c0 msgr2=0x555fb8f25c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7bb400640 0 client.18069 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 shutdown_connections 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 1 -- 172.21.15.7:0/1182216083 wait complete. 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.387+0000 7fa7e37c6740 20 client.18069 trim_cache size 0 max 16384 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:21:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa7c00a3e40 msgr2=0x7fa7c00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa7c00a3e40 0x7fa7c00a6300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4005fd0 tx=0x7fa7d4009580 comp rx=0 tx=0).stop 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 msgr2=0x7fa7d819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 0x7fa7d819ed30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc005ab0 tx=0x7fa7cc003cd0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 shutdown_connections 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa7c00a3e40 0x7fa7c00a6300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7d810e690 0x7fa7d81a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d8108fb0 0x7fa7d819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 --2- 172.21.15.7:0/3507211115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d81085f0 0x7fa7d819ed30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.388+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 >> 172.21.15.7:0/3507211115 conn(0x7fa7d8076590 msgr2=0x7fa7d8077cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.389+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 shutdown_connections 2024-04-23T15:21:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:12.389+0000 7fa7e0800640 1 -- 172.21.15.7:0/3507211115 wait complete. 2024-04-23T15:21:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:12 smithi137 ceph-mon[31694]: pgmap v943: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:21:13.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:12 smithi007 ceph-mon[27906]: pgmap v943: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:21:13.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:12 smithi186 ceph-mon[31814]: pgmap v943: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:21:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:14 smithi137 ceph-mon[31694]: pgmap v944: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-04-23T15:21:15.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:14 smithi007 ceph-mon[27906]: pgmap v944: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-04-23T15:21:15.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:14 smithi186 ceph-mon[31814]: pgmap v944: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-04-23T15:21:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:16 smithi137 ceph-mon[31694]: pgmap v945: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-04-23T15:21:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:16 smithi137 ceph-mon[31694]: osdmap e140: 12 total, 12 up, 12 in 2024-04-23T15:21:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:16 smithi007 ceph-mon[27906]: pgmap v945: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-04-23T15:21:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:16 smithi007 ceph-mon[27906]: osdmap e140: 12 total, 12 up, 12 in 2024-04-23T15:21:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:16 smithi186 ceph-mon[31814]: pgmap v945: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 11 op/s 2024-04-23T15:21:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:16 smithi186 ceph-mon[31814]: osdmap e140: 12 total, 12 up, 12 in 2024-04-23T15:21:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:18 smithi137 ceph-mon[31694]: pgmap v947: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:21:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:18 smithi007 ceph-mon[27906]: pgmap v947: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:21:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:18 smithi186 ceph-mon[31814]: pgmap v947: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:21:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:20 smithi137 ceph-mon[31694]: pgmap v948: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:21:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:20 smithi007 ceph-mon[27906]: pgmap v948: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:21:21.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:20 smithi186 ceph-mon[31814]: pgmap v948: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:21:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:22 smithi137 ceph-mon[31694]: pgmap v949: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:21:23.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:22 smithi007 ceph-mon[27906]: pgmap v949: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:21:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:22 smithi186 ceph-mon[31814]: pgmap v949: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:21:25.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:24 smithi007 ceph-mon[27906]: pgmap v950: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:21:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:24 smithi137 ceph-mon[31694]: pgmap v950: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:21:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:24 smithi186 ceph-mon[31814]: pgmap v950: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:21:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 -- 172.21.15.7:0/1465813482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f810c3d0 msgr2=0x7f86f810e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 --2- 172.21.15.7:0/1465813482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f810c3d0 0x7f86f810e870 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009ca0 tx=0x7f86f002a950 comp rx=0 tx=0).stop 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 -- 172.21.15.7:0/1465813482 shutdown_connections 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 --2- 172.21.15.7:0/1465813482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f810c3d0 0x7f86f810e870 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 --2- 172.21.15.7:0/1465813482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86f8103920 0x7f86f810be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 --2- 172.21.15.7:0/1465813482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86f8103000 0x7f86f81033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.549+0000 7f86fcc00640 1 -- 172.21.15.7:0/1465813482 >> 172.21.15.7:0/1465813482 conn(0x7f86f80fc820 msgr2=0x7f86f80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.550+0000 7f86fcc00640 1 -- 172.21.15.7:0/1465813482 shutdown_connections 2024-04-23T15:21:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.550+0000 7f86fcc00640 1 -- 172.21.15.7:0/1465813482 wait complete. 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.551+0000 7f86fcc00640 1 Processor -- start 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.551+0000 7f86fcc00640 1 -- start start 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.551+0000 7f86fcc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86f8103000 0x7f86f8100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.551+0000 7f86fcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 0x7f86f8101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.551+0000 7f86fcc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86f810c3d0 0x7f86f81016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86fcc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86f8112090 con 0x7f86f8103920 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86fcc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86f8111f10 con 0x7f86f8103000 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86fcc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f86f8112210 con 0x7f86f810c3d0 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 0x7f86f8101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 0x7f86f8101190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51510/0 (socket says 172.21.15.7:51510) 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 -- 172.21.15.7:0/22234414 learned_addr learned my addr 172.21.15.7:0/22234414 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f7e00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86f810c3d0 0x7f86f81016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f7400640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86f8103000 0x7f86f8100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 -- 172.21.15.7:0/22234414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86f810c3d0 msgr2=0x7f86f81016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86f810c3d0 0x7f86f81016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 -- 172.21.15.7:0/22234414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86f8103000 msgr2=0x7f86f8100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86f8103000 0x7f86f8100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.552+0000 7f86f6a00640 1 -- 172.21.15.7:0/22234414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f81a6a70 con 0x7f86f8103920 2024-04-23T15:21:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.553+0000 7f86f6a00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 0x7f86f8101190 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f86e400d950 tx=0x7f86e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.553+0000 7f86efe00640 1 -- 172.21.15.7:0/22234414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4017070 con 0x7f86f8103920 2024-04-23T15:21:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.553+0000 7f86efe00640 1 -- 172.21.15.7:0/22234414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86e4009c30 con 0x7f86f8103920 2024-04-23T15:21:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.553+0000 7f86efe00640 1 -- 172.21.15.7:0/22234414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e400f620 con 0x7f86f8103920 2024-04-23T15:21:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.553+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f81a6d60 con 0x7f86f8103920 2024-04-23T15:21:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.553+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f81a7250 con 0x7f86f8103920 2024-04-23T15:21:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.557+0000 7f8700d22740 1 Processor -- start 2024-04-23T15:21:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 -- start start 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f86efe00640 1 -- 172.21.15.7:0/22234414 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f86e40109a0 con 0x7f86f8103920 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cecf027900 con 0x55cecf0cc5a0 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cecefcdf20 con 0x55cecf0c1ce0 2024-04-23T15:21:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f8700d22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cecf0238c0 con 0x55cecf0c13c0 2024-04-23T15:21:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.558+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51520/0 (socket says 172.21.15.7:51520) 2024-04-23T15:21:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 -- 172.21.15.7:0/1155393629 learned_addr learned my addr 172.21.15.7:0/1155393629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f7e00640 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f7400640 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 -- 172.21.15.7:0/1155393629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 msgr2=0x55cecf0c17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0c17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 -- 172.21.15.7:0/1155393629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 msgr2=0x55cecf0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.559+0000 7f86f6a00640 1 -- 172.21.15.7:0/1155393629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceceff2e10 con 0x55cecf0cc5a0 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ce990 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f86e40cda90 tx=0x7f86e40d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b214c5a61b3c5bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86e3e00640 1 -- 172.21.15.7:0/1155393629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e40df070 con 0x55cecf0cc5a0 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86e3e00640 1 -- 172.21.15.7:0/1155393629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86e40d2580 con 0x55cecf0cc5a0 2024-04-23T15:21:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86e3e00640 1 -- 172.21.15.7:0/1155393629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e40db800 con 0x55cecf0cc5a0 2024-04-23T15:21:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86efe00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f86dc0a3d40 0x7f86dc0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86efe00640 1 -- 172.21.15.7:0/22234414 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7f86e40d0810 con 0x7f86f8103920 2024-04-23T15:21:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.560+0000 7f86f7e00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f86dc0a3d40 0x7f86dc0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 -- 172.21.15.7:0/1155393629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 msgr2=0x55cecf0ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ce990 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f86e40cda90 tx=0x7f86e40d8670 comp rx=0 tx=0).stop 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 -- 172.21.15.7:0/1155393629 shutdown_connections 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ce990 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 --2- 172.21.15.7:0/1155393629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0c17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 -- 172.21.15.7:0/1155393629 >> 172.21.15.7:0/1155393629 conn(0x55cecf0bd8d0 msgr2=0x55cecf0bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 -- 172.21.15.7:0/1155393629 shutdown_connections 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f8700d22740 1 -- 172.21.15.7:0/1155393629 wait complete. 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.561+0000 7f86f7e00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f86dc0a3d40 0x7f86dc0a6200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f86f0005fa0 tx=0x7f86f0004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.562+0000 7f8700d22740 1 -- start start 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.562+0000 7f8700d22740 1 Processor -- start 2024-04-23T15:21:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cecf0cf0e0 con 0x55cecf0c13c0 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cecefe12c0 con 0x55cecf0c1ce0 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cecf0cf260 con 0x55cecf0cc5a0 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f8700d22740 10 client.0 _ll_register_callbacks cb 0x55ceced39a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51536/0 (socket says 172.21.15.7:51536) 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 -- 172.21.15.7:0/1603269347 learned_addr learned my addr 172.21.15.7:0/1603269347 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 -- 172.21.15.7:0/1603269347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 msgr2=0x55cecf0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 -- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 msgr2=0x55cecf0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.563+0000 7f86f7400640 1 -- 172.21.15.7:0/1603269347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceceff1fd0 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.564+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.564+0000 7f86f7400640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c9640 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bde0 tx=0x7f86e80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34999559cc06c05 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.564+0000 7f86e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.564+0000 7f86e0c00640 1 -- 172.21.15.7:0/1603269347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8004220 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.564+0000 7f86e0c00640 1 -- 172.21.15.7:0/1603269347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7f86e80043c0 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.564+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e40d2580 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f86e0c00640 1 -- 172.21.15.7:0/1603269347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f86e80035f0 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 10 client.18081 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ceced3a210 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f86e0c00640 1 -- 172.21.15.7:0/1603269347 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86e40d2580 con 0x55cecf0c13c0 2024-04-23T15:21:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f86e0c00640 1 -- 172.21.15.7:0/1603269347 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f86e801b8a0 con 0x55cecf0c13c0 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 10 client.18081 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 10 client.18081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 20 client.18081 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf0dc870 0x55cecf0decc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 4 client.18081 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.565+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cecf035320 con 0x55cecf0dc870 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.566+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf0dc870 0x55cecf0decc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.567+0000 7f86f6a00640 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf0dc870 0x55cecf0decc0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4c07c6a3f513ce2 server_cookie=d94c4729587a3de1 in_seq=0 out_seq=0 2024-04-23T15:21:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.567+0000 7f86e0c00640 10 client.18081 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f86e0c00640 1 -- 172.21.15.7:0/1603269347 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cecf035320 con 0x55cecf0dc870 2024-04-23T15:21:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f86e0c00640 10 client.18081 handle_command_reply: tid=0 2024-04-23T15:21:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 client.18081 shutdown 2024-04-23T15:21:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 msgr2=0x55cecf0c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c9640 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bde0 tx=0x7f86e80117b0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 shutdown_connections 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf0dc870 0x55cecf0decc0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 --2- 172.21.15.7:0/1603269347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c9640 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f86e0c00640 0 client.18081 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.569+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 >> 172.21.15.7:0/1603269347 conn(0x55cecf0bd8d0 msgr2=0x55cecf0bca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.570+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 shutdown_connections 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.570+0000 7f8700d22740 1 -- 172.21.15.7:0/1603269347 wait complete. 2024-04-23T15:21:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.570+0000 7f8700d22740 20 client.18081 trim_cache size 0 max 16384 2024-04-23T15:21:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.590+0000 7f8700d22740 1 Processor -- start 2024-04-23T15:21:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.590+0000 7f8700d22740 1 -- start start 2024-04-23T15:21:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.590+0000 7f8700d22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.590+0000 7f8700d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f8700d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f8700d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81b14f0 con 0x55cecf0cc5a0 2024-04-23T15:21:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f8700d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81b3030 con 0x55cecf0c1ce0 2024-04-23T15:21:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f8700d22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81b1bc0 con 0x55cecf0c13c0 2024-04-23T15:21:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f86f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f86f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0e45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51548/0 (socket says 172.21.15.7:51548) 2024-04-23T15:21:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f86f7e00640 1 -- 172.21.15.7:0/3661261260 learned_addr learned my addr 172.21.15.7:0/3661261260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f86f7400640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.591+0000 7f86f6a00640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7e00640 1 -- 172.21.15.7:0/3661261260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 msgr2=0x55cecf0d8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7e00640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0d8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7e00640 1 -- 172.21.15.7:0/3661261260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 msgr2=0x55cecf0c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7e00640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7e00640 1 -- 172.21.15.7:0/3661261260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cecee06620 con 0x55cecf0cc5a0 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7400640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f6a00640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86f7e00640 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0e45d0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f86f0035000 tx=0x7f86f00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55994d8030fa870c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86e3400640 1 -- 172.21.15.7:0/3661261260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0034040 con 0x55cecf0cc5a0 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86e3400640 1 -- 172.21.15.7:0/3661261260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86f004d070 con 0x55cecf0cc5a0 2024-04-23T15:21:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.592+0000 7f86e3400640 1 -- 172.21.15.7:0/3661261260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0004790 con 0x55cecf0cc5a0 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 -- 172.21.15.7:0/3661261260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 msgr2=0x55cecf0e45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0e45d0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f86f0035000 tx=0x7f86f00095c0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 -- 172.21.15.7:0/3661261260 shutdown_connections 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0cc5a0 0x55cecf0e45d0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 --2- 172.21.15.7:0/3661261260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0c13c0 0x55cecf0d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 -- 172.21.15.7:0/3661261260 >> 172.21.15.7:0/3661261260 conn(0x55cecf0bd8d0 msgr2=0x55cecf0b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 -- 172.21.15.7:0/3661261260 shutdown_connections 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.593+0000 7f8700d22740 1 -- 172.21.15.7:0/3661261260 wait complete. 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.594+0000 7f8700d22740 1 -- start start 2024-04-23T15:21:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.594+0000 7f8700d22740 1 Processor -- start 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81b2960 con 0x55cecf0c13c0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81b2290 con 0x55cecf0c1ce0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81af4f0 con 0x55cecf0cc5a0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f8700d22740 10 client.0 _ll_register_callbacks cb 0x7f86e800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f86f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f86f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51554/0 (socket says 172.21.15.7:51554) 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f86f7400640 1 -- 172.21.15.7:0/3679189392 learned_addr learned my addr 172.21.15.7:0/3679189392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f86f6a00640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.595+0000 7f86f7e00640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f7400640 1 -- 172.21.15.7:0/3679189392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 msgr2=0x55cecf0c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f7400640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f7400640 1 -- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 msgr2=0x55cecf0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f7400640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f7400640 1 -- 172.21.15.7:0/3679189392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cecf142090 con 0x55cecf0c13c0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f6a00640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86f7400640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c6570 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bde0 tx=0x7f86e8011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f1ba3e6c2e891f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86e0c00640 1 -- 172.21.15.7:0/3679189392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8005450 con 0x55cecf0c13c0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f86e0c00640 1 -- 172.21.15.7:0/3679189392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7f86e801b480 con 0x55cecf0c13c0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.596+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f004d070 con 0x55cecf0c13c0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f86e0c00640 1 -- 172.21.15.7:0/3679189392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f86e80055f0 con 0x55cecf0c13c0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 10 client.18087 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cecf1433a0 con 0x55cecf0c13c0 2024-04-23T15:21:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f86e0c00640 1 -- 172.21.15.7:0/3679189392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86f004d070 con 0x55cecf0c13c0 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f86e0c00640 1 -- 172.21.15.7:0/3679189392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f86e8031020 con 0x55cecf0c13c0 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 10 client.18087 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 10 client.18087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 20 client.18087 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf143af0 0x55cecf145f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 4 client.18087 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.597+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cecf02f190 con 0x55cecf143af0 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.598+0000 7f86f6a00640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf143af0 0x55cecf145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.599+0000 7f86f6a00640 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf143af0 0x55cecf145f10 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3654f443ad8e22b0 server_cookie=a7ea1a46552023a9 in_seq=0 out_seq=0 2024-04-23T15:21:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.599+0000 7f86e0c00640 10 client.18087 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f86e0c00640 1 -- 172.21.15.7:0/3679189392 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cecf02f190 con 0x55cecf143af0 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f86e0c00640 10 client.18087 handle_command_reply: tid=0 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 client.18087 shutdown 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 msgr2=0x55cecf0c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c6570 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f86e800bde0 tx=0x7f86e8011fb0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 shutdown_connections 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cecf143af0 0x55cecf145f10 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cecf0c1ce0 0x55cecf0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cecf0cc5a0 0x55cecf0c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 --2- 172.21.15.7:0/3679189392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cecf0c13c0 0x55cecf0c6570 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 >> 172.21.15.7:0/3679189392 conn(0x55cecf0bd8d0 msgr2=0x55cecf0bc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.632+0000 7f86e0c00640 0 client.18087 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.633+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 shutdown_connections 2024-04-23T15:21:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.633+0000 7f8700d22740 1 -- 172.21.15.7:0/3679189392 wait complete. 2024-04-23T15:21:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.633+0000 7f8700d22740 20 client.18087 trim_cache size 0 max 16384 2024-04-23T15:21:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:21:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:21:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:21:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f86dc0a3d40 msgr2=0x7f86dc0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f86dc0a3d40 0x7f86dc0a6200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f86f0005fa0 tx=0x7f86f0004a40 comp rx=0 tx=0).stop 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 msgr2=0x7f86f8101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 0x7f86f8101190 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f86e400d950 tx=0x7f86e400de10 comp rx=0 tx=0).stop 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 shutdown_connections 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f86dc0a3d40 0x7f86dc0a6200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86f810c3d0 0x7f86f81016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86f8103920 0x7f86f8101190 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 --2- 172.21.15.7:0/22234414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86f8103000 0x7f86f8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 >> 172.21.15.7:0/22234414 conn(0x7f86f80fc820 msgr2=0x7f86f80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 shutdown_connections 2024-04-23T15:21:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:25.634+0000 7f86fcc00640 1 -- 172.21.15.7:0/22234414 wait complete. 2024-04-23T15:21:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:26 smithi137 ceph-mon[31694]: pgmap v951: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:21:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:26 smithi007 ceph-mon[27906]: pgmap v951: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:21:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:26 smithi186 ceph-mon[31814]: pgmap v951: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:21:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:28 smithi137 ceph-mon[31694]: pgmap v952: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.1 MiB/s wr, 23 op/s 2024-04-23T15:21:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:28 smithi007 ceph-mon[27906]: pgmap v952: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.1 MiB/s wr, 23 op/s 2024-04-23T15:21:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:28 smithi186 ceph-mon[31814]: pgmap v952: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.1 MiB/s wr, 23 op/s 2024-04-23T15:21:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:30 smithi137 ceph-mon[31694]: pgmap v953: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:21:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:30 smithi007 ceph-mon[27906]: pgmap v953: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:21:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:30 smithi186 ceph-mon[31814]: pgmap v953: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:21:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:32 smithi137 ceph-mon[31694]: pgmap v954: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:21:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:32 smithi007 ceph-mon[27906]: pgmap v954: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:21:33.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:32 smithi186 ceph-mon[31814]: pgmap v954: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:21:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:34 smithi007 ceph-mon[27906]: pgmap v955: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:21:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:34 smithi186 ceph-mon[31814]: pgmap v955: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:21:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:34 smithi137 ceph-mon[31694]: pgmap v955: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:21:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:36 smithi007 ceph-mon[27906]: pgmap v956: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:36 smithi186 ceph-mon[31814]: pgmap v956: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:36 smithi137 ceph-mon[31694]: pgmap v956: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 -- 172.21.15.7:0/921354873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0100f60 msgr2=0x7f97c0101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 --2- 172.21.15.7:0/921354873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0100f60 0x7f97c0101340 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009900 tx=0x7f97b002a410 comp rx=0 tx=0).stop 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 -- 172.21.15.7:0/921354873 shutdown_connections 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 --2- 172.21.15.7:0/921354873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97c0106030 0x7f97c010dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 --2- 172.21.15.7:0/921354873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97c0101910 0x7f97c0105950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 --2- 172.21.15.7:0/921354873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0100f60 0x7f97c0101340 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 -- 172.21.15.7:0/921354873 >> 172.21.15.7:0/921354873 conn(0x7f97c00fc820 msgr2=0x7f97c00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 -- 172.21.15.7:0/921354873 shutdown_connections 2024-04-23T15:21:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.791+0000 7f97c5a00640 1 -- 172.21.15.7:0/921354873 wait complete. 2024-04-23T15:21:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.792+0000 7f97c5a00640 1 Processor -- start 2024-04-23T15:21:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 -- start start 2024-04-23T15:21:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97c0100f60 0x7f97c01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 0x7f97c01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97c019a750 0x7f97c019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01120b0 con 0x7f97c0106030 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0111f30 con 0x7f97c0100f60 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97c5a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0112230 con 0x7f97c019a750 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 0x7f97c01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 0x7f97c01a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35200/0 (socket says 172.21.15.7:35200) 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.793+0000 7f97b7400640 1 -- 172.21.15.7:0/2438461226 learned_addr learned my addr 172.21.15.7:0/2438461226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97bfe00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97c0100f60 0x7f97c01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97c5000640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97c019a750 0x7f97c019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97b7400640 1 -- 172.21.15.7:0/2438461226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97c019a750 msgr2=0x7f97c019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97b7400640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97c019a750 0x7f97c019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97b7400640 1 -- 172.21.15.7:0/2438461226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97c0100f60 msgr2=0x7f97c01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97b7400640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97c0100f60 0x7f97c01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97b7400640 1 -- 172.21.15.7:0/2438461226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c019b350 con 0x7f97c0106030 2024-04-23T15:21:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.794+0000 7f97b7400640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 0x7f97c01a0bd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f97a800e9f0 tx=0x7f97a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.795+0000 7f97bd600640 1 -- 172.21.15.7:0/2438461226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a800ccc0 con 0x7f97c0106030 2024-04-23T15:21:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.795+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c01a7430 con 0x7f97c0106030 2024-04-23T15:21:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.795+0000 7f97bd600640 1 -- 172.21.15.7:0/2438461226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97a80054d0 con 0x7f97c0106030 2024-04-23T15:21:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.795+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c01a7830 con 0x7f97c0106030 2024-04-23T15:21:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.795+0000 7f97bd600640 1 -- 172.21.15.7:0/2438461226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8018430 con 0x7f97c0106030 2024-04-23T15:21:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 Processor -- start 2024-04-23T15:21:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97bd600640 1 -- 172.21.15.7:0/2438461226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f97a8005000 con 0x7f97c0106030 2024-04-23T15:21:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 -- start start 2024-04-23T15:21:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556a87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556b35a0 0x5593556b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55935560e900 con 0x5593556a83c0 2024-04-23T15:21:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5593555b4f20 con 0x5593556a8ce0 2024-04-23T15:21:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.799+0000 7f97c9dee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55935560a8c0 con 0x5593556b35a0 2024-04-23T15:21:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556a87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556a87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35202/0 (socket says 172.21.15.7:35202) 2024-04-23T15:21:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 -- 172.21.15.7:0/3104941164 learned_addr learned my addr 172.21.15.7:0/3104941164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97b7400640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556b35a0 0x5593556b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 -- 172.21.15.7:0/3104941164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556b35a0 msgr2=0x5593556b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556b35a0 0x5593556b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 -- 172.21.15.7:0/3104941164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 msgr2=0x5593556b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97c5000640 1 -- 172.21.15.7:0/3104941164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593555d9e10 con 0x5593556a83c0 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97b7400640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556b35a0 0x5593556b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.800+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97c5000640 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556a87a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009f40 tx=0x7f97b8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c88fcf21933821 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97bd600640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f97a40a3d10 0x7f97a40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97b5600640 1 -- 172.21.15.7:0/3104941164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8003b70 con 0x5593556a83c0 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97bd600640 1 -- 172.21.15.7:0/2438461226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7f97a80d1280 con 0x7f97c0106030 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97b5600640 1 -- 172.21.15.7:0/3104941164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97b8003d10 con 0x5593556a83c0 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97b5600640 1 -- 172.21.15.7:0/3104941164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b80119c0 con 0x5593556a83c0 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.801+0000 7f97bfe00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f97a40a3d10 0x7f97a40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 -- 172.21.15.7:0/3104941164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 msgr2=0x5593556a87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556a87a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009f40 tx=0x7f97b8010860 comp rx=0 tx=0).stop 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97bfe00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f97a40a3d10 0x7f97a40a61d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97b0031440 tx=0x7f97b00058b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 -- 172.21.15.7:0/3104941164 shutdown_connections 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556b35a0 0x5593556b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3104941164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556a87a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 -- 172.21.15.7:0/3104941164 >> 172.21.15.7:0/3104941164 conn(0x5593556a48d0 msgr2=0x5593556a4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 -- 172.21.15.7:0/3104941164 shutdown_connections 2024-04-23T15:21:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.802+0000 7f97c9dee740 1 -- 172.21.15.7:0/3104941164 wait complete. 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.803+0000 7f97c9dee740 1 -- start start 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.803+0000 7f97c9dee740 1 Processor -- start 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a83c0 0x5593556b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556b35a0 0x5593556b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593556b60e0 con 0x5593556a8ce0 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5593555c82c0 con 0x5593556b35a0 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5593556b6260 con 0x5593556a83c0 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c9dee740 10 client.0 _ll_register_callbacks cb 0x559355320a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35204/0 (socket says 172.21.15.7:35204) 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 -- 172.21.15.7:0/3384431923 learned_addr learned my addr 172.21.15.7:0/3384431923 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a83c0 0x5593556b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c5000640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556b35a0 0x5593556b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 -- 172.21.15.7:0/3384431923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a83c0 msgr2=0x5593556b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a83c0 0x5593556b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 -- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556b35a0 msgr2=0x5593556b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556b35a0 0x5593556b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97b7400640 1 -- 172.21.15.7:0/3384431923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593555d8fd0 con 0x5593556a8ce0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a83c0 0x5593556b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.804+0000 7f97c5000640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556b35a0 0x5593556b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97b7400640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556b0a40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f97a809cda0 tx=0x7f97a800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9707cf47a7562947 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97ae000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97ae000640 1 -- 172.21.15.7:0/3384431923 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a80cea40 con 0x5593556a8ce0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97ae000640 1 -- 172.21.15.7:0/3384431923 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7f97a809c260 con 0x5593556a8ce0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b8003d10 con 0x5593556a8ce0 2024-04-23T15:21:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97ae000640 1 -- 172.21.15.7:0/3384431923 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f97a809d510 con 0x5593556a8ce0 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97c9dee740 10 client.18099 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.805+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559355321210 con 0x5593556a8ce0 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97ae000640 1 -- 172.21.15.7:0/3384431923 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97b8003d10 con 0x5593556a8ce0 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97ae000640 1 -- 172.21.15.7:0/3384431923 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f97a809bcd0 con 0x5593556a8ce0 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97c9dee740 10 client.18099 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97c9dee740 10 client.18099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97c9dee740 20 client.18099 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556c3560 0x5593556c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97c9dee740 4 client.18099 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.806+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55935561c320 con 0x5593556c3560 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.807+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556c3560 0x5593556c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.808+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556c3560 0x5593556c5950 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b8f7719816e3db server_cookie=68e087e036709a92 in_seq=0 out_seq=0 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.808+0000 7f97ae000640 10 client.18099 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97ae000640 1 -- 172.21.15.7:0/3384431923 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55935561c320 con 0x5593556c3560 2024-04-23T15:21:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97ae000640 10 client.18099 handle_command_reply: tid=0 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 client.18099 shutdown 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 msgr2=0x5593556b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556b0a40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f97a809cda0 tx=0x7f97a800cf20 comp rx=0 tx=0).stop 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 shutdown_connections 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556c3560 0x5593556c5950 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556b35a0 0x5593556b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556b0a40 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3384431923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a83c0 0x5593556b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97ae000640 0 client.18099 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 >> 172.21.15.7:0/3384431923 conn(0x5593556a48d0 msgr2=0x5593556aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 shutdown_connections 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.810+0000 7f97c9dee740 1 -- 172.21.15.7:0/3384431923 wait complete. 2024-04-23T15:21:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.811+0000 7f97c9dee740 20 client.18099 trim_cache size 0 max 16384 2024-04-23T15:21:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 Processor -- start 2024-04-23T15:21:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 -- start start 2024-04-23T15:21:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a83c0 0x5593556bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b1580 con 0x5593556a8ce0 2024-04-23T15:21:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b30c0 con 0x5593556a83c0 2024-04-23T15:21:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.833+0000 7f97c9dee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b1c50 con 0x5593556a48d0 2024-04-23T15:21:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35216/0 (socket says 172.21.15.7:35216) 2024-04-23T15:21:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 -- 172.21.15.7:0/245586755 learned_addr learned my addr 172.21.15.7:0/245586755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97bfe00640 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97b7400640 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a83c0 0x5593556bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 -- 172.21.15.7:0/245586755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 msgr2=0x5593556b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 -- 172.21.15.7:0/245586755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a83c0 msgr2=0x5593556bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a83c0 0x5593556bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97c5000640 1 -- 172.21.15.7:0/245586755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593553ed620 con 0x5593556a8ce0 2024-04-23T15:21:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.834+0000 7f97bfe00640 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.835+0000 7f97c5000640 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556cb260 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000f80 tx=0x7f97b8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b318e2a383698e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.835+0000 7f97b4c00640 1 -- 172.21.15.7:0/245586755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8003a30 con 0x5593556a8ce0 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.835+0000 7f97b4c00640 1 -- 172.21.15.7:0/245586755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97b8003bd0 con 0x5593556a8ce0 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.835+0000 7f97b4c00640 1 -- 172.21.15.7:0/245586755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b80053b0 con 0x5593556a8ce0 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 -- 172.21.15.7:0/245586755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 msgr2=0x5593556cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556cb260 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f97b8000f80 tx=0x7f97b8009b80 comp rx=0 tx=0).stop 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 -- 172.21.15.7:0/245586755 shutdown_connections 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a83c0 0x5593556bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a8ce0 0x5593556cb260 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 --2- 172.21.15.7:0/245586755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 -- 172.21.15.7:0/245586755 >> 172.21.15.7:0/245586755 conn(0x55935569fe60 msgr2=0x5593556a4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 -- 172.21.15.7:0/245586755 shutdown_connections 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.836+0000 7f97c9dee740 1 -- 172.21.15.7:0/245586755 wait complete. 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.837+0000 7f97c9dee740 1 -- start start 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.837+0000 7f97c9dee740 1 Processor -- start 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.837+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.837+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97c9dee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97c9dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b29f0 con 0x5593556a83c0 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97c9dee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b2320 con 0x5593556a8ce0 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97c9dee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01af580 con 0x5593556a48d0 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97c9dee740 10 client.0 _ll_register_callbacks cb 0x7f97a80096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35226/0 (socket says 172.21.15.7:35226) 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 -- 172.21.15.7:0/3446659193 learned_addr learned my addr 172.21.15.7:0/3446659193 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97c5000640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 -- 172.21.15.7:0/3446659193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 msgr2=0x5593556ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 -- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 msgr2=0x5593556adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.838+0000 7f97b7400640 1 -- 172.21.15.7:0/3446659193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559355728ad0 con 0x5593556a83c0 2024-04-23T15:21:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97b7400640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556ad750 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f97a8099270 tx=0x7f97a80cea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637709d4aa724332 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97ae000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97ae000640 1 -- 172.21.15.7:0/3446659193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a80990b0 con 0x5593556a83c0 2024-04-23T15:21:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97ae000640 1 -- 172.21.15.7:0/3446659193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7f97a809c460 con 0x5593556a83c0 2024-04-23T15:21:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b8003bd0 con 0x5593556a83c0 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.839+0000 7f97ae000640 1 -- 172.21.15.7:0/3446659193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f97a809c950 con 0x5593556a83c0 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 10 client.18105 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559355728ad0 con 0x5593556a83c0 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97ae000640 1 -- 172.21.15.7:0/3446659193 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97b8003bd0 con 0x5593556a83c0 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97ae000640 1 -- 172.21.15.7:0/3446659193 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f97a80a23e0 con 0x5593556a83c0 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 10 client.18105 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 10 client.18105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 20 client.18105 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556b35a0 0x55935572c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 4 client.18105 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:21:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.840+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559355616190 con 0x5593556b35a0 2024-04-23T15:21:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.841+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556b35a0 0x55935572c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.842+0000 7f97bfe00640 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556b35a0 0x55935572c110 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b3705c7e5de5790 server_cookie=e3c7c1838fc7f64b in_seq=0 out_seq=0 2024-04-23T15:21:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.842+0000 7f97ae000640 10 client.18105 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97ae000640 1 -- 172.21.15.7:0/3446659193 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559355616190 con 0x5593556b35a0 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97ae000640 10 client.18105 handle_command_reply: tid=0 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 client.18105 shutdown 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 msgr2=0x5593556ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556ad750 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f97a8099270 tx=0x7f97a80cea70 comp rx=0 tx=0).stop 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 shutdown_connections 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593556b35a0 0x55935572c110 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593556a8ce0 0x5593556adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593556a83c0 0x5593556ad750 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 --2- 172.21.15.7:0/3446659193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593556a48d0 0x5593556ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 >> 172.21.15.7:0/3446659193 conn(0x55935569fe60 msgr2=0x5593556b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:38.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.877+0000 7f97ae000640 0 client.18105 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.878+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 shutdown_connections 2024-04-23T15:21:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.878+0000 7f97c9dee740 1 -- 172.21.15.7:0/3446659193 wait complete. 2024-04-23T15:21:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.878+0000 7f97c9dee740 20 client.18105 trim_cache size 0 max 16384 2024-04-23T15:21:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:21:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:21:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:21:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f97a40a3d10 msgr2=0x7f97a40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f97a40a3d10 0x7f97a40a61d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97b0031440 tx=0x7f97b00058b0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 msgr2=0x7f97c01a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 0x7f97c01a0bd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f97a800e9f0 tx=0x7f97a800eeb0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 shutdown_connections 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f97a40a3d10 0x7f97a40a61d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97c019a750 0x7f97c019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97c0106030 0x7f97c01a0bd0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 --2- 172.21.15.7:0/2438461226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97c0100f60 0x7f97c01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 >> 172.21.15.7:0/2438461226 conn(0x7f97c00fc820 msgr2=0x7f97c00fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 shutdown_connections 2024-04-23T15:21:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:38.879+0000 7f97c5a00640 1 -- 172.21.15.7:0/2438461226 wait complete. 2024-04-23T15:21:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:38 smithi007 ceph-mon[27906]: pgmap v957: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:38 smithi186 ceph-mon[31814]: pgmap v957: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:38 smithi137 ceph-mon[31694]: pgmap v957: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:40 smithi007 ceph-mon[27906]: pgmap v958: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:21:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:40 smithi186 ceph-mon[31814]: pgmap v958: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:21:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:40 smithi137 ceph-mon[31694]: pgmap v958: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:21:43.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:42 smithi007 ceph-mon[27906]: pgmap v959: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:21:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:42 smithi186 ceph-mon[31814]: pgmap v959: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:21:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:42 smithi137 ceph-mon[31694]: pgmap v959: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:21:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:44 smithi007 ceph-mon[27906]: pgmap v960: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:21:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:44 smithi186 ceph-mon[31814]: pgmap v960: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:21:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:44 smithi137 ceph-mon[31694]: pgmap v960: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:21:46.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:45 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:21:46.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:45 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:21:46.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:45 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:21:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:46 smithi007 ceph-mon[27906]: pgmap v961: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:46 smithi186 ceph-mon[31814]: pgmap v961: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:46 smithi137 ceph-mon[31694]: pgmap v961: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:48.698 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: pgmap v962: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:48.699 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:48.699 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: pgmap v962: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:21:49.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:21:49.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: pgmap v962: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:21:49.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:21:49.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:21:49.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:21:51.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:50 smithi007 ceph-mon[27906]: pgmap v963: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:51.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:50 smithi186 ceph-mon[31814]: pgmap v963: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:50 smithi137 ceph-mon[31694]: pgmap v963: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 -- 172.21.15.7:0/407201457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103020 msgr2=0x7fb32c103400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 --2- 172.21.15.7:0/407201457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103020 0x7fb32c103400 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fb320009900 tx=0x7fb32002a480 comp rx=0 tx=0).stop 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 -- 172.21.15.7:0/407201457 shutdown_connections 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 --2- 172.21.15.7:0/407201457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32c103940 0x7fb32c10be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 --2- 172.21.15.7:0/407201457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb32c10c3f0 0x7fb32c10e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 --2- 172.21.15.7:0/407201457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103020 0x7fb32c103400 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 -- 172.21.15.7:0/407201457 >> 172.21.15.7:0/407201457 conn(0x7fb32c0fc820 msgr2=0x7fb32c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 -- 172.21.15.7:0/407201457 shutdown_connections 2024-04-23T15:21:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.040+0000 7fb332e00640 1 -- 172.21.15.7:0/407201457 wait complete. 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.041+0000 7fb332e00640 1 Processor -- start 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.041+0000 7fb332e00640 1 -- start start 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.041+0000 7fb332e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb32c103020 0x7fb32c1a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.041+0000 7fb332e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 0x7fb32c1a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.041+0000 7fb332e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32c10c3f0 0x7fb32c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb332e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c112050 con 0x7fb32c103940 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb332e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c111ed0 con 0x7fb32c10c3f0 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb332e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1121d0 con 0x7fb32c103020 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 0x7fb32c1a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 0x7fb32c1a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48228/0 (socket says 172.21.15.7:48228) 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 -- 172.21.15.7:0/2918788160 learned_addr learned my addr 172.21.15.7:0/2918788160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331a00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb32c103020 0x7fb32c1a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb332400640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32c10c3f0 0x7fb32c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 -- 172.21.15.7:0/2918788160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb32c103020 msgr2=0x7fb32c1a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb32c103020 0x7fb32c1a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 -- 172.21.15.7:0/2918788160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32c10c3f0 msgr2=0x7fb32c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32c10c3f0 0x7fb32c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.042+0000 7fb331000640 1 -- 172.21.15.7:0/2918788160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c19af50 con 0x7fb32c103940 2024-04-23T15:21:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.043+0000 7fb331000640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 0x7fb32c1a0b10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb31800d950 tx=0x7fb31800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.043+0000 7fb32a000640 1 -- 172.21.15.7:0/2918788160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318017070 con 0x7fb32c103940 2024-04-23T15:21:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.043+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c19b240 con 0x7fb32c103940 2024-04-23T15:21:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.043+0000 7fb32a000640 1 -- 172.21.15.7:0/2918788160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb318009c30 con 0x7fb32c103940 2024-04-23T15:21:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.043+0000 7fb32a000640 1 -- 172.21.15.7:0/2918788160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31800f620 con 0x7fb32c103940 2024-04-23T15:21:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.043+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c1a7550 con 0x7fb32c103940 2024-04-23T15:21:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.047+0000 7fb337383740 1 Processor -- start 2024-04-23T15:21:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.047+0000 7fb337383740 1 -- start start 2024-04-23T15:21:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.047+0000 7fb32a000640 1 -- 172.21.15.7:0/2918788160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb3180109a0 con 0x7fb32c103940 2024-04-23T15:21:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb337383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432d3c0 0x55656432d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb337383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564338060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb337383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb337383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556564293900 con 0x55656432dce0 2024-04-23T15:21:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb337383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556564239f20 con 0x5565643385a0 2024-04-23T15:21:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb337383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55656428f8c0 con 0x55656432d3c0 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb331a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564338060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb331a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564338060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48236/0 (socket says 172.21.15.7:48236) 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb331a00640 1 -- 172.21.15.7:0/2945814196 learned_addr learned my addr 172.21.15.7:0/2945814196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb331000640 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.048+0000 7fb332400640 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432d3c0 0x55656432d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331a00640 1 -- 172.21.15.7:0/2945814196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432d3c0 msgr2=0x55656432d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331a00640 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432d3c0 0x55656432d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331a00640 1 -- 172.21.15.7:0/2945814196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 msgr2=0x55656433a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331a00640 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331a00640 1 -- 172.21.15.7:0/2945814196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55656425ee10 con 0x55656432dce0 2024-04-23T15:21:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331000640 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb331a00640 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564338060 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb320006010 tx=0x7fb320032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3fcf851ba4b357 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.049+0000 7fb32a000640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb3140a3d10 0x7fb3140a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.050+0000 7fb32a000640 1 -- 172.21.15.7:0/2918788160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7fb3180d08c0 con 0x7fb32c103940 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.050+0000 7fb31ea00640 1 -- 172.21.15.7:0/2945814196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32003f070 con 0x55656432dce0 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.050+0000 7fb31ea00640 1 -- 172.21.15.7:0/2945814196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb320032e20 con 0x55656432dce0 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.050+0000 7fb31ea00640 1 -- 172.21.15.7:0/2945814196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320035070 con 0x55656432dce0 2024-04-23T15:21:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.050+0000 7fb332400640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb3140a3d10 0x7fb3140a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 -- 172.21.15.7:0/2945814196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 msgr2=0x556564338060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb332400640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb3140a3d10 0x7fb3140a61d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb32400cd40 tx=0x7fb32400c330 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564338060 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb320006010 tx=0x7fb320032c30 comp rx=0 tx=0).stop 2024-04-23T15:21:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 -- 172.21.15.7:0/2945814196 shutdown_connections 2024-04-23T15:21:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564338060 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 --2- 172.21.15.7:0/2945814196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432d3c0 0x55656432d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 -- 172.21.15.7:0/2945814196 >> 172.21.15.7:0/2945814196 conn(0x5565643298d0 msgr2=0x556564329cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 -- 172.21.15.7:0/2945814196 shutdown_connections 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 -- 172.21.15.7:0/2945814196 wait complete. 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.051+0000 7fb337383740 1 -- start start 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 Processor -- start 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x5565643355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x556564335ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 0x556564336020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55656433b0e0 con 0x5565643385a0 2024-04-23T15:21:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55656424d2c0 con 0x55656432d3c0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.052+0000 7fb337383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55656433b260 con 0x55656432dce0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb337383740 10 client.0 _ll_register_callbacks cb 0x556563fa5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 0x556564336020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 0x556564336020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48240/0 (socket says 172.21.15.7:48240) 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 -- 172.21.15.7:0/143743795 learned_addr learned my addr 172.21.15.7:0/143743795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb331a00640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x5565643355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb331000640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x556564335ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 -- 172.21.15.7:0/143743795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 msgr2=0x556564335ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x556564335ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 -- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 msgr2=0x5565643355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x5565643355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb332400640 1 -- 172.21.15.7:0/143743795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55656425dfd0 con 0x5565643385a0 2024-04-23T15:21:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.053+0000 7fb331a00640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x5565643355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.054+0000 7fb332400640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 0x556564336020 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fb324011e40 tx=0x7fb324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83aedb2e8ae18e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.054+0000 7fb313400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.054+0000 7fb313400640 1 -- 172.21.15.7:0/143743795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32401e420 con 0x5565643385a0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.054+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb320032e20 con 0x5565643385a0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.054+0000 7fb313400640 1 -- 172.21.15.7:0/143743795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7fb32401e5c0 con 0x5565643385a0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.054+0000 7fb313400640 1 -- 172.21.15.7:0/143743795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb32402f050 con 0x5565643385a0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 10 client.18117 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556563fa6210 con 0x5565643385a0 2024-04-23T15:21:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb313400640 1 -- 172.21.15.7:0/143743795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb320032e20 con 0x5565643385a0 2024-04-23T15:21:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb313400640 1 -- 172.21.15.7:0/143743795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb32401c8e0 con 0x5565643385a0 2024-04-23T15:21:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 10 client.18117 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 10 client.18117 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 20 client.18117 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556564348760 0x55656434ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 4 client.18117 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.055+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565642a1320 con 0x556564348760 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.056+0000 7fb331a00640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556564348760 0x55656434ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.057+0000 7fb313400640 10 client.18117 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.057+0000 7fb331a00640 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556564348760 0x55656434ab90 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05edda7e6db7a9b server_cookie=ef66c56ecac0a6ca in_seq=0 out_seq=0 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb313400640 1 -- 172.21.15.7:0/143743795 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5565642a1320 con 0x556564348760 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb313400640 10 client.18117 handle_command_reply: tid=0 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 client.18117 shutdown 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 msgr2=0x556564336020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 0x556564336020 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fb324011e40 tx=0x7fb324004a40 comp rx=0 tx=0).stop 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 shutdown_connections 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556564348760 0x55656434ab90 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565643385a0 0x556564336020 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x556564335ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 --2- 172.21.15.7:0/143743795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x5565643355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 >> 172.21.15.7:0/143743795 conn(0x5565643298d0 msgr2=0x556564328a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb313400640 0 client.18117 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 shutdown_connections 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.059+0000 7fb337383740 1 -- 172.21.15.7:0/143743795 wait complete. 2024-04-23T15:21:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.060+0000 7fb337383740 20 client.18117 trim_cache size 0 max 16384 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 Processor -- start 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 -- start start 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x556564337cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564344b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5565643385a0 0x5565643440b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1b1500 con 0x55656432dce0 2024-04-23T15:21:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1b3040 con 0x55656432d3c0 2024-04-23T15:21:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb337383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1b1bd0 con 0x5565643385a0 2024-04-23T15:21:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb331000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564344b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb331000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564344b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48248/0 (socket says 172.21.15.7:48248) 2024-04-23T15:21:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.079+0000 7fb331000640 1 -- 172.21.15.7:0/1624539588 learned_addr learned my addr 172.21.15.7:0/1624539588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331a00640 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x556564337cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb332400640 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5565643385a0 0x5565643440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331000640 1 -- 172.21.15.7:0/1624539588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5565643385a0 msgr2=0x5565643440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331000640 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5565643385a0 0x5565643440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331000640 1 -- 172.21.15.7:0/1624539588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 msgr2=0x556564337cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331000640 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x556564337cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331000640 1 -- 172.21.15.7:0/1624539588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556564072620 con 0x55656432dce0 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.080+0000 7fb331000640 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564344b30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fb318098e20 tx=0x7fb318000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684f2592a71c8716 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.081+0000 7fb31e000640 1 -- 172.21.15.7:0/1624539588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318020040 con 0x55656432dce0 2024-04-23T15:21:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.081+0000 7fb31e000640 1 -- 172.21.15.7:0/1624539588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb31809c450 con 0x55656432dce0 2024-04-23T15:21:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.081+0000 7fb31e000640 1 -- 172.21.15.7:0/1624539588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318010460 con 0x55656432dce0 2024-04-23T15:21:52.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.081+0000 7fb337383740 1 -- 172.21.15.7:0/1624539588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 msgr2=0x556564344b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.081+0000 7fb337383740 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564344b30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fb318098e20 tx=0x7fb318000bc0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 -- 172.21.15.7:0/1624539588 shutdown_connections 2024-04-23T15:21:52.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5565643385a0 0x5565643440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432dce0 0x556564344b30 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 --2- 172.21.15.7:0/1624539588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55656432d3c0 0x556564337cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 -- 172.21.15.7:0/1624539588 >> 172.21.15.7:0/1624539588 conn(0x5565643298d0 msgr2=0x556564324a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 -- 172.21.15.7:0/1624539588 shutdown_connections 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 -- 172.21.15.7:0/1624539588 wait complete. 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 -- start start 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.082+0000 7fb337383740 1 Processor -- start 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 0x556564340a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x55656433bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1b2970 con 0x55656432d3c0 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1b22a0 con 0x5565643385a0 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c1af500 con 0x55656432dce0 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb337383740 10 client.0 _ll_register_callbacks cb 0x7fb32400c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:21:52.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb331a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 0x556564340a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb331a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 0x556564340a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48250/0 (socket says 172.21.15.7:48250) 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.083+0000 7fb331a00640 1 -- 172.21.15.7:0/640199005 learned_addr learned my addr 172.21.15.7:0/640199005 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331000640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x55656433bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331a00640 1 -- 172.21.15.7:0/640199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 msgr2=0x55656433bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb332400640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331a00640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x55656433bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331a00640 1 -- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 msgr2=0x55656433c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331a00640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331a00640 1 -- 172.21.15.7:0/640199005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55656433cb00 con 0x55656432d3c0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331000640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x55656433bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb331a00640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 0x556564340a00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fb320004650 tx=0x7fb320032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a039004f7bbe56f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb313400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb313400640 1 -- 172.21.15.7:0/640199005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320035040 con 0x55656432d3c0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb31809c450 con 0x55656432d3c0 2024-04-23T15:21:52.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.084+0000 7fb313400640 1 -- 172.21.15.7:0/640199005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 9467+0+0 (secure 0 0 0) 0x7fb32004c3c0 con 0x55656432d3c0 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb313400640 1 -- 172.21.15.7:0/640199005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb32005b050 con 0x55656432d3c0 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 10 client.18123 fetch_fsmap learned FSMap version 32 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5565643aee10 con 0x55656432d3c0 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb313400640 1 -- 172.21.15.7:0/640199005 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb31809c450 con 0x55656432d3c0 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb313400640 1 -- 172.21.15.7:0/640199005 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb320005400 con 0x55656432d3c0 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 10 client.18123 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 10 client.18123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 20 client.18123 populate_metadata read hostname 'smithi007' 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5565643af210 0x5565643b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 4 client.18123 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:21:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.085+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55656429b190 con 0x5565643af210 2024-04-23T15:21:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.086+0000 7fb331000640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5565643af210 0x5565643b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:21:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.087+0000 7fb331000640 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5565643af210 0x5565643b1600 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4ab01791b3314ab server_cookie=85f3c20af4c40d20 in_seq=0 out_seq=0 2024-04-23T15:21:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.087+0000 7fb313400640 10 client.18123 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb313400640 1 -- 172.21.15.7:0/640199005 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55656429b190 con 0x5565643af210 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb313400640 10 client.18123 handle_command_reply: tid=0 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 client.18123 shutdown 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 msgr2=0x556564340a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 0x556564340a00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fb320004650 tx=0x7fb320032bb0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 shutdown_connections 2024-04-23T15:21:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5565643af210 0x5565643b1600 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565643385a0 0x55656433c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55656432dce0 0x55656433bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 --2- 172.21.15.7:0/640199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55656432d3c0 0x556564340a00 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 >> 172.21.15.7:0/640199005 conn(0x5565643298d0 msgr2=0x556564328200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb313400640 0 client.18123 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 shutdown_connections 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 1 -- 172.21.15.7:0/640199005 wait complete. 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.120+0000 7fb337383740 20 client.18123 trim_cache size 0 max 16384 2024-04-23T15:21:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:21:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:21:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:21:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:21:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb3140a3d10 msgr2=0x7fb3140a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb3140a3d10 0x7fb3140a61d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb32400cd40 tx=0x7fb32400c330 comp rx=0 tx=0).stop 2024-04-23T15:21:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 msgr2=0x7fb32c1a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 0x7fb32c1a0b10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb31800d950 tx=0x7fb31800de10 comp rx=0 tx=0).stop 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 shutdown_connections 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb3140a3d10 0x7fb3140a61d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb32c10c3f0 0x7fb32c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb32c103940 0x7fb32c1a0b10 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 --2- 172.21.15.7:0/2918788160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb32c103020 0x7fb32c1a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.121+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 >> 172.21.15.7:0/2918788160 conn(0x7fb32c0fc820 msgr2=0x7fb32c101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.122+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 shutdown_connections 2024-04-23T15:21:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:21:52.122+0000 7fb332e00640 1 -- 172.21.15.7:0/2918788160 wait complete. 2024-04-23T15:21:53.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:52 smithi007 ceph-mon[27906]: pgmap v964: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:53.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:52 smithi186 ceph-mon[31814]: pgmap v964: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:52 smithi137 ceph-mon[31694]: pgmap v964: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:21:55.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:54 smithi007 ceph-mon[27906]: pgmap v965: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:21:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:54 smithi186 ceph-mon[31814]: pgmap v965: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:21:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:54 smithi137 ceph-mon[31694]: pgmap v965: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:21:57.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:56 smithi007 ceph-mon[27906]: pgmap v966: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:21:57.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:56 smithi186 ceph-mon[31814]: pgmap v966: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:21:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:56 smithi137 ceph-mon[31694]: pgmap v966: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:21:59.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:21:58 smithi007 ceph-mon[27906]: pgmap v967: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:59.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:21:58 smithi186 ceph-mon[31814]: pgmap v967: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:21:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:21:58 smithi137 ceph-mon[31694]: pgmap v967: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:22:01.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:00 smithi007 ceph-mon[27906]: pgmap v968: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:01.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:00 smithi186 ceph-mon[31814]: pgmap v968: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:00 smithi137 ceph-mon[31694]: pgmap v968: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:03.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:02 smithi007 ceph-mon[27906]: pgmap v969: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:02 smithi186 ceph-mon[31814]: pgmap v969: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:02 smithi137 ceph-mon[31694]: pgmap v969: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:04.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:03 smithi007 ceph-mon[27906]: osdmap e141: 12 total, 12 up, 12 in 2024-04-23T15:22:04.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:03 smithi186 ceph-mon[31814]: osdmap e141: 12 total, 12 up, 12 in 2024-04-23T15:22:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:03 smithi137 ceph-mon[31694]: osdmap e141: 12 total, 12 up, 12 in 2024-04-23T15:22:05.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:04 smithi007 ceph-mon[27906]: pgmap v971: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:05.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:04 smithi186 ceph-mon[31814]: pgmap v971: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:04 smithi137 ceph-mon[31694]: pgmap v971: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 -- 172.21.15.7:0/1993382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e0104c60 msgr2=0x7fc9e0108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 --2- 172.21.15.7:0/1993382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e0104c60 0x7fc9e0108ca0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009900 tx=0x7fc9cc02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 -- 172.21.15.7:0/1993382263 shutdown_connections 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 --2- 172.21.15.7:0/1993382263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9e0109380 0x7fc9e0110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 --2- 172.21.15.7:0/1993382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e0104c60 0x7fc9e0108ca0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 --2- 172.21.15.7:0/1993382263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9e01042b0 0x7fc9e0104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 -- 172.21.15.7:0/1993382263 >> 172.21.15.7:0/1993382263 conn(0x7fc9e00ffaf0 msgr2=0x7fc9e0101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 -- 172.21.15.7:0/1993382263 shutdown_connections 2024-04-23T15:22:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.278+0000 7fc9df200640 1 -- 172.21.15.7:0/1993382263 wait complete. 2024-04-23T15:22:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.279+0000 7fc9df200640 1 Processor -- start 2024-04-23T15:22:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.279+0000 7fc9df200640 1 -- start start 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9df200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 0x7fc9e01a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9df200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9e0109380 0x7fc9e01a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9df200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9e019a9b0 0x7fc9e019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9df200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01142f0 con 0x7fc9e01042b0 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9df200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0114170 con 0x7fc9e0109380 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9df200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0114470 con 0x7fc9e019a9b0 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 0x7fc9e01a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 0x7fc9e01a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51194/0 (socket says 172.21.15.7:51194) 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9dde00640 1 -- 172.21.15.7:0/2508958241 learned_addr learned my addr 172.21.15.7:0/2508958241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.280+0000 7fc9dd400640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9e0109380 0x7fc9e01a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9de800640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9e019a9b0 0x7fc9e019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9dde00640 1 -- 172.21.15.7:0/2508958241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9e019a9b0 msgr2=0x7fc9e019ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9dde00640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9e019a9b0 0x7fc9e019ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9dde00640 1 -- 172.21.15.7:0/2508958241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9e0109380 msgr2=0x7fc9e01a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9dde00640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9e0109380 0x7fc9e01a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9dde00640 1 -- 172.21.15.7:0/2508958241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e019b4d0 con 0x7fc9e01042b0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9dde00640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 0x7fc9e01a0800 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000d950 tx=0x7fc9d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9d6a00640 1 -- 172.21.15.7:0/2508958241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0017030 con 0x7fc9e01042b0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.281+0000 7fc9d6a00640 1 -- 172.21.15.7:0/2508958241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d0004020 con 0x7fc9e01042b0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.282+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e019b7c0 con 0x7fc9e01042b0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.282+0000 7fc9d6a00640 1 -- 172.21.15.7:0/2508958241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00047a0 con 0x7fc9e01042b0 2024-04-23T15:22:05.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.282+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e01a7a60 con 0x7fc9e01042b0 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 Processor -- start 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 -- start start 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9d6a00640 1 -- 172.21.15.7:0/2508958241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc9d00041d0 con 0x7fc9e01042b0 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5df97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5e04060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e06990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629f5d5f900 con 0x5629f5df93c0 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5629f5d05f20 con 0x5629f5df9ce0 2024-04-23T15:22:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.286+0000 7fc9e780a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5629f5d5b8c0 con 0x5629f5e045a0 2024-04-23T15:22:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5df97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5df97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51204/0 (socket says 172.21.15.7:51204) 2024-04-23T15:22:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 -- 172.21.15.7:0/2898692022 learned_addr learned my addr 172.21.15.7:0/2898692022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9dd400640 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e06990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9dde00640 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5e04060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 -- 172.21.15.7:0/2898692022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 msgr2=0x5629f5e06990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e06990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 -- 172.21.15.7:0/2898692022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 msgr2=0x5629f5e04060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5e04060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.287+0000 7fc9de800640 1 -- 172.21.15.7:0/2898692022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f5d2ae10 con 0x5629f5df93c0 2024-04-23T15:22:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9de800640 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5df97a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009f20 tx=0x7fc9d800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd3ee58723d92b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9d6a00640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9c40a3d90 0x7fc9c40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9cb000640 1 -- 172.21.15.7:0/2898692022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8015070 con 0x5629f5df93c0 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9cb000640 1 -- 172.21.15.7:0/2898692022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d801ab10 con 0x5629f5df93c0 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9cb000640 1 -- 172.21.15.7:0/2898692022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011b90 con 0x5629f5df93c0 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9d6a00640 1 -- 172.21.15.7:0/2508958241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 9555+0+0 (secure 0 0 0) 0x7fc9d00d0710 con 0x7fc9e01042b0 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.288+0000 7fc9dde00640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9c40a3d90 0x7fc9c40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 -- 172.21.15.7:0/2898692022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 msgr2=0x5629f5df97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5df97a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009f20 tx=0x7fc9d800f7f0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9dde00640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9c40a3d90 0x7fc9c40a6250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5629f5dfa960 tx=0x7fc9d0000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 -- 172.21.15.7:0/2898692022 shutdown_connections 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5e04060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e06990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2898692022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5df97a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.289+0000 7fc9e780a740 1 -- 172.21.15.7:0/2898692022 >> 172.21.15.7:0/2898692022 conn(0x5629f5df58d0 msgr2=0x5629f5df5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.290+0000 7fc9e780a740 1 -- 172.21.15.7:0/2898692022 shutdown_connections 2024-04-23T15:22:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.290+0000 7fc9e780a740 1 -- 172.21.15.7:0/2898692022 wait complete. 2024-04-23T15:22:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.290+0000 7fc9e780a740 1 -- start start 2024-04-23T15:22:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.290+0000 7fc9e780a740 1 Processor -- start 2024-04-23T15:22:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df93c0 0x5629f5e015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 0x5629f5e01b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629f5e070e0 con 0x5629f5df9ce0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5629f5d192c0 con 0x5629f5df93c0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5629f5e07260 con 0x5629f5e045a0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9e780a740 10 client.0 _ll_register_callbacks cb 0x5629f5a71a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 0x5629f5e01b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9dd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 0x5629f5e01b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51216/0 (socket says 172.21.15.7:51216) 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.291+0000 7fc9dd400640 1 -- 172.21.15.7:0/1918567284 learned_addr learned my addr 172.21.15.7:0/1918567284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9de800640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df93c0 0x5629f5e015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9de800640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9dd400640 1 -- 172.21.15.7:0/1918567284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 msgr2=0x5629f5e02040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9dd400640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9dd400640 1 -- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df93c0 msgr2=0x5629f5e015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9dd400640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df93c0 0x5629f5e015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9dd400640 1 -- 172.21.15.7:0/1918567284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f5d29fd0 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9de800640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9dd400640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 0x5629f5e01b00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009900 tx=0x7fc9cc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c478916e7d61cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.292+0000 7fc9bf400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9bf400640 1 -- 172.21.15.7:0/1918567284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc035040 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9bf400640 1 -- 172.21.15.7:0/1918567284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 9555+0+0 (secure 0 0 0) 0x7fc9cc0048c0 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d801ab10 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9bf400640 1 -- 172.21.15.7:0/1918567284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9cc005630 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9e780a740 10 client.18135 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5629f5a72210 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.293+0000 7fc9bf400640 1 -- 172.21.15.7:0/1918567284 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d801ab10 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9bf400640 1 -- 172.21.15.7:0/1918567284 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc9cc0314a0 con 0x5629f5df9ce0 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9e780a740 10 client.18135 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9e780a740 10 client.18135 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9e780a740 20 client.18135 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9e780a740 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e147c0 0x5629f5e16bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9e780a740 4 client.18135 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:22:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629f5d6d320 con 0x5629f5e147c0 2024-04-23T15:22:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.294+0000 7fc9de800640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e147c0 0x5629f5e16bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.295+0000 7fc9de800640 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e147c0 0x5629f5e16bb0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2891ead36558c88d server_cookie=1f95c5374536ca98 in_seq=0 out_seq=0 2024-04-23T15:22:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.295+0000 7fc9bf400640 10 client.18135 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9bf400640 1 -- 172.21.15.7:0/1918567284 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5629f5d6d320 con 0x5629f5e147c0 2024-04-23T15:22:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9bf400640 10 client.18135 handle_command_reply: tid=0 2024-04-23T15:22:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 client.18135 shutdown 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 msgr2=0x5629f5e01b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 0x5629f5e01b00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009900 tx=0x7fc9cc005270 comp rx=0 tx=0).stop 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 shutdown_connections 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e147c0 0x5629f5e16bb0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df9ce0 0x5629f5e01b00 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9bf400640 0 client.18135 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 --2- 172.21.15.7:0/1918567284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df93c0 0x5629f5e015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.297+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 >> 172.21.15.7:0/1918567284 conn(0x5629f5df58d0 msgr2=0x5629f5dfb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.298+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 shutdown_connections 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.298+0000 7fc9e780a740 1 -- 172.21.15.7:0/1918567284 wait complete. 2024-04-23T15:22:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.298+0000 7fc9e780a740 20 client.18135 trim_cache size 0 max 16384 2024-04-23T15:22:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.317+0000 7fc9e780a740 1 Processor -- start 2024-04-23T15:22:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.317+0000 7fc9e780a740 1 -- start start 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.317+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e03c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.317+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5df5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.317+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9e780a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01b1600 con 0x5629f5df93c0 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9e780a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01b3140 con 0x5629f5df9ce0 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9e780a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01b1cd0 con 0x5629f5e045a0 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e03c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e03c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51232/0 (socket says 172.21.15.7:51232) 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9de800640 1 -- 172.21.15.7:0/576511684 learned_addr learned my addr 172.21.15.7:0/576511684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9dd400640 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5df5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.318+0000 7fc9de800640 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9de800640 1 -- 172.21.15.7:0/576511684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 msgr2=0x5629f5e02050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9de800640 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9de800640 1 -- 172.21.15.7:0/576511684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 msgr2=0x5629f5df5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9de800640 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5df5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9de800640 1 -- 172.21.15.7:0/576511684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f5b3e620 con 0x5629f5df93c0 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9de800640 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e03c80 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800fcf0 tx=0x7fc9d8009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd5828c0d882e54 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9ca600640 1 -- 172.21.15.7:0/576511684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8015040 con 0x5629f5df93c0 2024-04-23T15:22:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9ca600640 1 -- 172.21.15.7:0/576511684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d8027860 con 0x5629f5df93c0 2024-04-23T15:22:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.319+0000 7fc9ca600640 1 -- 172.21.15.7:0/576511684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8005430 con 0x5629f5df93c0 2024-04-23T15:22:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 -- 172.21.15.7:0/576511684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 msgr2=0x5629f5e03c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e03c80 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800fcf0 tx=0x7fc9d8009820 comp rx=0 tx=0).stop 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 -- 172.21.15.7:0/576511684 shutdown_connections 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5df9ce0 0x5629f5df5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5e045a0 0x5629f5e02050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 --2- 172.21.15.7:0/576511684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e03c80 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 -- 172.21.15.7:0/576511684 >> 172.21.15.7:0/576511684 conn(0x5629f5df58d0 msgr2=0x5629f5e03570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 -- 172.21.15.7:0/576511684 shutdown_connections 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.320+0000 7fc9e780a740 1 -- 172.21.15.7:0/576511684 wait complete. 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 -- start start 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 Processor -- start 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e08750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5df9ce0 0x5629f5e08c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5e045a0 0x5629f5e79d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01b2a70 con 0x5629f5df93c0 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01b23a0 con 0x5629f5e045a0 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e01af600 con 0x5629f5df9ce0 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.321+0000 7fc9e780a740 10 client.0 _ll_register_callbacks cb 0x7fc9cc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e08750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e08750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51238/0 (socket says 172.21.15.7:51238) 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 -- 172.21.15.7:0/2109722008 learned_addr learned my addr 172.21.15.7:0/2109722008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9dd400640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5df9ce0 0x5629f5e08c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5e045a0 0x5629f5e79d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 -- 172.21.15.7:0/2109722008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5df9ce0 msgr2=0x5629f5e08c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5df9ce0 0x5629f5e08c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 -- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5e045a0 msgr2=0x5629f5e79d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5e045a0 0x5629f5e79d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.322+0000 7fc9de800640 1 -- 172.21.15.7:0/2109722008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f5e7a250 con 0x5629f5df93c0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.323+0000 7fc9de800640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e08750 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f80 tx=0x7fc9d8009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887d641a9e7ad6b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.323+0000 7fc9bf400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.323+0000 7fc9bf400640 1 -- 172.21.15.7:0/2109722008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8015070 con 0x5629f5df93c0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.323+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d8027860 con 0x5629f5df93c0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.323+0000 7fc9bf400640 1 -- 172.21.15.7:0/2109722008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 9555+0+0 (secure 0 0 0) 0x7fc9d8003970 con 0x5629f5df93c0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9bf400640 1 -- 172.21.15.7:0/2109722008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9d803d050 con 0x5629f5df93c0 2024-04-23T15:22:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 10 client.18141 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5629f5e7b530 con 0x5629f5df93c0 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9bf400640 1 -- 172.21.15.7:0/2109722008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d8027860 con 0x5629f5df93c0 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9bf400640 1 -- 172.21.15.7:0/2109722008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc9d80051b0 con 0x5629f5df93c0 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 10 client.18141 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 10 client.18141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 20 client.18141 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e7b950 0x5629f5e7dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 4 client.18141 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.324+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629f5d67190 con 0x5629f5e7b950 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.325+0000 7fc9dd400640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e7b950 0x5629f5e7dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.326+0000 7fc9dd400640 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e7b950 0x5629f5e7dd40 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a6d80baccc669c server_cookie=395b7327605d3e0d in_seq=0 out_seq=0 2024-04-23T15:22:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.326+0000 7fc9bf400640 10 client.18141 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.361+0000 7fc9bf400640 1 -- 172.21.15.7:0/2109722008 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629f5d67190 con 0x5629f5e7b950 2024-04-23T15:22:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.361+0000 7fc9bf400640 10 client.18141 handle_command_reply: tid=0 2024-04-23T15:22:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.361+0000 7fc9e780a740 1 client.18141 shutdown 2024-04-23T15:22:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.361+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 msgr2=0x5629f5e08750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.361+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e08750 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f80 tx=0x7fc9d8009fb0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.361+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 shutdown_connections 2024-04-23T15:22:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5629f5e7b950 0x5629f5e7dd40 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5629f5e045a0 0x5629f5e79d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629f5df9ce0 0x5629f5e08c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 --2- 172.21.15.7:0/2109722008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629f5df93c0 0x5629f5e08750 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9bf400640 0 client.18141 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 >> 172.21.15.7:0/2109722008 conn(0x5629f5df58d0 msgr2=0x5629f5e0f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 shutdown_connections 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 1 -- 172.21.15.7:0/2109722008 wait complete. 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.362+0000 7fc9e780a740 20 client.18141 trim_cache size 0 max 16384 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:22:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9c40a3d90 msgr2=0x7fc9c40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9c40a3d90 0x7fc9c40a6250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5629f5dfa960 tx=0x7fc9d0000bc0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 msgr2=0x7fc9e01a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 0x7fc9e01a0800 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000d950 tx=0x7fc9d000de10 comp rx=0 tx=0).stop 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 shutdown_connections 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9c40a3d90 0x7fc9c40a6250 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9e0109380 0x7fc9e01a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9e019a9b0 0x7fc9e019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 --2- 172.21.15.7:0/2508958241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9e01042b0 0x7fc9e01a0800 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 >> 172.21.15.7:0/2508958241 conn(0x7fc9e00ffaf0 msgr2=0x7fc9e0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 shutdown_connections 2024-04-23T15:22:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:05.363+0000 7fc9df200640 1 -- 172.21.15.7:0/2508958241 wait complete. 2024-04-23T15:22:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:06 smithi007 ceph-mon[27906]: pgmap v972: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:06 smithi186 ceph-mon[31814]: pgmap v972: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:06 smithi137 ceph-mon[31694]: pgmap v972: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:09.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:08 smithi007 ceph-mon[27906]: pgmap v973: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:08 smithi186 ceph-mon[31814]: pgmap v973: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:08 smithi137 ceph-mon[31694]: pgmap v973: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:10 smithi007 ceph-mon[27906]: pgmap v974: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:10 smithi186 ceph-mon[31814]: pgmap v974: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:10 smithi137 ceph-mon[31694]: pgmap v974: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:22:12.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:11 smithi137 ceph-mon[31694]: osdmap e142: 12 total, 12 up, 12 in 2024-04-23T15:22:12.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:11 smithi007 ceph-mon[27906]: osdmap e142: 12 total, 12 up, 12 in 2024-04-23T15:22:12.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:11 smithi186 ceph-mon[31814]: osdmap e142: 12 total, 12 up, 12 in 2024-04-23T15:22:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:12 smithi137 ceph-mon[31694]: pgmap v976: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-04-23T15:22:13.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:12 smithi007 ceph-mon[27906]: pgmap v976: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-04-23T15:22:13.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:12 smithi186 ceph-mon[31814]: pgmap v976: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-04-23T15:22:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:14 smithi137 ceph-mon[31694]: pgmap v977: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:22:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:14 smithi007 ceph-mon[27906]: pgmap v977: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:22:15.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:14 smithi186 ceph-mon[31814]: pgmap v977: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:22:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:16 smithi007 ceph-mon[27906]: pgmap v978: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:22:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:16 smithi186 ceph-mon[31814]: pgmap v978: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:22:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:16 smithi137 ceph-mon[31694]: pgmap v978: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:22:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 -- 172.21.15.7:0/1257672823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 msgr2=0x7f7d5c115230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 --2- 172.21.15.7:0/1257672823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c115230 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009ca0 tx=0x7f7d5402a950 comp rx=0 tx=0).stop 2024-04-23T15:22:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 -- 172.21.15.7:0/1257672823 shutdown_connections 2024-04-23T15:22:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 --2- 172.21.15.7:0/1257672823 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c115230 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 --2- 172.21.15.7:0/1257672823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d5c074cc0 0x7f7d5c112900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 --2- 172.21.15.7:0/1257672823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 0x7f7d5c074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 -- 172.21.15.7:0/1257672823 >> 172.21.15.7:0/1257672823 conn(0x7f7d5c0fd920 msgr2=0x7f7d5c0ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 -- 172.21.15.7:0/1257672823 shutdown_connections 2024-04-23T15:22:18.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.524+0000 7f7d5be00640 1 -- 172.21.15.7:0/1257672823 wait complete. 2024-04-23T15:22:18.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.525+0000 7f7d5be00640 1 Processor -- start 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.525+0000 7f7d5be00640 1 -- start start 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 0x7f7d5c1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d5c074cc0 0x7f7d5c1a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c118700 con 0x7f7d5c112e40 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c118580 con 0x7f7d5c0743a0 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c118880 con 0x7f7d5c074cc0 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c19eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58792/0 (socket says 172.21.15.7:58792) 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.526+0000 7f7d5b400640 1 -- 172.21.15.7:0/225958377 learned_addr learned my addr 172.21.15.7:0/225958377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d53e00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d5c074cc0 0x7f7d5c1a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 0x7f7d5c1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5b400640 1 -- 172.21.15.7:0/225958377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d5c074cc0 msgr2=0x7f7d5c1a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5b400640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d5c074cc0 0x7f7d5c1a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5b400640 1 -- 172.21.15.7:0/225958377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 msgr2=0x7f7d5c1a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5b400640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 0x7f7d5c1a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5b400640 1 -- 172.21.15.7:0/225958377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c19f280 con 0x7f7d5c112e40 2024-04-23T15:22:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 0x7f7d5c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:22:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.527+0000 7f7d5b400640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c19eb00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7d54004af0 tx=0x7f7d54003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.528+0000 7f7d53400640 1 -- 172.21.15.7:0/225958377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54034040 con 0x7f7d5c112e40 2024-04-23T15:22:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.528+0000 7f7d53400640 1 -- 172.21.15.7:0/225958377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d5402fd20 con 0x7f7d5c112e40 2024-04-23T15:22:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.528+0000 7f7d53400640 1 -- 172.21.15.7:0/225958377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54004570 con 0x7f7d5c112e40 2024-04-23T15:22:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.528+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5c19f510 con 0x7f7d5c112e40 2024-04-23T15:22:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.528+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5c1ab810 con 0x7f7d5c112e40 2024-04-23T15:22:18.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.532+0000 7f7d53400640 1 -- 172.21.15.7:0/225958377 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7d54037020 con 0x7f7d5c112e40 2024-04-23T15:22:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.532+0000 7f7d647c6740 1 Processor -- start 2024-04-23T15:22:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.532+0000 7f7d647c6740 1 -- start start 2024-04-23T15:22:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9b83c0 0x55b33d9b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 0x55b33d9c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d647c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b33d91e900 con 0x55b33d9c35a0 2024-04-23T15:22:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d647c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b33d8c4f20 con 0x55b33d9b8ce0 2024-04-23T15:22:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d647c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b33d91a8c0 con 0x55b33d9b83c0 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 0x55b33d9c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 0x55b33d9c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58802/0 (socket says 172.21.15.7:58802) 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d53400640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7d400a3d90 0x7f7d400a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.533+0000 7f7d53e00640 1 -- 172.21.15.7:0/1834890988 learned_addr learned my addr 172.21.15.7:0/1834890988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9b83c0 0x55b33d9b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53400640 1 -- 172.21.15.7:0/225958377 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f7d540f17d0 con 0x7f7d5c112e40 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d5b400640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7d400a3d90 0x7f7d400a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53e00640 1 -- 172.21.15.7:0/1834890988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9b83c0 msgr2=0x55b33d9b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9b83c0 0x55b33d9b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53e00640 1 -- 172.21.15.7:0/1834890988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b8ce0 msgr2=0x55b33d9c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.534+0000 7f7d53e00640 1 -- 172.21.15.7:0/1834890988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33d8e9e10 con 0x55b33d9c35a0 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.535+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 0x55b33d9c5990 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f7d44011740 tx=0x7f7d44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4983178354ee26de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.535+0000 7f7d5b400640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7d400a3d90 0x7f7d400a6250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b9e80 tx=0x7f7d5402a950 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.535+0000 7f7d4be00640 1 -- 172.21.15.7:0/1834890988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44004050 con 0x55b33d9c35a0 2024-04-23T15:22:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.535+0000 7f7d4be00640 1 -- 172.21.15.7:0/1834890988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d440054d0 con 0x55b33d9c35a0 2024-04-23T15:22:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.535+0000 7f7d4be00640 1 -- 172.21.15.7:0/1834890988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44004b80 con 0x55b33d9c35a0 2024-04-23T15:22:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 -- 172.21.15.7:0/1834890988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 msgr2=0x55b33d9c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 0x55b33d9c5990 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f7d44011740 tx=0x7f7d44004730 comp rx=0 tx=0).stop 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 -- 172.21.15.7:0/1834890988 shutdown_connections 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9c35a0 0x55b33d9c5990 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1834890988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9b83c0 0x55b33d9b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 -- 172.21.15.7:0/1834890988 >> 172.21.15.7:0/1834890988 conn(0x55b33d9b48d0 msgr2=0x55b33d9b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 -- 172.21.15.7:0/1834890988 shutdown_connections 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.536+0000 7f7d647c6740 1 -- 172.21.15.7:0/1834890988 wait complete. 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.537+0000 7f7d647c6740 1 -- start start 2024-04-23T15:22:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.537+0000 7f7d647c6740 1 Processor -- start 2024-04-23T15:22:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.537+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.537+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d647c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b33d9c60e0 con 0x55b33d9b8ce0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d647c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b33d8d82c0 con 0x55b33d9b83c0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d647c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b33d9c6260 con 0x55b33d9c35a0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d647c6740 10 client.0 _ll_register_callbacks cb 0x55b33d630a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58818/0 (socket says 172.21.15.7:58818) 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 -- 172.21.15.7:0/2795107538 learned_addr learned my addr 172.21.15.7:0/2795107538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 -- 172.21.15.7:0/2795107538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 msgr2=0x55b33d9c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 -- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 msgr2=0x55b33d9c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d5aa00640 1 -- 172.21.15.7:0/2795107538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33d8e8fd0 con 0x55b33d9b8ce0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.538+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.539+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c0b10 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009d70 tx=0x7f7d4c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3e469ea82749c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.539+0000 7f7d48c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.539+0000 7f7d48c00640 1 -- 172.21.15.7:0/2795107538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c013930 con 0x55b33d9b8ce0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.539+0000 7f7d48c00640 1 -- 172.21.15.7:0/2795107538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f7d4c013ad0 con 0x55b33d9b8ce0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.539+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d440054d0 con 0x55b33d9b8ce0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d48c00640 1 -- 172.21.15.7:0/2795107538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7d4c013cd0 con 0x55b33d9b8ce0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 10 client.18153 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b33d631210 con 0x55b33d9b8ce0 2024-04-23T15:22:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d48c00640 1 -- 172.21.15.7:0/2795107538 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d440054d0 con 0x55b33d9b8ce0 2024-04-23T15:22:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d48c00640 1 -- 172.21.15.7:0/2795107538 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7d4c01a070 con 0x55b33d9b8ce0 2024-04-23T15:22:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 10 client.18153 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 10 client.18153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 20 client.18153 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33d9d3810 0x55b33d9d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 4 client.18153 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.540+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b33d92c320 con 0x55b33d9d3810 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.541+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33d9d3810 0x55b33d9d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.542+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33d9d3810 0x55b33d9d5c60 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb8b1a0b048c8974 server_cookie=3d2e37e455f6d79b in_seq=0 out_seq=0 2024-04-23T15:22:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.542+0000 7f7d48c00640 10 client.18153 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d48c00640 1 -- 172.21.15.7:0/2795107538 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b33d92c320 con 0x55b33d9d3810 2024-04-23T15:22:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d48c00640 10 client.18153 handle_command_reply: tid=0 2024-04-23T15:22:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 client.18153 shutdown 2024-04-23T15:22:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 msgr2=0x55b33d9c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c0b10 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009d70 tx=0x7f7d4c0039c0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 shutdown_connections 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33d9d3810 0x55b33d9d5c60 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b8ce0 0x55b33d9c0b10 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2795107538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d48c00640 0 client.18153 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.544+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 >> 172.21.15.7:0/2795107538 conn(0x55b33d9b48d0 msgr2=0x55b33d9ba600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.545+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 shutdown_connections 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.545+0000 7f7d647c6740 1 -- 172.21.15.7:0/2795107538 wait complete. 2024-04-23T15:22:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.545+0000 7f7d647c6740 20 client.18153 trim_cache size 0 max 16384 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 Processor -- start 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 -- start start 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 0x55b33d9c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9bf300 0x55b33d9c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1b5830 con 0x55b33d9b83c0 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1b7370 con 0x55b33d9bf300 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d647c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1b5f00 con 0x55b33d9c35a0 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 0x55b33d9c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 0x55b33d9c2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58828/0 (socket says 172.21.15.7:58828) 2024-04-23T15:22:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.565+0000 7f7d53e00640 1 -- 172.21.15.7:0/2714854965 learned_addr learned my addr 172.21.15.7:0/2714854965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d53e00640 1 -- 172.21.15.7:0/2714854965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 msgr2=0x55b33d9bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d53e00640 1 -- 172.21.15.7:0/2714854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9bf300 msgr2=0x55b33d9c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9bf300 0x55b33d9c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d53e00640 1 -- 172.21.15.7:0/2714854965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33d6fd620 con 0x55b33d9b83c0 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.566+0000 7f7d53e00640 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 0x55b33d9c2d00 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004770 tx=0x7f7d44009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526c1821a3997953 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.567+0000 7f7d4b400640 1 -- 172.21.15.7:0/2714854965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44009b30 con 0x55b33d9b83c0 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.567+0000 7f7d4b400640 1 -- 172.21.15.7:0/2714854965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d4402d020 con 0x55b33d9b83c0 2024-04-23T15:22:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.567+0000 7f7d4b400640 1 -- 172.21.15.7:0/2714854965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44029df0 con 0x55b33d9b83c0 2024-04-23T15:22:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.567+0000 7f7d647c6740 1 -- 172.21.15.7:0/2714854965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 msgr2=0x55b33d9c2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.567+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 0x55b33d9c2d00 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004770 tx=0x7f7d44009ac0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 -- 172.21.15.7:0/2714854965 shutdown_connections 2024-04-23T15:22:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9bf300 0x55b33d9c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 --2- 172.21.15.7:0/2714854965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9b83c0 0x55b33d9c2d00 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 -- 172.21.15.7:0/2714854965 >> 172.21.15.7:0/2714854965 conn(0x55b33d9b48d0 msgr2=0x55b33d9c0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 -- 172.21.15.7:0/2714854965 shutdown_connections 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 -- 172.21.15.7:0/2714854965 wait complete. 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.568+0000 7f7d647c6740 1 -- start start 2024-04-23T15:22:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 Processor -- start 2024-04-23T15:22:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 0x55b33d9c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1b6ca0 con 0x55b33d9bf300 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1b65d0 con 0x55b33d9b83c0 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1b3830 con 0x55b33d9c35a0 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d647c6740 10 client.0 _ll_register_callbacks cb 0x7f7d4c004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.569+0000 7f7d5aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 0x55b33d9c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 0x55b33d9c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58844/0 (socket says 172.21.15.7:58844) 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 -- 172.21.15.7:0/1314747238 learned_addr learned my addr 172.21.15.7:0/1314747238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 -- 172.21.15.7:0/1314747238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 msgr2=0x55b33d9c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 -- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 msgr2=0x55b33d9cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 -- 172.21.15.7:0/1314747238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33d9c89e0 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d5aa00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 0x55b33d9c7ca0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c001eb0 tx=0x7f7d4c011470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64611e47b6930660 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.570+0000 7f7d48c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d48c00640 1 -- 172.21.15.7:0/1314747238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c005450 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d48c00640 1 -- 172.21.15.7:0/1314747238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f7d4c011830 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d4402d020 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d48c00640 1 -- 172.21.15.7:0/1314747238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7d4c039050 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d647c6740 10 client.18159 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b33da3ae00 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.571+0000 7f7d48c00640 1 -- 172.21.15.7:0/1314747238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d4402d020 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d48c00640 1 -- 172.21.15.7:0/1314747238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7d4c01a050 con 0x55b33d9bf300 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d647c6740 10 client.18159 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d647c6740 10 client.18159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d647c6740 20 client.18159 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33da3b5d0 0x55b33da3d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d647c6740 4 client.18159 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:22:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b33d926190 con 0x55b33da3b5d0 2024-04-23T15:22:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.572+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33da3b5d0 0x55b33da3d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.573+0000 7f7d48c00640 10 client.18159 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.573+0000 7f7d53e00640 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33da3b5d0 0x55b33da3d9f0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8028097b88bebf server_cookie=dd048820b4fbafbd in_seq=0 out_seq=0 2024-04-23T15:22:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.607+0000 7f7d48c00640 1 -- 172.21.15.7:0/1314747238 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b33d926190 con 0x55b33da3b5d0 2024-04-23T15:22:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.607+0000 7f7d48c00640 10 client.18159 handle_command_reply: tid=0 2024-04-23T15:22:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.607+0000 7f7d647c6740 1 client.18159 shutdown 2024-04-23T15:22:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 msgr2=0x55b33d9c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 0x55b33d9c7ca0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c001eb0 tx=0x7f7d4c011470 comp rx=0 tx=0).stop 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 shutdown_connections 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b33da3b5d0 0x55b33da3d9f0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b33d9c35a0 0x55b33d9c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b33d9bf300 0x55b33d9c7ca0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 --2- 172.21.15.7:0/1314747238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b33d9b83c0 0x55b33d9cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d48c00640 0 client.18159 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 >> 172.21.15.7:0/1314747238 conn(0x55b33d9b48d0 msgr2=0x55b33d9c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 shutdown_connections 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 1 -- 172.21.15.7:0/1314747238 wait complete. 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.608+0000 7f7d647c6740 20 client.18159 trim_cache size 0 max 16384 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7d400a3d90 msgr2=0x7f7d400a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7d400a3d90 0x7f7d400a6250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b9e80 tx=0x7f7d5402a950 comp rx=0 tx=0).stop 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 msgr2=0x7f7d5c19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c19eb00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7d54004af0 tx=0x7f7d54003c10 comp rx=0 tx=0).stop 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 shutdown_connections 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7d400a3d90 0x7f7d400a6250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d5c112e40 0x7f7d5c19eb00 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d5c074cc0 0x7f7d5c1a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 --2- 172.21.15.7:0/225958377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d5c0743a0 0x7f7d5c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.609+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 >> 172.21.15.7:0/225958377 conn(0x7f7d5c0fd920 msgr2=0x7f7d5c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.610+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 shutdown_connections 2024-04-23T15:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:18.610+0000 7f7d5be00640 1 -- 172.21.15.7:0/225958377 wait complete. 2024-04-23T15:22:19.220 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:18 smithi137 ceph-mon[31694]: pgmap v979: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:22:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:18 smithi007 ceph-mon[27906]: pgmap v979: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:22:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:18 smithi186 ceph-mon[31814]: pgmap v979: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:22:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:20 smithi007 ceph-mon[27906]: pgmap v980: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:22:21.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:20 smithi186 ceph-mon[31814]: pgmap v980: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:22:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:20 smithi137 ceph-mon[31694]: pgmap v980: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:22:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:22 smithi007 ceph-mon[27906]: pgmap v981: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T15:22:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:22 smithi186 ceph-mon[31814]: pgmap v981: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T15:22:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:22 smithi137 ceph-mon[31694]: pgmap v981: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-23T15:22:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:24 smithi007 ceph-mon[27906]: pgmap v982: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:22:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:24 smithi186 ceph-mon[31814]: pgmap v982: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:22:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:24 smithi137 ceph-mon[31694]: pgmap v982: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:22:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:26 smithi007 ceph-mon[27906]: pgmap v983: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:26 smithi186 ceph-mon[31814]: pgmap v983: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:26 smithi137 ceph-mon[31694]: pgmap v983: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:28 smithi007 ceph-mon[27906]: pgmap v984: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:22:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:28 smithi186 ceph-mon[31814]: pgmap v984: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:22:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:28 smithi137 ceph-mon[31694]: pgmap v984: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 19 op/s 2024-04-23T15:22:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:30 smithi007 ceph-mon[27906]: pgmap v985: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:31.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:30 smithi186 ceph-mon[31814]: pgmap v985: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:30 smithi137 ceph-mon[31694]: pgmap v985: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 -- 172.21.15.7:0/1017167857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7820112e20 msgr2=0x7f7820115210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 --2- 172.21.15.7:0/1017167857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7820112e20 0x7f7820115210 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f7818009ca0 tx=0x7f781802a950 comp rx=0 tx=0).stop 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 -- 172.21.15.7:0/1017167857 shutdown_connections 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 --2- 172.21.15.7:0/1017167857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820074cc0 0x7f78201128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 --2- 172.21.15.7:0/1017167857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7820112e20 0x7f7820115210 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 --2- 172.21.15.7:0/1017167857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78200743a0 0x7f7820074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 -- 172.21.15.7:0/1017167857 >> 172.21.15.7:0/1017167857 conn(0x7f78200fd940 msgr2=0x7f78200ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 -- 172.21.15.7:0/1017167857 shutdown_connections 2024-04-23T15:22:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.764+0000 7f781fe00640 1 -- 172.21.15.7:0/1017167857 wait complete. 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 Processor -- start 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 -- start start 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 0x7f78201a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7820074cc0 0x7f78201a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820112e20 0x7f782019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78201186e0 con 0x7f78200743a0 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7820118560 con 0x7f7820112e20 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7820118860 con 0x7f7820074cc0 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.766+0000 7f781ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 0x7f78201a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 0x7f78201a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47090/0 (socket says 172.21.15.7:47090) 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 -- 172.21.15.7:0/3204147182 learned_addr learned my addr 172.21.15.7:0/3204147182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781e000640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7820074cc0 0x7f78201a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781f400640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820112e20 0x7f782019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 -- 172.21.15.7:0/3204147182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7820074cc0 msgr2=0x7f78201a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7820074cc0 0x7f78201a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 -- 172.21.15.7:0/3204147182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820112e20 msgr2=0x7f782019eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820112e20 0x7f782019eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781ea00640 1 -- 172.21.15.7:0/3204147182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782019f240 con 0x7f78200743a0 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.767+0000 7f781f400640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820112e20 0x7f782019eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.768+0000 7f781ea00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 0x7f78201a48c0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f781000d770 tx=0x7f781000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.768+0000 7f7817400640 1 -- 172.21.15.7:0/3204147182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810017070 con 0x7f78200743a0 2024-04-23T15:22:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.768+0000 7f7817400640 1 -- 172.21.15.7:0/3204147182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78100054d0 con 0x7f78200743a0 2024-04-23T15:22:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.768+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782019f530 con 0x7f78200743a0 2024-04-23T15:22:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.768+0000 7f7817400640 1 -- 172.21.15.7:0/3204147182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810004cf0 con 0x7f78200743a0 2024-04-23T15:22:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.768+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78201ab780 con 0x7f78200743a0 2024-04-23T15:22:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.772+0000 7f7817400640 1 -- 172.21.15.7:0/3204147182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7810004e90 con 0x7f78200743a0 2024-04-23T15:22:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.772+0000 7f7828799740 1 Processor -- start 2024-04-23T15:22:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.772+0000 7f7828799740 1 -- start start 2024-04-23T15:22:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.772+0000 7f7828799740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.772+0000 7f7828799740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff402060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.772+0000 7f7828799740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff404990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f7828799740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561eff35d900 con 0x561eff4025a0 2024-04-23T15:22:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f7828799740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561eff303f20 con 0x561eff3f7ce0 2024-04-23T15:22:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f7828799740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561eff3598c0 con 0x561eff3f73c0 2024-04-23T15:22:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff404990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff404990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47102/0 (socket says 172.21.15.7:47102) 2024-04-23T15:22:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 -- 172.21.15.7:0/1496994626 learned_addr learned my addr 172.21.15.7:0/1496994626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781f400640 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781ea00640 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff402060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 -- 172.21.15.7:0/1496994626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 msgr2=0x561eff3f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 -- 172.21.15.7:0/1496994626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 msgr2=0x561eff402060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff402060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781e000640 1 -- 172.21.15.7:0/1496994626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eff328e10 con 0x561eff4025a0 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.773+0000 7f781f400640 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f7817400640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78040a3d10 0x7f78040a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f781e000640 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff404990 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f780c00bbe0 tx=0x7f780c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3299fc436c9a2d37 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f7817400640 1 -- 172.21.15.7:0/3204147182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f78100d03a0 con 0x7f78200743a0 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f780be00640 1 -- 172.21.15.7:0/1496994626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c015070 con 0x561eff4025a0 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f781f400640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78040a3d10 0x7f78040a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f780be00640 1 -- 172.21.15.7:0/1496994626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f780c0118f0 con 0x561eff4025a0 2024-04-23T15:22:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.774+0000 7f780be00640 1 -- 172.21.15.7:0/1496994626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c010740 con 0x561eff4025a0 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.775+0000 7f7828799740 1 -- 172.21.15.7:0/1496994626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 msgr2=0x561eff404990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.775+0000 7f781f400640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78040a3d10 0x7f78040a61d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7818004af0 tx=0x7f7818004a60 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.775+0000 7f7828799740 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff404990 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f780c00bbe0 tx=0x7f780c00f730 comp rx=0 tx=0).stop 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 -- 172.21.15.7:0/1496994626 shutdown_connections 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff402060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff404990 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 --2- 172.21.15.7:0/1496994626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 -- 172.21.15.7:0/1496994626 >> 172.21.15.7:0/1496994626 conn(0x561eff3f38d0 msgr2=0x561eff3f3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 -- 172.21.15.7:0/1496994626 shutdown_connections 2024-04-23T15:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 -- 172.21.15.7:0/1496994626 wait complete. 2024-04-23T15:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 -- start start 2024-04-23T15:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.776+0000 7f7828799740 1 Processor -- start 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 0x561eff3ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f7ce0 0x561eff3ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff4025a0 0x561eff3fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561eff405170 con 0x561eff3f73c0 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561eff3172c0 con 0x561eff4025a0 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561eff4052f0 con 0x561eff3f7ce0 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f7828799740 10 client.0 _ll_register_callbacks cb 0x561eff06fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f781ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 0x561eff3ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f781ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 0x561eff3ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47108/0 (socket says 172.21.15.7:47108) 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.777+0000 7f781ea00640 1 -- 172.21.15.7:0/2034435701 learned_addr learned my addr 172.21.15.7:0/2034435701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781f400640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff4025a0 0x561eff3fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781ea00640 1 -- 172.21.15.7:0/2034435701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f7ce0 msgr2=0x561eff3ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781e000640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f7ce0 0x561eff3ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781ea00640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f7ce0 0x561eff3ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781ea00640 1 -- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff4025a0 msgr2=0x561eff3fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781ea00640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff4025a0 0x561eff3fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781ea00640 1 -- 172.21.15.7:0/2034435701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eff327fd0 con 0x561eff3f73c0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781f400640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff4025a0 0x561eff3fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781e000640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f7ce0 0x561eff3ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f781ea00640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 0x561eff3ff520 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f781000d740 tx=0x7f781009bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ea85380bf9ea36 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f7808c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f7808c00640 1 -- 172.21.15.7:0/2034435701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810020040 con 0x561eff3f73c0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f7808c00640 1 -- 172.21.15.7:0/2034435701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f78100cd960 con 0x561eff3f73c0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.778+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f780c0118f0 con 0x561eff3f73c0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7808c00640 1 -- 172.21.15.7:0/2034435701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f78100cdb60 con 0x561eff3f73c0 2024-04-23T15:22:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7828799740 10 client.18171 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561eff070210 con 0x561eff3f73c0 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7808c00640 1 -- 172.21.15.7:0/2034435701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f780c0118f0 con 0x561eff3f73c0 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7808c00640 1 -- 172.21.15.7:0/2034435701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7810023060 con 0x561eff3f73c0 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7828799740 10 client.18171 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7828799740 10 client.18171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.779+0000 7f7828799740 20 client.18171 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.780+0000 7f7828799740 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff4126e0 0x561eff414af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.780+0000 7f7828799740 4 client.18171 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.780+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eff36b320 con 0x561eff4126e0 2024-04-23T15:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.780+0000 7f781e000640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff4126e0 0x561eff414af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.781+0000 7f781e000640 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff4126e0 0x561eff414af0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a692c31640435e69 server_cookie=9e7b7d3e80cb9dac in_seq=0 out_seq=0 2024-04-23T15:22:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.781+0000 7f7808c00640 10 client.18171 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7808c00640 1 -- 172.21.15.7:0/2034435701 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561eff36b320 con 0x561eff4126e0 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7808c00640 10 client.18171 handle_command_reply: tid=0 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 client.18171 shutdown 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 msgr2=0x561eff3ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 0x561eff3ff520 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f781000d740 tx=0x7f781009bdc0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 shutdown_connections 2024-04-23T15:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff4126e0 0x561eff414af0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff4025a0 0x561eff3fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f7ce0 0x561eff3ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 --2- 172.21.15.7:0/2034435701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff3f73c0 0x561eff3ff520 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7808c00640 0 client.18171 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.783+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 >> 172.21.15.7:0/2034435701 conn(0x561eff3f38d0 msgr2=0x561eff3f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.784+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 shutdown_connections 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.784+0000 7f7828799740 1 -- 172.21.15.7:0/2034435701 wait complete. 2024-04-23T15:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.784+0000 7f7828799740 20 client.18171 trim_cache size 0 max 16384 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.800+0000 7f7828799740 1 Processor -- start 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.800+0000 7f7828799740 1 -- start start 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.800+0000 7f7828799740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff40e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.800+0000 7f7828799740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.800+0000 7f7828799740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff3ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f7828799740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b5820 con 0x561eff4025a0 2024-04-23T15:22:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f7828799740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b7360 con 0x561eff3f7ce0 2024-04-23T15:22:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f7828799740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b5ef0 con 0x561eff3f73c0 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff3ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff3ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47110/0 (socket says 172.21.15.7:47110) 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781f400640 1 -- 172.21.15.7:0/59108927 learned_addr learned my addr 172.21.15.7:0/59108927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781ea00640 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff40e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781e000640 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781f400640 1 -- 172.21.15.7:0/59108927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 msgr2=0x561eff40e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.801+0000 7f781f400640 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff40e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f781f400640 1 -- 172.21.15.7:0/59108927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 msgr2=0x561eff3f9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f781f400640 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3f9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f781f400640 1 -- 172.21.15.7:0/59108927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eff3f7b10 con 0x561eff4025a0 2024-04-23T15:22:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f781e000640 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:22:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f781f400640 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff3ffbf0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f7818009ca0 tx=0x7f781803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddec1687f5fc55e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f780b400640 1 -- 172.21.15.7:0/59108927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818034040 con 0x561eff4025a0 2024-04-23T15:22:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f780b400640 1 -- 172.21.15.7:0/59108927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f781802fde0 con 0x561eff4025a0 2024-04-23T15:22:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.802+0000 7f780b400640 1 -- 172.21.15.7:0/59108927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818004810 con 0x561eff4025a0 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 -- 172.21.15.7:0/59108927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 msgr2=0x561eff3ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff3ffbf0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f7818009ca0 tx=0x7f781803f000 comp rx=0 tx=0).stop 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 -- 172.21.15.7:0/59108927 shutdown_connections 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff3ffbf0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 --2- 172.21.15.7:0/59108927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff40e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 -- 172.21.15.7:0/59108927 >> 172.21.15.7:0/59108927 conn(0x561eff3f38d0 msgr2=0x561eff3ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 -- 172.21.15.7:0/59108927 shutdown_connections 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.803+0000 7f7828799740 1 -- 172.21.15.7:0/59108927 wait complete. 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.804+0000 7f7828799740 1 -- start start 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.804+0000 7f7828799740 1 Processor -- start 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3fca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff477c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b6c90 con 0x561eff4025a0 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b65c0 con 0x561eff3f7ce0 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b3820 con 0x561eff3f73c0 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f7828799740 10 client.0 _ll_register_callbacks cb 0x7f7810009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff477c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff477c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47122/0 (socket says 172.21.15.7:47122) 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 -- 172.21.15.7:0/685534884 learned_addr learned my addr 172.21.15.7:0/685534884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781ea00640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781e000640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3fca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 -- 172.21.15.7:0/685534884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 msgr2=0x561eff3fc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3fc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 -- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 msgr2=0x561eff3fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3fca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.805+0000 7f781f400640 1 -- 172.21.15.7:0/685534884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eff13c620 con 0x561eff4025a0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f781f400640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff477c70 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f7818005e30 tx=0x7f78180042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76631d2af095311c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7808c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7808c00640 1 -- 172.21.15.7:0/685534884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818055070 con 0x561eff4025a0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7808c00640 1 -- 172.21.15.7:0/685534884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f7818004040 con 0x561eff4025a0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f781802fde0 con 0x561eff4025a0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7808c00640 1 -- 172.21.15.7:0/685534884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7818049020 con 0x561eff4025a0 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7828799740 10 client.18177 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.806+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561eff4790b0 con 0x561eff4025a0 2024-04-23T15:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7808c00640 1 -- 172.21.15.7:0/685534884 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f781802fde0 con 0x561eff4025a0 2024-04-23T15:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7808c00640 1 -- 172.21.15.7:0/685534884 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f781805a440 con 0x561eff4025a0 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7828799740 10 client.18177 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7828799740 10 client.18177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7828799740 20 client.18177 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7828799740 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff479750 0x561eff47bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7828799740 4 client.18177 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.807+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561eff365190 con 0x561eff479750 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.808+0000 7f781ea00640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff479750 0x561eff47bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.809+0000 7f781ea00640 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff479750 0x561eff47bb70 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd369b3c236091b server_cookie=50c38d7169e950c0 in_seq=0 out_seq=0 2024-04-23T15:22:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.809+0000 7f7808c00640 10 client.18177 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.842+0000 7f7808c00640 1 -- 172.21.15.7:0/685534884 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561eff365190 con 0x561eff479750 2024-04-23T15:22:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.842+0000 7f7808c00640 10 client.18177 handle_command_reply: tid=0 2024-04-23T15:22:31.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.842+0000 7f7828799740 1 client.18177 shutdown 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 msgr2=0x561eff477c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff477c70 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f7818005e30 tx=0x7f78180042c0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 shutdown_connections 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561eff479750 0x561eff47bb70 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561eff3f7ce0 0x561eff3fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561eff4025a0 0x561eff477c70 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 --2- 172.21.15.7:0/685534884 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561eff3f73c0 0x561eff3fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7808c00640 0 client.18177 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 >> 172.21.15.7:0/685534884 conn(0x561eff3f38d0 msgr2=0x561eff3ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 shutdown_connections 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 1 -- 172.21.15.7:0/685534884 wait complete. 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.843+0000 7f7828799740 20 client.18177 trim_cache size 0 max 16384 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:22:31.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:22:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78040a3d10 msgr2=0x7f78040a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78040a3d10 0x7f78040a61d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7818004af0 tx=0x7f7818004a60 comp rx=0 tx=0).stop 2024-04-23T15:22:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 msgr2=0x7f78201a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 0x7f78201a48c0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f781000d770 tx=0x7f781000dc30 comp rx=0 tx=0).stop 2024-04-23T15:22:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 shutdown_connections 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78040a3d10 0x7f78040a61d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7820112e20 0x7f782019eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7820074cc0 0x7f78201a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 --2- 172.21.15.7:0/3204147182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78200743a0 0x7f78201a48c0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.844+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 >> 172.21.15.7:0/3204147182 conn(0x7f78200fd940 msgr2=0x7f78200ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.845+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 shutdown_connections 2024-04-23T15:22:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:31.845+0000 7f781fe00640 1 -- 172.21.15.7:0/3204147182 wait complete. 2024-04-23T15:22:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:32 smithi007 ceph-mon[27906]: pgmap v986: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:32 smithi186 ceph-mon[31814]: pgmap v986: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:32 smithi137 ceph-mon[31694]: pgmap v986: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:22:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:34 smithi007 ceph-mon[27906]: pgmap v987: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:22:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:34 smithi186 ceph-mon[31814]: pgmap v987: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:22:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:34 smithi137 ceph-mon[31694]: pgmap v987: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:22:36.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:36 smithi007 ceph-mon[27906]: pgmap v988: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:22:36.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:36 smithi186 ceph-mon[31814]: pgmap v988: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:22:36.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:36 smithi137 ceph-mon[31694]: pgmap v988: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:22:38.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:38 smithi007 ceph-mon[27906]: pgmap v989: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:22:38.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:38 smithi186 ceph-mon[31814]: pgmap v989: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:22:38.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:38 smithi137 ceph-mon[31694]: pgmap v989: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:22:40.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:40 smithi007 ceph-mon[27906]: pgmap v990: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:40.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:40 smithi186 ceph-mon[31814]: pgmap v990: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:40.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:40 smithi137 ceph-mon[31694]: pgmap v990: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:42.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:42 smithi007 ceph-mon[27906]: pgmap v991: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:42.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:42 smithi186 ceph-mon[31814]: pgmap v991: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:42.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:42 smithi137 ceph-mon[31694]: pgmap v991: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:44.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:44 smithi007 ceph-mon[27906]: pgmap v992: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:22:44.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:44 smithi186 ceph-mon[31814]: pgmap v992: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:22:44.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:44 smithi137 ceph-mon[31694]: pgmap v992: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 -- 172.21.15.7:0/2350278953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964101550 msgr2=0x7f096410e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 --2- 172.21.15.7:0/2350278953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964101550 0x7f096410e210 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f094c009900 tx=0x7f094c02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 -- 172.21.15.7:0/2350278953 shutdown_connections 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 --2- 172.21.15.7:0/2350278953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f096410e750 0x7f0964110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 --2- 172.21.15.7:0/2350278953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964101550 0x7f096410e210 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 --2- 172.21.15.7:0/2350278953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0964100ba0 0x7f0964100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 -- 172.21.15.7:0/2350278953 >> 172.21.15.7:0/2350278953 conn(0x7f09640fc820 msgr2=0x7f09640fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 -- 172.21.15.7:0/2350278953 shutdown_connections 2024-04-23T15:22:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.997+0000 7f0963e00640 1 -- 172.21.15.7:0/2350278953 wait complete. 2024-04-23T15:22:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.999+0000 7f0963e00640 1 Processor -- start 2024-04-23T15:22:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:44.999+0000 7f0963e00640 1 -- start start 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 0x7f09641a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0964101550 0x7f09641a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f096410e750 0x7f096419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0964114280 con 0x7f0964100ba0 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0964114100 con 0x7f096410e750 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0964114400 con 0x7f0964101550 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0962a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 0x7f09641a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0962a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 0x7f09641a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41594/0 (socket says 172.21.15.7:41594) 2024-04-23T15:22:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0962a00640 1 -- 172.21.15.7:0/4286674621 learned_addr learned my addr 172.21.15.7:0/4286674621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f095a000640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0964101550 0x7f09641a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.000+0000 7f0963400640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f096410e750 0x7f096419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0962a00640 1 -- 172.21.15.7:0/4286674621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0964101550 msgr2=0x7f09641a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0962a00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0964101550 0x7f09641a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0962a00640 1 -- 172.21.15.7:0/4286674621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f096410e750 msgr2=0x7f096419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0962a00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f096410e750 0x7f096419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0962a00640 1 -- 172.21.15.7:0/4286674621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096419af00 con 0x7f0964100ba0 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0962a00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 0x7f09641a0580 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f095400c920 tx=0x7f095400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0968a00640 1 -- 172.21.15.7:0/4286674621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954007c70 con 0x7f0964100ba0 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0968a00640 1 -- 172.21.15.7:0/4286674621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0954007e10 con 0x7f0964100ba0 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0968a00640 1 -- 172.21.15.7:0/4286674621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954018820 con 0x7f0964100ba0 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.001+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096419b1f0 con 0x7f0964100ba0 2024-04-23T15:22:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.002+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09641a7500 con 0x7f0964100ba0 2024-04-23T15:22:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.006+0000 7f096cbe9740 1 Processor -- start 2024-04-23T15:22:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.006+0000 7f096cbe9740 1 -- start start 2024-04-23T15:22:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35d97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f0968a00640 1 -- 172.21.15.7:0/4286674621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f09540189c0 con 0x7f0964100ba0 2024-04-23T15:22:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 0x5604a35e6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f096cbe9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5604a353f900 con 0x5604a35e45a0 2024-04-23T15:22:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f096cbe9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5604a34e5f20 con 0x5604a35d9ce0 2024-04-23T15:22:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f096cbe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5604a353b8c0 con 0x5604a35d93c0 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f095a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 0x5604a35e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f095a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 0x5604a35e6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41610/0 (socket says 172.21.15.7:41610) 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f095a000640 1 -- 172.21.15.7:0/3532421246 learned_addr learned my addr 172.21.15.7:0/3532421246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f0963400640 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35d97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.007+0000 7f0962a00640 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f095a000640 1 -- 172.21.15.7:0/3532421246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 msgr2=0x5604a35d97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f095a000640 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35d97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f095a000640 1 -- 172.21.15.7:0/3532421246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 msgr2=0x5604a35e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f095a000640 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f095a000640 1 -- 172.21.15.7:0/3532421246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a350ae10 con 0x5604a35e45a0 2024-04-23T15:22:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f0962a00640 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:22:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.008+0000 7f095a000640 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 0x5604a35e6990 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f094c02a910 tx=0x7f094c032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a2f7a7ddd9a407 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.009+0000 7f0953e00640 1 -- 172.21.15.7:0/3532421246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c03f070 con 0x5604a35e45a0 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.009+0000 7f0953e00640 1 -- 172.21.15.7:0/3532421246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f094c0316a0 con 0x5604a35e45a0 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.009+0000 7f0953e00640 1 -- 172.21.15.7:0/3532421246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c035070 con 0x5604a35e45a0 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.009+0000 7f0968a00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f09480a3d10 0x7f09480a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.009+0000 7f0968a00640 1 -- 172.21.15.7:0/4286674621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f09540d0db0 con 0x7f0964100ba0 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.009+0000 7f0963400640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f09480a3d10 0x7f09480a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 -- 172.21.15.7:0/3532421246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 msgr2=0x5604a35e6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 0x5604a35e6990 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f094c02a910 tx=0x7f094c032cc0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 -- 172.21.15.7:0/3532421246 shutdown_connections 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35e45a0 0x5604a35e6990 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3532421246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35d97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 -- 172.21.15.7:0/3532421246 >> 172.21.15.7:0/3532421246 conn(0x5604a35d58d0 msgr2=0x5604a35d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 -- 172.21.15.7:0/3532421246 shutdown_connections 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f0963400640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f09480a3d10 0x7f09480a61d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0964102d80 tx=0x7f095c0096e0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.010+0000 7f096cbe9740 1 -- 172.21.15.7:0/3532421246 wait complete. 2024-04-23T15:22:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 -- start start 2024-04-23T15:22:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 Processor -- start 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35e1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35e45a0 0x5604a35e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5604a35e7020 con 0x5604a35d9ce0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5604a34f92c0 con 0x5604a35e45a0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.011+0000 7f096cbe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5604a35e71a0 con 0x5604a35d93c0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f096cbe9740 10 client.0 _ll_register_callbacks cb 0x5604a3251a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41614/0 (socket says 172.21.15.7:41614) 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 -- 172.21.15.7:0/335775195 learned_addr learned my addr 172.21.15.7:0/335775195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f0962a00640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f0963400640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35e45a0 0x5604a35e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 -- 172.21.15.7:0/335775195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 msgr2=0x5604a35e1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35e1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 -- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35e45a0 msgr2=0x5604a35e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35e45a0 0x5604a35e2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.012+0000 7f095a000640 1 -- 172.21.15.7:0/335775195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a3509fd0 con 0x5604a35d9ce0 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.013+0000 7f095a000640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35e1b50 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f094c031440 tx=0x7f094c005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2948b5d8279afb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.013+0000 7f0950c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.013+0000 7f0950c00640 1 -- 172.21.15.7:0/335775195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c03f040 con 0x5604a35d9ce0 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.013+0000 7f0950c00640 1 -- 172.21.15.7:0/335775195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f094c004240 con 0x5604a35d9ce0 2024-04-23T15:22:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.013+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f094c0316a0 con 0x5604a35d9ce0 2024-04-23T15:22:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f0950c00640 1 -- 172.21.15.7:0/335775195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f094c035040 con 0x5604a35d9ce0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 10 client.18189 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5604a3252210 con 0x5604a35d9ce0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f0950c00640 1 -- 172.21.15.7:0/335775195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f094c0316a0 con 0x5604a35d9ce0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f0950c00640 1 -- 172.21.15.7:0/335775195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f094c0047e0 con 0x5604a35d9ce0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 10 client.18189 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 10 client.18189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 20 client.18189 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a35f45e0 0x5604a35f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 4 client.18189 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.014+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604a354d320 con 0x5604a35f45e0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.015+0000 7f0962a00640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a35f45e0 0x5604a35f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.016+0000 7f0962a00640 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a35f45e0 0x5604a35f69d0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c20ff7a8c45c27c1 server_cookie=43638fa06d47aff8 in_seq=0 out_seq=0 2024-04-23T15:22:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.016+0000 7f0950c00640 10 client.18189 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f0950c00640 1 -- 172.21.15.7:0/335775195 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5604a354d320 con 0x5604a35f45e0 2024-04-23T15:22:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f0950c00640 10 client.18189 handle_command_reply: tid=0 2024-04-23T15:22:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 client.18189 shutdown 2024-04-23T15:22:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 msgr2=0x5604a35e1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35e1b50 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f094c031440 tx=0x7f094c005bc0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 shutdown_connections 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a35f45e0 0x5604a35f69d0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35e45a0 0x5604a35e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35e1b50 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 --2- 172.21.15.7:0/335775195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35d93c0 0x5604a35e1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f0950c00640 0 client.18189 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.018+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 >> 172.21.15.7:0/335775195 conn(0x5604a35d58d0 msgr2=0x5604a35d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.019+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 shutdown_connections 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.019+0000 7f096cbe9740 1 -- 172.21.15.7:0/335775195 wait complete. 2024-04-23T15:22:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.019+0000 7f096cbe9740 20 client.18189 trim_cache size 0 max 16384 2024-04-23T15:22:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.038+0000 7f096cbe9740 1 Processor -- start 2024-04-23T15:22:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.038+0000 7f096cbe9740 1 -- start start 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 0x5604a35e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a35f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f096cbe9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09641b13a0 con 0x5604a35d93c0 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f096cbe9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09641b2ee0 con 0x5604a35d9ce0 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f096cbe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f09641b1a70 con 0x5604a35e45a0 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f0962a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 0x5604a35e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f0962a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 0x5604a35e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41622/0 (socket says 172.21.15.7:41622) 2024-04-23T15:22:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f0962a00640 1 -- 172.21.15.7:0/3441615732 learned_addr learned my addr 172.21.15.7:0/3441615732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.039+0000 7f095a000640 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0962a00640 1 -- 172.21.15.7:0/3441615732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 msgr2=0x5604a35f99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0962a00640 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a35f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0962a00640 1 -- 172.21.15.7:0/3441615732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 msgr2=0x5604a35d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0962a00640 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35d4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0962a00640 1 -- 172.21.15.7:0/3441615732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a331e620 con 0x5604a35d93c0 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f095a000640 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:22:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0962a00640 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 0x5604a35e3d40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f09540ce200 tx=0x7f09540bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f22126f2f743bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0953400640 1 -- 172.21.15.7:0/3441615732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954018cb0 con 0x5604a35d93c0 2024-04-23T15:22:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0953400640 1 -- 172.21.15.7:0/3441615732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f095400fb00 con 0x5604a35d93c0 2024-04-23T15:22:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.040+0000 7f0953400640 1 -- 172.21.15.7:0/3441615732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540a5610 con 0x5604a35d93c0 2024-04-23T15:22:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 -- 172.21.15.7:0/3441615732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 msgr2=0x5604a35e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 0x5604a35e3d40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f09540ce200 tx=0x7f09540bd040 comp rx=0 tx=0).stop 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 -- 172.21.15.7:0/3441615732 shutdown_connections 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d9ce0 0x5604a35d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a35f99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3441615732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d93c0 0x5604a35e3d40 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 -- 172.21.15.7:0/3441615732 >> 172.21.15.7:0/3441615732 conn(0x5604a35d58d0 msgr2=0x5604a35d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 -- 172.21.15.7:0/3441615732 shutdown_connections 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.041+0000 7f096cbe9740 1 -- 172.21.15.7:0/3441615732 wait complete. 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 -- start start 2024-04-23T15:22:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 Processor -- start 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d93c0 0x5604a35f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35f8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a3653800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09641b2810 con 0x5604a35d9ce0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09641b2140 con 0x5604a35d93c0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.042+0000 7f096cbe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f09641af3a0 con 0x5604a35e45a0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f096cbe9740 10 client.0 _ll_register_callbacks cb 0x7f095c009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41634/0 (socket says 172.21.15.7:41634) 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 -- 172.21.15.7:0/3254990787 learned_addr learned my addr 172.21.15.7:0/3254990787 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f0962a00640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d93c0 0x5604a35f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f0963400640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a3653800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 -- 172.21.15.7:0/3254990787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 msgr2=0x5604a3653800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a3653800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 -- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d93c0 msgr2=0x5604a35f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d93c0 0x5604a35f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.043+0000 7f095a000640 1 -- 172.21.15.7:0/3254990787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a3653df0 con 0x5604a35d9ce0 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.044+0000 7f095a000640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35f8250 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f094c004bb0 tx=0x7f094c005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9136fda59db362d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.044+0000 7f0950c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.044+0000 7f0950c00640 1 -- 172.21.15.7:0/3254990787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c03f040 con 0x5604a35d9ce0 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.044+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604a3547190 con 0x5604a35d9ce0 2024-04-23T15:22:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.044+0000 7f0950c00640 1 -- 172.21.15.7:0/3254990787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f094c004450 con 0x5604a35d9ce0 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.044+0000 7f0950c00640 1 -- 172.21.15.7:0/3254990787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f094c0050b0 con 0x5604a35d9ce0 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 10 client.18195 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5604a365b110 con 0x5604a35d9ce0 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f0950c00640 1 -- 172.21.15.7:0/3254990787 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5604a3547190 con 0x5604a35d9ce0 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f0950c00640 1 -- 172.21.15.7:0/3254990787 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f094c04c450 con 0x5604a35d9ce0 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 10 client.18195 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 10 client.18195 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 20 client.18195 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a365b650 0x5604a365da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 4 client.18195 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:22:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.045+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604a34c34b0 con 0x5604a365b650 2024-04-23T15:22:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.046+0000 7f0962a00640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a365b650 0x5604a365da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.047+0000 7f0962a00640 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a365b650 0x5604a365da70 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd5f71e714e332dc server_cookie=4e24cf496cb7de80 in_seq=0 out_seq=0 2024-04-23T15:22:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.047+0000 7f0950c00640 10 client.18195 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.091+0000 7f0950c00640 1 -- 172.21.15.7:0/3254990787 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604a34c34b0 con 0x5604a365b650 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.091+0000 7f0950c00640 10 client.18195 handle_command_reply: tid=0 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.091+0000 7f096cbe9740 1 client.18195 shutdown 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.091+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 msgr2=0x5604a35f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.091+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35f8250 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f094c004bb0 tx=0x7f094c005930 comp rx=0 tx=0).stop 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 shutdown_connections 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5604a365b650 0x5604a365da70 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5604a35e45a0 0x5604a3653800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604a35d9ce0 0x5604a35f8250 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 --2- 172.21.15.7:0/3254990787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604a35d93c0 0x5604a35f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 >> 172.21.15.7:0/3254990787 conn(0x5604a35d58d0 msgr2=0x5604a35ef540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f0950c00640 0 client.18195 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 shutdown_connections 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 1 -- 172.21.15.7:0/3254990787 wait complete. 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.092+0000 7f096cbe9740 20 client.18195 trim_cache size 0 max 16384 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:22:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f09480a3d10 msgr2=0x7f09480a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f09480a3d10 0x7f09480a61d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0964102d80 tx=0x7f095c0096e0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 msgr2=0x7f09641a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 0x7f09641a0580 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f095400c920 tx=0x7f095400cde0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 shutdown_connections 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f09480a3d10 0x7f09480a61d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f096410e750 0x7f096419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0964101550 0x7f09641a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 --2- 172.21.15.7:0/4286674621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0964100ba0 0x7f09641a0580 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.093+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 >> 172.21.15.7:0/4286674621 conn(0x7f09640fc820 msgr2=0x7f09640fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.094+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 shutdown_connections 2024-04-23T15:22:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:45.094+0000 7f0963e00640 1 -- 172.21.15.7:0/4286674621 wait complete. 2024-04-23T15:22:46.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:46 smithi007 ceph-mon[27906]: pgmap v993: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:46.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:46 smithi186 ceph-mon[31814]: pgmap v993: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:46.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:46 smithi137 ceph-mon[31694]: pgmap v993: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:22:48.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:48 smithi007 ceph-mon[27906]: pgmap v994: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:22:48.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:48 smithi186 ceph-mon[31814]: pgmap v994: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:22:48.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:48 smithi137 ceph-mon[31694]: pgmap v994: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:22:49.571 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:49 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:22:49.572 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:49 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:49.572 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:49 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:49.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:49 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:22:49.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:49 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:49.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:49 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:49.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:49 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:22:49.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:49 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:49.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:49 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:50.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:50 smithi007 ceph-mon[27906]: pgmap v995: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:22:50.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:50 smithi186 ceph-mon[31814]: pgmap v995: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:22:50.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:50 smithi137 ceph-mon[31694]: pgmap v995: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: pgmap v996: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: pgmap v996: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: pgmap v996: 129 pgs: 129 active+clean; 8.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:22:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:22:53.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:53 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:22:53.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:53 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:22:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:22:53.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:53 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: pgmap v997: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:22:54.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:22:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:22:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:22:54.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: pgmap v997: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:22:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:22:54.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: pgmap v997: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:22:54.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:22:56.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:56 smithi007 ceph-mon[27906]: pgmap v998: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:22:56.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:56 smithi186 ceph-mon[31814]: pgmap v998: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:22:56.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:56 smithi137 ceph-mon[31694]: pgmap v998: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:22:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 -- 172.21.15.7:0/4177065659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e80102a40 msgr2=0x7f4e80106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 --2- 172.21.15.7:0/4177065659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e80102a40 0x7f4e80106a80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ca0 tx=0x7f4e7002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 -- 172.21.15.7:0/4177065659 shutdown_connections 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 --2- 172.21.15.7:0/4177065659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 0x7f4e8010ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 --2- 172.21.15.7:0/4177065659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e80102a40 0x7f4e80106a80 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 --2- 172.21.15.7:0/4177065659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e80102090 0x7f4e80102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 -- 172.21.15.7:0/4177065659 >> 172.21.15.7:0/4177065659 conn(0x7f4e800fd950 msgr2=0x7f4e800ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 -- 172.21.15.7:0/4177065659 shutdown_connections 2024-04-23T15:22:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.245+0000 7f4e84e00640 1 -- 172.21.15.7:0/4177065659 wait complete. 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.246+0000 7f4e84e00640 1 Processor -- start 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 -- start start 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e80102090 0x7f4e801a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 0x7f4e801a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 0x7f4e8019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801120f0 con 0x7f4e8019a690 2024-04-23T15:22:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80111f70 con 0x7f4e80107160 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.247+0000 7f4e84e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80112270 con 0x7f4e80102090 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 0x7f4e8019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 0x7f4e8019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54356/0 (socket says 172.21.15.7:54356) 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 -- 172.21.15.7:0/67087247 learned_addr learned my addr 172.21.15.7:0/67087247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 0x7f4e801a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7f400640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e80102090 0x7f4e801a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 -- 172.21.15.7:0/67087247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e80102090 msgr2=0x7f4e801a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e80102090 0x7f4e801a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 -- 172.21.15.7:0/67087247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 msgr2=0x7f4e801a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 0x7f4e801a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7fe00640 1 -- 172.21.15.7:0/67087247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8019b290 con 0x7f4e8019a690 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.248+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 0x7f4e801a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:22:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.249+0000 7f4e7fe00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 0x7f4e8019ab10 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c970 tx=0x7f4e7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.249+0000 7f4e77e00640 1 -- 172.21.15.7:0/67087247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78007bb0 con 0x7f4e8019a690 2024-04-23T15:22:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.249+0000 7f4e77e00640 1 -- 172.21.15.7:0/67087247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e78007d50 con 0x7f4e8019a690 2024-04-23T15:22:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.249+0000 7f4e77e00640 1 -- 172.21.15.7:0/67087247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78018700 con 0x7f4e8019a690 2024-04-23T15:22:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.249+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e801a7370 con 0x7f4e8019a690 2024-04-23T15:22:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.249+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e801a7720 con 0x7f4e8019a690 2024-04-23T15:22:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e77e00640 1 -- 172.21.15.7:0/67087247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4e7800fa20 con 0x7f4e8019a690 2024-04-23T15:22:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 Processor -- start 2024-04-23T15:22:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 -- start start 2024-04-23T15:22:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 0x55ee5e5a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ee5e4fc900 con 0x55ee5e5963c0 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee5e4a2f20 con 0x55ee5e596ce0 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.253+0000 7f4e89186740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ee5e4f88c0 con 0x55ee5e5a15a0 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54358/0 (socket says 172.21.15.7:54358) 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 -- 172.21.15.7:0/2716292862 learned_addr learned my addr 172.21.15.7:0/2716292862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7f400640 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 -- 172.21.15.7:0/2716292862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 msgr2=0x55ee5e5a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 0x55ee5e5a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 -- 172.21.15.7:0/2716292862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 msgr2=0x55ee5e5a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.254+0000 7f4e77e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e640a3d90 0x7f4e640a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.255+0000 7f4e7ea00640 1 -- 172.21.15.7:0/2716292862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5e4c7e10 con 0x55ee5e5963c0 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.255+0000 7f4e77e00640 1 -- 172.21.15.7:0/67087247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f4e780d0c40 con 0x7f4e8019a690 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.255+0000 7f4e7fe00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e640a3d90 0x7f4e640a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.255+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5967a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f4e70000f80 tx=0x7f4e70009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480a36ca0cfe84e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.255+0000 7f4e74c00640 1 -- 172.21.15.7:0/2716292862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70042070 con 0x55ee5e5963c0 2024-04-23T15:22:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.255+0000 7f4e74c00640 1 -- 172.21.15.7:0/2716292862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e70036040 con 0x55ee5e5963c0 2024-04-23T15:22:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.256+0000 7f4e74c00640 1 -- 172.21.15.7:0/2716292862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70004410 con 0x55ee5e5963c0 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 -- 172.21.15.7:0/2716292862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 msgr2=0x55ee5e5967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5967a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f4e70000f80 tx=0x7f4e70009930 comp rx=0 tx=0).stop 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e7fe00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e640a3d90 0x7f4e640a6250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e78098c90 tx=0x7f4e780046c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 -- 172.21.15.7:0/2716292862 shutdown_connections 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 0x55ee5e5a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 --2- 172.21.15.7:0/2716292862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5967a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 -- 172.21.15.7:0/2716292862 >> 172.21.15.7:0/2716292862 conn(0x55ee5e5928d0 msgr2=0x55ee5e592cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 -- 172.21.15.7:0/2716292862 shutdown_connections 2024-04-23T15:22:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 -- 172.21.15.7:0/2716292862 wait complete. 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.257+0000 7f4e89186740 1 -- start start 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 Processor -- start 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5963c0 0x55ee5e59e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e596ce0 0x55ee5e59eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ee5e5a40e0 con 0x55ee5e596ce0 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee5e4b62c0 con 0x55ee5e5a15a0 2024-04-23T15:22:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ee5e5a4260 con 0x55ee5e5963c0 2024-04-23T15:22:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.258+0000 7f4e89186740 10 client.0 _ll_register_callbacks cb 0x55ee5e20ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.259+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5963c0 0x55ee5e59e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.259+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5963c0 0x55ee5e59e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:44136/0 (socket says 172.21.15.7:44136) 2024-04-23T15:22:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.259+0000 7f4e7ea00640 1 -- 172.21.15.7:0/211797820 learned_addr learned my addr 172.21.15.7:0/211797820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.259+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.259+0000 7f4e7f400640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e596ce0 0x55ee5e59eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.260+0000 7f4e7f400640 1 -- 172.21.15.7:0/211797820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5963c0 msgr2=0x55ee5e59e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.260+0000 7f4e7f400640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5963c0 0x55ee5e59e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.260+0000 7f4e7f400640 1 -- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 msgr2=0x55ee5e59f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.260+0000 7f4e7f400640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.260+0000 7f4e7f400640 1 -- 172.21.15.7:0/211797820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5e4c6fd0 con 0x55ee5e596ce0 2024-04-23T15:22:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.261+0000 7f4e7f400640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e596ce0 0x55ee5e59eac0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800be10 tx=0x7f4e680117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae299be122cdf1e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.261+0000 7f4e6d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e6d600640 1 -- 172.21.15.7:0/211797820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68012650 con 0x55ee5e596ce0 2024-04-23T15:22:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e6d600640 1 -- 172.21.15.7:0/211797820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f4e680127f0 con 0x55ee5e596ce0 2024-04-23T15:22:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e70036040 con 0x55ee5e596ce0 2024-04-23T15:22:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e6d600640 1 -- 172.21.15.7:0/211797820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4e680129f0 con 0x55ee5e596ce0 2024-04-23T15:22:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e89186740 10 client.18207 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ee5e20f210 con 0x55ee5e596ce0 2024-04-23T15:22:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.263+0000 7f4e6d600640 1 -- 172.21.15.7:0/211797820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e70036040 con 0x55ee5e596ce0 2024-04-23T15:22:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e6d600640 1 -- 172.21.15.7:0/211797820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4e6801a3d0 con 0x55ee5e596ce0 2024-04-23T15:22:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e89186740 10 client.18207 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e89186740 10 client.18207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e89186740 20 client.18207 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e89186740 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e5b17c0 0x55ee5e5b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e89186740 4 client.18207 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:22:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee5e50a320 con 0x55ee5e5b17c0 2024-04-23T15:22:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.264+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e5b17c0 0x55ee5e5b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.265+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e5b17c0 0x55ee5e5b3bb0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c249bbe1e53cbc server_cookie=f27eae976bf9c92b in_seq=0 out_seq=0 2024-04-23T15:22:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.265+0000 7f4e6d600640 10 client.18207 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.267+0000 7f4e6d600640 1 -- 172.21.15.7:0/211797820 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ee5e50a320 con 0x55ee5e5b17c0 2024-04-23T15:22:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.267+0000 7f4e6d600640 10 client.18207 handle_command_reply: tid=0 2024-04-23T15:22:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.267+0000 7f4e89186740 1 client.18207 shutdown 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e596ce0 msgr2=0x55ee5e59eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e596ce0 0x55ee5e59eac0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800be10 tx=0x7f4e680117b0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 shutdown_connections 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e5b17c0 0x55ee5e5b3bb0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e596ce0 0x55ee5e59eac0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 --2- 172.21.15.7:0/211797820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5963c0 0x55ee5e59e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 >> 172.21.15.7:0/211797820 conn(0x55ee5e5928d0 msgr2=0x55ee5e598650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e6d600640 0 client.18207 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 shutdown_connections 2024-04-23T15:22:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 1 -- 172.21.15.7:0/211797820 wait complete. 2024-04-23T15:22:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.268+0000 7f4e89186740 20 client.18207 trim_cache size 0 max 16384 2024-04-23T15:22:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.293+0000 7f4e89186740 1 Processor -- start 2024-04-23T15:22:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.293+0000 7f4e89186740 1 -- start start 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e89186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e89186740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e592210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e89186740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 0x55ee5e5998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e89186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b13f0 con 0x55ee5e5963c0 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e89186740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b2f30 con 0x55ee5e596ce0 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e89186740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b1ac0 con 0x55ee5e5a15a0 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54368/0 (socket says 172.21.15.7:54368) 2024-04-23T15:22:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.294+0000 7f4e7ea00640 1 -- 172.21.15.7:0/3242904346 learned_addr learned my addr 172.21.15.7:0/3242904346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7f400640 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e592210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7ea00640 1 -- 172.21.15.7:0/3242904346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 msgr2=0x55ee5e5998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 0x55ee5e5998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7ea00640 1 -- 172.21.15.7:0/3242904346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 msgr2=0x55ee5e592210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e592210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7ea00640 1 -- 172.21.15.7:0/3242904346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5e2db620 con 0x55ee5e5963c0 2024-04-23T15:22:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a0cb0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ca0 tx=0x7f4e70009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4690f5b113a1e725 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.295+0000 7f4e6fe00640 1 -- 172.21.15.7:0/3242904346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70042040 con 0x55ee5e5963c0 2024-04-23T15:22:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.296+0000 7f4e6fe00640 1 -- 172.21.15.7:0/3242904346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e70036040 con 0x55ee5e5963c0 2024-04-23T15:22:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.296+0000 7f4e6fe00640 1 -- 172.21.15.7:0/3242904346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70003dd0 con 0x55ee5e5963c0 2024-04-23T15:22:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 -- 172.21.15.7:0/3242904346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 msgr2=0x55ee5e5a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a0cb0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ca0 tx=0x7f4e70009890 comp rx=0 tx=0).stop 2024-04-23T15:22:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 -- 172.21.15.7:0/3242904346 shutdown_connections 2024-04-23T15:22:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e596ce0 0x55ee5e592210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e5a15a0 0x55ee5e5998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 --2- 172.21.15.7:0/3242904346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a0cb0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 -- 172.21.15.7:0/3242904346 >> 172.21.15.7:0/3242904346 conn(0x55ee5e5928d0 msgr2=0x55ee5e597d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 -- 172.21.15.7:0/3242904346 shutdown_connections 2024-04-23T15:22:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 -- 172.21.15.7:0/3242904346 wait complete. 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.297+0000 7f4e89186740 1 -- start start 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 Processor -- start 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b2860 con 0x55ee5e5963c0 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b2190 con 0x55ee5e5a15a0 2024-04-23T15:22:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801af3f0 con 0x55ee5e596ce0 2024-04-23T15:22:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.298+0000 7f4e89186740 10 client.0 _ll_register_callbacks cb 0x7f4e6800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:22:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54372/0 (socket says 172.21.15.7:54372) 2024-04-23T15:22:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 -- 172.21.15.7:0/4070222332 learned_addr learned my addr 172.21.15.7:0/4070222332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:22:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7f400640 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 -- 172.21.15.7:0/4070222332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e596ce0 msgr2=0x55ee5e5a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 -- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 msgr2=0x55ee5e59aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 -- 172.21.15.7:0/4070222332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5e59b210 con 0x55ee5e5963c0 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e7ea00640 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a9590 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f4e7002a900 tx=0x7f4e700095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81fdef888536dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.299+0000 7f4e6d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e6d600640 1 -- 172.21.15.7:0/4070222332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70042040 con 0x55ee5e5963c0 2024-04-23T15:22:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e6d600640 1 -- 172.21.15.7:0/4070222332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 9467+0+0 (secure 0 0 0) 0x7f4e70004bc0 con 0x55ee5e5963c0 2024-04-23T15:22:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e70036040 con 0x55ee5e5963c0 2024-04-23T15:22:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e6d600640 1 -- 172.21.15.7:0/4070222332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4e70004dc0 con 0x55ee5e5963c0 2024-04-23T15:22:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e89186740 10 client.18213 fetch_fsmap learned FSMap version 32 2024-04-23T15:22:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ee5e617840 con 0x55ee5e5963c0 2024-04-23T15:22:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.300+0000 7f4e6d600640 1 -- 172.21.15.7:0/4070222332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e70036040 con 0x55ee5e5963c0 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e6d600640 1 -- 172.21.15.7:0/4070222332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4e70003b50 con 0x55ee5e5963c0 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e89186740 10 client.18213 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e89186740 10 client.18213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e89186740 20 client.18213 populate_metadata read hostname 'smithi007' 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e89186740 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e617a10 0x55ee5e619e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e89186740 4 client.18213 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.301+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee5e504190 con 0x55ee5e617a10 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.302+0000 7f4e7f400640 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e617a10 0x55ee5e619e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.303+0000 7f4e7f400640 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e617a10 0x55ee5e619e00 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa4f20b0b89c8067 server_cookie=94297a9a8dbce3ae in_seq=0 out_seq=0 2024-04-23T15:22:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.303+0000 7f4e6d600640 10 client.18213 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e6d600640 1 -- 172.21.15.7:0/4070222332 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee5e504190 con 0x55ee5e617a10 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e6d600640 10 client.18213 handle_command_reply: tid=0 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 client.18213 shutdown 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 msgr2=0x55ee5e5a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a9590 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f4e7002a900 tx=0x7f4e700095d0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 shutdown_connections 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ee5e617a10 0x55ee5e619e00 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee5e5a15a0 0x55ee5e59aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee5e596ce0 0x55ee5e5a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 --2- 172.21.15.7:0/4070222332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ee5e5963c0 0x55ee5e5a9590 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 >> 172.21.15.7:0/4070222332 conn(0x55ee5e5928d0 msgr2=0x55ee5e5985a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e6d600640 0 client.18213 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:22:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.341+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 shutdown_connections 2024-04-23T15:22:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.342+0000 7f4e89186740 1 -- 172.21.15.7:0/4070222332 wait complete. 2024-04-23T15:22:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.342+0000 7f4e89186740 20 client.18213 trim_cache size 0 max 16384 2024-04-23T15:22:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:22:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:22:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:22:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:22:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e640a3d90 msgr2=0x7f4e640a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e640a3d90 0x7f4e640a6250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e78098c90 tx=0x7f4e780046c0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 msgr2=0x7f4e8019ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 0x7f4e8019ab10 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c970 tx=0x7f4e7800ce30 comp rx=0 tx=0).stop 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 shutdown_connections 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4e640a3d90 0x7f4e640a6250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e80107160 0x7f4e801a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e8019a690 0x7f4e8019ab10 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 --2- 172.21.15.7:0/67087247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e80102090 0x7f4e801a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 >> 172.21.15.7:0/67087247 conn(0x7f4e800fd950 msgr2=0x7f4e800ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 shutdown_connections 2024-04-23T15:22:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:22:58.343+0000 7f4e84e00640 1 -- 172.21.15.7:0/67087247 wait complete. 2024-04-23T15:22:58.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:22:58 smithi007 ceph-mon[27906]: pgmap v999: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:22:58.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:22:58 smithi186 ceph-mon[31814]: pgmap v999: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:22:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:22:58 smithi137 ceph-mon[31694]: pgmap v999: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 18 op/s 2024-04-23T15:23:00.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:00 smithi007 ceph-mon[27906]: pgmap v1000: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-04-23T15:23:00.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:00 smithi186 ceph-mon[31814]: pgmap v1000: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-04-23T15:23:00.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:00 smithi137 ceph-mon[31694]: pgmap v1000: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-04-23T15:23:02.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:02 smithi007 ceph-mon[27906]: pgmap v1001: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-04-23T15:23:02.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:02 smithi186 ceph-mon[31814]: pgmap v1001: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-04-23T15:23:02.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:02 smithi137 ceph-mon[31694]: pgmap v1001: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 9 op/s 2024-04-23T15:23:04.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:04 smithi007 ceph-mon[27906]: pgmap v1002: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.7 MiB/s wr, 37 op/s 2024-04-23T15:23:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:04 smithi186 ceph-mon[31814]: pgmap v1002: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.7 MiB/s wr, 37 op/s 2024-04-23T15:23:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:04 smithi137 ceph-mon[31694]: pgmap v1002: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.7 MiB/s wr, 37 op/s 2024-04-23T15:23:06.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:06 smithi007 ceph-mon[27906]: pgmap v1003: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.1 MiB/s wr, 32 op/s 2024-04-23T15:23:06.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:06 smithi186 ceph-mon[31814]: pgmap v1003: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.1 MiB/s wr, 32 op/s 2024-04-23T15:23:06.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:06 smithi137 ceph-mon[31694]: pgmap v1003: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.1 MiB/s wr, 32 op/s 2024-04-23T15:23:08.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:08 smithi007 ceph-mon[27906]: pgmap v1004: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 37 op/s 2024-04-23T15:23:08.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:08 smithi186 ceph-mon[31814]: pgmap v1004: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 37 op/s 2024-04-23T15:23:08.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:08 smithi137 ceph-mon[31694]: pgmap v1004: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 37 op/s 2024-04-23T15:23:09.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:09 smithi007 ceph-mon[27906]: osdmap e143: 12 total, 12 up, 12 in 2024-04-23T15:23:09.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:09 smithi186 ceph-mon[31814]: osdmap e143: 12 total, 12 up, 12 in 2024-04-23T15:23:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:09 smithi137 ceph-mon[31694]: osdmap e143: 12 total, 12 up, 12 in 2024-04-23T15:23:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:10 smithi007 ceph-mon[27906]: pgmap v1006: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 38 op/s 2024-04-23T15:23:10.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:10 smithi186 ceph-mon[31814]: pgmap v1006: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 38 op/s 2024-04-23T15:23:10.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:10 smithi137 ceph-mon[31694]: pgmap v1006: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 38 op/s 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 -- 172.21.15.7:0/3105575754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 msgr2=0x7f96b810ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3105575754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b810ea70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009ca0 tx=0x7f96b002a9e0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 -- 172.21.15.7:0/3105575754 shutdown_connections 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3105575754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103bb0 0x7f96b810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3105575754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b810ea70 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3105575754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103290 0x7f96b8103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 -- 172.21.15.7:0/3105575754 >> 172.21.15.7:0/3105575754 conn(0x7f96b8078080 msgr2=0x7f96b8078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 -- 172.21.15.7:0/3105575754 shutdown_connections 2024-04-23T15:23:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.504+0000 7f96bfc00640 1 -- 172.21.15.7:0/3105575754 wait complete. 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.505+0000 7f96bfc00640 1 Processor -- start 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 -- start start 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103290 0x7f96b8198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103bb0 0x7f96b8198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81122b0 con 0x7f96b810c5d0 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8112130 con 0x7f96b8103290 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bfc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8112430 con 0x7f96b8103bb0 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b819cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39090/0 (socket says 172.21.15.7:39090) 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.506+0000 7f96bdc00640 1 -- 172.21.15.7:0/3583336994 learned_addr learned my addr 172.21.15.7:0/3583336994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bd200640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103290 0x7f96b8198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96afe00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103bb0 0x7f96b8198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bdc00640 1 -- 172.21.15.7:0/3583336994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103bb0 msgr2=0x7f96b8198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bdc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103bb0 0x7f96b8198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bdc00640 1 -- 172.21.15.7:0/3583336994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103290 msgr2=0x7f96b8198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bdc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103290 0x7f96b8198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bdc00640 1 -- 172.21.15.7:0/3583336994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b819d710 con 0x7f96b810c5d0 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96bd200640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103290 0x7f96b8198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:23:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.507+0000 7f96afe00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103bb0 0x7f96b8198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:23:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.508+0000 7f96bdc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b819cfe0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f96b002f040 tx=0x7f96b002fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.508+0000 7f96b6000640 1 -- 172.21.15.7:0/3583336994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0033040 con 0x7f96b810c5d0 2024-04-23T15:23:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.508+0000 7f96b6000640 1 -- 172.21.15.7:0/3583336994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96b002e820 con 0x7f96b810c5d0 2024-04-23T15:23:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.508+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b819d9a0 con 0x7f96b810c5d0 2024-04-23T15:23:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.508+0000 7f96b6000640 1 -- 172.21.15.7:0/3583336994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0043750 con 0x7f96b810c5d0 2024-04-23T15:23:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.508+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b81a5290 con 0x7f96b810c5d0 2024-04-23T15:23:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.512+0000 7f96c2a1a740 1 Processor -- start 2024-04-23T15:23:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.513+0000 7f96b6000640 1 -- 172.21.15.7:0/3583336994 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f96b0036070 con 0x7f96b810c5d0 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.513+0000 7f96c2a1a740 1 -- start start 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.513+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a7464b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.513+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 0x55945a755260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7557a0 0x55945a757b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55945a6ac900 con 0x55945a7469f0 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55945a652f20 con 0x55945a7460d0 2024-04-23T15:23:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55945a6a88c0 con 0x55945a7557a0 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 0x55945a755260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 0x55945a755260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39102/0 (socket says 172.21.15.7:39102) 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 -- 172.21.15.7:0/1910401356 learned_addr learned my addr 172.21.15.7:0/1910401356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96afe00640 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a7464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96afe00640 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7557a0 0x55945a757b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 -- 172.21.15.7:0/1910401356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7557a0 msgr2=0x55945a757b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7557a0 0x55945a757b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 -- 172.21.15.7:0/1910401356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 msgr2=0x55945a7464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a7464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96bd200640 1 -- 172.21.15.7:0/1910401356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945a677e10 con 0x55945a7469f0 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.514+0000 7f96afe00640 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a7464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.515+0000 7f96bd200640 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 0x55945a755260 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f96a800bd40 tx=0x7f96a800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c705a2dbe9fb043b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.515+0000 7f96b6000640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f969c0a3dc0 0x7f969c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.515+0000 7f96ae000640 1 -- 172.21.15.7:0/1910401356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8015070 con 0x55945a7469f0 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.515+0000 7f96ae000640 1 -- 172.21.15.7:0/1910401356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96a800be30 con 0x55945a7469f0 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.515+0000 7f96ae000640 1 -- 172.21.15.7:0/1910401356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80119a0 con 0x55945a7469f0 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.515+0000 7f96b6000640 1 -- 172.21.15.7:0/3583336994 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 9555+0+0 (secure 0 0 0) 0x7f96b00f1bc0 con 0x7f96b810c5d0 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96afe00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f969c0a3dc0 0x7f969c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1910401356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 msgr2=0x55945a755260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 0x55945a755260 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f96a800bd40 tx=0x7f96a800f730 comp rx=0 tx=0).stop 2024-04-23T15:23:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96afe00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f969c0a3dc0 0x7f969c0a6280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96a00058c0 tx=0x7f96a0005d10 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1910401356 shutdown_connections 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7557a0 0x55945a757b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7469f0 0x55945a755260 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1910401356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a7464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.516+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1910401356 >> 172.21.15.7:0/1910401356 conn(0x55945a7426c0 msgr2=0x55945a742aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.517+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1910401356 shutdown_connections 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.517+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1910401356 wait complete. 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.517+0000 7f96c2a1a740 1 -- start start 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.517+0000 7f96c2a1a740 1 Processor -- start 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a752750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a752c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55945a7583d0 con 0x55945a7460d0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55945a6662c0 con 0x55945a7557a0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55945a758550 con 0x55945a7469f0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96c2a1a740 10 client.0 _ll_register_callbacks cb 0x55945a3bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96bd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a752750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96bd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a752750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39112/0 (socket says 172.21.15.7:39112) 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96bd200640 1 -- 172.21.15.7:0/1692493166 learned_addr learned my addr 172.21.15.7:0/1692493166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.518+0000 7f96afe00640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a752c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bdc00640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bd200640 1 -- 172.21.15.7:0/1692493166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 msgr2=0x55945a752c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bd200640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a752c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bd200640 1 -- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 msgr2=0x55945a7531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bd200640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bd200640 1 -- 172.21.15.7:0/1692493166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945a676fd0 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96bd200640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a752750 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f96a800bab0 tx=0x7f96a8011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab26d4b4581f9d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96a6a00640 1 -- 172.21.15.7:0/1692493166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8015050 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96a6a00640 1 -- 172.21.15.7:0/1692493166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 9555+0+0 (secure 0 0 0) 0x7f96a8011b50 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.519+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a800be30 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96a6a00640 1 -- 172.21.15.7:0/1692493166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f96a8031050 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96c2a1a740 10 client.18225 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55945a3bf210 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96a6a00640 1 -- 172.21.15.7:0/1692493166 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96a800be30 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96a6a00640 1 -- 172.21.15.7:0/1692493166 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f96a802c030 con 0x55945a7460d0 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96c2a1a740 10 client.18225 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.520+0000 7f96c2a1a740 10 client.18225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.521+0000 7f96c2a1a740 20 client.18225 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.521+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7657e0 0x55945a767bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.521+0000 7f96c2a1a740 4 client.18225 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:23:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.521+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55945a6ba320 con 0x55945a7657e0 2024-04-23T15:23:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.521+0000 7f96afe00640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7657e0 0x55945a767bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.522+0000 7f96afe00640 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7657e0 0x55945a767bd0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4666a13ede559f5 server_cookie=4c70cf42d2ac8760 in_seq=0 out_seq=0 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.522+0000 7f96a6a00640 10 client.18225 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.524+0000 7f96a6a00640 1 -- 172.21.15.7:0/1692493166 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55945a6ba320 con 0x55945a7657e0 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.524+0000 7f96a6a00640 10 client.18225 handle_command_reply: tid=0 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.524+0000 7f96c2a1a740 1 client.18225 shutdown 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.524+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 msgr2=0x55945a752750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.524+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a752750 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f96a800bab0 tx=0x7f96a8011630 comp rx=0 tx=0).stop 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 shutdown_connections 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7657e0 0x55945a767bd0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a752c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96a6a00640 0 client.18225 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/1692493166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a752750 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 >> 172.21.15.7:0/1692493166 conn(0x55945a7426c0 msgr2=0x55945a748530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 shutdown_connections 2024-04-23T15:23:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 1 -- 172.21.15.7:0/1692493166 wait complete. 2024-04-23T15:23:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.525+0000 7f96c2a1a740 20 client.18225 trim_cache size 0 max 16384 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 Processor -- start 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 -- start start 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a761290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a7416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 0x55945a76d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ad300 con 0x55945a7557a0 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81aee40 con 0x55945a7460d0 2024-04-23T15:23:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.545+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ad9d0 con 0x55945a7469f0 2024-04-23T15:23:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 0x55945a76d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 0x55945a76d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39124/0 (socket says 172.21.15.7:39124) 2024-04-23T15:23:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 -- 172.21.15.7:0/993902353 learned_addr learned my addr 172.21.15.7:0/993902353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bd200640 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a761290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96afe00640 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a7416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 -- 172.21.15.7:0/993902353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 msgr2=0x55945a7416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a7416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 -- 172.21.15.7:0/993902353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 msgr2=0x55945a761290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a761290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.546+0000 7f96bdc00640 1 -- 172.21.15.7:0/993902353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945a746820 con 0x55945a7557a0 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.547+0000 7f96bdc00640 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 0x55945a76d230 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f96b00eef00 tx=0x7f96b00bd580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfb5f5698752da2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.547+0000 7f96ad600640 1 -- 172.21.15.7:0/993902353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b00bd6f0 con 0x55945a7557a0 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.547+0000 7f96ad600640 1 -- 172.21.15.7:0/993902353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96b00c1aa0 con 0x55945a7557a0 2024-04-23T15:23:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.547+0000 7f96ad600640 1 -- 172.21.15.7:0/993902353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b00c5ed0 con 0x55945a7557a0 2024-04-23T15:23:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 -- 172.21.15.7:0/993902353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 msgr2=0x55945a76d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 0x55945a76d230 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f96b00eef00 tx=0x7f96b00bd580 comp rx=0 tx=0).stop 2024-04-23T15:23:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 -- 172.21.15.7:0/993902353 shutdown_connections 2024-04-23T15:23:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7557a0 0x55945a76d230 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a7416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/993902353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7460d0 0x55945a761290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 -- 172.21.15.7:0/993902353 >> 172.21.15.7:0/993902353 conn(0x55945a7426c0 msgr2=0x55945a740fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 -- 172.21.15.7:0/993902353 shutdown_connections 2024-04-23T15:23:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 -- 172.21.15.7:0/993902353 wait complete. 2024-04-23T15:23:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.548+0000 7f96c2a1a740 1 -- start start 2024-04-23T15:23:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 Processor -- start 2024-04-23T15:23:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a7595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a759b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ae770 con 0x55945a7460d0 2024-04-23T15:23:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ae0a0 con 0x55945a7557a0 2024-04-23T15:23:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ab300 con 0x55945a7469f0 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96c2a1a740 10 client.0 _ll_register_callbacks cb 0x7f96a800bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96bd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a7595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96bd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a7595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39130/0 (socket says 172.21.15.7:39130) 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.549+0000 7f96bd200640 1 -- 172.21.15.7:0/2389963396 learned_addr learned my addr 172.21.15.7:0/2389963396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bdc00640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96afe00640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a759b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bd200640 1 -- 172.21.15.7:0/2389963396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 msgr2=0x55945a759b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bd200640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a759b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bd200640 1 -- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 msgr2=0x55945a7caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bd200640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bd200640 1 -- 172.21.15.7:0/2389963396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945a48b620 con 0x55945a7460d0 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bdc00640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96bd200640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a7595c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f96a800bc90 tx=0x7f96a8005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3278b9c65e2ea3b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.550+0000 7f96a6a00640 1 -- 172.21.15.7:0/2389963396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8015070 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96a6a00640 1 -- 172.21.15.7:0/2389963396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 9555+0+0 (secure 0 0 0) 0x7f96a8011d60 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b00c1aa0 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96a6a00640 1 -- 172.21.15.7:0/2389963396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f96a8043050 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96c2a1a740 10 client.18231 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55945a7cbfc0 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96a6a00640 1 -- 172.21.15.7:0/2389963396 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96b00c1aa0 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.551+0000 7f96a6a00640 1 -- 172.21.15.7:0/2389963396 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f96a802c040 con 0x55945a7460d0 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96c2a1a740 10 client.18231 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96c2a1a740 10 client.18231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96c2a1a740 20 client.18231 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7cc6d0 0x55945a7ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96c2a1a740 4 client.18231 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:23:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55945a6b4190 con 0x55945a7cc6d0 2024-04-23T15:23:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.552+0000 7f96afe00640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7cc6d0 0x55945a7ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.553+0000 7f96afe00640 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7cc6d0 0x55945a7ceaf0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5ee6fab5a147601 server_cookie=9af7596dde458e4c in_seq=0 out_seq=0 2024-04-23T15:23:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.553+0000 7f96a6a00640 10 client.18231 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96a6a00640 1 -- 172.21.15.7:0/2389963396 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55945a6b4190 con 0x55945a7cc6d0 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96a6a00640 10 client.18231 handle_command_reply: tid=0 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 client.18231 shutdown 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 msgr2=0x55945a7595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a7595c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f96a800bc90 tx=0x7f96a8005b90 comp rx=0 tx=0).stop 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 shutdown_connections 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55945a7cc6d0 0x55945a7ceaf0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55945a7557a0 0x55945a7caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96a6a00640 0 client.18231 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55945a7469f0 0x55945a759b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 --2- 172.21.15.7:0/2389963396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55945a7460d0 0x55945a7595c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.596+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 >> 172.21.15.7:0/2389963396 conn(0x55945a7426c0 msgr2=0x55945a741840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.597+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 shutdown_connections 2024-04-23T15:23:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.597+0000 7f96c2a1a740 1 -- 172.21.15.7:0/2389963396 wait complete. 2024-04-23T15:23:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.597+0000 7f96c2a1a740 20 client.18231 trim_cache size 0 max 16384 2024-04-23T15:23:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:23:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:23:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f969c0a3dc0 msgr2=0x7f969c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f969c0a3dc0 0x7f969c0a6280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96a00058c0 tx=0x7f96a0005d10 comp rx=0 tx=0).stop 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 msgr2=0x7f96b819cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b819cfe0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f96b002f040 tx=0x7f96b002fbe0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 shutdown_connections 2024-04-23T15:23:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f969c0a3dc0 0x7f969c0a6280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96b810c5d0 0x7f96b819cfe0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96b8103bb0 0x7f96b8198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 --2- 172.21.15.7:0/3583336994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b8103290 0x7f96b8198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 >> 172.21.15.7:0/3583336994 conn(0x7f96b8078080 msgr2=0x7f96b80fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 shutdown_connections 2024-04-23T15:23:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:11.598+0000 7f96bfc00640 1 -- 172.21.15.7:0/3583336994 wait complete. 2024-04-23T15:23:12.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:12 smithi186 ceph-mon[31814]: pgmap v1007: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 38 op/s 2024-04-23T15:23:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:12 smithi137 ceph-mon[31694]: pgmap v1007: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 38 op/s 2024-04-23T15:23:12.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:12 smithi007 ceph-mon[27906]: pgmap v1007: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 38 op/s 2024-04-23T15:23:14.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:14 smithi186 ceph-mon[31814]: pgmap v1008: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:23:14.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:14 smithi137 ceph-mon[31694]: pgmap v1008: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:23:14.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:14 smithi007 ceph-mon[27906]: pgmap v1008: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:23:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:16 smithi007 ceph-mon[27906]: pgmap v1009: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:23:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:16 smithi007 ceph-mon[27906]: osdmap e144: 12 total, 12 up, 12 in 2024-04-23T15:23:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:16 smithi186 ceph-mon[31814]: pgmap v1009: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:23:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:16 smithi186 ceph-mon[31814]: osdmap e144: 12 total, 12 up, 12 in 2024-04-23T15:23:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:16 smithi137 ceph-mon[31694]: pgmap v1009: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:23:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:16 smithi137 ceph-mon[31694]: osdmap e144: 12 total, 12 up, 12 in 2024-04-23T15:23:19.220 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:18 smithi137 ceph-mon[31694]: pgmap v1011: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 18 op/s 2024-04-23T15:23:19.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:18 smithi007 ceph-mon[27906]: pgmap v1011: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 18 op/s 2024-04-23T15:23:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:18 smithi186 ceph-mon[31814]: pgmap v1011: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.8 MiB/s wr, 18 op/s 2024-04-23T15:23:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:20 smithi137 ceph-mon[31694]: pgmap v1012: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:23:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:20 smithi007 ceph-mon[27906]: pgmap v1012: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:23:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:20 smithi186 ceph-mon[31814]: pgmap v1012: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:23:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:22 smithi007 ceph-mon[27906]: pgmap v1013: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:23:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:22 smithi186 ceph-mon[31814]: pgmap v1013: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:23:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:22 smithi137 ceph-mon[31694]: pgmap v1013: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 16 op/s 2024-04-23T15:23:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 -- 172.21.15.7:0/1835406216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103bb0 msgr2=0x7f091010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 --2- 172.21.15.7:0/1835406216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103bb0 0x7f091010c090 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009900 tx=0x7f08f802a510 comp rx=0 tx=0).stop 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 -- 172.21.15.7:0/1835406216 shutdown_connections 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 --2- 172.21.15.7:0/1835406216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f091010c5d0 0x7f091010ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 --2- 172.21.15.7:0/1835406216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103bb0 0x7f091010c090 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 --2- 172.21.15.7:0/1835406216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0910103290 0x7f0910103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 -- 172.21.15.7:0/1835406216 >> 172.21.15.7:0/1835406216 conn(0x7f0910078080 msgr2=0x7f0910078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.750+0000 7f0915e00640 1 -- 172.21.15.7:0/1835406216 shutdown_connections 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.751+0000 7f0915e00640 1 -- 172.21.15.7:0/1835406216 wait complete. 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 Processor -- start 2024-04-23T15:23:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 -- start start 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 0x7f0910100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0910103bb0 0x7f0910101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f091010c5d0 0x7f0910101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0910112260 con 0x7f0910103290 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09101120e0 con 0x7f091010c5d0 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.752+0000 7f0915e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f09101123e0 con 0x7f0910103bb0 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 0x7f0910100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 0x7f0910100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39866/0 (socket says 172.21.15.7:39866) 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 -- 172.21.15.7:0/4005844952 learned_addr learned my addr 172.21.15.7:0/4005844952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090e000640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0910103bb0 0x7f0910101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 -- 172.21.15.7:0/4005844952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0910103bb0 msgr2=0x7f0910101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0910103bb0 0x7f0910101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 -- 172.21.15.7:0/4005844952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f091010c5d0 msgr2=0x7f0910101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090f400640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f091010c5d0 0x7f0910101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f091010c5d0 0x7f0910101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090ea00640 1 -- 172.21.15.7:0/4005844952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09101a6c40 con 0x7f0910103290 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.753+0000 7f090f400640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f091010c5d0 0x7f0910101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.754+0000 7f090ea00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 0x7f0910100ee0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f090000eab0 tx=0x7f090000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.754+0000 7f0914a00640 1 -- 172.21.15.7:0/4005844952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090000ce40 con 0x7f0910103290 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.754+0000 7f0914a00640 1 -- 172.21.15.7:0/4005844952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0900011920 con 0x7f0910103290 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.754+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09101a6f30 con 0x7f0910103290 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.754+0000 7f0914a00640 1 -- 172.21.15.7:0/4005844952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900010a00 con 0x7f0910103290 2024-04-23T15:23:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.754+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09101a73a0 con 0x7f0910103290 2024-04-23T15:23:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.758+0000 7f0914a00640 1 -- 172.21.15.7:0/4005844952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0900011ad0 con 0x7f0910103290 2024-04-23T15:23:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.758+0000 7f0918d89740 1 Processor -- start 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.758+0000 7f0918d89740 1 -- start start 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f0918d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 0x563f2c1c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f0918d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f0918d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f0918d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f2c12a900 con 0x563f2c1c41b0 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f0918d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f2c0d0f20 con 0x563f2c1c4ad0 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f0918d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563f2c1268c0 con 0x563f2c1cf390 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f090f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 0x563f2c1c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f090f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 0x563f2c1c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39868/0 (socket says 172.21.15.7:39868) 2024-04-23T15:23:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f090f400640 1 -- 172.21.15.7:0/2112339132 learned_addr learned my addr 172.21.15.7:0/2112339132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f090ea00640 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.759+0000 7f090e000640 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090f400640 1 -- 172.21.15.7:0/2112339132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 msgr2=0x563f2c1d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090f400640 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090f400640 1 -- 172.21.15.7:0/2112339132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c4ad0 msgr2=0x563f2c1cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090f400640 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090f400640 1 -- 172.21.15.7:0/2112339132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2c0f5e10 con 0x563f2c1c41b0 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f0914a00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08f40a3df0 0x7f08f40a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f0914a00640 1 -- 172.21.15.7:0/4005844952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7f09000d12c0 con 0x7f0910103290 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090ea00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08f40a3df0 0x7f08f40a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.760+0000 7f090f400640 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 0x563f2c1c4590 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0908009b50 tx=0x7f090800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7d882dd6f94940 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.761+0000 7f08ffe00640 1 -- 172.21.15.7:0/2112339132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908016070 con 0x563f2c1c41b0 2024-04-23T15:23:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.761+0000 7f08ffe00640 1 -- 172.21.15.7:0/2112339132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0908009e40 con 0x563f2c1c41b0 2024-04-23T15:23:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.761+0000 7f08ffe00640 1 -- 172.21.15.7:0/2112339132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908010790 con 0x563f2c1c41b0 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 -- 172.21.15.7:0/2112339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 msgr2=0x563f2c1c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f090ea00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08f40a3df0 0x7f08f40a62b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x563f2c1c5750 tx=0x7f09000d4d70 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 0x563f2c1c4590 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0908009b50 tx=0x7f090800e6c0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 -- 172.21.15.7:0/2112339132 shutdown_connections 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 --2- 172.21.15.7:0/2112339132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c41b0 0x563f2c1c4590 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 -- 172.21.15.7:0/2112339132 >> 172.21.15.7:0/2112339132 conn(0x563f2c1c06c0 msgr2=0x563f2c1c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 -- 172.21.15.7:0/2112339132 shutdown_connections 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 -- 172.21.15.7:0/2112339132 wait complete. 2024-04-23T15:23:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.762+0000 7f0918d89740 1 -- start start 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 Processor -- start 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1c41b0 0x563f2c1cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1cf390 0x563f2c1ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f2c1d1fc0 con 0x563f2c1c4ad0 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f2c0e42c0 con 0x563f2c1cf390 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563f2c1d2140 con 0x563f2c1c41b0 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.763+0000 7f0918d89740 10 client.0 _ll_register_callbacks cb 0x563f2be3ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39884/0 (socket says 172.21.15.7:39884) 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 -- 172.21.15.7:0/184591237 learned_addr learned my addr 172.21.15.7:0/184591237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090f400640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1c41b0 0x563f2c1cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 -- 172.21.15.7:0/184591237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1c41b0 msgr2=0x563f2c1cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1c41b0 0x563f2c1cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090f400640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1cf390 0x563f2c1ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 -- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1cf390 msgr2=0x563f2c1ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1cf390 0x563f2c1ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090e000640 1 -- 172.21.15.7:0/184591237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2c0f4fd0 con 0x563f2c1c4ad0 2024-04-23T15:23:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.764+0000 7f090f400640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1cf390 0x563f2c1ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f090e000640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cc800 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009900 tx=0x7f08f80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12c63fd6e03694c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f08fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f08fcc00640 1 -- 172.21.15.7:0/184591237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8035030 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f08fcc00640 1 -- 172.21.15.7:0/184591237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7f08f8004460 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f2c138320 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f08fcc00640 1 -- 172.21.15.7:0/184591237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f08f804c050 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f0918d89740 10 client.18243 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.765+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f2be3d210 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f08fcc00640 1 -- 172.21.15.7:0/184591237 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x563f2c138320 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f08fcc00640 1 -- 172.21.15.7:0/184591237 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f08f8004a90 con 0x563f2c1c4ad0 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f0918d89740 10 client.18243 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f0918d89740 10 client.18243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f0918d89740 20 client.18243 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f0918d89740 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c1df4c0 0x563f2c1e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f0918d89740 4 client.18243 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:23:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.766+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f2c132190 con 0x563f2c1df4c0 2024-04-23T15:23:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.767+0000 7f090f400640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c1df4c0 0x563f2c1e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.768+0000 7f090f400640 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c1df4c0 0x563f2c1e18f0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f0838932d6d583 server_cookie=80fd752bfc3bb293 in_seq=0 out_seq=0 2024-04-23T15:23:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.768+0000 7f08fcc00640 10 client.18243 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f08fcc00640 1 -- 172.21.15.7:0/184591237 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563f2c132190 con 0x563f2c1df4c0 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f08fcc00640 10 client.18243 handle_command_reply: tid=0 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 client.18243 shutdown 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 msgr2=0x563f2c1cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cc800 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009900 tx=0x7f08f80316d0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 shutdown_connections 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c1df4c0 0x563f2c1e18f0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1cf390 0x563f2c1ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1cc800 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 --2- 172.21.15.7:0/184591237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1c41b0 0x563f2c1cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f08fcc00640 0 client.18243 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 >> 172.21.15.7:0/184591237 conn(0x563f2c1c06c0 msgr2=0x563f2c1c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 shutdown_connections 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 1 -- 172.21.15.7:0/184591237 wait complete. 2024-04-23T15:23:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.770+0000 7f0918d89740 20 client.18243 trim_cache size 0 max 16384 2024-04-23T15:23:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 Processor -- start 2024-04-23T15:23:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 -- start start 2024-04-23T15:23:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c1dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1e7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09101b1540 con 0x563f2c1c4ad0 2024-04-23T15:23:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09101b3080 con 0x563f2c1c41b0 2024-04-23T15:23:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.796+0000 7f0918d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f09101b1c10 con 0x563f2c1cf390 2024-04-23T15:23:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.797+0000 7f090f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c1dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.797+0000 7f090f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c1dae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45920/0 (socket says 172.21.15.7:45920) 2024-04-23T15:23:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.797+0000 7f090f400640 1 -- 172.21.15.7:0/659957896 learned_addr learned my addr 172.21.15.7:0/659957896 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.797+0000 7f090f400640 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.798+0000 7f090e000640 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.798+0000 7f090e000640 1 -- 172.21.15.7:0/659957896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 msgr2=0x563f2c1e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.798+0000 7f090e000640 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.798+0000 7f090e000640 1 -- 172.21.15.7:0/659957896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 msgr2=0x563f2c1dae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.798+0000 7f090e000640 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c1dae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.798+0000 7f090e000640 1 -- 172.21.15.7:0/659957896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2bf09620 con 0x563f2c1c4ad0 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.799+0000 7f090e000640 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1c6b70 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f08f8031440 tx=0x7f08f802ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b9508179c5f222 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.799+0000 7f08ff400640 1 -- 172.21.15.7:0/659957896 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8055070 con 0x563f2c1c4ad0 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.799+0000 7f08ff400640 1 -- 172.21.15.7:0/659957896 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08f803f070 con 0x563f2c1c4ad0 2024-04-23T15:23:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.799+0000 7f08ff400640 1 -- 172.21.15.7:0/659957896 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8035050 con 0x563f2c1c4ad0 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.800+0000 7f0918d89740 1 -- 172.21.15.7:0/659957896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 msgr2=0x563f2c1c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.800+0000 7f0918d89740 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1c6b70 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f08f8031440 tx=0x7f08f802ab90 comp rx=0 tx=0).stop 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.800+0000 7f0918d89740 1 -- 172.21.15.7:0/659957896 shutdown_connections 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.800+0000 7f0918d89740 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c1e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.800+0000 7f0918d89740 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1c4ad0 0x563f2c1c6b70 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.800+0000 7f0918d89740 1 --2- 172.21.15.7:0/659957896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c1dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.801+0000 7f0918d89740 1 -- 172.21.15.7:0/659957896 >> 172.21.15.7:0/659957896 conn(0x563f2c1c06c0 msgr2=0x563f2c1ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.801+0000 7f0918d89740 1 -- 172.21.15.7:0/659957896 shutdown_connections 2024-04-23T15:23:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.801+0000 7f0918d89740 1 -- 172.21.15.7:0/659957896 wait complete. 2024-04-23T15:23:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.801+0000 7f0918d89740 1 -- start start 2024-04-23T15:23:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.802+0000 7f0918d89740 1 Processor -- start 2024-04-23T15:23:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c240fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c2414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 0x563f2c23e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09101b29b0 con 0x563f2c1d74f0 2024-04-23T15:23:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09101b22e0 con 0x563f2c1c41b0 2024-04-23T15:23:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f09101af540 con 0x563f2c1cf390 2024-04-23T15:23:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f0918d89740 10 client.0 _ll_register_callbacks cb 0x7f08f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f090f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 0x563f2c23e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f090f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 0x563f2c23e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39894/0 (socket says 172.21.15.7:39894) 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f090f400640 1 -- 172.21.15.7:0/2332560262 learned_addr learned my addr 172.21.15.7:0/2332560262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.803+0000 7f090e000640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c2414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c240fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 -- 172.21.15.7:0/2332560262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 msgr2=0x563f2c2414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c2414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 -- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 msgr2=0x563f2c240fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c240fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 -- 172.21.15.7:0/2332560262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2c1d7c00 con 0x563f2c1d74f0 2024-04-23T15:23:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f090f400640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 0x563f2c23e290 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f090800f010 tx=0x7f0908009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7a4b41fbde4cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.804+0000 7f08fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.805+0000 7f08fcc00640 1 -- 172.21.15.7:0/2332560262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908016050 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.805+0000 7f08fcc00640 1 -- 172.21.15.7:0/2332560262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7f0908011470 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.805+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f803f070 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.805+0000 7f08fcc00640 1 -- 172.21.15.7:0/2332560262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f090803c050 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.805+0000 7f0918d89740 10 client.18249 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.805+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f2c24e800 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f08fcc00640 1 -- 172.21.15.7:0/2332560262 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08f803f070 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f08fcc00640 1 -- 172.21.15.7:0/2332560262 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f090800f040 con 0x563f2c1d74f0 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f0918d89740 10 client.18249 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f0918d89740 10 client.18249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f0918d89740 20 client.18249 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f0918d89740 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c24ecd0 0x563f2c2510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f0918d89740 4 client.18249 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:23:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.806+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f2c0ae4b0 con 0x563f2c24ecd0 2024-04-23T15:23:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.807+0000 7f090e000640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c24ecd0 0x563f2c2510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.808+0000 7f090e000640 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c24ecd0 0x563f2c2510f0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8595a80e326e62a server_cookie=97ffefafe7a4c055 in_seq=0 out_seq=0 2024-04-23T15:23:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.808+0000 7f08fcc00640 10 client.18249 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.849+0000 7f08fcc00640 1 -- 172.21.15.7:0/2332560262 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f2c0ae4b0 con 0x563f2c24ecd0 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.849+0000 7f08fcc00640 10 client.18249 handle_command_reply: tid=0 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.849+0000 7f0918d89740 1 client.18249 shutdown 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 msgr2=0x563f2c23e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 0x563f2c23e290 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f090800f010 tx=0x7f0908009460 comp rx=0 tx=0).stop 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 shutdown_connections 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f2c24ecd0 0x563f2c2510f0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f2c1d74f0 0x563f2c23e290 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f2c1cf390 0x563f2c2414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 --2- 172.21.15.7:0/2332560262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f2c1c41b0 0x563f2c240fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 >> 172.21.15.7:0/2332560262 conn(0x563f2c1c06c0 msgr2=0x563f2c1cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f08fcc00640 0 client.18249 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 shutdown_connections 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 1 -- 172.21.15.7:0/2332560262 wait complete. 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.850+0000 7f0918d89740 20 client.18249 trim_cache size 0 max 16384 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:23:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08f40a3df0 msgr2=0x7f08f40a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08f40a3df0 0x7f08f40a62b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x563f2c1c5750 tx=0x7f09000d4d70 comp rx=0 tx=0).stop 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 msgr2=0x7f0910100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 0x7f0910100ee0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f090000eab0 tx=0x7f090000ef70 comp rx=0 tx=0).stop 2024-04-23T15:23:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 shutdown_connections 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f08f40a3df0 0x7f08f40a62b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f091010c5d0 0x7f0910101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0910103bb0 0x7f0910101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 --2- 172.21.15.7:0/4005844952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0910103290 0x7f0910100ee0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.851+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 >> 172.21.15.7:0/4005844952 conn(0x7f0910078080 msgr2=0x7f09100fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.852+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 shutdown_connections 2024-04-23T15:23:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:24.852+0000 7f0915e00640 1 -- 172.21.15.7:0/4005844952 wait complete. 2024-04-23T15:23:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:24 smithi007 ceph-mon[27906]: pgmap v1014: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:23:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:24 smithi186 ceph-mon[31814]: pgmap v1014: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:23:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:24 smithi137 ceph-mon[31694]: pgmap v1014: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:23:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:26 smithi007 ceph-mon[27906]: pgmap v1015: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:23:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:26 smithi186 ceph-mon[31814]: pgmap v1015: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:23:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:26 smithi137 ceph-mon[31694]: pgmap v1015: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:23:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:28 smithi007 ceph-mon[27906]: pgmap v1016: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 24 op/s 2024-04-23T15:23:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:28 smithi186 ceph-mon[31814]: pgmap v1016: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 24 op/s 2024-04-23T15:23:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:28 smithi137 ceph-mon[31694]: pgmap v1016: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 24 op/s 2024-04-23T15:23:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:30 smithi007 ceph-mon[27906]: pgmap v1017: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:31.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:30 smithi186 ceph-mon[31814]: pgmap v1017: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:30 smithi137 ceph-mon[31694]: pgmap v1017: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:33.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:32 smithi007 ceph-mon[27906]: pgmap v1018: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:33.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:32 smithi186 ceph-mon[31814]: pgmap v1018: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:32 smithi137 ceph-mon[31694]: pgmap v1018: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:35.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:34 smithi007 ceph-mon[27906]: pgmap v1019: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:23:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:34 smithi186 ceph-mon[31814]: pgmap v1019: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:23:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:34 smithi137 ceph-mon[31694]: pgmap v1019: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:23:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:36 smithi007 ceph-mon[27906]: pgmap v1020: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:23:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:36 smithi186 ceph-mon[31814]: pgmap v1020: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:23:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:36 smithi137 ceph-mon[31694]: pgmap v1020: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 -- 172.21.15.7:0/4278165163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2750108fb0 msgr2=0x7f27501154c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 --2- 172.21.15.7:0/4278165163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2750108fb0 0x7f27501154c0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f2748009930 tx=0x7f274802a420 comp rx=0 tx=0).stop 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 -- 172.21.15.7:0/4278165163 shutdown_connections 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 --2- 172.21.15.7:0/4278165163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2750108fb0 0x7f27501154c0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 --2- 172.21.15.7:0/4278165163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27501085f0 0x7f2750108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 --2- 172.21.15.7:0/4278165163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f275010e690 0x7f275010ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 -- 172.21.15.7:0/4278165163 >> 172.21.15.7:0/4278165163 conn(0x7f2750076590 msgr2=0x7f27500789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 -- 172.21.15.7:0/4278165163 shutdown_connections 2024-04-23T15:23:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.002+0000 7f2755c00640 1 -- 172.21.15.7:0/4278165163 wait complete. 2024-04-23T15:23:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 Processor -- start 2024-04-23T15:23:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 -- start start 2024-04-23T15:23:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27501085f0 0x7f27501a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2750108fb0 0x7f27501a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 0x7f275019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2750118910 con 0x7f275010e690 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2750118790 con 0x7f2750108fb0 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.003+0000 7f2755c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2750118a90 con 0x7f27501085f0 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 0x7f275019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 0x7f275019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50668/0 (socket says 172.21.15.7:50668) 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 -- 172.21.15.7:0/221071831 learned_addr learned my addr 172.21.15.7:0/221071831 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274ea00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27501085f0 0x7f27501a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f2746000640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2750108fb0 0x7f27501a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 -- 172.21.15.7:0/221071831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27501085f0 msgr2=0x7f27501a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27501085f0 0x7f27501a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 -- 172.21.15.7:0/221071831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2750108fb0 msgr2=0x7f27501a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2750108fb0 0x7f27501a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f274f400640 1 -- 172.21.15.7:0/221071831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275019f250 con 0x7f275010e690 2024-04-23T15:23:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.004+0000 7f2746000640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2750108fb0 0x7f27501a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.005+0000 7f274f400640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 0x7f275019ead0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f274802a940 tx=0x7f2748003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.005+0000 7f2747e00640 1 -- 172.21.15.7:0/221071831 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274803f070 con 0x7f275010e690 2024-04-23T15:23:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.005+0000 7f2747e00640 1 -- 172.21.15.7:0/221071831 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2748003e40 con 0x7f275010e690 2024-04-23T15:23:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.005+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275019f4e0 con 0x7f275010e690 2024-04-23T15:23:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.005+0000 7f2747e00640 1 -- 172.21.15.7:0/221071831 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748035030 con 0x7f275010e690 2024-04-23T15:23:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.005+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27501ab7e0 con 0x7f275010e690 2024-04-23T15:23:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.010+0000 7f27589f8740 1 Processor -- start 2024-04-23T15:23:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.010+0000 7f2747e00640 1 -- 172.21.15.7:0/221071831 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2748042070 con 0x7f275010e690 2024-04-23T15:23:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.010+0000 7f27589f8740 1 -- start start 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f27589f8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658c1b0 0x55d81658c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f27589f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d816596e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f27589f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 0x55d816599780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f27589f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d8164f2900 con 0x55d816597390 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f27589f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d816498f20 con 0x55d81658cad0 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f27589f8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8164ee8c0 con 0x55d81658c1b0 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f2746000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 0x55d816599780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f2746000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 0x55d816599780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50680/0 (socket says 172.21.15.7:50680) 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f2746000640 1 -- 172.21.15.7:0/1100549588 learned_addr learned my addr 172.21.15.7:0/1100549588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f274ea00640 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d816596e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.011+0000 7f2746000640 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658c1b0 0x55d81658c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2746000640 1 -- 172.21.15.7:0/1100549588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658c1b0 msgr2=0x55d81658c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2746000640 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658c1b0 0x55d81658c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2746000640 1 -- 172.21.15.7:0/1100549588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 msgr2=0x55d816596e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2746000640 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d816596e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2746000640 1 -- 172.21.15.7:0/1100549588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8164bde10 con 0x55d816597390 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2746000640 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 0x55d816599780 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2738012440 tx=0x7f273800b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f2fa6966616798 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f273fe00640 1 -- 172.21.15.7:0/1100549588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273800e410 con 0x55d816597390 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f2747e00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f27340a3dc0 0x7f27340a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f273fe00640 1 -- 172.21.15.7:0/1100549588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f273800ea60 con 0x55d816597390 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.012+0000 7f273fe00640 1 -- 172.21.15.7:0/1100549588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738010a40 con 0x55d816597390 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f2747e00640 1 -- 172.21.15.7:0/221071831 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7f27480f1170 con 0x7f275010e690 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f274ea00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f27340a3dc0 0x7f27340a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 -- 172.21.15.7:0/1100549588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 msgr2=0x55d816599780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 0x55d816599780 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2738012440 tx=0x7f273800b400 comp rx=0 tx=0).stop 2024-04-23T15:23:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 -- 172.21.15.7:0/1100549588 shutdown_connections 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d816596e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d816597390 0x55d816599780 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 --2- 172.21.15.7:0/1100549588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658c1b0 0x55d81658c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.013+0000 7f27589f8740 1 -- 172.21.15.7:0/1100549588 >> 172.21.15.7:0/1100549588 conn(0x55d8165886c0 msgr2=0x55d816588aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.014+0000 7f27589f8740 1 -- 172.21.15.7:0/1100549588 shutdown_connections 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.014+0000 7f274ea00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f27340a3dc0 0x7f27340a6280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55d81658d750 tx=0x7f27400097c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:38.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.014+0000 7f27589f8740 1 -- 172.21.15.7:0/1100549588 wait complete. 2024-04-23T15:23:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.014+0000 7f27589f8740 1 -- start start 2024-04-23T15:23:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.014+0000 7f27589f8740 1 Processor -- start 2024-04-23T15:23:38.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816594320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816594860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d816594da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d816599fc0 con 0x55d81658c1b0 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8164ac2c0 con 0x55d816597390 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d81659a140 con 0x55d81658cad0 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f27589f8740 10 client.0 _ll_register_callbacks cb 0x55d816204a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f274ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816594320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f274ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816594320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50690/0 (socket says 172.21.15.7:50690) 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.015+0000 7f274ea00640 1 -- 172.21.15.7:0/3743308434 learned_addr learned my addr 172.21.15.7:0/3743308434 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274f400640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d816594da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f2746000640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816594860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274ea00640 1 -- 172.21.15.7:0/3743308434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 msgr2=0x55d816594860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274ea00640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816594860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274ea00640 1 -- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 msgr2=0x55d816594da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274ea00640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d816594da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274ea00640 1 -- 172.21.15.7:0/3743308434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8164bcfd0 con 0x55d81658c1b0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f2746000640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816594860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f274ea00640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816594320 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2740011cd0 tx=0x7f2740004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2776d597b7a6f012 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.016+0000 7f273cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f273cc00640 1 -- 172.21.15.7:0/3743308434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740020620 con 0x55d81658c1b0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f273cc00640 1 -- 172.21.15.7:0/3743308434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7f27400207c0 con 0x55d81658c1b0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f273800ea60 con 0x55d81658c1b0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f273cc00640 1 -- 172.21.15.7:0/3743308434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2740033050 con 0x55d81658c1b0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f27589f8740 10 client.18261 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d816205210 con 0x55d81658c1b0 2024-04-23T15:23:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.017+0000 7f273cc00640 1 -- 172.21.15.7:0/3743308434 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f273800ea60 con 0x55d81658c1b0 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f273cc00640 1 -- 172.21.15.7:0/3743308434 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f274000f040 con 0x55d81658c1b0 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f27589f8740 10 client.18261 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f27589f8740 10 client.18261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f27589f8740 20 client.18261 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f27589f8740 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8165a75d0 0x55d8165a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f27589f8740 4 client.18261 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d816500320 con 0x55d8165a75d0 2024-04-23T15:23:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.018+0000 7f2746000640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8165a75d0 0x55d8165a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.019+0000 7f273cc00640 10 client.18261 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.019+0000 7f2746000640 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8165a75d0 0x55d8165a9a40 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8806ec50e0da02 server_cookie=29295a180f0f0075 in_seq=0 out_seq=0 2024-04-23T15:23:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f273cc00640 1 -- 172.21.15.7:0/3743308434 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d816500320 con 0x55d8165a75d0 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f273cc00640 10 client.18261 handle_command_reply: tid=0 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f27589f8740 1 client.18261 shutdown 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 msgr2=0x55d816594320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f27589f8740 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816594320 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2740011cd0 tx=0x7f2740004a40 comp rx=0 tx=0).stop 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 shutdown_connections 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.021+0000 7f27589f8740 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d8165a75d0 0x55d8165a9a40 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d816594da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816594860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 1 --2- 172.21.15.7:0/3743308434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816594320 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 >> 172.21.15.7:0/3743308434 conn(0x55d8165886c0 msgr2=0x55d81658e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f273cc00640 0 client.18261 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 shutdown_connections 2024-04-23T15:23:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 1 -- 172.21.15.7:0/3743308434 wait complete. 2024-04-23T15:23:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.022+0000 7f27589f8740 20 client.18261 trim_cache size 0 max 16384 2024-04-23T15:23:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 Processor -- start 2024-04-23T15:23:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 -- start start 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d8165a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816596260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d8165af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27501b5900 con 0x55d81658c1b0 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27501b7440 con 0x55d816597390 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.045+0000 7f27589f8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f27501b5fd0 con 0x55d81658cad0 2024-04-23T15:23:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d8165a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d8165a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50706/0 (socket says 172.21.15.7:50706) 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 -- 172.21.15.7:0/1652447358 learned_addr learned my addr 172.21.15.7:0/1652447358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f2746000640 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816596260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274f400640 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d8165af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 -- 172.21.15.7:0/1652447358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 msgr2=0x55d816596260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816596260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 -- 172.21.15.7:0/1652447358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 msgr2=0x55d8165af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d8165af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 -- 172.21.15.7:0/1652447358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8162d1620 con 0x55d81658c1b0 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274f400640 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d8165af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.046+0000 7f274ea00640 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d8165a2e80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2740013d80 tx=0x7f2740009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe23d7b5cdd50bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.047+0000 7f273f400640 1 -- 172.21.15.7:0/1652447358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274003b070 con 0x55d81658c1b0 2024-04-23T15:23:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.047+0000 7f273f400640 1 -- 172.21.15.7:0/1652447358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2740011860 con 0x55d81658c1b0 2024-04-23T15:23:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.047+0000 7f273f400640 1 -- 172.21.15.7:0/1652447358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740003990 con 0x55d81658c1b0 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 -- 172.21.15.7:0/1652447358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 msgr2=0x55d8165a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d8165a2e80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2740013d80 tx=0x7f2740009e70 comp rx=0 tx=0).stop 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 -- 172.21.15.7:0/1652447358 shutdown_connections 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d816597390 0x55d8165af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d81658cad0 0x55d816596260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 --2- 172.21.15.7:0/1652447358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d8165a2e80 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 -- 172.21.15.7:0/1652447358 >> 172.21.15.7:0/1652447358 conn(0x55d8165886c0 msgr2=0x55d816595b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 -- 172.21.15.7:0/1652447358 shutdown_connections 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 -- 172.21.15.7:0/1652447358 wait complete. 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.048+0000 7f27589f8740 1 -- start start 2024-04-23T15:23:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 Processor -- start 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816591370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d8165918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d816597390 0x55d81660cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27501b6d70 con 0x55d81658c1b0 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27501b66a0 con 0x55d81658cad0 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f27501b3900 con 0x55d816597390 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f27589f8740 10 client.0 _ll_register_callbacks cb 0x7f2740009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.049+0000 7f274ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816591370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816591370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50712/0 (socket says 172.21.15.7:50712) 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 -- 172.21.15.7:0/3638039949 learned_addr learned my addr 172.21.15.7:0/3638039949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274f400640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d816597390 0x55d81660cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f2746000640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d8165918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 -- 172.21.15.7:0/3638039949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d816597390 msgr2=0x55d81660cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d816597390 0x55d81660cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 -- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 msgr2=0x55d8165918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d8165918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 -- 172.21.15.7:0/3638039949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d816592180 con 0x55d81658c1b0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f274ea00640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816591370 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2740018040 tx=0x7f274001fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5720de5181455807 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.050+0000 7f273cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f273cc00640 1 -- 172.21.15.7:0/3638039949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740045020 con 0x55d81658c1b0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f273cc00640 1 -- 172.21.15.7:0/3638039949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7f2740004a40 con 0x55d81658c1b0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8164fa190 con 0x55d81658c1b0 2024-04-23T15:23:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f273cc00640 1 -- 172.21.15.7:0/3638039949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2740050050 con 0x55d81658c1b0 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f27589f8740 10 client.18267 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d81660e150 con 0x55d81658c1b0 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.051+0000 7f273cc00640 1 -- 172.21.15.7:0/3638039949 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d8164fa190 con 0x55d81658c1b0 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f273cc00640 1 -- 172.21.15.7:0/3638039949 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2740004330 con 0x55d81658c1b0 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f27589f8740 10 client.18267 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f27589f8740 10 client.18267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f27589f8740 20 client.18267 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f27589f8740 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d81660e7e0 0x55d816610c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f27589f8740 4 client.18267 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8164764b0 con 0x55d81660e7e0 2024-04-23T15:23:38.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.052+0000 7f2746000640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d81660e7e0 0x55d816610c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:38.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.053+0000 7f2746000640 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d81660e7e0 0x55d816610c00 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d00570756a220855 server_cookie=138f3f7774e2d4c2 in_seq=0 out_seq=0 2024-04-23T15:23:38.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.053+0000 7f273cc00640 10 client.18267 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f273cc00640 1 -- 172.21.15.7:0/3638039949 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8164764b0 con 0x55d81660e7e0 2024-04-23T15:23:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f273cc00640 10 client.18267 handle_command_reply: tid=0 2024-04-23T15:23:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 client.18267 shutdown 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 msgr2=0x55d816591370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816591370 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2740018040 tx=0x7f274001fd50 comp rx=0 tx=0).stop 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 shutdown_connections 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d81660e7e0 0x55d816610c00 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d81658cad0 0x55d8165918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d816597390 0x55d81660cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f273cc00640 0 client.18267 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 --2- 172.21.15.7:0/3638039949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d81658c1b0 0x55d816591370 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 >> 172.21.15.7:0/3638039949 conn(0x55d8165886c0 msgr2=0x55d816586fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.093+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 shutdown_connections 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.094+0000 7f27589f8740 1 -- 172.21.15.7:0/3638039949 wait complete. 2024-04-23T15:23:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.094+0000 7f27589f8740 20 client.18267 trim_cache size 0 max 16384 2024-04-23T15:23:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:23:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:23:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:23:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f27340a3dc0 msgr2=0x7f27340a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f27340a3dc0 0x7f27340a6280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55d81658d750 tx=0x7f27400097c0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 msgr2=0x7f275019ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 0x7f275019ead0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f274802a940 tx=0x7f2748003cd0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 shutdown_connections 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f27340a3dc0 0x7f27340a6280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2750108fb0 0x7f27501a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f275010e690 0x7f275019ead0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 --2- 172.21.15.7:0/221071831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27501085f0 0x7f27501a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 >> 172.21.15.7:0/221071831 conn(0x7f2750076590 msgr2=0x7f2750077ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 shutdown_connections 2024-04-23T15:23:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:38.095+0000 7f2755c00640 1 -- 172.21.15.7:0/221071831 wait complete. 2024-04-23T15:23:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:38 smithi007 ceph-mon[27906]: pgmap v1021: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:23:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:38 smithi186 ceph-mon[31814]: pgmap v1021: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:23:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:38 smithi137 ceph-mon[31694]: pgmap v1021: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:23:41.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:40 smithi007 ceph-mon[27906]: pgmap v1022: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:23:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:40 smithi186 ceph-mon[31814]: pgmap v1022: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:23:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:40 smithi137 ceph-mon[31694]: pgmap v1022: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:23:42.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:42 smithi007 ceph-mon[27906]: pgmap v1023: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:23:42.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:42 smithi186 ceph-mon[31814]: pgmap v1023: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:23:42.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:42 smithi137 ceph-mon[31694]: pgmap v1023: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:23:44.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:44 smithi007 ceph-mon[27906]: pgmap v1024: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:23:44.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:44 smithi186 ceph-mon[31814]: pgmap v1024: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:23:44.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:44 smithi137 ceph-mon[31694]: pgmap v1024: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:23:46.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:46 smithi007 ceph-mon[27906]: pgmap v1025: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:46.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:46 smithi186 ceph-mon[31814]: pgmap v1025: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:46.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:46 smithi137 ceph-mon[31694]: pgmap v1025: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:48.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:48 smithi007 ceph-mon[27906]: pgmap v1026: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:23:48.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:48 smithi186 ceph-mon[31814]: pgmap v1026: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:23:48.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:48 smithi137 ceph-mon[31694]: pgmap v1026: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:23:50.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:50 smithi007 ceph-mon[27906]: pgmap v1027: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:50.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:50 smithi186 ceph-mon[31814]: pgmap v1027: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:50.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:50 smithi137 ceph-mon[31694]: pgmap v1027: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3663288599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 msgr2=0x7fc9c01128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3663288599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01128e0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009900 tx=0x7fc9ac02a480 comp rx=0 tx=0).stop 2024-04-23T15:23:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3663288599 shutdown_connections 2024-04-23T15:23:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3663288599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9c0112e20 0x7fc9c0115210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3663288599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01128e0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3663288599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 0x7fc9c0074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3663288599 >> 172.21.15.7:0/3663288599 conn(0x7fc9c00fd940 msgr2=0x7fc9c00ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3663288599 shutdown_connections 2024-04-23T15:23:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.252+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3663288599 wait complete. 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.253+0000 7fc9c4a00640 1 Processor -- start 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.253+0000 7fc9c4a00640 1 -- start start 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 0x7fc9c01a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9c0112e20 0x7fc9c019eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9c4a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01186a0 con 0x7fc9c0074cc0 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9c4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0118520 con 0x7fc9c0112e20 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9c4a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0118820 con 0x7fc9c00743a0 2024-04-23T15:23:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41006/0 (socket says 172.21.15.7:41006) 2024-04-23T15:23:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.254+0000 7fc9bea00640 1 -- 172.21.15.7:0/3976172535 learned_addr learned my addr 172.21.15.7:0/3976172535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9c0112e20 0x7fc9c019eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bf400640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 0x7fc9c01a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bea00640 1 -- 172.21.15.7:0/3976172535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 msgr2=0x7fc9c01a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 0x7fc9c01a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bea00640 1 -- 172.21.15.7:0/3976172535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9c0112e20 msgr2=0x7fc9c019eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9c0112e20 0x7fc9c019eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bea00640 1 -- 172.21.15.7:0/3976172535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c019f220 con 0x7fc9c0074cc0 2024-04-23T15:23:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.255+0000 7fc9bf400640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 0x7fc9c01a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:23:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.256+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01a4e30 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005940 tx=0x7fc9ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.256+0000 7fc9b7e00640 1 -- 172.21.15.7:0/3976172535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac03f030 con 0x7fc9c0074cc0 2024-04-23T15:23:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.256+0000 7fc9b7e00640 1 -- 172.21.15.7:0/3976172535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9ac003cb0 con 0x7fc9c0074cc0 2024-04-23T15:23:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.256+0000 7fc9b7e00640 1 -- 172.21.15.7:0/3976172535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac035070 con 0x7fc9c0074cc0 2024-04-23T15:23:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.256+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c019f4b0 con 0x7fc9c0074cc0 2024-04-23T15:23:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.256+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c01ab7b0 con 0x7fc9c0074cc0 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.260+0000 7fc9c8d6e740 1 Processor -- start 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.260+0000 7fc9c8d6e740 1 -- start start 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.260+0000 7fc9b7e00640 1 -- 172.21.15.7:0/3976172535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc9ac042030 con 0x7fc9c0074cc0 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.260+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d25451060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 0x560d25453990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d253ac900 con 0x560d254515a0 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560d25352f20 con 0x560d25446ce0 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560d253a88c0 con 0x560d254463c0 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 0x560d25453990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 0x560d25453990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41012/0 (socket says 172.21.15.7:41012) 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9bea00640 1 -- 172.21.15.7:0/649688063 learned_addr learned my addr 172.21.15.7:0/649688063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9bf400640 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d25451060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.261+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bea00640 1 -- 172.21.15.7:0/649688063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 msgr2=0x560d254467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bea00640 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bea00640 1 -- 172.21.15.7:0/649688063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 msgr2=0x560d25451060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bea00640 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d25451060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bea00640 1 -- 172.21.15.7:0/649688063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d25377e10 con 0x560d254515a0 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9bea00640 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 0x560d25453990 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ee690 tx=0x7fc9ac0f9630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88232e0ddabe8f96 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9b7e00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9a40a3d10 0x7fc9a40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.262+0000 7fc9b7e00640 1 -- 172.21.15.7:0/3976172535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7fc9ac0f1380 con 0x7fc9c0074cc0 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.263+0000 7fc9abe00640 1 -- 172.21.15.7:0/649688063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0b9210 con 0x560d254515a0 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.263+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9a40a3d10 0x7fc9a40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.263+0000 7fc9abe00640 1 -- 172.21.15.7:0/649688063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9ac0fe030 con 0x560d254515a0 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.263+0000 7fc9abe00640 1 -- 172.21.15.7:0/649688063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0bc8d0 con 0x560d254515a0 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/649688063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 msgr2=0x560d25453990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 0x560d25453990 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ee690 tx=0x7fc9ac0f9630 comp rx=0 tx=0).stop 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9a40a3d10 0x7fc9a40a61d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006b560 tx=0x7fc9b8009500 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/649688063 shutdown_connections 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d25451060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254515a0 0x560d25453990 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/649688063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/649688063 >> 172.21.15.7:0/649688063 conn(0x560d254428d0 msgr2=0x560d25442cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/649688063 shutdown_connections 2024-04-23T15:23:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/649688063 wait complete. 2024-04-23T15:23:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.264+0000 7fc9c8d6e740 1 -- start start 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 Processor -- start 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 0x560d2544e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d2544eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d25453f90 con 0x560d254463c0 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560d253662c0 con 0x560d25446ce0 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560d25454110 con 0x560d254515a0 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9c8d6e740 10 client.0 _ll_register_callbacks cb 0x560d250bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.265+0000 7fc9bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 0x560d2544e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 0x560d2544e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41026/0 (socket says 172.21.15.7:41026) 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 -- 172.21.15.7:0/3560895971 learned_addr learned my addr 172.21.15.7:0/3560895971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d2544eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 -- 172.21.15.7:0/3560895971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 msgr2=0x560d2544efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 -- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 msgr2=0x560d2544eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d2544eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 -- 172.21.15.7:0/3560895971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d25376fd0 con 0x560d254463c0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d2544eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9bf400640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 0x560d2544e560 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000bf70 tx=0x7fc9b00128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc515674aec95fe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.266+0000 7fc9a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.267+0000 7fc9a8c00640 1 -- 172.21.15.7:0/3560895971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00035f0 con 0x560d254463c0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.267+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9ac0fe030 con 0x560d254463c0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.267+0000 7fc9a8c00640 1 -- 172.21.15.7:0/3560895971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7fc9b0003790 con 0x560d254463c0 2024-04-23T15:23:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.267+0000 7fc9a8c00640 1 -- 172.21.15.7:0/3560895971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9b0003990 con 0x560d254463c0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.267+0000 7fc9c8d6e740 10 client.18279 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.267+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560d250bf210 con 0x560d254463c0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9a8c00640 1 -- 172.21.15.7:0/3560895971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9ac0fe030 con 0x560d254463c0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9a8c00640 1 -- 172.21.15.7:0/3560895971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc9b0019070 con 0x560d254463c0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9c8d6e740 10 client.18279 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9c8d6e740 10 client.18279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9c8d6e740 20 client.18279 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254614f0 0x560d25463940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9c8d6e740 4 client.18279 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.268+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d253ba320 con 0x560d254614f0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.269+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254614f0 0x560d25463940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.270+0000 7fc9bea00640 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254614f0 0x560d25463940 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dca3516d59ee054 server_cookie=c0a0ed82081183a8 in_seq=0 out_seq=0 2024-04-23T15:23:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.270+0000 7fc9a8c00640 10 client.18279 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9a8c00640 1 -- 172.21.15.7:0/3560895971 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560d253ba320 con 0x560d254614f0 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9a8c00640 10 client.18279 handle_command_reply: tid=0 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 client.18279 shutdown 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 msgr2=0x560d2544e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 0x560d2544e560 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000bf70 tx=0x7fc9b00128e0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 shutdown_connections 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254614f0 0x560d25463940 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d25446ce0 0x560d2544eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/3560895971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d254463c0 0x560d2544e560 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9a8c00640 0 client.18279 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 >> 172.21.15.7:0/3560895971 conn(0x560d254428d0 msgr2=0x560d25448600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 shutdown_connections 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/3560895971 wait complete. 2024-04-23T15:23:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.272+0000 7fc9c8d6e740 20 client.18279 trim_cache size 0 max 16384 2024-04-23T15:23:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.291+0000 7fc9c8d6e740 1 Processor -- start 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.291+0000 7fc9c8d6e740 1 -- start start 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254463c0 0x560d25442210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d2545ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b5910 con 0x560d25446ce0 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b7450 con 0x560d254463c0 2024-04-23T15:23:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b5fe0 con 0x560d254515a0 2024-04-23T15:23:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d2545ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d2545ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41030/0 (socket says 172.21.15.7:41030) 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.292+0000 7fc9bea00640 1 -- 172.21.15.7:0/2584785906 learned_addr learned my addr 172.21.15.7:0/2584785906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bf400640 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254463c0 0x560d25442210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bea00640 1 -- 172.21.15.7:0/2584785906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 msgr2=0x560d2544ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bea00640 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bea00640 1 -- 172.21.15.7:0/2584785906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254463c0 msgr2=0x560d25442210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bea00640 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254463c0 0x560d25442210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bea00640 1 -- 172.21.15.7:0/2584785906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2518b620 con 0x560d25446ce0 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bf400640 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254463c0 0x560d25442210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.293+0000 7fc9bea00640 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d2545ccd0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0b9940 tx=0x7fc9ac031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63477571c3c2b563 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.294+0000 7fc9ab400640 1 -- 172.21.15.7:0/2584785906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac049040 con 0x560d25446ce0 2024-04-23T15:23:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.294+0000 7fc9ab400640 1 -- 172.21.15.7:0/2584785906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9ac0fe050 con 0x560d25446ce0 2024-04-23T15:23:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.294+0000 7fc9ab400640 1 -- 172.21.15.7:0/2584785906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0bcab0 con 0x560d25446ce0 2024-04-23T15:23:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.294+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/2584785906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 msgr2=0x560d2545ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.294+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d2545ccd0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0b9940 tx=0x7fc9ac031a10 comp rx=0 tx=0).stop 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/2584785906 shutdown_connections 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254515a0 0x560d2544ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d2545ccd0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/2584785906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254463c0 0x560d25442210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/2584785906 >> 172.21.15.7:0/2584785906 conn(0x560d254428d0 msgr2=0x560d2544e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/2584785906 shutdown_connections 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/2584785906 wait complete. 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 -- start start 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.295+0000 7fc9c8d6e740 1 Processor -- start 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d25459720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254515a0 0x560d254562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b6d80 con 0x560d25446ce0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b66b0 con 0x560d254515a0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b3910 con 0x560d254463c0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9c8d6e740 10 client.0 _ll_register_callbacks cb 0x7fc9b000b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d25459720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d25459720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41032/0 (socket says 172.21.15.7:41032) 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9bea00640 1 -- 172.21.15.7:0/1615460998 learned_addr learned my addr 172.21.15.7:0/1615460998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.296+0000 7fc9bfe00640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254515a0 0x560d254562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bf400640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bea00640 1 -- 172.21.15.7:0/1615460998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 msgr2=0x560d254591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bea00640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bea00640 1 -- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254515a0 msgr2=0x560d254562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bea00640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254515a0 0x560d254562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bea00640 1 -- 172.21.15.7:0/1615460998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d25456aa0 con 0x560d25446ce0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9bea00640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d25459720 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0bcc70 tx=0x7fc9ac005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0314593e4dc3ed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:23:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9a8c00640 1 -- 172.21.15.7:0/1615460998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0d5070 con 0x560d25446ce0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9a8c00640 1 -- 172.21.15.7:0/1615460998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 9467+0+0 (secure 0 0 0) 0x7fc9ac0f9150 con 0x560d25446ce0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.297+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9ac0fe050 con 0x560d25446ce0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9a8c00640 1 -- 172.21.15.7:0/1615460998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9ac049040 con 0x560d25446ce0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 10 client.18285 fetch_fsmap learned FSMap version 32 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560d254c8680 con 0x560d25446ce0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9a8c00640 1 -- 172.21.15.7:0/1615460998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9ac0fe050 con 0x560d25446ce0 2024-04-23T15:23:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9a8c00640 1 -- 172.21.15.7:0/1615460998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc9ac0c0070 con 0x560d25446ce0 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 10 client.18285 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 10 client.18285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 20 client.18285 populate_metadata read hostname 'smithi007' 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254c88f0 0x560d254cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 4 client.18285 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.298+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d253b4190 con 0x560d254c88f0 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.299+0000 7fc9bf400640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254c88f0 0x560d254cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.300+0000 7fc9bf400640 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254c88f0 0x560d254cad10 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af244dcbb450602a server_cookie=a50e27c27472bc38 in_seq=0 out_seq=0 2024-04-23T15:23:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.300+0000 7fc9a8c00640 10 client.18285 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.338+0000 7fc9a8c00640 1 -- 172.21.15.7:0/1615460998 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d253b4190 con 0x560d254c88f0 2024-04-23T15:23:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.338+0000 7fc9a8c00640 10 client.18285 handle_command_reply: tid=0 2024-04-23T15:23:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.338+0000 7fc9c8d6e740 1 client.18285 shutdown 2024-04-23T15:23:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 msgr2=0x560d25459720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d25459720 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0bcc70 tx=0x7fc9ac005de0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 shutdown_connections 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d254c88f0 0x560d254cad10 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d254515a0 0x560d254562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d25446ce0 0x560d25459720 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 --2- 172.21.15.7:0/1615460998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d254463c0 0x560d254591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 >> 172.21.15.7:0/1615460998 conn(0x560d254428d0 msgr2=0x560d25448600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9a8c00640 0 client.18285 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 shutdown_connections 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 1 -- 172.21.15.7:0/1615460998 wait complete. 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.339+0000 7fc9c8d6e740 20 client.18285 trim_cache size 0 max 16384 2024-04-23T15:23:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:23:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:23:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:23:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:23:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9a40a3d10 msgr2=0x7fc9a40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9a40a3d10 0x7fc9a40a61d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006b560 tx=0x7fc9b8009500 comp rx=0 tx=0).stop 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 msgr2=0x7fc9c01a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01a4e30 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005940 tx=0x7fc9ac0042f0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 shutdown_connections 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9a40a3d10 0x7fc9a40a61d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9c0112e20 0x7fc9c019eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9c0074cc0 0x7fc9c01a4e30 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 --2- 172.21.15.7:0/3976172535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9c00743a0 0x7fc9c01a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.340+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 >> 172.21.15.7:0/3976172535 conn(0x7fc9c00fd940 msgr2=0x7fc9c00ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.341+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 shutdown_connections 2024-04-23T15:23:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:23:51.341+0000 7fc9c4a00640 1 -- 172.21.15.7:0/3976172535 wait complete. 2024-04-23T15:23:52.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:52 smithi186 ceph-mon[31814]: pgmap v1028: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:52.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:52 smithi137 ceph-mon[31694]: pgmap v1028: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:52.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:52 smithi007 ceph-mon[27906]: pgmap v1028: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:23:54.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:54 smithi186 ceph-mon[31814]: pgmap v1029: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:23:54.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:23:54.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:54 smithi137 ceph-mon[31694]: pgmap v1029: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:23:54.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:23:54.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:54 smithi007 ceph-mon[27906]: pgmap v1029: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:23:54.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:23:55.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:55 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:23:55.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:55 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:23:55.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:55 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:23:55.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:55 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:23:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:55 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:23:55.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:55 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:23:55.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:55 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:23:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:55 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:23:55.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:55 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:23:56.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:56 smithi137 ceph-mon[31694]: pgmap v1030: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:23:56.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:56 smithi007 ceph-mon[27906]: pgmap v1030: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:23:56.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:56 smithi186 ceph-mon[31814]: pgmap v1030: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:23:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:23:58 smithi137 ceph-mon[31694]: pgmap v1031: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:23:58.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:23:58 smithi007 ceph-mon[27906]: pgmap v1031: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:23:58.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:23:58 smithi186 ceph-mon[31814]: pgmap v1031: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:24:00.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:00 smithi137 ceph-mon[31694]: pgmap v1032: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:00.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:00 smithi007 ceph-mon[27906]: pgmap v1032: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:00.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:00 smithi186 ceph-mon[31814]: pgmap v1032: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:02.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:02 smithi007 ceph-mon[27906]: pgmap v1033: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:02.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:02 smithi186 ceph-mon[31814]: pgmap v1033: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:02.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:02 smithi137 ceph-mon[31694]: pgmap v1033: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:03 smithi007 ceph-mon[27906]: osdmap e145: 12 total, 12 up, 12 in 2024-04-23T15:24:03.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:03 smithi186 ceph-mon[31814]: osdmap e145: 12 total, 12 up, 12 in 2024-04-23T15:24:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:03 smithi137 ceph-mon[31694]: osdmap e145: 12 total, 12 up, 12 in 2024-04-23T15:24:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 -- 172.21.15.7:0/4240054667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe0109530 msgr2=0x7fbbe0111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 --2- 172.21.15.7:0/4240054667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe0109530 0x7fbbe0111100 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009ca0 tx=0x7fbbd802a8c0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 -- 172.21.15.7:0/4240054667 shutdown_connections 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 --2- 172.21.15.7:0/4240054667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe0109530 0x7fbbe0111100 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 --2- 172.21.15.7:0/4240054667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbe0104e10 0x7fbbe0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 --2- 172.21.15.7:0/4240054667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0104460 0x7fbbe0104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 -- 172.21.15.7:0/4240054667 >> 172.21.15.7:0/4240054667 conn(0x7fbbe00ffd00 msgr2=0x7fbbe0102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 -- 172.21.15.7:0/4240054667 shutdown_connections 2024-04-23T15:24:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.502+0000 7fbbe6600640 1 -- 172.21.15.7:0/4240054667 wait complete. 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.503+0000 7fbbe6600640 1 Processor -- start 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.503+0000 7fbbe6600640 1 -- start start 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbe6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0104460 0x7fbbe01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbe6600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbe0109530 0x7fbbe01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbe6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 0x7fbbe019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbe6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01144f0 con 0x7fbbe019a750 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbe6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0114370 con 0x7fbbe0104460 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbe6600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0114670 con 0x7fbbe0109530 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 0x7fbbe019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 0x7fbbe019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40892/0 (socket says 172.21.15.7:40892) 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.504+0000 7fbbdfe00640 1 -- 172.21.15.7:0/326475946 learned_addr learned my addr 172.21.15.7:0/326475946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdf400640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0104460 0x7fbbe01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdea00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbe0109530 0x7fbbe01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdfe00640 1 -- 172.21.15.7:0/326475946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbe0109530 msgr2=0x7fbbe01a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdfe00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbe0109530 0x7fbbe01a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdfe00640 1 -- 172.21.15.7:0/326475946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0104460 msgr2=0x7fbbe01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdfe00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0104460 0x7fbbe01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdfe00640 1 -- 172.21.15.7:0/326475946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe019b350 con 0x7fbbe019a750 2024-04-23T15:24:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.505+0000 7fbbdfe00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 0x7fbbe019abd0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005e30 tx=0x7fbbd80093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.506+0000 7fbbd7e00640 1 -- 172.21.15.7:0/326475946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8003c70 con 0x7fbbe019a750 2024-04-23T15:24:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.506+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe019b5e0 con 0x7fbbe019a750 2024-04-23T15:24:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.506+0000 7fbbd7e00640 1 -- 172.21.15.7:0/326475946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbd8003e10 con 0x7fbbe019a750 2024-04-23T15:24:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.506+0000 7fbbd7e00640 1 -- 172.21.15.7:0/326475946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8030c10 con 0x7fbbe019a750 2024-04-23T15:24:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.506+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe01a7780 con 0x7fbbe019a750 2024-04-23T15:24:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.509+0000 7fbbd7e00640 1 -- 172.21.15.7:0/326475946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbbd8004040 con 0x7fbbe019a750 2024-04-23T15:24:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.510+0000 7fbbe93b3740 1 Processor -- start 2024-04-23T15:24:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.510+0000 7fbbe93b3740 1 -- start start 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 0x55f643d5d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d67e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d68390 0x55f643d6a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f643cc3900 con 0x55f643d5d1b0 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f643c69f20 con 0x55f643d68390 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f643cbf8c0 con 0x55f643d5dad0 2024-04-23T15:24:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbd7e00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbbc40a3dc0 0x7fbbc40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 0x55f643d5d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 0x55f643d5d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40896/0 (socket says 172.21.15.7:40896) 2024-04-23T15:24:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbdea00640 1 -- 172.21.15.7:0/3959351021 learned_addr learned my addr 172.21.15.7:0/3959351021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.511+0000 7fbbdf400640 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d67e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbd7e00640 1 -- 172.21.15.7:0/326475946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 9555+0+0 (secure 0 0 0) 0x7fbbd80f2120 con 0x7fbbe019a750 2024-04-23T15:24:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdfe00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbbc40a3dc0 0x7fbbc40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d68390 0x55f643d6a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 -- 172.21.15.7:0/3959351021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 msgr2=0x55f643d67e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d67e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 -- 172.21.15.7:0/3959351021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d68390 msgr2=0x55f643d6a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d68390 0x55f643d6a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 -- 172.21.15.7:0/3959351021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f643c8ee10 con 0x55f643d5d1b0 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 0x55f643d5d590 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc013480 tx=0x7fbbcc0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b83f79d1bf3320 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.512+0000 7fbbdfe00640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbbc40a3dc0 0x7fbbc40a6280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80c64a0 tx=0x7fbbd80305c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.513+0000 7fbbd4c00640 1 -- 172.21.15.7:0/3959351021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc011470 con 0x55f643d5d1b0 2024-04-23T15:24:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.513+0000 7fbbd4c00640 1 -- 172.21.15.7:0/3959351021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc00f8f0 con 0x55f643d5d1b0 2024-04-23T15:24:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.513+0000 7fbbd4c00640 1 -- 172.21.15.7:0/3959351021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc010630 con 0x55f643d5d1b0 2024-04-23T15:24:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3959351021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 msgr2=0x55f643d5d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 0x55f643d5d590 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc013480 tx=0x7fbbcc0096e0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3959351021 shutdown_connections 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d68390 0x55f643d6a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d67e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3959351021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5d1b0 0x55f643d5d590 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3959351021 >> 172.21.15.7:0/3959351021 conn(0x55f643d596c0 msgr2=0x55f643d59aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3959351021 shutdown_connections 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.514+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3959351021 wait complete. 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 -- start start 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 Processor -- start 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d65280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 0x55f643d657c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d68390 0x55f643d65d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f643d6afc0 con 0x55f643d5dad0 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f643c7d2c0 con 0x55f643d5d1b0 2024-04-23T15:24:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.515+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f643d6b140 con 0x55f643d68390 2024-04-23T15:24:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbe93b3740 10 client.0 _ll_register_callbacks cb 0x55f6439d5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 0x55f643d657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 0x55f643d657c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40902/0 (socket says 172.21.15.7:40902) 2024-04-23T15:24:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 -- 172.21.15.7:0/3471840067 learned_addr learned my addr 172.21.15.7:0/3471840067 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d65280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 -- 172.21.15.7:0/3471840067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d68390 msgr2=0x55f643d65d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d68390 0x55f643d65d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 -- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 msgr2=0x55f643d65280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d65280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdf400640 1 -- 172.21.15.7:0/3471840067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f643c8dfd0 con 0x55f643d5dad0 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.516+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d65280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbdf400640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 0x55f643d657c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000bb00 tx=0x7fbbd000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d452cb07bddee41 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbc9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbc9600640 1 -- 172.21.15.7:0/3471840067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0003ee0 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbc9600640 1 -- 172.21.15.7:0/3471840067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 9555+0+0 (secure 0 0 0) 0x7fbbd0005020 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbcc00f8f0 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbc9600640 1 -- 172.21.15.7:0/3471840067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbbd0005260 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbe93b3740 10 client.18297 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.517+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f6439d6210 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbc9600640 1 -- 172.21.15.7:0/3471840067 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc00f8f0 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbc9600640 1 -- 172.21.15.7:0/3471840067 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbbd001b500 con 0x55f643d5dad0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbe93b3740 10 client.18297 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbe93b3740 10 client.18297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbe93b3740 20 client.18297 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643d784e0 0x55f643d7a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbe93b3740 4 client.18297 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.518+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f643cd1320 con 0x55f643d784e0 2024-04-23T15:24:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.519+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643d784e0 0x55f643d7a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.519+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643d784e0 0x55f643d7a910 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2510f872660ad045 server_cookie=47560c35a72037bc in_seq=0 out_seq=0 2024-04-23T15:24:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.519+0000 7fbbc9600640 10 client.18297 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.521+0000 7fbbc9600640 1 -- 172.21.15.7:0/3471840067 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f643cd1320 con 0x55f643d784e0 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.521+0000 7fbbc9600640 10 client.18297 handle_command_reply: tid=0 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.521+0000 7fbbe93b3740 1 client.18297 shutdown 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 msgr2=0x55f643d657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 0x55f643d657c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000bb00 tx=0x7fbbd000bf00 comp rx=0 tx=0).stop 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 shutdown_connections 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643d784e0 0x55f643d7a910 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d68390 0x55f643d65d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d5dad0 0x55f643d657c0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3471840067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d65280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbc9600640 0 client.18297 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 >> 172.21.15.7:0/3471840067 conn(0x55f643d596c0 msgr2=0x55f643d5f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 shutdown_connections 2024-04-23T15:24:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3471840067 wait complete. 2024-04-23T15:24:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.522+0000 7fbbe93b3740 20 client.18297 trim_cache size 0 max 16384 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 Processor -- start 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 -- start start 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5d1b0 0x55f643d73e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5dad0 0x55f643d5fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d80220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01b16c0 con 0x55f643d68390 2024-04-23T15:24:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01b3200 con 0x55f643d5dad0 2024-04-23T15:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01b1d90 con 0x55f643d5d1b0 2024-04-23T15:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.546+0000 7fbbdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d80220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d80220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40910/0 (socket says 172.21.15.7:40910) 2024-04-23T15:24:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 -- 172.21.15.7:0/3033834886 learned_addr learned my addr 172.21.15.7:0/3033834886 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdf400640 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5dad0 0x55f643d5fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5d1b0 0x55f643d73e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 -- 172.21.15.7:0/3033834886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5d1b0 msgr2=0x55f643d73e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5d1b0 0x55f643d73e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 -- 172.21.15.7:0/3033834886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5dad0 msgr2=0x55f643d5fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5dad0 0x55f643d5fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 -- 172.21.15.7:0/3033834886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f643aa2620 con 0x55f643d68390 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.547+0000 7fbbdea00640 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d80220 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0097b0 tx=0x7fbbcc009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a3ba531daebc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbcbe00640 1 -- 172.21.15.7:0/3033834886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0132c0 con 0x55f643d68390 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbcbe00640 1 -- 172.21.15.7:0/3033834886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc0054f0 con 0x55f643d68390 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbcbe00640 1 -- 172.21.15.7:0/3033834886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0035f0 con 0x55f643d68390 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3033834886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 msgr2=0x55f643d80220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d80220 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0097b0 tx=0x7fbbcc009340 comp rx=0 tx=0).stop 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3033834886 shutdown_connections 2024-04-23T15:24:04.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5dad0 0x55f643d5fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d80220 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/3033834886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5d1b0 0x55f643d73e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.548+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3033834886 >> 172.21.15.7:0/3033834886 conn(0x55f643d596c0 msgr2=0x55f643d65ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.549+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3033834886 shutdown_connections 2024-04-23T15:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.549+0000 7fbbe93b3740 1 -- 172.21.15.7:0/3033834886 wait complete. 2024-04-23T15:24:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.549+0000 7fbbe93b3740 1 -- start start 2024-04-23T15:24:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.549+0000 7fbbe93b3740 1 Processor -- start 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d61f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d62460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01b2b30 con 0x55f643d68390 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01b2460 con 0x55f643d5d1b0 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01af6c0 con 0x55f643d5dad0 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbe93b3740 10 client.0 _ll_register_callbacks cb 0x7fbbd00040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40916/0 (socket says 172.21.15.7:40916) 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbdea00640 1 -- 172.21.15.7:0/2696693868 learned_addr learned my addr 172.21.15.7:0/2696693868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.550+0000 7fbbdea00640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d61f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdf400640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d62460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdea00640 1 -- 172.21.15.7:0/2696693868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 msgr2=0x55f643d62460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdea00640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d62460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdea00640 1 -- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 msgr2=0x55f643d61f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdea00640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d61f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdea00640 1 -- 172.21.15.7:0/2696693868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f643ddda90 con 0x55f643d68390 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbdea00640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d629a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009780 tx=0x7fbbcc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952d4022c6e8d7ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbc9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.551+0000 7fbbc9600640 1 -- 172.21.15.7:0/2696693868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc00f8c0 con 0x55f643d68390 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbcc0054f0 con 0x55f643d68390 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbc9600640 1 -- 172.21.15.7:0/2696693868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 9555+0+0 (secure 0 0 0) 0x7fbbcc00fe30 con 0x55f643d68390 2024-04-23T15:24:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbc9600640 1 -- 172.21.15.7:0/2696693868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbbcc0132d0 con 0x55f643d68390 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbe93b3740 10 client.18303 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f643ddece0 con 0x55f643d68390 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbc9600640 1 -- 172.21.15.7:0/2696693868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbbcc0054f0 con 0x55f643d68390 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbc9600640 1 -- 172.21.15.7:0/2696693868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbbcc0035f0 con 0x55f643d68390 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.552+0000 7fbbe93b3740 10 client.18303 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.553+0000 7fbbe93b3740 10 client.18303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.553+0000 7fbbe93b3740 20 client.18303 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.553+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643ddf2d0 0x55f643de16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.553+0000 7fbbe93b3740 4 client.18303 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.553+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f643ccb190 con 0x55f643ddf2d0 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.553+0000 7fbbdf400640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643ddf2d0 0x55f643de16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.554+0000 7fbbdf400640 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643ddf2d0 0x55f643de16f0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93b790eaa23a4659 server_cookie=89b90b8b0067cffe in_seq=0 out_seq=0 2024-04-23T15:24:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.554+0000 7fbbc9600640 10 client.18303 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.605+0000 7fbbc9600640 1 -- 172.21.15.7:0/2696693868 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f643ccb190 con 0x55f643ddf2d0 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.605+0000 7fbbc9600640 10 client.18303 handle_command_reply: tid=0 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.605+0000 7fbbe93b3740 1 client.18303 shutdown 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.605+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 msgr2=0x55f643d629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.605+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d629a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009780 tx=0x7fbbcc009e40 comp rx=0 tx=0).stop 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 shutdown_connections 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f643ddf2d0 0x55f643de16f0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f643d68390 0x55f643d629a0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f643d5dad0 0x55f643d62460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbc9600640 0 client.18303 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 --2- 172.21.15.7:0/2696693868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f643d5d1b0 0x55f643d61f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 >> 172.21.15.7:0/2696693868 conn(0x55f643d596c0 msgr2=0x55f643d57fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 shutdown_connections 2024-04-23T15:24:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 1 -- 172.21.15.7:0/2696693868 wait complete. 2024-04-23T15:24:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.606+0000 7fbbe93b3740 20 client.18303 trim_cache size 0 max 16384 2024-04-23T15:24:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:24:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:24:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:24:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbbc40a3dc0 msgr2=0x7fbbc40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbbc40a3dc0 0x7fbbc40a6280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80c64a0 tx=0x7fbbd80305c0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 msgr2=0x7fbbe019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 0x7fbbe019abd0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005e30 tx=0x7fbbd80093d0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 shutdown_connections 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbbc40a3dc0 0x7fbbc40a6280 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbe019a750 0x7fbbe019abd0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbe0109530 0x7fbbe01a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 --2- 172.21.15.7:0/326475946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0104460 0x7fbbe01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 >> 172.21.15.7:0/326475946 conn(0x7fbbe00ffd00 msgr2=0x7fbbe0101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.607+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 shutdown_connections 2024-04-23T15:24:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:04.608+0000 7fbbe6600640 1 -- 172.21.15.7:0/326475946 wait complete. 2024-04-23T15:24:04.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:04 smithi007 ceph-mon[27906]: pgmap v1035: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:24:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:04 smithi186 ceph-mon[31814]: pgmap v1035: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:24:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:04 smithi137 ceph-mon[31694]: pgmap v1035: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:24:06.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:06 smithi007 ceph-mon[27906]: pgmap v1036: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:24:06.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:06 smithi186 ceph-mon[31814]: pgmap v1036: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:24:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:06 smithi137 ceph-mon[31694]: pgmap v1036: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:24:08.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:08 smithi007 ceph-mon[27906]: pgmap v1037: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 38 op/s 2024-04-23T15:24:08.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:08 smithi186 ceph-mon[31814]: pgmap v1037: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 38 op/s 2024-04-23T15:24:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:08 smithi137 ceph-mon[31694]: pgmap v1037: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 38 op/s 2024-04-23T15:24:10.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:10 smithi007 ceph-mon[27906]: pgmap v1038: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 38 op/s 2024-04-23T15:24:10.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:10 smithi186 ceph-mon[31814]: pgmap v1038: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 38 op/s 2024-04-23T15:24:10.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:10 smithi137 ceph-mon[31694]: pgmap v1038: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.9 MiB/s wr, 38 op/s 2024-04-23T15:24:12.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:11 smithi007 ceph-mon[27906]: osdmap e146: 12 total, 12 up, 12 in 2024-04-23T15:24:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:11 smithi186 ceph-mon[31814]: osdmap e146: 12 total, 12 up, 12 in 2024-04-23T15:24:12.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:11 smithi137 ceph-mon[31694]: osdmap e146: 12 total, 12 up, 12 in 2024-04-23T15:24:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:12 smithi007 ceph-mon[27906]: pgmap v1040: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-04-23T15:24:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:12 smithi186 ceph-mon[31814]: pgmap v1040: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-04-23T15:24:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:12 smithi137 ceph-mon[31694]: pgmap v1040: 129 pgs: 129 active+clean; 8.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 12 op/s 2024-04-23T15:24:15.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:14 smithi007 ceph-mon[27906]: pgmap v1041: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:24:15.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:14 smithi186 ceph-mon[31814]: pgmap v1041: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:24:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:14 smithi137 ceph-mon[31694]: pgmap v1041: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:24:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:16 smithi007 ceph-mon[27906]: pgmap v1042: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:24:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:16 smithi186 ceph-mon[31814]: pgmap v1042: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:24:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:16 smithi137 ceph-mon[31694]: pgmap v1042: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:24:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 -- 172.21.15.7:0/4282413585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8102c40 msgr2=0x7fd9a8106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 --2- 172.21.15.7:0/4282413585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8102c40 0x7fd9a8106c80 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd994009900 tx=0x7fd99402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 -- 172.21.15.7:0/4282413585 shutdown_connections 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 --2- 172.21.15.7:0/4282413585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 0x7fd9a810ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 --2- 172.21.15.7:0/4282413585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8102c40 0x7fd9a8106c80 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 --2- 172.21.15.7:0/4282413585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a8102290 0x7fd9a8102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 -- 172.21.15.7:0/4282413585 >> 172.21.15.7:0/4282413585 conn(0x7fd9a80fdab0 msgr2=0x7fd9a80ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 -- 172.21.15.7:0/4282413585 shutdown_connections 2024-04-23T15:24:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.760+0000 7fd9ad800640 1 -- 172.21.15.7:0/4282413585 wait complete. 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.761+0000 7fd9ad800640 1 Processor -- start 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 -- start start 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a8102290 0x7fd9a8074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 0x7fd9a8074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 0x7fd9a81a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81122d0 con 0x7fd9a8074d80 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a8112150 con 0x7fd9a8102290 2024-04-23T15:24:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9ad800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a8112450 con 0x7fd9a8107360 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.762+0000 7fd9a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 0x7fd9a81a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 0x7fd9a81a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41044/0 (socket says 172.21.15.7:41044) 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 -- 172.21.15.7:0/593465932 learned_addr learned my addr 172.21.15.7:0/593465932 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a8102290 0x7fd9a8074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a6000640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 0x7fd9a8074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 -- 172.21.15.7:0/593465932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 msgr2=0x7fd9a8074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 0x7fd9a8074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 -- 172.21.15.7:0/593465932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a8102290 msgr2=0x7fd9a8074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a8102290 0x7fd9a8074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 -- 172.21.15.7:0/593465932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a81a7040 con 0x7fd9a8074d80 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a6000640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 0x7fd9a8074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:24:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.763+0000 7fd9a7400640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 0x7fd9a81a6940 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000eaa0 tx=0x7fd9a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.764+0000 7fd99f400640 1 -- 172.21.15.7:0/593465932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000cdb0 con 0x7fd9a8074d80 2024-04-23T15:24:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.764+0000 7fd99f400640 1 -- 172.21.15.7:0/593465932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9a0005020 con 0x7fd9a8074d80 2024-04-23T15:24:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.764+0000 7fd99f400640 1 -- 172.21.15.7:0/593465932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00116d0 con 0x7fd9a8074d80 2024-04-23T15:24:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.764+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a81a7330 con 0x7fd9a8074d80 2024-04-23T15:24:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.764+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a81a7800 con 0x7fd9a8074d80 2024-04-23T15:24:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.767+0000 7fd99f400640 1 -- 172.21.15.7:0/593465932 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd9a00051d0 con 0x7fd9a8074d80 2024-04-23T15:24:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 Processor -- start 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 -- start start 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd99f400640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd98c0a3df0 0x7fd98c0a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd99f400640 1 -- 172.21.15.7:0/593465932 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fd9a00d0d40 con 0x7fd9a8074d80 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9a6000640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd98c0a3df0 0x7fd98c0a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872641a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x558726424e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x558726427780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558726380900 con 0x55872641aad0 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558726326f20 con 0x55872641a1b0 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.769+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55872637c8c0 con 0x558726425390 2024-04-23T15:24:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x558726424e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x558726424e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41054/0 (socket says 172.21.15.7:41054) 2024-04-23T15:24:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a6000640 1 -- 172.21.15.7:0/2223776251 learned_addr learned my addr 172.21.15.7:0/2223776251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872641a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a7400640 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x558726427780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a6000640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd98c0a3df0 0x7fd98c0a62b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd994031440 tx=0x7fd994004590 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.770+0000 7fd9a6000640 1 -- 172.21.15.7:0/2223776251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 msgr2=0x558726427780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x558726427780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd9a6000640 1 -- 172.21.15.7:0/2223776251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 msgr2=0x55872641a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872641a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd9a6000640 1 -- 172.21.15.7:0/2223776251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872634be10 con 0x55872641aad0 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x558726424e50 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd9a806b660 tx=0x7fd994047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f6885057070d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd993e00640 1 -- 172.21.15.7:0/2223776251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994035050 con 0x55872641aad0 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd993e00640 1 -- 172.21.15.7:0/2223776251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd99404e070 con 0x55872641aad0 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.771+0000 7fd993e00640 1 -- 172.21.15.7:0/2223776251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9940324b0 con 0x55872641aad0 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2223776251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 msgr2=0x558726424e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x558726424e50 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd9a806b660 tx=0x7fd994047000 comp rx=0 tx=0).stop 2024-04-23T15:24:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2223776251 shutdown_connections 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x558726427780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x558726424e50 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2223776251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872641a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2223776251 >> 172.21.15.7:0/2223776251 conn(0x5587264166c0 msgr2=0x558726416aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2223776251 shutdown_connections 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.772+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2223776251 wait complete. 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.773+0000 7fd9b05d8740 1 -- start start 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.773+0000 7fd9b05d8740 1 Processor -- start 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x5587264222a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55872641aad0 0x5587264227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 0x558726422d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558726427f60 con 0x558726425390 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55872633a2c0 con 0x55872641a1b0 2024-04-23T15:24:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5587264280e0 con 0x55872641aad0 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9b05d8740 10 client.0 _ll_register_callbacks cb 0x558726092a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 0x558726422d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 0x558726422d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41056/0 (socket says 172.21.15.7:41056) 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 -- 172.21.15.7:0/2250656443 learned_addr learned my addr 172.21.15.7:0/2250656443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x5587264222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55872641aad0 0x5587264227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 -- 172.21.15.7:0/2250656443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55872641aad0 msgr2=0x5587264227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55872641aad0 0x5587264227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 -- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 msgr2=0x5587264222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x5587264222a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.774+0000 7fd9a7400640 1 -- 172.21.15.7:0/2250656443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872634afd0 con 0x558726425390 2024-04-23T15:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55872641aad0 0x5587264227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd9a7400640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 0x558726422d20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00ce0e0 tx=0x7fd9a009d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e80fe69f37b823c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd990c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd990c00640 1 -- 172.21.15.7:0/2250656443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a001f040 con 0x558726425390 2024-04-23T15:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd990c00640 1 -- 172.21.15.7:0/2250656443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fd9a00870b0 con 0x558726425390 2024-04-23T15:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd99404e070 con 0x558726425390 2024-04-23T15:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd990c00640 1 -- 172.21.15.7:0/2250656443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd9a00872b0 con 0x558726425390 2024-04-23T15:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.775+0000 7fd9b05d8740 10 client.18315 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558726093210 con 0x558726425390 2024-04-23T15:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd990c00640 1 -- 172.21.15.7:0/2250656443 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd99404e070 con 0x558726425390 2024-04-23T15:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd990c00640 1 -- 172.21.15.7:0/2250656443 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd9a000f040 con 0x558726425390 2024-04-23T15:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 10 client.18315 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 10 client.18315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 20 client.18315 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5587264354a0 0x5587264378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 4 client.18315 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.776+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55872638e320 con 0x5587264354a0 2024-04-23T15:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.777+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5587264354a0 0x5587264378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.778+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5587264354a0 0x5587264378d0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf775142c742266 server_cookie=afcdf2adb4b9b02c in_seq=0 out_seq=0 2024-04-23T15:24:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.778+0000 7fd990c00640 10 client.18315 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd990c00640 1 -- 172.21.15.7:0/2250656443 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55872638e320 con 0x5587264354a0 2024-04-23T15:24:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd990c00640 10 client.18315 handle_command_reply: tid=0 2024-04-23T15:24:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 client.18315 shutdown 2024-04-23T15:24:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 msgr2=0x558726422d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 0x558726422d20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00ce0e0 tx=0x7fd9a009d110 comp rx=0 tx=0).stop 2024-04-23T15:24:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 shutdown_connections 2024-04-23T15:24:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5587264354a0 0x5587264378d0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558726425390 0x558726422d20 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55872641aad0 0x5587264227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd990c00640 0 client.18315 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2250656443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x5587264222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 >> 172.21.15.7:0/2250656443 conn(0x5587264166c0 msgr2=0x55872641c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 shutdown_connections 2024-04-23T15:24:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.780+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2250656443 wait complete. 2024-04-23T15:24:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.781+0000 7fd9b05d8740 20 client.18315 trim_cache size 0 max 16384 2024-04-23T15:24:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.797+0000 7fd9b05d8740 1 Processor -- start 2024-04-23T15:24:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.797+0000 7fd9b05d8740 1 -- start start 2024-04-23T15:24:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x558726430e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872643d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81b1610 con 0x55872641aad0 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81b3150 con 0x55872641a1b0 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81b1ce0 con 0x558726425390 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41062/0 (socket says 172.21.15.7:41062) 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9a6000640 1 -- 172.21.15.7:0/921834434 learned_addr learned my addr 172.21.15.7:0/921834434 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.798+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x558726430e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a7400640 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872643d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a6000640 1 -- 172.21.15.7:0/921834434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 msgr2=0x55872643d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a6000640 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872643d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a6000640 1 -- 172.21.15.7:0/921834434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 msgr2=0x558726430e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a6000640 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x558726430e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a6000640 1 -- 172.21.15.7:0/921834434 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872615f620 con 0x55872641aad0 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a7400640 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872643d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd9a6000640 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641cb70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd99402a9e0 tx=0x7fd99402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c8ccf5d6ed7a22 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.799+0000 7fd993400640 1 -- 172.21.15.7:0/921834434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994056070 con 0x55872641aad0 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd993400640 1 -- 172.21.15.7:0/921834434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd99404e050 con 0x55872641aad0 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd993400640 1 -- 172.21.15.7:0/921834434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994003e20 con 0x55872641aad0 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 -- 172.21.15.7:0/921834434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 msgr2=0x55872641cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641cb70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd99402a9e0 tx=0x7fd99402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 -- 172.21.15.7:0/921834434 shutdown_connections 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872643d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641cb70 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/921834434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x558726430e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 -- 172.21.15.7:0/921834434 >> 172.21.15.7:0/921834434 conn(0x5587264166c0 msgr2=0x558726422af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 -- 172.21.15.7:0/921834434 shutdown_connections 2024-04-23T15:24:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.800+0000 7fd9b05d8740 1 -- 172.21.15.7:0/921834434 wait complete. 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.801+0000 7fd9b05d8740 1 -- start start 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.801+0000 7fd9b05d8740 1 Processor -- start 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872642d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872641f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81b2a80 con 0x55872641aad0 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81b23b0 con 0x55872641a1b0 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a81af610 con 0x558726425390 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9b05d8740 10 client.0 _ll_register_callbacks cb 0x7fd9a0005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41064/0 (socket says 172.21.15.7:41064) 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 -- 172.21.15.7:0/2531810766 learned_addr learned my addr 172.21.15.7:0/2531810766 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a7400640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872641f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872642d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 -- 172.21.15.7:0/2531810766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 msgr2=0x55872641f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872641f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 -- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 msgr2=0x55872642d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872642d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.802+0000 7fd9a6000640 1 -- 172.21.15.7:0/2531810766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872641fa90 con 0x55872641aad0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.803+0000 7fd9a6000640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641ece0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fd99405a000 tx=0x7fd994005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942e2ec0774868af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.803+0000 7fd990c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.803+0000 7fd990c00640 1 -- 172.21.15.7:0/2531810766 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994062030 con 0x55872641aad0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.803+0000 7fd990c00640 1 -- 172.21.15.7:0/2531810766 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fd994003800 con 0x55872641aad0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.803+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd99404e050 con 0x55872641aad0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.803+0000 7fd990c00640 1 -- 172.21.15.7:0/2531810766 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd994056050 con 0x55872641aad0 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 10 client.18321 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55872649ba70 con 0x55872641aad0 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd990c00640 1 -- 172.21.15.7:0/2531810766 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd99404e050 con 0x55872641aad0 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd990c00640 1 -- 172.21.15.7:0/2531810766 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd994032800 con 0x55872641aad0 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 10 client.18321 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 10 client.18321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 20 client.18321 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55872649bd40 0x55872649e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 4 client.18321 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:24:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.804+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558726388190 con 0x55872649bd40 2024-04-23T15:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.805+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55872649bd40 0x55872649e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.806+0000 7fd9a6a00640 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55872649bd40 0x55872649e130 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703819d7a5727a25 server_cookie=b6b5526e999b280b in_seq=0 out_seq=0 2024-04-23T15:24:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.806+0000 7fd990c00640 10 client.18321 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd990c00640 1 -- 172.21.15.7:0/2531810766 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558726388190 con 0x55872649bd40 2024-04-23T15:24:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd990c00640 10 client.18321 handle_command_reply: tid=0 2024-04-23T15:24:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 client.18321 shutdown 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 msgr2=0x55872641ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641ece0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fd99405a000 tx=0x7fd994005710 comp rx=0 tx=0).stop 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 shutdown_connections 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55872649bd40 0x55872649e130 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558726425390 0x55872641f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd990c00640 0 client.18321 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55872641aad0 0x55872641ece0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 --2- 172.21.15.7:0/2531810766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55872641a1b0 0x55872642d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 >> 172.21.15.7:0/2531810766 conn(0x5587264166c0 msgr2=0x558726414fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 shutdown_connections 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.835+0000 7fd9b05d8740 1 -- 172.21.15.7:0/2531810766 wait complete. 2024-04-23T15:24:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.836+0000 7fd9b05d8740 20 client.18321 trim_cache size 0 max 16384 2024-04-23T15:24:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:24:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:24:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:24:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.836+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd98c0a3df0 msgr2=0x7fd98c0a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.836+0000 7fd9ad800640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd98c0a3df0 0x7fd98c0a62b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd994031440 tx=0x7fd994004590 comp rx=0 tx=0).stop 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.836+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 msgr2=0x7fd9a81a6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.836+0000 7fd9ad800640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 0x7fd9a81a6940 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000eaa0 tx=0x7fd9a000ef60 comp rx=0 tx=0).stop 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 shutdown_connections 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd98c0a3df0 0x7fd98c0a62b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9a8074d80 0x7fd9a81a6940 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a8107360 0x7fd9a8074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 --2- 172.21.15.7:0/593465932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a8102290 0x7fd9a8074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 >> 172.21.15.7:0/593465932 conn(0x7fd9a80fdab0 msgr2=0x7fd9a80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 shutdown_connections 2024-04-23T15:24:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:17.837+0000 7fd9ad800640 1 -- 172.21.15.7:0/593465932 wait complete. 2024-04-23T15:24:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:18 smithi007 ceph-mon[27906]: pgmap v1043: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:24:19.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:18 smithi186 ceph-mon[31814]: pgmap v1043: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:24:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:18 smithi137 ceph-mon[31694]: pgmap v1043: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:24:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:20 smithi007 ceph-mon[27906]: pgmap v1044: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:24:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:20 smithi186 ceph-mon[31814]: pgmap v1044: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:24:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:20 smithi137 ceph-mon[31694]: pgmap v1044: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.4 MiB/s wr, 11 op/s 2024-04-23T15:24:23.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:22 smithi007 ceph-mon[27906]: pgmap v1045: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:24:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:22 smithi186 ceph-mon[31814]: pgmap v1045: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:24:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:22 smithi137 ceph-mon[31694]: pgmap v1045: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:24:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:24 smithi007 ceph-mon[27906]: pgmap v1046: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:24:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:24 smithi186 ceph-mon[31814]: pgmap v1046: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:24:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:24 smithi137 ceph-mon[31694]: pgmap v1046: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:24:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:27 smithi007 ceph-mon[27906]: pgmap v1047: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:24:27.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:27 smithi186 ceph-mon[31814]: pgmap v1047: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:24:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:27 smithi137 ceph-mon[31694]: pgmap v1047: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:24:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:29 smithi007 ceph-mon[27906]: pgmap v1048: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:24:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:29 smithi186 ceph-mon[31814]: pgmap v1048: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:24:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:29 smithi137 ceph-mon[31694]: pgmap v1048: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:24:30.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:30 smithi007 ceph-mon[27906]: pgmap v1049: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:24:30.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:30 smithi186 ceph-mon[31814]: pgmap v1049: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:24:30.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:30 smithi137 ceph-mon[31694]: pgmap v1049: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.986+0000 7fbd31e00640 1 -- 172.21.15.7:0/550233507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 msgr2=0x7fbd2c10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.986+0000 7fbd31e00640 1 --2- 172.21.15.7:0/550233507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10de50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009ca0 tx=0x7fbd2402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 -- 172.21.15.7:0/550233507 shutdown_connections 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 --2- 172.21.15.7:0/550233507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10de50 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 --2- 172.21.15.7:0/550233507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd2c102080 0x7fbd2c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 --2- 172.21.15.7:0/550233507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c1016d0 0x7fbd2c101ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 -- 172.21.15.7:0/550233507 >> 172.21.15.7:0/550233507 conn(0x7fbd2c077240 msgr2=0x7fbd2c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 -- 172.21.15.7:0/550233507 shutdown_connections 2024-04-23T15:24:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.987+0000 7fbd31e00640 1 -- 172.21.15.7:0/550233507 wait complete. 2024-04-23T15:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 Processor -- start 2024-04-23T15:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 -- start start 2024-04-23T15:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd2c1016d0 0x7fbd2c10e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c10f260 0x7fbd2c1a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c112330 con 0x7fbd2c106280 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.988+0000 7fbd31e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1121b0 con 0x7fbd2c10f260 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd31e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1124b0 con 0x7fbd2c1016d0 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36054/0 (socket says 172.21.15.7:36054) 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 -- 172.21.15.7:0/3304526731 learned_addr learned my addr 172.21.15.7:0/3304526731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd30a00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd2c1016d0 0x7fbd2c10e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd31400640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c10f260 0x7fbd2c1a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 -- 172.21.15.7:0/3304526731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd2c1016d0 msgr2=0x7fbd2c10e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd2c1016d0 0x7fbd2c10e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 -- 172.21.15.7:0/3304526731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c10f260 msgr2=0x7fbd2c1a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c10f260 0x7fbd2c1a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd2be00640 1 -- 172.21.15.7:0/3304526731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c1a7160 con 0x7fbd2c106280 2024-04-23T15:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.989+0000 7fbd31400640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c10f260 0x7fbd2c1a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.990+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10ed20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800d740 tx=0x7fbd1800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.990+0000 7fbd29600640 1 -- 172.21.15.7:0/3304526731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18017070 con 0x7fbd2c106280 2024-04-23T15:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.990+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2c1a7450 con 0x7fbd2c106280 2024-04-23T15:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.990+0000 7fbd29600640 1 -- 172.21.15.7:0/3304526731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd1800de50 con 0x7fbd2c106280 2024-04-23T15:24:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.990+0000 7fbd29600640 1 -- 172.21.15.7:0/3304526731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18004d60 con 0x7fbd2c106280 2024-04-23T15:24:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.990+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c1a79a0 con 0x7fbd2c106280 2024-04-23T15:24:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 Processor -- start 2024-04-23T15:24:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 -- start start 2024-04-23T15:24:30.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd29600640 1 -- 172.21.15.7:0/3304526731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbd18004f00 con 0x7fbd2c106280 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57dd0ce0 0x55ab57ddb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 0x55ab57ddd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ab57d36900 con 0x55ab57ddb5a0 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab57cdcf20 con 0x55ab57dd03c0 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.994+0000 7fbd3621b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ab57d328c0 con 0x55ab57dd0ce0 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 0x55ab57ddd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 0x55ab57ddd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36066/0 (socket says 172.21.15.7:36066) 2024-04-23T15:24:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 -- 172.21.15.7:0/3798111708 learned_addr learned my addr 172.21.15.7:0/3798111708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd30a00640 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57dd0ce0 0x55ab57ddb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd31400640 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 -- 172.21.15.7:0/3798111708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57dd0ce0 msgr2=0x55ab57ddb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57dd0ce0 0x55ab57ddb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 -- 172.21.15.7:0/3798111708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 msgr2=0x55ab57dd07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd2be00640 1 -- 172.21.15.7:0/3798111708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab57d01e10 con 0x55ab57ddb5a0 2024-04-23T15:24:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.995+0000 7fbd31400640 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:24:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.996+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 0x55ab57ddd990 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fbd180cd890 tx=0x7fbd180d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9578d9a30c4fb6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.996+0000 7fbd29600640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd140a3d10 0x7fbd140a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.996+0000 7fbd1dc00640 1 -- 172.21.15.7:0/3798111708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180df070 con 0x55ab57ddb5a0 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.996+0000 7fbd1dc00640 1 -- 172.21.15.7:0/3798111708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd180a4e10 con 0x55ab57ddb5a0 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.996+0000 7fbd1dc00640 1 -- 172.21.15.7:0/3798111708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1809bb00 con 0x55ab57ddb5a0 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.996+0000 7fbd29600640 1 -- 172.21.15.7:0/3304526731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fbd180d0610 con 0x7fbd2c106280 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd31400640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd140a3d10 0x7fbd140a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 -- 172.21.15.7:0/3798111708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 msgr2=0x55ab57ddd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 0x55ab57ddd990 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fbd180cd890 tx=0x7fbd180d8670 comp rx=0 tx=0).stop 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 -- 172.21.15.7:0/3798111708 shutdown_connections 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57ddb5a0 0x55ab57ddd990 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57dd0ce0 0x55ab57ddb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3798111708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 -- 172.21.15.7:0/3798111708 >> 172.21.15.7:0/3798111708 conn(0x55ab57dcc8d0 msgr2=0x55ab57dcccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.997+0000 7fbd3621b740 1 -- 172.21.15.7:0/3798111708 shutdown_connections 2024-04-23T15:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.998+0000 7fbd3621b740 1 -- 172.21.15.7:0/3798111708 wait complete. 2024-04-23T15:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.998+0000 7fbd31400640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd140a3d10 0x7fbd140a61d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009a60 tx=0x7fbd24004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.998+0000 7fbd3621b740 1 -- start start 2024-04-23T15:24:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.998+0000 7fbd3621b740 1 Processor -- start 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57dd9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ab57dde170 con 0x55ab57dd0ce0 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab57cf02c0 con 0x55ab57dd03c0 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ab57dde2f0 con 0x55ab57ddb5a0 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd3621b740 10 client.0 _ll_register_callbacks cb 0x55ab57a48a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36072/0 (socket says 172.21.15.7:36072) 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd2be00640 1 -- 172.21.15.7:0/2791760392 learned_addr learned my addr 172.21.15.7:0/2791760392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:30.999+0000 7fbd31400640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57dd9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd2be00640 1 -- 172.21.15.7:0/2791760392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 msgr2=0x55ab57dd9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd2be00640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57dd9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd2be00640 1 -- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 msgr2=0x55ab57dd8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd2be00640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd2be00640 1 -- 172.21.15.7:0/2791760392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab57d00fd0 con 0x55ab57dd0ce0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd31400640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57dd9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd2be00640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd8ad0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009610 tx=0x7fbd180d0890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f7f5cda87692a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd12000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd12000640 1 -- 172.21.15.7:0/2791760392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a0550 con 0x55ab57dd0ce0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd12000640 1 -- 172.21.15.7:0/2791760392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fbd180cdbd0 con 0x55ab57dd0ce0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.000+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd180a4e10 con 0x55ab57dd0ce0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd12000640 1 -- 172.21.15.7:0/2791760392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd180a07b0 con 0x55ab57dd0ce0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 10 client.18333 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ab57a49210 con 0x55ab57dd0ce0 2024-04-23T15:24:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd12000640 1 -- 172.21.15.7:0/2791760392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd180a4e10 con 0x55ab57dd0ce0 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd12000640 1 -- 172.21.15.7:0/2791760392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbd180a00c0 con 0x55ab57dd0ce0 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 10 client.18333 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 10 client.18333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 20 client.18333 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57deb5b0 0x55ab57ded9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 4 client.18333 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.001+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab57d44320 con 0x55ab57deb5b0 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.002+0000 7fbd30a00640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57deb5b0 0x55ab57ded9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.003+0000 7fbd30a00640 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57deb5b0 0x55ab57ded9a0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d676c1aa4371a743 server_cookie=1cff7cd99ebe046a in_seq=0 out_seq=0 2024-04-23T15:24:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.003+0000 7fbd12000640 10 client.18333 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd12000640 1 -- 172.21.15.7:0/2791760392 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ab57d44320 con 0x55ab57deb5b0 2024-04-23T15:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd12000640 10 client.18333 handle_command_reply: tid=0 2024-04-23T15:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 client.18333 shutdown 2024-04-23T15:24:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 msgr2=0x55ab57dd8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd8ad0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009610 tx=0x7fbd180d0890 comp rx=0 tx=0).stop 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 shutdown_connections 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57deb5b0 0x55ab57ded9a0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57dd9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd8ad0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd12000640 0 client.18333 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 --2- 172.21.15.7:0/2791760392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd03c0 0x55ab57dd8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.005+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 >> 172.21.15.7:0/2791760392 conn(0x55ab57dcc8d0 msgr2=0x55ab57dcba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.006+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 shutdown_connections 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.006+0000 7fbd3621b740 1 -- 172.21.15.7:0/2791760392 wait complete. 2024-04-23T15:24:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.006+0000 7fbd3621b740 20 client.18333 trim_cache size 0 max 16384 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.023+0000 7fbd3621b740 1 Processor -- start 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.023+0000 7fbd3621b740 1 -- start start 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57de7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57df2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57df3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd3621b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1b1450 con 0x55ab57dd03c0 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd3621b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1b2f90 con 0x55ab57dd0ce0 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd3621b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1b1b20 con 0x55ab57ddb5a0 2024-04-23T15:24:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57de7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57de7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36076/0 (socket says 172.21.15.7:36076) 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd30a00640 1 -- 172.21.15.7:0/4246179948 learned_addr learned my addr 172.21.15.7:0/4246179948 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.024+0000 7fbd2be00640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57df2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd30a00640 1 -- 172.21.15.7:0/4246179948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 msgr2=0x55ab57df3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd31400640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57df3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd30a00640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57df3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd30a00640 1 -- 172.21.15.7:0/4246179948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 msgr2=0x55ab57df2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd30a00640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57df2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd30a00640 1 -- 172.21.15.7:0/4246179948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab57b15620 con 0x55ab57dd03c0 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd2be00640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57df2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd31400640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57df3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd30a00640 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57de7030 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fbd200044e0 tx=0x7fbd20004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c93a96232961dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd1d200640 1 -- 172.21.15.7:0/4246179948 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2001a530 con 0x55ab57dd03c0 2024-04-23T15:24:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd1d200640 1 -- 172.21.15.7:0/4246179948 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd200054d0 con 0x55ab57dd03c0 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.025+0000 7fbd1d200640 1 -- 172.21.15.7:0/4246179948 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004c00 con 0x55ab57dd03c0 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 -- 172.21.15.7:0/4246179948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 msgr2=0x55ab57de7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57de7030 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fbd200044e0 tx=0x7fbd20004080 comp rx=0 tx=0).stop 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 -- 172.21.15.7:0/4246179948 shutdown_connections 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57df2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57df3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 --2- 172.21.15.7:0/4246179948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57de7030 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 -- 172.21.15.7:0/4246179948 >> 172.21.15.7:0/4246179948 conn(0x55ab57dcc8d0 msgr2=0x55ab57dcccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 -- 172.21.15.7:0/4246179948 shutdown_connections 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.026+0000 7fbd3621b740 1 -- 172.21.15.7:0/4246179948 wait complete. 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.027+0000 7fbd3621b740 1 -- start start 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.027+0000 7fbd3621b740 1 Processor -- start 2024-04-23T15:24:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57dd5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57e50840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1b28c0 con 0x55ab57dd03c0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1b21f0 con 0x55ab57dd0ce0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c1af450 con 0x55ab57ddb5a0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd3621b740 10 client.0 _ll_register_callbacks cb 0x7fbd2000d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57dd5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57dd5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36078/0 (socket says 172.21.15.7:36078) 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd30a00640 1 -- 172.21.15.7:0/3043826541 learned_addr learned my addr 172.21.15.7:0/3043826541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.028+0000 7fbd31400640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57e50840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd30a00640 1 -- 172.21.15.7:0/3043826541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 msgr2=0x55ab57e50840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd30a00640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57e50840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd30a00640 1 -- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 msgr2=0x55ab57dd5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd30a00640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd30a00640 1 -- 172.21.15.7:0/3043826541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab57e50d80 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd30a00640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57dd5640 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fbd20004540 tx=0x7fbd200057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fc3a14a0a400ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd12000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.029+0000 7fbd12000640 1 -- 172.21.15.7:0/3043826541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004840 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd200054d0 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd12000640 1 -- 172.21.15.7:0/3043826541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fbd200049e0 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd12000640 1 -- 172.21.15.7:0/3043826541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd20035050 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd3621b740 10 client.18339 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ab57e51ea0 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd12000640 1 -- 172.21.15.7:0/3043826541 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd200054d0 con 0x55ab57dd03c0 2024-04-23T15:24:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd12000640 1 -- 172.21.15.7:0/3043826541 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbd20003680 con 0x55ab57dd03c0 2024-04-23T15:24:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd3621b740 10 client.18339 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd3621b740 10 client.18339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.030+0000 7fbd3621b740 20 client.18339 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.031+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57e52570 0x55ab57e54990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.031+0000 7fbd3621b740 4 client.18339 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:24:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.031+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab57d3e190 con 0x55ab57e52570 2024-04-23T15:24:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.031+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57e52570 0x55ab57e54990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.032+0000 7fbd12000640 10 client.18339 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.032+0000 7fbd2be00640 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57e52570 0x55ab57e54990 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc15ffbda03cf50b server_cookie=5b431626b5bbc07c in_seq=0 out_seq=0 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.060+0000 7fbd12000640 1 -- 172.21.15.7:0/3043826541 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab57d3e190 con 0x55ab57e52570 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.060+0000 7fbd12000640 10 client.18339 handle_command_reply: tid=0 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.060+0000 7fbd3621b740 1 client.18339 shutdown 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.060+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 msgr2=0x55ab57dd5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.060+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57dd5640 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fbd20004540 tx=0x7fbd200057e0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 shutdown_connections 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ab57e52570 0x55ab57e54990 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab57dd0ce0 0x55ab57dd5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ab57ddb5a0 0x55ab57e50840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 --2- 172.21.15.7:0/3043826541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab57dd03c0 0x55ab57dd5640 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 >> 172.21.15.7:0/3043826541 conn(0x55ab57dcc8d0 msgr2=0x55ab57dcb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd12000640 0 client.18339 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 shutdown_connections 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 1 -- 172.21.15.7:0/3043826541 wait complete. 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.061+0000 7fbd3621b740 20 client.18339 trim_cache size 0 max 16384 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:24:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:24:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd140a3d10 msgr2=0x7fbd140a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd140a3d10 0x7fbd140a61d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009a60 tx=0x7fbd24004a40 comp rx=0 tx=0).stop 2024-04-23T15:24:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 msgr2=0x7fbd2c10ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:31.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10ed20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800d740 tx=0x7fbd1800dc00 comp rx=0 tx=0).stop 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 shutdown_connections 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd140a3d10 0x7fbd140a61d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd2c10f260 0x7fbd2c1a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd2c106280 0x7fbd2c10ed20 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 --2- 172.21.15.7:0/3304526731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd2c1016d0 0x7fbd2c10e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 >> 172.21.15.7:0/3304526731 conn(0x7fbd2c077240 msgr2=0x7fbd2c1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 shutdown_connections 2024-04-23T15:24:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:31.062+0000 7fbd31e00640 1 -- 172.21.15.7:0/3304526731 wait complete. 2024-04-23T15:24:32.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:32 smithi186 ceph-mon[31814]: pgmap v1050: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 16 op/s 2024-04-23T15:24:32.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:32 smithi137 ceph-mon[31694]: pgmap v1050: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 16 op/s 2024-04-23T15:24:32.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:32 smithi007 ceph-mon[27906]: pgmap v1050: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 16 op/s 2024-04-23T15:24:34.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:34 smithi186 ceph-mon[31814]: pgmap v1051: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-04-23T15:24:34.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:34 smithi137 ceph-mon[31694]: pgmap v1051: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-04-23T15:24:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:34 smithi007 ceph-mon[27906]: pgmap v1051: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.0 MiB/s wr, 21 op/s 2024-04-23T15:24:36.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:36 smithi186 ceph-mon[31814]: pgmap v1052: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:24:36.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:36 smithi137 ceph-mon[31694]: pgmap v1052: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:24:36.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:36 smithi007 ceph-mon[27906]: pgmap v1052: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:24:38.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:38 smithi186 ceph-mon[31814]: pgmap v1053: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:24:38.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:38 smithi137 ceph-mon[31694]: pgmap v1053: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:24:38.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:38 smithi007 ceph-mon[27906]: pgmap v1053: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:24:40.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:40 smithi137 ceph-mon[31694]: pgmap v1054: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:24:40.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:40 smithi007 ceph-mon[27906]: pgmap v1054: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:24:40.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:40 smithi186 ceph-mon[31814]: pgmap v1054: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:24:42.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:42 smithi186 ceph-mon[31814]: pgmap v1055: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-04-23T15:24:42.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:42 smithi137 ceph-mon[31694]: pgmap v1055: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-04-23T15:24:42.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:42 smithi007 ceph-mon[27906]: pgmap v1055: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 15 op/s 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.215+0000 7fcf36e00640 1 -- 172.21.15.7:0/3674254650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30104c60 msgr2=0x7fcf30108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.215+0000 7fcf36e00640 1 --2- 172.21.15.7:0/3674254650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30104c60 0x7fcf30108ca0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009900 tx=0x7fcf1c02a410 comp rx=0 tx=0).stop 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 -- 172.21.15.7:0/3674254650 shutdown_connections 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 --2- 172.21.15.7:0/3674254650 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf30109380 0x7fcf30110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 --2- 172.21.15.7:0/3674254650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30104c60 0x7fcf30108ca0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 --2- 172.21.15.7:0/3674254650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf301042b0 0x7fcf30104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 -- 172.21.15.7:0/3674254650 >> 172.21.15.7:0/3674254650 conn(0x7fcf300ffb10 msgr2=0x7fcf30101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 -- 172.21.15.7:0/3674254650 shutdown_connections 2024-04-23T15:24:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.216+0000 7fcf36e00640 1 -- 172.21.15.7:0/3674254650 wait complete. 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 Processor -- start 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 -- start start 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf301042b0 0x7fcf301a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 0x7fcf301a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf3019a6b0 0x7fcf3019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf30114310 con 0x7fcf30109380 2024-04-23T15:24:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf30114190 con 0x7fcf301042b0 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.217+0000 7fcf36e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf30114490 con 0x7fcf3019a6b0 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 0x7fcf301a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 0x7fcf301a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33040/0 (socket says 172.21.15.7:33040) 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 -- 172.21.15.7:0/801082435 learned_addr learned my addr 172.21.15.7:0/801082435 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35a00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf301042b0 0x7fcf301a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf36400640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf3019a6b0 0x7fcf3019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 -- 172.21.15.7:0/801082435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf3019a6b0 msgr2=0x7fcf3019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf3019a6b0 0x7fcf3019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 -- 172.21.15.7:0/801082435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf301042b0 msgr2=0x7fcf301a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf301042b0 0x7fcf301a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.218+0000 7fcf35000640 1 -- 172.21.15.7:0/801082435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3019b2b0 con 0x7fcf30109380 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.219+0000 7fcf35000640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 0x7fcf301a0b30 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c005ab0 tx=0x7fcf1c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.219+0000 7fcf2e000640 1 -- 172.21.15.7:0/801082435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c03f070 con 0x7fcf30109380 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.219+0000 7fcf2e000640 1 -- 172.21.15.7:0/801082435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf1c031d60 con 0x7fcf30109380 2024-04-23T15:24:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.219+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3019b540 con 0x7fcf30109380 2024-04-23T15:24:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.219+0000 7fcf2e000640 1 -- 172.21.15.7:0/801082435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c035030 con 0x7fcf30109380 2024-04-23T15:24:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.219+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf301a7680 con 0x7fcf30109380 2024-04-23T15:24:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.223+0000 7fcf3b260740 1 Processor -- start 2024-04-23T15:24:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.223+0000 7fcf2e000640 1 -- 172.21.15.7:0/801082435 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fcf1c042070 con 0x7fcf30109380 2024-04-23T15:24:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.223+0000 7fcf3b260740 1 -- start start 2024-04-23T15:24:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f98f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f99c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf3b260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a73f8f5900 con 0x55a73f99a5a0 2024-04-23T15:24:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf3b260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a73f89bf20 con 0x55a73f98f3c0 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf3b260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a73f8f18c0 con 0x55a73f98fce0 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf35000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f99c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf35000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f99c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33042/0 (socket says 172.21.15.7:33042) 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf35000640 1 -- 172.21.15.7:0/2077383326 learned_addr learned my addr 172.21.15.7:0/2077383326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf36400640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f98f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.224+0000 7fcf35a00640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35000640 1 -- 172.21.15.7:0/2077383326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 msgr2=0x55a73f99a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35000640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35000640 1 -- 172.21.15.7:0/2077383326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 msgr2=0x55a73f98f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35000640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f98f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35000640 1 -- 172.21.15.7:0/2077383326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a73f8c0e10 con 0x55a73f99a5a0 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35a00640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:24:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf36400640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f98f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf2e000640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf180a3d10 0x7fcf180a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf35000640 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f99c990 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0ee760 tx=0x7fcf1c0f76e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1035716a087c58eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf2e000640 1 -- 172.21.15.7:0/801082435 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fcf1c0f14e0 con 0x7fcf30109380 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.225+0000 7fcf36400640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf180a3d10 0x7fcf180a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.226+0000 7fcf22a00640 1 -- 172.21.15.7:0/2077383326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0b9310 con 0x55a73f99a5a0 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.226+0000 7fcf22a00640 1 -- 172.21.15.7:0/2077383326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf1c0bd770 con 0x55a73f99a5a0 2024-04-23T15:24:44.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.226+0000 7fcf22a00640 1 -- 172.21.15.7:0/2077383326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0bc9d0 con 0x55a73f99a5a0 2024-04-23T15:24:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 -- 172.21.15.7:0/2077383326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 msgr2=0x55a73f99c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f99c990 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0ee760 tx=0x7fcf1c0f76e0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf36400640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf180a3d10 0x7fcf180a61d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf280092f0 tx=0x7fcf28009280 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 -- 172.21.15.7:0/2077383326 shutdown_connections 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f99c990 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2077383326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f98f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 -- 172.21.15.7:0/2077383326 >> 172.21.15.7:0/2077383326 conn(0x55a73f98b8d0 msgr2=0x55a73f98bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 -- 172.21.15.7:0/2077383326 shutdown_connections 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 -- 172.21.15.7:0/2077383326 wait complete. 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.227+0000 7fcf3b260740 1 -- start start 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 Processor -- start 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f9975a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f997ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f998020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a73f99cf90 con 0x55a73f99a5a0 2024-04-23T15:24:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a73f8af2c0 con 0x55a73f98f3c0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a73f99d110 con 0x55a73f98fce0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.228+0000 7fcf3b260740 10 client.0 _ll_register_callbacks cb 0x55a73f607a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f998020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f998020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33044/0 (socket says 172.21.15.7:33044) 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 -- 172.21.15.7:0/210461516 learned_addr learned my addr 172.21.15.7:0/210461516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf35000640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f997ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf35a00640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f9975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 -- 172.21.15.7:0/210461516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 msgr2=0x55a73f997ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f997ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 -- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 msgr2=0x55a73f9975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f9975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf36400640 1 -- 172.21.15.7:0/210461516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a73f8bffd0 con 0x55a73f99a5a0 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.229+0000 7fcf35a00640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f9975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:24:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.230+0000 7fcf36400640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f998020 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009d40 tx=0x7fcf28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28bd12aa87700b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.230+0000 7fcf17400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.230+0000 7fcf17400640 1 -- 172.21.15.7:0/210461516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800eaa0 con 0x55a73f99a5a0 2024-04-23T15:24:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.230+0000 7fcf17400640 1 -- 172.21.15.7:0/210461516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fcf2800ec40 con 0x55a73f99a5a0 2024-04-23T15:24:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.230+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf1c0bd770 con 0x55a73f99a5a0 2024-04-23T15:24:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.230+0000 7fcf17400640 1 -- 172.21.15.7:0/210461516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcf28030050 con 0x55a73f99a5a0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 10 client.18351 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a73f608210 con 0x55a73f99a5a0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf17400640 1 -- 172.21.15.7:0/210461516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf1c0bd770 con 0x55a73f99a5a0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf17400640 1 -- 172.21.15.7:0/210461516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fcf2800f040 con 0x55a73f99a5a0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 10 client.18351 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 10 client.18351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 20 client.18351 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73f9aa4d0 0x55a73f9ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 4 client.18351 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.231+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a73f903320 con 0x55a73f9aa4d0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.232+0000 7fcf35a00640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73f9aa4d0 0x55a73f9ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.233+0000 7fcf35a00640 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73f9aa4d0 0x55a73f9ac8c0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4ff4b3a554e29cb server_cookie=1ffd8c187dfb6b0c in_seq=0 out_seq=0 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.233+0000 7fcf17400640 10 client.18351 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf17400640 1 -- 172.21.15.7:0/210461516 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a73f903320 con 0x55a73f9aa4d0 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf17400640 10 client.18351 handle_command_reply: tid=0 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 client.18351 shutdown 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 msgr2=0x55a73f998020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f998020 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009d40 tx=0x7fcf28004a40 comp rx=0 tx=0).stop 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 shutdown_connections 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73f9aa4d0 0x55a73f9ac8c0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f99a5a0 0x55a73f998020 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f997ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 --2- 172.21.15.7:0/210461516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f98f3c0 0x55a73f9975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 >> 172.21.15.7:0/210461516 conn(0x55a73f98b8d0 msgr2=0x55a73f991600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf17400640 0 client.18351 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 shutdown_connections 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 1 -- 172.21.15.7:0/210461516 wait complete. 2024-04-23T15:24:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.235+0000 7fcf3b260740 20 client.18351 trim_cache size 0 max 16384 2024-04-23T15:24:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 Processor -- start 2024-04-23T15:24:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 -- start start 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f9a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f991d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f9b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf301b1480 con 0x55a73f98f3c0 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf301b2fc0 con 0x55a73f99a5a0 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.253+0000 7fcf3b260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf301b1b50 con 0x55a73f98fce0 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f9a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f9a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33046/0 (socket says 172.21.15.7:33046) 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 -- 172.21.15.7:0/205352048 learned_addr learned my addr 172.21.15.7:0/205352048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:44.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35000640 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f991d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf36400640 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f9b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 -- 172.21.15.7:0/205352048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 msgr2=0x55a73f991d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f991d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 -- 172.21.15.7:0/205352048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 msgr2=0x55a73f9b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f9b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.254+0000 7fcf35a00640 1 -- 172.21.15.7:0/205352048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a73f6d4620 con 0x55a73f98f3c0 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.255+0000 7fcf35a00640 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f9a5dc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcf240058c0 tx=0x7fcf24005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3527f870d1b05d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.255+0000 7fcf22000640 1 -- 172.21.15.7:0/205352048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2401bc80 con 0x55a73f98f3c0 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.255+0000 7fcf22000640 1 -- 172.21.15.7:0/205352048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf2401be20 con 0x55a73f98f3c0 2024-04-23T15:24:44.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.255+0000 7fcf22000640 1 -- 172.21.15.7:0/205352048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf240035f0 con 0x55a73f98f3c0 2024-04-23T15:24:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 -- 172.21.15.7:0/205352048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 msgr2=0x55a73f9a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f9a5dc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcf240058c0 tx=0x7fcf24005850 comp rx=0 tx=0).stop 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 -- 172.21.15.7:0/205352048 shutdown_connections 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f9b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f991d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 --2- 172.21.15.7:0/205352048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f9a5dc0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 -- 172.21.15.7:0/205352048 >> 172.21.15.7:0/205352048 conn(0x55a73f98b8d0 msgr2=0x55a73f997df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 -- 172.21.15.7:0/205352048 shutdown_connections 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 -- 172.21.15.7:0/205352048 wait complete. 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.256+0000 7fcf3b260740 1 -- start start 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 Processor -- start 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f99ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f99e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf301b28f0 con 0x55a73f98f3c0 2024-04-23T15:24:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf301b2220 con 0x55a73f99a5a0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf301af480 con 0x55a73f98fce0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf3b260740 10 client.0 _ll_register_callbacks cb 0x7fcf280096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.257+0000 7fcf35a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f99ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f99ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33052/0 (socket says 172.21.15.7:33052) 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 -- 172.21.15.7:0/2390767234 learned_addr learned my addr 172.21.15.7:0/2390767234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35000640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf36400640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f99e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 -- 172.21.15.7:0/2390767234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 msgr2=0x55a73f99e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 -- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 msgr2=0x55a73f99e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f99e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 -- 172.21.15.7:0/2390767234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a73fa0fb20 con 0x55a73f98f3c0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf35a00640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f99ddf0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcf24000c00 tx=0x7fcf2400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271ac422801b04e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.258+0000 7fcf17400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf17400640 1 -- 172.21.15.7:0/2390767234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2401b530 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf17400640 1 -- 172.21.15.7:0/2390767234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7fcf24005040 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf2401be20 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf17400640 1 -- 172.21.15.7:0/2390767234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcf24036050 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf3b260740 10 client.18357 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a73fa10e30 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.259+0000 7fcf17400640 1 -- 172.21.15.7:0/2390767234 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf2401be20 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf17400640 1 -- 172.21.15.7:0/2390767234 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fcf24004c30 con 0x55a73f98f3c0 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf3b260740 10 client.18357 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf3b260740 10 client.18357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf3b260740 20 client.18357 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73fa114c0 0x55a73fa138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf3b260740 4 client.18357 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:24:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a73f8fd190 con 0x55a73fa114c0 2024-04-23T15:24:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.260+0000 7fcf35000640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73fa114c0 0x55a73fa138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.261+0000 7fcf35000640 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73fa114c0 0x55a73fa138e0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c48af3d9eb0230f server_cookie=16179df478a81e7d in_seq=0 out_seq=0 2024-04-23T15:24:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.261+0000 7fcf17400640 10 client.18357 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf17400640 1 -- 172.21.15.7:0/2390767234 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a73f8fd190 con 0x55a73fa114c0 2024-04-23T15:24:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf17400640 10 client.18357 handle_command_reply: tid=0 2024-04-23T15:24:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 client.18357 shutdown 2024-04-23T15:24:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 msgr2=0x55a73f99ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f99ddf0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcf24000c00 tx=0x7fcf2400ff90 comp rx=0 tx=0).stop 2024-04-23T15:24:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 shutdown_connections 2024-04-23T15:24:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a73fa114c0 0x55a73fa138e0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a73f99a5a0 0x55a73f99e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a73f98fce0 0x55a73f99e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 --2- 172.21.15.7:0/2390767234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a73f98f3c0 0x55a73f99ddf0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf17400640 0 client.18357 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.292+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 >> 172.21.15.7:0/2390767234 conn(0x55a73f98b8d0 msgr2=0x55a73f98a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.293+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 shutdown_connections 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.293+0000 7fcf3b260740 1 -- 172.21.15.7:0/2390767234 wait complete. 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.293+0000 7fcf3b260740 20 client.18357 trim_cache size 0 max 16384 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:24:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:24:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf180a3d10 msgr2=0x7fcf180a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf180a3d10 0x7fcf180a61d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf280092f0 tx=0x7fcf28009280 comp rx=0 tx=0).stop 2024-04-23T15:24:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 msgr2=0x7fcf301a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 0x7fcf301a0b30 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c005ab0 tx=0x7fcf1c003cd0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 shutdown_connections 2024-04-23T15:24:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf180a3d10 0x7fcf180a61d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf3019a6b0 0x7fcf3019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf30109380 0x7fcf301a0b30 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 --2- 172.21.15.7:0/801082435 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf301042b0 0x7fcf301a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 >> 172.21.15.7:0/801082435 conn(0x7fcf300ffb10 msgr2=0x7fcf30101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 shutdown_connections 2024-04-23T15:24:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:44.294+0000 7fcf36e00640 1 -- 172.21.15.7:0/801082435 wait complete. 2024-04-23T15:24:44.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:44 smithi137 ceph-mon[31694]: pgmap v1056: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-04-23T15:24:44.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:44 smithi007 ceph-mon[27906]: pgmap v1056: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-04-23T15:24:44.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:44 smithi186 ceph-mon[31814]: pgmap v1056: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 15 op/s 2024-04-23T15:24:46.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:46 smithi137 ceph-mon[31694]: pgmap v1057: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:24:46.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:46 smithi007 ceph-mon[27906]: pgmap v1057: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:24:46.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:46 smithi186 ceph-mon[31814]: pgmap v1057: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:24:48.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:48 smithi137 ceph-mon[31694]: pgmap v1058: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:24:48.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:48 smithi007 ceph-mon[27906]: pgmap v1058: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:24:48.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:48 smithi186 ceph-mon[31814]: pgmap v1058: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:24:50.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:50 smithi137 ceph-mon[31694]: pgmap v1059: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:50.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:50 smithi007 ceph-mon[27906]: pgmap v1059: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:50.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:50 smithi186 ceph-mon[31814]: pgmap v1059: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:24:52.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:52 smithi137 ceph-mon[31694]: pgmap v1060: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 17 op/s 2024-04-23T15:24:52.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:52 smithi007 ceph-mon[27906]: pgmap v1060: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 17 op/s 2024-04-23T15:24:52.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:52 smithi186 ceph-mon[31814]: pgmap v1060: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 17 op/s 2024-04-23T15:24:54.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:54 smithi137 ceph-mon[31694]: pgmap v1061: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:24:54.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:54 smithi007 ceph-mon[27906]: pgmap v1061: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:24:54.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:54 smithi186 ceph-mon[31814]: pgmap v1061: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:24:56.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:56 smithi007 ceph-mon[27906]: pgmap v1062: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:24:56.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:56 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:24:56.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:56 smithi186 ceph-mon[31814]: pgmap v1062: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:24:56.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:56 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:24:56.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:56 smithi137 ceph-mon[31694]: pgmap v1062: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:24:56.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:56 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:24:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 -- 172.21.15.7:0/2978940893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0101550 msgr2=0x7f02e010e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 --2- 172.21.15.7:0/2978940893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0101550 0x7f02e010e210 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009900 tx=0x7f02cc02a410 comp rx=0 tx=0).stop 2024-04-23T15:24:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 -- 172.21.15.7:0/2978940893 shutdown_connections 2024-04-23T15:24:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 --2- 172.21.15.7:0/2978940893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02e010e750 0x7f02e0110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 --2- 172.21.15.7:0/2978940893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0101550 0x7f02e010e210 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 --2- 172.21.15.7:0/2978940893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e0100ba0 0x7f02e0100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 -- 172.21.15.7:0/2978940893 >> 172.21.15.7:0/2978940893 conn(0x7f02e00fc820 msgr2=0x7f02e00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 -- 172.21.15.7:0/2978940893 shutdown_connections 2024-04-23T15:24:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.451+0000 7f02e5800640 1 -- 172.21.15.7:0/2978940893 wait complete. 2024-04-23T15:24:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.452+0000 7f02e5800640 1 Processor -- start 2024-04-23T15:24:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.452+0000 7f02e5800640 1 -- start start 2024-04-23T15:24:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02e5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 0x7f02e01a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02e5800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02e0101550 0x7f02e01a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02e5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e010e750 0x7f02e019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02e5800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01142a0 con 0x7f02e0100ba0 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02e5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0114120 con 0x7f02e010e750 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02e5800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0114420 con 0x7f02e0101550 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 0x7f02e01a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 0x7f02e01a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46072/0 (socket says 172.21.15.7:46072) 2024-04-23T15:24:57.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.453+0000 7f02dfe00640 1 -- 172.21.15.7:0/2551127118 learned_addr learned my addr 172.21.15.7:0/2551127118 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:57.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02df400640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02e0101550 0x7f02e01a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02e4e00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e010e750 0x7f02e019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dfe00640 1 -- 172.21.15.7:0/2551127118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02e0101550 msgr2=0x7f02e01a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dfe00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02e0101550 0x7f02e01a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dfe00640 1 -- 172.21.15.7:0/2551127118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e010e750 msgr2=0x7f02e019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dfe00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e010e750 0x7f02e019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dfe00640 1 -- 172.21.15.7:0/2551127118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e019afe0 con 0x7f02e0100ba0 2024-04-23T15:24:57.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dfe00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 0x7f02e01a0660 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f02d000e9f0 tx=0x7f02d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:57.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02dcc00640 1 -- 172.21.15.7:0/2551127118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d000cd80 con 0x7f02e0100ba0 2024-04-23T15:24:57.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.454+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e019b2d0 con 0x7f02e0100ba0 2024-04-23T15:24:57.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.455+0000 7f02dcc00640 1 -- 172.21.15.7:0/2551127118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02d00054d0 con 0x7f02e0100ba0 2024-04-23T15:24:57.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.455+0000 7f02dcc00640 1 -- 172.21.15.7:0/2551127118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0010490 con 0x7f02e0100ba0 2024-04-23T15:24:57.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.455+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e01a75e0 con 0x7f02e0100ba0 2024-04-23T15:24:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.459+0000 7f02dcc00640 1 -- 172.21.15.7:0/2551127118 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f02d0005020 con 0x7f02e0100ba0 2024-04-23T15:24:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.459+0000 7f02e9c05740 1 Processor -- start 2024-04-23T15:24:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.459+0000 7f02e9c05740 1 -- start start 2024-04-23T15:24:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x5617244527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 0x56172445d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56172445d5a0 0x56172445f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02e9c05740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617243b8900 con 0x561724452ce0 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02e9c05740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56172435ef20 con 0x56172445d5a0 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02e9c05740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5617243b48c0 con 0x5617244523c0 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 0x56172445d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 0x56172445d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46086/0 (socket says 172.21.15.7:46086) 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.460+0000 7f02dfe00640 1 -- 172.21.15.7:0/3410363423 learned_addr learned my addr 172.21.15.7:0/3410363423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02df400640 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56172445d5a0 0x56172445f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02e4e00640 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x5617244527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dcc00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f02c40a3d90 0x7f02c40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dcc00640 1 -- 172.21.15.7:0/2551127118 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7f02d00d0fe0 con 0x7f02e0100ba0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02e4e00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f02c40a3d90 0x7f02c40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dfe00640 1 -- 172.21.15.7:0/3410363423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 msgr2=0x5617244527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dfe00640 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x5617244527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dfe00640 1 -- 172.21.15.7:0/3410363423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56172445d5a0 msgr2=0x56172445f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dfe00640 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56172445d5a0 0x56172445f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.461+0000 7f02dfe00640 1 -- 172.21.15.7:0/3410363423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561724383e10 con 0x561724452ce0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.462+0000 7f02dfe00640 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 0x56172445d060 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f02d009cb60 tx=0x7f02d0009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fdad2facf4a98b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.462+0000 7f02d5600640 1 -- 172.21.15.7:0/3410363423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0005310 con 0x561724452ce0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.462+0000 7f02d5600640 1 -- 172.21.15.7:0/3410363423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02d0005680 con 0x561724452ce0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.462+0000 7f02d5600640 1 -- 172.21.15.7:0/3410363423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d00a5840 con 0x561724452ce0 2024-04-23T15:24:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.462+0000 7f02e4e00640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f02c40a3d90 0x7f02c40a6250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009fd0 tx=0x7f02d8004ab0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 -- 172.21.15.7:0/3410363423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 msgr2=0x56172445d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 0x56172445d060 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f02d009cb60 tx=0x7f02d0009720 comp rx=0 tx=0).stop 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 -- 172.21.15.7:0/3410363423 shutdown_connections 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56172445d5a0 0x56172445f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561724452ce0 0x56172445d060 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3410363423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x5617244527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 -- 172.21.15.7:0/3410363423 >> 172.21.15.7:0/3410363423 conn(0x56172444e8d0 msgr2=0x56172444ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 -- 172.21.15.7:0/3410363423 shutdown_connections 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.463+0000 7f02e9c05740 1 -- 172.21.15.7:0/3410363423 wait complete. 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.464+0000 7f02e9c05740 1 -- start start 2024-04-23T15:24:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.464+0000 7f02e9c05740 1 Processor -- start 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x56172445a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172445abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56172445ffc0 con 0x56172445d5a0 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5617243722c0 con 0x561724452ce0 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561724460140 con 0x5617244523c0 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e9c05740 10 client.0 _ll_register_callbacks cb 0x5617240caa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46092/0 (socket says 172.21.15.7:46092) 2024-04-23T15:24:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02e4e00640 1 -- 172.21.15.7:0/1131424838 learned_addr learned my addr 172.21.15.7:0/1131424838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.465+0000 7f02df400640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172445abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02dfe00640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x56172445a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02e4e00640 1 -- 172.21.15.7:0/1131424838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 msgr2=0x56172445a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02e4e00640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x56172445a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02e4e00640 1 -- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 msgr2=0x56172445abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02e4e00640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172445abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02e4e00640 1 -- 172.21.15.7:0/1131424838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561724382fd0 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02e4e00640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445b100 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f02d80116d0 tx=0x7f02d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c50d576ac9facd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02ca000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.466+0000 7f02ca000640 1 -- 172.21.15.7:0/1131424838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d800fa50 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.467+0000 7f02ca000640 1 -- 172.21.15.7:0/1131424838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7f02d800fbf0 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.467+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02d0005680 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.467+0000 7f02ca000640 1 -- 172.21.15.7:0/1131424838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f02d8030050 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.467+0000 7f02e9c05740 10 client.18369 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.467+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5617240cb210 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.467+0000 7f02ca000640 1 -- 172.21.15.7:0/1131424838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02d0005680 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02ca000640 1 -- 172.21.15.7:0/1131424838 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f02d801b040 con 0x56172445d5a0 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02e9c05740 10 client.18369 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02e9c05740 10 client.18369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02e9c05740 20 client.18369 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:57.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02e9c05740 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56172446d6c0 0x56172446fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02e9c05740 4 client.18369 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:24:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.468+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617243c6320 con 0x56172446d6c0 2024-04-23T15:24:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.469+0000 7f02dfe00640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56172446d6c0 0x56172446fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.469+0000 7f02ca000640 10 client.18369 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:57.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.469+0000 7f02dfe00640 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56172446d6c0 0x56172446fab0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca65f3f8ad540f6e server_cookie=32f9eabc9f5d0793 in_seq=0 out_seq=0 2024-04-23T15:24:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.471+0000 7f02ca000640 1 -- 172.21.15.7:0/1131424838 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617243c6320 con 0x56172446d6c0 2024-04-23T15:24:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.471+0000 7f02ca000640 10 client.18369 handle_command_reply: tid=0 2024-04-23T15:24:57.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.471+0000 7f02e9c05740 1 client.18369 shutdown 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.471+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 msgr2=0x56172445b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.471+0000 7f02e9c05740 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445b100 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f02d80116d0 tx=0x7f02d8004a40 comp rx=0 tx=0).stop 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 shutdown_connections 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56172446d6c0 0x56172446fab0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172445abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445b100 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 --2- 172.21.15.7:0/1131424838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x56172445a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02ca000640 0 client.18369 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 >> 172.21.15.7:0/1131424838 conn(0x56172444e8d0 msgr2=0x56172444da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 shutdown_connections 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 1 -- 172.21.15.7:0/1131424838 wait complete. 2024-04-23T15:24:57.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.472+0000 7f02e9c05740 20 client.18369 trim_cache size 0 max 16384 2024-04-23T15:24:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 Processor -- start 2024-04-23T15:24:57.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 -- start start 2024-04-23T15:24:57.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x561724468f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172444e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b15a0 con 0x56172445d5a0 2024-04-23T15:24:57.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b30e0 con 0x561724452ce0 2024-04-23T15:24:57.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.489+0000 7f02e9c05740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b1c70 con 0x5617244523c0 2024-04-23T15:24:57.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46098/0 (socket says 172.21.15.7:46098) 2024-04-23T15:24:57.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 -- 172.21.15.7:0/3747880017 learned_addr learned my addr 172.21.15.7:0/3747880017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:57.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02df400640 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172444e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 -- 172.21.15.7:0/3747880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 msgr2=0x561724468f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x561724468f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 -- 172.21.15.7:0/3747880017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 msgr2=0x56172444e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172444e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.490+0000 7f02e4e00640 1 -- 172.21.15.7:0/3747880017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561724197620 con 0x56172445d5a0 2024-04-23T15:24:57.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.491+0000 7f02e4e00640 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445c4b0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000f80 tx=0x7f02d8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542878958968b8a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.491+0000 7f02d4c00640 1 -- 172.21.15.7:0/3747880017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8038020 con 0x56172445d5a0 2024-04-23T15:24:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.491+0000 7f02d4c00640 1 -- 172.21.15.7:0/3747880017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02d802d070 con 0x56172445d5a0 2024-04-23T15:24:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.491+0000 7f02d4c00640 1 -- 172.21.15.7:0/3747880017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d800fcf0 con 0x56172445d5a0 2024-04-23T15:24:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 -- 172.21.15.7:0/3747880017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 msgr2=0x56172445c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445c4b0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000f80 tx=0x7f02d8011f60 comp rx=0 tx=0).stop 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 -- 172.21.15.7:0/3747880017 shutdown_connections 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561724452ce0 0x56172444e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x56172445c4b0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3747880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5617244523c0 0x561724468f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.492+0000 7f02e9c05740 1 -- 172.21.15.7:0/3747880017 >> 172.21.15.7:0/3747880017 conn(0x56172444e8d0 msgr2=0x56172445bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.493+0000 7f02e9c05740 1 -- 172.21.15.7:0/3747880017 shutdown_connections 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.493+0000 7f02e9c05740 1 -- 172.21.15.7:0/3747880017 wait complete. 2024-04-23T15:24:57.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.494+0000 7f02e9c05740 1 -- start start 2024-04-23T15:24:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.494+0000 7f02e9c05740 1 Processor -- start 2024-04-23T15:24:57.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 0x561724457760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561724452ce0 0x561724457ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x5617244d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b2a10 con 0x56172445d5a0 2024-04-23T15:24:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b2340 con 0x5617244523c0 2024-04-23T15:24:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01af5a0 con 0x561724452ce0 2024-04-23T15:24:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e9c05740 10 client.0 _ll_register_callbacks cb 0x7f02d8009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02dfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 0x561724457760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02e4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x5617244d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02dfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 0x561724457760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:60380/0 (socket says 172.21.15.7:60380) 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.495+0000 7f02dfe00640 1 -- 172.21.15.7:0/3182469987 learned_addr learned my addr 172.21.15.7:0/3182469987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02df400640 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561724452ce0 0x561724457ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02dfe00640 1 -- 172.21.15.7:0/3182469987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561724452ce0 msgr2=0x561724457ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02dfe00640 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561724452ce0 0x561724457ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02dfe00640 1 -- 172.21.15.7:0/3182469987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 msgr2=0x5617244d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:24:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02dfe00640 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x5617244d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02dfe00640 1 -- 172.21.15.7:0/3182469987 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617244d3150 con 0x5617244523c0 2024-04-23T15:24:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02dfe00640 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 0x561724457760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f02d009cb60 tx=0x7f02d00d12e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8faea12064f093d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:24:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.496+0000 7f02ca000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.497+0000 7f02ca000640 1 -- 172.21.15.7:0/3182469987 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0005680 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.497+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02d802d070 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.497+0000 7f02ca000640 1 -- 172.21.15.7:0/3182469987 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 9467+0+0 (secure 0 0 0) 0x7f02d0016d90 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.497+0000 7f02ca000640 1 -- 172.21.15.7:0/3182469987 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f02d009d2d0 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.497+0000 7f02e9c05740 10 client.37307 fetch_fsmap learned FSMap version 32 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.497+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5617244d42c0 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02ca000640 1 -- 172.21.15.7:0/3182469987 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02d802d070 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02ca000640 1 -- 172.21.15.7:0/3182469987 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f02d00bd0b0 con 0x5617244523c0 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02e9c05740 10 client.37307 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:24:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02e9c05740 10 client.37307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02e9c05740 20 client.37307 populate_metadata read hostname 'smithi007' 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617244d4600 0x5617244d69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02e9c05740 4 client.37307 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.498+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617243c0190 con 0x5617244d4600 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.499+0000 7f02df400640 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617244d4600 0x5617244d69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.499+0000 7f02df400640 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617244d4600 0x5617244d69f0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e65201d28abd8dd server_cookie=6924bc2db0eb61bf in_seq=0 out_seq=0 2024-04-23T15:24:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.499+0000 7f02ca000640 10 client.37307 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:57.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02ca000640 1 -- 172.21.15.7:0/3182469987 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617243c0190 con 0x5617244d4600 2024-04-23T15:24:57.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02ca000640 10 client.37307 handle_command_reply: tid=0 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 client.37307 shutdown 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 msgr2=0x561724457760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 0x561724457760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f02d009cb60 tx=0x7f02d00d12e0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 shutdown_connections 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5617244d4600 0x5617244d69f0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56172445d5a0 0x5617244d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561724452ce0 0x561724457ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 --2- 172.21.15.7:0/3182469987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617244523c0 0x561724457760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02ca000640 0 client.37307 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 >> 172.21.15.7:0/3182469987 conn(0x56172444e8d0 msgr2=0x56172445aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 shutdown_connections 2024-04-23T15:24:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.520+0000 7f02e9c05740 1 -- 172.21.15.7:0/3182469987 wait complete. 2024-04-23T15:24:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e9c05740 20 client.37307 trim_cache size 0 max 16384 2024-04-23T15:24:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:24:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:24:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:24:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f02c40a3d90 msgr2=0x7f02c40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f02c40a3d90 0x7f02c40a6250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009fd0 tx=0x7f02d8004ab0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 msgr2=0x7f02e01a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 0x7f02e01a0660 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f02d000e9f0 tx=0x7f02d000edf0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 shutdown_connections 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f02c40a3d90 0x7f02c40a6250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e010e750 0x7f02e019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02e0101550 0x7f02e01a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 --2- 172.21.15.7:0/2551127118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e0100ba0 0x7f02e01a0660 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.521+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 >> 172.21.15.7:0/2551127118 conn(0x7f02e00fc820 msgr2=0x7f02e00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:24:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.522+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 shutdown_connections 2024-04-23T15:24:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:24:57.522+0000 7f02e5800640 1 -- 172.21.15.7:0/2551127118 wait complete. 2024-04-23T15:24:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:57 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:24:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:57 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:24:57.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:57 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:24:57.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:57 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:24:57.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:57 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:24:57.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:57 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:24:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:57 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:24:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:57 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:24:57.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:57 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:24:58.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:24:58 smithi007 ceph-mon[27906]: pgmap v1063: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:24:58.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:24:58 smithi186 ceph-mon[31814]: pgmap v1063: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:24:58.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:24:58 smithi137 ceph-mon[31694]: pgmap v1063: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:00.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:00 smithi007 ceph-mon[27906]: pgmap v1064: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:25:00.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:00 smithi186 ceph-mon[31814]: pgmap v1064: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:25:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:00 smithi137 ceph-mon[31694]: pgmap v1064: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:25:02.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:02 smithi007 ceph-mon[27906]: pgmap v1065: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.9 MiB/s wr, 30 op/s 2024-04-23T15:25:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:02 smithi186 ceph-mon[31814]: pgmap v1065: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.9 MiB/s wr, 30 op/s 2024-04-23T15:25:02.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:02 smithi137 ceph-mon[31694]: pgmap v1065: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.9 MiB/s wr, 30 op/s 2024-04-23T15:25:04.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:04 smithi007 ceph-mon[27906]: pgmap v1066: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.6 MiB/s wr, 31 op/s 2024-04-23T15:25:04.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:04 smithi186 ceph-mon[31814]: pgmap v1066: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.6 MiB/s wr, 31 op/s 2024-04-23T15:25:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:04 smithi137 ceph-mon[31694]: pgmap v1066: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.6 MiB/s wr, 31 op/s 2024-04-23T15:25:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:06 smithi007 ceph-mon[27906]: pgmap v1067: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.6 MiB/s wr, 30 op/s 2024-04-23T15:25:06.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:06 smithi186 ceph-mon[31814]: pgmap v1067: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.6 MiB/s wr, 30 op/s 2024-04-23T15:25:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:06 smithi137 ceph-mon[31694]: pgmap v1067: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.6 MiB/s wr, 30 op/s 2024-04-23T15:25:08.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:08 smithi007 ceph-mon[27906]: pgmap v1068: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:25:08.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:08 smithi007 ceph-mon[27906]: osdmap e147: 12 total, 12 up, 12 in 2024-04-23T15:25:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:08 smithi186 ceph-mon[31814]: pgmap v1068: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:25:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:08 smithi186 ceph-mon[31814]: osdmap e147: 12 total, 12 up, 12 in 2024-04-23T15:25:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:08 smithi137 ceph-mon[31694]: pgmap v1068: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.1 MiB/s wr, 36 op/s 2024-04-23T15:25:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:08 smithi137 ceph-mon[31694]: osdmap e147: 12 total, 12 up, 12 in 2024-04-23T15:25:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 -- 172.21.15.7:0/3575715590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104e20 msgr2=0x7f676c108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 --2- 172.21.15.7:0/3575715590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104e20 0x7f676c108e60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f6754009900 tx=0x7f675402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 -- 172.21.15.7:0/3575715590 shutdown_connections 2024-04-23T15:25:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 --2- 172.21.15.7:0/3575715590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c109540 0x7f676c111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 --2- 172.21.15.7:0/3575715590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104e20 0x7f676c108e60 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 --2- 172.21.15.7:0/3575715590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c104470 0x7f676c104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 -- 172.21.15.7:0/3575715590 >> 172.21.15.7:0/3575715590 conn(0x7f676c0ffcd0 msgr2=0x7f676c1020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 -- 172.21.15.7:0/3575715590 shutdown_connections 2024-04-23T15:25:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.682+0000 7f6771200640 1 -- 172.21.15.7:0/3575715590 wait complete. 2024-04-23T15:25:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 Processor -- start 2024-04-23T15:25:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 -- start start 2024-04-23T15:25:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 0x7f676c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c109540 0x7f676c1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c19a780 0x7f676c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1144e0 con 0x7f676c104470 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f676c114360 con 0x7f676c109540 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.683+0000 7f6771200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f676c114660 con 0x7f676c19a780 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 0x7f676c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 0x7f676c1a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50116/0 (socket says 172.21.15.7:50116) 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 -- 172.21.15.7:0/2942199005 learned_addr learned my addr 172.21.15.7:0/2942199005 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6763e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c109540 0x7f676c1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f676a800640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c19a780 0x7f676c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 -- 172.21.15.7:0/2942199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c19a780 msgr2=0x7f676c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c19a780 0x7f676c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 -- 172.21.15.7:0/2942199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c109540 msgr2=0x7f676c1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c109540 0x7f676c1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6769e00640 1 -- 172.21.15.7:0/2942199005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c19b380 con 0x7f676c104470 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f676a800640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c19a780 0x7f676c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.684+0000 7f6763e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c109540 0x7f676c1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.685+0000 7f6769e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 0x7f676c1a0670 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c920 tx=0x7f675c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.685+0000 7f6762a00640 1 -- 172.21.15.7:0/2942199005 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c007c70 con 0x7f676c104470 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.685+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c1a7410 con 0x7f676c104470 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.685+0000 7f6762a00640 1 -- 172.21.15.7:0/2942199005 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f675c007e10 con 0x7f676c104470 2024-04-23T15:25:10.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.685+0000 7f6762a00640 1 -- 172.21.15.7:0/2942199005 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c018820 con 0x7f676c104470 2024-04-23T15:25:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.685+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c1a7870 con 0x7f676c104470 2024-04-23T15:25:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 Processor -- start 2024-04-23T15:25:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6762a00640 1 -- 172.21.15.7:0/2942199005 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f675c0189c0 con 0x7f676c104470 2024-04-23T15:25:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 -- start start 2024-04-23T15:25:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 0x561abb95d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb967e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb968390 0x561abb96a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561abb8c3900 con 0x561abb95d1b0 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561abb869f20 con 0x561abb968390 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.689+0000 7f6773fdc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561abb8bf8c0 con 0x561abb95dad0 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 0x561abb95d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 0x561abb95d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50126/0 (socket says 172.21.15.7:50126) 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 -- 172.21.15.7:0/1857936897 learned_addr learned my addr 172.21.15.7:0/1857936897 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f6769e00640 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb967e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f6763e00640 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb968390 0x561abb96a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 -- 172.21.15.7:0/1857936897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 msgr2=0x561abb967e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb967e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 -- 172.21.15.7:0/1857936897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb968390 msgr2=0x561abb96a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb968390 0x561abb96a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.690+0000 7f676a800640 1 -- 172.21.15.7:0/1857936897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abb88ee10 con 0x561abb95d1b0 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f676a800640 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 0x561abb95d590 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f6764007f30 tx=0x7f676400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7460e8e6bb334765 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f6762a00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f67500a3e40 0x7f67500a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f675b400640 1 -- 172.21.15.7:0/1857936897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764014070 con 0x561abb95d1b0 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f675b400640 1 -- 172.21.15.7:0/1857936897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f676400fd00 con 0x561abb95d1b0 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f6762a00640 1 -- 172.21.15.7:0/2942199005 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 9555+0+0 (secure 0 0 0) 0x7f675c0d0dc0 con 0x7f676c104470 2024-04-23T15:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f675b400640 1 -- 172.21.15.7:0/1857936897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676400ed10 con 0x561abb95d1b0 2024-04-23T15:25:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.691+0000 7f6769e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f67500a3e40 0x7f67500a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 -- 172.21.15.7:0/1857936897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 msgr2=0x561abb95d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6769e00640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f67500a3e40 0x7f67500a6300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f675c0ce1b0 tx=0x7f675c000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 0x561abb95d590 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f6764007f30 tx=0x7f676400c750 comp rx=0 tx=0).stop 2024-04-23T15:25:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 -- 172.21.15.7:0/1857936897 shutdown_connections 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb968390 0x561abb96a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb967e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 --2- 172.21.15.7:0/1857936897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95d1b0 0x561abb95d590 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 -- 172.21.15.7:0/1857936897 >> 172.21.15.7:0/1857936897 conn(0x561abb9596c0 msgr2=0x561abb959aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 -- 172.21.15.7:0/1857936897 shutdown_connections 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.692+0000 7f6773fdc740 1 -- 172.21.15.7:0/1857936897 wait complete. 2024-04-23T15:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.693+0000 7f6773fdc740 1 -- start start 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.693+0000 7f6773fdc740 1 Processor -- start 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb9652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb965830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb965d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561abb96afc0 con 0x561abb95dad0 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561abb87d2c0 con 0x561abb95d1b0 2024-04-23T15:25:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561abb96b140 con 0x561abb968390 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6773fdc740 10 client.0 _ll_register_callbacks cb 0x561abb5d5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb965830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb965830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50130/0 (socket says 172.21.15.7:50130) 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f6763e00640 1 -- 172.21.15.7:0/3025609677 learned_addr learned my addr 172.21.15.7:0/3025609677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f676a800640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb9652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.694+0000 7f676a800640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb965d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f6763e00640 1 -- 172.21.15.7:0/3025609677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 msgr2=0x561abb965d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f6763e00640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb965d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f6763e00640 1 -- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 msgr2=0x561abb9652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f6763e00640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb9652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f6763e00640 1 -- 172.21.15.7:0/3025609677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abb88dfd0 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f6763e00640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb965830 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f676c06b710 tx=0x7f67540317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee12733c428768d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.695+0000 7f674fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f674fe00640 1 -- 172.21.15.7:0/3025609677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675403f070 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f674fe00640 1 -- 172.21.15.7:0/3025609677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 9555+0+0 (secure 0 0 0) 0x7f6754004450 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f676400fd00 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f674fe00640 1 -- 172.21.15.7:0/3025609677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f675404c050 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f6773fdc740 10 client.18387 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561abb5d6210 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.696+0000 7f674fe00640 1 -- 172.21.15.7:0/3025609677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f676400fd00 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f674fe00640 1 -- 172.21.15.7:0/3025609677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6754004bd0 con 0x561abb95dad0 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f6773fdc740 10 client.18387 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f6773fdc740 10 client.18387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f6773fdc740 20 client.18387 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb978490 0x561abb97a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f6773fdc740 4 client.18387 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:25:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561abb8d1320 con 0x561abb978490 2024-04-23T15:25:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.697+0000 7f676a800640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb978490 0x561abb97a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.698+0000 7f676a800640 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb978490 0x561abb97a880 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a6ecd54573730a server_cookie=e456324e1cac30e6 in_seq=0 out_seq=0 2024-04-23T15:25:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.698+0000 7f674fe00640 10 client.18387 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.700+0000 7f674fe00640 1 -- 172.21.15.7:0/3025609677 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561abb8d1320 con 0x561abb978490 2024-04-23T15:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.700+0000 7f674fe00640 10 client.18387 handle_command_reply: tid=0 2024-04-23T15:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.700+0000 7f6773fdc740 1 client.18387 shutdown 2024-04-23T15:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 msgr2=0x561abb965830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb965830 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f676c06b710 tx=0x7f67540317e0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 shutdown_connections 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb978490 0x561abb97a880 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb965d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb965830 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3025609677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb9652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f674fe00640 0 client.18387 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 >> 172.21.15.7:0/3025609677 conn(0x561abb9596c0 msgr2=0x561abb95f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 shutdown_connections 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 1 -- 172.21.15.7:0/3025609677 wait complete. 2024-04-23T15:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.701+0000 7f6773fdc740 20 client.18387 trim_cache size 0 max 16384 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 Processor -- start 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 -- start start 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb973e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb95fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb967230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1b1630 con 0x561abb95dad0 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1b3170 con 0x561abb95d1b0 2024-04-23T15:25:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6773fdc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1b1d00 con 0x561abb968390 2024-04-23T15:25:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb95fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb95fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50138/0 (socket says 172.21.15.7:50138) 2024-04-23T15:25:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.718+0000 7f6763e00640 1 -- 172.21.15.7:0/3348312380 learned_addr learned my addr 172.21.15.7:0/3348312380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f676a800640 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb973e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f6763e00640 1 -- 172.21.15.7:0/3348312380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 msgr2=0x561abb967230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f6763e00640 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb967230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f6763e00640 1 -- 172.21.15.7:0/3348312380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 msgr2=0x561abb973e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f6763e00640 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb973e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f6763e00640 1 -- 172.21.15.7:0/3348312380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abb6a2620 con 0x561abb95dad0 2024-04-23T15:25:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f6763e00640 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb95fb70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f6754009850 tx=0x7f675402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f139efd2645ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f675aa00640 1 -- 172.21.15.7:0/3348312380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754055070 con 0x561abb95dad0 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f675aa00640 1 -- 172.21.15.7:0/3348312380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6754005480 con 0x561abb95dad0 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.719+0000 7f675aa00640 1 -- 172.21.15.7:0/3348312380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675403f070 con 0x561abb95dad0 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 -- 172.21.15.7:0/3348312380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 msgr2=0x561abb95fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb95fb70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f6754009850 tx=0x7f675402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 -- 172.21.15.7:0/3348312380 shutdown_connections 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb968390 0x561abb967230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb95dad0 0x561abb95fb70 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 --2- 172.21.15.7:0/3348312380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb973e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.720+0000 7f6773fdc740 1 -- 172.21.15.7:0/3348312380 >> 172.21.15.7:0/3348312380 conn(0x561abb9596c0 msgr2=0x561abb966b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.721+0000 7f6773fdc740 1 -- 172.21.15.7:0/3348312380 shutdown_connections 2024-04-23T15:25:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.721+0000 7f6773fdc740 1 -- 172.21.15.7:0/3348312380 wait complete. 2024-04-23T15:25:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.721+0000 7f6773fdc740 1 -- start start 2024-04-23T15:25:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.721+0000 7f6773fdc740 1 Processor -- start 2024-04-23T15:25:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb970600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb96b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 0x561abb96be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1b2aa0 con 0x561abb968390 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1b23d0 con 0x561abb95d1b0 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f676c1af630 con 0x561abb95dad0 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6773fdc740 10 client.0 _ll_register_callbacks cb 0x7f6754009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f676a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 0x561abb96be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f676a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 0x561abb96be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50144/0 (socket says 172.21.15.7:50144) 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f676a800640 1 -- 172.21.15.7:0/2932257277 learned_addr learned my addr 172.21.15.7:0/2932257277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.722+0000 7f6763e00640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb96b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb970600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 -- 172.21.15.7:0/2932257277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 msgr2=0x561abb96b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb96b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 -- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 msgr2=0x561abb970600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb970600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 -- 172.21.15.7:0/2932257277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abb96c480 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f6763e00640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb96b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f676a800640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 0x561abb96be90 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f676400e920 tx=0x7f6764007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc521aedb3870548 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f674fe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f674fe00640 1 -- 172.21.15.7:0/2932257277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764014040 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f674fe00640 1 -- 172.21.15.7:0/2932257277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 9555+0+0 (secure 0 0 0) 0x7f6764029ae0 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.723+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6754005480 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f674fe00640 1 -- 172.21.15.7:0/2932257277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6764039050 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f6773fdc740 10 client.18393 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561abb9de7f0 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f674fe00640 1 -- 172.21.15.7:0/2932257277 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6754005480 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f674fe00640 1 -- 172.21.15.7:0/2932257277 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f676400f650 con 0x561abb968390 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f6773fdc740 10 client.18393 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f6773fdc740 10 client.18393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.724+0000 7f6773fdc740 20 client.18393 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.725+0000 7f6773fdc740 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb9dedf0 0x561abb9e1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.725+0000 7f6773fdc740 4 client.18393 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:25:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.725+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561abb8cb190 con 0x561abb9dedf0 2024-04-23T15:25:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.725+0000 7f6763e00640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb9dedf0 0x561abb9e1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.726+0000 7f6763e00640 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb9dedf0 0x561abb9e1210 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e80d8e9c03ed295 server_cookie=ad1990151e2123d1 in_seq=0 out_seq=0 2024-04-23T15:25:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.726+0000 7f674fe00640 10 client.18393 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f674fe00640 1 -- 172.21.15.7:0/2932257277 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561abb8cb190 con 0x561abb9dedf0 2024-04-23T15:25:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f674fe00640 10 client.18393 handle_command_reply: tid=0 2024-04-23T15:25:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 client.18393 shutdown 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 msgr2=0x561abb96be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 0x561abb96be90 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f676400e920 tx=0x7f6764007800 comp rx=0 tx=0).stop 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 shutdown_connections 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561abb9dedf0 0x561abb9e1210 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561abb968390 0x561abb96be90 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561abb95dad0 0x561abb96b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 --2- 172.21.15.7:0/2932257277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abb95d1b0 0x561abb970600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f674fe00640 0 client.18393 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.763+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 >> 172.21.15.7:0/2932257277 conn(0x561abb9596c0 msgr2=0x561abb9673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.764+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 shutdown_connections 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.764+0000 7f6773fdc740 1 -- 172.21.15.7:0/2932257277 wait complete. 2024-04-23T15:25:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.764+0000 7f6773fdc740 20 client.18393 trim_cache size 0 max 16384 2024-04-23T15:25:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:25:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:25:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:25:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f67500a3e40 msgr2=0x7f67500a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f67500a3e40 0x7f67500a6300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f675c0ce1b0 tx=0x7f675c000bc0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 msgr2=0x7f676c1a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 0x7f676c1a0670 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c920 tx=0x7f675c00cde0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 shutdown_connections 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f67500a3e40 0x7f67500a6300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f676c109540 0x7f676c1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f676c19a780 0x7f676c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 --2- 172.21.15.7:0/2942199005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f676c104470 0x7f676c1a0670 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 >> 172.21.15.7:0/2942199005 conn(0x7f676c0ffcd0 msgr2=0x7f676c100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 shutdown_connections 2024-04-23T15:25:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:10.765+0000 7f6771200640 1 -- 172.21.15.7:0/2942199005 wait complete. 2024-04-23T15:25:10.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:10 smithi007 ceph-mon[27906]: pgmap v1070: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:25:10.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:10 smithi186 ceph-mon[31814]: pgmap v1070: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:25:10.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:10 smithi137 ceph-mon[31694]: pgmap v1070: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:25:12.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:12 smithi007 ceph-mon[27906]: pgmap v1071: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.8 MiB/s wr, 19 op/s 2024-04-23T15:25:12.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:12 smithi186 ceph-mon[31814]: pgmap v1071: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.8 MiB/s wr, 19 op/s 2024-04-23T15:25:12.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:12 smithi137 ceph-mon[31694]: pgmap v1071: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.8 MiB/s wr, 19 op/s 2024-04-23T15:25:14.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:14 smithi007 ceph-mon[27906]: pgmap v1072: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 17 op/s 2024-04-23T15:25:14.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:14 smithi186 ceph-mon[31814]: pgmap v1072: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 17 op/s 2024-04-23T15:25:14.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:14 smithi137 ceph-mon[31694]: pgmap v1072: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 17 op/s 2024-04-23T15:25:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:16 smithi007 ceph-mon[27906]: pgmap v1073: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 17 op/s 2024-04-23T15:25:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:16 smithi007 ceph-mon[27906]: osdmap e148: 12 total, 12 up, 12 in 2024-04-23T15:25:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:16 smithi186 ceph-mon[31814]: pgmap v1073: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 17 op/s 2024-04-23T15:25:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:16 smithi186 ceph-mon[31814]: osdmap e148: 12 total, 12 up, 12 in 2024-04-23T15:25:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:16 smithi137 ceph-mon[31694]: pgmap v1073: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 17 op/s 2024-04-23T15:25:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:16 smithi137 ceph-mon[31694]: osdmap e148: 12 total, 12 up, 12 in 2024-04-23T15:25:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:18 smithi007 ceph-mon[27906]: pgmap v1075: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 17 op/s 2024-04-23T15:25:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:18 smithi186 ceph-mon[31814]: pgmap v1075: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 17 op/s 2024-04-23T15:25:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:18 smithi137 ceph-mon[31694]: pgmap v1075: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.9 MiB/s wr, 17 op/s 2024-04-23T15:25:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:20 smithi007 ceph-mon[27906]: pgmap v1076: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:25:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:20 smithi186 ceph-mon[31814]: pgmap v1076: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:25:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:20 smithi137 ceph-mon[31694]: pgmap v1076: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:25:23.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:22 smithi007 ceph-mon[27906]: pgmap v1077: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 15 op/s 2024-04-23T15:25:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:22 smithi186 ceph-mon[31814]: pgmap v1077: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 15 op/s 2024-04-23T15:25:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:22 smithi137 ceph-mon[31694]: pgmap v1077: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 15 op/s 2024-04-23T15:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.924+0000 7f0c5ec00640 1 -- 172.21.15.7:0/2478098752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 msgr2=0x7f0c580746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.924+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/2478098752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c580746e0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009ca0 tx=0x7f0c4802a950 comp rx=0 tx=0).stop 2024-04-23T15:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 -- 172.21.15.7:0/2478098752 shutdown_connections 2024-04-23T15:25:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/2478098752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c5810e8f0 0x7f0c58110ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/2478098752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c58074c20 0x7f0c5810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/2478098752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c580746e0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 -- 172.21.15.7:0/2478098752 >> 172.21.15.7:0/2478098752 conn(0x7f0c58079490 msgr2=0x7f0c580798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 -- 172.21.15.7:0/2478098752 shutdown_connections 2024-04-23T15:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.925+0000 7f0c5ec00640 1 -- 172.21.15.7:0/2478098752 wait complete. 2024-04-23T15:25:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.926+0000 7f0c5ec00640 1 Processor -- start 2024-04-23T15:25:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.926+0000 7f0c5ec00640 1 -- start start 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c5ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c581a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c5ec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c58074c20 0x7f0c581a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c5ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c5810e8f0 0x7f0c5819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c5ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58114500 con 0x7f0c58074300 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c5ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58114380 con 0x7f0c5810e8f0 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c5ec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58114680 con 0x7f0c58074c20 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c581a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c581a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34080/0 (socket says 172.21.15.7:34080) 2024-04-23T15:25:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.927+0000 7f0c57e00640 1 -- 172.21.15.7:0/1437211546 learned_addr learned my addr 172.21.15.7:0/1437211546 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c5810e8f0 0x7f0c5819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c4f400640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c58074c20 0x7f0c581a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c57e00640 1 -- 172.21.15.7:0/1437211546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c58074c20 msgr2=0x7f0c581a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c57e00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c58074c20 0x7f0c581a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c57e00640 1 -- 172.21.15.7:0/1437211546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c5810e8f0 msgr2=0x7f0c5819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c57e00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c5810e8f0 0x7f0c5819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c57e00640 1 -- 172.21.15.7:0/1437211546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5819afe0 con 0x7f0c58074300 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.928+0000 7f0c57e00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c581a0660 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f0c480098d0 tx=0x7f0c48030440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.929+0000 7f0c55600640 1 -- 172.21.15.7:0/1437211546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48034040 con 0x7f0c58074300 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.929+0000 7f0c55600640 1 -- 172.21.15.7:0/1437211546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c480308f0 con 0x7f0c58074300 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.929+0000 7f0c55600640 1 -- 172.21.15.7:0/1437211546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48004810 con 0x7f0c58074300 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.929+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5819b270 con 0x7f0c58074300 2024-04-23T15:25:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.929+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c581a7400 con 0x7f0c58074300 2024-04-23T15:25:23.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.933+0000 7f0c55600640 1 -- 172.21.15.7:0/1437211546 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0c48037020 con 0x7f0c58074300 2024-04-23T15:25:23.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.933+0000 7f0c61a3d740 1 Processor -- start 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.933+0000 7f0c61a3d740 1 -- start start 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a10590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a1ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a1b390 0x55c3a5a1d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c3a5976900 con 0x55c3a5a10ad0 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c3a591cf20 con 0x55c3a5a101b0 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c3a59728c0 con 0x55c3a5a1b390 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a1ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a1ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34082/0 (socket says 172.21.15.7:34082) 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c57e00640 1 -- 172.21.15.7:0/1852074920 learned_addr learned my addr 172.21.15.7:0/1852074920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a10590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.934+0000 7f0c4f400640 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a1b390 0x55c3a5a1d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c57e00640 1 -- 172.21.15.7:0/1852074920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a1b390 msgr2=0x55c3a5a1d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c57e00640 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a1b390 0x55c3a5a1d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c55600640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c3c0a3e40 0x7f0c3c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c57e00640 1 -- 172.21.15.7:0/1852074920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 msgr2=0x55c3a5a10590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c57e00640 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a10590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c57e00640 1 -- 172.21.15.7:0/1852074920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a5941e10 con 0x55c3a5a10ad0 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c3c0a3e40 0x7f0c3c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c55600640 1 -- 172.21.15.7:0/1437211546 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7f0c480f1d90 con 0x7f0c58074300 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.935+0000 7f0c57e00640 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a1ae50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ef120 tx=0x7f0c480b9d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b974051b7a2957de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.936+0000 7f0c4d200640 1 -- 172.21.15.7:0/1852074920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480bd570 con 0x55c3a5a10ad0 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.936+0000 7f0c4d200640 1 -- 172.21.15.7:0/1852074920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c4802c020 con 0x55c3a5a10ad0 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.936+0000 7f0c4d200640 1 -- 172.21.15.7:0/1852074920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480bd390 con 0x55c3a5a10ad0 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 -- 172.21.15.7:0/1852074920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 msgr2=0x55c3a5a1ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c3c0a3e40 0x7f0c3c0a6300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c500045c0 tx=0x7f0c500046c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a1ae50 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ef120 tx=0x7f0c480b9d90 comp rx=0 tx=0).stop 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 -- 172.21.15.7:0/1852074920 shutdown_connections 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a1b390 0x55c3a5a1d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a1ae50 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/1852074920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a10590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 -- 172.21.15.7:0/1852074920 >> 172.21.15.7:0/1852074920 conn(0x55c3a5a0c6c0 msgr2=0x55c3a5a0caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 -- 172.21.15.7:0/1852074920 shutdown_connections 2024-04-23T15:25:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 -- 172.21.15.7:0/1852074920 wait complete. 2024-04-23T15:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.937+0000 7f0c61a3d740 1 -- start start 2024-04-23T15:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 Processor -- start 2024-04-23T15:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a101b0 0x55c3a5a182d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a18d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c3a5976900 con 0x55c3a5a1b390 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c3a59302c0 con 0x55c3a5a10ad0 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.938+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c3a5a1dd80 con 0x55c3a5a101b0 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c61a3d740 10 client.0 _ll_register_callbacks cb 0x55c3a5688a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a18d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a18d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34088/0 (socket says 172.21.15.7:34088) 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 -- 172.21.15.7:0/310804761 learned_addr learned my addr 172.21.15.7:0/310804761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c57e00640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a101b0 0x55c3a5a182d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c4f400640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 -- 172.21.15.7:0/310804761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a101b0 msgr2=0x55c3a5a182d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a101b0 0x55c3a5a182d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 -- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a10ad0 msgr2=0x55c3a5a18810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.939+0000 7f0c5cc00640 1 -- 172.21.15.7:0/310804761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a5940fd0 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.940+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a18d50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005d50 tx=0x7f0c50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3995af943e46bfa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.940+0000 7f0c45600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.940+0000 7f0c45600640 1 -- 172.21.15.7:0/310804761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50022070 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.940+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3a5984320 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.940+0000 7f0c45600640 1 -- 172.21.15.7:0/310804761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7f0c50010970 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c45600640 1 -- 172.21.15.7:0/310804761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0c5002e050 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 10 client.18405 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c3a5689210 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c45600640 1 -- 172.21.15.7:0/310804761 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55c3a5984320 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c45600640 1 -- 172.21.15.7:0/310804761 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0c5000f3c0 con 0x55c3a5a1b390 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 10 client.18405 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 10 client.18405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 20 client.18405 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a2b220 0x55c3a5a2d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 4 client.18405 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:25:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.941+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a597e190 con 0x55c3a5a2b220 2024-04-23T15:25:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.942+0000 7f0c57e00640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a2b220 0x55c3a5a2d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.943+0000 7f0c57e00640 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a2b220 0x55c3a5a2d660 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31ff881eb685aae6 server_cookie=8c26818c376e71c5 in_seq=0 out_seq=0 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.943+0000 7f0c45600640 10 client.18405 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.945+0000 7f0c45600640 1 -- 172.21.15.7:0/310804761 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c3a597e190 con 0x55c3a5a2b220 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.945+0000 7f0c45600640 10 client.18405 handle_command_reply: tid=0 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.945+0000 7f0c61a3d740 1 client.18405 shutdown 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 msgr2=0x55c3a5a18d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a18d50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005d50 tx=0x7f0c50004730 comp rx=0 tx=0).stop 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 shutdown_connections 2024-04-23T15:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a2b220 0x55c3a5a2d660 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a18d50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/310804761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a101b0 0x55c3a5a182d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c45600640 0 client.18405 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 >> 172.21.15.7:0/310804761 conn(0x55c3a5a0c6c0 msgr2=0x55c3a5a12440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 shutdown_connections 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 1 -- 172.21.15.7:0/310804761 wait complete. 2024-04-23T15:25:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.946+0000 7f0c61a3d740 20 client.18405 trim_cache size 0 max 16384 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 Processor -- start 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 -- start start 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a26ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a32f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581b14f0 con 0x55c3a5a1b390 2024-04-23T15:25:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581b3030 con 0x55c3a5a101b0 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.967+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581b1bc0 con 0x55c3a5a10ad0 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a32f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a32f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34090/0 (socket says 172.21.15.7:34090) 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 -- 172.21.15.7:0/137320107 learned_addr learned my addr 172.21.15.7:0/137320107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c57e00640 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a26ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c4f400640 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 -- 172.21.15.7:0/137320107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 msgr2=0x55c3a5a18b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 -- 172.21.15.7:0/137320107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 msgr2=0x55c3a5a26ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a26ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 -- 172.21.15.7:0/137320107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a5755620 con 0x55c3a5a1b390 2024-04-23T15:25:23.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.968+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a32f30 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f0c50003d00 tx=0x7f0c5000ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188a86ac7af58e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.969+0000 7f0c47e00640 1 -- 172.21.15.7:0/137320107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50022070 con 0x55c3a5a1b390 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.969+0000 7f0c47e00640 1 -- 172.21.15.7:0/137320107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c50037070 con 0x55c3a5a1b390 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.969+0000 7f0c47e00640 1 -- 172.21.15.7:0/137320107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50027440 con 0x55c3a5a1b390 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 -- 172.21.15.7:0/137320107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 msgr2=0x55c3a5a32f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a32f30 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f0c50003d00 tx=0x7f0c5000ff60 comp rx=0 tx=0).stop 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 -- 172.21.15.7:0/137320107 shutdown_connections 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a1b390 0x55c3a5a32f30 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a18b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/137320107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a101b0 0x55c3a5a26ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 -- 172.21.15.7:0/137320107 >> 172.21.15.7:0/137320107 conn(0x55c3a5a0c6c0 msgr2=0x55c3a5a0b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 -- 172.21.15.7:0/137320107 shutdown_connections 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.970+0000 7f0c61a3d740 1 -- 172.21.15.7:0/137320107 wait complete. 2024-04-23T15:25:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 -- start start 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 Processor -- start 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 0x55c3a5a233a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a14c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a1b390 0x55c3a5a151c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581b2960 con 0x55c3a5a101b0 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581b2290 con 0x55c3a5a1b390 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.971+0000 7f0c61a3d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581af4f0 con 0x55c3a5a10ad0 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c61a3d740 10 client.0 _ll_register_callbacks cb 0x7f0c50005be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 0x55c3a5a233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 0x55c3a5a233a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34100/0 (socket says 172.21.15.7:34100) 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 -- 172.21.15.7:0/2442844730 learned_addr learned my addr 172.21.15.7:0/2442844730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c4f400640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a14c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a1b390 0x55c3a5a151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 -- 172.21.15.7:0/2442844730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 msgr2=0x55c3a5a14c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a14c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 -- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a1b390 msgr2=0x55c3a5a151c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a1b390 0x55c3a5a151c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c57e00640 1 -- 172.21.15.7:0/2442844730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a5a159f0 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.972+0000 7f0c5cc00640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a1b390 0x55c3a5a151c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c57e00640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 0x55c3a5a233a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009430 tx=0x7f0c4802ffe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5270d1448fb3e676 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c45600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c45600640 1 -- 172.21.15.7:0/2442844730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480bd390 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c45600640 1 -- 172.21.15.7:0/2442844730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7f0c48004040 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c50037070 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c45600640 1 -- 172.21.15.7:0/2442844730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0c480de0b0 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c61a3d740 10 client.18411 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.973+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c3a5a91790 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c45600640 1 -- 172.21.15.7:0/2442844730 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c480f3070 con 0x55c3a5a101b0 2024-04-23T15:25:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c45600640 1 -- 172.21.15.7:0/2442844730 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0c480ba0a0 con 0x55c3a5a101b0 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c61a3d740 10 client.18411 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c61a3d740 10 client.18411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c61a3d740 20 client.18411 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a91d20 0x55c3a5a94110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c61a3d740 4 client.18411 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.974+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3a58fa4b0 con 0x55c3a5a91d20 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.975+0000 7f0c4f400640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a91d20 0x55c3a5a94110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.976+0000 7f0c4f400640 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a91d20 0x55c3a5a94110 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c0dc26ca67858f0 server_cookie=32aba1e47976b92 in_seq=0 out_seq=0 2024-04-23T15:25:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:23.976+0000 7f0c45600640 10 client.18411 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:24.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.006+0000 7f0c45600640 1 -- 172.21.15.7:0/2442844730 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3a58fa4b0 con 0x55c3a5a91d20 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.006+0000 7f0c45600640 10 client.18411 handle_command_reply: tid=0 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.006+0000 7f0c61a3d740 1 client.18411 shutdown 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.006+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 msgr2=0x55c3a5a233a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.006+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 0x55c3a5a233a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009430 tx=0x7f0c4802ffe0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 shutdown_connections 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c3a5a91d20 0x55c3a5a94110 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c3a5a1b390 0x55c3a5a151c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3a5a10ad0 0x55c3a5a14c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 --2- 172.21.15.7:0/2442844730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c3a5a101b0 0x55c3a5a233a0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c45600640 0 client.18411 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 >> 172.21.15.7:0/2442844730 conn(0x55c3a5a0c6c0 msgr2=0x55c3a5a11b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 shutdown_connections 2024-04-23T15:25:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 1 -- 172.21.15.7:0/2442844730 wait complete. 2024-04-23T15:25:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.007+0000 7f0c61a3d740 20 client.18411 trim_cache size 0 max 16384 2024-04-23T15:25:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:25:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:25:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:25:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:25:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c3c0a3e40 msgr2=0x7f0c3c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c3c0a3e40 0x7f0c3c0a6300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c500045c0 tx=0x7f0c500046c0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 msgr2=0x7f0c581a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c581a0660 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f0c480098d0 tx=0x7f0c48030440 comp rx=0 tx=0).stop 2024-04-23T15:25:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 shutdown_connections 2024-04-23T15:25:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0c3c0a3e40 0x7f0c3c0a6300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c5810e8f0 0x7f0c5819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c58074c20 0x7f0c581a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 --2- 172.21.15.7:0/1437211546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c58074300 0x7f0c581a0660 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 >> 172.21.15.7:0/1437211546 conn(0x7f0c58079490 msgr2=0x7f0c580feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 shutdown_connections 2024-04-23T15:25:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:24.008+0000 7f0c5ec00640 1 -- 172.21.15.7:0/1437211546 wait complete. 2024-04-23T15:25:25.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:24 smithi007 ceph-mon[27906]: pgmap v1078: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:25:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:24 smithi186 ceph-mon[31814]: pgmap v1078: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:25:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:24 smithi137 ceph-mon[31694]: pgmap v1078: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:25:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:26 smithi007 ceph-mon[27906]: pgmap v1079: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:25:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:26 smithi186 ceph-mon[31814]: pgmap v1079: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:25:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:26 smithi137 ceph-mon[31694]: pgmap v1079: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:25:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:29 smithi007 ceph-mon[27906]: pgmap v1080: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:29 smithi186 ceph-mon[31814]: pgmap v1080: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:29 smithi137 ceph-mon[31694]: pgmap v1080: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:31 smithi007 ceph-mon[27906]: pgmap v1081: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:31.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:31 smithi186 ceph-mon[31814]: pgmap v1081: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:31 smithi137 ceph-mon[31694]: pgmap v1081: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:33 smithi007 ceph-mon[27906]: pgmap v1082: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:25:33.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:33 smithi186 ceph-mon[31814]: pgmap v1082: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:25:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:33 smithi137 ceph-mon[31694]: pgmap v1082: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:25:34.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:34 smithi007 ceph-mon[27906]: pgmap v1083: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:25:34.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:34 smithi186 ceph-mon[31814]: pgmap v1083: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:25:34.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:34 smithi137 ceph-mon[31694]: pgmap v1083: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:25:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 -- 172.21.15.7:0/630421721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 msgr2=0x7ff7ac10dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 --2- 172.21.15.7:0/630421721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac10dc00 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009ca0 tx=0x7ff7a402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 -- 172.21.15.7:0/630421721 shutdown_connections 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 --2- 172.21.15.7:0/630421721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac10dc00 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 --2- 172.21.15.7:0/630421721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7ac101910 0x7ff7ac105950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 --2- 172.21.15.7:0/630421721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7ac100f60 0x7ff7ac101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 -- 172.21.15.7:0/630421721 >> 172.21.15.7:0/630421721 conn(0x7ff7ac0fc820 msgr2=0x7ff7ac0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.166+0000 7ff7b2400640 1 -- 172.21.15.7:0/630421721 shutdown_connections 2024-04-23T15:25:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.167+0000 7ff7b2400640 1 -- 172.21.15.7:0/630421721 wait complete. 2024-04-23T15:25:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 Processor -- start 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 -- start start 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7ac100f60 0x7ff7ac10fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7ac1105a0 0x7ff7ac1a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1120d0 con 0x7ff7ac106030 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac111f50 con 0x7ff7ac1105a0 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7b2400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac112250 con 0x7ff7ac100f60 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.168+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55980/0 (socket says 172.21.15.7:55980) 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 -- 172.21.15.7:0/3815191538 learned_addr learned my addr 172.21.15.7:0/3815191538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7b1000640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7ac100f60 0x7ff7ac10fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7ac1105a0 0x7ff7ac1a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 -- 172.21.15.7:0/3815191538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7ac100f60 msgr2=0x7ff7ac10fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7ac100f60 0x7ff7ac10fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 -- 172.21.15.7:0/3815191538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7ac1105a0 msgr2=0x7ff7ac1a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7ac1105a0 0x7ff7ac1a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 -- 172.21.15.7:0/3815191538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac1a6ee0 con 0x7ff7ac106030 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.169+0000 7ff7abe00640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac110060 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c970 tx=0x7ff79800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.170+0000 7ff7a9600640 1 -- 172.21.15.7:0/3815191538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798014070 con 0x7ff7ac106030 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.170+0000 7ff7a9600640 1 -- 172.21.15.7:0/3815191538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff798004440 con 0x7ff7ac106030 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.170+0000 7ff7a9600640 1 -- 172.21.15.7:0/3815191538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798003e50 con 0x7ff7ac106030 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.170+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac1a71d0 con 0x7ff7ac106030 2024-04-23T15:25:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.170+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac1a7770 con 0x7ff7ac106030 2024-04-23T15:25:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 Processor -- start 2024-04-23T15:25:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 -- start start 2024-04-23T15:25:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x5593870f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x559387103060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x559387105990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55938705e900 con 0x5593870f8ce0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559387004f20 con 0x5593870f83c0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.174+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55938705a8c0 con 0x5593871035a0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7a9600640 1 -- 172.21.15.7:0/3815191538 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff798017070 con 0x7ff7ac106030 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7b1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x559387103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7b1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x559387103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55984/0 (socket says 172.21.15.7:55984) 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7b1000640 1 -- 172.21.15.7:0/3747605750 learned_addr learned my addr 172.21.15.7:0/3747605750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x5593870f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7abe00640 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x559387105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7b1000640 1 -- 172.21.15.7:0/3747605750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 msgr2=0x559387105990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.175+0000 7ff7b1000640 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x559387105990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff7b1000640 1 -- 172.21.15.7:0/3747605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 msgr2=0x5593870f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff7b1000640 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x5593870f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff7b1000640 1 -- 172.21.15.7:0/3747605750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559387029e10 con 0x5593870f8ce0 2024-04-23T15:25:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x5593870f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:25:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff7b1000640 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x559387103060 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000bd10 tx=0x7ff7a00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99ef30b9e548320 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff79e000640 1 -- 172.21.15.7:0/3747605750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0004030 con 0x5593870f8ce0 2024-04-23T15:25:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff79e000640 1 -- 172.21.15.7:0/3747605750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7a00035f0 con 0x5593870f8ce0 2024-04-23T15:25:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.176+0000 7ff79e000640 1 -- 172.21.15.7:0/3747605750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0011770 con 0x5593870f8ce0 2024-04-23T15:25:37.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.177+0000 7ff7a9600640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7940a3f60 0x7ff7940a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.177+0000 7ff7a9600640 1 -- 172.21.15.7:0/3815191538 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7ff7980d0600 con 0x7ff7ac106030 2024-04-23T15:25:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.177+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7940a3f60 0x7ff7940a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.177+0000 7ff7b69b6740 1 -- 172.21.15.7:0/3747605750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 msgr2=0x559387103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.177+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x559387103060 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000bd10 tx=0x7ff7a00107a0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 -- 172.21.15.7:0/3747605750 shutdown_connections 2024-04-23T15:25:37.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x559387105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x559387103060 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/3747605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x5593870f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 -- 172.21.15.7:0/3747605750 >> 172.21.15.7:0/3747605750 conn(0x5593870f48d0 msgr2=0x5593870f4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 -- 172.21.15.7:0/3747605750 shutdown_connections 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 -- 172.21.15.7:0/3747605750 wait complete. 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7940a3f60 0x7ff7940a6420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff7a402f3a0 tx=0x7ff7a402f310 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.178+0000 7ff7b69b6740 1 -- start start 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 Processor -- start 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f83c0 0x5593871004b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593871009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593871035a0 0x559387100f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559387106140 con 0x5593870f8ce0 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5593870182c0 con 0x5593871035a0 2024-04-23T15:25:37.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5593871062c0 con 0x5593870f83c0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7b69b6740 10 client.0 _ll_register_callbacks cb 0x559386d70a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593871009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593871009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55990/0 (socket says 172.21.15.7:55990) 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.179+0000 7ff7abe00640 1 -- 172.21.15.7:0/1534292592 learned_addr learned my addr 172.21.15.7:0/1534292592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7b1000640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f83c0 0x5593871004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593871035a0 0x559387100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7abe00640 1 -- 172.21.15.7:0/1534292592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f83c0 msgr2=0x5593871004b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7abe00640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f83c0 0x5593871004b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7abe00640 1 -- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593871035a0 msgr2=0x559387100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7abe00640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593871035a0 0x559387100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7abe00640 1 -- 172.21.15.7:0/1534292592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559387028fd0 con 0x5593870f8ce0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7b1000640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f83c0 0x5593871004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593871035a0 0x559387100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff7abe00640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593871009f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ff7980cda00 tx=0x7ff79809bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42604cda772b5158 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.180+0000 7ff792a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff792a00640 1 -- 172.21.15.7:0/1534292592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980cde20 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff792a00640 1 -- 172.21.15.7:0/1534292592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7ff7980a0160 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a00035f0 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff792a00640 1 -- 172.21.15.7:0/1534292592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff79809c8f0 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff7b69b6740 10 client.18423 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559386d71210 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff792a00640 1 -- 172.21.15.7:0/1534292592 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7a00035f0 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.181+0000 7ff792a00640 1 -- 172.21.15.7:0/1534292592 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff7980d01f0 con 0x5593870f8ce0 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b69b6740 10 client.18423 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b69b6740 10 client.18423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b69b6740 20 client.18423 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x559387115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b69b6740 4 client.18423 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:25:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55938706c320 con 0x5593871136b0 2024-04-23T15:25:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.182+0000 7ff7b1000640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x559387115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.183+0000 7ff7b1000640 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x559387115aa0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc2f26c7867c1a63 server_cookie=e27658c705a738f4 in_seq=0 out_seq=0 2024-04-23T15:25:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.183+0000 7ff792a00640 10 client.18423 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff792a00640 1 -- 172.21.15.7:0/1534292592 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55938706c320 con 0x5593871136b0 2024-04-23T15:25:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff792a00640 10 client.18423 handle_command_reply: tid=0 2024-04-23T15:25:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 client.18423 shutdown 2024-04-23T15:25:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 msgr2=0x5593871009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593871009f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ff7980cda00 tx=0x7ff79809bfc0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 shutdown_connections 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x559387115aa0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593871035a0 0x559387100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593871009f0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff792a00640 0 client.18423 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/1534292592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f83c0 0x5593871004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.185+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 >> 172.21.15.7:0/1534292592 conn(0x5593870f48d0 msgr2=0x5593870fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.186+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 shutdown_connections 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.186+0000 7ff7b69b6740 1 -- 172.21.15.7:0/1534292592 wait complete. 2024-04-23T15:25:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.186+0000 7ff7b69b6740 20 client.18423 trim_cache size 0 max 16384 2024-04-23T15:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.210+0000 7ff7b69b6740 1 Processor -- start 2024-04-23T15:25:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.210+0000 7ff7b69b6740 1 -- start start 2024-04-23T15:25:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.210+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x559387102be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f8ce0 0x55938710f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 0x5593870fad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b14b0 con 0x5593871035a0 2024-04-23T15:25:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b2ff0 con 0x5593870f83c0 2024-04-23T15:25:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b1b80 con 0x5593870f8ce0 2024-04-23T15:25:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 0x5593870fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 0x5593870fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56006/0 (socket says 172.21.15.7:56006) 2024-04-23T15:25:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b1a00640 1 -- 172.21.15.7:0/65230697 learned_addr learned my addr 172.21.15.7:0/65230697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7abe00640 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f8ce0 0x55938710f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.211+0000 7ff7b1000640 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x559387102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.212+0000 7ff7b1a00640 1 -- 172.21.15.7:0/65230697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f8ce0 msgr2=0x55938710f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.212+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f8ce0 0x55938710f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.212+0000 7ff7b1a00640 1 -- 172.21.15.7:0/65230697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 msgr2=0x559387102be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.212+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x559387102be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.212+0000 7ff7b1a00640 1 -- 172.21.15.7:0/65230697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559386e3d620 con 0x5593871035a0 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.212+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 0x5593870fad80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4031fb0 tx=0x7ff7a4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5c8227955884ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.213+0000 7ff79d600640 1 -- 172.21.15.7:0/65230697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4003af0 con 0x5593871035a0 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.213+0000 7ff79d600640 1 -- 172.21.15.7:0/65230697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7a4036040 con 0x5593871035a0 2024-04-23T15:25:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.213+0000 7ff79d600640 1 -- 172.21.15.7:0/65230697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4030820 con 0x5593871035a0 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 -- 172.21.15.7:0/65230697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 msgr2=0x5593870fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 0x5593870fad80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4031fb0 tx=0x7ff7a4040000 comp rx=0 tx=0).stop 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 -- 172.21.15.7:0/65230697 shutdown_connections 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593871035a0 0x5593870fad80 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593870f8ce0 0x55938710f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/65230697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x559387102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 -- 172.21.15.7:0/65230697 >> 172.21.15.7:0/65230697 conn(0x5593870f48d0 msgr2=0x559387100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 -- 172.21.15.7:0/65230697 shutdown_connections 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 -- 172.21.15.7:0/65230697 wait complete. 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 -- start start 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.214+0000 7ff7b69b6740 1 Processor -- start 2024-04-23T15:25:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x55938710bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593870fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x5593870fd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b2920 con 0x5593870f8ce0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b2250 con 0x5593870f83c0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1af4b0 con 0x5593871035a0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7b69b6740 10 client.0 _ll_register_callbacks cb 0x7ff798007f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593870fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593870fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56020/0 (socket says 172.21.15.7:56020) 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.215+0000 7ff7abe00640 1 -- 172.21.15.7:0/2811455942 learned_addr learned my addr 172.21.15.7:0/2811455942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7b1000640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x55938710bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7b1a00640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x5593870fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7abe00640 1 -- 172.21.15.7:0/2811455942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 msgr2=0x5593870fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7abe00640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x5593870fd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7abe00640 1 -- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 msgr2=0x55938710bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7abe00640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x55938710bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7abe00640 1 -- 172.21.15.7:0/2811455942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593870fdcc0 con 0x5593870f8ce0 2024-04-23T15:25:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff7abe00640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593870fcef0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff798098bc0 tx=0x7ff7980a4f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb823ff25a9fecc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff792a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.216+0000 7ff792a00640 1 -- 172.21.15.7:0/2811455942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79809bd30 con 0x5593870f8ce0 2024-04-23T15:25:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff792a00640 1 -- 172.21.15.7:0/2811455942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7ff798098210 con 0x5593870f8ce0 2024-04-23T15:25:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a4036040 con 0x5593870f8ce0 2024-04-23T15:25:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff792a00640 1 -- 172.21.15.7:0/2811455942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff7980a0370 con 0x5593870f8ce0 2024-04-23T15:25:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 10 client.18429 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559387179ca0 con 0x5593870f8ce0 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff792a00640 1 -- 172.21.15.7:0/2811455942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7a4036040 con 0x5593870f8ce0 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff792a00640 1 -- 172.21.15.7:0/2811455942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff7980a1730 con 0x5593870f8ce0 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 10 client.18429 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 10 client.18429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 20 client.18429 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x55938717c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 4 client.18429 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.217+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559387066190 con 0x5593871136b0 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.218+0000 7ff7b1000640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x55938717c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.219+0000 7ff7b1000640 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x55938717c2d0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd8fe4f7edf0375 server_cookie=8f47e4f0b4f19d88 in_seq=0 out_seq=0 2024-04-23T15:25:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.219+0000 7ff792a00640 10 client.18429 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff792a00640 1 -- 172.21.15.7:0/2811455942 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559387066190 con 0x5593871136b0 2024-04-23T15:25:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff792a00640 10 client.18429 handle_command_reply: tid=0 2024-04-23T15:25:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 client.18429 shutdown 2024-04-23T15:25:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 msgr2=0x5593870fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593870fcef0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff798098bc0 tx=0x7ff7980a4f10 comp rx=0 tx=0).stop 2024-04-23T15:25:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 shutdown_connections 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593871136b0 0x55938717c2d0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593871035a0 0x5593870fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593870f8ce0 0x5593870fcef0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 --2- 172.21.15.7:0/2811455942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593870f83c0 0x55938710bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 >> 172.21.15.7:0/2811455942 conn(0x5593870f48d0 msgr2=0x55938710e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.249+0000 7ff792a00640 0 client.18429 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 shutdown_connections 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b69b6740 1 -- 172.21.15.7:0/2811455942 wait complete. 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b69b6740 20 client.18429 trim_cache size 0 max 16384 2024-04-23T15:25:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:25:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:25:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:25:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:25:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7940a3f60 msgr2=0x7ff7940a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b2400640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7940a3f60 0x7ff7940a6420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff7a402f3a0 tx=0x7ff7a402f310 comp rx=0 tx=0).stop 2024-04-23T15:25:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 msgr2=0x7ff7ac110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.250+0000 7ff7b2400640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac110060 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c970 tx=0x7ff79800ce30 comp rx=0 tx=0).stop 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 shutdown_connections 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff7940a3f60 0x7ff7940a6420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7ac1105a0 0x7ff7ac1a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7ac106030 0x7ff7ac110060 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 --2- 172.21.15.7:0/3815191538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7ac100f60 0x7ff7ac10fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 >> 172.21.15.7:0/3815191538 conn(0x7ff7ac0fc820 msgr2=0x7ff7ac0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 shutdown_connections 2024-04-23T15:25:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:37.251+0000 7ff7b2400640 1 -- 172.21.15.7:0/3815191538 wait complete. 2024-04-23T15:25:37.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:36 smithi007 ceph-mon[27906]: pgmap v1084: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:36 smithi186 ceph-mon[31814]: pgmap v1084: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:36 smithi137 ceph-mon[31694]: pgmap v1084: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:38 smithi007 ceph-mon[27906]: pgmap v1085: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:25:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:38 smithi186 ceph-mon[31814]: pgmap v1085: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:25:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:38 smithi137 ceph-mon[31694]: pgmap v1085: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:25:41.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:40 smithi007 ceph-mon[27906]: pgmap v1086: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:25:41.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:40 smithi186 ceph-mon[31814]: pgmap v1086: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:25:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:40 smithi137 ceph-mon[31694]: pgmap v1086: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:25:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:42 smithi007 ceph-mon[27906]: pgmap v1087: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:25:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:42 smithi186 ceph-mon[31814]: pgmap v1087: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:25:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:42 smithi137 ceph-mon[31694]: pgmap v1087: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:25:45.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:45 smithi007 ceph-mon[27906]: pgmap v1088: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:25:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:45 smithi186 ceph-mon[31814]: pgmap v1088: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:25:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:45 smithi137 ceph-mon[31694]: pgmap v1088: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:25:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:47 smithi007 ceph-mon[27906]: pgmap v1089: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:25:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:47 smithi186 ceph-mon[31814]: pgmap v1089: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:25:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:47 smithi137 ceph-mon[31694]: pgmap v1089: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:25:49.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:49 smithi007 ceph-mon[27906]: pgmap v1090: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:25:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:49 smithi186 ceph-mon[31814]: pgmap v1090: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:25:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:49 smithi137 ceph-mon[31694]: pgmap v1090: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:25:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 -- 172.21.15.7:0/1917619441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda40743d0 msgr2=0x7efda40747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 --2- 172.21.15.7:0/1917619441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda40743d0 0x7efda40747b0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7efd94009900 tx=0x7efd9402a490 comp rx=0 tx=0).stop 2024-04-23T15:25:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 -- 172.21.15.7:0/1917619441 shutdown_connections 2024-04-23T15:25:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 --2- 172.21.15.7:0/1917619441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda4074cf0 0x7efda410e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 --2- 172.21.15.7:0/1917619441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efda410e6c0 0x7efda4110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 --2- 172.21.15.7:0/1917619441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda40743d0 0x7efda40747b0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 -- 172.21.15.7:0/1917619441 >> 172.21.15.7:0/1917619441 conn(0x7efda40fd950 msgr2=0x7efda40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 -- 172.21.15.7:0/1917619441 shutdown_connections 2024-04-23T15:25:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.406+0000 7efda3200640 1 -- 172.21.15.7:0/1917619441 wait complete. 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.407+0000 7efda3200640 1 Processor -- start 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.407+0000 7efda3200640 1 -- start start 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda40743d0 0x7efda41a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efda4074cf0 0x7efda41a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 0x7efda419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efda4114340 con 0x7efda410e6c0 2024-04-23T15:25:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efda41141c0 con 0x7efda40743d0 2024-04-23T15:25:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efda41144c0 con 0x7efda4074cf0 2024-04-23T15:25:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 0x7efda419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 0x7efda419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35636/0 (socket says 172.21.15.7:35636) 2024-04-23T15:25:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.408+0000 7efda2800640 1 -- 172.21.15.7:0/17633621 learned_addr learned my addr 172.21.15.7:0/17633621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda1e00640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda40743d0 0x7efda41a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efd99400640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efda4074cf0 0x7efda41a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda2800640 1 -- 172.21.15.7:0/17633621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efda4074cf0 msgr2=0x7efda41a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda2800640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efda4074cf0 0x7efda41a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda2800640 1 -- 172.21.15.7:0/17633621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda40743d0 msgr2=0x7efda41a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda2800640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda40743d0 0x7efda41a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda2800640 1 -- 172.21.15.7:0/17633621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda419afc0 con 0x7efda410e6c0 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.409+0000 7efda2800640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 0x7efda419a700 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009fd0 tx=0x7efd9c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.410+0000 7efd9b400640 1 -- 172.21.15.7:0/17633621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c004d20 con 0x7efda410e6c0 2024-04-23T15:25:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.410+0000 7efd9b400640 1 -- 172.21.15.7:0/17633621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd9c005020 con 0x7efda410e6c0 2024-04-23T15:25:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.410+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda419b2b0 con 0x7efda410e6c0 2024-04-23T15:25:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.410+0000 7efd9b400640 1 -- 172.21.15.7:0/17633621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0116b0 con 0x7efda410e6c0 2024-04-23T15:25:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.410+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda41a7570 con 0x7efda410e6c0 2024-04-23T15:25:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.414+0000 7efd9b400640 1 -- 172.21.15.7:0/17633621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7efd9c0051d0 con 0x7efda410e6c0 2024-04-23T15:25:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.414+0000 7efdac02a740 1 Processor -- start 2024-04-23T15:25:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.414+0000 7efdac02a740 1 -- start start 2024-04-23T15:25:50.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efdac02a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dc97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efdac02a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efdac02a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efdac02a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55abb9d2f900 con 0x55abb9dc9ce0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efdac02a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55abb9cd5f20 con 0x55abb9dd45a0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efdac02a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55abb9d2b8c0 con 0x55abb9dc93c0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efda1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efda1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35646/0 (socket says 172.21.15.7:35646) 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efda1e00640 1 -- 172.21.15.7:0/3482320187 learned_addr learned my addr 172.21.15.7:0/3482320187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.415+0000 7efd99400640 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efd9b400640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efd880a3d10 0x7efd880a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efd99400640 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dc97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda1e00640 1 -- 172.21.15.7:0/3482320187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 msgr2=0x55abb9dc97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efd9b400640 1 -- 172.21.15.7:0/17633621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7efd9c0d11b0 con 0x7efda410e6c0 2024-04-23T15:25:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda1e00640 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dc97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda1e00640 1 -- 172.21.15.7:0/3482320187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 msgr2=0x55abb9dd6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda1e00640 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda1e00640 1 -- 172.21.15.7:0/3482320187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb9cfae10 con 0x55abb9dc9ce0 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efd99400640 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda2800640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efd880a3d10 0x7efd880a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.416+0000 7efda1e00640 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd4060 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7efd94009900 tx=0x7efd94004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20272ba6d6a975e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.417+0000 7efd93400640 1 -- 172.21.15.7:0/3482320187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94035030 con 0x55abb9dc9ce0 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.417+0000 7efd93400640 1 -- 172.21.15.7:0/3482320187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd940054f0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.417+0000 7efd93400640 1 -- 172.21.15.7:0/3482320187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940035f0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.417+0000 7efda2800640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efd880a3d10 0x7efd880a61d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0ce550 tx=0x7efd9c005b40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 -- 172.21.15.7:0/3482320187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 msgr2=0x55abb9dd4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd4060 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7efd94009900 tx=0x7efd94004170 comp rx=0 tx=0).stop 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 -- 172.21.15.7:0/3482320187 shutdown_connections 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd4060 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 --2- 172.21.15.7:0/3482320187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dc97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 -- 172.21.15.7:0/3482320187 >> 172.21.15.7:0/3482320187 conn(0x55abb9dc58d0 msgr2=0x55abb9dc5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 -- 172.21.15.7:0/3482320187 shutdown_connections 2024-04-23T15:25:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 -- 172.21.15.7:0/3482320187 wait complete. 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.418+0000 7efdac02a740 1 -- start start 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 Processor -- start 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55abb9dd70e0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55abb9ce92c0 con 0x55abb9dd45a0 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55abb9dd7260 con 0x55abb9dc93c0 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.419+0000 7efdac02a740 10 client.0 _ll_register_callbacks cb 0x55abb9a41a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35662/0 (socket says 172.21.15.7:35662) 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 -- 172.21.15.7:0/3950426697 learned_addr learned my addr 172.21.15.7:0/3950426697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efd99400640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efd99400640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 -- 172.21.15.7:0/3950426697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 msgr2=0x55abb9dd1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 -- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 msgr2=0x55abb9dd20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efda1e00640 1 -- 172.21.15.7:0/3950426697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb9cf9fd0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.420+0000 7efd99400640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.421+0000 7efda1e00640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd1b80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7efd9402a9b0 tx=0x7efd94005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0f8d970ff5f368 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.421+0000 7efd87e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.421+0000 7efd87e00640 1 -- 172.21.15.7:0/3950426697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94035070 con 0x55abb9dc9ce0 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.421+0000 7efd87e00640 1 -- 172.21.15.7:0/3950426697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7efd940050d0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.421+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd940054f0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efd87e00640 1 -- 172.21.15.7:0/3950426697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efd940052d0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 10 client.18441 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55abb9a42210 con 0x55abb9dc9ce0 2024-04-23T15:25:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efd87e00640 1 -- 172.21.15.7:0/3950426697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd940054f0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efd87e00640 1 -- 172.21.15.7:0/3950426697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7efd940317d0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 10 client.18441 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 10 client.18441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 20 client.18441 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9de45f0 0x55abb9de69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 4 client.18441 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.422+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abb9d3d320 con 0x55abb9de45f0 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.423+0000 7efd99400640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9de45f0 0x55abb9de69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.424+0000 7efd99400640 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9de45f0 0x55abb9de69e0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519b15b9f2f5dd5 server_cookie=987488cbb3b256e5 in_seq=0 out_seq=0 2024-04-23T15:25:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.424+0000 7efd87e00640 10 client.18441 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efd87e00640 1 -- 172.21.15.7:0/3950426697 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55abb9d3d320 con 0x55abb9de45f0 2024-04-23T15:25:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efd87e00640 10 client.18441 handle_command_reply: tid=0 2024-04-23T15:25:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 client.18441 shutdown 2024-04-23T15:25:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 msgr2=0x55abb9dd1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd1b80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7efd9402a9b0 tx=0x7efd94005770 comp rx=0 tx=0).stop 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 shutdown_connections 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9de45f0 0x55abb9de69e0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd1b80 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 --2- 172.21.15.7:0/3950426697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efd87e00640 0 client.18441 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 >> 172.21.15.7:0/3950426697 conn(0x55abb9dc58d0 msgr2=0x55abb9dcb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 shutdown_connections 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.426+0000 7efdac02a740 1 -- 172.21.15.7:0/3950426697 wait complete. 2024-04-23T15:25:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.427+0000 7efdac02a740 20 client.18441 trim_cache size 0 max 16384 2024-04-23T15:25:50.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.451+0000 7efdac02a740 1 Processor -- start 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.451+0000 7efdac02a740 1 -- start start 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efdac02a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 0x55abb9de00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efdac02a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc9ce0 0x55abb9dcbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efdac02a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efdac02a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efda41b14a0 con 0x55abb9dc93c0 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efdac02a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efda41b2fe0 con 0x55abb9dd45a0 2024-04-23T15:25:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efdac02a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efda41b1b70 con 0x55abb9dc9ce0 2024-04-23T15:25:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efd99400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 0x55abb9de00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efd99400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 0x55abb9de00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35668/0 (socket says 172.21.15.7:35668) 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efd99400640 1 -- 172.21.15.7:0/1992284870 learned_addr learned my addr 172.21.15.7:0/1992284870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.452+0000 7efda1e00640 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc9ce0 0x55abb9dcbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efd99400640 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efda1e00640 1 -- 172.21.15.7:0/1992284870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 msgr2=0x55abb9dd1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efda1e00640 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efda1e00640 1 -- 172.21.15.7:0/1992284870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 msgr2=0x55abb9de00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efda1e00640 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 0x55abb9de00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efda1e00640 1 -- 172.21.15.7:0/1992284870 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb9de1250 con 0x55abb9dc9ce0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efd99400640 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 0x55abb9de00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.453+0000 7efda1e00640 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc9ce0 0x55abb9dcbcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd94031bd0 tx=0x7efd94000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31e7a56b769c8a10 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.454+0000 7efd92a00640 1 -- 172.21.15.7:0/1992284870 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94035070 con 0x55abb9dc9ce0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.454+0000 7efd92a00640 1 -- 172.21.15.7:0/1992284870 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd940050d0 con 0x55abb9dc9ce0 2024-04-23T15:25:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.454+0000 7efd92a00640 1 -- 172.21.15.7:0/1992284870 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94003d10 con 0x55abb9dc9ce0 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 -- 172.21.15.7:0/1992284870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc9ce0 msgr2=0x55abb9dcbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc9ce0 0x55abb9dcbcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd94031bd0 tx=0x7efd94000bc0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 -- 172.21.15.7:0/1992284870 shutdown_connections 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dd45a0 0x55abb9dd1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc9ce0 0x55abb9dcbcf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 --2- 172.21.15.7:0/1992284870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dc93c0 0x55abb9de00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 -- 172.21.15.7:0/1992284870 >> 172.21.15.7:0/1992284870 conn(0x55abb9dc58d0 msgr2=0x55abb9dd1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 -- 172.21.15.7:0/1992284870 shutdown_connections 2024-04-23T15:25:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.455+0000 7efdac02a740 1 -- 172.21.15.7:0/1992284870 wait complete. 2024-04-23T15:25:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 -- start start 2024-04-23T15:25:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 Processor -- start 2024-04-23T15:25:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 0x55abb9dd8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efda41b2910 con 0x55abb9dd45a0 2024-04-23T15:25:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.456+0000 7efdac02a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efda41b2240 con 0x55abb9dc9ce0 2024-04-23T15:25:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efdac02a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efda41af4a0 con 0x55abb9dc93c0 2024-04-23T15:25:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efdac02a740 10 client.0 _ll_register_callbacks cb 0x7efd94004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 0x55abb9dd8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 0x55abb9dd8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35678/0 (socket says 172.21.15.7:35678) 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 -- 172.21.15.7:0/3365123968 learned_addr learned my addr 172.21.15.7:0/3365123968 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efda1e00640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 -- 172.21.15.7:0/3365123968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 msgr2=0x55abb9dd8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 -- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dc9ce0 msgr2=0x55abb9dd8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.457+0000 7efd99400640 1 -- 172.21.15.7:0/3365123968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb9b0e620 con 0x55abb9dd45a0 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efd99400640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 0x55abb9dd8b90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7efda419bf00 tx=0x7efd8c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131442e5e2175db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efd87e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efd87e00640 1 -- 172.21.15.7:0/3365123968 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c004030 con 0x55abb9dd45a0 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efd87e00640 1 -- 172.21.15.7:0/3365123968 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 9467+0+0 (secure 0 0 0) 0x7efd8c01d040 con 0x55abb9dd45a0 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd940050d0 con 0x55abb9dd45a0 2024-04-23T15:25:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efd87e00640 1 -- 172.21.15.7:0/3365123968 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efd8c035050 con 0x55abb9dd45a0 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efdac02a740 10 client.18447 fetch_fsmap learned FSMap version 32 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.458+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55abb9e4abf0 con 0x55abb9dd45a0 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efd87e00640 1 -- 172.21.15.7:0/3365123968 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd940050d0 con 0x55abb9dd45a0 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efd87e00640 1 -- 172.21.15.7:0/3365123968 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7efd94004360 con 0x55abb9dd45a0 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efdac02a740 10 client.18447 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efdac02a740 10 client.18447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efdac02a740 20 client.18447 populate_metadata read hostname 'smithi007' 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efdac02a740 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9e4b350 0x55abb9e4d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:25:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efdac02a740 4 client.18447 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:25:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.459+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55abb9d37190 con 0x55abb9e4b350 2024-04-23T15:25:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.460+0000 7efda1e00640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9e4b350 0x55abb9e4d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:25:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.461+0000 7efda1e00640 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9e4b350 0x55abb9e4d770 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46c4f79a3fa4afb4 server_cookie=563a0cf8216c06bb in_seq=0 out_seq=0 2024-04-23T15:25:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.461+0000 7efd87e00640 10 client.18447 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.493+0000 7efd87e00640 1 -- 172.21.15.7:0/3365123968 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55abb9d37190 con 0x55abb9e4b350 2024-04-23T15:25:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.493+0000 7efd87e00640 10 client.18447 handle_command_reply: tid=0 2024-04-23T15:25:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.493+0000 7efdac02a740 1 client.18447 shutdown 2024-04-23T15:25:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 msgr2=0x55abb9dd8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 0x55abb9dd8b90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7efda419bf00 tx=0x7efd8c00c830 comp rx=0 tx=0).stop 2024-04-23T15:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 shutdown_connections 2024-04-23T15:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55abb9e4b350 0x55abb9e4d770 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55abb9dc9ce0 0x55abb9dd8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55abb9dd45a0 0x55abb9dd8b90 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efd87e00640 0 client.18447 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 --2- 172.21.15.7:0/3365123968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55abb9dc93c0 0x55abb9dd8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 >> 172.21.15.7:0/3365123968 conn(0x55abb9dc58d0 msgr2=0x55abb9dc4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 shutdown_connections 2024-04-23T15:25:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 1 -- 172.21.15.7:0/3365123968 wait complete. 2024-04-23T15:25:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.494+0000 7efdac02a740 20 client.18447 trim_cache size 0 max 16384 2024-04-23T15:25:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:25:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:25:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:25:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:25:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efd880a3d10 msgr2=0x7efd880a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efd880a3d10 0x7efd880a61d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0ce550 tx=0x7efd9c005b40 comp rx=0 tx=0).stop 2024-04-23T15:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 msgr2=0x7efda419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 0x7efda419a700 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009fd0 tx=0x7efd9c00ee60 comp rx=0 tx=0).stop 2024-04-23T15:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 shutdown_connections 2024-04-23T15:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efd880a3d10 0x7efd880a61d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efda410e6c0 0x7efda419a700 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efda4074cf0 0x7efda41a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 --2- 172.21.15.7:0/17633621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda40743d0 0x7efda41a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.495+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 >> 172.21.15.7:0/17633621 conn(0x7efda40fd950 msgr2=0x7efda40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.496+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 shutdown_connections 2024-04-23T15:25:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:25:50.496+0000 7efda3200640 1 -- 172.21.15.7:0/17633621 wait complete. 2024-04-23T15:25:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:51 smithi007 ceph-mon[27906]: pgmap v1091: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:25:51.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:51 smithi186 ceph-mon[31814]: pgmap v1091: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:25:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:51 smithi137 ceph-mon[31694]: pgmap v1091: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:25:52.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:52 smithi007 ceph-mon[27906]: pgmap v1092: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:25:52.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:52 smithi186 ceph-mon[31814]: pgmap v1092: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:25:52.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:52 smithi137 ceph-mon[31694]: pgmap v1092: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:25:54.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:54 smithi137 ceph-mon[31694]: pgmap v1093: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:25:54.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:54 smithi007 ceph-mon[27906]: pgmap v1093: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:25:54.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:54 smithi186 ceph-mon[31814]: pgmap v1093: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:25:56.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:56 smithi137 ceph-mon[31694]: pgmap v1094: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:56.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:56 smithi007 ceph-mon[27906]: pgmap v1094: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:56.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:56 smithi186 ceph-mon[31814]: pgmap v1094: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:25:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:58 smithi137 ceph-mon[31694]: pgmap v1095: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:25:58.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:58 smithi007 ceph-mon[27906]: pgmap v1095: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:58.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:25:58.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:58 smithi186 ceph-mon[31814]: pgmap v1095: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:25:58.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:25:59.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:59 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:25:59.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:59 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:25:59.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:25:59 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:25:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:59 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:25:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:59 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:25:59.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:25:59 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:25:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:59 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:25:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:59 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:25:59.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:25:59 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:26:00.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:00 smithi137 ceph-mon[31694]: pgmap v1096: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:26:00.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:00 smithi007 ceph-mon[27906]: pgmap v1096: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:26:00.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:00 smithi186 ceph-mon[31814]: pgmap v1096: 129 pgs: 129 active+clean; 9.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:26:02.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:02 smithi137 ceph-mon[31694]: pgmap v1097: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.0 MiB/s wr, 36 op/s 2024-04-23T15:26:02.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:02 smithi007 ceph-mon[27906]: pgmap v1097: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.0 MiB/s wr, 36 op/s 2024-04-23T15:26:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:02 smithi186 ceph-mon[31814]: pgmap v1097: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.0 MiB/s wr, 36 op/s 2024-04-23T15:26:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.656+0000 7fb30d200640 1 -- 172.21.15.7:0/3855369358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308104c50 msgr2=0x7fb308108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.656+0000 7fb30d200640 1 --2- 172.21.15.7:0/3855369358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308104c50 0x7fb308108c90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009900 tx=0x7fb2f402a410 comp rx=0 tx=0).stop 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 -- 172.21.15.7:0/3855369358 shutdown_connections 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 --2- 172.21.15.7:0/3855369358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb308109370 0x7fb308110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 --2- 172.21.15.7:0/3855369358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308104c50 0x7fb308108c90 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 --2- 172.21.15.7:0/3855369358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3081042a0 0x7fb308104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 -- 172.21.15.7:0/3855369358 >> 172.21.15.7:0/3855369358 conn(0x7fb3080ffae0 msgr2=0x7fb308101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 -- 172.21.15.7:0/3855369358 shutdown_connections 2024-04-23T15:26:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.657+0000 7fb30d200640 1 -- 172.21.15.7:0/3855369358 wait complete. 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.658+0000 7fb30d200640 1 Processor -- start 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.658+0000 7fb30d200640 1 -- start start 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb30d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3081042a0 0x7fb3081a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb30d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 0x7fb3081a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb30d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb30819a7a0 0x7fb30819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb30d200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb308114300 con 0x7fb308109370 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb30d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb308114180 con 0x7fb30819a7a0 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb30d200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb308114480 con 0x7fb3081042a0 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb306a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 0x7fb3081a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb306a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 0x7fb3081a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46022/0 (socket says 172.21.15.7:46022) 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.659+0000 7fb306a00640 1 -- 172.21.15.7:0/3432470375 learned_addr learned my addr 172.21.15.7:0/3432470375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb307e00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb30819a7a0 0x7fb30819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb307400640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3081042a0 0x7fb3081a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb306a00640 1 -- 172.21.15.7:0/3432470375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3081042a0 msgr2=0x7fb3081a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb306a00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3081042a0 0x7fb3081a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb306a00640 1 -- 172.21.15.7:0/3432470375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb30819a7a0 msgr2=0x7fb30819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb306a00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb30819a7a0 0x7fb30819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb306a00640 1 -- 172.21.15.7:0/3432470375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30819b3a0 con 0x7fb308109370 2024-04-23T15:26:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.660+0000 7fb306a00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 0x7fb3081a0bd0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4005ab0 tx=0x7fb2f4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.661+0000 7fb2ffe00640 1 -- 172.21.15.7:0/3432470375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f403f070 con 0x7fb308109370 2024-04-23T15:26:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.661+0000 7fb2ffe00640 1 -- 172.21.15.7:0/3432470375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2f4031d60 con 0x7fb308109370 2024-04-23T15:26:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.661+0000 7fb2ffe00640 1 -- 172.21.15.7:0/3432470375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4035030 con 0x7fb308109370 2024-04-23T15:26:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.661+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30819b630 con 0x7fb308109370 2024-04-23T15:26:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.661+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3081a76d0 con 0x7fb308109370 2024-04-23T15:26:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.664+0000 7fb3115b7740 1 Processor -- start 2024-04-23T15:26:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.664+0000 7fb3115b7740 1 -- start start 2024-04-23T15:26:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb3115b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1cb42e900 con 0x55d1cb4c83c0 2024-04-23T15:26:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb3115b7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d1cb3d4f20 con 0x55d1cb4c8ce0 2024-04-23T15:26:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb3115b7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d1cb42a8c0 con 0x55d1cb4d35a0 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb307e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb307e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46036/0 (socket says 172.21.15.7:46036) 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb307e00640 1 -- 172.21.15.7:0/2597334048 learned_addr learned my addr 172.21.15.7:0/2597334048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.665+0000 7fb307400640 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb307e00640 1 -- 172.21.15.7:0/2597334048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4d35a0 msgr2=0x55d1cb4d5990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb307e00640 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d5990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb307e00640 1 -- 172.21.15.7:0/2597334048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 msgr2=0x55d1cb4d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb307e00640 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb307e00640 1 -- 172.21.15.7:0/2597334048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1cb3f9e10 con 0x55d1cb4c83c0 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb2ffe00640 1 -- 172.21.15.7:0/3432470375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb2f4042070 con 0x7fb308109370 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb307e00640 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4c87a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fb300009e60 tx=0x7fb300010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc0af12674c995 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb2fcc00640 1 -- 172.21.15.7:0/2597334048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300016070 con 0x55d1cb4c83c0 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb2fcc00640 1 -- 172.21.15.7:0/2597334048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb300004d20 con 0x55d1cb4c83c0 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.666+0000 7fb2fcc00640 1 -- 172.21.15.7:0/2597334048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300012740 con 0x55d1cb4c83c0 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.667+0000 7fb3115b7740 1 -- 172.21.15.7:0/2597334048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 msgr2=0x55d1cb4c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.667+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4c87a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fb300009e60 tx=0x7fb300010740 comp rx=0 tx=0).stop 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb2ffe00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb2ec0a3d90 0x7fb2ec0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 -- 172.21.15.7:0/2597334048 shutdown_connections 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb2ffe00640 1 -- 172.21.15.7:0/3432470375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 9555+0+0 (secure 0 0 0) 0x7fb2f40f1480 con 0x7fb308109370 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2597334048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4c87a0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 -- 172.21.15.7:0/2597334048 >> 172.21.15.7:0/2597334048 conn(0x55d1cb4c48d0 msgr2=0x55d1cb4c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb307e00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb2ec0a3d90 0x7fb2ec0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 -- 172.21.15.7:0/2597334048 shutdown_connections 2024-04-23T15:26:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.668+0000 7fb3115b7740 1 -- 172.21.15.7:0/2597334048 wait complete. 2024-04-23T15:26:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.669+0000 7fb3115b7740 1 -- start start 2024-04-23T15:26:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.669+0000 7fb307e00640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb2ec0a3d90 0x7fb2ec0a6250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb300005bd0 tx=0x7fb300000f40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.669+0000 7fb3115b7740 1 Processor -- start 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1cb4d60e0 con 0x55d1cb4c83c0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d1cb3e82c0 con 0x55d1cb4d35a0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d1cb4d6260 con 0x55d1cb4c8ce0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb3115b7740 10 client.0 _ll_register_callbacks cb 0x55d1cb140a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb307400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb307400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46052/0 (socket says 172.21.15.7:46052) 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb307400640 1 -- 172.21.15.7:0/4027629977 learned_addr learned my addr 172.21.15.7:0/4027629977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb307e00640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.670+0000 7fb306a00640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb307400640 1 -- 172.21.15.7:0/4027629977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 msgr2=0x55d1cb4d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb307400640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb307400640 1 -- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4d35a0 msgr2=0x55d1cb4d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb307400640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb307400640 1 -- 172.21.15.7:0/4027629977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cb3f8fd0 con 0x55d1cb4c83c0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb307400640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d0620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800be40 tx=0x7fb2f80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1ee2b07af09436 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb2f1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb2f1600640 1 -- 172.21.15.7:0/4027629977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8012650 con 0x55d1cb4c83c0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb2f1600640 1 -- 172.21.15.7:0/4027629977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 9555+0+0 (secure 0 0 0) 0x7fb2f80127f0 con 0x55d1cb4c83c0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.671+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb300004d20 con 0x55d1cb4c83c0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb2f1600640 1 -- 172.21.15.7:0/4027629977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb2f80129f0 con 0x55d1cb4c83c0 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb3115b7740 10 client.18459 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d1cb141210 con 0x55d1cb4c83c0 2024-04-23T15:26:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb2f1600640 1 -- 172.21.15.7:0/4027629977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb300004d20 con 0x55d1cb4c83c0 2024-04-23T15:26:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb2f1600640 1 -- 172.21.15.7:0/4027629977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb2f801bc60 con 0x55d1cb4c83c0 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb3115b7740 10 client.18459 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.672+0000 7fb3115b7740 10 client.18459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.673+0000 7fb3115b7740 20 client.18459 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.673+0000 7fb3115b7740 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb4e3850 0x55d1cb4e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.673+0000 7fb3115b7740 4 client.18459 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.673+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1cb43c320 con 0x55d1cb4e3850 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.673+0000 7fb306a00640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb4e3850 0x55d1cb4e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.674+0000 7fb2f1600640 10 client.18459 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.674+0000 7fb306a00640 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb4e3850 0x55d1cb4e5c40 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86980cd2b685c1f3 server_cookie=5fca3d11adb7460f in_seq=0 out_seq=0 2024-04-23T15:26:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb2f1600640 1 -- 172.21.15.7:0/4027629977 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d1cb43c320 con 0x55d1cb4e3850 2024-04-23T15:26:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb2f1600640 10 client.18459 handle_command_reply: tid=0 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 client.18459 shutdown 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 msgr2=0x55d1cb4d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d0620 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800be40 tx=0x7fb2f80117b0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 shutdown_connections 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb4e3850 0x55d1cb4e5c40 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb2f1600640 0 client.18459 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 --2- 172.21.15.7:0/4027629977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d0620 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.676+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 >> 172.21.15.7:0/4027629977 conn(0x55d1cb4c48d0 msgr2=0x55d1cb4ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.677+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 shutdown_connections 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.677+0000 7fb3115b7740 1 -- 172.21.15.7:0/4027629977 wait complete. 2024-04-23T15:26:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.677+0000 7fb3115b7740 20 client.18459 trim_cache size 0 max 16384 2024-04-23T15:26:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.694+0000 7fb3115b7740 1 Processor -- start 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.694+0000 7fb3115b7740 1 -- start start 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4eb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb3115b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b1600 con 0x55d1cb4d35a0 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb3115b7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b3140 con 0x55d1cb4c83c0 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb3115b7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b1cd0 con 0x55d1cb4c8ce0 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4eb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46060/0 (socket says 172.21.15.7:46060) 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 -- 172.21.15.7:0/2928682605 learned_addr learned my addr 172.21.15.7:0/2928682605 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb306a00640 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307400640 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 -- 172.21.15.7:0/2928682605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 msgr2=0x55d1cb4df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4df080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 -- 172.21.15.7:0/2928682605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c83c0 msgr2=0x55d1cb4d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307e00640 1 -- 172.21.15.7:0/2928682605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1cb4e5fb0 con 0x55d1cb4d35a0 2024-04-23T15:26:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.695+0000 7fb307400640 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:26:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.696+0000 7fb307e00640 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4eb530 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb300005a50 tx=0x7fb300009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244aeca6d4c24427 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.696+0000 7fb2f3e00640 1 -- 172.21.15.7:0/2928682605 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300016040 con 0x55d1cb4d35a0 2024-04-23T15:26:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.696+0000 7fb2f3e00640 1 -- 172.21.15.7:0/2928682605 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb300012d30 con 0x55d1cb4d35a0 2024-04-23T15:26:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.696+0000 7fb2f3e00640 1 -- 172.21.15.7:0/2928682605 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30002e670 con 0x55d1cb4d35a0 2024-04-23T15:26:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 -- 172.21.15.7:0/2928682605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 msgr2=0x55d1cb4eb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4eb530 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb300005a50 tx=0x7fb300009760 comp rx=0 tx=0).stop 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 -- 172.21.15.7:0/2928682605 shutdown_connections 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4eb530 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2928682605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 -- 172.21.15.7:0/2928682605 >> 172.21.15.7:0/2928682605 conn(0x55d1cb4c48d0 msgr2=0x55d1cb4c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 -- 172.21.15.7:0/2928682605 shutdown_connections 2024-04-23T15:26:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.697+0000 7fb3115b7740 1 -- 172.21.15.7:0/2928682605 wait complete. 2024-04-23T15:26:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.698+0000 7fb3115b7740 1 -- start start 2024-04-23T15:26:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.698+0000 7fb3115b7740 1 Processor -- start 2024-04-23T15:26:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.698+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4db860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb3115b7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb3115b7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b2a70 con 0x55d1cb4d35a0 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb3115b7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b23a0 con 0x55d1cb4c8ce0 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb3115b7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081af600 con 0x55d1cb4c83c0 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb3115b7740 10 client.0 _ll_register_callbacks cb 0x7fb2f800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46064/0 (socket says 172.21.15.7:46064) 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 -- 172.21.15.7:0/2343330432 learned_addr learned my addr 172.21.15.7:0/2343330432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307400640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4db860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb306a00640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 -- 172.21.15.7:0/2343330432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c83c0 msgr2=0x55d1cb4db860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4db860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 -- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 msgr2=0x55d1cb4d8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.699+0000 7fb307e00640 1 -- 172.21.15.7:0/2343330432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cb20d620 con 0x55d1cb4d35a0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.700+0000 7fb307e00640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d8aa0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb300005fd0 tx=0x7fb300025740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff5f59bb9c845f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.700+0000 7fb2f1600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.700+0000 7fb2f1600640 1 -- 172.21.15.7:0/2343330432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30003c020 con 0x55d1cb4d35a0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.700+0000 7fb2f1600640 1 -- 172.21.15.7:0/2343330432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 9555+0+0 (secure 0 0 0) 0x7fb300012450 con 0x55d1cb4d35a0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.700+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb300012d30 con 0x55d1cb4d35a0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb2f1600640 1 -- 172.21.15.7:0/2343330432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb300047050 con 0x55d1cb4d35a0 2024-04-23T15:26:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 10 client.18465 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d1cb54aa20 con 0x55d1cb4d35a0 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb2f1600640 1 -- 172.21.15.7:0/2343330432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb300012d30 con 0x55d1cb4d35a0 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb2f1600640 1 -- 172.21.15.7:0/2343330432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb30000f040 con 0x55d1cb4d35a0 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 10 client.18465 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 10 client.18465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 20 client.18465 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb54af90 0x55d1cb54d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:03.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 4 client.18465 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:26:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.701+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1cb436190 con 0x55d1cb54af90 2024-04-23T15:26:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.702+0000 7fb307400640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb54af90 0x55d1cb54d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.703+0000 7fb307400640 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb54af90 0x55d1cb54d380 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=341238e96064a8b5 server_cookie=8524583c95aacb1a in_seq=0 out_seq=0 2024-04-23T15:26:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.703+0000 7fb2f1600640 10 client.18465 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb2f1600640 1 -- 172.21.15.7:0/2343330432 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d1cb436190 con 0x55d1cb54af90 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb2f1600640 10 client.18465 handle_command_reply: tid=0 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 client.18465 shutdown 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 msgr2=0x55d1cb4d8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d8aa0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb300005fd0 tx=0x7fb300025740 comp rx=0 tx=0).stop 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 shutdown_connections 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d1cb54af90 0x55d1cb54d380 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d1cb4c8ce0 0x55d1cb4d8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cb4d35a0 0x55d1cb4d8aa0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 --2- 172.21.15.7:0/2343330432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d1cb4c83c0 0x55d1cb4db860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 >> 172.21.15.7:0/2343330432 conn(0x55d1cb4c48d0 msgr2=0x55d1cb4c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.764+0000 7fb2f1600640 0 client.18465 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 shutdown_connections 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb3115b7740 1 -- 172.21.15.7:0/2343330432 wait complete. 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb3115b7740 20 client.18465 trim_cache size 0 max 16384 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:26:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:26:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:26:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:26:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb2ec0a3d90 msgr2=0x7fb2ec0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb30d200640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb2ec0a3d90 0x7fb2ec0a6250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb300005bd0 tx=0x7fb300000f40 comp rx=0 tx=0).stop 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 msgr2=0x7fb3081a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.765+0000 7fb30d200640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 0x7fb3081a0bd0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4005ab0 tx=0x7fb2f4003cd0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 shutdown_connections 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb2ec0a3d90 0x7fb2ec0a6250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb30819a7a0 0x7fb30819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb308109370 0x7fb3081a0bd0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 --2- 172.21.15.7:0/3432470375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3081042a0 0x7fb3081a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 >> 172.21.15.7:0/3432470375 conn(0x7fb3080ffae0 msgr2=0x7fb308100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 shutdown_connections 2024-04-23T15:26:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:03.766+0000 7fb30d200640 1 -- 172.21.15.7:0/3432470375 wait complete. 2024-04-23T15:26:04.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:04 smithi007 ceph-mon[27906]: pgmap v1098: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 27 op/s 2024-04-23T15:26:04.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:04 smithi007 ceph-mon[27906]: osdmap e149: 12 total, 12 up, 12 in 2024-04-23T15:26:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:04 smithi186 ceph-mon[31814]: pgmap v1098: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 27 op/s 2024-04-23T15:26:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:04 smithi186 ceph-mon[31814]: osdmap e149: 12 total, 12 up, 12 in 2024-04-23T15:26:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:04 smithi137 ceph-mon[31694]: pgmap v1098: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 27 op/s 2024-04-23T15:26:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:04 smithi137 ceph-mon[31694]: osdmap e149: 12 total, 12 up, 12 in 2024-04-23T15:26:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:06 smithi007 ceph-mon[27906]: pgmap v1100: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T15:26:06.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:06 smithi186 ceph-mon[31814]: pgmap v1100: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T15:26:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:06 smithi137 ceph-mon[31694]: pgmap v1100: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 33 op/s 2024-04-23T15:26:08.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:08 smithi007 ceph-mon[27906]: pgmap v1101: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:26:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:08 smithi186 ceph-mon[31814]: pgmap v1101: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:26:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:08 smithi137 ceph-mon[31694]: pgmap v1101: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:26:10.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:10 smithi007 ceph-mon[27906]: pgmap v1102: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:26:10.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:10 smithi186 ceph-mon[31814]: pgmap v1102: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:26:10.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:10 smithi137 ceph-mon[31694]: pgmap v1102: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:26:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:12 smithi007 ceph-mon[27906]: osdmap e150: 12 total, 12 up, 12 in 2024-04-23T15:26:12.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:12 smithi186 ceph-mon[31814]: osdmap e150: 12 total, 12 up, 12 in 2024-04-23T15:26:12.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:12 smithi137 ceph-mon[31694]: osdmap e150: 12 total, 12 up, 12 in 2024-04-23T15:26:13.265 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:13 smithi186 ceph-mon[31814]: pgmap v1104: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:26:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:13 smithi007 ceph-mon[27906]: pgmap v1104: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:26:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:13 smithi137 ceph-mon[31694]: pgmap v1104: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.7 MiB/s wr, 21 op/s 2024-04-23T15:26:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:15 smithi007 ceph-mon[27906]: pgmap v1105: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:26:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:15 smithi186 ceph-mon[31814]: pgmap v1105: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:26:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:15 smithi137 ceph-mon[31694]: pgmap v1105: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:26:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 -- 172.21.15.7:0/3450247177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 msgr2=0x7f7cc41053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3450247177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc41053c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009900 tx=0x7f7cb002a410 comp rx=0 tx=0).stop 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 -- 172.21.15.7:0/3450247177 shutdown_connections 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3450247177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc410b120 0x7f7cc410d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3450247177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc41053c0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3450247177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc40689d0 0x7f7cc4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 -- 172.21.15.7:0/3450247177 >> 172.21.15.7:0/3450247177 conn(0x7f7cc4077000 msgr2=0x7f7cc40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 -- 172.21.15.7:0/3450247177 shutdown_connections 2024-04-23T15:26:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.925+0000 7f7ccba00640 1 -- 172.21.15.7:0/3450247177 wait complete. 2024-04-23T15:26:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.926+0000 7f7ccba00640 1 Processor -- start 2024-04-23T15:26:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 -- start start 2024-04-23T15:26:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc40689d0 0x7f7cc419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc410b120 0x7f7cc4109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41122d0 con 0x7f7cc4100db0 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc4112150 con 0x7f7cc410b120 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.927+0000 7f7ccba00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc4112450 con 0x7f7cc40689d0 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc419fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40626/0 (socket says 172.21.15.7:40626) 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 -- 172.21.15.7:0/3356029192 learned_addr learned my addr 172.21.15.7:0/3356029192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc9000640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc40689d0 0x7f7cc419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc410b120 0x7f7cc4109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 -- 172.21.15.7:0/3356029192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc40689d0 msgr2=0x7f7cc419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc40689d0 0x7f7cc419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 -- 172.21.15.7:0/3356029192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc410b120 msgr2=0x7f7cc4109cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc410b120 0x7f7cc4109cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.928+0000 7f7cc3e00640 1 -- 172.21.15.7:0/3356029192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc410a440 con 0x7f7cc4100db0 2024-04-23T15:26:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.929+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc419fac0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0005ab0 tx=0x7f7cb0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.929+0000 7f7cc1600640 1 -- 172.21.15.7:0/3356029192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb003f070 con 0x7f7cc4100db0 2024-04-23T15:26:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.929+0000 7f7cc1600640 1 -- 172.21.15.7:0/3356029192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cb0031d60 con 0x7f7cc4100db0 2024-04-23T15:26:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.929+0000 7f7cc1600640 1 -- 172.21.15.7:0/3356029192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0035030 con 0x7f7cc4100db0 2024-04-23T15:26:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.929+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc410a6d0 con 0x7f7cc4100db0 2024-04-23T15:26:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.929+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc41a74a0 con 0x7f7cc4100db0 2024-04-23T15:26:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.933+0000 7f7cce994740 1 Processor -- start 2024-04-23T15:26:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.933+0000 7f7cce994740 1 -- start start 2024-04-23T15:26:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.933+0000 7f7cc1600640 1 -- 172.21.15.7:0/3356029192 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7cb0042070 con 0x7f7cc4100db0 2024-04-23T15:26:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.933+0000 7f7cce994740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134e9b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.933+0000 7f7cce994740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134ea5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.933+0000 7f7cce994740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cce994740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558134e01900 con 0x558134ea6390 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cce994740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558134da7f20 con 0x558134e9b1b0 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cce994740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558134dfd8c0 con 0x558134e9bad0 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40628/0 (socket says 172.21.15.7:40628) 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cc3e00640 1 -- 172.21.15.7:0/2412220514 learned_addr learned my addr 172.21.15.7:0/2412220514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134e9b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.934+0000 7f7cc9000640 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134ea5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc3e00640 1 -- 172.21.15.7:0/2412220514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 msgr2=0x558134ea5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134ea5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc3e00640 1 -- 172.21.15.7:0/2412220514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 msgr2=0x558134e9b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134e9b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc3e00640 1 -- 172.21.15.7:0/2412220514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558134dcce10 con 0x558134ea6390 2024-04-23T15:26:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc9000640 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134ea5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:26:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea8780 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00ee470 tx=0x7f7cb00f9540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0a8c4c60d90836 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cb6000640 1 -- 172.21.15.7:0/2412220514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00f9940 con 0x558134ea6390 2024-04-23T15:26:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.935+0000 7f7cc1600640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cac0a3e40 0x7f7cac0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.936+0000 7f7cb6000640 1 -- 172.21.15.7:0/2412220514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cb00fe030 con 0x558134ea6390 2024-04-23T15:26:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.936+0000 7f7cb6000640 1 -- 172.21.15.7:0/2412220514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb01023d0 con 0x558134ea6390 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.936+0000 7f7cc1600640 1 -- 172.21.15.7:0/3356029192 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f7cb00f11f0 con 0x7f7cc4100db0 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.936+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cac0a3e40 0x7f7cac0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.936+0000 7f7cce994740 1 -- 172.21.15.7:0/2412220514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 msgr2=0x558134ea8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.936+0000 7f7cce994740 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea8780 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00ee470 tx=0x7f7cb00f9540 comp rx=0 tx=0).stop 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 -- 172.21.15.7:0/2412220514 shutdown_connections 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea8780 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134ea5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 --2- 172.21.15.7:0/2412220514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134e9b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 -- 172.21.15.7:0/2412220514 >> 172.21.15.7:0/2412220514 conn(0x558134e976c0 msgr2=0x558134e97aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cac0a3e40 0x7f7cac0a6300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7cc406b890 tx=0x7f7cbc009630 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 -- 172.21.15.7:0/2412220514 shutdown_connections 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 -- 172.21.15.7:0/2412220514 wait complete. 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.937+0000 7f7cce994740 1 -- start start 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 Processor -- start 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134ea3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9bad0 0x558134ea3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558134ea8d80 con 0x558134ea6390 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558134dbb2c0 con 0x558134e9bad0 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558134ea8f00 con 0x558134e9b1b0 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.938+0000 7f7cce994740 10 client.0 _ll_register_callbacks cb 0x558134b13a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40632/0 (socket says 172.21.15.7:40632) 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 -- 172.21.15.7:0/2602215943 learned_addr learned my addr 172.21.15.7:0/2602215943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9000640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134ea3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9bad0 0x558134ea3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 -- 172.21.15.7:0/2602215943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 msgr2=0x558134ea3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134ea3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 -- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9bad0 msgr2=0x558134ea3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9bad0 0x558134ea3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.939+0000 7f7cc9a00640 1 -- 172.21.15.7:0/2602215943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558134dcbfd0 con 0x558134ea6390 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea3d90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc01d800 tx=0x7f7cbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0e5dbf6c21de53 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7caaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7caaa00640 1 -- 172.21.15.7:0/2602215943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc02a060 con 0x558134ea6390 2024-04-23T15:26:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cb00fe030 con 0x558134ea6390 2024-04-23T15:26:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7caaa00640 1 -- 172.21.15.7:0/2602215943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f7cbc010950 con 0x558134ea6390 2024-04-23T15:26:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7caaa00640 1 -- 172.21.15.7:0/2602215943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7cbc031050 con 0x558134ea6390 2024-04-23T15:26:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7cce994740 10 client.18477 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.940+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558134b14210 con 0x558134ea6390 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7caaa00640 1 -- 172.21.15.7:0/2602215943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cb00fe030 con 0x558134ea6390 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7caaa00640 1 -- 172.21.15.7:0/2602215943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7cbc019040 con 0x558134ea6390 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7cce994740 10 client.18477 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7cce994740 10 client.18477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7cce994740 20 client.18477 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7cce994740 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134eb6240 0x558134eb8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7cce994740 4 client.18477 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.941+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558134e0f320 con 0x558134eb6240 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.942+0000 7f7cc9000640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134eb6240 0x558134eb8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.943+0000 7f7cc9000640 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134eb6240 0x558134eb8630 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8bc96d6e7b7706d server_cookie=c1741e2b5704105a in_seq=0 out_seq=0 2024-04-23T15:26:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.943+0000 7f7caaa00640 10 client.18477 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7caaa00640 1 -- 172.21.15.7:0/2602215943 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558134e0f320 con 0x558134eb6240 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7caaa00640 10 client.18477 handle_command_reply: tid=0 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 client.18477 shutdown 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 msgr2=0x558134ea3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea3d90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc01d800 tx=0x7f7cbc004a40 comp rx=0 tx=0).stop 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 shutdown_connections 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134eb6240 0x558134eb8630 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9bad0 0x558134ea3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134ea3d90 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 --2- 172.21.15.7:0/2602215943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134ea3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 >> 172.21.15.7:0/2602215943 conn(0x558134e976c0 msgr2=0x558134e9d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7caaa00640 0 client.18477 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.945+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 shutdown_connections 2024-04-23T15:26:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.946+0000 7f7cce994740 1 -- 172.21.15.7:0/2602215943 wait complete. 2024-04-23T15:26:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.946+0000 7f7cce994740 20 client.18477 trim_cache size 0 max 16384 2024-04-23T15:26:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 Processor -- start 2024-04-23T15:26:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 -- start start 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134eb1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134e96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134e9d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41b1600 con 0x558134ea6390 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41b3140 con 0x558134e9b1b0 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.966+0000 7f7cce994740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41b1cd0 con 0x558134e9bad0 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134e9d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134e9d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40638/0 (socket says 172.21.15.7:40638) 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 -- 172.21.15.7:0/4232569721 learned_addr learned my addr 172.21.15.7:0/4232569721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9000640 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134eb1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134e96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 -- 172.21.15.7:0/4232569721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 msgr2=0x558134e96fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134e96fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 -- 172.21.15.7:0/4232569721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 msgr2=0x558134eb1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134eb1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc9a00640 1 -- 172.21.15.7:0/4232569721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558134e92ea0 con 0x558134ea6390 2024-04-23T15:26:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.967+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134e96fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:26:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.968+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134e9d270 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc004af0 tx=0x7f7cbc025510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a0b0c24eea6fdd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.968+0000 7f7cb5600640 1 -- 172.21.15.7:0/4232569721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03a070 con 0x558134ea6390 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.968+0000 7f7cb5600640 1 -- 172.21.15.7:0/4232569721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cbc01d240 con 0x558134ea6390 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.968+0000 7f7cb5600640 1 -- 172.21.15.7:0/4232569721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc010c10 con 0x558134ea6390 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 -- 172.21.15.7:0/4232569721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 msgr2=0x558134e9d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134e9d270 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc004af0 tx=0x7f7cbc025510 comp rx=0 tx=0).stop 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 -- 172.21.15.7:0/4232569721 shutdown_connections 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134ea6390 0x558134e9d270 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9bad0 0x558134e96fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 --2- 172.21.15.7:0/4232569721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134e9b1b0 0x558134eb1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 -- 172.21.15.7:0/4232569721 >> 172.21.15.7:0/4232569721 conn(0x558134e976c0 msgr2=0x558134e9cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 -- 172.21.15.7:0/4232569721 shutdown_connections 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.969+0000 7f7cce994740 1 -- 172.21.15.7:0/4232569721 wait complete. 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 -- start start 2024-04-23T15:26:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 Processor -- start 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134eae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 0x558134e9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134ea6390 0x558134ea01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41b2a70 con 0x558134e9bad0 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41b23a0 con 0x558134ea6390 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41af600 con 0x558134e9b1b0 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.970+0000 7f7cce994740 10 client.0 _ll_register_callbacks cb 0x7f7cbc01d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 0x558134e9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 0x558134e9fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40652/0 (socket says 172.21.15.7:40652) 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 -- 172.21.15.7:0/1416183309 learned_addr learned my addr 172.21.15.7:0/1416183309 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc9000640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134eae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc9a00640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134ea6390 0x558134ea01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 -- 172.21.15.7:0/1416183309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 msgr2=0x558134eae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134eae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 -- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134ea6390 msgr2=0x558134ea01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134ea6390 0x558134ea01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 -- 172.21.15.7:0/1416183309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558134be0620 con 0x558134e9bad0 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc9000640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134eae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7cc3e00640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 0x558134e9fc60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00b9750 tx=0x7f7cb0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63d9f719669e305 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.971+0000 7f7caaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7caaa00640 1 -- 172.21.15.7:0/1416183309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0049070 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7caaa00640 1 -- 172.21.15.7:0/1416183309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f7cb00bb080 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cbc01d240 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7caaa00640 1 -- 172.21.15.7:0/1416183309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7cb00b9020 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7cce994740 10 client.18483 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558134f1c4d0 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.972+0000 7f7caaa00640 1 -- 172.21.15.7:0/1416183309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cbc01d240 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7caaa00640 1 -- 172.21.15.7:0/1416183309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7cb004c060 con 0x558134e9bad0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cce994740 10 client.18483 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cce994740 10 client.18483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cce994740 20 client.18483 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cce994740 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134f1c810 0x558134f1ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cce994740 4 client.18483 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558134e09190 con 0x558134f1c810 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.973+0000 7f7cc9000640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134f1c810 0x558134f1ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.974+0000 7f7caaa00640 10 client.18483 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:16.974+0000 7f7cc9000640 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134f1c810 0x558134f1ec00 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c9e58baad6237a server_cookie=263286936578c9f8 in_seq=0 out_seq=0 2024-04-23T15:26:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.013+0000 7f7caaa00640 1 -- 172.21.15.7:0/1416183309 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558134e09190 con 0x558134f1c810 2024-04-23T15:26:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.013+0000 7f7caaa00640 10 client.18483 handle_command_reply: tid=0 2024-04-23T15:26:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.013+0000 7f7cce994740 1 client.18483 shutdown 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 msgr2=0x558134e9fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 0x558134e9fc60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00b9750 tx=0x7f7cb0005bd0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 shutdown_connections 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558134f1c810 0x558134f1ec00 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558134ea6390 0x558134ea01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558134e9bad0 0x558134e9fc60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7caaa00640 0 client.18483 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 --2- 172.21.15.7:0/1416183309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558134e9b1b0 0x558134eae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 >> 172.21.15.7:0/1416183309 conn(0x558134e976c0 msgr2=0x558134e9d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 shutdown_connections 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.014+0000 7f7cce994740 1 -- 172.21.15.7:0/1416183309 wait complete. 2024-04-23T15:26:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.015+0000 7f7cce994740 20 client.18483 trim_cache size 0 max 16384 2024-04-23T15:26:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:26:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:26:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:26:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cac0a3e40 msgr2=0x7f7cac0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cac0a3e40 0x7f7cac0a6300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7cc406b890 tx=0x7f7cbc009630 comp rx=0 tx=0).stop 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 msgr2=0x7f7cc419fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc419fac0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0005ab0 tx=0x7f7cb0003cd0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 shutdown_connections 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7cac0a3e40 0x7f7cac0a6300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc410b120 0x7f7cc4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4100db0 0x7f7cc419fac0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 --2- 172.21.15.7:0/3356029192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc40689d0 0x7f7cc419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 >> 172.21.15.7:0/3356029192 conn(0x7f7cc4077000 msgr2=0x7f7cc410c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 shutdown_connections 2024-04-23T15:26:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:17.016+0000 7f7ccba00640 1 -- 172.21.15.7:0/3356029192 wait complete. 2024-04-23T15:26:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:17 smithi007 ceph-mon[27906]: pgmap v1106: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:26:17.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:17 smithi186 ceph-mon[31814]: pgmap v1106: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:26:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:17 smithi137 ceph-mon[31694]: pgmap v1106: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:26:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:19 smithi007 ceph-mon[27906]: pgmap v1107: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:26:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:19 smithi186 ceph-mon[31814]: pgmap v1107: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:26:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:19 smithi137 ceph-mon[31694]: pgmap v1107: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:26:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:21 smithi007 ceph-mon[27906]: pgmap v1108: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:26:21.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:21 smithi186 ceph-mon[31814]: pgmap v1108: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:26:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:21 smithi137 ceph-mon[31694]: pgmap v1108: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:26:22.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:22 smithi007 ceph-mon[27906]: pgmap v1109: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 22 op/s 2024-04-23T15:26:22.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:22 smithi186 ceph-mon[31814]: pgmap v1109: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 22 op/s 2024-04-23T15:26:22.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:22 smithi137 ceph-mon[31694]: pgmap v1109: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 22 op/s 2024-04-23T15:26:24.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:24 smithi137 ceph-mon[31694]: pgmap v1110: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:24.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:24 smithi007 ceph-mon[27906]: pgmap v1110: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:24 smithi186 ceph-mon[31814]: pgmap v1110: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:26.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:26 smithi137 ceph-mon[31694]: pgmap v1111: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:26.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:26 smithi007 ceph-mon[27906]: pgmap v1111: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:26.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:26 smithi186 ceph-mon[31814]: pgmap v1111: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:28.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:28 smithi137 ceph-mon[31694]: pgmap v1112: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:28.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:28 smithi007 ceph-mon[27906]: pgmap v1112: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:28.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:28 smithi186 ceph-mon[31814]: pgmap v1112: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 -- 172.21.15.7:0/1261957932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c107340 msgr2=0x7f241c10ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 --2- 172.21.15.7:0/1261957932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c107340 0x7f241c10ef10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f2414009ca0 tx=0x7f241402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 -- 172.21.15.7:0/1261957932 shutdown_connections 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 --2- 172.21.15.7:0/1261957932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c107340 0x7f241c10ef10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 --2- 172.21.15.7:0/1261957932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f241c102c20 0x7f241c106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 --2- 172.21.15.7:0/1261957932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 0x7f241c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.172+0000 7f2420c00640 1 -- 172.21.15.7:0/1261957932 >> 172.21.15.7:0/1261957932 conn(0x7f241c0fdaf0 msgr2=0x7f241c0fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.173+0000 7f2420c00640 1 -- 172.21.15.7:0/1261957932 shutdown_connections 2024-04-23T15:26:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.173+0000 7f2420c00640 1 -- 172.21.15.7:0/1261957932 wait complete. 2024-04-23T15:26:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.174+0000 7f2420c00640 1 Processor -- start 2024-04-23T15:26:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.174+0000 7f2420c00640 1 -- start start 2024-04-23T15:26:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.174+0000 7f2420c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 0x7f241c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.174+0000 7f2420c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f241c107340 0x7f241c198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.174+0000 7f2420c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 0x7f241c19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.174+0000 7f2420c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f241c112300 con 0x7f241c19d020 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f2420c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f241c112180 con 0x7f241c102270 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f2420c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f241c112480 con 0x7f241c107340 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 0x7f241c19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 0x7f241c19d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59750/0 (socket says 172.21.15.7:59750) 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 -- 172.21.15.7:0/1069828937 learned_addr learned my addr 172.21.15.7:0/1069828937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f2419e00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 0x7f241c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f2419400640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f241c107340 0x7f241c198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 -- 172.21.15.7:0/1069828937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f241c107340 msgr2=0x7f241c198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f241c107340 0x7f241c198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 -- 172.21.15.7:0/1069828937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 msgr2=0x7f241c198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 0x7f241c198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f241a800640 1 -- 172.21.15.7:0/1069828937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241c19db10 con 0x7f241c19d020 2024-04-23T15:26:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.175+0000 7f2419e00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 0x7f241c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:26:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.176+0000 7f241a800640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 0x7f241c19d4d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f2414031040 tx=0x7f2414003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.176+0000 7f2412a00640 1 -- 172.21.15.7:0/1069828937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414003ce0 con 0x7f241c19d020 2024-04-23T15:26:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.176+0000 7f2412a00640 1 -- 172.21.15.7:0/1069828937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24140044f0 con 0x7f241c19d020 2024-04-23T15:26:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.176+0000 7f2412a00640 1 -- 172.21.15.7:0/1069828937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414030c90 con 0x7f241c19d020 2024-04-23T15:26:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.176+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241c19dda0 con 0x7f241c19d020 2024-04-23T15:26:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.176+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241c1a55f0 con 0x7f241c19d020 2024-04-23T15:26:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.180+0000 7f2412a00640 1 -- 172.21.15.7:0/1069828937 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f24140046a0 con 0x7f241c19d020 2024-04-23T15:26:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.180+0000 7f24239e4740 1 Processor -- start 2024-04-23T15:26:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 -- start start 2024-04-23T15:26:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140ff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564714058900 con 0x5647140f21b0 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564713ffef20 con 0x5647140f2ad0 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f24239e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5647140548c0 con 0x5647140fd390 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59762/0 (socket says 172.21.15.7:59762) 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.181+0000 7f2419400640 1 -- 172.21.15.7:0/298751450 learned_addr learned my addr 172.21.15.7:0/298751450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419e00640 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419400640 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2412a00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24000a3e40 0x7f24000a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419400640 1 -- 172.21.15.7:0/298751450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 msgr2=0x5647140ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419400640 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419400640 1 -- 172.21.15.7:0/298751450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 msgr2=0x5647140fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419400640 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2419400640 1 -- 172.21.15.7:0/298751450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564714023e10 con 0x5647140f21b0 2024-04-23T15:26:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f2412a00640 1 -- 172.21.15.7:0/1069828937 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f24140f2190 con 0x7f241c19d020 2024-04-23T15:26:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.182+0000 7f241a800640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24000a3e40 0x7f24000a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.183+0000 7f2419400640 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f2590 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2404013450 tx=0x7f240400b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304bc43dbb52e71d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.183+0000 7f240b000640 1 -- 172.21.15.7:0/298751450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404019030 con 0x5647140f21b0 2024-04-23T15:26:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.183+0000 7f240b000640 1 -- 172.21.15.7:0/298751450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2404005bf0 con 0x5647140f21b0 2024-04-23T15:26:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.183+0000 7f240b000640 1 -- 172.21.15.7:0/298751450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404011440 con 0x5647140f21b0 2024-04-23T15:26:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 -- 172.21.15.7:0/298751450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 msgr2=0x5647140f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f2590 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2404013450 tx=0x7f240400b5c0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f241a800640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24000a3e40 0x7f24000a6300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f24140bdb30 tx=0x7f2414003e80 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 -- 172.21.15.7:0/298751450 shutdown_connections 2024-04-23T15:26:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 --2- 172.21.15.7:0/298751450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f2590 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 -- 172.21.15.7:0/298751450 >> 172.21.15.7:0/298751450 conn(0x5647140ee6c0 msgr2=0x5647140eeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 -- 172.21.15.7:0/298751450 shutdown_connections 2024-04-23T15:26:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.184+0000 7f24239e4740 1 -- 172.21.15.7:0/298751450 wait complete. 2024-04-23T15:26:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 -- start start 2024-04-23T15:26:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 Processor -- start 2024-04-23T15:26:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140fad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5647140fffc0 con 0x5647140f21b0 2024-04-23T15:26:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5647140122c0 con 0x5647140f2ad0 2024-04-23T15:26:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.185+0000 7f24239e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564714100140 con 0x5647140fd390 2024-04-23T15:26:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f24239e4740 10 client.0 _ll_register_callbacks cb 0x564713d6aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59770/0 (socket says 172.21.15.7:59770) 2024-04-23T15:26:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 -- 172.21.15.7:0/2313763604 learned_addr learned my addr 172.21.15.7:0/2313763604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419e00640 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 -- 172.21.15.7:0/2313763604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 msgr2=0x5647140fad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 -- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 msgr2=0x5647140fa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.186+0000 7f2419400640 1 -- 172.21.15.7:0/2313763604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564714022fd0 con 0x5647140f21b0 2024-04-23T15:26:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f2419400640 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140fa2d0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f240400b3f0 tx=0x7f240400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c4bbad64e9100a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f23ff400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f23ff400640 1 -- 172.21.15.7:0/2313763604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404019050 con 0x5647140f21b0 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f23ff400640 1 -- 172.21.15.7:0/2313763604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f2404005200 con 0x5647140f21b0 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564714066320 con 0x5647140f21b0 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f23ff400640 1 -- 172.21.15.7:0/2313763604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2404032050 con 0x5647140f21b0 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.187+0000 7f24239e4740 10 client.18495 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564713d6b210 con 0x5647140f21b0 2024-04-23T15:26:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f23ff400640 1 -- 172.21.15.7:0/2313763604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x564714066320 con 0x5647140f21b0 2024-04-23T15:26:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f23ff400640 1 -- 172.21.15.7:0/2313763604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f240402c4e0 con 0x5647140f21b0 2024-04-23T15:26:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 10 client.18495 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 10 client.18495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 20 client.18495 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56471410d2e0 0x56471410f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 4 client.18495 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:26:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.188+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564714060190 con 0x56471410d2e0 2024-04-23T15:26:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.189+0000 7f2419e00640 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56471410d2e0 0x56471410f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.190+0000 7f2419e00640 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56471410d2e0 0x56471410f6d0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c477c74015b1d41 server_cookie=e3e8382d35e2ffeb in_seq=0 out_seq=0 2024-04-23T15:26:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.190+0000 7f23ff400640 10 client.18495 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f23ff400640 1 -- 172.21.15.7:0/2313763604 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564714060190 con 0x56471410d2e0 2024-04-23T15:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f23ff400640 10 client.18495 handle_command_reply: tid=0 2024-04-23T15:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 client.18495 shutdown 2024-04-23T15:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 msgr2=0x5647140fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140fa2d0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f240400b3f0 tx=0x7f240400be10 comp rx=0 tx=0).stop 2024-04-23T15:26:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 shutdown_connections 2024-04-23T15:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56471410d2e0 0x56471410f6d0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140fa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140fad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 --2- 172.21.15.7:0/2313763604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140fa2d0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 >> 172.21.15.7:0/2313763604 conn(0x5647140ee6c0 msgr2=0x5647140f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:30.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f23ff400640 0 client.18495 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:30.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 shutdown_connections 2024-04-23T15:26:30.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.192+0000 7f24239e4740 1 -- 172.21.15.7:0/2313763604 wait complete. 2024-04-23T15:26:30.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.193+0000 7f24239e4740 20 client.18495 trim_cache size 0 max 16384 2024-04-23T15:26:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.212+0000 7f24239e4740 1 Processor -- start 2024-04-23T15:26:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.212+0000 7f24239e4740 1 -- start start 2024-04-23T15:26:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f24239e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x564714105770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f24239e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f24239e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f24239e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1af370 con 0x5647140f21b0 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f24239e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1b0eb0 con 0x5647140f2ad0 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f24239e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1afa40 con 0x5647140fd390 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x564714105770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x564714105770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59782/0 (socket says 172.21.15.7:59782) 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f2419400640 1 -- 172.21.15.7:0/2612940646 learned_addr learned my addr 172.21.15.7:0/2612940646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.213+0000 7f2419e00640 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419400640 1 -- 172.21.15.7:0/2612940646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 msgr2=0x5647140f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419400640 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419400640 1 -- 172.21.15.7:0/2612940646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 msgr2=0x5647140f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419400640 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419400640 1 -- 172.21.15.7:0/2612940646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564713e37620 con 0x5647140f21b0 2024-04-23T15:26:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419e00640 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:26:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f2419400640 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x564714105770 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f24040059f0 tx=0x7f240400b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ce27afb3e84e10 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f240a600640 1 -- 172.21.15.7:0/2612940646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404019070 con 0x5647140f21b0 2024-04-23T15:26:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f240a600640 1 -- 172.21.15.7:0/2612940646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2404025030 con 0x5647140f21b0 2024-04-23T15:26:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.214+0000 7f240a600640 1 -- 172.21.15.7:0/2612940646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040051b0 con 0x5647140f21b0 2024-04-23T15:26:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 -- 172.21.15.7:0/2612940646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 msgr2=0x564714105770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x564714105770 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f24040059f0 tx=0x7f240400b2e0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 -- 172.21.15.7:0/2612940646 shutdown_connections 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140f2ad0 0x5647140f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140fd390 0x5647140f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 --2- 172.21.15.7:0/2612940646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x564714105770 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 -- 172.21.15.7:0/2612940646 >> 172.21.15.7:0/2612940646 conn(0x5647140ee6c0 msgr2=0x5647140ecfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 -- 172.21.15.7:0/2612940646 shutdown_connections 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.215+0000 7f24239e4740 1 -- 172.21.15.7:0/2612940646 wait complete. 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.216+0000 7f24239e4740 1 -- start start 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.216+0000 7f24239e4740 1 Processor -- start 2024-04-23T15:26:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140f2ad0 0x5647141145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140fd390 0x564714114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1b07e0 con 0x5647140f21b0 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1b0110 con 0x5647140fd390 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1ad370 con 0x5647140f2ad0 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f24239e4740 10 client.0 _ll_register_callbacks cb 0x7f2404013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59796/0 (socket says 172.21.15.7:59796) 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 -- 172.21.15.7:0/3072001760 learned_addr learned my addr 172.21.15.7:0/3072001760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 -- 172.21.15.7:0/3072001760 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140f2ad0 msgr2=0x5647141145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140f2ad0 0x5647141145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 -- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140fd390 msgr2=0x564714114bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140fd390 0x564714114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.217+0000 7f2419400640 1 -- 172.21.15.7:0/3072001760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647141153e0 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f2419400640 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f7f50 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f240400b3e0 tx=0x7f240402cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64da097cba0aa11 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f23ff400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f23ff400640 1 -- 172.21.15.7:0/3072001760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404019040 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f23ff400640 1 -- 172.21.15.7:0/3072001760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f2404013220 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2404025030 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f23ff400640 1 -- 172.21.15.7:0/3072001760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f240400b660 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f24239e4740 10 client.18501 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.218+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5647141776e0 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f23ff400640 1 -- 172.21.15.7:0/3072001760 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2404025030 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f23ff400640 1 -- 172.21.15.7:0/3072001760 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f24040053d0 con 0x5647140f21b0 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f24239e4740 10 client.18501 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f24239e4740 10 client.18501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f24239e4740 20 client.18501 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f24239e4740 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564714177ce0 0x56471417a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f24239e4740 4 client.18501 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:26:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.219+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564713fdc4b0 con 0x564714177ce0 2024-04-23T15:26:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.220+0000 7f2419e00640 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564714177ce0 0x56471417a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.221+0000 7f2419e00640 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564714177ce0 0x56471417a0d0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452aa95452fc3bd3 server_cookie=fde844b0c04e44bf in_seq=0 out_seq=0 2024-04-23T15:26:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.221+0000 7f23ff400640 10 client.18501 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.259+0000 7f23ff400640 1 -- 172.21.15.7:0/3072001760 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564713fdc4b0 con 0x564714177ce0 2024-04-23T15:26:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.259+0000 7f23ff400640 10 client.18501 handle_command_reply: tid=0 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.259+0000 7f24239e4740 1 client.18501 shutdown 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 msgr2=0x5647140f7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f7f50 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f240400b3e0 tx=0x7f240402cdc0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 shutdown_connections 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564714177ce0 0x56471417a0d0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647140fd390 0x564714114bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5647140f2ad0 0x5647141145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 --2- 172.21.15.7:0/3072001760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5647140f21b0 0x5647140f7f50 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f23ff400640 0 client.18501 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 >> 172.21.15.7:0/3072001760 conn(0x5647140ee6c0 msgr2=0x5647140ed840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 shutdown_connections 2024-04-23T15:26:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.260+0000 7f24239e4740 1 -- 172.21.15.7:0/3072001760 wait complete. 2024-04-23T15:26:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.261+0000 7f24239e4740 20 client.18501 trim_cache size 0 max 16384 2024-04-23T15:26:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:26:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:26:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:26:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:26:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24000a3e40 msgr2=0x7f24000a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24000a3e40 0x7f24000a6300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f24140bdb30 tx=0x7f2414003e80 comp rx=0 tx=0).stop 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 msgr2=0x7f241c19d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 0x7f241c19d4d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f2414031040 tx=0x7f2414003970 comp rx=0 tx=0).stop 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 shutdown_connections 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f24000a3e40 0x7f24000a6300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f241c19d020 0x7f241c19d4d0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f241c107340 0x7f241c198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 --2- 172.21.15.7:0/1069828937 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f241c102270 0x7f241c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 >> 172.21.15.7:0/1069828937 conn(0x7f241c0fdaf0 msgr2=0x7f241c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 shutdown_connections 2024-04-23T15:26:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:30.262+0000 7f2420c00640 1 -- 172.21.15.7:0/1069828937 wait complete. 2024-04-23T15:26:30.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:30 smithi007 ceph-mon[27906]: pgmap v1113: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:30.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:30 smithi186 ceph-mon[31814]: pgmap v1113: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:30.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:30 smithi137 ceph-mon[31694]: pgmap v1113: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:26:32.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:32 smithi007 ceph-mon[27906]: pgmap v1114: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:26:32.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:32 smithi186 ceph-mon[31814]: pgmap v1114: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:26:32.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:32 smithi137 ceph-mon[31694]: pgmap v1114: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:26:34.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:34 smithi007 ceph-mon[27906]: pgmap v1115: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:34 smithi186 ceph-mon[31814]: pgmap v1115: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:34.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:34 smithi137 ceph-mon[31694]: pgmap v1115: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:36.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:36 smithi007 ceph-mon[27906]: pgmap v1116: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:36.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:36 smithi186 ceph-mon[31814]: pgmap v1116: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:36.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:36 smithi137 ceph-mon[31694]: pgmap v1116: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:38.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:38 smithi007 ceph-mon[27906]: pgmap v1117: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:26:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:38 smithi186 ceph-mon[31814]: pgmap v1117: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:26:38.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:38 smithi137 ceph-mon[31694]: pgmap v1117: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:26:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:40 smithi007 ceph-mon[27906]: pgmap v1118: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:26:40.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:40 smithi186 ceph-mon[31814]: pgmap v1118: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:26:40.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:40 smithi137 ceph-mon[31694]: pgmap v1118: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:26:42.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:42 smithi007 ceph-mon[27906]: pgmap v1119: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:26:42.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:42 smithi186 ceph-mon[31814]: pgmap v1119: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:26:42.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:42 smithi137 ceph-mon[31694]: pgmap v1119: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.434+0000 7f2060600640 1 -- 172.21.15.7:0/1444998599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 msgr2=0x7f2058111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.434+0000 7f2060600640 1 --2- 172.21.15.7:0/1444998599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f2058111130 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f2050009ca0 tx=0x7f205002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.434+0000 7f2060600640 1 -- 172.21.15.7:0/1444998599 shutdown_connections 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.434+0000 7f2060600640 1 --2- 172.21.15.7:0/1444998599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f2058111130 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.435+0000 7f2060600640 1 --2- 172.21.15.7:0/1444998599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2058104e40 0x7f2058108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.435+0000 7f2060600640 1 --2- 172.21.15.7:0/1444998599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2058104490 0x7f2058104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.435+0000 7f2060600640 1 -- 172.21.15.7:0/1444998599 >> 172.21.15.7:0/1444998599 conn(0x7f20580ffd10 msgr2=0x7f2058102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.435+0000 7f2060600640 1 -- 172.21.15.7:0/1444998599 shutdown_connections 2024-04-23T15:26:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.435+0000 7f2060600640 1 -- 172.21.15.7:0/1444998599 wait complete. 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 Processor -- start 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 -- start start 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2058104490 0x7f20581a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f20581a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205819a770 0x7f205819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20581144d0 con 0x7f2058109560 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2058114350 con 0x7f2058104490 2024-04-23T15:26:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.436+0000 7f2060600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2058114650 con 0x7f205819a770 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f20581a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f20581a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33922/0 (socket says 172.21.15.7:33922) 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 -- 172.21.15.7:0/3510463145 learned_addr learned my addr 172.21.15.7:0/3510463145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205dc00640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2058104490 0x7f20581a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205e600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205819a770 0x7f205819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 -- 172.21.15.7:0/3510463145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205819a770 msgr2=0x7f205819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205819a770 0x7f205819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 -- 172.21.15.7:0/3510463145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2058104490 msgr2=0x7f20581a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2058104490 0x7f20581a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.437+0000 7f205d200640 1 -- 172.21.15.7:0/3510463145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205819b370 con 0x7f2058109560 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.438+0000 7f205d200640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f20581a0bf0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f204400d740 tx=0x7f204400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.438+0000 7f2056000640 1 -- 172.21.15.7:0/3510463145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044017070 con 0x7f2058109560 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.438+0000 7f2056000640 1 -- 172.21.15.7:0/3510463145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f204400de50 con 0x7f2058109560 2024-04-23T15:26:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.438+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20581a7450 con 0x7f2058109560 2024-04-23T15:26:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.438+0000 7f2056000640 1 -- 172.21.15.7:0/3510463145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044004d60 con 0x7f2058109560 2024-04-23T15:26:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.438+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20581a7800 con 0x7f2058109560 2024-04-23T15:26:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.442+0000 7f206359d740 1 Processor -- start 2024-04-23T15:26:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 -- start start 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f2056000640 1 -- 172.21.15.7:0/3510463145 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2044004f00 con 0x7f2058109560 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153eb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a315351900 con 0x55a3153ebad0 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a3152f7f20 con 0x55a3153eb1b0 2024-04-23T15:26:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.443+0000 7f206359d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a31534d8c0 con 0x55a3153f6390 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33924/0 (socket says 172.21.15.7:33924) 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 -- 172.21.15.7:0/2977981474 learned_addr learned my addr 172.21.15.7:0/2977981474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205e600640 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153eb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205d200640 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 -- 172.21.15.7:0/2977981474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 msgr2=0x55a3153f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 -- 172.21.15.7:0/2977981474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 msgr2=0x55a3153eb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153eb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205dc00640 1 -- 172.21.15.7:0/2977981474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31531ce10 con 0x55a3153ebad0 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.444+0000 7f205e600640 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153eb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.445+0000 7f205dc00640 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f5e50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f204c00bcb0 tx=0x7f204c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616a6e549f3ace18 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.445+0000 7f204aa00640 1 -- 172.21.15.7:0/2977981474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c015070 con 0x55a3153ebad0 2024-04-23T15:26:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.445+0000 7f204aa00640 1 -- 172.21.15.7:0/2977981474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f204c01a910 con 0x55a3153ebad0 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.445+0000 7f204aa00640 1 -- 172.21.15.7:0/2977981474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c011990 con 0x55a3153ebad0 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.445+0000 7f2056000640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f20400a3dc0 0x7f20400a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.445+0000 7f2056000640 1 -- 172.21.15.7:0/3510463145 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f20440d05e0 con 0x7f2058109560 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f205e600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f20400a3dc0 0x7f20400a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 -- 172.21.15.7:0/2977981474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 msgr2=0x55a3153f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f5e50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f204c00bcb0 tx=0x7f204c00f730 comp rx=0 tx=0).stop 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 -- 172.21.15.7:0/2977981474 shutdown_connections 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f5e50 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 --2- 172.21.15.7:0/2977981474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153eb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.446+0000 7f206359d740 1 -- 172.21.15.7:0/2977981474 >> 172.21.15.7:0/2977981474 conn(0x55a3153e76c0 msgr2=0x55a3153e7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.447+0000 7f206359d740 1 -- 172.21.15.7:0/2977981474 shutdown_connections 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.447+0000 7f205e600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f20400a3dc0 0x7f20400a6280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2050009a60 tx=0x7f2050005ef0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.447+0000 7f206359d740 1 -- 172.21.15.7:0/2977981474 wait complete. 2024-04-23T15:26:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.447+0000 7f206359d740 1 -- start start 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.447+0000 7f206359d740 1 Processor -- start 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a3153f8fc0 con 0x55a3153ebad0 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a31530b2c0 con 0x55a3153eb1b0 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a3153f9140 con 0x55a3153f6390 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f206359d740 10 client.0 _ll_register_callbacks cb 0x55a315063a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f205d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f205d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33938/0 (socket says 172.21.15.7:33938) 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f205d200640 1 -- 172.21.15.7:0/3905263724 learned_addr learned my addr 172.21.15.7:0/3905263724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.448+0000 7f205dc00640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205e600640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205d200640 1 -- 172.21.15.7:0/3905263724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 msgr2=0x55a3153f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205d200640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205d200640 1 -- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 msgr2=0x55a3153f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205d200640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205d200640 1 -- 172.21.15.7:0/3905263724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a31531bfd0 con 0x55a3153ebad0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205dc00640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f205d200640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f37c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f204409c100 tx=0x7f20440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc916d850d1819c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f203f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f203f400640 1 -- 172.21.15.7:0/3905263724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204409c870 con 0x55a3153ebad0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.449+0000 7f203f400640 1 -- 172.21.15.7:0/3905263724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f20440cdba0 con 0x55a3153ebad0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.450+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c01a910 con 0x55a3153ebad0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.450+0000 7f203f400640 1 -- 172.21.15.7:0/3905263724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f20440b5050 con 0x55a3153ebad0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.450+0000 7f206359d740 10 client.18513 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.450+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a315064210 con 0x55a3153ebad0 2024-04-23T15:26:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.450+0000 7f203f400640 1 -- 172.21.15.7:0/3905263724 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f204c01a910 con 0x55a3153ebad0 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.450+0000 7f203f400640 1 -- 172.21.15.7:0/3905263724 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2044096ce0 con 0x55a3153ebad0 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f206359d740 10 client.18513 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f206359d740 10 client.18513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f206359d740 20 client.18513 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f206359d740 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a315406430 0x55a315408820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f206359d740 4 client.18513 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a31535f320 con 0x55a315406430 2024-04-23T15:26:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.451+0000 7f205dc00640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a315406430 0x55a315408820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.452+0000 7f205dc00640 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a315406430 0x55a315408820 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f269835c10c0337 server_cookie=965ce929022dc6a1 in_seq=0 out_seq=0 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.452+0000 7f203f400640 10 client.18513 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.454+0000 7f203f400640 1 -- 172.21.15.7:0/3905263724 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a31535f320 con 0x55a315406430 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.454+0000 7f203f400640 10 client.18513 handle_command_reply: tid=0 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.454+0000 7f206359d740 1 client.18513 shutdown 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 msgr2=0x55a3153f37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f37c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f204409c100 tx=0x7f20440046c0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 shutdown_connections 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a315406430 0x55a315408820 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153f6390 0x55a3153f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a3153f37c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 --2- 172.21.15.7:0/3905263724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 >> 172.21.15.7:0/3905263724 conn(0x55a3153e76c0 msgr2=0x55a3153ed440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f203f400640 0 client.18513 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 shutdown_connections 2024-04-23T15:26:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 1 -- 172.21.15.7:0/3905263724 wait complete. 2024-04-23T15:26:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.455+0000 7f206359d740 20 client.18513 trim_cache size 0 max 16384 2024-04-23T15:26:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 Processor -- start 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 -- start start 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153e76c0 0x55a3153f3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a31540e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a31540e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20581b1600 con 0x55a3153ebad0 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20581b3140 con 0x55a3153eb1b0 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.474+0000 7f206359d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20581b1cd0 con 0x55a3153e76c0 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a31540e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a31540e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33942/0 (socket says 172.21.15.7:33942) 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 -- 172.21.15.7:0/349565990 learned_addr learned my addr 172.21.15.7:0/349565990 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205d200640 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a31540e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205dc00640 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153e76c0 0x55a3153f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 -- 172.21.15.7:0/349565990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153e76c0 msgr2=0x55a3153f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153e76c0 0x55a3153f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 -- 172.21.15.7:0/349565990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 msgr2=0x55a31540e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a31540e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.475+0000 7f205e600640 1 -- 172.21.15.7:0/349565990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a315130620 con 0x55a3153ebad0 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.476+0000 7f205e600640 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a31540e650 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2050009ca0 tx=0x7f2050040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d279c68b291933 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.476+0000 7f204a000640 1 -- 172.21.15.7:0/349565990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050003970 con 0x55a3153ebad0 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.476+0000 7f204a000640 1 -- 172.21.15.7:0/349565990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2050036040 con 0x55a3153ebad0 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.476+0000 7f204a000640 1 -- 172.21.15.7:0/349565990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050030820 con 0x55a3153ebad0 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 -- 172.21.15.7:0/349565990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 msgr2=0x55a31540e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a31540e650 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2050009ca0 tx=0x7f2050040000 comp rx=0 tx=0).stop 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 -- 172.21.15.7:0/349565990 shutdown_connections 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a31540e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153ebad0 0x55a31540e650 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 --2- 172.21.15.7:0/349565990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153e76c0 0x55a3153f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 -- 172.21.15.7:0/349565990 >> 172.21.15.7:0/349565990 conn(0x55a3153eec50 msgr2=0x55a3153f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 -- 172.21.15.7:0/349565990 shutdown_connections 2024-04-23T15:26:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.477+0000 7f206359d740 1 -- 172.21.15.7:0/349565990 wait complete. 2024-04-23T15:26:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 -- start start 2024-04-23T15:26:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 Processor -- start 2024-04-23T15:26:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 0x55a3153fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153ebad0 0x55a3153fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20581b2a70 con 0x55a3153e76c0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20581b23a0 con 0x55a3153eb1b0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20581af600 con 0x55a3153ebad0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.478+0000 7f206359d740 10 client.0 _ll_register_callbacks cb 0x7f2044009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 0x55a3153fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 0x55a3153fe7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33948/0 (socket says 172.21.15.7:33948) 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 -- 172.21.15.7:0/1603677316 learned_addr learned my addr 172.21.15.7:0/1603677316 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205d200640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205e600640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153ebad0 0x55a3153fa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 -- 172.21.15.7:0/1603677316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153ebad0 msgr2=0x55a3153fa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153ebad0 0x55a3153fa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 -- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 msgr2=0x55a3153f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205dc00640 1 -- 172.21.15.7:0/1603677316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3153fa910 con 0x55a3153e76c0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.479+0000 7f205d200640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f205dc00640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 0x55a3153fe7f0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f204c00bcb0 tx=0x7f204c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86c025e9472dbc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f203f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f203f400640 1 -- 172.21.15.7:0/1603677316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c015040 con 0x55a3153e76c0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f203f400640 1 -- 172.21.15.7:0/1603677316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f204c004240 con 0x55a3153e76c0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2050036040 con 0x55a3153e76c0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f203f400640 1 -- 172.21.15.7:0/1603677316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f204c036050 con 0x55a3153e76c0 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f206359d740 10 client.18519 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.480+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a31546ca30 con 0x55a3153e76c0 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f203f400640 1 -- 172.21.15.7:0/1603677316 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2050036040 con 0x55a3153e76c0 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f203f400640 1 -- 172.21.15.7:0/1603677316 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f204c011710 con 0x55a3153e76c0 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f206359d740 10 client.18519 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f206359d740 10 client.18519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f206359d740 20 client.18519 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f206359d740 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a3153f6390 0x55a31546eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f206359d740 4 client.18519 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.481+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a315359190 con 0x55a3153f6390 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.482+0000 7f205d200640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a3153f6390 0x55a31546eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.482+0000 7f205d200640 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a3153f6390 0x55a31546eeb0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beebdc3961e1e626 server_cookie=b1d87f76b1d13f5e in_seq=0 out_seq=0 2024-04-23T15:26:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.482+0000 7f203f400640 10 client.18519 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f203f400640 1 -- 172.21.15.7:0/1603677316 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a315359190 con 0x55a3153f6390 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f203f400640 10 client.18519 handle_command_reply: tid=0 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 client.18519 shutdown 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 msgr2=0x55a3153fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 0x55a3153fe7f0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f204c00bcb0 tx=0x7f204c011440 comp rx=0 tx=0).stop 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 shutdown_connections 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a3153f6390 0x55a31546eeb0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3153eb1b0 0x55a3153f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3153ebad0 0x55a3153fa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 --2- 172.21.15.7:0/1603677316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a3153e76c0 0x55a3153fe7f0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f203f400640 0 client.18519 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.516+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 >> 172.21.15.7:0/1603677316 conn(0x55a3153eec50 msgr2=0x55a3153f3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.517+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 shutdown_connections 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.517+0000 7f206359d740 1 -- 172.21.15.7:0/1603677316 wait complete. 2024-04-23T15:26:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.517+0000 7f206359d740 20 client.18519 trim_cache size 0 max 16384 2024-04-23T15:26:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:26:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:26:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:26:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:26:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f20400a3dc0 msgr2=0x7f20400a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f20400a3dc0 0x7f20400a6280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2050009a60 tx=0x7f2050005ef0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 msgr2=0x7f20581a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f20581a0bf0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f204400d740 tx=0x7f204400dc00 comp rx=0 tx=0).stop 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 shutdown_connections 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f20400a3dc0 0x7f20400a6280 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205819a770 0x7f205819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2058109560 0x7f20581a0bf0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 --2- 172.21.15.7:0/3510463145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2058104490 0x7f20581a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 >> 172.21.15.7:0/3510463145 conn(0x7f20580ffd10 msgr2=0x7f2058102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 shutdown_connections 2024-04-23T15:26:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:43.518+0000 7f2060600640 1 -- 172.21.15.7:0/3510463145 wait complete. 2024-04-23T15:26:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:44 smithi007 ceph-mon[27906]: pgmap v1120: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:26:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:44 smithi186 ceph-mon[31814]: pgmap v1120: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:26:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:44 smithi137 ceph-mon[31694]: pgmap v1120: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:26:46.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:46 smithi007 ceph-mon[27906]: pgmap v1121: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:26:46.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:46 smithi186 ceph-mon[31814]: pgmap v1121: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:26:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:46 smithi137 ceph-mon[31694]: pgmap v1121: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:26:48.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:48 smithi007 ceph-mon[27906]: pgmap v1122: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:48.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:48 smithi186 ceph-mon[31814]: pgmap v1122: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:48.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:48 smithi137 ceph-mon[31694]: pgmap v1122: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:50.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:50 smithi007 ceph-mon[27906]: pgmap v1123: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:26:50.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:50 smithi186 ceph-mon[31814]: pgmap v1123: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:26:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:50 smithi137 ceph-mon[31694]: pgmap v1123: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:26:52.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:52 smithi007 ceph-mon[27906]: pgmap v1124: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:26:52.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:52 smithi186 ceph-mon[31814]: pgmap v1124: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:26:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:52 smithi137 ceph-mon[31694]: pgmap v1124: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:26:54.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:54 smithi007 ceph-mon[27906]: pgmap v1125: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:54.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:54 smithi186 ceph-mon[31814]: pgmap v1125: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:54.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:54 smithi137 ceph-mon[31694]: pgmap v1125: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 -- 172.21.15.7:0/1745495087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6374103920 msgr2=0x7f637410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 --2- 172.21.15.7:0/1745495087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6374103920 0x7f637410be00 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f6360009900 tx=0x7f636002a480 comp rx=0 tx=0).stop 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 -- 172.21.15.7:0/1745495087 shutdown_connections 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 --2- 172.21.15.7:0/1745495087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f637410c420 0x7f637410e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 --2- 172.21.15.7:0/1745495087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6374103920 0x7f637410be00 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 --2- 172.21.15.7:0/1745495087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6374103000 0x7f63741033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 -- 172.21.15.7:0/1745495087 >> 172.21.15.7:0/1745495087 conn(0x7f63740fc840 msgr2=0x7f63740fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 -- 172.21.15.7:0/1745495087 shutdown_connections 2024-04-23T15:26:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.677+0000 7f6379e00640 1 -- 172.21.15.7:0/1745495087 wait complete. 2024-04-23T15:26:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.678+0000 7f6379e00640 1 Processor -- start 2024-04-23T15:26:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.678+0000 7f6379e00640 1 -- start start 2024-04-23T15:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6374103000 0x7f6374100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6374103920 0x7f6374101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 0x7f63741016d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63741120e0 con 0x7f637410c420 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6374111f60 con 0x7f6374103920 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6374112260 con 0x7f6374103000 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 0x7f63741016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 0x7f63741016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35094/0 (socket says 172.21.15.7:35094) 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.679+0000 7f6379400640 1 -- 172.21.15.7:0/147855596 learned_addr learned my addr 172.21.15.7:0/147855596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6378a00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6374103000 0x7f6374100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6373e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6374103920 0x7f6374101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6379400640 1 -- 172.21.15.7:0/147855596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6374103000 msgr2=0x7f6374100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6379400640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6374103000 0x7f6374100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6379400640 1 -- 172.21.15.7:0/147855596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6374103920 msgr2=0x7f6374101190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6379400640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6374103920 0x7f6374101190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6379400640 1 -- 172.21.15.7:0/147855596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63741a6ac0 con 0x7f637410c420 2024-04-23T15:26:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.680+0000 7f6379400640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 0x7f63741016d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f636c00cce0 tx=0x7f636c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.681+0000 7f6371600640 1 -- 172.21.15.7:0/147855596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c00f450 con 0x7f637410c420 2024-04-23T15:26:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.681+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63741a6db0 con 0x7f637410c420 2024-04-23T15:26:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.681+0000 7f6371600640 1 -- 172.21.15.7:0/147855596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f636c00faa0 con 0x7f637410c420 2024-04-23T15:26:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.681+0000 7f6371600640 1 -- 172.21.15.7:0/147855596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c018b70 con 0x7f637410c420 2024-04-23T15:26:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.681+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63741a7270 con 0x7f637410c420 2024-04-23T15:26:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.685+0000 7f637e25c740 1 Processor -- start 2024-04-23T15:26:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.686+0000 7f6371600640 1 -- 172.21.15.7:0/147855596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f636c018d10 con 0x7f637410c420 2024-04-23T15:26:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.686+0000 7f637e25c740 1 -- start start 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.686+0000 7f637e25c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 0x55627aa177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f637e25c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa17ce0 0x55627aa22060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f637e25c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa24990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f637e25c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55627a97d900 con 0x55627aa173c0 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f637e25c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55627a923f20 con 0x55627aa17ce0 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f637e25c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55627a9798c0 con 0x55627aa225a0 2024-04-23T15:26:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f6373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 0x55627aa177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f6373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 0x55627aa177a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35096/0 (socket says 172.21.15.7:35096) 2024-04-23T15:26:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f6373e00640 1 -- 172.21.15.7:0/2697223527 learned_addr learned my addr 172.21.15.7:0/2697223527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f6378a00640 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa17ce0 0x55627aa22060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.687+0000 7f6373e00640 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa24990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6373e00640 1 -- 172.21.15.7:0/2697223527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 msgr2=0x55627aa24990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6373e00640 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa24990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6373e00640 1 -- 172.21.15.7:0/2697223527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa17ce0 msgr2=0x55627aa22060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6373e00640 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa17ce0 0x55627aa22060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6373e00640 1 -- 172.21.15.7:0/2697223527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55627a948e10 con 0x55627aa173c0 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6371600640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f635c0a3d10 0x7f635c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6373e00640 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 0x55627aa177a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f6360005ab0 tx=0x7f6360009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8952920172975156 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6378a00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f635c0a3d10 0x7f635c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.688+0000 7f6371600640 1 -- 172.21.15.7:0/147855596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f636c0d10a0 con 0x7f637410c420 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.689+0000 7f6365c00640 1 -- 172.21.15.7:0/2697223527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360043020 con 0x55627aa173c0 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.689+0000 7f6365c00640 1 -- 172.21.15.7:0/2697223527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63600046c0 con 0x55627aa173c0 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.689+0000 7f6365c00640 1 -- 172.21.15.7:0/2697223527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360035070 con 0x55627aa173c0 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.689+0000 7f637e25c740 1 -- 172.21.15.7:0/2697223527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 msgr2=0x55627aa177a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.689+0000 7f637e25c740 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 0x55627aa177a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f6360005ab0 tx=0x7f6360009580 comp rx=0 tx=0).stop 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 -- 172.21.15.7:0/2697223527 shutdown_connections 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa17ce0 0x55627aa22060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa24990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 --2- 172.21.15.7:0/2697223527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa173c0 0x55627aa177a0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 -- 172.21.15.7:0/2697223527 >> 172.21.15.7:0/2697223527 conn(0x55627aa138d0 msgr2=0x55627aa13cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f6378a00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f635c0a3d10 0x7f635c0a61d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55627aa18960 tx=0x7f636800b4d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 -- 172.21.15.7:0/2697223527 shutdown_connections 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 -- 172.21.15.7:0/2697223527 wait complete. 2024-04-23T15:26:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.690+0000 7f637e25c740 1 -- start start 2024-04-23T15:26:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.691+0000 7f637e25c740 1 Processor -- start 2024-04-23T15:26:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.691+0000 7f637e25c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa173c0 0x55627aa1f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.691+0000 7f637e25c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa1fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.691+0000 7f6373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa1fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.691+0000 7f6373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa1fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35112/0 (socket says 172.21.15.7:35112) 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f637e25c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa225a0 0x55627aa20040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55627aa25020 con 0x55627aa17ce0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6373e00640 1 -- 172.21.15.7:0/3078475269 learned_addr learned my addr 172.21.15.7:0/3078475269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55627a9372c0 con 0x55627aa225a0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55627aa251a0 con 0x55627aa173c0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f637e25c740 10 client.0 _ll_register_callbacks cb 0x55627a68fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6378a00640 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa173c0 0x55627aa1f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6373e00640 1 -- 172.21.15.7:0/3078475269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa173c0 msgr2=0x55627aa1f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6373e00640 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa173c0 0x55627aa1f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6373e00640 1 -- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa225a0 msgr2=0x55627aa20040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6373e00640 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa225a0 0x55627aa20040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.692+0000 7f6373e00640 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55627a947fd0 con 0x55627aa17ce0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.693+0000 7f6373e00640 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa1fb00 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f636002a9a0 tx=0x7f6360005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f09c06c164a9d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.693+0000 7f635a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.693+0000 7f635a000640 1 -- 172.21.15.7:0/3078475269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360043030 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.693+0000 7f635a000640 1 -- 172.21.15.7:0/3078475269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f6360004c80 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.693+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63600046c0 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f635a000640 1 -- 172.21.15.7:0/3078475269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6360058050 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 10 client.18531 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55627a690210 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f635a000640 1 -- 172.21.15.7:0/3078475269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63600046c0 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f635a000640 1 -- 172.21.15.7:0/3078475269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f63600316d0 con 0x55627aa17ce0 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 10 client.18531 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 10 client.18531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 20 client.18531 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa324e0 0x55627aa348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 4 client.18531 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:26:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.694+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55627a98b320 con 0x55627aa324e0 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.695+0000 7f6378a00640 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa324e0 0x55627aa348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.696+0000 7f6378a00640 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa324e0 0x55627aa348d0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a558f2a8506820 server_cookie=d1d70215ae3dd4a in_seq=0 out_seq=0 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.696+0000 7f635a000640 10 client.18531 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f635a000640 1 -- 172.21.15.7:0/3078475269 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55627a98b320 con 0x55627aa324e0 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f635a000640 10 client.18531 handle_command_reply: tid=0 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 client.18531 shutdown 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 msgr2=0x55627aa1fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa1fb00 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f636002a9a0 tx=0x7f6360005a40 comp rx=0 tx=0).stop 2024-04-23T15:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 shutdown_connections 2024-04-23T15:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa324e0 0x55627aa348d0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa225a0 0x55627aa20040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa1fb00 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 --2- 172.21.15.7:0/3078475269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa173c0 0x55627aa1f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 >> 172.21.15.7:0/3078475269 conn(0x55627aa138d0 msgr2=0x55627aa19650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.698+0000 7f635a000640 0 client.18531 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.699+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 shutdown_connections 2024-04-23T15:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.699+0000 7f637e25c740 1 -- 172.21.15.7:0/3078475269 wait complete. 2024-04-23T15:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.699+0000 7f637e25c740 20 client.18531 trim_cache size 0 max 16384 2024-04-23T15:26:56.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.721+0000 7f637e25c740 1 Processor -- start 2024-04-23T15:26:56.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.721+0000 7f637e25c740 1 -- start start 2024-04-23T15:26:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f637e25c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa2e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f637e25c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa13210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f637e25c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f637e25c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63741b1230 con 0x55627aa17ce0 2024-04-23T15:26:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f637e25c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63741b2d70 con 0x55627aa173c0 2024-04-23T15:26:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f637e25c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63741b1900 con 0x55627aa225a0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f6373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa13210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f6373e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa13210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35118/0 (socket says 172.21.15.7:35118) 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f6373e00640 1 -- 172.21.15.7:0/1951016380 learned_addr learned my addr 172.21.15.7:0/1951016380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.722+0000 7f6378a00640 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa2e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6379400640 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6373e00640 1 -- 172.21.15.7:0/1951016380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 msgr2=0x55627aa1fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6373e00640 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa1fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6373e00640 1 -- 172.21.15.7:0/1951016380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 msgr2=0x55627aa2e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6373e00640 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa2e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6373e00640 1 -- 172.21.15.7:0/1951016380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55627aa1e5d0 con 0x55627aa17ce0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6373e00640 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa13210 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f6360031c90 tx=0x7f6360005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6383a9f524d06f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.723+0000 7f6365200640 1 -- 172.21.15.7:0/1951016380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360043070 con 0x55627aa17ce0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.724+0000 7f6365200640 1 -- 172.21.15.7:0/1951016380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63600046c0 con 0x55627aa17ce0 2024-04-23T15:26:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.724+0000 7f6365200640 1 -- 172.21.15.7:0/1951016380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360035040 con 0x55627aa17ce0 2024-04-23T15:26:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.724+0000 7f637e25c740 1 -- 172.21.15.7:0/1951016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 msgr2=0x55627aa13210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.724+0000 7f637e25c740 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa13210 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f6360031c90 tx=0x7f6360005fd0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 -- 172.21.15.7:0/1951016380 shutdown_connections 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa225a0 0x55627aa1fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa17ce0 0x55627aa13210 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 --2- 172.21.15.7:0/1951016380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa2e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 -- 172.21.15.7:0/1951016380 >> 172.21.15.7:0/1951016380 conn(0x55627aa138d0 msgr2=0x55627aa1f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 -- 172.21.15.7:0/1951016380 shutdown_connections 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 -- 172.21.15.7:0/1951016380 wait complete. 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 -- start start 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.725+0000 7f637e25c740 1 Processor -- start 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa1c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa17ce0 0x55627aa1c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 0x55627aa1cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63741b26a0 con 0x55627aa225a0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63741b1fd0 con 0x55627aa173c0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63741af230 con 0x55627aa17ce0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f637e25c740 10 client.0 _ll_register_callbacks cb 0x7f636800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f6379400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 0x55627aa1cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f6379400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 0x55627aa1cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35124/0 (socket says 172.21.15.7:35124) 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f6379400640 1 -- 172.21.15.7:0/987304830 learned_addr learned my addr 172.21.15.7:0/987304830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f6378a00640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa1c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.726+0000 7f6373e00640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa17ce0 0x55627aa1c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6379400640 1 -- 172.21.15.7:0/987304830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa17ce0 msgr2=0x55627aa1c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6379400640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa17ce0 0x55627aa1c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6379400640 1 -- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 msgr2=0x55627aa1c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6379400640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa1c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6379400640 1 -- 172.21.15.7:0/987304830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55627a75c620 con 0x55627aa225a0 2024-04-23T15:26:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6378a00640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa1c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f6379400640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 0x55627aa1cd80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f636c09cbc0 tx=0x7f636c00fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f90256102f1543 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f635a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f635a000640 1 -- 172.21.15.7:0/987304830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c087040 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f635a000640 1 -- 172.21.15.7:0/987304830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 9467+0+0 (secure 0 0 0) 0x7f636c0992a0 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.727+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63600046c0 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.728+0000 7f635a000640 1 -- 172.21.15.7:0/987304830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f636c0a0fe0 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.728+0000 7f637e25c740 10 client.18537 fetch_fsmap learned FSMap version 32 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.728+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55627aa98980 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.728+0000 7f635a000640 1 -- 172.21.15.7:0/987304830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63600046c0 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.728+0000 7f635a000640 1 -- 172.21.15.7:0/987304830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f636c09ce90 con 0x55627aa225a0 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.728+0000 7f637e25c740 10 client.18537 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.729+0000 7f637e25c740 10 client.18537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.729+0000 7f637e25c740 20 client.18537 populate_metadata read hostname 'smithi007' 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.729+0000 7f637e25c740 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa99100 0x55627aa9b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:26:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.729+0000 7f637e25c740 4 client.18537 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:26:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.729+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55627a985190 con 0x55627aa99100 2024-04-23T15:26:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.729+0000 7f6378a00640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa99100 0x55627aa9b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:26:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.730+0000 7f6378a00640 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa99100 0x55627aa9b520 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=811902139d4ce41a server_cookie=9781cab2b64097b2 in_seq=0 out_seq=0 2024-04-23T15:26:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.730+0000 7f635a000640 10 client.18537 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.768+0000 7f635a000640 1 -- 172.21.15.7:0/987304830 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55627a985190 con 0x55627aa99100 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.768+0000 7f635a000640 10 client.18537 handle_command_reply: tid=0 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.768+0000 7f637e25c740 1 client.18537 shutdown 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.768+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 msgr2=0x55627aa1cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.768+0000 7f637e25c740 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 0x55627aa1cd80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f636c09cbc0 tx=0x7f636c00fc50 comp rx=0 tx=0).stop 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 shutdown_connections 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55627aa99100 0x55627aa9b520 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55627aa225a0 0x55627aa1cd80 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55627aa17ce0 0x55627aa1c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 --2- 172.21.15.7:0/987304830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55627aa173c0 0x55627aa1c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f635a000640 0 client.18537 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 >> 172.21.15.7:0/987304830 conn(0x55627aa138d0 msgr2=0x55627aa19600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 shutdown_connections 2024-04-23T15:26:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 1 -- 172.21.15.7:0/987304830 wait complete. 2024-04-23T15:26:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.769+0000 7f637e25c740 20 client.18537 trim_cache size 0 max 16384 2024-04-23T15:26:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:26:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:26:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:26:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f635c0a3d10 msgr2=0x7f635c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f635c0a3d10 0x7f635c0a61d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55627aa18960 tx=0x7f636800b4d0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 msgr2=0x7f63741016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 0x7f63741016d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f636c00cce0 tx=0x7f636c00a620 comp rx=0 tx=0).stop 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 shutdown_connections 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f635c0a3d10 0x7f635c0a61d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6374103920 0x7f6374101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f637410c420 0x7f63741016d0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 --2- 172.21.15.7:0/147855596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6374103000 0x7f6374100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.770+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 >> 172.21.15.7:0/147855596 conn(0x7f63740fc840 msgr2=0x7f63740fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.771+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 shutdown_connections 2024-04-23T15:26:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:26:56.771+0000 7f6379e00640 1 -- 172.21.15.7:0/147855596 wait complete. 2024-04-23T15:26:56.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:56 smithi007 ceph-mon[27906]: pgmap v1126: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:56.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:56 smithi186 ceph-mon[31814]: pgmap v1126: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:56.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:56 smithi137 ceph-mon[31694]: pgmap v1126: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:26:58.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:26:58 smithi007 ceph-mon[27906]: pgmap v1127: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:58.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:26:58 smithi186 ceph-mon[31814]: pgmap v1127: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:26:58.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:26:58 smithi137 ceph-mon[31694]: pgmap v1127: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:00.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:00 smithi007 ceph-mon[27906]: pgmap v1128: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:27:00.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:00 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:27:00.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:00 smithi186 ceph-mon[31814]: pgmap v1128: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:27:00.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:00 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:27:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:00 smithi137 ceph-mon[31694]: pgmap v1128: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:27:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:00 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:27:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:01 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:27:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:01 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:27:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:01 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:27:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:01 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:27:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:01 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:27:01.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:01 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:27:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:01 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:27:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:01 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:27:01.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:01 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:27:02.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:02 smithi007 ceph-mon[27906]: pgmap v1129: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.7 MiB/s wr, 36 op/s 2024-04-23T15:27:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:02 smithi186 ceph-mon[31814]: pgmap v1129: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.7 MiB/s wr, 36 op/s 2024-04-23T15:27:02.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:02 smithi137 ceph-mon[31694]: pgmap v1129: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.7 MiB/s wr, 36 op/s 2024-04-23T15:27:04.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:04 smithi007 ceph-mon[27906]: pgmap v1130: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-04-23T15:27:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:04 smithi186 ceph-mon[31814]: pgmap v1130: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-04-23T15:27:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:04 smithi137 ceph-mon[31694]: pgmap v1130: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-04-23T15:27:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:06 smithi007 ceph-mon[27906]: pgmap v1131: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-04-23T15:27:06.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:06 smithi186 ceph-mon[31814]: pgmap v1131: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-04-23T15:27:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:06 smithi137 ceph-mon[31694]: pgmap v1131: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.1 MiB/s wr, 31 op/s 2024-04-23T15:27:08.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:08 smithi007 ceph-mon[27906]: pgmap v1132: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.7 MiB/s wr, 36 op/s 2024-04-23T15:27:08.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:08 smithi007 ceph-mon[27906]: osdmap e151: 12 total, 12 up, 12 in 2024-04-23T15:27:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:08 smithi186 ceph-mon[31814]: pgmap v1132: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.7 MiB/s wr, 36 op/s 2024-04-23T15:27:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:08 smithi186 ceph-mon[31814]: osdmap e151: 12 total, 12 up, 12 in 2024-04-23T15:27:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:08 smithi137 ceph-mon[31694]: pgmap v1132: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.7 MiB/s wr, 36 op/s 2024-04-23T15:27:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:08 smithi137 ceph-mon[31694]: osdmap e151: 12 total, 12 up, 12 in 2024-04-23T15:27:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 -- 172.21.15.7:0/3756053183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108540 msgr2=0x7ff920108980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 --2- 172.21.15.7:0/3756053183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108540 0x7ff920108980 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7ff908009930 tx=0x7ff90802a420 comp rx=0 tx=0).stop 2024-04-23T15:27:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 -- 172.21.15.7:0/3756053183 shutdown_connections 2024-04-23T15:27:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 --2- 172.21.15.7:0/3756053183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff920108ec0 0x7ff920115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 --2- 172.21.15.7:0/3756053183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108540 0x7ff920108980 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 --2- 172.21.15.7:0/3756053183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff92010e4d0 0x7ff92010e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 -- 172.21.15.7:0/3756053183 >> 172.21.15.7:0/3756053183 conn(0x7ff920077de0 msgr2=0x7ff920106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 -- 172.21.15.7:0/3756053183 shutdown_connections 2024-04-23T15:27:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.937+0000 7ff924c00640 1 -- 172.21.15.7:0/3756053183 wait complete. 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.938+0000 7ff924c00640 1 Processor -- start 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.938+0000 7ff924c00640 1 -- start start 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff924c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff920108540 0x7ff9201a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff924c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 0x7ff9201a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff924c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92010e4d0 0x7ff92019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff924c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201186f0 con 0x7ff920108ec0 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff924c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff920118570 con 0x7ff92010e4d0 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff924c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff920118870 con 0x7ff920108540 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff916a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 0x7ff9201a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff916a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 0x7ff9201a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41534/0 (socket says 172.21.15.7:41534) 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff916a00640 1 -- 172.21.15.7:0/3474536181 learned_addr learned my addr 172.21.15.7:0/3474536181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff91f400640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff920108540 0x7ff9201a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.939+0000 7ff91fe00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92010e4d0 0x7ff92019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff916a00640 1 -- 172.21.15.7:0/3474536181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff920108540 msgr2=0x7ff9201a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff916a00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff920108540 0x7ff9201a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff916a00640 1 -- 172.21.15.7:0/3474536181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92010e4d0 msgr2=0x7ff92019ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff916a00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92010e4d0 0x7ff92019ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff916a00640 1 -- 172.21.15.7:0/3474536181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92019f210 con 0x7ff920108ec0 2024-04-23T15:27:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff916a00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 0x7ff9201a4e20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff908005ab0 tx=0x7ff908003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.940+0000 7ff91cc00640 1 -- 172.21.15.7:0/3474536181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90803f070 con 0x7ff920108ec0 2024-04-23T15:27:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.941+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92019f4a0 con 0x7ff920108ec0 2024-04-23T15:27:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.941+0000 7ff91cc00640 1 -- 172.21.15.7:0/3474536181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff908031d60 con 0x7ff920108ec0 2024-04-23T15:27:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.941+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9201ab7a0 con 0x7ff920108ec0 2024-04-23T15:27:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.941+0000 7ff91cc00640 1 -- 172.21.15.7:0/3474536181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908049060 con 0x7ff920108ec0 2024-04-23T15:27:09.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff91cc00640 1 -- 172.21.15.7:0/3474536181 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff908042070 con 0x7ff920108ec0 2024-04-23T15:27:09.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 Processor -- start 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 -- start start 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56103d210900 con 0x56103d2b55a0 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56103d1b6f20 con 0x56103d2aace0 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.945+0000 7ff929024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56103d20c8c0 con 0x56103d2aa3c0 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41536/0 (socket says 172.21.15.7:41536) 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 -- 172.21.15.7:0/427535002 learned_addr learned my addr 172.21.15.7:0/427535002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff91fe00640 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff91f400640 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 -- 172.21.15.7:0/427535002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 msgr2=0x56103d2aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 -- 172.21.15.7:0/427535002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 msgr2=0x56103d2b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.946+0000 7ff916a00640 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff916a00640 1 -- 172.21.15.7:0/427535002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103d1dbe10 con 0x56103d2b55a0 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff916a00640 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b7990 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff9080eeaa0 tx=0x7ff9080f7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bc3d3225bb438b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff91cc00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9040a3d10 0x7ff9040a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff91cc00640 1 -- 172.21.15.7:0/3474536181 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 9555+0+0 (secure 0 0 0) 0x7ff9080f1880 con 0x7ff920108ec0 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff90fe00640 1 -- 172.21.15.7:0/427535002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908100030 con 0x56103d2b55a0 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff90fe00640 1 -- 172.21.15.7:0/427535002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9080bdab0 con 0x56103d2b55a0 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff90fe00640 1 -- 172.21.15.7:0/427535002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080f4e60 con 0x56103d2b55a0 2024-04-23T15:27:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.947+0000 7ff91fe00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9040a3d10 0x7ff9040a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.948+0000 7ff929024740 1 -- 172.21.15.7:0/427535002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 msgr2=0x56103d2b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.948+0000 7ff929024740 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b7990 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff9080eeaa0 tx=0x7ff9080f7cb0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.948+0000 7ff91fe00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9040a3d10 0x7ff9040a61d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff91800bca0 tx=0x7ff91800b450 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 -- 172.21.15.7:0/427535002 shutdown_connections 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b7990 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 --2- 172.21.15.7:0/427535002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 -- 172.21.15.7:0/427535002 >> 172.21.15.7:0/427535002 conn(0x56103d2a68d0 msgr2=0x56103d2a6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 -- 172.21.15.7:0/427535002 shutdown_connections 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 -- 172.21.15.7:0/427535002 wait complete. 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 -- start start 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.949+0000 7ff929024740 1 Processor -- start 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56103d2b7f90 con 0x56103d2b55a0 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56103d1ca2c0 con 0x56103d2aace0 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56103d2b8110 con 0x56103d2aa3c0 2024-04-23T15:27:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff929024740 10 client.0 _ll_register_callbacks cb 0x56103cf22a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.950+0000 7ff91fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41546/0 (socket says 172.21.15.7:41546) 2024-04-23T15:27:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 -- 172.21.15.7:0/1292322037 learned_addr learned my addr 172.21.15.7:0/1292322037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91f400640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff916a00640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 -- 172.21.15.7:0/1292322037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 msgr2=0x56103d2b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 -- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 msgr2=0x56103d2b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.951+0000 7ff91fe00640 1 -- 172.21.15.7:0/1292322037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103d1dafd0 con 0x56103d2b55a0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff91fe00640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b2fc0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ff918013fd0 tx=0x7ff9180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc398feb1d82aad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff90cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff90cc00640 1 -- 172.21.15.7:0/1292322037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918029680 con 0x56103d2b55a0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff90cc00640 1 -- 172.21.15.7:0/1292322037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(151..151 src has 1..151) ==== 9555+0+0 (secure 0 0 0) 0x7ff918029820 con 0x56103d2b55a0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9080bdab0 con 0x56103d2b55a0 2024-04-23T15:27:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff90cc00640 1 -- 172.21.15.7:0/1292322037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff918032050 con 0x56103d2b55a0 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff929024740 10 client.18549 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.952+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56103cf23210 con 0x56103d2b55a0 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff90cc00640 1 -- 172.21.15.7:0/1292322037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9080bdab0 con 0x56103d2b55a0 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff90cc00640 1 -- 172.21.15.7:0/1292322037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff91801b420 con 0x56103d2b55a0 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff929024740 10 client.18549 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff929024740 10 client.18549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff929024740 20 client.18549 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff929024740 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d2c5530 0x56103d2c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff929024740 4 client.18549 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.953+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56103d21e320 con 0x56103d2c5530 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.954+0000 7ff91f400640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d2c5530 0x56103d2c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.955+0000 7ff91f400640 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d2c5530 0x56103d2c7920 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d67af6baebd6972 server_cookie=8f77b2bf3913c6ea in_seq=0 out_seq=0 2024-04-23T15:27:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.955+0000 7ff90cc00640 10 client.18549 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff90cc00640 1 -- 172.21.15.7:0/1292322037 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56103d21e320 con 0x56103d2c5530 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff90cc00640 10 client.18549 handle_command_reply: tid=0 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 client.18549 shutdown 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 msgr2=0x56103d2b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b2fc0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ff918013fd0 tx=0x7ff9180046c0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 shutdown_connections 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d2c5530 0x56103d2c7920 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2b2fc0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 --2- 172.21.15.7:0/1292322037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aa3c0 0x56103d2b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff90cc00640 0 client.18549 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 >> 172.21.15.7:0/1292322037 conn(0x56103d2a68d0 msgr2=0x56103d2ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 shutdown_connections 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 1 -- 172.21.15.7:0/1292322037 wait complete. 2024-04-23T15:27:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.957+0000 7ff929024740 20 client.18549 trim_cache size 0 max 16384 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.982+0000 7ff929024740 1 Processor -- start 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.982+0000 7ff929024740 1 -- start start 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff929024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 0x56103d2c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff929024740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff929024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2b55a0 0x56103d2a5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff929024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201b5930 con 0x56103d2aa3c0 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff929024740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201b7470 con 0x56103d2aace0 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff929024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201b6000 con 0x56103d2b55a0 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff91f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 0x56103d2c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff91f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 0x56103d2c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41560/0 (socket says 172.21.15.7:41560) 2024-04-23T15:27:09.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff91f400640 1 -- 172.21.15.7:0/1890452802 learned_addr learned my addr 172.21.15.7:0/1890452802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:09.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff91fe00640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2b55a0 0x56103d2a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff91f400640 1 -- 172.21.15.7:0/1890452802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2b55a0 msgr2=0x56103d2a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.983+0000 7ff916a00640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff91f400640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2b55a0 0x56103d2a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff91f400640 1 -- 172.21.15.7:0/1890452802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 msgr2=0x56103d2acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff91f400640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff91f400640 1 -- 172.21.15.7:0/1890452802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103d2aab10 con 0x56103d2aa3c0 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff91fe00640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2b55a0 0x56103d2a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff916a00640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff91f400640 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 0x56103d2c0d30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x56103d2c81d0 tx=0x7ff910014c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8df8e94f698d49b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff90f400640 1 -- 172.21.15.7:0/1890452802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100142d0 con 0x56103d2aa3c0 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff90f400640 1 -- 172.21.15.7:0/1890452802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff910011dc0 con 0x56103d2aa3c0 2024-04-23T15:27:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.984+0000 7ff90f400640 1 -- 172.21.15.7:0/1890452802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91001e8b0 con 0x56103d2aa3c0 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 -- 172.21.15.7:0/1890452802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 msgr2=0x56103d2c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 0x56103d2c0d30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x56103d2c81d0 tx=0x7ff910014c70 comp rx=0 tx=0).stop 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 -- 172.21.15.7:0/1890452802 shutdown_connections 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aace0 0x56103d2acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2b55a0 0x56103d2a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 --2- 172.21.15.7:0/1890452802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2aa3c0 0x56103d2c0d30 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 -- 172.21.15.7:0/1890452802 >> 172.21.15.7:0/1890452802 conn(0x56103d2a68d0 msgr2=0x56103d2a5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 -- 172.21.15.7:0/1890452802 shutdown_connections 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.985+0000 7ff929024740 1 -- 172.21.15.7:0/1890452802 wait complete. 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.986+0000 7ff929024740 1 -- start start 2024-04-23T15:27:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.986+0000 7ff929024740 1 Processor -- start 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aa3c0 0x56103d2af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aace0 0x56103d2af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201b6da0 con 0x56103d2b55a0 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201b66d0 con 0x56103d2aa3c0 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201b3930 con 0x56103d2aace0 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff929024740 10 client.0 _ll_register_callbacks cb 0x7ff918005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41568/0 (socket says 172.21.15.7:41568) 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 -- 172.21.15.7:0/2230167590 learned_addr learned my addr 172.21.15.7:0/2230167590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91f400640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aa3c0 0x56103d2af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff916a00640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aace0 0x56103d2af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 -- 172.21.15.7:0/2230167590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aace0 msgr2=0x56103d2af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aace0 0x56103d2af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 -- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aa3c0 msgr2=0x56103d2af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aa3c0 0x56103d2af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.987+0000 7ff91fe00640 1 -- 172.21.15.7:0/2230167590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56103cfef620 con 0x56103d2b55a0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.988+0000 7ff91fe00640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2afcf0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ff918012d50 tx=0x7ff91800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41118814c7e1fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.988+0000 7ff90cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.988+0000 7ff90cc00640 1 -- 172.21.15.7:0/2230167590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91803c020 con 0x56103d2b55a0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.988+0000 7ff90cc00640 1 -- 172.21.15.7:0/2230167590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(151..151 src has 1..151) ==== 9555+0+0 (secure 0 0 0) 0x7ff918005240 con 0x56103d2b55a0 2024-04-23T15:27:09.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.988+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff910011dc0 con 0x56103d2b55a0 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff90cc00640 1 -- 172.21.15.7:0/2230167590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff91801b5a0 con 0x56103d2b55a0 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff929024740 10 client.18555 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56103d32bcb0 con 0x56103d2b55a0 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff90cc00640 1 -- 172.21.15.7:0/2230167590 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff910011dc0 con 0x56103d2b55a0 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff90cc00640 1 -- 172.21.15.7:0/2230167590 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff918035030 con 0x56103d2b55a0 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff929024740 10 client.18555 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff929024740 10 client.18555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff929024740 20 client.18555 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.989+0000 7ff929024740 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d32c450 0x56103d32e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.990+0000 7ff929024740 4 client.18555 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.990+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56103d218190 con 0x56103d32c450 2024-04-23T15:27:09.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.990+0000 7ff91f400640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d32c450 0x56103d32e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:09.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.991+0000 7ff91f400640 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d32c450 0x56103d32e870 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12d4257000b08ca server_cookie=6e0259cb80a2d069 in_seq=0 out_seq=0 2024-04-23T15:27:09.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:09.991+0000 7ff90cc00640 10 client.18555 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.025+0000 7ff90cc00640 1 -- 172.21.15.7:0/2230167590 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56103d218190 con 0x56103d32c450 2024-04-23T15:27:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.025+0000 7ff90cc00640 10 client.18555 handle_command_reply: tid=0 2024-04-23T15:27:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.025+0000 7ff929024740 1 client.18555 shutdown 2024-04-23T15:27:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 msgr2=0x56103d2afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2afcf0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ff918012d50 tx=0x7ff91800b670 comp rx=0 tx=0).stop 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 shutdown_connections 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56103d32c450 0x56103d32e870 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56103d2b55a0 0x56103d2afcf0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56103d2aace0 0x56103d2af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 --2- 172.21.15.7:0/2230167590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56103d2aa3c0 0x56103d2af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff90cc00640 0 client.18555 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 >> 172.21.15.7:0/2230167590 conn(0x56103d2a68d0 msgr2=0x56103d2a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 shutdown_connections 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.026+0000 7ff929024740 1 -- 172.21.15.7:0/2230167590 wait complete. 2024-04-23T15:27:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.027+0000 7ff929024740 20 client.18555 trim_cache size 0 max 16384 2024-04-23T15:27:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:27:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:27:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:27:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:27:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.027+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9040a3d10 msgr2=0x7ff9040a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.027+0000 7ff924c00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9040a3d10 0x7ff9040a61d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff91800bca0 tx=0x7ff91800b450 comp rx=0 tx=0).stop 2024-04-23T15:27:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.027+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 msgr2=0x7ff9201a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.027+0000 7ff924c00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 0x7ff9201a4e20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff908005ab0 tx=0x7ff908003cd0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 shutdown_connections 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff9040a3d10 0x7ff9040a61d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92010e4d0 0x7ff92019ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff920108ec0 0x7ff9201a4e20 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 --2- 172.21.15.7:0/3474536181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff920108540 0x7ff9201a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 >> 172.21.15.7:0/3474536181 conn(0x7ff920077de0 msgr2=0x7ff920078440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 shutdown_connections 2024-04-23T15:27:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:10.028+0000 7ff924c00640 1 -- 172.21.15.7:0/3474536181 wait complete. 2024-04-23T15:27:10.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:10 smithi007 ceph-mon[27906]: pgmap v1134: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:27:10.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:10 smithi186 ceph-mon[31814]: pgmap v1134: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:27:10.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:10 smithi137 ceph-mon[31694]: pgmap v1134: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:27:12.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:12 smithi007 ceph-mon[27906]: pgmap v1135: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:12.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:12 smithi186 ceph-mon[31814]: pgmap v1135: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:12.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:12 smithi137 ceph-mon[31694]: pgmap v1135: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:14.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:14 smithi186 ceph-mon[31814]: pgmap v1136: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:14.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:14 smithi137 ceph-mon[31694]: pgmap v1136: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:15.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:14 smithi007 ceph-mon[27906]: pgmap v1136: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:17 smithi007 ceph-mon[27906]: pgmap v1137: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:17.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:17 smithi007 ceph-mon[27906]: osdmap e152: 12 total, 12 up, 12 in 2024-04-23T15:27:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:17 smithi186 ceph-mon[31814]: pgmap v1137: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:17 smithi186 ceph-mon[31814]: osdmap e152: 12 total, 12 up, 12 in 2024-04-23T15:27:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:17 smithi137 ceph-mon[31694]: pgmap v1137: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:17 smithi137 ceph-mon[31694]: osdmap e152: 12 total, 12 up, 12 in 2024-04-23T15:27:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:19 smithi007 ceph-mon[27906]: pgmap v1139: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:27:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:19 smithi186 ceph-mon[31814]: pgmap v1139: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:27:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:19 smithi137 ceph-mon[31694]: pgmap v1139: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:27:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:21 smithi007 ceph-mon[27906]: pgmap v1140: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:21 smithi186 ceph-mon[31814]: pgmap v1140: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:21 smithi137 ceph-mon[31694]: pgmap v1140: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:27:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 -- 172.21.15.7:0/3297361067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4101910 msgr2=0x7f1ec4105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/3297361067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4101910 0x7f1ec4105950 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009900 tx=0x7f1eb002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 -- 172.21.15.7:0/3297361067 shutdown_connections 2024-04-23T15:27:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/3297361067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ec4106030 0x7f1ec410dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/3297361067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4101910 0x7f1ec4105950 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/3297361067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec4100f60 0x7f1ec4101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 -- 172.21.15.7:0/3297361067 >> 172.21.15.7:0/3297361067 conn(0x7f1ec40fc820 msgr2=0x7f1ec40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 -- 172.21.15.7:0/3297361067 shutdown_connections 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.244+0000 7f1ecaa00640 1 -- 172.21.15.7:0/3297361067 wait complete. 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.245+0000 7f1ecaa00640 1 Processor -- start 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.245+0000 7f1ecaa00640 1 -- start start 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ecaa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ec4100f60 0x7f1ec4110d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ecaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec4106030 0x7f1ec4111240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ecaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 0x7f1ec41a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ecaa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec4069a40 con 0x7f1ec4111780 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ecaa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40698c0 con 0x7f1ec4106030 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ecaa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec4069bc0 con 0x7f1ec4100f60 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1eca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 0x7f1ec41a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1eca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 0x7f1ec41a6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48282/0 (socket says 172.21.15.7:48282) 2024-04-23T15:27:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1eca000640 1 -- 172.21.15.7:0/2340357133 learned_addr learned my addr 172.21.15.7:0/2340357133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.246+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec4106030 0x7f1ec4111240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ec4100f60 0x7f1ec4110d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1eca000640 1 -- 172.21.15.7:0/2340357133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ec4100f60 msgr2=0x7f1ec4110d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1eca000640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ec4100f60 0x7f1ec4110d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1eca000640 1 -- 172.21.15.7:0/2340357133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec4106030 msgr2=0x7f1ec4111240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1eca000640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec4106030 0x7f1ec4111240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1eca000640 1 -- 172.21.15.7:0/2340357133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec41a6f30 con 0x7f1ec4111780 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1eca000640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 0x7f1ec41a6830 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00eaa0 tx=0x7f1ebc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.247+0000 7f1ec2000640 1 -- 172.21.15.7:0/2340357133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00cdb0 con 0x7f1ec4111780 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.248+0000 7f1ec2000640 1 -- 172.21.15.7:0/2340357133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ebc005020 con 0x7f1ec4111780 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.248+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec41a7220 con 0x7f1ec4111780 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.248+0000 7f1ec2000640 1 -- 172.21.15.7:0/2340357133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc0116d0 con 0x7f1ec4111780 2024-04-23T15:27:23.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.248+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec41a7740 con 0x7f1ec4111780 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.251+0000 7f1ec2000640 1 -- 172.21.15.7:0/2340357133 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1ebc0051d0 con 0x7f1ec4111780 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 Processor -- start 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 -- start start 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db4833c0 0x55a8db4837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db48e5a0 0x55a8db490990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a8db3e9900 con 0x55a8db483ce0 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a8db38ff20 con 0x55a8db4833c0 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.252+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a8db3e58c0 con 0x55a8db48e5a0 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48294/0 (socket says 172.21.15.7:48294) 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 -- 172.21.15.7:0/4020294201 learned_addr learned my addr 172.21.15.7:0/4020294201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db4833c0 0x55a8db4837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db48e5a0 0x55a8db490990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 -- 172.21.15.7:0/4020294201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db48e5a0 msgr2=0x55a8db490990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db48e5a0 0x55a8db490990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 -- 172.21.15.7:0/4020294201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db4833c0 msgr2=0x55a8db4837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.253+0000 7f1ec9600640 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db4833c0 0x55a8db4837a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.254+0000 7f1ec9600640 1 -- 172.21.15.7:0/4020294201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8db3b4e10 con 0x55a8db483ce0 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.254+0000 7f1ec9600640 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48e060 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800dcb0 tx=0x7f1eb800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729d61fc2aa404a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.254+0000 7f1eb6600640 1 -- 172.21.15.7:0/4020294201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8011440 con 0x55a8db483ce0 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.254+0000 7f1ec2000640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1eac0a3d40 0x7f1eac0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.254+0000 7f1eb6600640 1 -- 172.21.15.7:0/4020294201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1eb8011a90 con 0x55a8db483ce0 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.254+0000 7f1eb6600640 1 -- 172.21.15.7:0/4020294201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb801b9d0 con 0x55a8db483ce0 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.255+0000 7f1ec2000640 1 -- 172.21.15.7:0/2340357133 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7f1ebc0d0a60 con 0x7f1ec4111780 2024-04-23T15:27:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.255+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1eac0a3d40 0x7f1eac0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.255+0000 7f1ecefb6740 1 -- 172.21.15.7:0/4020294201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 msgr2=0x55a8db48e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.255+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48e060 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800dcb0 tx=0x7f1eb800f730 comp rx=0 tx=0).stop 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1eac0a3d40 0x7f1eac0a6200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0006010 tx=0x7f1eb0000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 -- 172.21.15.7:0/4020294201 shutdown_connections 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db48e5a0 0x55a8db490990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48e060 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/4020294201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db4833c0 0x55a8db4837a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 -- 172.21.15.7:0/4020294201 >> 172.21.15.7:0/4020294201 conn(0x55a8db47f8d0 msgr2=0x55a8db47fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 -- 172.21.15.7:0/4020294201 shutdown_connections 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 -- 172.21.15.7:0/4020294201 wait complete. 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.256+0000 7f1ecefb6740 1 -- start start 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 Processor -- start 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db4833c0 0x55a8db48b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db48bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a8db491140 con 0x55a8db483ce0 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a8db3a32c0 con 0x55a8db48e5a0 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a8db4912c0 con 0x55a8db4833c0 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ecefb6740 10 client.0 _ll_register_callbacks cb 0x55a8db0fba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ec8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ec8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48302/0 (socket says 172.21.15.7:48302) 2024-04-23T15:27:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.257+0000 7f1ec8c00640 1 -- 172.21.15.7:0/2191691967 learned_addr learned my addr 172.21.15.7:0/2191691967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db4833c0 0x55a8db48b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1eca000640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db48bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec8c00640 1 -- 172.21.15.7:0/2191691967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db4833c0 msgr2=0x55a8db48b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db4833c0 0x55a8db48b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec8c00640 1 -- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 msgr2=0x55a8db48bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db48bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec8c00640 1 -- 172.21.15.7:0/2191691967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8db3b3fd0 con 0x55a8db483ce0 2024-04-23T15:27:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48ba40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0003870 tx=0x7f1eb0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f52706e3d79a29 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.258+0000 7f1eaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1eaaa00640 1 -- 172.21.15.7:0/2191691967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb004e070 con 0x55a8db483ce0 2024-04-23T15:27:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1eaaa00640 1 -- 172.21.15.7:0/2191691967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7f1eb00318b0 con 0x55a8db483ce0 2024-04-23T15:27:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb8011a90 con 0x55a8db483ce0 2024-04-23T15:27:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1eaaa00640 1 -- 172.21.15.7:0/2191691967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1eb0035040 con 0x55a8db483ce0 2024-04-23T15:27:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1ecefb6740 10 client.18567 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a8db0fc210 con 0x55a8db483ce0 2024-04-23T15:27:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.259+0000 7f1eaaa00640 1 -- 172.21.15.7:0/2191691967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1eb8011a90 con 0x55a8db483ce0 2024-04-23T15:27:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1eaaa00640 1 -- 172.21.15.7:0/2191691967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1eb004ab10 con 0x55a8db483ce0 2024-04-23T15:27:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1ecefb6740 10 client.18567 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1ecefb6740 10 client.18567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1ecefb6740 20 client.18567 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db49e690 0x55a8db4a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1ecefb6740 4 client.18567 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.260+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8db3f7320 con 0x55a8db49e690 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.261+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db49e690 0x55a8db4a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.262+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db49e690 0x55a8db4a0ae0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b76d889212a069b server_cookie=59b626e0248d8104 in_seq=0 out_seq=0 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.262+0000 7f1eaaa00640 10 client.18567 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.263+0000 7f1eaaa00640 1 -- 172.21.15.7:0/2191691967 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8db3f7320 con 0x55a8db49e690 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.263+0000 7f1eaaa00640 10 client.18567 handle_command_reply: tid=0 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 client.18567 shutdown 2024-04-23T15:27:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 msgr2=0x55a8db48ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48ba40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0003870 tx=0x7f1eb0031400 comp rx=0 tx=0).stop 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 shutdown_connections 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db49e690 0x55a8db4a0ae0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db48bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db483ce0 0x55a8db48ba40 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2191691967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db4833c0 0x55a8db48b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1eaaa00640 0 client.18567 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 >> 172.21.15.7:0/2191691967 conn(0x55a8db47f8d0 msgr2=0x55a8db485650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 shutdown_connections 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2191691967 wait complete. 2024-04-23T15:27:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.264+0000 7f1ecefb6740 20 client.18567 trim_cache size 0 max 16384 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 Processor -- start 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 -- start start 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db48dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db49a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db4a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41b1520 con 0x55a8db4833c0 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41b3060 con 0x55a8db48e5a0 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41b1bf0 con 0x55a8db483ce0 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.281+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db48dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db48dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48312/0 (socket says 172.21.15.7:48312) 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 -- 172.21.15.7:0/2789208939 learned_addr learned my addr 172.21.15.7:0/2789208939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db49a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1eca000640 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db4a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 -- 172.21.15.7:0/2789208939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 msgr2=0x55a8db49a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db49a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 -- 172.21.15.7:0/2789208939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 msgr2=0x55a8db4a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db4a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 -- 172.21.15.7:0/2789208939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8db1c8620 con 0x55a8db4833c0 2024-04-23T15:27:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.282+0000 7f1ec9600640 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db48dc30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x55a8db484960 tx=0x7f1eb800ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67199ee7e9ba5910 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1eb5c00640 1 -- 172.21.15.7:0/2789208939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8030070 con 0x55a8db4833c0 2024-04-23T15:27:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1eb5c00640 1 -- 172.21.15.7:0/2789208939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1eb802a030 con 0x55a8db4833c0 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1eb5c00640 1 -- 172.21.15.7:0/2789208939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8005650 con 0x55a8db4833c0 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2789208939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 msgr2=0x55a8db48dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db48dc30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x55a8db484960 tx=0x7f1eb800ffc0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2789208939 shutdown_connections 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db4a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.283+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db49a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.284+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/2789208939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db48dc30 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.284+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2789208939 >> 172.21.15.7:0/2789208939 conn(0x55a8db47f8d0 msgr2=0x55a8db47fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.284+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2789208939 shutdown_connections 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.284+0000 7f1ecefb6740 1 -- 172.21.15.7:0/2789208939 wait complete. 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.284+0000 7f1ecefb6740 1 -- start start 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.284+0000 7f1ecefb6740 1 Processor -- start 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db488370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db4888b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db488df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41b2990 con 0x55a8db4833c0 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41b22c0 con 0x55a8db48e5a0 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41af520 con 0x55a8db483ce0 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ecefb6740 10 client.0 _ll_register_callbacks cb 0x7f1eb0041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db488370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ec9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db488370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48326/0 (socket says 172.21.15.7:48326) 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ec9600640 1 -- 172.21.15.7:0/3673707224 learned_addr learned my addr 172.21.15.7:0/3673707224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1eca000640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db488df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.285+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db4888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ec9600640 1 -- 172.21.15.7:0/3673707224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 msgr2=0x55a8db4888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ec9600640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db4888b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ec9600640 1 -- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 msgr2=0x55a8db488df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ec9600640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db488df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ec9600640 1 -- 172.21.15.7:0/3673707224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8db503e10 con 0x55a8db4833c0 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ec9600640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db488370 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8006010 tx=0x7f1eb800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5369f860d6bccb33 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1eaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1eaaa00640 1 -- 172.21.15.7:0/3673707224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8030040 con 0x55a8db4833c0 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1eaaa00640 1 -- 172.21.15.7:0/3673707224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7f1eb8004040 con 0x55a8db4833c0 2024-04-23T15:27:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.286+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb802a030 con 0x55a8db4833c0 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1eaaa00640 1 -- 172.21.15.7:0/3673707224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1eb8042050 con 0x55a8db4833c0 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1ecefb6740 10 client.18573 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a8db5050e0 con 0x55a8db4833c0 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1eaaa00640 1 -- 172.21.15.7:0/3673707224 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1eb802a030 con 0x55a8db4833c0 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1eaaa00640 1 -- 172.21.15.7:0/3673707224 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1eb8033050 con 0x55a8db4833c0 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1ecefb6740 10 client.18573 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1ecefb6740 10 client.18573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1ecefb6740 20 client.18573 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.287+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db505550 0x55a8db507940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.288+0000 7f1ecefb6740 4 client.18573 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:27:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.288+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8db3f1190 con 0x55a8db505550 2024-04-23T15:27:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.288+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db505550 0x55a8db507940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.289+0000 7f1ec8c00640 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db505550 0x55a8db507940 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cee5cb0d657caae server_cookie=ed39fcb23f15e6ec in_seq=0 out_seq=0 2024-04-23T15:27:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.289+0000 7f1eaaa00640 10 client.18573 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:23.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.323+0000 7f1eaaa00640 1 -- 172.21.15.7:0/3673707224 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8db3f1190 con 0x55a8db505550 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.323+0000 7f1eaaa00640 10 client.18573 handle_command_reply: tid=0 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.323+0000 7f1ecefb6740 1 client.18573 shutdown 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.323+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 msgr2=0x55a8db488370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.323+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db488370 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8006010 tx=0x7f1eb800d520 comp rx=0 tx=0).stop 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 shutdown_connections 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a8db505550 0x55a8db507940 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8db48e5a0 0x55a8db488df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a8db483ce0 0x55a8db4888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1eaaa00640 0 client.18573 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 --2- 172.21.15.7:0/3673707224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8db4833c0 0x55a8db488370 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 >> 172.21.15.7:0/3673707224 conn(0x55a8db47f8d0 msgr2=0x55a8db484dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:23.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 shutdown_connections 2024-04-23T15:27:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 1 -- 172.21.15.7:0/3673707224 wait complete. 2024-04-23T15:27:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.324+0000 7f1ecefb6740 20 client.18573 trim_cache size 0 max 16384 2024-04-23T15:27:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:27:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:27:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:27:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1eac0a3d40 msgr2=0x7f1eac0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1eac0a3d40 0x7f1eac0a6200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0006010 tx=0x7f1eb0000bc0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 msgr2=0x7f1ec41a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 0x7f1ec41a6830 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00eaa0 tx=0x7f1ebc00ef60 comp rx=0 tx=0).stop 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 shutdown_connections 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1eac0a3d40 0x7f1eac0a6200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ec4106030 0x7f1ec4111240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ec4111780 0x7f1ec41a6830 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 --2- 172.21.15.7:0/2340357133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ec4100f60 0x7f1ec4110d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 >> 172.21.15.7:0/2340357133 conn(0x7f1ec40fc820 msgr2=0x7f1ec40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 shutdown_connections 2024-04-23T15:27:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:23.325+0000 7f1ecaa00640 1 -- 172.21.15.7:0/2340357133 wait complete. 2024-04-23T15:27:23.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:23 smithi007 ceph-mon[27906]: pgmap v1141: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:23 smithi186 ceph-mon[31814]: pgmap v1141: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:23 smithi137 ceph-mon[31694]: pgmap v1141: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:25.352 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:25 smithi007 ceph-mon[27906]: pgmap v1142: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:25 smithi186 ceph-mon[31814]: pgmap v1142: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:25 smithi137 ceph-mon[31694]: pgmap v1142: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:26.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:26 smithi186 ceph-mon[31814]: pgmap v1143: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:26.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:26 smithi137 ceph-mon[31694]: pgmap v1143: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:26.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:26 smithi007 ceph-mon[27906]: pgmap v1143: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 12 op/s 2024-04-23T15:27:28.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:28 smithi007 ceph-mon[27906]: pgmap v1144: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:27:28.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:28 smithi186 ceph-mon[31814]: pgmap v1144: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:27:28.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:28 smithi137 ceph-mon[31694]: pgmap v1144: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:27:30.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:30 smithi007 ceph-mon[27906]: pgmap v1145: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:30 smithi186 ceph-mon[31814]: pgmap v1145: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:30.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:30 smithi137 ceph-mon[31694]: pgmap v1145: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:32.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:32 smithi007 ceph-mon[27906]: pgmap v1146: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:27:32.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:32 smithi186 ceph-mon[31814]: pgmap v1146: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:27:32.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:32 smithi137 ceph-mon[31694]: pgmap v1146: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:27:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:34 smithi007 ceph-mon[27906]: pgmap v1147: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:27:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:34 smithi186 ceph-mon[31814]: pgmap v1147: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:27:34.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:34 smithi137 ceph-mon[31694]: pgmap v1147: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:27:36.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:36 smithi007 ceph-mon[27906]: pgmap v1148: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:27:36.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:36 smithi186 ceph-mon[31814]: pgmap v1148: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:27:36.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:36 smithi137 ceph-mon[31694]: pgmap v1148: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 -- 172.21.15.7:0/3795619345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981063a0 msgr2=0x7f0f98106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/3795619345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981063a0 0x7f0f98106830 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009ca0 tx=0x7f0f9002a9e0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 -- 172.21.15.7:0/3795619345 shutdown_connections 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/3795619345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981063a0 0x7f0f98106830 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/3795619345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f981019a0 0x7f0f98105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/3795619345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 0x7f0f98101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 -- 172.21.15.7:0/3795619345 >> 172.21.15.7:0/3795619345 conn(0x7f0f98078080 msgr2=0x7f0f98078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 -- 172.21.15.7:0/3795619345 shutdown_connections 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.146+0000 7f0f9ee00640 1 -- 172.21.15.7:0/3795619345 wait complete. 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.147+0000 7f0f9ee00640 1 Processor -- start 2024-04-23T15:27:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 -- start start 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 0x7f0f9819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 0x7f0f9819f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f981063a0 0x7f0f981a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981188d0 con 0x7f0f981019a0 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f98118750 con 0x7f0f98101080 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f9ee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f98118a50 con 0x7f0f981063a0 2024-04-23T15:27:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.148+0000 7f0f97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 0x7f0f9819f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 0x7f0f9819f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43008/0 (socket says 172.21.15.7:43008) 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 -- 172.21.15.7:0/2235878624 learned_addr learned my addr 172.21.15.7:0/2235878624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97e00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 0x7f0f9819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f9ce00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f981063a0 0x7f0f981a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 -- 172.21.15.7:0/2235878624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f981063a0 msgr2=0x7f0f981a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f981063a0 0x7f0f981a3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 -- 172.21.15.7:0/2235878624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 msgr2=0x7f0f9819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 0x7f0f9819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97400640 1 -- 172.21.15.7:0/2235878624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f981a3d80 con 0x7f0f981019a0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.149+0000 7f0f97e00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 0x7f0f9819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.150+0000 7f0f97400640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 0x7f0f9819f2d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400e9f0 tx=0x7f0f8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.150+0000 7f0f94c00640 1 -- 172.21.15.7:0/2235878624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400cd80 con 0x7f0f981019a0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.150+0000 7f0f94c00640 1 -- 172.21.15.7:0/2235878624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f840054d0 con 0x7f0f981019a0 2024-04-23T15:27:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.150+0000 7f0f94c00640 1 -- 172.21.15.7:0/2235878624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84010490 con 0x7f0f981019a0 2024-04-23T15:27:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.150+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f981a4070 con 0x7f0f981019a0 2024-04-23T15:27:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.150+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f981ab900 con 0x7f0f981019a0 2024-04-23T15:27:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.156+0000 7f0f94c00640 1 -- 172.21.15.7:0/2235878624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0f84005020 con 0x7f0f981019a0 2024-04-23T15:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.157+0000 7f0f94c00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f7c0a3e40 0x7f0f7c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.157+0000 7f0f94c00640 1 -- 172.21.15.7:0/2235878624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7f0f840d0ff0 con 0x7f0f981019a0 2024-04-23T15:27:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.158+0000 7f0f97e00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f7c0a3e40 0x7f0f7c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.158+0000 7f0f97e00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f7c0a3e40 0x7f0f7c0a6300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009c20 tx=0x7f0f88005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.197+0000 7f0fa1b98740 1 Processor -- start 2024-04-23T15:27:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 -- start start 2024-04-23T15:27:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f50590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6eb6900 con 0x55d5c6f501b0 2024-04-23T15:27:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6e5cf20 con 0x55d5c6f50ad0 2024-04-23T15:27:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.198+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6eb28c0 con 0x55d5c6f5b390 2024-04-23T15:27:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f50590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f50590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43014/0 (socket says 172.21.15.7:43014) 2024-04-23T15:27:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 -- 172.21.15.7:0/1904522747 learned_addr learned my addr 172.21.15.7:0/1904522747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f9ce00640 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97400640 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 -- 172.21.15.7:0/1904522747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 msgr2=0x55d5c6f5d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 -- 172.21.15.7:0/1904522747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f50ad0 msgr2=0x55d5c6f5ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.199+0000 7f0f97e00640 1 -- 172.21.15.7:0/1904522747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5c6e81e10 con 0x55d5c6f501b0 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.200+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f50590 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f0f88004160 tx=0x7f0f88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7720fe5c51dc1c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.200+0000 7f0f8d600640 1 -- 172.21.15.7:0/1904522747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88003e30 con 0x55d5c6f501b0 2024-04-23T15:27:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.200+0000 7f0f8d600640 1 -- 172.21.15.7:0/1904522747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f88025070 con 0x55d5c6f501b0 2024-04-23T15:27:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.200+0000 7f0f8d600640 1 -- 172.21.15.7:0/1904522747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88020720 con 0x55d5c6f501b0 2024-04-23T15:27:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1904522747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 msgr2=0x55d5c6f50590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f50590 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f0f88004160 tx=0x7f0f88014000 comp rx=0 tx=0).stop 2024-04-23T15:27:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1904522747 shutdown_connections 2024-04-23T15:27:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1904522747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f50590 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.201+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1904522747 >> 172.21.15.7:0/1904522747 conn(0x55d5c6f4c6c0 msgr2=0x55d5c6f4caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.202+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1904522747 shutdown_connections 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.202+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1904522747 wait complete. 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.202+0000 7f0fa1b98740 1 -- start start 2024-04-23T15:27:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.202+0000 7f0fa1b98740 1 Processor -- start 2024-04-23T15:27:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.203+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f58250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.203+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f58790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.203+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f58cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.203+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6f5dfc0 con 0x55d5c6f501b0 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6e702c0 con 0x55d5c6f5b390 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6f5e140 con 0x55d5c6f50ad0 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f58250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0fa1b98740 10 client.0 _ll_register_callbacks cb 0x55d5c6bc8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f58250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43030/0 (socket says 172.21.15.7:43030) 2024-04-23T15:27:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 -- 172.21.15.7:0/1160983182 learned_addr learned my addr 172.21.15.7:0/1160983182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97400640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f58790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f9ce00640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f58cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 -- 172.21.15.7:0/1160983182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f50ad0 msgr2=0x55d5c6f58790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f58790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 -- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 msgr2=0x55d5c6f58cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f58cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f97e00640 1 -- 172.21.15.7:0/1160983182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5c6e80fd0 con 0x55d5c6f501b0 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.204+0000 7f0f9ce00640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f58cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:27:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.205+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f58250 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009350 tx=0x7f0f88012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8446c0fcf137935c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.205+0000 7f0f82000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.205+0000 7f0f82000640 1 -- 172.21.15.7:0/1160983182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880129e0 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.205+0000 7f0f82000640 1 -- 172.21.15.7:0/1160983182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7f0f88005050 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.205+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f88025070 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0f82000640 1 -- 172.21.15.7:0/1160983182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0f8803e050 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 10 client.18585 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d5c6bc9210 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0f82000640 1 -- 172.21.15.7:0/1160983182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f88025070 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0f82000640 1 -- 172.21.15.7:0/1160983182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0f880204a0 con 0x55d5c6f501b0 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 10 client.18585 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 10 client.18585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 20 client.18585 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6f6b350 0x55d5c6f6d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 4 client.18585 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:27:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.206+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5c6ec4320 con 0x55d5c6f6b350 2024-04-23T15:27:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.207+0000 7f0f97400640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6f6b350 0x55d5c6f6d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.208+0000 7f0f82000640 10 client.18585 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.208+0000 7f0f97400640 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6f6b350 0x55d5c6f6d740 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44959d0262c2c3e server_cookie=765ee85248532103 in_seq=0 out_seq=0 2024-04-23T15:27:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0f82000640 1 -- 172.21.15.7:0/1160983182 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d5c6ec4320 con 0x55d5c6f6b350 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0f82000640 10 client.18585 handle_command_reply: tid=0 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 client.18585 shutdown 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 msgr2=0x55d5c6f58250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f58250 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009350 tx=0x7f0f88012f30 comp rx=0 tx=0).stop 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 shutdown_connections 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6f6b350 0x55d5c6f6d740 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f58cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f58790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1160983182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f501b0 0x55d5c6f58250 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 >> 172.21.15.7:0/1160983182 conn(0x55d5c6f4c6c0 msgr2=0x55d5c6f52440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0f82000640 0 client.18585 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.210+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 shutdown_connections 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.211+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1160983182 wait complete. 2024-04-23T15:27:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.211+0000 7f0fa1b98740 20 client.18585 trim_cache size 0 max 16384 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.242+0000 7f0fa1b98740 1 Processor -- start 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 -- start start 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f501b0 0x55d5c6f52270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f72ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f73410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981b59f0 con 0x55d5c6f50ad0 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981b7530 con 0x55d5c6f501b0 2024-04-23T15:27:37.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.243+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981b60c0 con 0x55d5c6f5b390 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f72ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f72ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43040/0 (socket says 172.21.15.7:43040) 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 -- 172.21.15.7:0/3741070450 learned_addr learned my addr 172.21.15.7:0/3741070450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97e00640 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f501b0 0x55d5c6f52270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f9ce00640 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f73410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 -- 172.21.15.7:0/3741070450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 msgr2=0x55d5c6f73410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f73410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 -- 172.21.15.7:0/3741070450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f501b0 msgr2=0x55d5c6f52270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f501b0 0x55d5c6f52270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.244+0000 7f0f97400640 1 -- 172.21.15.7:0/3741070450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5c6c95620 con 0x55d5c6f50ad0 2024-04-23T15:27:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.245+0000 7f0f97400640 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f72ed0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0f8409cb30 tx=0x7f0f84009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823e68d915b3aade server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.245+0000 7f0f8cc00640 1 -- 172.21.15.7:0/3741070450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8409d2a0 con 0x55d5c6f50ad0 2024-04-23T15:27:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.245+0000 7f0f8cc00640 1 -- 172.21.15.7:0/3741070450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f840b5070 con 0x55d5c6f50ad0 2024-04-23T15:27:37.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.245+0000 7f0f8cc00640 1 -- 172.21.15.7:0/3741070450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84016d90 con 0x55d5c6f50ad0 2024-04-23T15:27:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.246+0000 7f0fa1b98740 1 -- 172.21.15.7:0/3741070450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 msgr2=0x55d5c6f72ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.246+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f72ed0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0f8409cb30 tx=0x7f0f84009310 comp rx=0 tx=0).stop 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 -- 172.21.15.7:0/3741070450 shutdown_connections 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f5b390 0x55d5c6f73410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f72ed0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/3741070450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f501b0 0x55d5c6f52270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 -- 172.21.15.7:0/3741070450 >> 172.21.15.7:0/3741070450 conn(0x55d5c6f4c6c0 msgr2=0x55d5c6f51b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 -- 172.21.15.7:0/3741070450 shutdown_connections 2024-04-23T15:27:37.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.247+0000 7f0fa1b98740 1 -- 172.21.15.7:0/3741070450 wait complete. 2024-04-23T15:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.248+0000 7f0fa1b98740 1 -- start start 2024-04-23T15:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.248+0000 7f0fa1b98740 1 Processor -- start 2024-04-23T15:27:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 0x55d5c6f5eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981b6e60 con 0x55d5c6f50ad0 2024-04-23T15:27:37.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981b6790 con 0x55d5c6f5b390 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f981b39f0 con 0x55d5c6f501b0 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.249+0000 7f0fa1b98740 10 client.0 _ll_register_callbacks cb 0x7f0f88004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.250+0000 7f0f97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.250+0000 7f0f97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 0x55d5c6f5eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.250+0000 7f0f9ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.250+0000 7f0f97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 0x55d5c6f5eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:47492/0 (socket says 172.21.15.7:47492) 2024-04-23T15:27:37.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.250+0000 7f0f97e00640 1 -- 172.21.15.7:0/1463994081 learned_addr learned my addr 172.21.15.7:0/1463994081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.251+0000 7f0f97400640 1 -- 172.21.15.7:0/1463994081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 msgr2=0x55d5c6f5eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.251+0000 7f0f97400640 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 0x55d5c6f5eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.251+0000 7f0f97400640 1 -- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 msgr2=0x55d5c6f5f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.251+0000 7f0f97400640 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.251+0000 7f0f97400640 1 -- 172.21.15.7:0/1463994081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5c6fd0870 con 0x55d5c6f50ad0 2024-04-23T15:27:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.251+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 0x55d5c6f5eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0f97400640 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5f420 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0f840a1110 tx=0x7f0f840b61e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bd51b8298e7491 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0f82000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0f82000640 1 -- 172.21.15.7:0/1463994081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f840a0f50 con 0x55d5c6f50ad0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0f82000640 1 -- 172.21.15.7:0/1463994081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7f0f840bd0c0 con 0x55d5c6f50ad0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f840b5070 con 0x55d5c6f50ad0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0f82000640 1 -- 172.21.15.7:0/1463994081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0f840a5810 con 0x55d5c6f50ad0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0fa1b98740 10 client.18591 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.252+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d5c6fd1b60 con 0x55d5c6f50ad0 2024-04-23T15:27:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0f82000640 1 -- 172.21.15.7:0/1463994081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f840b5070 con 0x55d5c6f50ad0 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0f82000640 1 -- 172.21.15.7:0/1463994081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0f840a5380 con 0x55d5c6f50ad0 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0fa1b98740 10 client.18591 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0fa1b98740 10 client.18591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0fa1b98740 20 client.18591 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6fd2170 0x55d5c6fd4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0fa1b98740 4 client.18591 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.253+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d5c6ebe190 con 0x55d5c6fd2170 2024-04-23T15:27:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.254+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6fd2170 0x55d5c6fd4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.255+0000 7f0f97e00640 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6fd2170 0x55d5c6fd4590 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=905cdba93f419b1f server_cookie=28c015d492b2ba06 in_seq=0 out_seq=0 2024-04-23T15:27:37.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.255+0000 7f0f82000640 10 client.18591 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.290+0000 7f0f82000640 1 -- 172.21.15.7:0/1463994081 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d5c6ebe190 con 0x55d5c6fd2170 2024-04-23T15:27:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.290+0000 7f0f82000640 10 client.18591 handle_command_reply: tid=0 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.290+0000 7f0fa1b98740 1 client.18591 shutdown 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.290+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 msgr2=0x55d5c6f5f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.290+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5f420 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0f840a1110 tx=0x7f0f840b61e0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 shutdown_connections 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d5c6fd2170 0x55d5c6fd4590 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d5c6f5b390 0x55d5c6f5f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5c6f50ad0 0x55d5c6f5f420 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0f82000640 0 client.18591 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 --2- 172.21.15.7:0/1463994081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d5c6f501b0 0x55d5c6f5eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 >> 172.21.15.7:0/1463994081 conn(0x55d5c6f4c6c0 msgr2=0x55d5c6f58a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 shutdown_connections 2024-04-23T15:27:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 1 -- 172.21.15.7:0/1463994081 wait complete. 2024-04-23T15:27:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.291+0000 7f0fa1b98740 20 client.18591 trim_cache size 0 max 16384 2024-04-23T15:27:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:27:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:27:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:27:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:27:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f7c0a3e40 msgr2=0x7f0f7c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f7c0a3e40 0x7f0f7c0a6300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009c20 tx=0x7f0f88005f90 comp rx=0 tx=0).stop 2024-04-23T15:27:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 msgr2=0x7f0f9819f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 0x7f0f9819f2d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400e9f0 tx=0x7f0f8400edf0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 shutdown_connections 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f0f7c0a3e40 0x7f0f7c0a6300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f981063a0 0x7f0f981a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f981019a0 0x7f0f9819f2d0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 --2- 172.21.15.7:0/2235878624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f98101080 0x7f0f9819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.292+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 >> 172.21.15.7:0/2235878624 conn(0x7f0f98078080 msgr2=0x7f0f98103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.293+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 shutdown_connections 2024-04-23T15:27:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:37.293+0000 7f0f9ee00640 1 -- 172.21.15.7:0/2235878624 wait complete. 2024-04-23T15:27:38.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:38 smithi007 ceph-mon[27906]: pgmap v1149: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:38 smithi186 ceph-mon[31814]: pgmap v1149: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:38.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:38 smithi137 ceph-mon[31694]: pgmap v1149: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:40 smithi007 ceph-mon[27906]: pgmap v1150: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:27:40.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:40 smithi186 ceph-mon[31814]: pgmap v1150: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:27:40.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:40 smithi137 ceph-mon[31694]: pgmap v1150: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:27:42.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:42 smithi007 ceph-mon[27906]: pgmap v1151: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:42.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:42 smithi186 ceph-mon[31814]: pgmap v1151: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:42.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:42 smithi137 ceph-mon[31694]: pgmap v1151: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:44.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:44 smithi007 ceph-mon[27906]: pgmap v1152: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:27:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:44 smithi186 ceph-mon[31814]: pgmap v1152: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:27:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:44 smithi137 ceph-mon[31694]: pgmap v1152: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:27:46.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:46 smithi007 ceph-mon[27906]: pgmap v1153: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:27:46.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:46 smithi186 ceph-mon[31814]: pgmap v1153: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:27:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:46 smithi137 ceph-mon[31694]: pgmap v1153: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:27:48.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:48 smithi007 ceph-mon[27906]: pgmap v1154: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:27:48.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:48 smithi186 ceph-mon[31814]: pgmap v1154: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:27:48.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:48 smithi137 ceph-mon[31694]: pgmap v1154: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:27:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 -- 172.21.15.7:0/4231403991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c1019a0 msgr2=0x7fdd0c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 --2- 172.21.15.7:0/4231403991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c1019a0 0x7fdd0c105e60 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009930 tx=0x7fdcf802a4d0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 -- 172.21.15.7:0/4231403991 shutdown_connections 2024-04-23T15:27:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 --2- 172.21.15.7:0/4231403991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd0c106480 0x7fdd0c106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 --2- 172.21.15.7:0/4231403991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c1019a0 0x7fdd0c105e60 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 --2- 172.21.15.7:0/4231403991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c101080 0x7fdd0c101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 -- 172.21.15.7:0/4231403991 >> 172.21.15.7:0/4231403991 conn(0x7fdd0c078010 msgr2=0x7fdd0c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 -- 172.21.15.7:0/4231403991 shutdown_connections 2024-04-23T15:27:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.506+0000 7fdd13200640 1 -- 172.21.15.7:0/4231403991 wait complete. 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.507+0000 7fdd13200640 1 Processor -- start 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.507+0000 7fdd13200640 1 -- start start 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd13200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 0x7fdd0c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd13200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd0c1019a0 0x7fdd0c19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd13200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c106480 0x7fdd0c1a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd13200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c118910 con 0x7fdd0c101080 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd13200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c118790 con 0x7fdd0c106480 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd13200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c118a90 con 0x7fdd0c1019a0 2024-04-23T15:27:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 0x7fdd0c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 0x7fdd0c19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58208/0 (socket says 172.21.15.7:58208) 2024-04-23T15:27:50.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.508+0000 7fdd0be00640 1 -- 172.21.15.7:0/1958638019 learned_addr learned my addr 172.21.15.7:0/1958638019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:50.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd11200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c106480 0x7fdd0c1a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0b400640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd0c1019a0 0x7fdd0c19f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0be00640 1 -- 172.21.15.7:0/1958638019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd0c1019a0 msgr2=0x7fdd0c19f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd0c1019a0 0x7fdd0c19f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0be00640 1 -- 172.21.15.7:0/1958638019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c106480 msgr2=0x7fdd0c1a36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c106480 0x7fdd0c1a36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0be00640 1 -- 172.21.15.7:0/1958638019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0c1a3de0 con 0x7fdd0c101080 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd11200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c106480 0x7fdd0c1a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:27:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.509+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 0x7fdd0c19edf0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00e9f0 tx=0x7fdcfc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.513+0000 7fdd08c00640 1 -- 172.21.15.7:0/1958638019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00cd80 con 0x7fdd0c101080 2024-04-23T15:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.513+0000 7fdd08c00640 1 -- 172.21.15.7:0/1958638019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdcfc0108e0 con 0x7fdd0c101080 2024-04-23T15:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.513+0000 7fdd08c00640 1 -- 172.21.15.7:0/1958638019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc018920 con 0x7fdd0c101080 2024-04-23T15:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.513+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0c1a40d0 con 0x7fdd0c101080 2024-04-23T15:27:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.513+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd0c1ab960 con 0x7fdd0c101080 2024-04-23T15:27:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.516+0000 7fdd08c00640 1 -- 172.21.15.7:0/1958638019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdcfc010a90 con 0x7fdd0c101080 2024-04-23T15:27:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.519+0000 7fdd08c00640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdcf00a3e40 0x7fdcf00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.519+0000 7fdd08c00640 1 -- 172.21.15.7:0/1958638019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7fdcfc0d0fa0 con 0x7fdd0c101080 2024-04-23T15:27:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.519+0000 7fdd0b400640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdcf00a3e40 0x7fdcf00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.520+0000 7fdd0b400640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdcf00a3e40 0x7fdcf00a6300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8006010 tx=0x7fdcf8000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:50.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 Processor -- start 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 -- start start 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cad9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f80ca3f900 con 0x55f80cae4390 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f80c9e5f20 con 0x55f80cad91b0 2024-04-23T15:27:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.521+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f80ca3b8c0 con 0x55f80cad9ad0 2024-04-23T15:27:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58218/0 (socket says 172.21.15.7:58218) 2024-04-23T15:27:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 -- 172.21.15.7:0/3292705097 learned_addr learned my addr 172.21.15.7:0/3292705097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd0b400640 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd0be00640 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cad9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 -- 172.21.15.7:0/3292705097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 msgr2=0x55f80cae3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 -- 172.21.15.7:0/3292705097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 msgr2=0x55f80cad9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cad9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.522+0000 7fdd11200640 1 -- 172.21.15.7:0/3292705097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80ca0ae10 con 0x55f80cae4390 2024-04-23T15:27:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.523+0000 7fdd11200640 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae6780 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009f30 tx=0x7fdd04010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd69fa59fbcd8aa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.523+0000 7fdd01600640 1 -- 172.21.15.7:0/3292705097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04016070 con 0x55f80cae4390 2024-04-23T15:27:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.523+0000 7fdd01600640 1 -- 172.21.15.7:0/3292705097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd0401bb10 con 0x55f80cae4390 2024-04-23T15:27:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.523+0000 7fdd01600640 1 -- 172.21.15.7:0/3292705097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04012b40 con 0x55f80cae4390 2024-04-23T15:27:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3292705097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 msgr2=0x55f80cae6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae6780 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009f30 tx=0x7fdd04010740 comp rx=0 tx=0).stop 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3292705097 shutdown_connections 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae6780 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3292705097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cad9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3292705097 >> 172.21.15.7:0/3292705097 conn(0x55f80cad56c0 msgr2=0x55f80cad5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3292705097 shutdown_connections 2024-04-23T15:27:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.524+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3292705097 wait complete. 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.525+0000 7fdd15fe3740 1 -- start start 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.525+0000 7fdd15fe3740 1 Processor -- start 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cae1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f80cae6fc0 con 0x55f80cae4390 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f80c9f92c0 con 0x55f80cad91b0 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f80cae7140 con 0x55f80cad9ad0 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd15fe3740 10 client.0 _ll_register_callbacks cb 0x55f80c751a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cae1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cae1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:52118/0 (socket says 172.21.15.7:52118) 2024-04-23T15:27:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd0be00640 1 -- 172.21.15.7:0/811390851 learned_addr learned my addr 172.21.15.7:0/811390851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.526+0000 7fdd0b400640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.527+0000 7fdd0be00640 1 -- 172.21.15.7:0/811390851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 msgr2=0x55f80cae1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.527+0000 7fdd0be00640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.527+0000 7fdd0be00640 1 -- 172.21.15.7:0/811390851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 msgr2=0x55f80cae1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.527+0000 7fdd0be00640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.527+0000 7fdd0be00640 1 -- 172.21.15.7:0/811390851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80ca09fd0 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.527+0000 7fdd11200640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.528+0000 7fdd0be00640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cae1330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc09cac0 tx=0x7fdcfc09d2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc51a71b5820c285 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.528+0000 7fdcf6000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.528+0000 7fdcf6000640 1 -- 172.21.15.7:0/811390851 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc09de60 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.528+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd0401bb10 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.528+0000 7fdcf6000640 1 -- 172.21.15.7:0/811390851 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7fdcfc0ce560 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdcf6000640 1 -- 172.21.15.7:0/811390851 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdcfc0a57a0 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdd15fe3740 10 client.37496 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f80c752210 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdcf6000640 1 -- 172.21.15.7:0/811390851 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd0401bb10 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdcf6000640 1 -- 172.21.15.7:0/811390851 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdcfc098880 con 0x55f80cad91b0 2024-04-23T15:27:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdd15fe3740 10 client.37496 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.529+0000 7fdd15fe3740 10 client.37496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.530+0000 7fdd15fe3740 20 client.37496 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.530+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80caf4540 0x55f80caf6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.530+0000 7fdd15fe3740 4 client.37496 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.530+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f80ca4d320 con 0x55f80caf4540 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.530+0000 7fdd0b400640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80caf4540 0x55f80caf6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.531+0000 7fdd0b400640 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80caf4540 0x55f80caf6930 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce49c014de9fa929 server_cookie=7aba14753243d099 in_seq=0 out_seq=0 2024-04-23T15:27:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.531+0000 7fdcf6000640 10 client.37496 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdcf6000640 1 -- 172.21.15.7:0/811390851 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f80ca4d320 con 0x55f80caf4540 2024-04-23T15:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdcf6000640 10 client.37496 handle_command_reply: tid=0 2024-04-23T15:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdd15fe3740 1 client.37496 shutdown 2024-04-23T15:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 msgr2=0x55f80cae1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cae1330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc09cac0 tx=0x7fdcfc09d2f0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 shutdown_connections 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.533+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80caf4540 0x55f80caf6930 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/811390851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80cae1330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdcf6000640 0 client.37496 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 >> 172.21.15.7:0/811390851 conn(0x55f80cad56c0 msgr2=0x55f80cadb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 shutdown_connections 2024-04-23T15:27:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 1 -- 172.21.15.7:0/811390851 wait complete. 2024-04-23T15:27:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.534+0000 7fdd15fe3740 20 client.37496 trim_cache size 0 max 16384 2024-04-23T15:27:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.553+0000 7fdd15fe3740 1 Processor -- start 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 -- start start 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caefe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 0x55f80cadbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cae4390 0x55f80cafc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b5a50 con 0x55f80cad9ad0 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b7590 con 0x55f80cad91b0 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b6120 con 0x55f80cae4390 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 0x55f80cadbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 0x55f80cadbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58238/0 (socket says 172.21.15.7:58238) 2024-04-23T15:27:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.554+0000 7fdd0b400640 1 -- 172.21.15.7:0/3378180784 learned_addr learned my addr 172.21.15.7:0/3378180784 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd11200640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cae4390 0x55f80cafc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0be00640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caefe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0b400640 1 -- 172.21.15.7:0/3378180784 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cae4390 msgr2=0x55f80cafc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0b400640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cae4390 0x55f80cafc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0b400640 1 -- 172.21.15.7:0/3378180784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 msgr2=0x55f80caefe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0b400640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caefe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0b400640 1 -- 172.21.15.7:0/3378180784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80cad9900 con 0x55f80cad9ad0 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd11200640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cae4390 0x55f80cafc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0be00640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caefe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd0b400640 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 0x55f80cadbb70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fdcf802aac0 tx=0x7fdcf803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43a30e5bfda487c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd00c00640 1 -- 172.21.15.7:0/3378180784 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8035050 con 0x55f80cad9ad0 2024-04-23T15:27:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.555+0000 7fdd00c00640 1 -- 172.21.15.7:0/3378180784 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdcf8058070 con 0x55f80cad9ad0 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd00c00640 1 -- 172.21.15.7:0/3378180784 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8004b20 con 0x55f80cad9ad0 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3378180784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 msgr2=0x55f80cadbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 0x55f80cadbb70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fdcf802aac0 tx=0x7fdcf803f000 comp rx=0 tx=0).stop 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3378180784 shutdown_connections 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cae4390 0x55f80cafc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cad9ad0 0x55f80cadbb70 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/3378180784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caefe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3378180784 >> 172.21.15.7:0/3378180784 conn(0x55f80cad56c0 msgr2=0x55f80cae33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.556+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3378180784 shutdown_connections 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.557+0000 7fdd15fe3740 1 -- 172.21.15.7:0/3378180784 wait complete. 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.557+0000 7fdd15fe3740 1 -- start start 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.557+0000 7fdd15fe3740 1 Processor -- start 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b6ec0 con 0x55f80cae4390 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b67f0 con 0x55f80cad91b0 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b3a50 con 0x55f80cad9ad0 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd15fe3740 10 client.0 _ll_register_callbacks cb 0x7fdcfc010de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58240/0 (socket says 172.21.15.7:58240) 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 -- 172.21.15.7:0/1465759324 learned_addr learned my addr 172.21.15.7:0/1465759324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd0b400640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 -- 172.21.15.7:0/1465759324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 msgr2=0x55f80cae7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 -- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 msgr2=0x55f80caec6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:27:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caec6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.558+0000 7fdd11200640 1 -- 172.21.15.7:0/1465759324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80c81e620 con 0x55f80cae4390 2024-04-23T15:27:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.559+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:27:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.559+0000 7fdd11200640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae7f90 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x55f80cad6850 tx=0x7fdd04009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a517b65edda038 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:27:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.559+0000 7fdcf6000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:27:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.559+0000 7fdcf6000640 1 -- 172.21.15.7:0/1465759324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04016040 con 0x55f80cae4390 2024-04-23T15:27:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.559+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf8058070 con 0x55f80cae4390 2024-04-23T15:27:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.559+0000 7fdcf6000640 1 -- 172.21.15.7:0/1465759324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 9467+0+0 (secure 0 0 0) 0x7fdd04012750 con 0x55f80cae4390 2024-04-23T15:27:50.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdcf6000640 1 -- 172.21.15.7:0/1465759324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd04032050 con 0x55f80cae4390 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 10 client.18609 fetch_fsmap learned FSMap version 32 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f80cb5a800 con 0x55f80cae4390 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdcf6000640 1 -- 172.21.15.7:0/1465759324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdcf8058070 con 0x55f80cae4390 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdcf6000640 1 -- 172.21.15.7:0/1465759324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdd0400f040 con 0x55f80cae4390 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 10 client.18609 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 10 client.18609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 20 client.18609 populate_metadata read hostname 'smithi007' 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80cb5ac10 0x55f80cb5d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.560+0000 7fdd15fe3740 4 client.18609 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.561+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f80ca47190 con 0x55f80cb5ac10 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.561+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80cb5ac10 0x55f80cb5d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:27:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.562+0000 7fdcf6000640 10 client.18609 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.562+0000 7fdd0be00640 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80cb5ac10 0x55f80cb5d030 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01e6e84bb5d25c4 server_cookie=8bffa4d1c93f3434 in_seq=0 out_seq=0 2024-04-23T15:27:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdcf6000640 1 -- 172.21.15.7:0/1465759324 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f80ca47190 con 0x55f80cb5ac10 2024-04-23T15:27:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdcf6000640 10 client.18609 handle_command_reply: tid=0 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 client.18609 shutdown 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 msgr2=0x55f80cae7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae7f90 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x55f80cad6850 tx=0x7fdd04009510 comp rx=0 tx=0).stop 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 shutdown_connections 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f80cb5ac10 0x55f80cb5d030 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f80cae4390 0x55f80cae7f90 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f80cad9ad0 0x55f80cae7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 --2- 172.21.15.7:0/1465759324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f80cad91b0 0x55f80caec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 >> 172.21.15.7:0/1465759324 conn(0x55f80cad56c0 msgr2=0x55f80cae12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdcf6000640 0 client.18609 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.594+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 shutdown_connections 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.595+0000 7fdd15fe3740 1 -- 172.21.15.7:0/1465759324 wait complete. 2024-04-23T15:27:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.595+0000 7fdd15fe3740 20 client.18609 trim_cache size 0 max 16384 2024-04-23T15:27:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:27:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:27:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:27:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.595+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdcf00a3e40 msgr2=0x7fdcf00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.595+0000 7fdd13200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdcf00a3e40 0x7fdcf00a6300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8006010 tx=0x7fdcf8000bc0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.595+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 msgr2=0x7fdd0c19edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.595+0000 7fdd13200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 0x7fdd0c19edf0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00e9f0 tx=0x7fdcfc00eeb0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 shutdown_connections 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdcf00a3e40 0x7fdcf00a6300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0c106480 0x7fdd0c1a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd0c1019a0 0x7fdd0c19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 --2- 172.21.15.7:0/1958638019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0c101080 0x7fdd0c19edf0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:27:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 >> 172.21.15.7:0/1958638019 conn(0x7fdd0c078010 msgr2=0x7fdd0c103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:27:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 shutdown_connections 2024-04-23T15:27:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:27:50.596+0000 7fdd13200640 1 -- 172.21.15.7:0/1958638019 wait complete. 2024-04-23T15:27:50.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:50 smithi007 ceph-mon[27906]: pgmap v1155: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:27:50.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:50 smithi186 ceph-mon[31814]: pgmap v1155: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:27:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:50 smithi137 ceph-mon[31694]: pgmap v1155: 129 pgs: 129 active+clean; 9.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:27:52.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:52 smithi007 ceph-mon[27906]: pgmap v1156: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:27:52.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:52 smithi186 ceph-mon[31814]: pgmap v1156: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:27:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:52 smithi137 ceph-mon[31694]: pgmap v1156: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:27:54.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:54 smithi007 ceph-mon[27906]: pgmap v1157: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:54.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:54 smithi186 ceph-mon[31814]: pgmap v1157: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:54.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:54 smithi137 ceph-mon[31694]: pgmap v1157: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:56.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:56 smithi007 ceph-mon[27906]: pgmap v1158: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:56.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:56 smithi186 ceph-mon[31814]: pgmap v1158: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:56.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:56 smithi137 ceph-mon[31694]: pgmap v1158: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:27:58.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:27:58 smithi007 ceph-mon[27906]: pgmap v1159: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:58.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:27:58 smithi186 ceph-mon[31814]: pgmap v1159: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:27:58.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:27:58 smithi137 ceph-mon[31694]: pgmap v1159: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:28:00.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:00 smithi007 ceph-mon[27906]: pgmap v1160: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:28:00.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:00 smithi186 ceph-mon[31814]: pgmap v1160: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:28:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:00 smithi137 ceph-mon[31694]: pgmap v1160: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:28:01.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:01 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:28:01.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:01 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:28:01.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:01 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:28:02.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:02 smithi007 ceph-mon[27906]: pgmap v1161: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.9 MiB/s wr, 35 op/s 2024-04-23T15:28:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:02 smithi186 ceph-mon[31814]: pgmap v1161: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.9 MiB/s wr, 35 op/s 2024-04-23T15:28:02.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:02 smithi137 ceph-mon[31694]: pgmap v1161: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.9 MiB/s wr, 35 op/s 2024-04-23T15:28:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 -- 172.21.15.7:0/3624820676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24102090 msgr2=0x7fdd24102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 --2- 172.21.15.7:0/3624820676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24102090 0x7fdd24102470 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009900 tx=0x7fdd1402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 -- 172.21.15.7:0/3624820676 shutdown_connections 2024-04-23T15:28:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 --2- 172.21.15.7:0/3624820676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd24102a40 0x7fdd24106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 --2- 172.21.15.7:0/3624820676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd24107160 0x7fdd2410ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 --2- 172.21.15.7:0/3624820676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24102090 0x7fdd24102470 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 -- 172.21.15.7:0/3624820676 >> 172.21.15.7:0/3624820676 conn(0x7fdd240fd950 msgr2=0x7fdd240ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 -- 172.21.15.7:0/3624820676 shutdown_connections 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.796+0000 7fdd23e00640 1 -- 172.21.15.7:0/3624820676 wait complete. 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.797+0000 7fdd23e00640 1 Processor -- start 2024-04-23T15:28:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 -- start start 2024-04-23T15:28:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd24102090 0x7fdd24198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 0x7fdd24198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2419cf10 0x7fdd2419d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24112170 con 0x7fdd24107160 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24111ff0 con 0x7fdd24102090 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd23e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241122f0 con 0x7fdd2419cf10 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 0x7fdd24198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.798+0000 7fdd22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 0x7fdd24198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37306/0 (socket says 172.21.15.7:37306) 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22000640 1 -- 172.21.15.7:0/1023361009 learned_addr learned my addr 172.21.15.7:0/1023361009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd23400640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2419cf10 0x7fdd2419d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22a00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd24102090 0x7fdd24198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22000640 1 -- 172.21.15.7:0/1023361009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2419cf10 msgr2=0x7fdd2419d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22000640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2419cf10 0x7fdd2419d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22000640 1 -- 172.21.15.7:0/1023361009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd24102090 msgr2=0x7fdd24198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22000640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd24102090 0x7fdd24198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.799+0000 7fdd22000640 1 -- 172.21.15.7:0/1023361009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2419da00 con 0x7fdd24107160 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.800+0000 7fdd22000640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 0x7fdd24198b90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c970 tx=0x7fdd1000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.800+0000 7fdd1b400640 1 -- 172.21.15.7:0/1023361009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10014070 con 0x7fdd24107160 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.800+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2419dcf0 con 0x7fdd24107160 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.800+0000 7fdd1b400640 1 -- 172.21.15.7:0/1023361009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd10004440 con 0x7fdd24107160 2024-04-23T15:28:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.800+0000 7fdd1b400640 1 -- 172.21.15.7:0/1023361009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10003e50 con 0x7fdd24107160 2024-04-23T15:28:03.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.800+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd241a5530 con 0x7fdd24107160 2024-04-23T15:28:03.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.805+0000 7fdd2c41b740 1 Processor -- start 2024-04-23T15:28:03.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.805+0000 7fdd2c41b740 1 -- start start 2024-04-23T15:28:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd1b400640 1 -- 172.21.15.7:0/1023361009 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdd10017070 con 0x7fdd24107160 2024-04-23T15:28:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 0x564344e546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54c20 0x564344e63470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e65da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564344dba900 con 0x564344e54300 2024-04-23T15:28:03.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564344d60f20 con 0x564344e54c20 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564344db68c0 con 0x564344e639b0 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 0x564344e546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 0x564344e546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37320/0 (socket says 172.21.15.7:37320) 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.806+0000 7fdd23400640 1 -- 172.21.15.7:0/1967943782 learned_addr learned my addr 172.21.15.7:0/1967943782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd22a00640 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54c20 0x564344e63470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd23400640 1 -- 172.21.15.7:0/1967943782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 msgr2=0x564344e65da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd23400640 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e65da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd23400640 1 -- 172.21.15.7:0/1967943782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54c20 msgr2=0x564344e63470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd23400640 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54c20 0x564344e63470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd23400640 1 -- 172.21.15.7:0/1967943782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564344d85e10 con 0x564344e54300 2024-04-23T15:28:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.807+0000 7fdd23400640 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 0x564344e546e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00a430 tx=0x7fdd1c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce915c1d982b1d67 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.808+0000 7fdd1b400640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd080a3eb0 0x7fdd080a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.808+0000 7fdd0f400640 1 -- 172.21.15.7:0/1967943782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c013790 con 0x564344e54300 2024-04-23T15:28:03.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.808+0000 7fdd0f400640 1 -- 172.21.15.7:0/1967943782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd1c019070 con 0x564344e54300 2024-04-23T15:28:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.808+0000 7fdd0f400640 1 -- 172.21.15.7:0/1967943782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c014d50 con 0x564344e54300 2024-04-23T15:28:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.808+0000 7fdd1b400640 1 -- 172.21.15.7:0/1023361009 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 9555+0+0 (secure 0 0 0) 0x7fdd100d0740 con 0x7fdd24107160 2024-04-23T15:28:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.808+0000 7fdd22a00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd080a3eb0 0x7fdd080a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1967943782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 msgr2=0x564344e546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 0x564344e546e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00a430 tx=0x7fdd1c009650 comp rx=0 tx=0).stop 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1967943782 shutdown_connections 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54c20 0x564344e63470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e65da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1967943782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54300 0x564344e546e0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1967943782 >> 172.21.15.7:0/1967943782 conn(0x564344e508d0 msgr2=0x564344e50cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.809+0000 7fdd22a00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd080a3eb0 0x7fdd080a6370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd14005ab0 tx=0x7fdd14005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.810+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1967943782 shutdown_connections 2024-04-23T15:28:03.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.810+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1967943782 wait complete. 2024-04-23T15:28:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.810+0000 7fdd2c41b740 1 -- start start 2024-04-23T15:28:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 Processor -- start 2024-04-23T15:28:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e60a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 0x564344e60f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564344e66580 con 0x564344e54c20 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564344d742c0 con 0x564344e54300 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564344e66700 con 0x564344e639b0 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.811+0000 7fdd2c41b740 10 client.0 _ll_register_callbacks cb 0x564344acca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 0x564344e60f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 0x564344e60f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37332/0 (socket says 172.21.15.7:37332) 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 -- 172.21.15.7:0/2561961454 learned_addr learned my addr 172.21.15.7:0/2561961454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:03.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22a00640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e60a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd23400640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 -- 172.21.15.7:0/2561961454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 msgr2=0x564344e614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 -- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 msgr2=0x564344e60a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e60a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.812+0000 7fdd22000640 1 -- 172.21.15.7:0/2561961454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564344d84fd0 con 0x564344e54c20 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd22000640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 0x564344e60f80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fdd1009c200 tx=0x7fdd1009bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8051fa7b8ae1e95e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd03e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd03e00640 1 -- 172.21.15.7:0/2561961454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd100cf070 con 0x564344e54c20 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd03e00640 1 -- 172.21.15.7:0/2561961454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 9555+0+0 (secure 0 0 0) 0x7fdd100b56c0 con 0x564344e54c20 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd1c019070 con 0x564344e54c20 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd03e00640 1 -- 172.21.15.7:0/2561961454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd100cdea0 con 0x564344e54c20 2024-04-23T15:28:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd2c41b740 10 client.18621 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.813+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564344acd210 con 0x564344e54c20 2024-04-23T15:28:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.814+0000 7fdd03e00640 1 -- 172.21.15.7:0/2561961454 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd1c019070 con 0x564344e54c20 2024-04-23T15:28:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd03e00640 1 -- 172.21.15.7:0/2561961454 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdd100b5250 con 0x564344e54c20 2024-04-23T15:28:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd2c41b740 10 client.18621 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd2c41b740 10 client.18621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd2c41b740 20 client.18621 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344e73c10 0x564344e76000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd2c41b740 4 client.18621 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564344dc8320 con 0x564344e73c10 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.815+0000 7fdd22a00640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344e73c10 0x564344e76000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.816+0000 7fdd22a00640 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344e73c10 0x564344e76000 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65cf29a07030da92 server_cookie=8c7d74b34efdf20a in_seq=0 out_seq=0 2024-04-23T15:28:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.816+0000 7fdd03e00640 10 client.18621 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:03.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.818+0000 7fdd03e00640 1 -- 172.21.15.7:0/2561961454 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564344dc8320 con 0x564344e73c10 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.818+0000 7fdd03e00640 10 client.18621 handle_command_reply: tid=0 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.818+0000 7fdd2c41b740 1 client.18621 shutdown 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.818+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 msgr2=0x564344e60f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.818+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 0x564344e60f80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fdd1009c200 tx=0x7fdd1009bc90 comp rx=0 tx=0).stop 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 shutdown_connections 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344e73c10 0x564344e76000 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e639b0 0x564344e614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e54c20 0x564344e60f80 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2561961454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e60a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd03e00640 0 client.18621 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 >> 172.21.15.7:0/2561961454 conn(0x564344e508d0 msgr2=0x564344e56650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 shutdown_connections 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2561961454 wait complete. 2024-04-23T15:28:03.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.819+0000 7fdd2c41b740 20 client.18621 trim_cache size 0 max 16384 2024-04-23T15:28:03.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:03 smithi007 ceph-mon[27906]: osdmap e153: 12 total, 12 up, 12 in 2024-04-23T15:28:03.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:03 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:28:03.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:03 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:28:03.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:03 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:28:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 Processor -- start 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 -- start start 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e7b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ad1b0 con 0x564344e639b0 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241aecf0 con 0x564344e54300 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ad880 con 0x564344e54c20 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e7b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.837+0000 7fdd23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e7b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37334/0 (socket says 172.21.15.7:37334) 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 -- 172.21.15.7:0/1265441807 learned_addr learned my addr 172.21.15.7:0/1265441807 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd22a00640 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd22000640 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 -- 172.21.15.7:0/1265441807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 msgr2=0x564344e612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 -- 172.21.15.7:0/1265441807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 msgr2=0x564344e6f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 -- 172.21.15.7:0/1265441807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564344b99620 con 0x564344e639b0 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.838+0000 7fdd23400640 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e7b820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00a430 tx=0x7fdd1c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980710a58f91e7d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.839+0000 7fdd0ea00640 1 -- 172.21.15.7:0/1265441807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c014620 con 0x564344e639b0 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.839+0000 7fdd0ea00640 1 -- 172.21.15.7:0/1265441807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd1c019040 con 0x564344e639b0 2024-04-23T15:28:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.839+0000 7fdd0ea00640 1 -- 172.21.15.7:0/1265441807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c013cc0 con 0x564344e639b0 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1265441807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 msgr2=0x564344e7b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e7b820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00a430 tx=0x7fdd1c009c90 comp rx=0 tx=0).stop 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1265441807 shutdown_connections 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e7b820 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/1265441807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1265441807 >> 172.21.15.7:0/1265441807 conn(0x564344e508d0 msgr2=0x564344e55da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1265441807 shutdown_connections 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 -- 172.21.15.7:0/1265441807 wait complete. 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 -- start start 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.840+0000 7fdd2c41b740 1 Processor -- start 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ae620 con 0x564344e639b0 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241adf50 con 0x564344e54300 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ab1b0 con 0x564344e54c20 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd2c41b740 10 client.0 _ll_register_callbacks cb 0x7fdd10007f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd23400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e677e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37348/0 (socket says 172.21.15.7:37348) 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.841+0000 7fdd23400640 1 -- 172.21.15.7:0/2068499683 learned_addr learned my addr 172.21.15.7:0/2068499683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd22000640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd22a00640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd23400640 1 -- 172.21.15.7:0/2068499683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 msgr2=0x564344e671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd23400640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd23400640 1 -- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 msgr2=0x564344e6be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd23400640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd23400640 1 -- 172.21.15.7:0/2068499683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564344e67fe0 con 0x564344e639b0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd23400640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e677e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0094c0 tx=0x7fdd1c013840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af49dd6d77cff3a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd03e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.842+0000 7fdd03e00640 1 -- 172.21.15.7:0/2068499683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c013e40 con 0x564344e639b0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd03e00640 1 -- 172.21.15.7:0/2068499683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 9555+0+0 (secure 0 0 0) 0x7fdd1c014420 con 0x564344e639b0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd1c019040 con 0x564344e639b0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd03e00640 1 -- 172.21.15.7:0/2068499683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd1c03c050 con 0x564344e639b0 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd2c41b740 10 client.18627 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564344eda1a0 con 0x564344e639b0 2024-04-23T15:28:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd03e00640 1 -- 172.21.15.7:0/2068499683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd1c019040 con 0x564344e639b0 2024-04-23T15:28:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.843+0000 7fdd03e00640 1 -- 172.21.15.7:0/2068499683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdd1c029830 con 0x564344e639b0 2024-04-23T15:28:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd2c41b740 10 client.18627 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd2c41b740 10 client.18627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd2c41b740 20 client.18627 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344eda5c0 0x564344edc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd2c41b740 4 client.18627 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564344dc2190 con 0x564344eda5c0 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.844+0000 7fdd22a00640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344eda5c0 0x564344edc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.845+0000 7fdd22a00640 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344eda5c0 0x564344edc9b0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d06460b39a99841 server_cookie=19bb93bbecd24464 in_seq=0 out_seq=0 2024-04-23T15:28:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.845+0000 7fdd03e00640 10 client.18627 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:03.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:03 smithi186 ceph-mon[31814]: osdmap e153: 12 total, 12 up, 12 in 2024-04-23T15:28:03.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:03 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:28:03.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:03 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:28:03.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:03 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:28:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd03e00640 1 -- 172.21.15.7:0/2068499683 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564344dc2190 con 0x564344eda5c0 2024-04-23T15:28:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd03e00640 10 client.18627 handle_command_reply: tid=0 2024-04-23T15:28:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd2c41b740 1 client.18627 shutdown 2024-04-23T15:28:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 msgr2=0x564344e677e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e677e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0094c0 tx=0x7fdd1c013840 comp rx=0 tx=0).stop 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 shutdown_connections 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.883+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564344eda5c0 0x564344edc9b0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564344e639b0 0x564344e677e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564344e54c20 0x564344e671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 1 --2- 172.21.15.7:0/2068499683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564344e54300 0x564344e6be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 >> 172.21.15.7:0/2068499683 conn(0x564344e508d0 msgr2=0x564344e56630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd03e00640 0 client.18627 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 shutdown_connections 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 1 -- 172.21.15.7:0/2068499683 wait complete. 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.884+0000 7fdd2c41b740 20 client.18627 trim_cache size 0 max 16384 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:28:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd080a3eb0 msgr2=0x7fdd080a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd080a3eb0 0x7fdd080a6370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd14005ab0 tx=0x7fdd14005a20 comp rx=0 tx=0).stop 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 msgr2=0x7fdd24198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 0x7fdd24198b90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c970 tx=0x7fdd1000ce30 comp rx=0 tx=0).stop 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 shutdown_connections 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd080a3eb0 0x7fdd080a6370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2419cf10 0x7fdd2419d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd24107160 0x7fdd24198b90 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 --2- 172.21.15.7:0/1023361009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd24102090 0x7fdd24198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 >> 172.21.15.7:0/1023361009 conn(0x7fdd240fd950 msgr2=0x7fdd240ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 shutdown_connections 2024-04-23T15:28:03.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:03.885+0000 7fdd23e00640 1 -- 172.21.15.7:0/1023361009 wait complete. 2024-04-23T15:28:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:03 smithi137 ceph-mon[31694]: osdmap e153: 12 total, 12 up, 12 in 2024-04-23T15:28:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:03 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:28:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:03 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:28:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:03 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:28:04.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:04 smithi007 ceph-mon[27906]: pgmap v1163: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-04-23T15:28:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:04 smithi186 ceph-mon[31814]: pgmap v1163: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-04-23T15:28:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:04 smithi137 ceph-mon[31694]: pgmap v1163: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-04-23T15:28:06.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:06 smithi007 ceph-mon[27906]: pgmap v1164: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-04-23T15:28:06.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:06 smithi186 ceph-mon[31814]: pgmap v1164: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-04-23T15:28:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:06 smithi137 ceph-mon[31694]: pgmap v1164: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 33 op/s 2024-04-23T15:28:08.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:08 smithi186 ceph-mon[31814]: pgmap v1165: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:28:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:08 smithi137 ceph-mon[31694]: pgmap v1165: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:28:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:08 smithi007 ceph-mon[27906]: pgmap v1165: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:28:10.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:10 smithi186 ceph-mon[31814]: pgmap v1166: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:28:10.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:10 smithi137 ceph-mon[31694]: pgmap v1166: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:28:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:10 smithi007 ceph-mon[27906]: pgmap v1166: 129 pgs: 129 active+clean; 9.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:28:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:12 smithi007 ceph-mon[27906]: osdmap e154: 12 total, 12 up, 12 in 2024-04-23T15:28:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:12 smithi186 ceph-mon[31814]: osdmap e154: 12 total, 12 up, 12 in 2024-04-23T15:28:12.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:12 smithi137 ceph-mon[31694]: osdmap e154: 12 total, 12 up, 12 in 2024-04-23T15:28:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:13 smithi007 ceph-mon[27906]: pgmap v1168: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 18 op/s 2024-04-23T15:28:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:13 smithi186 ceph-mon[31814]: pgmap v1168: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 18 op/s 2024-04-23T15:28:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:13 smithi137 ceph-mon[31694]: pgmap v1168: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 18 op/s 2024-04-23T15:28:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:14 smithi186 ceph-mon[31814]: pgmap v1169: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:28:14.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:14 smithi137 ceph-mon[31694]: pgmap v1169: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:28:14.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:14 smithi007 ceph-mon[27906]: pgmap v1169: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:28:16.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:16 smithi007 ceph-mon[27906]: pgmap v1170: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:28:16.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:16 smithi186 ceph-mon[31814]: pgmap v1170: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:28:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:16 smithi137 ceph-mon[31694]: pgmap v1170: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:28:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 -- 172.21.15.7:0/1036801423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa994100ba0 msgr2=0x7fa994100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 --2- 172.21.15.7:0/1036801423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa994100ba0 0x7fa994100f80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fa984009900 tx=0x7fa98402a410 comp rx=0 tx=0).stop 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 -- 172.21.15.7:0/1036801423 shutdown_connections 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 --2- 172.21.15.7:0/1036801423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994101550 0x7fa99410e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 --2- 172.21.15.7:0/1036801423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99410e750 0x7fa994110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 --2- 172.21.15.7:0/1036801423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa994100ba0 0x7fa994100f80 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 -- 172.21.15.7:0/1036801423 >> 172.21.15.7:0/1036801423 conn(0x7fa9940fc820 msgr2=0x7fa9940fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 -- 172.21.15.7:0/1036801423 shutdown_connections 2024-04-23T15:28:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.055+0000 7fa993200640 1 -- 172.21.15.7:0/1036801423 wait complete. 2024-04-23T15:28:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.056+0000 7fa993200640 1 Processor -- start 2024-04-23T15:28:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.056+0000 7fa993200640 1 -- start start 2024-04-23T15:28:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa993200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994100ba0 0x7fa9941a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa993200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa994101550 0x7fa9941a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa993200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 0x7fa99419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa993200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941142f0 con 0x7fa99410e750 2024-04-23T15:28:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa993200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa994114170 con 0x7fa994100ba0 2024-04-23T15:28:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa993200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa994114470 con 0x7fa994101550 2024-04-23T15:28:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa992800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 0x7fa99419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa992800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 0x7fa99419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39946/0 (socket says 172.21.15.7:39946) 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa992800640 1 -- 172.21.15.7:0/3173413971 learned_addr learned my addr 172.21.15.7:0/3173413971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa991e00640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994100ba0 0x7fa9941a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.057+0000 7fa991400640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa994101550 0x7fa9941a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa992800640 1 -- 172.21.15.7:0/3173413971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa994101550 msgr2=0x7fa9941a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa992800640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa994101550 0x7fa9941a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa992800640 1 -- 172.21.15.7:0/3173413971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994100ba0 msgr2=0x7fa9941a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa992800640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994100ba0 0x7fa9941a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa992800640 1 -- 172.21.15.7:0/3173413971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99419af50 con 0x7fa99410e750 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa991e00640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994100ba0 0x7fa9941a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa992800640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 0x7fa99419a690 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00e9d0 tx=0x7fa98c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa98aa00640 1 -- 172.21.15.7:0/3173413971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00cd80 con 0x7fa99410e750 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa98aa00640 1 -- 172.21.15.7:0/3173413971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa98c005020 con 0x7fa99410e750 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa98aa00640 1 -- 172.21.15.7:0/3173413971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0116d0 con 0x7fa99410e750 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.058+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99419b240 con 0x7fa99410e750 2024-04-23T15:28:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.059+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9941a7550 con 0x7fa99410e750 2024-04-23T15:28:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.062+0000 7fa98aa00640 1 -- 172.21.15.7:0/3173413971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa98c0051d0 con 0x7fa99410e750 2024-04-23T15:28:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 Processor -- start 2024-04-23T15:28:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 -- start start 2024-04-23T15:28:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5110060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d5112990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a1d506b900 con 0x55a1d5105ce0 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a1d5011f20 con 0x55a1d51053c0 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.063+0000 7fa99bc76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a1d50678c0 con 0x55a1d51105a0 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39962/0 (socket says 172.21.15.7:39962) 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 -- 172.21.15.7:0/2252074366 learned_addr learned my addr 172.21.15.7:0/2252074366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991400640 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991400640 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d5112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 -- 172.21.15.7:0/2252074366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 msgr2=0x55a1d5112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d5112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 -- 172.21.15.7:0/2252074366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 msgr2=0x55a1d51057a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51057a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa98aa00640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9780a3d90 0x7fa9780a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991e00640 1 -- 172.21.15.7:0/2252074366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1d5036e10 con 0x55a1d5105ce0 2024-04-23T15:28:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa991400640 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d5112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.064+0000 7fa98aa00640 1 -- 172.21.15.7:0/3173413971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7fa98c0d10d0 con 0x7fa99410e750 2024-04-23T15:28:17.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.065+0000 7fa992800640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9780a3d90 0x7fa9780a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.065+0000 7fa991e00640 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5110060 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa984031440 tx=0x7fa984004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a2f935e6a365ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.065+0000 7fa97f400640 1 -- 172.21.15.7:0/2252074366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984035030 con 0x55a1d5105ce0 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.065+0000 7fa97f400640 1 -- 172.21.15.7:0/2252074366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9840046c0 con 0x55a1d5105ce0 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.065+0000 7fa97f400640 1 -- 172.21.15.7:0/2252074366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984005d50 con 0x55a1d5105ce0 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 -- 172.21.15.7:0/2252074366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 msgr2=0x55a1d5110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa992800640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9780a3d90 0x7fa9780a6250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0a53a0 tx=0x7fa98c00c7f0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5110060 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa984031440 tx=0x7fa984004390 comp rx=0 tx=0).stop 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 -- 172.21.15.7:0/2252074366 shutdown_connections 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d5112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5110060 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2252074366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 -- 172.21.15.7:0/2252074366 >> 172.21.15.7:0/2252074366 conn(0x55a1d51018d0 msgr2=0x55a1d5101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 -- 172.21.15.7:0/2252074366 shutdown_connections 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.066+0000 7fa99bc76740 1 -- 172.21.15.7:0/2252074366 wait complete. 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.067+0000 7fa99bc76740 1 -- start start 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.067+0000 7fa99bc76740 1 Processor -- start 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d510dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a1d5113020 con 0x55a1d51105a0 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a1d50252c0 con 0x55a1d51053c0 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a1d51131a0 con 0x55a1d5105ce0 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa99bc76740 10 client.0 _ll_register_callbacks cb 0x55a1d4d7da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa991400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa991400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39972/0 (socket says 172.21.15.7:39972) 2024-04-23T15:28:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa991400640 1 -- 172.21.15.7:0/2947532895 learned_addr learned my addr 172.21.15.7:0/2947532895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa991400640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.068+0000 7fa991e00640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d510dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa991400640 1 -- 172.21.15.7:0/2947532895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 msgr2=0x55a1d510dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa991400640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d510dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa991400640 1 -- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 msgr2=0x55a1d510d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa991400640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa991400640 1 -- 172.21.15.7:0/2947532895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1d5035fd0 con 0x55a1d51105a0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa973e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa991400640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510e020 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa980012d80 tx=0x7fa98000c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c144944df68df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa973e00640 1 -- 172.21.15.7:0/2947532895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98000fe00 con 0x55a1d51105a0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.069+0000 7fa973e00640 1 -- 172.21.15.7:0/2947532895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7fa980004030 con 0x55a1d51105a0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9840046c0 con 0x55a1d51105a0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa973e00640 1 -- 172.21.15.7:0/2947532895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa980027050 con 0x55a1d51105a0 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa99bc76740 10 client.18639 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a1d4d7e210 con 0x55a1d51105a0 2024-04-23T15:28:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa973e00640 1 -- 172.21.15.7:0/2947532895 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9840046c0 con 0x55a1d51105a0 2024-04-23T15:28:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa973e00640 1 -- 172.21.15.7:0/2947532895 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa980011440 con 0x55a1d51105a0 2024-04-23T15:28:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa99bc76740 10 client.18639 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.070+0000 7fa99bc76740 10 client.18639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.071+0000 7fa99bc76740 20 client.18639 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.071+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5120670 0x55a1d5122a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.071+0000 7fa99bc76740 4 client.18639 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.071+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1d5079320 con 0x55a1d5120670 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.071+0000 7fa991e00640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5120670 0x55a1d5122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.072+0000 7fa991e00640 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5120670 0x55a1d5122a80 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f12acc149cebf06 server_cookie=3673fc8197bdfd16 in_seq=0 out_seq=0 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.072+0000 7fa973e00640 10 client.18639 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa973e00640 1 -- 172.21.15.7:0/2947532895 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a1d5079320 con 0x55a1d5120670 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa973e00640 10 client.18639 handle_command_reply: tid=0 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 client.18639 shutdown 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 msgr2=0x55a1d510e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510e020 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa980012d80 tx=0x7fa98000c6f0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 shutdown_connections 2024-04-23T15:28:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5120670 0x55a1d5122a80 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510e020 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d510dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 --2- 172.21.15.7:0/2947532895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 >> 172.21.15.7:0/2947532895 conn(0x55a1d51018d0 msgr2=0x55a1d5107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.074+0000 7fa973e00640 0 client.18639 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.075+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 shutdown_connections 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.075+0000 7fa99bc76740 1 -- 172.21.15.7:0/2947532895 wait complete. 2024-04-23T15:28:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.075+0000 7fa99bc76740 20 client.18639 trim_cache size 0 max 16384 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 Processor -- start 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 -- start start 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d5101210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b14e0 con 0x55a1d51105a0 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b3020 con 0x55a1d51053c0 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.094+0000 7fa99bc76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b1bb0 con 0x55a1d5105ce0 2024-04-23T15:28:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39988/0 (socket says 172.21.15.7:39988) 2024-04-23T15:28:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 -- 172.21.15.7:0/3307378386 learned_addr learned my addr 172.21.15.7:0/3307378386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991e00640 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d5101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 -- 172.21.15.7:0/3307378386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 msgr2=0x55a1d5101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d5101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 -- 172.21.15.7:0/3307378386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 msgr2=0x55a1d510fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 -- 172.21.15.7:0/3307378386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1d5112d00 con 0x55a1d51105a0 2024-04-23T15:28:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.095+0000 7fa991400640 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510dc70 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa980012ae0 tx=0x7fa98000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5334d6ae1acf13 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.096+0000 7fa97ea00640 1 -- 172.21.15.7:0/3307378386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98000cc40 con 0x55a1d51105a0 2024-04-23T15:28:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.096+0000 7fa97ea00640 1 -- 172.21.15.7:0/3307378386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa980012b80 con 0x55a1d51105a0 2024-04-23T15:28:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.096+0000 7fa97ea00640 1 -- 172.21.15.7:0/3307378386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980011a30 con 0x55a1d51105a0 2024-04-23T15:28:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.096+0000 7fa99bc76740 1 -- 172.21.15.7:0/3307378386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 msgr2=0x55a1d510dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.096+0000 7fa99bc76740 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510dc70 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa980012ae0 tx=0x7fa98000cbd0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 -- 172.21.15.7:0/3307378386 shutdown_connections 2024-04-23T15:28:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d51105a0 0x55a1d510dc70 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d5105ce0 0x55a1d5101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 --2- 172.21.15.7:0/3307378386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d510fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 -- 172.21.15.7:0/3307378386 >> 172.21.15.7:0/3307378386 conn(0x55a1d51018d0 msgr2=0x55a1d510d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 -- 172.21.15.7:0/3307378386 shutdown_connections 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 -- 172.21.15.7:0/3307378386 wait complete. 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 -- start start 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.097+0000 7fa99bc76740 1 Processor -- start 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51185f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5118b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d51155c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b2950 con 0x55a1d5105ce0 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b2280 con 0x55a1d51053c0 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941af4e0 con 0x55a1d51105a0 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa99bc76740 10 client.0 _ll_register_callbacks cb 0x7fa98000ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa991e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5118b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa991e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5118b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39992/0 (socket says 172.21.15.7:39992) 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa991e00640 1 -- 172.21.15.7:0/1519565885 learned_addr learned my addr 172.21.15.7:0/1519565885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.098+0000 7fa991400640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991e00640 1 -- 172.21.15.7:0/1519565885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 msgr2=0x55a1d51155c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991e00640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d51155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991e00640 1 -- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 msgr2=0x55a1d51185f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991e00640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51185f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991e00640 1 -- 172.21.15.7:0/1519565885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1d4e4a620 con 0x55a1d5105ce0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991400640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51185f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa991e00640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5118b30 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa98402a930 tx=0x7fa984005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620c4fd0a46b012 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa973e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa973e00640 1 -- 172.21.15.7:0/1519565885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984057060 con 0x55a1d5105ce0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa973e00640 1 -- 172.21.15.7:0/1519565885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7fa984051580 con 0x55a1d5105ce0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.099+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa980012b80 con 0x55a1d5105ce0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa973e00640 1 -- 172.21.15.7:0/1519565885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa98405e050 con 0x55a1d5105ce0 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 10 client.18645 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a1d5187440 con 0x55a1d5105ce0 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa973e00640 1 -- 172.21.15.7:0/1519565885 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa980012b80 con 0x55a1d5105ce0 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa973e00640 1 -- 172.21.15.7:0/1519565885 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa984031ce0 con 0x55a1d5105ce0 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 10 client.18645 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 10 client.18645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 20 client.18645 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5187840 0x55a1d5189c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 4 client.18645 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.100+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1d5073190 con 0x55a1d5187840 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.101+0000 7fa991400640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5187840 0x55a1d5189c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.102+0000 7fa991400640 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5187840 0x55a1d5189c50 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa2938fb6826e43 server_cookie=706759586099d8a0 in_seq=0 out_seq=0 2024-04-23T15:28:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.102+0000 7fa973e00640 10 client.18645 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.131+0000 7fa973e00640 1 -- 172.21.15.7:0/1519565885 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1d5073190 con 0x55a1d5187840 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.131+0000 7fa973e00640 10 client.18645 handle_command_reply: tid=0 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.131+0000 7fa99bc76740 1 client.18645 shutdown 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 msgr2=0x55a1d5118b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5118b30 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa98402a930 tx=0x7fa984005de0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 shutdown_connections 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55a1d5187840 0x55a1d5189c50 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a1d51105a0 0x55a1d51155c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1d5105ce0 0x55a1d5118b30 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 --2- 172.21.15.7:0/1519565885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1d51053c0 0x55a1d51185f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa973e00640 0 client.18645 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 >> 172.21.15.7:0/1519565885 conn(0x55a1d51018d0 msgr2=0x55a1d510ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 shutdown_connections 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 1 -- 172.21.15.7:0/1519565885 wait complete. 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.132+0000 7fa99bc76740 20 client.18645 trim_cache size 0 max 16384 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:28:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:28:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:28:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9780a3d90 msgr2=0x7fa9780a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9780a3d90 0x7fa9780a6250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0a53a0 tx=0x7fa98c00c7f0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 msgr2=0x7fa99419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 0x7fa99419a690 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00e9d0 tx=0x7fa98c00ee90 comp rx=0 tx=0).stop 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 shutdown_connections 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9780a3d90 0x7fa9780a6250 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa99410e750 0x7fa99419a690 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa994101550 0x7fa9941a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 --2- 172.21.15.7:0/3173413971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa994100ba0 0x7fa9941a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.133+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 >> 172.21.15.7:0/3173413971 conn(0x7fa9940fc820 msgr2=0x7fa9940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.134+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 shutdown_connections 2024-04-23T15:28:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:17.134+0000 7fa993200640 1 -- 172.21.15.7:0/3173413971 wait complete. 2024-04-23T15:28:18.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:18 smithi007 ceph-mon[27906]: pgmap v1171: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:28:18.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:18 smithi186 ceph-mon[31814]: pgmap v1171: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:28:18.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:18 smithi137 ceph-mon[31694]: pgmap v1171: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:28:20.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:20 smithi007 ceph-mon[27906]: pgmap v1172: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:28:20.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:20 smithi186 ceph-mon[31814]: pgmap v1172: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:28:20.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:20 smithi137 ceph-mon[31694]: pgmap v1172: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:28:22.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:22 smithi007 ceph-mon[27906]: pgmap v1173: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 22 op/s 2024-04-23T15:28:22.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:22 smithi186 ceph-mon[31814]: pgmap v1173: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 22 op/s 2024-04-23T15:28:22.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:22 smithi137 ceph-mon[31694]: pgmap v1173: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 22 op/s 2024-04-23T15:28:24.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:24 smithi007 ceph-mon[27906]: pgmap v1174: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:28:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:24 smithi186 ceph-mon[31814]: pgmap v1174: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:28:24.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:24 smithi137 ceph-mon[31694]: pgmap v1174: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:28:26.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:26 smithi007 ceph-mon[27906]: pgmap v1175: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:28:26.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:26 smithi186 ceph-mon[31814]: pgmap v1175: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:28:26.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:26 smithi137 ceph-mon[31694]: pgmap v1175: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:28:28.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:28 smithi007 ceph-mon[27906]: pgmap v1176: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:28:28.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:28 smithi186 ceph-mon[31814]: pgmap v1176: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:28:28.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:28 smithi137 ceph-mon[31694]: pgmap v1176: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 -- 172.21.15.7:0/2675573539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 msgr2=0x7f3e10110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 --2- 172.21.15.7:0/2675573539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e10110f40 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009ca0 tx=0x7f3e0802a8c0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 -- 172.21.15.7:0/2675573539 shutdown_connections 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 --2- 172.21.15.7:0/2675573539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e10110f40 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 --2- 172.21.15.7:0/2675573539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e10104c50 0x7f3e10108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 --2- 172.21.15.7:0/2675573539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 0x7f3e10104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 -- 172.21.15.7:0/2675573539 >> 172.21.15.7:0/2675573539 conn(0x7f3e100ffae0 msgr2=0x7f3e10101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 -- 172.21.15.7:0/2675573539 shutdown_connections 2024-04-23T15:28:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.315+0000 7f3e16c00640 1 -- 172.21.15.7:0/2675573539 wait complete. 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 Processor -- start 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 -- start start 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 0x7f3e101a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e101a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e1019a690 0x7f3e1019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10114330 con 0x7f3e10109370 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101141b0 con 0x7f3e101042a0 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.317+0000 7f3e16c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101144b0 con 0x7f3e1019a690 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e101a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e101a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43684/0 (socket says 172.21.15.7:43684) 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 -- 172.21.15.7:0/1510460638 learned_addr learned my addr 172.21.15.7:0/1510460638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e16200640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e1019a690 0x7f3e1019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e15800640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 0x7f3e101a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 -- 172.21.15.7:0/1510460638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e1019a690 msgr2=0x7f3e1019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e1019a690 0x7f3e1019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 -- 172.21.15.7:0/1510460638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 msgr2=0x7f3e101a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 0x7f3e101a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 -- 172.21.15.7:0/1510460638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1019b290 con 0x7f3e10109370 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e15800640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 0x7f3e101a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e16200640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e1019a690 0x7f3e1019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.318+0000 7f3e14e00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e101a0ac0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00d740 tx=0x7f3dfc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.319+0000 7f3e0e000640 1 -- 172.21.15.7:0/1510460638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc017070 con 0x7f3e10109370 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.319+0000 7f3e0e000640 1 -- 172.21.15.7:0/1510460638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3dfc00de50 con 0x7f3e10109370 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.319+0000 7f3e0e000640 1 -- 172.21.15.7:0/1510460638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc004d60 con 0x7f3e10109370 2024-04-23T15:28:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.319+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101a7320 con 0x7f3e10109370 2024-04-23T15:28:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.319+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101a7720 con 0x7f3e10109370 2024-04-23T15:28:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.323+0000 7f3e1b052740 1 Processor -- start 2024-04-23T15:28:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 -- start start 2024-04-23T15:28:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed46007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed460b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed460d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560ed4566900 con 0x560ed460b5a0 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560ed450cf20 con 0x560ed46003c0 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.324+0000 7f3e1b052740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560ed45628c0 con 0x560ed4600ce0 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e0e000640 1 -- 172.21.15.7:0/1510460638 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3dfc004f00 con 0x7f3e10109370 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e16200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed46007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e16200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed46007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:39650/0 (socket says 172.21.15.7:39650) 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e16200640 1 -- 172.21.15.7:0/1497369147 learned_addr learned my addr 172.21.15.7:0/1497369147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e15800640 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed460b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e14e00640 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed460d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e15800640 1 -- 172.21.15.7:0/1497369147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 msgr2=0x560ed46007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e15800640 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed46007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e15800640 1 -- 172.21.15.7:0/1497369147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 msgr2=0x560ed460d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e15800640 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed460d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.325+0000 7f3e15800640 1 -- 172.21.15.7:0/1497369147 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed4531e10 con 0x560ed4600ce0 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.326+0000 7f3e15800640 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed460b060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009b90 tx=0x7f3e0400e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8dded0b007c9be server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.326+0000 7f3e02a00640 1 -- 172.21.15.7:0/1497369147 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04016070 con 0x560ed4600ce0 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.327+0000 7f3e0e000640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3df80a3d90 0x7f3df80a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.327+0000 7f3e02a00640 1 -- 172.21.15.7:0/1497369147 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e040054d0 con 0x560ed4600ce0 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.327+0000 7f3e02a00640 1 -- 172.21.15.7:0/1497369147 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04011470 con 0x560ed4600ce0 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.327+0000 7f3e0e000640 1 -- 172.21.15.7:0/1510460638 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7f3dfc0d0550 con 0x7f3e10109370 2024-04-23T15:28:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.327+0000 7f3e16200640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3df80a3d90 0x7f3df80a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 -- 172.21.15.7:0/1497369147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 msgr2=0x560ed460b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed460b060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009b90 tx=0x7f3e0400e6c0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 -- 172.21.15.7:0/1497369147 shutdown_connections 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed460d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed460b060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 --2- 172.21.15.7:0/1497369147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed46007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 -- 172.21.15.7:0/1497369147 >> 172.21.15.7:0/1497369147 conn(0x560ed45fc8d0 msgr2=0x560ed45fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 -- 172.21.15.7:0/1497369147 shutdown_connections 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e16200640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3df80a3d90 0x7f3df80a6250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e0802ade0 tx=0x7f3e08004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 -- 172.21.15.7:0/1497369147 wait complete. 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.328+0000 7f3e1b052740 1 -- start start 2024-04-23T15:28:30.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 Processor -- start 2024-04-23T15:28:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed46003c0 0x560ed4608580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 0x560ed4608ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed460b5a0 0x560ed4609000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560ed460e140 con 0x560ed4600ce0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560ed45202c0 con 0x560ed460b5a0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560ed460e2c0 con 0x560ed46003c0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.329+0000 7f3e1b052740 10 client.0 _ll_register_callbacks cb 0x560ed4278a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 0x560ed4608ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 0x560ed4608ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43706/0 (socket says 172.21.15.7:43706) 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 -- 172.21.15.7:0/2545546725 learned_addr learned my addr 172.21.15.7:0/2545546725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e15800640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed46003c0 0x560ed4608580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e16200640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed460b5a0 0x560ed4609000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 -- 172.21.15.7:0/2545546725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed46003c0 msgr2=0x560ed4608580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed46003c0 0x560ed4608580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 -- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed460b5a0 msgr2=0x560ed4609000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed460b5a0 0x560ed4609000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e14e00640 1 -- 172.21.15.7:0/2545546725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed4530fd0 con 0x560ed4600ce0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e16200640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed460b5a0 0x560ed4609000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.330+0000 7f3e15800640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed46003c0 0x560ed4608580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3e14e00640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 0x560ed4608ac0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc09c070 tx=0x7f3dfc09bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3143bcafea1bea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3df7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3df7400640 1 -- 172.21.15.7:0/2545546725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc020040 con 0x560ed4600ce0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3df7400640 1 -- 172.21.15.7:0/2545546725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7f3dfc0d0120 con 0x560ed4600ce0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e040054d0 con 0x560ed4600ce0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3df7400640 1 -- 172.21.15.7:0/2545546725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3dfc0cdd10 con 0x560ed4600ce0 2024-04-23T15:28:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3e1b052740 10 client.18657 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560ed4279210 con 0x560ed4600ce0 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.331+0000 7f3df7400640 1 -- 172.21.15.7:0/2545546725 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e040054d0 con 0x560ed4600ce0 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3df7400640 1 -- 172.21.15.7:0/2545546725 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3dfc097e30 con 0x560ed4600ce0 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3e1b052740 10 client.18657 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3e1b052740 10 client.18657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3e1b052740 20 client.18657 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3e1b052740 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed4623fd0 0x560ed46263c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3e1b052740 4 client.18657 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.332+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ed4574320 con 0x560ed4623fd0 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.333+0000 7f3e15800640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed4623fd0 0x560ed46263c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.333+0000 7f3e15800640 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed4623fd0 0x560ed46263c0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35a208566b1b66d1 server_cookie=cc9fb0ac5d94b9bf in_seq=0 out_seq=0 2024-04-23T15:28:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.333+0000 7f3df7400640 10 client.18657 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.335+0000 7f3df7400640 1 -- 172.21.15.7:0/2545546725 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560ed4574320 con 0x560ed4623fd0 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.335+0000 7f3df7400640 10 client.18657 handle_command_reply: tid=0 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.335+0000 7f3e1b052740 1 client.18657 shutdown 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 msgr2=0x560ed4608ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 0x560ed4608ac0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc09c070 tx=0x7f3dfc09bc20 comp rx=0 tx=0).stop 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 shutdown_connections 2024-04-23T15:28:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed4623fd0 0x560ed46263c0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed460b5a0 0x560ed4609000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed4600ce0 0x560ed4608ac0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 --2- 172.21.15.7:0/2545546725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed46003c0 0x560ed4608580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 >> 172.21.15.7:0/2545546725 conn(0x560ed45fc8d0 msgr2=0x560ed45fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3df7400640 0 client.18657 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 shutdown_connections 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 1 -- 172.21.15.7:0/2545546725 wait complete. 2024-04-23T15:28:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.336+0000 7f3e1b052740 20 client.18657 trim_cache size 0 max 16384 2024-04-23T15:28:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.360+0000 7f3e1b052740 1 Processor -- start 2024-04-23T15:28:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 -- start start 2024-04-23T15:28:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed462bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed462c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4625fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101ad060 con 0x560ed460b5a0 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101aeba0 con 0x560ed46003c0 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.361+0000 7f3e1b052740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101ad730 con 0x560ed4600ce0 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e15800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed462bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4625fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e14e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed462c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e15800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed462bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:39664/0 (socket says 172.21.15.7:39664) 2024-04-23T15:28:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e15800640 1 -- 172.21.15.7:0/4283109105 learned_addr learned my addr 172.21.15.7:0/4283109105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e16200640 1 -- 172.21.15.7:0/4283109105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 msgr2=0x560ed462c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e16200640 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed462c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e16200640 1 -- 172.21.15.7:0/4283109105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 msgr2=0x560ed462bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e16200640 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed462bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.362+0000 7f3e16200640 1 -- 172.21.15.7:0/4283109105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed4600b10 con 0x560ed460b5a0 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.363+0000 7f3e16200640 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4625fe0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f3e08006010 tx=0x7f3e08040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f786ac2f79b782 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.363+0000 7f3e02000640 1 -- 172.21.15.7:0/4283109105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08003dc0 con 0x560ed460b5a0 2024-04-23T15:28:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.363+0000 7f3e02000640 1 -- 172.21.15.7:0/4283109105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e08036050 con 0x560ed460b5a0 2024-04-23T15:28:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.363+0000 7f3e02000640 1 -- 172.21.15.7:0/4283109105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080308a0 con 0x560ed460b5a0 2024-04-23T15:28:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 -- 172.21.15.7:0/4283109105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 msgr2=0x560ed4625fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4625fe0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f3e08006010 tx=0x7f3e08040000 comp rx=0 tx=0).stop 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 -- 172.21.15.7:0/4283109105 shutdown_connections 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4625fe0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed462c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 --2- 172.21.15.7:0/4283109105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed462bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 -- 172.21.15.7:0/4283109105 >> 172.21.15.7:0/4283109105 conn(0x560ed45fc8d0 msgr2=0x560ed45fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 -- 172.21.15.7:0/4283109105 shutdown_connections 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.364+0000 7f3e1b052740 1 -- 172.21.15.7:0/4283109105 wait complete. 2024-04-23T15:28:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.365+0000 7f3e1b052740 1 -- start start 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.365+0000 7f3e1b052740 1 Processor -- start 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed461c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed4617550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4617a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101ae4d0 con 0x560ed460b5a0 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101ade00 con 0x560ed46003c0 2024-04-23T15:28:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101ab060 con 0x560ed4600ce0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e1b052740 10 client.0 _ll_register_callbacks cb 0x7f3dfc098410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4617a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e16200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4617a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43712/0 (socket says 172.21.15.7:43712) 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e16200640 1 -- 172.21.15.7:0/553157684 learned_addr learned my addr 172.21.15.7:0/553157684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.366+0000 7f3e14e00640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed4617550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e15800640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed461c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e16200640 1 -- 172.21.15.7:0/553157684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 msgr2=0x560ed4617550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e16200640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed4617550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e16200640 1 -- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 msgr2=0x560ed461c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e16200640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed461c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e16200640 1 -- 172.21.15.7:0/553157684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed4345620 con 0x560ed460b5a0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e16200640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4617a90 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f3e08042040 tx=0x7f3e08004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f027fc19e4f1db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3df7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3df7400640 1 -- 172.21.15.7:0/553157684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08056070 con 0x560ed460b5a0 2024-04-23T15:28:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3df7400640 1 -- 172.21.15.7:0/553157684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7f3e080045f0 con 0x560ed460b5a0 2024-04-23T15:28:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.367+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e08036050 con 0x560ed460b5a0 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3df7400640 1 -- 172.21.15.7:0/553157684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e08031ad0 con 0x560ed460b5a0 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3e1b052740 10 client.18663 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560ed468a250 con 0x560ed460b5a0 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3df7400640 1 -- 172.21.15.7:0/553157684 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e08036050 con 0x560ed460b5a0 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3df7400640 1 -- 172.21.15.7:0/553157684 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3e080524f0 con 0x560ed460b5a0 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3e1b052740 10 client.18663 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3e1b052740 10 client.18663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.368+0000 7f3e1b052740 20 client.18663 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.369+0000 7f3e1b052740 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed468a980 0x560ed468cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.369+0000 7f3e1b052740 4 client.18663 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.369+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ed456e190 con 0x560ed468a980 2024-04-23T15:28:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.369+0000 7f3e15800640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed468a980 0x560ed468cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.371+0000 7f3e15800640 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed468a980 0x560ed468cda0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317c5871ef349d03 server_cookie=75646cfc52ce7726 in_seq=0 out_seq=0 2024-04-23T15:28:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.371+0000 7f3df7400640 10 client.18663 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3df7400640 1 -- 172.21.15.7:0/553157684 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ed456e190 con 0x560ed468a980 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3df7400640 10 client.18663 handle_command_reply: tid=0 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 client.18663 shutdown 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 msgr2=0x560ed4617a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4617a90 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f3e08042040 tx=0x7f3e08004500 comp rx=0 tx=0).stop 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 shutdown_connections 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560ed468a980 0x560ed468cda0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560ed460b5a0 0x560ed4617a90 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560ed4600ce0 0x560ed4617550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 --2- 172.21.15.7:0/553157684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ed46003c0 0x560ed461c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 >> 172.21.15.7:0/553157684 conn(0x560ed45fc8d0 msgr2=0x560ed4606a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3df7400640 0 client.18663 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 shutdown_connections 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.402+0000 7f3e1b052740 1 -- 172.21.15.7:0/553157684 wait complete. 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.403+0000 7f3e1b052740 20 client.18663 trim_cache size 0 max 16384 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:28:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:28:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.403+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3df80a3d90 msgr2=0x7f3df80a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.403+0000 7f3e16c00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3df80a3d90 0x7f3df80a6250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e0802ade0 tx=0x7f3e08004a40 comp rx=0 tx=0).stop 2024-04-23T15:28:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.403+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 msgr2=0x7f3e101a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.403+0000 7f3e16c00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e101a0ac0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00d740 tx=0x7f3dfc00dc00 comp rx=0 tx=0).stop 2024-04-23T15:28:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 shutdown_connections 2024-04-23T15:28:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3df80a3d90 0x7f3df80a6250 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e1019a690 0x7f3e1019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e10109370 0x7f3e101a0ac0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 --2- 172.21.15.7:0/1510460638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e101042a0 0x7f3e101a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 >> 172.21.15.7:0/1510460638 conn(0x7f3e100ffae0 msgr2=0x7f3e10101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 shutdown_connections 2024-04-23T15:28:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:30.404+0000 7f3e16c00640 1 -- 172.21.15.7:0/1510460638 wait complete. 2024-04-23T15:28:30.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:30 smithi007 ceph-mon[27906]: pgmap v1177: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:30 smithi186 ceph-mon[31814]: pgmap v1177: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:30.919 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:30 smithi137 ceph-mon[31694]: pgmap v1177: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:32.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:32 smithi007 ceph-mon[27906]: pgmap v1178: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 22 op/s 2024-04-23T15:28:32.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:32 smithi186 ceph-mon[31814]: pgmap v1178: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 22 op/s 2024-04-23T15:28:32.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:32 smithi137 ceph-mon[31694]: pgmap v1178: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 22 op/s 2024-04-23T15:28:34.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:34 smithi007 ceph-mon[27906]: pgmap v1179: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:28:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:34 smithi186 ceph-mon[31814]: pgmap v1179: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:28:34.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:34 smithi137 ceph-mon[31694]: pgmap v1179: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:28:36.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:36 smithi007 ceph-mon[27906]: pgmap v1180: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:28:36.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:36 smithi186 ceph-mon[31814]: pgmap v1180: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:28:36.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:36 smithi137 ceph-mon[31694]: pgmap v1180: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-04-23T15:28:38.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:38 smithi007 ceph-mon[27906]: pgmap v1181: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:28:38.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:38 smithi186 ceph-mon[31814]: pgmap v1181: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:28:38.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:38 smithi137 ceph-mon[31694]: pgmap v1181: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:28:40.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:40 smithi007 ceph-mon[27906]: pgmap v1182: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:28:40.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:40 smithi186 ceph-mon[31814]: pgmap v1182: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:28:40.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:40 smithi137 ceph-mon[31694]: pgmap v1182: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:28:42.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:42 smithi007 ceph-mon[27906]: pgmap v1183: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:28:43.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:42 smithi137 ceph-mon[31694]: pgmap v1183: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:28:43.055 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:42 smithi186 ceph-mon[31814]: pgmap v1183: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:28:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 -- 172.21.15.7:0/2324032783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 msgr2=0x7fdb6c1033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 --2- 172.21.15.7:0/2324032783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1033a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009ca0 tx=0x7fdb5c02a950 comp rx=0 tx=0).stop 2024-04-23T15:28:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 -- 172.21.15.7:0/2324032783 shutdown_connections 2024-04-23T15:28:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 --2- 172.21.15.7:0/2324032783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb6c10c3e0 0x7fdb6c10e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 --2- 172.21.15.7:0/2324032783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 0x7fdb6c10bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 --2- 172.21.15.7:0/2324032783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1033a0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 -- 172.21.15.7:0/2324032783 >> 172.21.15.7:0/2324032783 conn(0x7fdb6c0fc820 msgr2=0x7fdb6c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 -- 172.21.15.7:0/2324032783 shutdown_connections 2024-04-23T15:28:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.572+0000 7fdb6be00640 1 -- 172.21.15.7:0/2324032783 wait complete. 2024-04-23T15:28:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.573+0000 7fdb6be00640 1 Processor -- start 2024-04-23T15:28:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.573+0000 7fdb6be00640 1 -- start start 2024-04-23T15:28:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 0x7fdb6c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb6c10c3e0 0x7fdb6c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1120c0 con 0x7fdb6c102fc0 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c111f40 con 0x7fdb6c10c3e0 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c112240 con 0x7fdb6c1038e0 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47650/0 (socket says 172.21.15.7:47650) 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6aa00640 1 -- 172.21.15.7:0/1124677511 learned_addr learned my addr 172.21.15.7:0/1124677511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb6c10c3e0 0x7fdb6c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.574+0000 7fdb6a000640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 0x7fdb6c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6aa00640 1 -- 172.21.15.7:0/1124677511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 msgr2=0x7fdb6c1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6aa00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 0x7fdb6c1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6aa00640 1 -- 172.21.15.7:0/1124677511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb6c10c3e0 msgr2=0x7fdb6c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6aa00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb6c10c3e0 0x7fdb6c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6aa00640 1 -- 172.21.15.7:0/1124677511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c19ad40 con 0x7fdb6c102fc0 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6a000640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 0x7fdb6c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6aa00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1a0410 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c005e30 tx=0x7fdb5c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb63400640 1 -- 172.21.15.7:0/1124677511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c034040 con 0x7fdb6c102fc0 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb63400640 1 -- 172.21.15.7:0/1124677511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb5c0308d0 con 0x7fdb6c102fc0 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c19afd0 con 0x7fdb6c102fc0 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb63400640 1 -- 172.21.15.7:0/1124677511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c004830 con 0x7fdb6c102fc0 2024-04-23T15:28:43.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.575+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c1a72d0 con 0x7fdb6c102fc0 2024-04-23T15:28:43.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.579+0000 7fdb74837740 1 Processor -- start 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.579+0000 7fdb74837740 1 -- start start 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb63400640 1 -- 172.21.15.7:0/1124677511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdb5c037020 con 0x7fdb6c102fc0 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb74837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 0x562c35b977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb74837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35ba2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb74837740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb74837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c35afd900 con 0x562c35b973c0 2024-04-23T15:28:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb74837740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562c35aa3f20 con 0x562c35ba25a0 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb74837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562c35af98c0 con 0x562c35b97ce0 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb6b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 0x562c35b977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb6b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 0x562c35b977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47658/0 (socket says 172.21.15.7:47658) 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb6b400640 1 -- 172.21.15.7:0/861519095 learned_addr learned my addr 172.21.15.7:0/861519095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.580+0000 7fdb6aa00640 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35ba2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6a000640 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6b400640 1 -- 172.21.15.7:0/861519095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 msgr2=0x562c35ba2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6b400640 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35ba2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6b400640 1 -- 172.21.15.7:0/861519095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 msgr2=0x562c35ba4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6b400640 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6b400640 1 -- 172.21.15.7:0/861519095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c35ac8e10 con 0x562c35b973c0 2024-04-23T15:28:43.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.581+0000 7fdb6b400640 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 0x562c35b977a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400cb40 tx=0x7fdb6400e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d8969d13af297f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.582+0000 7fdb57e00640 1 -- 172.21.15.7:0/861519095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005020 con 0x562c35b973c0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.582+0000 7fdb57e00640 1 -- 172.21.15.7:0/861519095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb640047a0 con 0x562c35b973c0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.582+0000 7fdb57e00640 1 -- 172.21.15.7:0/861519095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64010670 con 0x562c35b973c0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.582+0000 7fdb63400640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb500a3d10 0x7fdb500a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.582+0000 7fdb63400640 1 -- 172.21.15.7:0/1124677511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7fdb5c0f1b20 con 0x7fdb6c102fc0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.582+0000 7fdb6aa00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb500a3d10 0x7fdb500a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 -- 172.21.15.7:0/861519095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 msgr2=0x562c35b977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 0x562c35b977a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400cb40 tx=0x7fdb6400e350 comp rx=0 tx=0).stop 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb6aa00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb500a3d10 0x7fdb500a61d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x562c35b98960 tx=0x7fdb5c0f55d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 -- 172.21.15.7:0/861519095 shutdown_connections 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35ba2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 --2- 172.21.15.7:0/861519095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b973c0 0x562c35b977a0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 -- 172.21.15.7:0/861519095 >> 172.21.15.7:0/861519095 conn(0x562c35b938d0 msgr2=0x562c35b93cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 -- 172.21.15.7:0/861519095 shutdown_connections 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.583+0000 7fdb74837740 1 -- 172.21.15.7:0/861519095 wait complete. 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.584+0000 7fdb74837740 1 -- start start 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.584+0000 7fdb74837740 1 Processor -- start 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.584+0000 7fdb74837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b973c0 0x562c35b9f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.584+0000 7fdb74837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 0x562c35b9fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.584+0000 7fdb74837740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb74837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c35ba50e0 con 0x562c35b97ce0 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb74837740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562c35ab72c0 con 0x562c35ba25a0 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb74837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x562c35ba5260 con 0x562c35b973c0 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb74837740 10 client.0 _ll_register_callbacks cb 0x562c3580fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 0x562c35b9fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 0x562c35b9fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47668/0 (socket says 172.21.15.7:47668) 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 -- 172.21.15.7:0/3289470903 learned_addr learned my addr 172.21.15.7:0/3289470903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6b400640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b973c0 0x562c35b9f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6b400640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 -- 172.21.15.7:0/3289470903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b973c0 msgr2=0x562c35b9f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b973c0 0x562c35b9f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 -- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 msgr2=0x562c35ba0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.585+0000 7fdb6a000640 1 -- 172.21.15.7:0/3289470903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c35ac7fd0 con 0x562c35b97ce0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb6a000640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 0x562c35b9fb50 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e80 tx=0x7fdb580117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37af2a0cbb278b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb54c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb54c00640 1 -- 172.21.15.7:0/3289470903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58012860 con 0x562c35b97ce0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb54c00640 1 -- 172.21.15.7:0/3289470903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7fdb58012a00 con 0x562c35b97ce0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb640047a0 con 0x562c35b97ce0 2024-04-23T15:28:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb54c00640 1 -- 172.21.15.7:0/3289470903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdb58025050 con 0x562c35b97ce0 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb74837740 10 client.18675 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.586+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562c35810210 con 0x562c35b97ce0 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb54c00640 1 -- 172.21.15.7:0/3289470903 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb640047a0 con 0x562c35b97ce0 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb54c00640 1 -- 172.21.15.7:0/3289470903 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdb5800f040 con 0x562c35b97ce0 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb74837740 10 client.18675 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb74837740 10 client.18675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb74837740 20 client.18675 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb74837740 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35bb2850 0x562c35bb4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb74837740 4 client.18675 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.587+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c35b0b320 con 0x562c35bb2850 2024-04-23T15:28:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.588+0000 7fdb6b400640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35bb2850 0x562c35bb4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.589+0000 7fdb6b400640 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35bb2850 0x562c35bb4c40 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4a3659c543e41d0 server_cookie=9e587dfb8e0eccd0 in_seq=0 out_seq=0 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.589+0000 7fdb54c00640 10 client.18675 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb54c00640 1 -- 172.21.15.7:0/3289470903 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562c35b0b320 con 0x562c35bb2850 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb54c00640 10 client.18675 handle_command_reply: tid=0 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 client.18675 shutdown 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 msgr2=0x562c35b9fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 0x562c35b9fb50 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e80 tx=0x7fdb580117b0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 shutdown_connections 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35bb2850 0x562c35bb4c40 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35ba25a0 0x562c35ba0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35b97ce0 0x562c35b9fb50 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 --2- 172.21.15.7:0/3289470903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b973c0 0x562c35b9f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 >> 172.21.15.7:0/3289470903 conn(0x562c35b938d0 msgr2=0x562c35b99600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb54c00640 0 client.18675 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 shutdown_connections 2024-04-23T15:28:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.591+0000 7fdb74837740 1 -- 172.21.15.7:0/3289470903 wait complete. 2024-04-23T15:28:43.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.592+0000 7fdb74837740 20 client.18675 trim_cache size 0 max 16384 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.614+0000 7fdb74837740 1 Processor -- start 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.614+0000 7fdb74837740 1 -- start start 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb74837740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35bae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb74837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb74837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35bba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb74837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1b13e0 con 0x562c35ba25a0 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb74837740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1b2f20 con 0x562c35b973c0 2024-04-23T15:28:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb74837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1b1ab0 con 0x562c35b97ce0 2024-04-23T15:28:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.615+0000 7fdb6b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35bba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35bba550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47670/0 (socket says 172.21.15.7:47670) 2024-04-23T15:28:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 -- 172.21.15.7:0/1457248172 learned_addr learned my addr 172.21.15.7:0/1457248172 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35bae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6a000640 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 -- 172.21.15.7:0/1457248172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 msgr2=0x562c35b9feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 -- 172.21.15.7:0/1457248172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 msgr2=0x562c35bae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35bae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.616+0000 7fdb6b400640 1 -- 172.21.15.7:0/1457248172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c35bb4fb0 con 0x562c35ba25a0 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.617+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35bba550 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400cb10 tx=0x7fdb64000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139032987192ff4d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.617+0000 7fdb57400640 1 -- 172.21.15.7:0/1457248172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64023040 con 0x562c35ba25a0 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.617+0000 7fdb57400640 1 -- 172.21.15.7:0/1457248172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb6402b640 con 0x562c35ba25a0 2024-04-23T15:28:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.617+0000 7fdb57400640 1 -- 172.21.15.7:0/1457248172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64029e40 con 0x562c35ba25a0 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 -- 172.21.15.7:0/1457248172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 msgr2=0x562c35bba550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35bba550 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400cb10 tx=0x7fdb64000bc0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 -- 172.21.15.7:0/1457248172 shutdown_connections 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35bba550 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 --2- 172.21.15.7:0/1457248172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35bae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.618+0000 7fdb74837740 1 -- 172.21.15.7:0/1457248172 >> 172.21.15.7:0/1457248172 conn(0x562c35b938d0 msgr2=0x562c35b92a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.619+0000 7fdb74837740 1 -- 172.21.15.7:0/1457248172 shutdown_connections 2024-04-23T15:28:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.619+0000 7fdb74837740 1 -- 172.21.15.7:0/1457248172 wait complete. 2024-04-23T15:28:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.620+0000 7fdb74837740 1 -- start start 2024-04-23T15:28:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.620+0000 7fdb74837740 1 Processor -- start 2024-04-23T15:28:43.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35b9c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35b9cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1b2850 con 0x562c35ba25a0 2024-04-23T15:28:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1b2180 con 0x562c35b973c0 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1af3e0 con 0x562c35b97ce0 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb74837740 10 client.0 _ll_register_callbacks cb 0x7fdb58009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb6b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35b9cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb6b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35b9cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47680/0 (socket says 172.21.15.7:47680) 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb6b400640 1 -- 172.21.15.7:0/1598064107 learned_addr learned my addr 172.21.15.7:0/1598064107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.621+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35b9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.622+0000 7fdb6a000640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.622+0000 7fdb6b400640 1 -- 172.21.15.7:0/1598064107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 msgr2=0x562c35b9ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.622+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.622+0000 7fdb6b400640 1 -- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 msgr2=0x562c35b9c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.622+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35b9c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.622+0000 7fdb6b400640 1 -- 172.21.15.7:0/1598064107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c358dc620 con 0x562c35ba25a0 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb6b400640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35b9cfa0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c7c0 tx=0x7fdb6401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fe784ae11ee2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb54c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb54c00640 1 -- 172.21.15.7:0/1598064107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6402b7f0 con 0x562c35ba25a0 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb54c00640 1 -- 172.21.15.7:0/1598064107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7fdb64029b20 con 0x562c35ba25a0 2024-04-23T15:28:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb6402b640 con 0x562c35ba25a0 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb54c00640 1 -- 172.21.15.7:0/1598064107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdb64029450 con 0x562c35ba25a0 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb74837740 10 client.18681 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.623+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562c35c21920 con 0x562c35ba25a0 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb54c00640 1 -- 172.21.15.7:0/1598064107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb6402b640 con 0x562c35ba25a0 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb54c00640 1 -- 172.21.15.7:0/1598064107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fdb64005140 con 0x562c35ba25a0 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb74837740 10 client.18681 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb74837740 10 client.18681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb74837740 20 client.18681 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb74837740 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35c21e70 0x562c35c24290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb74837740 4 client.18681 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:28:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.624+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c35b05190 con 0x562c35c21e70 2024-04-23T15:28:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.625+0000 7fdb6a000640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35c21e70 0x562c35c24290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.626+0000 7fdb6a000640 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35c21e70 0x562c35c24290 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb2e1380af4f737b server_cookie=bb45a40d451721b0 in_seq=0 out_seq=0 2024-04-23T15:28:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.626+0000 7fdb54c00640 10 client.18681 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.658+0000 7fdb54c00640 1 -- 172.21.15.7:0/1598064107 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c35b05190 con 0x562c35c21e70 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.658+0000 7fdb54c00640 10 client.18681 handle_command_reply: tid=0 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.658+0000 7fdb74837740 1 client.18681 shutdown 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 msgr2=0x562c35b9cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35b9cfa0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c7c0 tx=0x7fdb6401c040 comp rx=0 tx=0).stop 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 shutdown_connections 2024-04-23T15:28:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562c35c21e70 0x562c35c24290 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c35ba25a0 0x562c35b9cfa0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c35b97ce0 0x562c35b9ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb54c00640 0 client.18681 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 --2- 172.21.15.7:0/1598064107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c35b973c0 0x562c35b9c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 >> 172.21.15.7:0/1598064107 conn(0x562c35b938d0 msgr2=0x562c35b98d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 shutdown_connections 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 1 -- 172.21.15.7:0/1598064107 wait complete. 2024-04-23T15:28:43.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.659+0000 7fdb74837740 20 client.18681 trim_cache size 0 max 16384 2024-04-23T15:28:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:28:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:28:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:28:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:28:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb500a3d10 msgr2=0x7fdb500a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb500a3d10 0x7fdb500a61d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x562c35b98960 tx=0x7fdb5c0f55d0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 msgr2=0x7fdb6c1a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1a0410 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c005e30 tx=0x7fdb5c003f90 comp rx=0 tx=0).stop 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 shutdown_connections 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdb500a3d10 0x7fdb500a61d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb6c10c3e0 0x7fdb6c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb6c1038e0 0x7fdb6c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 --2- 172.21.15.7:0/1124677511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb6c102fc0 0x7fdb6c1a0410 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.660+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 >> 172.21.15.7:0/1124677511 conn(0x7fdb6c0fc820 msgr2=0x7fdb6c100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.661+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 shutdown_connections 2024-04-23T15:28:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:43.661+0000 7fdb6be00640 1 -- 172.21.15.7:0/1124677511 wait complete. 2024-04-23T15:28:44.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:44 smithi007 ceph-mon[27906]: pgmap v1184: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:28:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:44 smithi186 ceph-mon[31814]: pgmap v1184: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:28:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:44 smithi137 ceph-mon[31694]: pgmap v1184: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:28:46.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:46 smithi007 ceph-mon[27906]: pgmap v1185: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:28:46.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:46 smithi186 ceph-mon[31814]: pgmap v1185: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:28:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:46 smithi137 ceph-mon[31694]: pgmap v1185: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:28:48.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:48 smithi007 ceph-mon[27906]: pgmap v1186: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:28:48.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:48 smithi186 ceph-mon[31814]: pgmap v1186: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:28:48.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:48 smithi137 ceph-mon[31694]: pgmap v1186: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:28:50.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:50 smithi007 ceph-mon[27906]: pgmap v1187: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:50.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:50 smithi186 ceph-mon[31814]: pgmap v1187: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:50 smithi137 ceph-mon[31694]: pgmap v1187: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:52.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:52 smithi007 ceph-mon[27906]: pgmap v1188: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:28:52.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:52 smithi186 ceph-mon[31814]: pgmap v1188: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:28:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:52 smithi137 ceph-mon[31694]: pgmap v1188: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:28:54.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:54 smithi186 ceph-mon[31814]: pgmap v1189: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:54.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:54 smithi137 ceph-mon[31694]: pgmap v1189: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:54 smithi007 ceph-mon[27906]: pgmap v1189: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 -- 172.21.15.7:0/698413019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634102a30 msgr2=0x7f2634106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 --2- 172.21.15.7:0/698413019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634102a30 0x7f2634106a70 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f261c009900 tx=0x7f261c02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 -- 172.21.15.7:0/698413019 shutdown_connections 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 --2- 172.21.15.7:0/698413019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634107150 0x7f263410ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 --2- 172.21.15.7:0/698413019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634102a30 0x7f2634106a70 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 --2- 172.21.15.7:0/698413019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634102080 0x7f2634102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 -- 172.21.15.7:0/698413019 >> 172.21.15.7:0/698413019 conn(0x7f26340fd940 msgr2=0x7f26340ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:56.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 -- 172.21.15.7:0/698413019 shutdown_connections 2024-04-23T15:28:56.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.843+0000 7f2639a00640 1 -- 172.21.15.7:0/698413019 wait complete. 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.844+0000 7f2639a00640 1 Processor -- start 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.844+0000 7f2639a00640 1 -- start start 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.844+0000 7f2639a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634102080 0x7f2634074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.844+0000 7f2639a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634107150 0x7f2634074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 0x7f26341a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26341120c0 con 0x7f2634074d80 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2634111f40 con 0x7f2634102080 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2634112240 con 0x7f2634107150 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 0x7f26341a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 0x7f26341a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36720/0 (socket says 172.21.15.7:36720) 2024-04-23T15:28:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2639000640 1 -- 172.21.15.7:0/3153953946 learned_addr learned my addr 172.21.15.7:0/3153953946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f262b400640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634107150 0x7f2634074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.845+0000 7f2633e00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634102080 0x7f2634074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639000640 1 -- 172.21.15.7:0/3153953946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634107150 msgr2=0x7f2634074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639000640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634107150 0x7f2634074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639000640 1 -- 172.21.15.7:0/3153953946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634102080 msgr2=0x7f2634074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639000640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634102080 0x7f2634074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639000640 1 -- 172.21.15.7:0/3153953946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26341a6f10 con 0x7f2634074d80 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f262b400640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634107150 0x7f2634074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2633e00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634102080 0x7f2634074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639000640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 0x7f26341a6870 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f262c00eaa0 tx=0x7f262c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2631600640 1 -- 172.21.15.7:0/3153953946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c00cdb0 con 0x7f2634074d80 2024-04-23T15:28:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2631600640 1 -- 172.21.15.7:0/3153953946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f262c005020 con 0x7f2634074d80 2024-04-23T15:28:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2631600640 1 -- 172.21.15.7:0/3153953946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0116d0 con 0x7f2634074d80 2024-04-23T15:28:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.846+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26341a7200 con 0x7f2634074d80 2024-04-23T15:28:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.847+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26341a7720 con 0x7f2634074d80 2024-04-23T15:28:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.850+0000 7f263dd7a740 1 Processor -- start 2024-04-23T15:28:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.851+0000 7f2631600640 1 -- 172.21.15.7:0/3153953946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f262c0051d0 con 0x7f2634074d80 2024-04-23T15:28:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.851+0000 7f263dd7a740 1 -- start start 2024-04-23T15:28:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 0x55e41e6eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6ebce0 0x55e41e6f6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6f65a0 0x55e41e6f8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f263dd7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e41e651900 con 0x55e41e6eb3c0 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f263dd7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e41e5f7f20 con 0x55e41e6ebce0 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f263dd7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e41e64d8c0 con 0x55e41e6f65a0 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f262b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 0x55e41e6eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f262b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 0x55e41e6eb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36732/0 (socket says 172.21.15.7:36732) 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f262b400640 1 -- 172.21.15.7:0/990021890 learned_addr learned my addr 172.21.15.7:0/990021890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.852+0000 7f2633e00640 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6ebce0 0x55e41e6f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f262b400640 1 -- 172.21.15.7:0/990021890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6f65a0 msgr2=0x55e41e6f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f262b400640 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6f65a0 0x55e41e6f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f262b400640 1 -- 172.21.15.7:0/990021890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6ebce0 msgr2=0x55e41e6f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f262b400640 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6ebce0 0x55e41e6f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f262b400640 1 -- 172.21.15.7:0/990021890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e41e61ce10 con 0x55e41e6eb3c0 2024-04-23T15:28:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f2633e00640 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6ebce0 0x55e41e6f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f2631600640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26180a3d90 0x7f26180a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f262b400640 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 0x55e41e6eb7a0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f261c031440 tx=0x7f261c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80651cfedb3e014 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f2631600640 1 -- 172.21.15.7:0/3153953946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7f262c0d0df0 con 0x7f2634074d80 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.853+0000 7f2633e00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26180a3d90 0x7f26180a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.854+0000 7f2629600640 1 -- 172.21.15.7:0/990021890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c041020 con 0x55e41e6eb3c0 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.854+0000 7f2629600640 1 -- 172.21.15.7:0/990021890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f261c004490 con 0x55e41e6eb3c0 2024-04-23T15:28:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.854+0000 7f2629600640 1 -- 172.21.15.7:0/990021890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c035070 con 0x55e41e6eb3c0 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.854+0000 7f263dd7a740 1 -- 172.21.15.7:0/990021890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 msgr2=0x55e41e6eb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.854+0000 7f2633e00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26180a3d90 0x7f26180a6250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55e41e6ec960 tx=0x7f262400b7d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 0x55e41e6eb7a0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f261c031440 tx=0x7f261c005e10 comp rx=0 tx=0).stop 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 -- 172.21.15.7:0/990021890 shutdown_connections 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6ebce0 0x55e41e6f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6f65a0 0x55e41e6f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 --2- 172.21.15.7:0/990021890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6eb3c0 0x55e41e6eb7a0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 -- 172.21.15.7:0/990021890 >> 172.21.15.7:0/990021890 conn(0x55e41e6e78d0 msgr2=0x55e41e6e7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 -- 172.21.15.7:0/990021890 shutdown_connections 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 -- 172.21.15.7:0/990021890 wait complete. 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.855+0000 7f263dd7a740 1 -- start start 2024-04-23T15:28:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 Processor -- start 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 0x55e41e6f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6f65a0 0x55e41e6f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e41e6f9020 con 0x55e41e6ebce0 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e41e60b2c0 con 0x55e41e6f65a0 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e41e6f91a0 con 0x55e41e6eb3c0 2024-04-23T15:28:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f263dd7a740 10 client.0 _ll_register_callbacks cb 0x55e41e363a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f262b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 0x55e41e6f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.856+0000 7f262b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 0x55e41e6f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36742/0 (socket says 172.21.15.7:36742) 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 -- 172.21.15.7:0/1277991645 learned_addr learned my addr 172.21.15.7:0/1277991645 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f2633e00640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f2639000640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6f65a0 0x55e41e6f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 -- 172.21.15.7:0/1277991645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6eb3c0 msgr2=0x55e41e6f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 -- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6f65a0 msgr2=0x55e41e6f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6f65a0 0x55e41e6f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 -- 172.21.15.7:0/1277991645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e41e61bfd0 con 0x55e41e6ebce0 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f2633e00640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f262b400640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 0x55e41e6f3b80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f261c0050c0 tx=0x7f261c004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e1b25999830f39 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.857+0000 7f2622000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.858+0000 7f2622000640 1 -- 172.21.15.7:0/1277991645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c041030 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.858+0000 7f2622000640 1 -- 172.21.15.7:0/1277991645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7f261c0314a0 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.858+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f261c004490 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.858+0000 7f2622000640 1 -- 172.21.15.7:0/1277991645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f261c056050 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.858+0000 7f263dd7a740 10 client.18693 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.858+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e41e364210 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f2622000640 1 -- 172.21.15.7:0/1277991645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f261c004490 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f2622000640 1 -- 172.21.15.7:0/1277991645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f261c03d6e0 con 0x55e41e6ebce0 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f263dd7a740 10 client.18693 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f263dd7a740 10 client.18693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f263dd7a740 20 client.18693 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f263dd7a740 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e7065d0 0x55e41e7089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f263dd7a740 4 client.18693 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:28:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.859+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e41e65f320 con 0x55e41e7065d0 2024-04-23T15:28:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.860+0000 7f2633e00640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e7065d0 0x55e41e7089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.861+0000 7f2633e00640 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e7065d0 0x55e41e7089c0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feace13f1540723a server_cookie=ee474a4fdba631ad in_seq=0 out_seq=0 2024-04-23T15:28:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.861+0000 7f2622000640 10 client.18693 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f2622000640 1 -- 172.21.15.7:0/1277991645 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e41e65f320 con 0x55e41e7065d0 2024-04-23T15:28:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f2622000640 10 client.18693 handle_command_reply: tid=0 2024-04-23T15:28:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 client.18693 shutdown 2024-04-23T15:28:56.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:56 smithi186 ceph-mon[31814]: pgmap v1190: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 msgr2=0x55e41e6f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 0x55e41e6f3b80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f261c0050c0 tx=0x7f261c004c50 comp rx=0 tx=0).stop 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 shutdown_connections 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e7065d0 0x55e41e7089c0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6f65a0 0x55e41e6f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6ebce0 0x55e41e6f3b80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 --2- 172.21.15.7:0/1277991645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 >> 172.21.15.7:0/1277991645 conn(0x55e41e6e78d0 msgr2=0x55e41e6ed650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f2622000640 0 client.18693 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 shutdown_connections 2024-04-23T15:28:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 1 -- 172.21.15.7:0/1277991645 wait complete. 2024-04-23T15:28:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.863+0000 7f263dd7a740 20 client.18693 trim_cache size 0 max 16384 2024-04-23T15:28:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 Processor -- start 2024-04-23T15:28:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 -- start start 2024-04-23T15:28:56.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e6f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e6eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26341b1340 con 0x55e41e6f65a0 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26341b2e80 con 0x55e41e6eb3c0 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.888+0000 7f263dd7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26341b1a10 con 0x55e41e6ebce0 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e6eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e6eddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36748/0 (socket says 172.21.15.7:36748) 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 -- 172.21.15.7:0/3316105538 learned_addr learned my addr 172.21.15.7:0/3316105538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f262b400640 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e6f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2633e00640 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 -- 172.21.15.7:0/3316105538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 msgr2=0x55e41e6f1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e6f1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 -- 172.21.15.7:0/3316105538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 msgr2=0x55e41e6f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.889+0000 7f2639000640 1 -- 172.21.15.7:0/3316105538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e41e6f25f0 con 0x55e41e6f65a0 2024-04-23T15:28:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.890+0000 7f2639000640 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e6eddd0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f262c0ce190 tx=0x7f262c09d100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fdbaed4801a377 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.890+0000 7f2628c00640 1 -- 172.21.15.7:0/3316105538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c01f040 con 0x55e41e6f65a0 2024-04-23T15:28:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.890+0000 7f2628c00640 1 -- 172.21.15.7:0/3316105538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f262c0a55f0 con 0x55e41e6f65a0 2024-04-23T15:28:56.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.890+0000 7f2628c00640 1 -- 172.21.15.7:0/3316105538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0870b0 con 0x55e41e6f65a0 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.891+0000 7f263dd7a740 1 -- 172.21.15.7:0/3316105538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 msgr2=0x55e41e6eddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.891+0000 7f263dd7a740 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e6eddd0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f262c0ce190 tx=0x7f262c09d100 comp rx=0 tx=0).stop 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 -- 172.21.15.7:0/3316105538 shutdown_connections 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e6eddd0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e6f1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 --2- 172.21.15.7:0/3316105538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e6f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 -- 172.21.15.7:0/3316105538 >> 172.21.15.7:0/3316105538 conn(0x55e41e6e78d0 msgr2=0x55e41e701df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 -- 172.21.15.7:0/3316105538 shutdown_connections 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 -- 172.21.15.7:0/3316105538 wait complete. 2024-04-23T15:28:56.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.892+0000 7f263dd7a740 1 -- start start 2024-04-23T15:28:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 Processor -- start 2024-04-23T15:28:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e70bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e708ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e7095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26341b27b0 con 0x55e41e6f65a0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26341b20e0 con 0x55e41e6eb3c0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26341af340 con 0x55e41e6ebce0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.893+0000 7f263dd7a740 10 client.0 _ll_register_callbacks cb 0x7f261c004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e7095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e7095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36754/0 (socket says 172.21.15.7:36754) 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 -- 172.21.15.7:0/2590741540 learned_addr learned my addr 172.21.15.7:0/2590741540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f262b400640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e708ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2633e00640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e70bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 -- 172.21.15.7:0/2590741540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 msgr2=0x55e41e708ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e708ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 -- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 msgr2=0x55e41e70bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e70bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 -- 172.21.15.7:0/2590741540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e41e430620 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2633e00640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e70bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2639000640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e7095f0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f262c09d230 tx=0x7f262c0bd100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842c78f8f6c4b619 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.894+0000 7f2622000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f2622000640 1 -- 172.21.15.7:0/2590741540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0870b0 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f2622000640 1 -- 172.21.15.7:0/2590741540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9467+0+0 (secure 0 0 0) 0x7f262c087250 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f262c0a55f0 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f2622000640 1 -- 172.21.15.7:0/2590741540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f262c0bbb40 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f263dd7a740 10 client.18699 fetch_fsmap learned FSMap version 32 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e41e774f80 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.895+0000 7f2622000640 1 -- 172.21.15.7:0/2590741540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f262c0a55f0 con 0x55e41e6f65a0 2024-04-23T15:28:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f2622000640 1 -- 172.21.15.7:0/2590741540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f262c0bb030 con 0x55e41e6f65a0 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f263dd7a740 10 client.18699 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f263dd7a740 10 client.18699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f263dd7a740 20 client.18699 populate_metadata read hostname 'smithi007' 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f263dd7a740 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e775590 0x55e41e7779b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f263dd7a740 4 client.18699 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.896+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e41e659190 con 0x55e41e775590 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.897+0000 7f2633e00640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e775590 0x55e41e7779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:28:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.898+0000 7f2633e00640 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e775590 0x55e41e7779b0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba463490c534312d server_cookie=478957e875b0b2af in_seq=0 out_seq=0 2024-04-23T15:28:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.898+0000 7f2622000640 10 client.18699 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:56.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:56 smithi137 ceph-mon[31694]: pgmap v1190: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f2622000640 1 -- 172.21.15.7:0/2590741540 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e41e659190 con 0x55e41e775590 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f2622000640 10 client.18699 handle_command_reply: tid=0 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 client.18699 shutdown 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 msgr2=0x55e41e7095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e7095f0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f262c09d230 tx=0x7f262c0bd100 comp rx=0 tx=0).stop 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 shutdown_connections 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e41e775590 0x55e41e7779b0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e41e6f65a0 0x55e41e7095f0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e41e6ebce0 0x55e41e708ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 --2- 172.21.15.7:0/2590741540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e41e6eb3c0 0x55e41e70bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f2622000640 0 client.18699 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.930+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 >> 172.21.15.7:0/2590741540 conn(0x55e41e6e78d0 msgr2=0x55e41e6ecd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.931+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 shutdown_connections 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.931+0000 7f263dd7a740 1 -- 172.21.15.7:0/2590741540 wait complete. 2024-04-23T15:28:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.931+0000 7f263dd7a740 20 client.18699 trim_cache size 0 max 16384 2024-04-23T15:28:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:28:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:28:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:28:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:28:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26180a3d90 msgr2=0x7f26180a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26180a3d90 0x7f26180a6250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55e41e6ec960 tx=0x7f262400b7d0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 msgr2=0x7f26341a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:28:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 0x7f26341a6870 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f262c00eaa0 tx=0x7f262c00ef60 comp rx=0 tx=0).stop 2024-04-23T15:28:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 shutdown_connections 2024-04-23T15:28:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26180a3d90 0x7f26180a6250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2634074d80 0x7f26341a6870 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2634107150 0x7f2634074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 --2- 172.21.15.7:0/3153953946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2634102080 0x7f2634074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:28:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 >> 172.21.15.7:0/3153953946 conn(0x7f26340fd940 msgr2=0x7f26340fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:28:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 shutdown_connections 2024-04-23T15:28:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:28:56.932+0000 7f2639a00640 1 -- 172.21.15.7:0/3153953946 wait complete. 2024-04-23T15:28:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:56 smithi007 ceph-mon[27906]: pgmap v1190: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:28:58.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:28:58 smithi186 ceph-mon[31814]: pgmap v1191: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:28:58.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:28:58 smithi137 ceph-mon[31694]: pgmap v1191: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:28:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:28:58 smithi007 ceph-mon[27906]: pgmap v1191: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:29:00.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:00 smithi186 ceph-mon[31814]: pgmap v1192: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:29:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:00 smithi137 ceph-mon[31694]: pgmap v1192: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:29:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:00 smithi007 ceph-mon[27906]: pgmap v1192: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:29:02.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:02 smithi007 ceph-mon[27906]: pgmap v1193: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:29:02.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:02 smithi137 ceph-mon[31694]: pgmap v1193: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:29:03.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:02 smithi186 ceph-mon[31814]: pgmap v1193: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:29:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:03 smithi137 ceph-mon[31694]: osdmap e155: 12 total, 12 up, 12 in 2024-04-23T15:29:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:03 smithi007 ceph-mon[27906]: osdmap e155: 12 total, 12 up, 12 in 2024-04-23T15:29:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:03 smithi186 ceph-mon[31814]: osdmap e155: 12 total, 12 up, 12 in 2024-04-23T15:29:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:04 smithi137 ceph-mon[31694]: pgmap v1195: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.2 MiB/s wr, 37 op/s 2024-04-23T15:29:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:04 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:29:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:04 smithi007 ceph-mon[27906]: pgmap v1195: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.2 MiB/s wr, 37 op/s 2024-04-23T15:29:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:04 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:29:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:04 smithi186 ceph-mon[31814]: pgmap v1195: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.2 MiB/s wr, 37 op/s 2024-04-23T15:29:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:04 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:29:05.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:05 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:29:05.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:05 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:29:05.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:05 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:29:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:05 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:29:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:05 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:29:06.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:05 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:29:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:05 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:29:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:05 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:29:06.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:05 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:29:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:06 smithi137 ceph-mon[31694]: pgmap v1196: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.2 MiB/s wr, 37 op/s 2024-04-23T15:29:07.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:06 smithi007 ceph-mon[27906]: pgmap v1196: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.2 MiB/s wr, 37 op/s 2024-04-23T15:29:07.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:06 smithi186 ceph-mon[31814]: pgmap v1196: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.2 MiB/s wr, 37 op/s 2024-04-23T15:29:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:08 smithi137 ceph-mon[31694]: pgmap v1197: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:29:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:08 smithi007 ceph-mon[27906]: pgmap v1197: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:29:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:08 smithi186 ceph-mon[31814]: pgmap v1197: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:29:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 -- 172.21.15.7:0/1573835886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 msgr2=0x7fbd68104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 --2- 172.21.15.7:0/1573835886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd68104830 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009900 tx=0x7fbd5802a410 comp rx=0 tx=0).stop 2024-04-23T15:29:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 -- 172.21.15.7:0/1573835886 shutdown_connections 2024-04-23T15:29:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 --2- 172.21.15.7:0/1573835886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68104e00 0x7fbd68108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 --2- 172.21.15.7:0/1573835886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd68109520 0x7fbd681110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 --2- 172.21.15.7:0/1573835886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd68104830 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.134+0000 7fbd6e600640 1 -- 172.21.15.7:0/1573835886 >> 172.21.15.7:0/1573835886 conn(0x7fbd680ffcf0 msgr2=0x7fbd68102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.135+0000 7fbd6e600640 1 -- 172.21.15.7:0/1573835886 shutdown_connections 2024-04-23T15:29:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.135+0000 7fbd6e600640 1 -- 172.21.15.7:0/1573835886 wait complete. 2024-04-23T15:29:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 Processor -- start 2024-04-23T15:29:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 -- start start 2024-04-23T15:29:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd681a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68109520 0x7fbd681a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6819a770 0x7fbd6819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68114490 con 0x7fbd68104450 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68114310 con 0x7fbd68109520 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.136+0000 7fbd6e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68114610 con 0x7fbd6819a770 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd681a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd681a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37452/0 (socket says 172.21.15.7:37452) 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 -- 172.21.15.7:0/2982974521 learned_addr learned my addr 172.21.15.7:0/2982974521 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd66a00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68109520 0x7fbd681a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67e00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6819a770 0x7fbd6819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 -- 172.21.15.7:0/2982974521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6819a770 msgr2=0x7fbd6819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6819a770 0x7fbd6819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 -- 172.21.15.7:0/2982974521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68109520 msgr2=0x7fbd681a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68109520 0x7fbd681a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67400640 1 -- 172.21.15.7:0/2982974521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6819b370 con 0x7fbd68104450 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd67e00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6819a770 0x7fbd6819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.137+0000 7fbd66a00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68109520 0x7fbd681a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.138+0000 7fbd67400640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd681a06b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fbd58005940 tx=0x7fbd580040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.138+0000 7fbd5fe00640 1 -- 172.21.15.7:0/2982974521 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5803f030 con 0x7fbd68104450 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.138+0000 7fbd5fe00640 1 -- 172.21.15.7:0/2982974521 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd580044c0 con 0x7fbd68104450 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.138+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6819b600 con 0x7fbd68104450 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.138+0000 7fbd5fe00640 1 -- 172.21.15.7:0/2982974521 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58035070 con 0x7fbd68104450 2024-04-23T15:29:10.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.138+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a7740 con 0x7fbd68104450 2024-04-23T15:29:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.142+0000 7fbd5fe00640 1 -- 172.21.15.7:0/2982974521 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbd58042030 con 0x7fbd68104450 2024-04-23T15:29:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.142+0000 7fbd713f7740 1 Processor -- start 2024-04-23T15:29:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.142+0000 7fbd713f7740 1 -- start start 2024-04-23T15:29:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd49590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd53e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd56780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd713f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1accaf900 con 0x55f1acd49ad0 2024-04-23T15:29:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd713f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1acc55f20 con 0x55f1acd54390 2024-04-23T15:29:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd713f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f1accab8c0 con 0x55f1acd491b0 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd53e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd53e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37468/0 (socket says 172.21.15.7:37468) 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.143+0000 7fbd67400640 1 -- 172.21.15.7:0/1619558452 learned_addr learned my addr 172.21.15.7:0/1619558452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67e00640 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd49590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd66a00640 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd56780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd5fe00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd4c0a3dc0 0x7fbd4c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67400640 1 -- 172.21.15.7:0/1619558452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 msgr2=0x55f1acd49590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67400640 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd49590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67400640 1 -- 172.21.15.7:0/1619558452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 msgr2=0x55f1acd56780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67400640 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd56780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67400640 1 -- 172.21.15.7:0/1619558452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1acc7ae10 con 0x55f1acd49ad0 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd66a00640 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd56780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd5fe00640 1 -- 172.21.15.7:0/2982974521 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 9555+0+0 (secure 0 0 0) 0x7fbd580f10f0 con 0x7fbd68104450 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.144+0000 7fbd67e00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd4c0a3dc0 0x7fbd4c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.145+0000 7fbd67400640 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd53e50 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fbd580ee310 tx=0x7fbd5808f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e812bfd8adb295f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.145+0000 7fbd5cc00640 1 -- 172.21.15.7:0/1619558452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580bc580 con 0x55f1acd49ad0 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.145+0000 7fbd5cc00640 1 -- 172.21.15.7:0/1619558452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd580d6190 con 0x55f1acd49ad0 2024-04-23T15:29:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.145+0000 7fbd5cc00640 1 -- 172.21.15.7:0/1619558452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580f4c90 con 0x55f1acd49ad0 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 -- 172.21.15.7:0/1619558452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 msgr2=0x55f1acd53e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd67e00640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd4c0a3dc0 0x7fbd4c0a6280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbd60005fd0 tx=0x7fbd60004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd53e50 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fbd580ee310 tx=0x7fbd5808f710 comp rx=0 tx=0).stop 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 -- 172.21.15.7:0/1619558452 shutdown_connections 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd56780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd53e50 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 --2- 172.21.15.7:0/1619558452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd49590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 -- 172.21.15.7:0/1619558452 >> 172.21.15.7:0/1619558452 conn(0x55f1acd456c0 msgr2=0x55f1acd45aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 -- 172.21.15.7:0/1619558452 shutdown_connections 2024-04-23T15:29:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.146+0000 7fbd713f7740 1 -- 172.21.15.7:0/1619558452 wait complete. 2024-04-23T15:29:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.147+0000 7fbd713f7740 1 -- start start 2024-04-23T15:29:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.147+0000 7fbd713f7740 1 Processor -- start 2024-04-23T15:29:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd51310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd51850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd51d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1acd56d80 con 0x55f1acd49ad0 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1acc692c0 con 0x55f1acd54390 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55f1acd56f00 con 0x55f1acd491b0 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd713f7740 10 client.0 _ll_register_callbacks cb 0x55f1ac9c1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd51850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd51850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37482/0 (socket says 172.21.15.7:37482) 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd66a00640 1 -- 172.21.15.7:0/914696211 learned_addr learned my addr 172.21.15.7:0/914696211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd67400640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd51310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.148+0000 7fbd67e00640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd51d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd66a00640 1 -- 172.21.15.7:0/914696211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 msgr2=0x55f1acd51310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd66a00640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd51310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd66a00640 1 -- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 msgr2=0x55f1acd51d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd66a00640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd51d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd66a00640 1 -- 172.21.15.7:0/914696211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1acc79fd0 con 0x55f1acd49ad0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd66a00640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd51850 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fbd54012510 tx=0x7fbd540129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fb4a75d3bfa64c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd51600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd51600640 1 -- 172.21.15.7:0/914696211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54004220 con 0x55f1acd49ad0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.149+0000 7fbd51600640 1 -- 172.21.15.7:0/914696211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 9555+0+0 (secure 0 0 0) 0x7fbd540043c0 con 0x55f1acd49ad0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.150+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd580d6190 con 0x55f1acd49ad0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.150+0000 7fbd51600640 1 -- 172.21.15.7:0/914696211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd54010780 con 0x55f1acd49ad0 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.150+0000 7fbd713f7740 10 client.18711 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.150+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f1ac9c2210 con 0x55f1acd49ad0 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.150+0000 7fbd51600640 1 -- 172.21.15.7:0/914696211 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd580d6190 con 0x55f1acd49ad0 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.150+0000 7fbd51600640 1 -- 172.21.15.7:0/914696211 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbd5400f040 con 0x55f1acd49ad0 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd713f7740 10 client.18711 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd713f7740 10 client.18711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd713f7740 20 client.18711 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd713f7740 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acd642e0 0x55f1acd66710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd713f7740 4 client.18711 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:29:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1accbd320 con 0x55f1acd642e0 2024-04-23T15:29:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.151+0000 7fbd67400640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acd642e0 0x55f1acd66710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.153+0000 7fbd67400640 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acd642e0 0x55f1acd66710 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc8dbee109a91ea3 server_cookie=a92c3ca709d5b7fe in_seq=0 out_seq=0 2024-04-23T15:29:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.153+0000 7fbd51600640 10 client.18711 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd51600640 1 -- 172.21.15.7:0/914696211 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1accbd320 con 0x55f1acd642e0 2024-04-23T15:29:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd51600640 10 client.18711 handle_command_reply: tid=0 2024-04-23T15:29:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 client.18711 shutdown 2024-04-23T15:29:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 msgr2=0x55f1acd51850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd51850 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fbd54012510 tx=0x7fbd540129d0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 shutdown_connections 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acd642e0 0x55f1acd66710 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd51d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd51850 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd51600640 0 client.18711 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 --2- 172.21.15.7:0/914696211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd51310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 >> 172.21.15.7:0/914696211 conn(0x55f1acd456c0 msgr2=0x55f1acd4b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 shutdown_connections 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.155+0000 7fbd713f7740 1 -- 172.21.15.7:0/914696211 wait complete. 2024-04-23T15:29:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.156+0000 7fbd713f7740 20 client.18711 trim_cache size 0 max 16384 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.175+0000 7fbd713f7740 1 Processor -- start 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 -- start start 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd5fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd4bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd6c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681b1680 con 0x55f1acd49ad0 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681b31c0 con 0x55f1acd54390 2024-04-23T15:29:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd713f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681b1d50 con 0x55f1acd491b0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd4bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd66a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd4bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37488/0 (socket says 172.21.15.7:37488) 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.176+0000 7fbd66a00640 1 -- 172.21.15.7:0/907920007 learned_addr learned my addr 172.21.15.7:0/907920007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd67e00640 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd6c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd67400640 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd5fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd66a00640 1 -- 172.21.15.7:0/907920007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 msgr2=0x55f1acd5fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd66a00640 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd5fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd66a00640 1 -- 172.21.15.7:0/907920007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 msgr2=0x55f1acd6c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd66a00640 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd6c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd66a00640 1 -- 172.21.15.7:0/907920007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1acd56af0 con 0x55f1acd49ad0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.177+0000 7fbd66a00640 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd4bb70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009680 tx=0x7fbd54010050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bcebbd093e35a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.178+0000 7fbd53e00640 1 -- 172.21.15.7:0/907920007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54010240 con 0x55f1acd49ad0 2024-04-23T15:29:10.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.178+0000 7fbd53e00640 1 -- 172.21.15.7:0/907920007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd54010dd0 con 0x55f1acd49ad0 2024-04-23T15:29:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.178+0000 7fbd53e00640 1 -- 172.21.15.7:0/907920007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540035f0 con 0x55f1acd49ad0 2024-04-23T15:29:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 -- 172.21.15.7:0/907920007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 msgr2=0x55f1acd4bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd4bb70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009680 tx=0x7fbd54010050 comp rx=0 tx=0).stop 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 -- 172.21.15.7:0/907920007 shutdown_connections 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd54390 0x55f1acd6c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd49ad0 0x55f1acd4bb70 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 --2- 172.21.15.7:0/907920007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd491b0 0x55f1acd5fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 -- 172.21.15.7:0/907920007 >> 172.21.15.7:0/907920007 conn(0x55f1acd456c0 msgr2=0x55f1acd51b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 -- 172.21.15.7:0/907920007 shutdown_connections 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 -- 172.21.15.7:0/907920007 wait complete. 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.179+0000 7fbd713f7740 1 -- start start 2024-04-23T15:29:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 Processor -- start 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 0x55f1acd4e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd49ad0 0x55f1acd4e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd54390 0x55f1acd4eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681b2af0 con 0x55f1acd491b0 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681b2420 con 0x55f1acd49ad0 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681af680 con 0x55f1acd54390 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.180+0000 7fbd713f7740 10 client.0 _ll_register_callbacks cb 0x7fbd54009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 0x55f1acd4e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 0x55f1acd4e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37502/0 (socket says 172.21.15.7:37502) 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 -- 172.21.15.7:0/2420889613 learned_addr learned my addr 172.21.15.7:0/2420889613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67e00640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd54390 0x55f1acd4eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd66a00640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd49ad0 0x55f1acd4e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 -- 172.21.15.7:0/2420889613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd54390 msgr2=0x55f1acd4eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd54390 0x55f1acd4eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 -- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd49ad0 msgr2=0x55f1acd4e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd49ad0 0x55f1acd4e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.181+0000 7fbd67400640 1 -- 172.21.15.7:0/2420889613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1aca8e620 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd67400640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 0x55f1acd4e0e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fbd580bcbb0 tx=0x7fbd580bcaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f33f93e9dad9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd51600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd51600640 1 -- 172.21.15.7:0/2420889613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58049040 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd51600640 1 -- 172.21.15.7:0/2420889613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 9555+0+0 (secure 0 0 0) 0x7fbd580baf20 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd54010dd0 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd51600640 1 -- 172.21.15.7:0/2420889613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd5808f780 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd713f7740 10 client.18717 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f1acdcab30 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.182+0000 7fbd51600640 1 -- 172.21.15.7:0/2420889613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd54010dd0 con 0x55f1acd491b0 2024-04-23T15:29:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd51600640 1 -- 172.21.15.7:0/2420889613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbd580b9290 con 0x55f1acd491b0 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd713f7740 10 client.18717 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd713f7740 10 client.18717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd713f7740 20 client.18717 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd713f7740 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acdcb0c0 0x55f1acdcd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd713f7740 4 client.18717 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1accb7190 con 0x55f1acdcb0c0 2024-04-23T15:29:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.183+0000 7fbd66a00640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acdcb0c0 0x55f1acdcd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.185+0000 7fbd51600640 10 client.18717 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.185+0000 7fbd66a00640 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acdcb0c0 0x55f1acdcd4b0 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73ed66937e1ee04b server_cookie=1d53402413e397c9 in_seq=0 out_seq=0 2024-04-23T15:29:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.217+0000 7fbd51600640 1 -- 172.21.15.7:0/2420889613 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1accb7190 con 0x55f1acdcb0c0 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.217+0000 7fbd51600640 10 client.18717 handle_command_reply: tid=0 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.217+0000 7fbd713f7740 1 client.18717 shutdown 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 msgr2=0x55f1acd4e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 0x55f1acd4e0e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fbd580bcbb0 tx=0x7fbd580bcaf0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 shutdown_connections 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55f1acdcb0c0 0x55f1acdcd4b0 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1acd49ad0 0x55f1acd4e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f1acd54390 0x55f1acd4eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 --2- 172.21.15.7:0/2420889613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1acd491b0 0x55f1acd4e0e0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd51600640 0 client.18717 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 >> 172.21.15.7:0/2420889613 conn(0x55f1acd456c0 msgr2=0x55f1acd52b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 shutdown_connections 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 1 -- 172.21.15.7:0/2420889613 wait complete. 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.218+0000 7fbd713f7740 20 client.18717 trim_cache size 0 max 16384 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:29:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:29:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.219+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd4c0a3dc0 msgr2=0x7fbd4c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.219+0000 7fbd6e600640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd4c0a3dc0 0x7fbd4c0a6280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbd60005fd0 tx=0x7fbd60004a40 comp rx=0 tx=0).stop 2024-04-23T15:29:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.219+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 msgr2=0x7fbd681a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.219+0000 7fbd6e600640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd681a06b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fbd58005940 tx=0x7fbd580040c0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 shutdown_connections 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd4c0a3dc0 0x7fbd4c0a6280 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68109520 0x7fbd681a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6819a770 0x7fbd6819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 --2- 172.21.15.7:0/2982974521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd68104450 0x7fbd681a06b0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 >> 172.21.15.7:0/2982974521 conn(0x7fbd680ffcf0 msgr2=0x7fbd68102080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 shutdown_connections 2024-04-23T15:29:10.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:10.220+0000 7fbd6e600640 1 -- 172.21.15.7:0/2982974521 wait complete. 2024-04-23T15:29:10.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:10 smithi137 ceph-mon[31694]: pgmap v1198: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:29:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:10 smithi007 ceph-mon[27906]: pgmap v1198: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:29:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:10 smithi186 ceph-mon[31814]: pgmap v1198: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 37 op/s 2024-04-23T15:29:12.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:12 smithi007 ceph-mon[27906]: osdmap e156: 12 total, 12 up, 12 in 2024-04-23T15:29:12.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:12 smithi186 ceph-mon[31814]: osdmap e156: 12 total, 12 up, 12 in 2024-04-23T15:29:12.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:12 smithi137 ceph-mon[31694]: osdmap e156: 12 total, 12 up, 12 in 2024-04-23T15:29:13.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:13 smithi007 ceph-mon[27906]: pgmap v1200: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.5 MiB/s wr, 18 op/s 2024-04-23T15:29:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:13 smithi186 ceph-mon[31814]: pgmap v1200: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.5 MiB/s wr, 18 op/s 2024-04-23T15:29:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:13 smithi137 ceph-mon[31694]: pgmap v1200: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.5 MiB/s wr, 18 op/s 2024-04-23T15:29:14.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:14 smithi186 ceph-mon[31814]: pgmap v1201: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:29:14.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:14 smithi137 ceph-mon[31694]: pgmap v1201: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:29:14.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:14 smithi007 ceph-mon[27906]: pgmap v1201: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:29:16.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:16 smithi007 ceph-mon[27906]: pgmap v1202: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:29:16.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:16 smithi186 ceph-mon[31814]: pgmap v1202: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:29:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:16 smithi137 ceph-mon[31694]: pgmap v1202: 129 pgs: 129 active+clean; 9.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.9 MiB/s wr, 16 op/s 2024-04-23T15:29:18.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:18 smithi007 ceph-mon[27906]: pgmap v1203: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:29:18.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:18 smithi186 ceph-mon[31814]: pgmap v1203: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:29:18.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:18 smithi137 ceph-mon[31694]: pgmap v1203: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:29:20.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:20 smithi007 ceph-mon[27906]: pgmap v1204: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:29:20.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:20 smithi186 ceph-mon[31814]: pgmap v1204: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:29:20.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:20 smithi137 ceph-mon[31694]: pgmap v1204: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:29:22.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:22 smithi007 ceph-mon[27906]: pgmap v1205: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.0 MiB/s wr, 22 op/s 2024-04-23T15:29:22.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:22 smithi186 ceph-mon[31814]: pgmap v1205: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.0 MiB/s wr, 22 op/s 2024-04-23T15:29:22.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:22 smithi137 ceph-mon[31694]: pgmap v1205: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.0 MiB/s wr, 22 op/s 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.446+0000 7f4f2aa00640 1 -- 172.21.15.7:0/3063435117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f24102a30 msgr2=0x7f4f24106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.446+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/3063435117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f24102a30 0x7f4f24106a70 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009900 tx=0x7f4f1002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 -- 172.21.15.7:0/3063435117 shutdown_connections 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/3063435117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 0x7f4f2410ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/3063435117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f24102a30 0x7f4f24106a70 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/3063435117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f24102080 0x7f4f24102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 -- 172.21.15.7:0/3063435117 >> 172.21.15.7:0/3063435117 conn(0x7f4f240fd980 msgr2=0x7f4f240ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 -- 172.21.15.7:0/3063435117 shutdown_connections 2024-04-23T15:29:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.447+0000 7f4f2aa00640 1 -- 172.21.15.7:0/3063435117 wait complete. 2024-04-23T15:29:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.448+0000 7f4f2aa00640 1 Processor -- start 2024-04-23T15:29:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 -- start start 2024-04-23T15:29:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f24102080 0x7f4f241a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 0x7f4f241a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 0x7f4f2419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241120e0 con 0x7f4f2419a700 2024-04-23T15:29:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24111f60 con 0x7f4f24102080 2024-04-23T15:29:23.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.449+0000 7f4f2aa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24112260 con 0x7f4f24107150 2024-04-23T15:29:23.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 0x7f4f2419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f29600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f24102080 0x7f4f241a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 0x7f4f2419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49856/0 (socket says 172.21.15.7:49856) 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 -- 172.21.15.7:0/200045982 learned_addr learned my addr 172.21.15.7:0/200045982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f28c00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 0x7f4f241a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 -- 172.21.15.7:0/200045982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 msgr2=0x7f4f241a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 0x7f4f241a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 -- 172.21.15.7:0/200045982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f24102080 msgr2=0x7f4f241a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f24102080 0x7f4f241a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f2a000640 1 -- 172.21.15.7:0/200045982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2419b300 con 0x7f4f2419a700 2024-04-23T15:29:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.450+0000 7f4f28c00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 0x7f4f241a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:29:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.451+0000 7f4f2a000640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 0x7f4f2419ab80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00eaa0 tx=0x7f4f1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.451+0000 7f4f22000640 1 -- 172.21.15.7:0/200045982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00cdb0 con 0x7f4f2419a700 2024-04-23T15:29:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.451+0000 7f4f22000640 1 -- 172.21.15.7:0/200045982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f1c005020 con 0x7f4f2419a700 2024-04-23T15:29:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.451+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f241a73e0 con 0x7f4f2419a700 2024-04-23T15:29:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.451+0000 7f4f22000640 1 -- 172.21.15.7:0/200045982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0116d0 con 0x7f4f2419a700 2024-04-23T15:29:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.451+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f241a77e0 con 0x7f4f2419a700 2024-04-23T15:29:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.455+0000 7f4f22000640 1 -- 172.21.15.7:0/200045982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4f1c0051d0 con 0x7f4f2419a700 2024-04-23T15:29:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 Processor -- start 2024-04-23T15:29:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 -- start start 2024-04-23T15:29:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebdc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebde990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56441eb37900 con 0x56441ebd13c0 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56441eaddf20 con 0x56441ebdc5a0 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.456+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56441eb338c0 con 0x56441ebd1ce0 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49858/0 (socket says 172.21.15.7:49858) 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 -- 172.21.15.7:0/2819761544 learned_addr learned my addr 172.21.15.7:0/2819761544 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f29600640 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebdc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebde990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 -- 172.21.15.7:0/2819761544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 msgr2=0x56441ebdc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebdc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 -- 172.21.15.7:0/2819761544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 msgr2=0x56441ebde990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebde990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f28c00640 1 -- 172.21.15.7:0/2819761544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56441eb02e10 con 0x56441ebd13c0 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.457+0000 7f4f22000640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f0c0a3d90 0x7f4f0c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.458+0000 7f4f22000640 1 -- 172.21.15.7:0/200045982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7f4f1c0d0cb0 con 0x7f4f2419a700 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.458+0000 7f4f28c00640 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd17a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4f10005ec0 tx=0x7f4f10005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d6c497c4aeeedd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.458+0000 7f4f29600640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f0c0a3d90 0x7f4f0c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.458+0000 7f4f16600640 1 -- 172.21.15.7:0/2819761544 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10043020 con 0x56441ebd13c0 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.458+0000 7f4f16600640 1 -- 172.21.15.7:0/2819761544 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f100046c0 con 0x56441ebd13c0 2024-04-23T15:29:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.459+0000 7f4f16600640 1 -- 172.21.15.7:0/2819761544 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10035070 con 0x56441ebd13c0 2024-04-23T15:29:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.459+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2819761544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 msgr2=0x56441ebd17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.459+0000 7f4f29600640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f0c0a3d90 0x7f4f0c0a6250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56441ebd2960 tx=0x7f4f18005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.459+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd17a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4f10005ec0 tx=0x7f4f10005bc0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2819761544 shutdown_connections 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebde990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebdc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2819761544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd17a0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2819761544 >> 172.21.15.7:0/2819761544 conn(0x56441ebcd8d0 msgr2=0x56441ebcdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2819761544 shutdown_connections 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2819761544 wait complete. 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 -- start start 2024-04-23T15:29:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.460+0000 7f4f2ed80740 1 Processor -- start 2024-04-23T15:29:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebd9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebda180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56441ebdefc0 con 0x56441ebd13c0 2024-04-23T15:29:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56441eaf12c0 con 0x56441ebdc5a0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56441ebdf140 con 0x56441ebd1ce0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f2ed80740 10 client.0 _ll_register_callbacks cb 0x56441e849a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f29600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f29600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49872/0 (socket says 172.21.15.7:49872) 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.461+0000 7f4f29600640 1 -- 172.21.15.7:0/1494251224 learned_addr learned my addr 172.21.15.7:0/1494251224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f2a000640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebda180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f28c00640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebd9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f29600640 1 -- 172.21.15.7:0/1494251224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 msgr2=0x56441ebd9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f29600640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebd9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f29600640 1 -- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 msgr2=0x56441ebda180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f29600640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebda180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f29600640 1 -- 172.21.15.7:0/1494251224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56441eb01fd0 con 0x56441ebd13c0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f29600640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd9700 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4f18004650 tx=0x7f4f18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc94f06afa17b2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.462+0000 7f4f0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.463+0000 7f4f0aa00640 1 -- 172.21.15.7:0/1494251224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1802e060 con 0x56441ebd13c0 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.463+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f100046c0 con 0x56441ebd13c0 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.463+0000 7f4f0aa00640 1 -- 172.21.15.7:0/1494251224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7f4f18018030 con 0x56441ebd13c0 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.463+0000 7f4f0aa00640 1 -- 172.21.15.7:0/1494251224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4f18035050 con 0x56441ebd13c0 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.463+0000 7f4f2ed80740 10 client.18729 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.463+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56441e84a210 con 0x56441ebd13c0 2024-04-23T15:29:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f0aa00640 1 -- 172.21.15.7:0/1494251224 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f100046c0 con 0x56441ebd13c0 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f0aa00640 1 -- 172.21.15.7:0/1494251224 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4f1801c4e0 con 0x56441ebd13c0 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f2ed80740 10 client.18729 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f2ed80740 10 client.18729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f2ed80740 20 client.18729 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ebec750 0x56441ebeeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f2ed80740 4 client.18729 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.464+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56441eb45320 con 0x56441ebec750 2024-04-23T15:29:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.465+0000 7f4f28c00640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ebec750 0x56441ebeeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.466+0000 7f4f28c00640 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ebec750 0x56441ebeeb60 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97dfd87c727eb0d1 server_cookie=db45c0111375eaf8 in_seq=0 out_seq=0 2024-04-23T15:29:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.466+0000 7f4f0aa00640 10 client.18729 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.467+0000 7f4f0aa00640 1 -- 172.21.15.7:0/1494251224 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56441eb45320 con 0x56441ebec750 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.467+0000 7f4f0aa00640 10 client.18729 handle_command_reply: tid=0 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.467+0000 7f4f2ed80740 1 client.18729 shutdown 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 msgr2=0x56441ebd9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd9700 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4f18004650 tx=0x7f4f18004730 comp rx=0 tx=0).stop 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 shutdown_connections 2024-04-23T15:29:23.469 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ebec750 0x56441ebeeb60 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebdc5a0 0x56441ebda180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd1ce0 0x56441ebd9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/1494251224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd13c0 0x56441ebd9700 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 >> 172.21.15.7:0/1494251224 conn(0x56441ebcd8d0 msgr2=0x56441ebd3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f0aa00640 0 client.18729 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 shutdown_connections 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 1 -- 172.21.15.7:0/1494251224 wait complete. 2024-04-23T15:29:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.468+0000 7f4f2ed80740 20 client.18729 trim_cache size 0 max 16384 2024-04-23T15:29:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 Processor -- start 2024-04-23T15:29:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 -- start start 2024-04-23T15:29:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd13c0 0x56441ebd3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 0x56441ebd9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebdc5a0 0x56441ebf4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241b1410 con 0x56441ebd1ce0 2024-04-23T15:29:23.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241b2f50 con 0x56441ebd13c0 2024-04-23T15:29:23.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.489+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241b1ae0 con 0x56441ebdc5a0 2024-04-23T15:29:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 0x56441ebd9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 0x56441ebd9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49882/0 (socket says 172.21.15.7:49882) 2024-04-23T15:29:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 -- 172.21.15.7:0/3807093706 learned_addr learned my addr 172.21.15.7:0/3807093706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f2a000640 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebdc5a0 0x56441ebf4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f29600640 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd13c0 0x56441ebd3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 -- 172.21.15.7:0/3807093706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebdc5a0 msgr2=0x56441ebf4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebdc5a0 0x56441ebf4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 -- 172.21.15.7:0/3807093706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd13c0 msgr2=0x56441ebd3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd13c0 0x56441ebd3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f28c00640 1 -- 172.21.15.7:0/3807093706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56441e916620 con 0x56441ebd1ce0 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.490+0000 7f4f29600640 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd13c0 0x56441ebd3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.491+0000 7f4f28c00640 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 0x56441ebd9dd0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4f10006010 tx=0x7f4f10005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604f76c800c258d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.491+0000 7f4f15c00640 1 -- 172.21.15.7:0/3807093706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10055070 con 0x56441ebd1ce0 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.491+0000 7f4f15c00640 1 -- 172.21.15.7:0/3807093706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f10050d50 con 0x56441ebd1ce0 2024-04-23T15:29:23.493 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.491+0000 7f4f15c00640 1 -- 172.21.15.7:0/3807093706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10043070 con 0x56441ebd1ce0 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 -- 172.21.15.7:0/3807093706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 msgr2=0x56441ebd9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 0x56441ebd9dd0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4f10006010 tx=0x7f4f10005bc0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 -- 172.21.15.7:0/3807093706 shutdown_connections 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebdc5a0 0x56441ebf4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebd1ce0 0x56441ebd9dd0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/3807093706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd13c0 0x56441ebd3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 -- 172.21.15.7:0/3807093706 >> 172.21.15.7:0/3807093706 conn(0x56441ebcd8d0 msgr2=0x56441ebd96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 -- 172.21.15.7:0/3807093706 shutdown_connections 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.492+0000 7f4f2ed80740 1 -- 172.21.15.7:0/3807093706 wait complete. 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.493+0000 7f4f2ed80740 1 -- start start 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.493+0000 7f4f2ed80740 1 Processor -- start 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.493+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd13c0 0x56441ebd6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.493+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd1ce0 0x56441ebd6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.493+0000 7f4f2ed80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 0x56441ec51ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241b2880 con 0x56441ebdc5a0 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241b21b0 con 0x56441ebd1ce0 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2ed80740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241af410 con 0x56441ebd13c0 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2ed80740 10 client.0 _ll_register_callbacks cb 0x7f4f18009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 0x56441ec51ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 0x56441ec51ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49894/0 (socket says 172.21.15.7:49894) 2024-04-23T15:29:23.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 -- 172.21.15.7:0/2323571160 learned_addr learned my addr 172.21.15.7:0/2323571160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f28c00640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd1ce0 0x56441ebd6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f29600640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd13c0 0x56441ebd6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 -- 172.21.15.7:0/2323571160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd13c0 msgr2=0x56441ebd6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd13c0 0x56441ebd6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 -- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd1ce0 msgr2=0x56441ebd6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd1ce0 0x56441ebd6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f2a000640 1 -- 172.21.15.7:0/2323571160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56441ec52220 con 0x56441ebdc5a0 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f29600640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd13c0 0x56441ebd6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.494+0000 7f4f28c00640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd1ce0 0x56441ebd6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f2a000640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 0x56441ec51ce0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0ce050 tx=0x7f4f1c09cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09ca32834c763e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f0aa00640 1 -- 172.21.15.7:0/2323571160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c01f040 con 0x56441ebdc5a0 2024-04-23T15:29:23.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f0aa00640 1 -- 172.21.15.7:0/2323571160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7f4f1c098eb0 con 0x56441ebdc5a0 2024-04-23T15:29:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f10050d50 con 0x56441ebdc5a0 2024-04-23T15:29:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f0aa00640 1 -- 172.21.15.7:0/2323571160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4f1c0a54b0 con 0x56441ebdc5a0 2024-04-23T15:29:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f2ed80740 10 client.18735 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:23.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.495+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56441ec53370 con 0x56441ebdc5a0 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f0aa00640 1 -- 172.21.15.7:0/2323571160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f10050d50 con 0x56441ebdc5a0 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f0aa00640 1 -- 172.21.15.7:0/2323571160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4f1c00f040 con 0x56441ebdc5a0 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f2ed80740 10 client.18735 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f2ed80740 10 client.18735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f2ed80740 20 client.18735 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ec53b70 0x56441ec55f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f2ed80740 4 client.18735 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.496+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56441eb3f190 con 0x56441ec53b70 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.497+0000 7f4f29600640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ec53b70 0x56441ec55f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.497+0000 7f4f29600640 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ec53b70 0x56441ec55f90 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12874a1296033581 server_cookie=60f366f3940c0894 in_seq=0 out_seq=0 2024-04-23T15:29:23.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.497+0000 7f4f0aa00640 10 client.18735 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f0aa00640 1 -- 172.21.15.7:0/2323571160 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56441eb3f190 con 0x56441ec53b70 2024-04-23T15:29:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f0aa00640 10 client.18735 handle_command_reply: tid=0 2024-04-23T15:29:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f2ed80740 1 client.18735 shutdown 2024-04-23T15:29:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 msgr2=0x56441ec51ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 0x56441ec51ce0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0ce050 tx=0x7f4f1c09cf40 comp rx=0 tx=0).stop 2024-04-23T15:29:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 shutdown_connections 2024-04-23T15:29:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.535+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56441ec53b70 0x56441ec55f90 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56441ebd1ce0 0x56441ebd6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f0aa00640 0 client.18735 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56441ebdc5a0 0x56441ec51ce0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 1 --2- 172.21.15.7:0/2323571160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56441ebd13c0 0x56441ebd6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 >> 172.21.15.7:0/2323571160 conn(0x56441ebcd8d0 msgr2=0x56441ebd9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 shutdown_connections 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 1 -- 172.21.15.7:0/2323571160 wait complete. 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.536+0000 7f4f2ed80740 20 client.18735 trim_cache size 0 max 16384 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:29:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:29:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f0c0a3d90 msgr2=0x7f4f0c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f0c0a3d90 0x7f4f0c0a6250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56441ebd2960 tx=0x7f4f18005f90 comp rx=0 tx=0).stop 2024-04-23T15:29:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 msgr2=0x7f4f2419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 0x7f4f2419ab80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00eaa0 tx=0x7f4f1c00ef60 comp rx=0 tx=0).stop 2024-04-23T15:29:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 shutdown_connections 2024-04-23T15:29:23.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4f0c0a3d90 0x7f4f0c0a6250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f2419a700 0x7f4f2419ab80 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f24107150 0x7f4f241a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 --2- 172.21.15.7:0/200045982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f24102080 0x7f4f241a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.537+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 >> 172.21.15.7:0/200045982 conn(0x7f4f240fd980 msgr2=0x7f4f240ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.538+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 shutdown_connections 2024-04-23T15:29:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:23.538+0000 7f4f2aa00640 1 -- 172.21.15.7:0/200045982 wait complete. 2024-04-23T15:29:24.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:24 smithi007 ceph-mon[27906]: pgmap v1206: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:29:24.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:24 smithi186 ceph-mon[31814]: pgmap v1206: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:29:24.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:24 smithi137 ceph-mon[31694]: pgmap v1206: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:29:26.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:26 smithi007 ceph-mon[27906]: pgmap v1207: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:29:26.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:26 smithi186 ceph-mon[31814]: pgmap v1207: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:29:26.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:26 smithi137 ceph-mon[31694]: pgmap v1207: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:29:28.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:28 smithi007 ceph-mon[27906]: pgmap v1208: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:29:28.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:28 smithi186 ceph-mon[31814]: pgmap v1208: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:29:28.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:28 smithi137 ceph-mon[31694]: pgmap v1208: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:29:30.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:30 smithi007 ceph-mon[27906]: pgmap v1209: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:29:30.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:30 smithi186 ceph-mon[31814]: pgmap v1209: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:29:30.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:30 smithi137 ceph-mon[31694]: pgmap v1209: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:29:32.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:32 smithi007 ceph-mon[27906]: pgmap v1210: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:29:32.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:32 smithi186 ceph-mon[31814]: pgmap v1210: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:29:32.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:32 smithi137 ceph-mon[31694]: pgmap v1210: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:29:34.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:34 smithi007 ceph-mon[27906]: pgmap v1211: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:29:34.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:34 smithi186 ceph-mon[31814]: pgmap v1211: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:29:34.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:34 smithi137 ceph-mon[31694]: pgmap v1211: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:29:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 -- 172.21.15.7:0/3384424138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e58104c60 msgr2=0x7f9e58108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 --2- 172.21.15.7:0/3384424138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e58104c60 0x7f9e58108ca0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009900 tx=0x7f9e4002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 -- 172.21.15.7:0/3384424138 shutdown_connections 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 --2- 172.21.15.7:0/3384424138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e58109380 0x7f9e58110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 --2- 172.21.15.7:0/3384424138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e58104c60 0x7f9e58108ca0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 --2- 172.21.15.7:0/3384424138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e581042b0 0x7f9e58104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 -- 172.21.15.7:0/3384424138 >> 172.21.15.7:0/3384424138 conn(0x7f9e580ffb10 msgr2=0x7f9e58101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 -- 172.21.15.7:0/3384424138 shutdown_connections 2024-04-23T15:29:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.739+0000 7f9e57e00640 1 -- 172.21.15.7:0/3384424138 wait complete. 2024-04-23T15:29:36.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.740+0000 7f9e57e00640 1 Processor -- start 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.740+0000 7f9e57e00640 1 -- start start 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e581042b0 0x7f9e581a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e58109380 0x7f9e581a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 0x7f9e5819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581142f0 con 0x7f9e5819a690 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58114170 con 0x7f9e581042b0 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58114470 con 0x7f9e58109380 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 0x7f9e5819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 0x7f9e5819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41630/0 (socket says 172.21.15.7:41630) 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e57400640 1 -- 172.21.15.7:0/1941449281 learned_addr learned my addr 172.21.15.7:0/1941449281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.741+0000 7f9e56a00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e581042b0 0x7f9e581a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e58109380 0x7f9e581a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e57400640 1 -- 172.21.15.7:0/1941449281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e58109380 msgr2=0x7f9e581a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e57400640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e58109380 0x7f9e581a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e57400640 1 -- 172.21.15.7:0/1941449281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e581042b0 msgr2=0x7f9e581a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e57400640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e581042b0 0x7f9e581a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e57400640 1 -- 172.21.15.7:0/1941449281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5819b290 con 0x7f9e5819a690 2024-04-23T15:29:36.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e56a00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e581042b0 0x7f9e581a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:29:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.742+0000 7f9e57400640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 0x7f9e5819ab10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000eaa0 tx=0x7f9e5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.743+0000 7f9e4f400640 1 -- 172.21.15.7:0/1941449281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5000cdb0 con 0x7f9e5819a690 2024-04-23T15:29:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.743+0000 7f9e4f400640 1 -- 172.21.15.7:0/1941449281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e50005020 con 0x7f9e5819a690 2024-04-23T15:29:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.743+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e581a7370 con 0x7f9e5819a690 2024-04-23T15:29:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.743+0000 7f9e4f400640 1 -- 172.21.15.7:0/1941449281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e500116d0 con 0x7f9e5819a690 2024-04-23T15:29:36.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.743+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e581a7720 con 0x7f9e5819a690 2024-04-23T15:29:36.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.747+0000 7f9e4f400640 1 -- 172.21.15.7:0/1941449281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f9e500051d0 con 0x7f9e5819a690 2024-04-23T15:29:36.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.747+0000 7f9e607e7740 1 Processor -- start 2024-04-23T15:29:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.747+0000 7f9e607e7740 1 -- start start 2024-04-23T15:29:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f683c0 0x55e340f687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f73060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f735a0 0x55e340f75990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e607e7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e340ece900 con 0x55e340f68ce0 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e607e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e340e74f20 con 0x55e340f735a0 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e607e7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e340eca8c0 con 0x55e340f683c0 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e56a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f73060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e56a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f73060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41636/0 (socket says 172.21.15.7:41636) 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e56a00640 1 -- 172.21.15.7:0/947415994 learned_addr learned my addr 172.21.15.7:0/947415994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f683c0 0x55e340f687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.748+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f735a0 0x55e340f75990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e56a00640 1 -- 172.21.15.7:0/947415994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f683c0 msgr2=0x55e340f687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e56a00640 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f683c0 0x55e340f687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e56a00640 1 -- 172.21.15.7:0/947415994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f735a0 msgr2=0x55e340f75990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e56a00640 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f735a0 0x55e340f75990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e56a00640 1 -- 172.21.15.7:0/947415994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e340e99e10 con 0x55e340f68ce0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e4f400640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9e3c0a3d90 0x7f9e3c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f683c0 0x55e340f687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e4f400640 1 -- 172.21.15.7:0/1941449281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7f9e500d0da0 con 0x7f9e5819a690 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e57400640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9e3c0a3d90 0x7f9e3c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e56a00640 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f73060 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800bd40 tx=0x7f9e4800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89c006dd153866a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.749+0000 7f9e47e00640 1 -- 172.21.15.7:0/947415994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48015070 con 0x55e340f68ce0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.750+0000 7f9e47e00640 1 -- 172.21.15.7:0/947415994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e4800be30 con 0x55e340f68ce0 2024-04-23T15:29:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.750+0000 7f9e47e00640 1 -- 172.21.15.7:0/947415994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48011990 con 0x55e340f68ce0 2024-04-23T15:29:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.750+0000 7f9e57400640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9e3c0a3d90 0x7f9e3c0a6250 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e5009c8c0 tx=0x7f9e50009270 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.750+0000 7f9e607e7740 1 -- 172.21.15.7:0/947415994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 msgr2=0x55e340f73060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.750+0000 7f9e607e7740 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f73060 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800bd40 tx=0x7f9e4800f730 comp rx=0 tx=0).stop 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 -- 172.21.15.7:0/947415994 shutdown_connections 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f735a0 0x55e340f75990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f73060 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 --2- 172.21.15.7:0/947415994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f683c0 0x55e340f687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 -- 172.21.15.7:0/947415994 >> 172.21.15.7:0/947415994 conn(0x55e340f648d0 msgr2=0x55e340f64cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 -- 172.21.15.7:0/947415994 shutdown_connections 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 -- 172.21.15.7:0/947415994 wait complete. 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.751+0000 7f9e607e7740 1 -- start start 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 Processor -- start 2024-04-23T15:29:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f70520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f68ce0 0x55e340f70a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 0x55e340f70fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e340f76140 con 0x55e340f735a0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e340e882c0 con 0x55e340f683c0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e340f762c0 con 0x55e340f68ce0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.752+0000 7f9e607e7740 10 client.0 _ll_register_callbacks cb 0x55e340be0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 0x55e340f70fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 0x55e340f70fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41642/0 (socket says 172.21.15.7:41642) 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 -- 172.21.15.7:0/3384924897 learned_addr learned my addr 172.21.15.7:0/3384924897 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f70520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e56a00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f68ce0 0x55e340f70a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 -- 172.21.15.7:0/3384924897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f68ce0 msgr2=0x55e340f70a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f68ce0 0x55e340f70a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 -- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 msgr2=0x55e340f70520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f70520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.753+0000 7f9e4fe00640 1 -- 172.21.15.7:0/3384924897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e340e98fd0 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 0x55e340f70fa0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009900 tx=0x7f9e40009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cc971ab47924b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e44c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e44c00640 1 -- 172.21.15.7:0/3384924897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40035040 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e44c00640 1 -- 172.21.15.7:0/3384924897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7f9e40003c00 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e4800be30 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e44c00640 1 -- 172.21.15.7:0/3384924897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9e40003e00 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e607e7740 10 client.18747 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.754+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e340be1210 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e44c00640 1 -- 172.21.15.7:0/3384924897 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e4800be30 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e44c00640 1 -- 172.21.15.7:0/3384924897 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9e4004d4d0 con 0x55e340f735a0 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e607e7740 10 client.18747 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e607e7740 10 client.18747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e607e7740 20 client.18747 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e607e7740 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340f83640 0x55e340f85a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e607e7740 4 client.18747 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:29:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.755+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e340edc320 con 0x55e340f83640 2024-04-23T15:29:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.756+0000 7f9e56a00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340f83640 0x55e340f85a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.757+0000 7f9e56a00640 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340f83640 0x55e340f85a30 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ddb8bdf1a1f036 server_cookie=da9b3aa09fe2c644 in_seq=0 out_seq=0 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.757+0000 7f9e44c00640 10 client.18747 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e44c00640 1 -- 172.21.15.7:0/3384924897 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e340edc320 con 0x55e340f83640 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e44c00640 10 client.18747 handle_command_reply: tid=0 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 client.18747 shutdown 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 msgr2=0x55e340f70fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 0x55e340f70fa0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009900 tx=0x7f9e40009260 comp rx=0 tx=0).stop 2024-04-23T15:29:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 shutdown_connections 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340f83640 0x55e340f85a30 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f735a0 0x55e340f70fa0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f68ce0 0x55e340f70a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 --2- 172.21.15.7:0/3384924897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f70520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 >> 172.21.15.7:0/3384924897 conn(0x55e340f648d0 msgr2=0x55e340f6a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e44c00640 0 client.18747 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 shutdown_connections 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 1 -- 172.21.15.7:0/3384924897 wait complete. 2024-04-23T15:29:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.759+0000 7f9e607e7740 20 client.18747 trim_cache size 0 max 16384 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.778+0000 7f9e607e7740 1 Processor -- start 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.778+0000 7f9e607e7740 1 -- start start 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 0x55e340f72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f68ce0 0x55e340f7f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 0x55e340f63910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e607e7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581b1550 con 0x55e340f683c0 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e607e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581b3090 con 0x55e340f68ce0 2024-04-23T15:29:36.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e607e7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581b1c20 con 0x55e340f735a0 2024-04-23T15:29:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 0x55e340f72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 0x55e340f72c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41646/0 (socket says 172.21.15.7:41646) 2024-04-23T15:29:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e4fe00640 1 -- 172.21.15.7:0/674287339 learned_addr learned my addr 172.21.15.7:0/674287339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.779+0000 7f9e56a00640 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f68ce0 0x55e340f7f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e4fe00640 1 -- 172.21.15.7:0/674287339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 msgr2=0x55e340f63910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 0x55e340f63910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e4fe00640 1 -- 172.21.15.7:0/674287339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f68ce0 msgr2=0x55e340f7f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f68ce0 0x55e340f7f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e4fe00640 1 -- 172.21.15.7:0/674287339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e340cad620 con 0x55e340f683c0 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 0x55e340f72c50 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f9e40005d00 tx=0x7f9e4002aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987d52ee35ac6c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e47400640 1 -- 172.21.15.7:0/674287339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40035070 con 0x55e340f683c0 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e47400640 1 -- 172.21.15.7:0/674287339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e40003c00 con 0x55e340f683c0 2024-04-23T15:29:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.780+0000 7f9e47400640 1 -- 172.21.15.7:0/674287339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e400314a0 con 0x55e340f683c0 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 -- 172.21.15.7:0/674287339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 msgr2=0x55e340f72c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 0x55e340f72c50 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f9e40005d00 tx=0x7f9e4002aab0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 -- 172.21.15.7:0/674287339 shutdown_connections 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f68ce0 0x55e340f7f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 0x55e340f63910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 --2- 172.21.15.7:0/674287339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f683c0 0x55e340f72c50 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 -- 172.21.15.7:0/674287339 >> 172.21.15.7:0/674287339 conn(0x55e340f648d0 msgr2=0x55e340f63200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.781+0000 7f9e607e7740 1 -- 172.21.15.7:0/674287339 shutdown_connections 2024-04-23T15:29:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.782+0000 7f9e607e7740 1 -- 172.21.15.7:0/674287339 wait complete. 2024-04-23T15:29:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.782+0000 7f9e607e7740 1 -- start start 2024-04-23T15:29:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.782+0000 7f9e607e7740 1 Processor -- start 2024-04-23T15:29:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f7bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f6d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 0x55e340f6d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581b29c0 con 0x55e340f68ce0 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581b22f0 con 0x55e340f683c0 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9e581af550 con 0x55e340f735a0 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e607e7740 10 client.0 _ll_register_callbacks cb 0x7f9e40009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f6d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f6d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41658/0 (socket says 172.21.15.7:41658) 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 -- 172.21.15.7:0/1557930779 learned_addr learned my addr 172.21.15.7:0/1557930779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f7bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 -- 172.21.15.7:0/1557930779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 msgr2=0x55e340f6d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 0x55e340f6d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 -- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 msgr2=0x55e340f7bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f7bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.783+0000 7f9e56a00640 1 -- 172.21.15.7:0/1557930779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e340fe8bb0 con 0x55e340f68ce0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.784+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f7bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.784+0000 7f9e56a00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f6d040 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f9e48010010 tx=0x7f9e4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf57d4cf614d17a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.784+0000 7f9e44c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.784+0000 7f9e44c00640 1 -- 172.21.15.7:0/1557930779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48015040 con 0x55e340f68ce0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.784+0000 7f9e44c00640 1 -- 172.21.15.7:0/1557930779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7f9e48005040 con 0x55e340f68ce0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.784+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e40003c00 con 0x55e340f68ce0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e44c00640 1 -- 172.21.15.7:0/1557930779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9e48035050 con 0x55e340f68ce0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 10 client.18753 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e340fe9d60 con 0x55e340f68ce0 2024-04-23T15:29:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e44c00640 1 -- 172.21.15.7:0/1557930779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e40003c00 con 0x55e340f68ce0 2024-04-23T15:29:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e44c00640 1 -- 172.21.15.7:0/1557930779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9e48027110 con 0x55e340f68ce0 2024-04-23T15:29:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 10 client.18753 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 10 client.18753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 20 client.18753 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340fea250 0x55e340fec670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 4 client.18753 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:29:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.785+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e340ed6190 con 0x55e340fea250 2024-04-23T15:29:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.786+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340fea250 0x55e340fec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.787+0000 7f9e4fe00640 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340fea250 0x55e340fec670 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf7eeb874d393d49 server_cookie=bffdd243e1fa65c8 in_seq=0 out_seq=0 2024-04-23T15:29:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.787+0000 7f9e44c00640 10 client.18753 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e44c00640 1 -- 172.21.15.7:0/1557930779 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e340ed6190 con 0x55e340fea250 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e44c00640 10 client.18753 handle_command_reply: tid=0 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e607e7740 1 client.18753 shutdown 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 msgr2=0x55e340f6d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e607e7740 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f6d040 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f9e48010010 tx=0x7f9e4800be30 comp rx=0 tx=0).stop 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 shutdown_connections 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e607e7740 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e340fea250 0x55e340fec670 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.817+0000 7f9e607e7740 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e340f735a0 0x55e340f6d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e607e7740 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e340f68ce0 0x55e340f6d040 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e607e7740 1 --2- 172.21.15.7:0/1557930779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e340f683c0 0x55e340f7bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e44c00640 0 client.18753 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 >> 172.21.15.7:0/1557930779 conn(0x55e340f648d0 msgr2=0x55e340f70d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 shutdown_connections 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e607e7740 1 -- 172.21.15.7:0/1557930779 wait complete. 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.818+0000 7f9e607e7740 20 client.18753 trim_cache size 0 max 16384 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:29:36.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:29:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9e3c0a3d90 msgr2=0x7f9e3c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9e3c0a3d90 0x7f9e3c0a6250 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e5009c8c0 tx=0x7f9e50009270 comp rx=0 tx=0).stop 2024-04-23T15:29:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 msgr2=0x7f9e5819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 0x7f9e5819ab10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000eaa0 tx=0x7f9e5000ef60 comp rx=0 tx=0).stop 2024-04-23T15:29:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 shutdown_connections 2024-04-23T15:29:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9e3c0a3d90 0x7f9e3c0a6250 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e5819a690 0x7f9e5819ab10 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e58109380 0x7f9e581a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 --2- 172.21.15.7:0/1941449281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e581042b0 0x7f9e581a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 >> 172.21.15.7:0/1941449281 conn(0x7f9e580ffb10 msgr2=0x7f9e58100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 shutdown_connections 2024-04-23T15:29:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:36.819+0000 7f9e57e00640 1 -- 172.21.15.7:0/1941449281 wait complete. 2024-04-23T15:29:36.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:36 smithi007 ceph-mon[27906]: pgmap v1212: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:29:36.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:36 smithi186 ceph-mon[31814]: pgmap v1212: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:29:36.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:36 smithi137 ceph-mon[31694]: pgmap v1212: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:29:38.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:38 smithi007 ceph-mon[27906]: pgmap v1213: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:29:38.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:38 smithi186 ceph-mon[31814]: pgmap v1213: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:29:38.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:38 smithi137 ceph-mon[31694]: pgmap v1213: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:29:40.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:40 smithi007 ceph-mon[27906]: pgmap v1214: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:29:40.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:40 smithi186 ceph-mon[31814]: pgmap v1214: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:29:40.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:40 smithi137 ceph-mon[31694]: pgmap v1214: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:29:42.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:42 smithi007 ceph-mon[27906]: pgmap v1215: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:29:42.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:42 smithi186 ceph-mon[31814]: pgmap v1215: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:29:42.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:42 smithi137 ceph-mon[31694]: pgmap v1215: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:29:44.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:44 smithi186 ceph-mon[31814]: pgmap v1216: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:44.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:44 smithi137 ceph-mon[31694]: pgmap v1216: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:45.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:44 smithi007 ceph-mon[27906]: pgmap v1216: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:46.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:46 smithi186 ceph-mon[31814]: pgmap v1217: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:46.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:46 smithi137 ceph-mon[31694]: pgmap v1217: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:47.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:46 smithi007 ceph-mon[27906]: pgmap v1217: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:48.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:48 smithi186 ceph-mon[31814]: pgmap v1218: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:29:48.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:48 smithi137 ceph-mon[31694]: pgmap v1218: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:29:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:48 smithi007 ceph-mon[27906]: pgmap v1218: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.974+0000 7fcca3200640 1 -- 172.21.15.7:0/3526403055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca4102090 msgr2=0x7fcca4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.974+0000 7fcca3200640 1 --2- 172.21.15.7:0/3526403055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca4102090 0x7fcca4102470 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009900 tx=0x7fcc9402a410 comp rx=0 tx=0).stop 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 -- 172.21.15.7:0/3526403055 shutdown_connections 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 --2- 172.21.15.7:0/3526403055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcca4107160 0x7fcca410ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 --2- 172.21.15.7:0/3526403055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca4102a40 0x7fcca4106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 --2- 172.21.15.7:0/3526403055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca4102090 0x7fcca4102470 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 -- 172.21.15.7:0/3526403055 >> 172.21.15.7:0/3526403055 conn(0x7fcca40fd950 msgr2=0x7fcca40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 -- 172.21.15.7:0/3526403055 shutdown_connections 2024-04-23T15:29:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.975+0000 7fcca3200640 1 -- 172.21.15.7:0/3526403055 wait complete. 2024-04-23T15:29:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.976+0000 7fcca3200640 1 Processor -- start 2024-04-23T15:29:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.976+0000 7fcca3200640 1 -- start start 2024-04-23T15:29:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.976+0000 7fcca3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca4102090 0x7fcca41a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.976+0000 7fcca3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcca4107160 0x7fcca41a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 0x7fcca419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4112110 con 0x7fcca419a6c0 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4111f90 con 0x7fcca4107160 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4112290 con 0x7fcca4102090 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 0x7fcca419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 0x7fcca419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37138/0 (socket says 172.21.15.7:37138) 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca2800640 1 -- 172.21.15.7:0/3184964974 learned_addr learned my addr 172.21.15.7:0/3184964974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca1e00640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca4102090 0x7fcca41a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.977+0000 7fcca1400640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcca4107160 0x7fcca41a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca2800640 1 -- 172.21.15.7:0/3184964974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca4102090 msgr2=0x7fcca41a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca2800640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca4102090 0x7fcca41a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca2800640 1 -- 172.21.15.7:0/3184964974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcca4107160 msgr2=0x7fcca41a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca2800640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcca4107160 0x7fcca41a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca2800640 1 -- 172.21.15.7:0/3184964974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca419b2c0 con 0x7fcca419a6c0 2024-04-23T15:29:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca2800640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 0x7fcca419ab40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00eb10 tx=0x7fcc9c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcc9aa00640 1 -- 172.21.15.7:0/3184964974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c004b20 con 0x7fcca419a6c0 2024-04-23T15:29:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcc9aa00640 1 -- 172.21.15.7:0/3184964974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc9c004cc0 con 0x7fcca419a6c0 2024-04-23T15:29:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcc9aa00640 1 -- 172.21.15.7:0/3184964974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c010690 con 0x7fcca419a6c0 2024-04-23T15:29:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.978+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca41a73a0 con 0x7fcca419a6c0 2024-04-23T15:29:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.979+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca41a77a0 con 0x7fcca419a6c0 2024-04-23T15:29:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.982+0000 7fccabdde740 1 Processor -- start 2024-04-23T15:29:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.982+0000 7fcc9aa00640 1 -- 172.21.15.7:0/3184964974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fcc9c005020 con 0x7fcca419a6c0 2024-04-23T15:29:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.982+0000 7fccabdde740 1 -- start start 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fccabdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e7716037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fccabdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e77160e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fccabdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e77160e5a0 0x55e771610990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fccabdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e771569900 con 0x55e771603ce0 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fccabdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e77150ff20 con 0x55e7716033c0 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fccabdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e7715658c0 con 0x55e77160e5a0 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e77160e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e77160e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37144/0 (socket says 172.21.15.7:37144) 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.983+0000 7fcca1e00640 1 -- 172.21.15.7:0/2932736840 learned_addr learned my addr 172.21.15.7:0/2932736840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1400640 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e7716037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1400640 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e77160e5a0 0x55e771610990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1e00640 1 -- 172.21.15.7:0/2932736840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e77160e5a0 msgr2=0x55e771610990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1e00640 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e77160e5a0 0x55e771610990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1e00640 1 -- 172.21.15.7:0/2932736840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 msgr2=0x55e7716037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1e00640 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e7716037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1e00640 1 -- 172.21.15.7:0/2932736840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e771534e10 con 0x55e771603ce0 2024-04-23T15:29:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcca1e00640 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e77160e060 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fcc94000c00 tx=0x7fcc94004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fbb4a61e33e3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.984+0000 7fcc9aa00640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcc880a3d90 0x7fcc880a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.985+0000 7fcc9aa00640 1 -- 172.21.15.7:0/3184964974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7fcc9c0d1090 con 0x7fcca419a6c0 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.985+0000 7fcc8f400640 1 -- 172.21.15.7:0/2932736840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94035040 con 0x55e771603ce0 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.985+0000 7fcca1400640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcc880a3d90 0x7fcc880a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.985+0000 7fcc8f400640 1 -- 172.21.15.7:0/2932736840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc940054f0 con 0x55e771603ce0 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.985+0000 7fcc8f400640 1 -- 172.21.15.7:0/2932736840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc940035f0 con 0x55e771603ce0 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 -- 172.21.15.7:0/2932736840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 msgr2=0x55e77160e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e77160e060 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fcc94000c00 tx=0x7fcc94004170 comp rx=0 tx=0).stop 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fcca1400640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcc880a3d90 0x7fcc880a6250 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e771600cf0 tx=0x7fcc90014040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 -- 172.21.15.7:0/2932736840 shutdown_connections 2024-04-23T15:29:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e77160e5a0 0x55e771610990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e77160e060 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 --2- 172.21.15.7:0/2932736840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e7716037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 -- 172.21.15.7:0/2932736840 >> 172.21.15.7:0/2932736840 conn(0x55e7715ff8d0 msgr2=0x55e7715ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 -- 172.21.15.7:0/2932736840 shutdown_connections 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.986+0000 7fccabdde740 1 -- 172.21.15.7:0/2932736840 wait complete. 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 -- start start 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 Processor -- start 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e77160b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e771603ce0 0x55e77160baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.992 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e77160bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e7716110e0 con 0x55e77160e5a0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e7715232c0 con 0x55e7716033c0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55e771611260 con 0x55e771603ce0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.987+0000 7fccabdde740 10 client.0 _ll_register_callbacks cb 0x55e77127ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e77160bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e77160bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37150/0 (socket says 172.21.15.7:37150) 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 -- 172.21.15.7:0/4035169715 learned_addr learned my addr 172.21.15.7:0/4035169715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca1400640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e771603ce0 0x55e77160baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca1e00640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e77160b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 -- 172.21.15.7:0/4035169715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e771603ce0 msgr2=0x55e77160baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e771603ce0 0x55e77160baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 -- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 msgr2=0x55e77160b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e77160b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.988+0000 7fcca2800640 1 -- 172.21.15.7:0/4035169715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e771533fd0 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fcca2800640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e77160bfe0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0a5360 tx=0x7fcc9c09c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfac2fad2458c2e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fcc83e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fcc83e00640 1 -- 172.21.15.7:0/4035169715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0a0fd0 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fcc83e00640 1 -- 172.21.15.7:0/4035169715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7fcc9c0a5400 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc940054f0 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fcc83e00640 1 -- 172.21.15.7:0/4035169715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcc9c0a5890 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fccabdde740 10 client.18765 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e77127c210 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.989+0000 7fcc83e00640 1 -- 172.21.15.7:0/4035169715 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc940054f0 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fcc83e00640 1 -- 172.21.15.7:0/4035169715 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fcc9c0ceb20 con 0x55e77160e5a0 2024-04-23T15:29:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fccabdde740 10 client.18765 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fccabdde740 10 client.18765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fccabdde740 20 client.18765 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fccabdde740 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e77161e7f0 0x55e771620c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fccabdde740 4 client.18765 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:29:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e771577320 con 0x55e77161e7f0 2024-04-23T15:29:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.990+0000 7fcca1e00640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e77161e7f0 0x55e771620c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.992+0000 7fcca1e00640 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e77161e7f0 0x55e771620c00 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b226246f83ae5aa8 server_cookie=a9f97cdf4d06f100 in_seq=0 out_seq=0 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.992+0000 7fcc83e00640 10 client.18765 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.993+0000 7fcc83e00640 1 -- 172.21.15.7:0/4035169715 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e771577320 con 0x55e77161e7f0 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.993+0000 7fcc83e00640 10 client.18765 handle_command_reply: tid=0 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.993+0000 7fccabdde740 1 client.18765 shutdown 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 msgr2=0x55e77160bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e77160bfe0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0a5360 tx=0x7fcc9c09c640 comp rx=0 tx=0).stop 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 shutdown_connections 2024-04-23T15:29:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e77161e7f0 0x55e771620c00 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e77160bfe0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e771603ce0 0x55e77160baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 --2- 172.21.15.7:0/4035169715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7716033c0 0x55e77160b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fcc83e00640 0 client.18765 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 >> 172.21.15.7:0/4035169715 conn(0x55e7715ff8d0 msgr2=0x55e771605650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 shutdown_connections 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 1 -- 172.21.15.7:0/4035169715 wait complete. 2024-04-23T15:29:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:49.994+0000 7fccabdde740 20 client.18765 trim_cache size 0 max 16384 2024-04-23T15:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.014+0000 7fccabdde740 1 Processor -- start 2024-04-23T15:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.014+0000 7fccabdde740 1 -- start start 2024-04-23T15:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.014+0000 7fccabdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e77161a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.014+0000 7fccabdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e771605dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fccabdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e77160e5a0 0x55e771626510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fccabdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41b14c0 con 0x55e771603ce0 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fccabdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41b3000 con 0x55e77160e5a0 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fccabdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41b1b90 con 0x55e7716033c0 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e771605dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e771605dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37164/0 (socket says 172.21.15.7:37164) 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 -- 172.21.15.7:0/2845368913 learned_addr learned my addr 172.21.15.7:0/2845368913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1e00640 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e77161a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca2800640 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e77160e5a0 0x55e771626510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 -- 172.21.15.7:0/2845368913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 msgr2=0x55e77161a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e77161a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 -- 172.21.15.7:0/2845368913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e77160e5a0 msgr2=0x55e771626510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e77160e5a0 0x55e771626510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.015+0000 7fcca1400640 1 -- 172.21.15.7:0/2845368913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e771348620 con 0x55e771603ce0 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.016+0000 7fcca1400640 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e771605dd0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fcca419bf10 tx=0x7fcc90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fbfa1399d00046 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.016+0000 7fcc8ea00640 1 -- 172.21.15.7:0/2845368913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90018030 con 0x55e771603ce0 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.016+0000 7fcc8ea00640 1 -- 172.21.15.7:0/2845368913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc9001a070 con 0x55e771603ce0 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.016+0000 7fcc8ea00640 1 -- 172.21.15.7:0/2845368913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9002a780 con 0x55e771603ce0 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 -- 172.21.15.7:0/2845368913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 msgr2=0x55e771605dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e771605dd0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fcca419bf10 tx=0x7fcc90017000 comp rx=0 tx=0).stop 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 -- 172.21.15.7:0/2845368913 shutdown_connections 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e77160e5a0 0x55e771626510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e771603ce0 0x55e771605dd0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 --2- 172.21.15.7:0/2845368913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e77161a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 -- 172.21.15.7:0/2845368913 >> 172.21.15.7:0/2845368913 conn(0x55e7715ff8d0 msgr2=0x55e7715fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 -- 172.21.15.7:0/2845368913 shutdown_connections 2024-04-23T15:29:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.017+0000 7fccabdde740 1 -- 172.21.15.7:0/2845368913 wait complete. 2024-04-23T15:29:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 -- start start 2024-04-23T15:29:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 Processor -- start 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e7716165f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e771603ce0 0x55e771616b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e7716135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41b2930 con 0x55e77160e5a0 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41b2260 con 0x55e771603ce0 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.018+0000 7fccabdde740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcca41af4c0 con 0x55e7716033c0 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fccabdde740 10 client.0 _ll_register_callbacks cb 0x7fcc9c09ca60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e7716135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e7716135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37172/0 (socket says 172.21.15.7:37172) 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 -- 172.21.15.7:0/723782006 learned_addr learned my addr 172.21.15.7:0/723782006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca1400640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e771603ce0 0x55e771616b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca1e00640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e7716165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 -- 172.21.15.7:0/723782006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 msgr2=0x55e7716165f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e7716165f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 -- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e771603ce0 msgr2=0x55e771616b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e771603ce0 0x55e771616b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.019+0000 7fcca2800640 1 -- 172.21.15.7:0/723782006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e771613bd0 con 0x55e77160e5a0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fcca2800640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e7716135c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0cef80 tx=0x7fcc9c09cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf9b4a127a0d1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fcc83e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fcc83e00640 1 -- 172.21.15.7:0/723782006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c098970 con 0x55e77160e5a0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fcc83e00640 1 -- 172.21.15.7:0/723782006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7fcc9c0bd0b0 con 0x55e77160e5a0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc9001a070 con 0x55e77160e5a0 2024-04-23T15:29:50.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fcc83e00640 1 -- 172.21.15.7:0/723782006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcc9c09c760 con 0x55e77160e5a0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fccabdde740 10 client.18771 fetch_fsmap learned FSMap version 32 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.020+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e7716856a0 con 0x55e77160e5a0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fcc83e00640 1 -- 172.21.15.7:0/723782006 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc9001a070 con 0x55e77160e5a0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fcc83e00640 1 -- 172.21.15.7:0/723782006 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fcc9c0a5490 con 0x55e77160e5a0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fccabdde740 10 client.18771 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fccabdde740 10 client.18771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fccabdde740 20 client.18771 populate_metadata read hostname 'smithi007' 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fccabdde740 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e771685de0 0x55e771688200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fccabdde740 4 client.18771 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.021+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e771571190 con 0x55e771685de0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.022+0000 7fcca1e00640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e771685de0 0x55e771688200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.022+0000 7fcca1e00640 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e771685de0 0x55e771688200 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ff3e53ecaf5753 server_cookie=b6f93fcaefb41a8e in_seq=0 out_seq=0 2024-04-23T15:29:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.022+0000 7fcc83e00640 10 client.18771 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.055+0000 7fcc83e00640 1 -- 172.21.15.7:0/723782006 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e771571190 con 0x55e771685de0 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.055+0000 7fcc83e00640 10 client.18771 handle_command_reply: tid=0 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.055+0000 7fccabdde740 1 client.18771 shutdown 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.055+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 msgr2=0x55e7716135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.055+0000 7fccabdde740 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e7716135c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0cef80 tx=0x7fcc9c09cce0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 shutdown_connections 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55e771685de0 0x55e771688200 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e771603ce0 0x55e771616b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e77160e5a0 0x55e7716135c0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 --2- 172.21.15.7:0/723782006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7716033c0 0x55e7716165f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 >> 172.21.15.7:0/723782006 conn(0x55e7715ff8d0 msgr2=0x55e77160b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fcc83e00640 0 client.18771 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 shutdown_connections 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 1 -- 172.21.15.7:0/723782006 wait complete. 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.056+0000 7fccabdde740 20 client.18771 trim_cache size 0 max 16384 2024-04-23T15:29:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:29:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:29:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:29:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:29:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcc880a3d90 msgr2=0x7fcc880a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcc880a3d90 0x7fcc880a6250 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e771600cf0 tx=0x7fcc90014040 comp rx=0 tx=0).stop 2024-04-23T15:29:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 msgr2=0x7fcca419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 0x7fcca419ab40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00eb10 tx=0x7fcc9c00c2d0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 shutdown_connections 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcc880a3d90 0x7fcc880a6250 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcca4107160 0x7fcca41a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcca419a6c0 0x7fcca419ab40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 --2- 172.21.15.7:0/3184964974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca4102090 0x7fcca41a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.057+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 >> 172.21.15.7:0/3184964974 conn(0x7fcca40fd950 msgr2=0x7fcca40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.058+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 shutdown_connections 2024-04-23T15:29:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:29:50.058+0000 7fcca3200640 1 -- 172.21.15.7:0/3184964974 wait complete. 2024-04-23T15:29:50.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:50 smithi186 ceph-mon[31814]: pgmap v1219: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:50 smithi137 ceph-mon[31694]: pgmap v1219: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:50 smithi007 ceph-mon[27906]: pgmap v1219: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:52 smithi137 ceph-mon[31694]: pgmap v1220: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2024-04-23T15:29:53.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:52 smithi007 ceph-mon[27906]: pgmap v1220: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2024-04-23T15:29:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:52 smithi186 ceph-mon[31814]: pgmap v1220: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2024-04-23T15:29:54.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:54 smithi137 ceph-mon[31694]: pgmap v1221: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:54 smithi007 ceph-mon[27906]: pgmap v1221: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:55.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:54 smithi186 ceph-mon[31814]: pgmap v1221: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:56.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:56 smithi137 ceph-mon[31694]: pgmap v1222: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:57.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:56 smithi007 ceph-mon[27906]: pgmap v1222: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:57.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:56 smithi186 ceph-mon[31814]: pgmap v1222: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:29:58.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:29:58 smithi137 ceph-mon[31694]: pgmap v1223: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:29:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:29:58 smithi007 ceph-mon[27906]: pgmap v1223: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:29:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:29:58 smithi186 ceph-mon[31814]: pgmap v1223: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:30:00.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:00 smithi137 ceph-mon[31694]: pgmap v1224: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:00.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T15:30:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:00 smithi007 ceph-mon[27906]: pgmap v1224: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T15:30:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:00 smithi186 ceph-mon[31814]: pgmap v1224: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T15:30:02.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:02 smithi137 ceph-mon[31694]: pgmap v1225: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 35 op/s 2024-04-23T15:30:03.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:02 smithi007 ceph-mon[27906]: pgmap v1225: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 35 op/s 2024-04-23T15:30:03.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:02 smithi186 ceph-mon[31814]: pgmap v1225: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 35 op/s 2024-04-23T15:30:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 -- 172.21.15.7:0/3361567655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 msgr2=0x7fbc48104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 --2- 172.21.15.7:0/3361567655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc48104840 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009900 tx=0x7fbc3c02a410 comp rx=0 tx=0).stop 2024-04-23T15:30:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 -- 172.21.15.7:0/3361567655 shutdown_connections 2024-04-23T15:30:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 --2- 172.21.15.7:0/3361567655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc48104e10 0x7fbc48108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 --2- 172.21.15.7:0/3361567655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc48109530 0x7fbc48111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 --2- 172.21.15.7:0/3361567655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc48104840 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 -- 172.21.15.7:0/3361567655 >> 172.21.15.7:0/3361567655 conn(0x7fbc480ffd00 msgr2=0x7fbc48102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 -- 172.21.15.7:0/3361567655 shutdown_connections 2024-04-23T15:30:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.229+0000 7fbc50200640 1 -- 172.21.15.7:0/3361567655 wait complete. 2024-04-23T15:30:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.230+0000 7fbc50200640 1 Processor -- start 2024-04-23T15:30:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.230+0000 7fbc50200640 1 -- start start 2024-04-23T15:30:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc50200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc4819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc50200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc48109530 0x7fbc4819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc50200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc4819f330 0x7fbc4819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc50200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481144a0 con 0x7fbc48104460 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc50200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc48114320 con 0x7fbc48109530 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc50200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbc48114620 con 0x7fbc4819f330 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc4d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc4819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc4d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc4819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48782/0 (socket says 172.21.15.7:48782) 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.231+0000 7fbc4d800640 1 -- 172.21.15.7:0/983983007 learned_addr learned my addr 172.21.15.7:0/983983007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc48109530 0x7fbc4819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4e200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc4819f330 0x7fbc4819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4d800640 1 -- 172.21.15.7:0/983983007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc4819f330 msgr2=0x7fbc4819f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4d800640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc4819f330 0x7fbc4819f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4d800640 1 -- 172.21.15.7:0/983983007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc48109530 msgr2=0x7fbc4819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4d800640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc48109530 0x7fbc4819af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4d800640 1 -- 172.21.15.7:0/983983007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4819fe20 con 0x7fbc48104460 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.232+0000 7fbc4d800640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc4819aa40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c005940 tx=0x7fbc3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.233+0000 7fbc46000640 1 -- 172.21.15.7:0/983983007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c03f030 con 0x7fbc48104460 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.233+0000 7fbc46000640 1 -- 172.21.15.7:0/983983007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc3c003aa0 con 0x7fbc48104460 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.233+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc481a00b0 con 0x7fbc48104460 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.233+0000 7fbc46000640 1 -- 172.21.15.7:0/983983007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c035070 con 0x7fbc48104460 2024-04-23T15:30:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.233+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc481a78d0 con 0x7fbc48104460 2024-04-23T15:30:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 Processor -- start 2024-04-23T15:30:03.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 -- start start 2024-04-23T15:30:03.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc46000640 1 -- 172.21.15.7:0/983983007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbc3c042030 con 0x7fbc48104460 2024-04-23T15:30:03.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f85e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f88780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564661ee1900 con 0x564661f86390 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564661e87f20 con 0x564661f7b1b0 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.238+0000 7fbc5301d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564661edd8c0 con 0x564661f7bad0 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f88780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f88780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48792/0 (socket says 172.21.15.7:48792) 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 -- 172.21.15.7:0/3950160919 learned_addr learned my addr 172.21.15.7:0/3950160919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4d800640 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f85e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4e200640 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 -- 172.21.15.7:0/3950160919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 msgr2=0x564661f85e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f85e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 -- 172.21.15.7:0/3950160919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 msgr2=0x564661f7b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4ce00640 1 -- 172.21.15.7:0/3950160919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564661eace10 con 0x564661f86390 2024-04-23T15:30:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.239+0000 7fbc4e200640 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.240+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f88780 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806b790 tx=0x7fbc340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abdb89f505366e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.240+0000 7fbc46000640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbc300a3e40 0x7fbc300a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.240+0000 7fbc3aa00640 1 -- 172.21.15.7:0/3950160919 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401c480 con 0x564661f86390 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.240+0000 7fbc3aa00640 1 -- 172.21.15.7:0/3950160919 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc3401cad0 con 0x564661f86390 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.240+0000 7fbc3aa00640 1 -- 172.21.15.7:0/3950160919 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34011bb0 con 0x564661f86390 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.241+0000 7fbc46000640 1 -- 172.21.15.7:0/983983007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7fbc3c0f11e0 con 0x7fbc48104460 2024-04-23T15:30:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.241+0000 7fbc4e200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbc300a3e40 0x7fbc300a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.241+0000 7fbc5301d740 1 -- 172.21.15.7:0/3950160919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 msgr2=0x564661f88780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.241+0000 7fbc5301d740 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f88780 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806b790 tx=0x7fbc340107a0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 -- 172.21.15.7:0/3950160919 shutdown_connections 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f88780 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f85e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 --2- 172.21.15.7:0/3950160919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 -- 172.21.15.7:0/3950160919 >> 172.21.15.7:0/3950160919 conn(0x564661f776c0 msgr2=0x564661f77aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc4e200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbc300a3e40 0x7fbc300a6300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc40005fd0 tx=0x7fbc40009600 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 -- 172.21.15.7:0/3950160919 shutdown_connections 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 -- 172.21.15.7:0/3950160919 wait complete. 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 -- start start 2024-04-23T15:30:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.242+0000 7fbc5301d740 1 Processor -- start 2024-04-23T15:30:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 0x564661f83300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f83840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f86390 0x564661f83d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564661f88fc0 con 0x564661f7b1b0 2024-04-23T15:30:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564661e9b2c0 con 0x564661f86390 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564661f89140 con 0x564661f7bad0 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc5301d740 10 client.0 _ll_register_callbacks cb 0x564661bf3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc4d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 0x564661f83300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc4d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 0x564661f83300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48798/0 (socket says 172.21.15.7:48798) 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.243+0000 7fbc4d800640 1 -- 172.21.15.7:0/4081941779 learned_addr learned my addr 172.21.15.7:0/4081941779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f83840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4d800640 1 -- 172.21.15.7:0/4081941779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 msgr2=0x564661f83840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4d800640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f83840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4d800640 1 -- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f86390 msgr2=0x564661f83d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4e200640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f86390 0x564661f83d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4d800640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f86390 0x564661f83d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4d800640 1 -- 172.21.15.7:0/4081941779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564661eabfd0 con 0x564661f7b1b0 2024-04-23T15:30:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4e200640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f86390 0x564661f83d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc4d800640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 0x564661f83300 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c006010 tx=0x7fbc3c0b8a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b8194d142d8156 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.244+0000 7fbc2f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc2f400640 1 -- 172.21.15.7:0/4081941779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c049050 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc2f400640 1 -- 172.21.15.7:0/4081941779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7fbc3c0ee800 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc3401cad0 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc2f400640 1 -- 172.21.15.7:0/4081941779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbc3c0bc7e0 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc5301d740 10 client.18783 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564661bf4210 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc2f400640 1 -- 172.21.15.7:0/4081941779 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc3401cad0 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.245+0000 7fbc2f400640 1 -- 172.21.15.7:0/4081941779 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbc3c0b94f0 con 0x564661f7b1b0 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc5301d740 10 client.18783 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc5301d740 10 client.18783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc5301d740 20 client.18783 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc5301d740 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661f96450 0x564661f988a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.248 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc5301d740 4 client.18783 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:30:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564661eef320 con 0x564661f96450 2024-04-23T15:30:03.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.246+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661f96450 0x564661f988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.247+0000 7fbc2f400640 10 client.18783 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.247+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661f96450 0x564661f988a0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34505cd7bebe1766 server_cookie=5760a9beb8cf2e70 in_seq=0 out_seq=0 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc2f400640 1 -- 172.21.15.7:0/4081941779 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564661eef320 con 0x564661f96450 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc2f400640 10 client.18783 handle_command_reply: tid=0 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc5301d740 1 client.18783 shutdown 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 msgr2=0x564661f83300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc5301d740 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 0x564661f83300 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c006010 tx=0x7fbc3c0b8a00 comp rx=0 tx=0).stop 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 shutdown_connections 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.249+0000 7fbc5301d740 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661f96450 0x564661f988a0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f86390 0x564661f83d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f83840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 1 --2- 172.21.15.7:0/4081941779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f7b1b0 0x564661f83300 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 >> 172.21.15.7:0/4081941779 conn(0x564661f776c0 msgr2=0x564661f7d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc2f400640 0 client.18783 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 shutdown_connections 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 1 -- 172.21.15.7:0/4081941779 wait complete. 2024-04-23T15:30:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.250+0000 7fbc5301d740 20 client.18783 trim_cache size 0 max 16384 2024-04-23T15:30:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.269+0000 7fbc5301d740 1 Processor -- start 2024-04-23T15:30:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.269+0000 7fbc5301d740 1 -- start start 2024-04-23T15:30:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f91e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f76fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f9e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc5301d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481b14e0 con 0x564661f86390 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc5301d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481b3020 con 0x564661f7b1b0 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc5301d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481b1bb0 con 0x564661f7bad0 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc4e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f9e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc4e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f9e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48810/0 (socket says 172.21.15.7:48810) 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc4e200640 1 -- 172.21.15.7:0/313048842 learned_addr learned my addr 172.21.15.7:0/313048842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.270+0000 7fbc4d800640 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f91e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f76fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4e200640 1 -- 172.21.15.7:0/313048842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 msgr2=0x564661f76fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4e200640 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f76fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4e200640 1 -- 172.21.15.7:0/313048842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 msgr2=0x564661f91e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4e200640 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f91e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4e200640 1 -- 172.21.15.7:0/313048842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564661cc0620 con 0x564661f86390 2024-04-23T15:30:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.271+0000 7fbc4e200640 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f9e180 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbc400105d0 tx=0x7fbc40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffd68406b9b93cc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.272+0000 7fbc3a000640 1 -- 172.21.15.7:0/313048842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40004b20 con 0x564661f86390 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.272+0000 7fbc3a000640 1 -- 172.21.15.7:0/313048842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc40004cc0 con 0x564661f86390 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.272+0000 7fbc3a000640 1 -- 172.21.15.7:0/313048842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40005310 con 0x564661f86390 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 -- 172.21.15.7:0/313048842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 msgr2=0x564661f9e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f9e180 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fbc400105d0 tx=0x7fbc40015000 comp rx=0 tx=0).stop 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 -- 172.21.15.7:0/313048842 shutdown_connections 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f9e180 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f76fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 --2- 172.21.15.7:0/313048842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f91e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 -- 172.21.15.7:0/313048842 >> 172.21.15.7:0/313048842 conn(0x564661f776c0 msgr2=0x564661f7e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 -- 172.21.15.7:0/313048842 shutdown_connections 2024-04-23T15:30:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 -- 172.21.15.7:0/313048842 wait complete. 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 -- start start 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.273+0000 7fbc5301d740 1 Processor -- start 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f80a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481b2950 con 0x564661f86390 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481b2280 con 0x564661f7b1b0 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481af4e0 con 0x564661f7bad0 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc5301d740 10 client.0 _ll_register_callbacks cb 0x7fbc3c032a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc4e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f80a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc4e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f80a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48826/0 (socket says 172.21.15.7:48826) 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.274+0000 7fbc4e200640 1 -- 172.21.15.7:0/2838423950 learned_addr learned my addr 172.21.15.7:0/2838423950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4d800640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4ce00640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4e200640 1 -- 172.21.15.7:0/2838423950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 msgr2=0x564661f804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4e200640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4e200640 1 -- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 msgr2=0x564661f7ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4e200640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4e200640 1 -- 172.21.15.7:0/2838423950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564661ffba20 con 0x564661f86390 2024-04-23T15:30:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc4e200640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f80a10 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fbc40027040 tx=0x7fbc4001cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f4056d8f52fb68 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.275+0000 7fbc2f400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc2f400640 1 -- 172.21.15.7:0/2838423950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4001c6c0 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc40004cc0 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc2f400640 1 -- 172.21.15.7:0/2838423950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9467+0+0 (secure 0 0 0) 0x7fbc4001c860 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc2f400640 1 -- 172.21.15.7:0/2838423950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbc40005090 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc5301d740 10 client.18789 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564661ffcd10 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc2f400640 1 -- 172.21.15.7:0/2838423950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc40004cc0 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.276+0000 7fbc2f400640 1 -- 172.21.15.7:0/2838423950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbc40037030 con 0x564661f86390 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc5301d740 10 client.18789 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc5301d740 10 client.18789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc5301d740 20 client.18789 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc5301d740 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661ffd460 0x564661fff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc5301d740 4 client.18789 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:30:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564661ee9190 con 0x564661ffd460 2024-04-23T15:30:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.277+0000 7fbc4d800640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661ffd460 0x564661fff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.278+0000 7fbc4d800640 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661ffd460 0x564661fff880 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f71bd9b2ae7714c server_cookie=fdfa721312c8cacb in_seq=0 out_seq=0 2024-04-23T15:30:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.278+0000 7fbc2f400640 10 client.18789 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc2f400640 1 -- 172.21.15.7:0/2838423950 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564661ee9190 con 0x564661ffd460 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc2f400640 10 client.18789 handle_command_reply: tid=0 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 client.18789 shutdown 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 msgr2=0x564661f80a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f80a10 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fbc40027040 tx=0x7fbc4001cda0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 shutdown_connections 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564661ffd460 0x564661fff880 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564661f86390 0x564661f80a10 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564661f7bad0 0x564661f804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc2f400640 0 client.18789 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 --2- 172.21.15.7:0/2838423950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564661f7b1b0 0x564661f7ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 >> 172.21.15.7:0/2838423950 conn(0x564661f776c0 msgr2=0x564661f7cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 shutdown_connections 2024-04-23T15:30:03.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.313+0000 7fbc5301d740 1 -- 172.21.15.7:0/2838423950 wait complete. 2024-04-23T15:30:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.314+0000 7fbc5301d740 20 client.18789 trim_cache size 0 max 16384 2024-04-23T15:30:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:30:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:30:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:30:03.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.314+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbc300a3e40 msgr2=0x7fbc300a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.314+0000 7fbc50200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbc300a3e40 0x7fbc300a6300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc40005fd0 tx=0x7fbc40009600 comp rx=0 tx=0).stop 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.314+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 msgr2=0x7fbc4819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.314+0000 7fbc50200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc4819aa40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c005940 tx=0x7fbc3c004270 comp rx=0 tx=0).stop 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 shutdown_connections 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbc300a3e40 0x7fbc300a6300 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc48109530 0x7fbc4819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc4819f330 0x7fbc4819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 --2- 172.21.15.7:0/983983007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc48104460 0x7fbc4819aa40 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 >> 172.21.15.7:0/983983007 conn(0x7fbc480ffd00 msgr2=0x7fbc481010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:03.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 shutdown_connections 2024-04-23T15:30:03.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:03.315+0000 7fbc50200640 1 -- 172.21.15.7:0/983983007 wait complete. 2024-04-23T15:30:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:04 smithi137 ceph-mon[31694]: pgmap v1226: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-04-23T15:30:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:04 smithi007 ceph-mon[27906]: pgmap v1226: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-04-23T15:30:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:04 smithi186 ceph-mon[31814]: pgmap v1226: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-04-23T15:30:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:06 smithi137 ceph-mon[31694]: pgmap v1227: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-04-23T15:30:06.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:06 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:30:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:06 smithi007 ceph-mon[27906]: pgmap v1227: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-04-23T15:30:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:06 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:30:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:06 smithi186 ceph-mon[31814]: pgmap v1227: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.2 MiB/s wr, 27 op/s 2024-04-23T15:30:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:06 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:30:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:30:07.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:30:07.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:07 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:30:08.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:30:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:30:08.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:07 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:30:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:30:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:30:08.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:07 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:30:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:08 smithi007 ceph-mon[27906]: pgmap v1228: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:30:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:08 smithi007 ceph-mon[27906]: osdmap e157: 12 total, 12 up, 12 in 2024-04-23T15:30:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:08 smithi186 ceph-mon[31814]: pgmap v1228: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:30:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:08 smithi186 ceph-mon[31814]: osdmap e157: 12 total, 12 up, 12 in 2024-04-23T15:30:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:08 smithi137 ceph-mon[31694]: pgmap v1228: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:30:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:08 smithi137 ceph-mon[31694]: osdmap e157: 12 total, 12 up, 12 in 2024-04-23T15:30:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:10 smithi007 ceph-mon[27906]: pgmap v1230: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:30:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:10 smithi186 ceph-mon[31814]: pgmap v1230: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:30:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:10 smithi137 ceph-mon[31694]: pgmap v1230: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.3 MiB/s wr, 37 op/s 2024-04-23T15:30:13.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:12 smithi007 ceph-mon[27906]: pgmap v1231: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:13.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:12 smithi186 ceph-mon[31814]: pgmap v1231: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:12 smithi137 ceph-mon[31694]: pgmap v1231: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:15.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:14 smithi007 ceph-mon[27906]: pgmap v1232: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:14 smithi186 ceph-mon[31814]: pgmap v1232: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:14 smithi137 ceph-mon[31694]: pgmap v1232: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 -- 172.21.15.7:0/3304810390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c074d50 msgr2=0x7fb88c10e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 --2- 172.21.15.7:0/3304810390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c074d50 0x7fb88c10e100 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fb878009900 tx=0x7fb87802a480 comp rx=0 tx=0).stop 2024-04-23T15:30:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 -- 172.21.15.7:0/3304810390 shutdown_connections 2024-04-23T15:30:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 --2- 172.21.15.7:0/3304810390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb88c10e640 0x7fb88c110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 --2- 172.21.15.7:0/3304810390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c074d50 0x7fb88c10e100 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 --2- 172.21.15.7:0/3304810390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb88c074430 0x7fb88c074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 -- 172.21.15.7:0/3304810390 >> 172.21.15.7:0/3304810390 conn(0x7fb88c0fd950 msgr2=0x7fb88c0ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 -- 172.21.15.7:0/3304810390 shutdown_connections 2024-04-23T15:30:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.469+0000 7fb890a00640 1 -- 172.21.15.7:0/3304810390 wait complete. 2024-04-23T15:30:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.470+0000 7fb890a00640 1 Processor -- start 2024-04-23T15:30:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.470+0000 7fb890a00640 1 -- start start 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.470+0000 7fb890a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb88c074430 0x7fb88c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.470+0000 7fb890a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb88c074d50 0x7fb88c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb890a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 0x7fb88c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb890a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1142d0 con 0x7fb88c10e640 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb890a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c114150 con 0x7fb88c074d50 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb890a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c114450 con 0x7fb88c074430 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb88be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 0x7fb88c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb88be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 0x7fb88c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54948/0 (socket says 172.21.15.7:54948) 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb88be00640 1 -- 172.21.15.7:0/992523034 learned_addr learned my addr 172.21.15.7:0/992523034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb88b400640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb88c074430 0x7fb88c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.471+0000 7fb88aa00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb88c074d50 0x7fb88c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb88be00640 1 -- 172.21.15.7:0/992523034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb88c074430 msgr2=0x7fb88c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb88be00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb88c074430 0x7fb88c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb88be00640 1 -- 172.21.15.7:0/992523034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb88c074d50 msgr2=0x7fb88c1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb88be00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb88c074d50 0x7fb88c1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb88be00640 1 -- 172.21.15.7:0/992523034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c19ad90 con 0x7fb88c10e640 2024-04-23T15:30:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb88be00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 0x7fb88c19a610 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb88400eaa0 tx=0x7fb88400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb883e00640 1 -- 172.21.15.7:0/992523034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884004d20 con 0x7fb88c10e640 2024-04-23T15:30:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb883e00640 1 -- 172.21.15.7:0/992523034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb884005020 con 0x7fb88c10e640 2024-04-23T15:30:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb883e00640 1 -- 172.21.15.7:0/992523034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840116b0 con 0x7fb88c10e640 2024-04-23T15:30:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.472+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c19b080 con 0x7fb88c10e640 2024-04-23T15:30:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.473+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c1a72d0 con 0x7fb88c10e640 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.476+0000 7fb894fd1740 1 Processor -- start 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb883e00640 1 -- 172.21.15.7:0/992523034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb8840051d0 con 0x7fb88c10e640 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 -- start start 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3ad57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ae05a0 0x5593e3ae2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593e3a3b900 con 0x5593e3ad53c0 2024-04-23T15:30:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5593e39e1f20 con 0x5593e3ad5ce0 2024-04-23T15:30:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.477+0000 7fb894fd1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5593e3a378c0 con 0x5593e3ae05a0 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3ad57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3ad57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54958/0 (socket says 172.21.15.7:54958) 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 -- 172.21.15.7:0/1940997943 learned_addr learned my addr 172.21.15.7:0/1940997943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88b400640 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ae05a0 0x5593e3ae2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 -- 172.21.15.7:0/1940997943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ae05a0 msgr2=0x5593e3ae2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ae05a0 0x5593e3ae2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 -- 172.21.15.7:0/1940997943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad5ce0 msgr2=0x5593e3ae0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.478+0000 7fb88aa00640 1 -- 172.21.15.7:0/1940997943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593e3a06e10 con 0x5593e3ad53c0 2024-04-23T15:30:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.479+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3ad57a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb878000c00 tx=0x7fb878005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a3a56e6af8c705 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.479+0000 7fb877e00640 1 -- 172.21.15.7:0/1940997943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878044020 con 0x5593e3ad53c0 2024-04-23T15:30:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.479+0000 7fb877e00640 1 -- 172.21.15.7:0/1940997943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb878004770 con 0x5593e3ad53c0 2024-04-23T15:30:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.479+0000 7fb877e00640 1 -- 172.21.15.7:0/1940997943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878035040 con 0x5593e3ad53c0 2024-04-23T15:30:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.479+0000 7fb883e00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb8700a3d90 0x7fb8700a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb883e00640 1 -- 172.21.15.7:0/992523034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7fb8840d0c30 con 0x7fb88c10e640 2024-04-23T15:30:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb88b400640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb8700a3d90 0x7fb8700a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 -- 172.21.15.7:0/1940997943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 msgr2=0x5593e3ad57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3ad57a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb878000c00 tx=0x7fb878005fd0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 -- 172.21.15.7:0/1940997943 shutdown_connections 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ae05a0 0x5593e3ae2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1940997943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3ad57a0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 -- 172.21.15.7:0/1940997943 >> 172.21.15.7:0/1940997943 conn(0x5593e3ad18d0 msgr2=0x5593e3ad1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 -- 172.21.15.7:0/1940997943 shutdown_connections 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.480+0000 7fb894fd1740 1 -- 172.21.15.7:0/1940997943 wait complete. 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.481+0000 7fb88b400640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb8700a3d90 0x7fb8700a6250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5593e3ad6960 tx=0x7fb87c00a2d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.481+0000 7fb894fd1740 1 -- start start 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.481+0000 7fb894fd1740 1 Processor -- start 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3add5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3addb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ade060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593e3ae3080 con 0x5593e3ad53c0 2024-04-23T15:30:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5593e39f52c0 con 0x5593e3ae05a0 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5593e3ae3200 con 0x5593e3ad5ce0 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb894fd1740 10 client.0 _ll_register_callbacks cb 0x5593e374da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb88b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3add5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb88b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3add5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54972/0 (socket says 172.21.15.7:54972) 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb88b400640 1 -- 172.21.15.7:0/1741983945 learned_addr learned my addr 172.21.15.7:0/1741983945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.482+0000 7fb88be00640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ade060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3addb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88b400640 1 -- 172.21.15.7:0/1741983945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 msgr2=0x5593e3addb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88b400640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3addb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88b400640 1 -- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 msgr2=0x5593e3ade060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88b400640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ade060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88b400640 1 -- 172.21.15.7:0/1741983945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593e3a05fd0 con 0x5593e3ad53c0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb88b400640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3add5e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb87c01cbe0 tx=0x7fb87c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429f9b986ec30cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.483+0000 7fb874c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb874c00640 1 -- 172.21.15.7:0/1741983945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c02c060 con 0x5593e3ad53c0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb874c00640 1 -- 172.21.15.7:0/1741983945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7fb87c016030 con 0x5593e3ad53c0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb878004770 con 0x5593e3ad53c0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb874c00640 1 -- 172.21.15.7:0/1741983945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb87c033050 con 0x5593e3ad53c0 2024-04-23T15:30:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb894fd1740 10 client.18801 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5593e374e210 con 0x5593e3ad53c0 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.484+0000 7fb874c00640 1 -- 172.21.15.7:0/1741983945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb878004770 con 0x5593e3ad53c0 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb874c00640 1 -- 172.21.15.7:0/1741983945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb87c01a560 con 0x5593e3ad53c0 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb894fd1740 10 client.18801 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb894fd1740 10 client.18801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb894fd1740 20 client.18801 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3af07b0 0x5593e3af2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb894fd1740 4 client.18801 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.485+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593e3a49320 con 0x5593e3af07b0 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.486+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3af07b0 0x5593e3af2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.486+0000 7fb874c00640 10 client.18801 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.486+0000 7fb88aa00640 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3af07b0 0x5593e3af2c30 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce5bc6ba1d3c03ed server_cookie=fdbacbc3ee48090e in_seq=0 out_seq=0 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.488+0000 7fb874c00640 1 -- 172.21.15.7:0/1741983945 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5593e3a49320 con 0x5593e3af07b0 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.488+0000 7fb874c00640 10 client.18801 handle_command_reply: tid=0 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.488+0000 7fb894fd1740 1 client.18801 shutdown 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 msgr2=0x5593e3add5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3add5e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb87c01cbe0 tx=0x7fb87c004730 comp rx=0 tx=0).stop 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 shutdown_connections 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3af07b0 0x5593e3af2c30 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ade060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3addb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 --2- 172.21.15.7:0/1741983945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3add5e0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 >> 172.21.15.7:0/1741983945 conn(0x5593e3ad18d0 msgr2=0x5593e3ad7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:16.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb874c00640 0 client.18801 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:16.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 shutdown_connections 2024-04-23T15:30:16.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 1 -- 172.21.15.7:0/1741983945 wait complete. 2024-04-23T15:30:16.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.489+0000 7fb894fd1740 20 client.18801 trim_cache size 0 max 16384 2024-04-23T15:30:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 Processor -- start 2024-04-23T15:30:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 -- start start 2024-04-23T15:30:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3adfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3aec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ad7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1b1300 con 0x5593e3ad53c0 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1b2e40 con 0x5593e3ae05a0 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.509+0000 7fb894fd1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1b19d0 con 0x5593e3ad5ce0 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3adfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3adfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54980/0 (socket says 172.21.15.7:54980) 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 -- 172.21.15.7:0/568291764 learned_addr learned my addr 172.21.15.7:0/568291764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88aa00640 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3aec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88be00640 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ad7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 -- 172.21.15.7:0/568291764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 msgr2=0x5593e3aec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3aec050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 -- 172.21.15.7:0/568291764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 msgr2=0x5593e3ad7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ad7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 -- 172.21.15.7:0/568291764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593e381a620 con 0x5593e3ad53c0 2024-04-23T15:30:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.510+0000 7fb88b400640 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3adfd10 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0058c0 tx=0x7fb87c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3652fb4c2a96ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.511+0000 7fb877400640 1 -- 172.21.15.7:0/568291764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c02c020 con 0x5593e3ad53c0 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.511+0000 7fb877400640 1 -- 172.21.15.7:0/568291764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb87c01ab70 con 0x5593e3ad53c0 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.511+0000 7fb877400640 1 -- 172.21.15.7:0/568291764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c00fe10 con 0x5593e3ad53c0 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 -- 172.21.15.7:0/568291764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 msgr2=0x5593e3adfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3adfd10 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0058c0 tx=0x7fb87c00a6e0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 -- 172.21.15.7:0/568291764 shutdown_connections 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ae05a0 0x5593e3ad7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3aec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 --2- 172.21.15.7:0/568291764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ad53c0 0x5593e3adfd10 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 -- 172.21.15.7:0/568291764 >> 172.21.15.7:0/568291764 conn(0x5593e3ad18d0 msgr2=0x5593e3add5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 -- 172.21.15.7:0/568291764 shutdown_connections 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 -- 172.21.15.7:0/568291764 wait complete. 2024-04-23T15:30:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.512+0000 7fb894fd1740 1 -- start start 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 Processor -- start 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad53c0 0x5593e3ae3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 0x5593e3b4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1b2770 con 0x5593e3ae05a0 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1b20a0 con 0x5593e3ad53c0 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1af300 con 0x5593e3ad5ce0 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb894fd1740 10 client.0 _ll_register_callbacks cb 0x7fb87c00aa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.513+0000 7fb88be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 0x5593e3b4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 0x5593e3b4eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54992/0 (socket says 172.21.15.7:54992) 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 -- 172.21.15.7:0/3993308719 learned_addr learned my addr 172.21.15.7:0/3993308719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88b400640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad53c0 0x5593e3ae3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88aa00640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 -- 172.21.15.7:0/3993308719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 msgr2=0x5593e3ae3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 -- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad53c0 msgr2=0x5593e3ae3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad53c0 0x5593e3ae3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 -- 172.21.15.7:0/3993308719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593e3b4f3e0 con 0x5593e3ae05a0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb88be00640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 0x5593e3b4eda0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb88409c750 tx=0x7fb88409c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372f0fd688b61368 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb874c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.514+0000 7fb874c00640 1 -- 172.21.15.7:0/3993308719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88401f040 con 0x5593e3ae05a0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb874c00640 1 -- 172.21.15.7:0/3993308719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7fb88409bc10 con 0x5593e3ae05a0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb87c01ab70 con 0x5593e3ae05a0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb874c00640 1 -- 172.21.15.7:0/3993308719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb88409c7c0 con 0x5593e3ae05a0 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 10 client.18807 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5593e3b567a0 con 0x5593e3ae05a0 2024-04-23T15:30:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb874c00640 1 -- 172.21.15.7:0/3993308719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb87c01ab70 con 0x5593e3ae05a0 2024-04-23T15:30:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb874c00640 1 -- 172.21.15.7:0/3993308719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb88400f040 con 0x5593e3ae05a0 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 10 client.18807 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 10 client.18807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 20 client.18807 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3b56ef0 0x5593e3b59310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 4 client.18807 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.515+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593e3a43190 con 0x5593e3b56ef0 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.516+0000 7fb88b400640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3b56ef0 0x5593e3b59310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.517+0000 7fb88b400640 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3b56ef0 0x5593e3b59310 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59c6cf71afa0afa4 server_cookie=1104d055e2008df8 in_seq=0 out_seq=0 2024-04-23T15:30:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.517+0000 7fb874c00640 10 client.18807 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.548+0000 7fb874c00640 1 -- 172.21.15.7:0/3993308719 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593e3a43190 con 0x5593e3b56ef0 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.548+0000 7fb874c00640 10 client.18807 handle_command_reply: tid=0 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.548+0000 7fb894fd1740 1 client.18807 shutdown 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 msgr2=0x5593e3b4eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 0x5593e3b4eda0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb88409c750 tx=0x7fb88409c6b0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 shutdown_connections 2024-04-23T15:30:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5593e3b56ef0 0x5593e3b59310 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593e3ae05a0 0x5593e3b4eda0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5593e3ad5ce0 0x5593e3ae3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 --2- 172.21.15.7:0/3993308719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5593e3ad53c0 0x5593e3ae3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb874c00640 0 client.18807 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 >> 172.21.15.7:0/3993308719 conn(0x5593e3ad18d0 msgr2=0x5593e3addc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 shutdown_connections 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 1 -- 172.21.15.7:0/3993308719 wait complete. 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.549+0000 7fb894fd1740 20 client.18807 trim_cache size 0 max 16384 2024-04-23T15:30:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:30:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:30:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:30:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:30:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb8700a3d90 msgr2=0x7fb8700a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb8700a3d90 0x7fb8700a6250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5593e3ad6960 tx=0x7fb87c00a2d0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 msgr2=0x7fb88c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 0x7fb88c19a610 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb88400eaa0 tx=0x7fb88400eea0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 shutdown_connections 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb8700a3d90 0x7fb8700a6250 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb88c074d50 0x7fb88c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb88c10e640 0x7fb88c19a610 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.550+0000 7fb890a00640 1 --2- 172.21.15.7:0/992523034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb88c074430 0x7fb88c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.551+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 >> 172.21.15.7:0/992523034 conn(0x7fb88c0fd950 msgr2=0x7fb88c0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.551+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 shutdown_connections 2024-04-23T15:30:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:16.551+0000 7fb890a00640 1 -- 172.21.15.7:0/992523034 wait complete. 2024-04-23T15:30:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:16 smithi007 ceph-mon[27906]: pgmap v1233: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:16 smithi007 ceph-mon[27906]: osdmap e158: 12 total, 12 up, 12 in 2024-04-23T15:30:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:16 smithi186 ceph-mon[31814]: pgmap v1233: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:16 smithi186 ceph-mon[31814]: osdmap e158: 12 total, 12 up, 12 in 2024-04-23T15:30:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:16 smithi137 ceph-mon[31694]: pgmap v1233: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 16 op/s 2024-04-23T15:30:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:16 smithi137 ceph-mon[31694]: osdmap e158: 12 total, 12 up, 12 in 2024-04-23T15:30:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:18 smithi007 ceph-mon[27906]: pgmap v1235: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-04-23T15:30:19.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:18 smithi186 ceph-mon[31814]: pgmap v1235: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-04-23T15:30:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:18 smithi137 ceph-mon[31694]: pgmap v1235: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 12 op/s 2024-04-23T15:30:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:20 smithi007 ceph-mon[27906]: pgmap v1236: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.2 MiB/s wr, 12 op/s 2024-04-23T15:30:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:20 smithi186 ceph-mon[31814]: pgmap v1236: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.2 MiB/s wr, 12 op/s 2024-04-23T15:30:21.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:20 smithi137 ceph-mon[31694]: pgmap v1236: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.2 MiB/s wr, 12 op/s 2024-04-23T15:30:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:22 smithi007 ceph-mon[27906]: pgmap v1237: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:22 smithi186 ceph-mon[31814]: pgmap v1237: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:22 smithi137 ceph-mon[31694]: pgmap v1237: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:24 smithi007 ceph-mon[27906]: pgmap v1238: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:25.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:24 smithi186 ceph-mon[31814]: pgmap v1238: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:24 smithi137 ceph-mon[31694]: pgmap v1238: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:26 smithi007 ceph-mon[27906]: pgmap v1239: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:27.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:26 smithi186 ceph-mon[31814]: pgmap v1239: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:26 smithi137 ceph-mon[31694]: pgmap v1239: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:30:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:28 smithi007 ceph-mon[27906]: pgmap v1240: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:30:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:28 smithi186 ceph-mon[31814]: pgmap v1240: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:30:29.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:28 smithi137 ceph-mon[31694]: pgmap v1240: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.713+0000 7fefa5800640 1 -- 172.21.15.7:0/1265543293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 msgr2=0x7fefa010dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 --2- 172.21.15.7:0/1265543293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa010dc00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fef98009ca0 tx=0x7fef9802a8c0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 -- 172.21.15.7:0/1265543293 shutdown_connections 2024-04-23T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 --2- 172.21.15.7:0/1265543293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa0101910 0x7fefa0105950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 --2- 172.21.15.7:0/1265543293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa010dc00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 --2- 172.21.15.7:0/1265543293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefa0100f60 0x7fefa0101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 -- 172.21.15.7:0/1265543293 >> 172.21.15.7:0/1265543293 conn(0x7fefa00fc820 msgr2=0x7fefa00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 -- 172.21.15.7:0/1265543293 shutdown_connections 2024-04-23T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.714+0000 7fefa5800640 1 -- 172.21.15.7:0/1265543293 wait complete. 2024-04-23T15:30:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.715+0000 7fefa5800640 1 Processor -- start 2024-04-23T15:30:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 -- start start 2024-04-23T15:30:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefa0100f60 0x7fefa01a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa01a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa019a670 0x7fefa019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01120b0 con 0x7fefa0106030 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0111f30 con 0x7fefa019a670 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fefa5800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0112230 con 0x7fefa0100f60 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fef9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa01a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fef9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa01a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44056/0 (socket says 172.21.15.7:44056) 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.716+0000 7fef9f400640 1 -- 172.21.15.7:0/2845305255 learned_addr learned my addr 172.21.15.7:0/2845305255 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9fe00640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefa0100f60 0x7fefa01a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fefa4e00640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa019a670 0x7fefa019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9f400640 1 -- 172.21.15.7:0/2845305255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefa0100f60 msgr2=0x7fefa01a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9f400640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefa0100f60 0x7fefa01a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9f400640 1 -- 172.21.15.7:0/2845305255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa019a670 msgr2=0x7fefa019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9f400640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa019a670 0x7fefa019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9f400640 1 -- 172.21.15.7:0/2845305255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa019b270 con 0x7fefa0106030 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fefa4e00640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa019a670 0x7fefa019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.717+0000 7fef9f400640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa01a0af0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00d770 tx=0x7fef8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.718+0000 7fef9cc00640 1 -- 172.21.15.7:0/2845305255 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c017070 con 0x7fefa0106030 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.718+0000 7fef9cc00640 1 -- 172.21.15.7:0/2845305255 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef8c009c30 con 0x7fefa0106030 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.718+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa01a7350 con 0x7fefa0106030 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.718+0000 7fef9cc00640 1 -- 172.21.15.7:0/2845305255 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00f620 con 0x7fefa0106030 2024-04-23T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.718+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa01a7750 con 0x7fefa0106030 2024-04-23T15:30:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 Processor -- start 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 -- start start 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fef9cc00640 1 -- 172.21.15.7:0/2845305255 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fef8c01a070 con 0x7fefa0106030 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 0x557e3feb57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb5ce0 0x557e3fec0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3fec05a0 0x557e3fec2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e3fe1b900 con 0x557e3feb53c0 2024-04-23T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e3fdc1f20 con 0x557e3feb5ce0 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.722+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557e3fe178c0 con 0x557e3fec05a0 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 0x557e3feb57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 0x557e3feb57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44062/0 (socket says 172.21.15.7:44062) 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 -- 172.21.15.7:0/2815857408 learned_addr learned my addr 172.21.15.7:0/2815857408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fef9f400640 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3fec05a0 0x557e3fec2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fef9fe00640 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb5ce0 0x557e3fec0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 -- 172.21.15.7:0/2815857408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3fec05a0 msgr2=0x557e3fec2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3fec05a0 0x557e3fec2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 -- 172.21.15.7:0/2815857408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb5ce0 msgr2=0x557e3fec0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb5ce0 0x557e3fec0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.723+0000 7fefa4e00640 1 -- 172.21.15.7:0/2815857408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3fde6e10 con 0x557e3feb53c0 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.724+0000 7fefa4e00640 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 0x557e3feb57a0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fef98005fa0 tx=0x7fef98009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77faec18955a8be5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.724+0000 7fef9cc00640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fef840a3d10 0x7fef840a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.724+0000 7fef95600640 1 -- 172.21.15.7:0/2815857408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98031dc0 con 0x557e3feb53c0 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.724+0000 7fef9cc00640 1 -- 172.21.15.7:0/2845305255 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7fef8c0d0630 con 0x7fefa0106030 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.725+0000 7fef9fe00640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fef840a3d10 0x7fef840a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.725+0000 7fef95600640 1 -- 172.21.15.7:0/2815857408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef98036040 con 0x557e3feb53c0 2024-04-23T15:30:29.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.725+0000 7fef95600640 1 -- 172.21.15.7:0/2815857408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98004330 con 0x557e3feb53c0 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 -- 172.21.15.7:0/2815857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 msgr2=0x557e3feb57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 0x557e3feb57a0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fef98005fa0 tx=0x7fef98009360 comp rx=0 tx=0).stop 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fef9fe00640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fef840a3d10 0x7fef840a61d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x557e3feb6960 tx=0x7fef9000b410 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 -- 172.21.15.7:0/2815857408 shutdown_connections 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb5ce0 0x557e3fec0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3fec05a0 0x557e3fec2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/2815857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb53c0 0x557e3feb57a0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 -- 172.21.15.7:0/2815857408 >> 172.21.15.7:0/2815857408 conn(0x557e3feb18d0 msgr2=0x557e3feb1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 -- 172.21.15.7:0/2815857408 shutdown_connections 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 -- 172.21.15.7:0/2815857408 wait complete. 2024-04-23T15:30:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.726+0000 7fefa9bf3740 1 -- start start 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 Processor -- start 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3febd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3febdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3febe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557e3fec2fc0 con 0x557e3feb5ce0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557e3fdd52c0 con 0x557e3fec05a0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557e3fec3140 con 0x557e3feb53c0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.727+0000 7fefa9bf3740 10 client.0 _ll_register_callbacks cb 0x557e3fb2da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3febdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3febdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44064/0 (socket says 172.21.15.7:44064) 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 -- 172.21.15.7:0/1059738528 learned_addr learned my addr 172.21.15.7:0/1059738528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3febd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3febe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 -- 172.21.15.7:0/1059738528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 msgr2=0x557e3febd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3febd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 -- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 msgr2=0x557e3febe0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3febe0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fef9f400640 1 -- 172.21.15.7:0/1059738528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3fde5fd0 con 0x557e3feb5ce0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.728+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3febe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fef9f400640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3febdba0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fef8c09bf20 tx=0x7fef8c09c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dee61e8a3289b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fef8a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fef8a000640 1 -- 172.21.15.7:0/1059738528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c021070 con 0x557e3feb5ce0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fef8a000640 1 -- 172.21.15.7:0/1059738528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7fef8c0d0210 con 0x557e3feb5ce0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef98036040 con 0x557e3feb5ce0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fef8a000640 1 -- 172.21.15.7:0/1059738528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fef8c0cde50 con 0x557e3feb5ce0 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fefa9bf3740 10 client.18819 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557e3fb2e210 con 0x557e3feb5ce0 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.729+0000 7fef8a000640 1 -- 172.21.15.7:0/1059738528 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef98036040 con 0x557e3feb5ce0 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fef8a000640 1 -- 172.21.15.7:0/1059738528 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fef8c0a0100 con 0x557e3feb5ce0 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fefa9bf3740 10 client.18819 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fefa9bf3740 10 client.18819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fefa9bf3740 20 client.18819 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3fed06f0 0x557e3fed2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fefa9bf3740 4 client.18819 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e3fe29320 con 0x557e3fed06f0 2024-04-23T15:30:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.730+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3fed06f0 0x557e3fed2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.732+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3fed06f0 0x557e3fed2ae0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=908ef1b36f031836 server_cookie=d3c03f6a1608fc55 in_seq=0 out_seq=0 2024-04-23T15:30:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.732+0000 7fef8a000640 10 client.18819 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.733+0000 7fef8a000640 1 -- 172.21.15.7:0/1059738528 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557e3fe29320 con 0x557e3fed06f0 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.733+0000 7fef8a000640 10 client.18819 handle_command_reply: tid=0 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.733+0000 7fefa9bf3740 1 client.18819 shutdown 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 msgr2=0x557e3febdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3febdba0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fef8c09bf20 tx=0x7fef8c09c0e0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 shutdown_connections 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3fed06f0 0x557e3fed2ae0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3febe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3febdba0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1059738528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3febd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fef8a000640 0 client.18819 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 >> 172.21.15.7:0/1059738528 conn(0x557e3feb18d0 msgr2=0x557e3feb7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 shutdown_connections 2024-04-23T15:30:29.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1059738528 wait complete. 2024-04-23T15:30:29.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.734+0000 7fefa9bf3740 20 client.18819 trim_cache size 0 max 16384 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 Processor -- start 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 -- start start 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb53c0 0x557e3fecbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb5ce0 0x557e3feb1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 0x557e3fed8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01b1580 con 0x557e3fec05a0 2024-04-23T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01b30c0 con 0x557e3feb53c0 2024-04-23T15:30:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01b1c50 con 0x557e3feb5ce0 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.754+0000 7fefa4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 0x557e3fed8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 0x557e3fed8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44072/0 (socket says 172.21.15.7:44072) 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 -- 172.21.15.7:0/1197974643 learned_addr learned my addr 172.21.15.7:0/1197974643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb53c0 0x557e3fecbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fef9f400640 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb5ce0 0x557e3feb1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 -- 172.21.15.7:0/1197974643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb5ce0 msgr2=0x557e3feb1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb5ce0 0x557e3feb1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 -- 172.21.15.7:0/1197974643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb53c0 msgr2=0x557e3fecbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb53c0 0x557e3fecbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.755+0000 7fefa4e00640 1 -- 172.21.15.7:0/1197974643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3fbfa620 con 0x557e3fec05a0 2024-04-23T15:30:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.756+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 0x557e3fed8380 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fef98005e30 tx=0x7fef98009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffec38c5db944d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.756+0000 7fef94c00640 1 -- 172.21.15.7:0/1197974643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98031bc0 con 0x557e3fec05a0 2024-04-23T15:30:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.756+0000 7fef94c00640 1 -- 172.21.15.7:0/1197974643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef98036050 con 0x557e3fec05a0 2024-04-23T15:30:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.756+0000 7fef94c00640 1 -- 172.21.15.7:0/1197974643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98004040 con 0x557e3fec05a0 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1197974643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 msgr2=0x557e3fed8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 0x557e3fed8380 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fef98005e30 tx=0x7fef98009b80 comp rx=0 tx=0).stop 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1197974643 shutdown_connections 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3fec05a0 0x557e3fed8380 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb5ce0 0x557e3feb1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1197974643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3feb53c0 0x557e3fecbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1197974643 >> 172.21.15.7:0/1197974643 conn(0x557e3feb18d0 msgr2=0x557e3feb7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1197974643 shutdown_connections 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.757+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1197974643 wait complete. 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.758+0000 7fefa9bf3740 1 -- start start 2024-04-23T15:30:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.758+0000 7fefa9bf3740 1 Processor -- start 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3fec8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3fec3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3fec44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01b29f0 con 0x557e3feb5ce0 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01b2320 con 0x557e3fec05a0 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fefa01af580 con 0x557e3feb53c0 2024-04-23T15:30:29.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa9bf3740 10 client.0 _ll_register_callbacks cb 0x7fef8c010ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fef9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3fec3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fef9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3fec3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44084/0 (socket says 172.21.15.7:44084) 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fef9f400640 1 -- 172.21.15.7:0/1131767688 learned_addr learned my addr 172.21.15.7:0/1131767688 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3fec44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.759+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3fec8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9f400640 1 -- 172.21.15.7:0/1131767688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 msgr2=0x557e3fec8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9f400640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3fec8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9f400640 1 -- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 msgr2=0x557e3fec44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9f400640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3fec44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9f400640 1 -- 172.21.15.7:0/1131767688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3ff35bf0 con 0x557e3feb5ce0 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fefa4e00640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3fec44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3fec8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef9f400640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3fec3d80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0cda80 tx=0x7fef8c0d0440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8499be5600d95a6b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef8a000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.760+0000 7fef8a000640 1 -- 172.21.15.7:0/1131767688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0984c0 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.761+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef98036050 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.761+0000 7fef8a000640 1 -- 172.21.15.7:0/1131767688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7fef8c0b4020 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.761+0000 7fef8a000640 1 -- 172.21.15.7:0/1131767688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fef8c0cde60 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.761+0000 7fefa9bf3740 10 client.18825 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.761+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557e3ff36d80 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.761+0000 7fef8a000640 1 -- 172.21.15.7:0/1131767688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef98036050 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fef8a000640 1 -- 172.21.15.7:0/1131767688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fef8c098040 con 0x557e3feb5ce0 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fefa9bf3740 10 client.18825 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fefa9bf3740 10 client.18825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fefa9bf3740 20 client.18825 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3ff374a0 0x557e3ff398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fefa9bf3740 4 client.18825 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e3fe23190 con 0x557e3ff374a0 2024-04-23T15:30:29.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.762+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3ff374a0 0x557e3ff398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:29.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.763+0000 7fef9fe00640 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3ff374a0 0x557e3ff398c0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3773af9f3a501ec9 server_cookie=8607f039ce3b3225 in_seq=0 out_seq=0 2024-04-23T15:30:29.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.763+0000 7fef8a000640 10 client.18825 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fef8a000640 1 -- 172.21.15.7:0/1131767688 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e3fe23190 con 0x557e3ff374a0 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fef8a000640 10 client.18825 handle_command_reply: tid=0 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 client.18825 shutdown 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 msgr2=0x557e3fec3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3fec3d80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0cda80 tx=0x7fef8c0d0440 comp rx=0 tx=0).stop 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 shutdown_connections 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557e3ff374a0 0x557e3ff398c0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557e3fec05a0 0x557e3fec44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557e3feb5ce0 0x557e3fec3d80 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 --2- 172.21.15.7:0/1131767688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e3feb53c0 0x557e3fec8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 >> 172.21.15.7:0/1131767688 conn(0x557e3feb18d0 msgr2=0x557e3feb6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fef8a000640 0 client.18825 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.797+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 shutdown_connections 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.798+0000 7fefa9bf3740 1 -- 172.21.15.7:0/1131767688 wait complete. 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.798+0000 7fefa9bf3740 20 client.18825 trim_cache size 0 max 16384 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:30:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fef840a3d10 msgr2=0x7fef840a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fef840a3d10 0x7fef840a61d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x557e3feb6960 tx=0x7fef9000b410 comp rx=0 tx=0).stop 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 msgr2=0x7fefa01a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa01a0af0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00d770 tx=0x7fef8c00dc30 comp rx=0 tx=0).stop 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 shutdown_connections 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fef840a3d10 0x7fef840a61d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefa019a670 0x7fefa019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefa0106030 0x7fefa01a0af0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 --2- 172.21.15.7:0/2845305255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefa0100f60 0x7fefa01a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 >> 172.21.15.7:0/2845305255 conn(0x7fefa00fc820 msgr2=0x7fefa00fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 shutdown_connections 2024-04-23T15:30:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:29.799+0000 7fefa5800640 1 -- 172.21.15.7:0/2845305255 wait complete. 2024-04-23T15:30:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:30 smithi007 ceph-mon[27906]: pgmap v1241: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:30:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:30 smithi186 ceph-mon[31814]: pgmap v1241: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:30:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:30 smithi137 ceph-mon[31694]: pgmap v1241: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:30:33.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:32 smithi007 ceph-mon[27906]: pgmap v1242: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:30:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:32 smithi186 ceph-mon[31814]: pgmap v1242: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:30:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:32 smithi137 ceph-mon[31694]: pgmap v1242: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:30:35.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:34 smithi007 ceph-mon[27906]: pgmap v1243: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:35.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:34 smithi186 ceph-mon[31814]: pgmap v1243: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:34 smithi137 ceph-mon[31694]: pgmap v1243: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:36 smithi007 ceph-mon[27906]: pgmap v1244: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:37.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:36 smithi186 ceph-mon[31814]: pgmap v1244: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:36 smithi137 ceph-mon[31694]: pgmap v1244: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:38 smithi007 ceph-mon[27906]: pgmap v1245: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:30:39.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:38 smithi186 ceph-mon[31814]: pgmap v1245: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:30:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:38 smithi137 ceph-mon[31694]: pgmap v1245: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:30:41.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:40 smithi007 ceph-mon[27906]: pgmap v1246: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:30:41.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:40 smithi186 ceph-mon[31814]: pgmap v1246: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:30:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:40 smithi137 ceph-mon[31694]: pgmap v1246: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.015+0000 7f04b3e00640 1 -- 172.21.15.7:0/3219759702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b4102fc0 msgr2=0x7f04b41033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.015+0000 7f04b3e00640 1 --2- 172.21.15.7:0/3219759702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b4102fc0 0x7f04b41033a0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009900 tx=0x7f04a402a480 comp rx=0 tx=0).stop 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 -- 172.21.15.7:0/3219759702 shutdown_connections 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 --2- 172.21.15.7:0/3219759702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b410c3e0 0x7f04b410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 --2- 172.21.15.7:0/3219759702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04b41038e0 0x7f04b410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 --2- 172.21.15.7:0/3219759702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b4102fc0 0x7f04b41033a0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 -- 172.21.15.7:0/3219759702 >> 172.21.15.7:0/3219759702 conn(0x7f04b40fc820 msgr2=0x7f04b40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 -- 172.21.15.7:0/3219759702 shutdown_connections 2024-04-23T15:30:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.016+0000 7f04b3e00640 1 -- 172.21.15.7:0/3219759702 wait complete. 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 Processor -- start 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 -- start start 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b4102fc0 0x7f04b41a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04b41038e0 0x7f04b41a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 0x7f04b419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4112050 con 0x7f04b410c3e0 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4111ed0 con 0x7f04b4102fc0 2024-04-23T15:30:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.017+0000 7f04b3e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41121d0 con 0x7f04b41038e0 2024-04-23T15:30:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 0x7f04b419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 0x7f04b419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42718/0 (socket says 172.21.15.7:42718) 2024-04-23T15:30:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b3400640 1 -- 172.21.15.7:0/1514254315 learned_addr learned my addr 172.21.15.7:0/1514254315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b2000640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04b41038e0 0x7f04b41a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b2a00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b4102fc0 0x7f04b41a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b3400640 1 -- 172.21.15.7:0/1514254315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04b41038e0 msgr2=0x7f04b41a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.018+0000 7f04b3400640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04b41038e0 0x7f04b41a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b3400640 1 -- 172.21.15.7:0/1514254315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b4102fc0 msgr2=0x7f04b41a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b3400640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b4102fc0 0x7f04b41a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b3400640 1 -- 172.21.15.7:0/1514254315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b419adf0 con 0x7f04b410c3e0 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b2a00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b4102fc0 0x7f04b41a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b3400640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 0x7f04b419a670 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00eaa0 tx=0x7f04ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04ab400640 1 -- 172.21.15.7:0/1514254315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00cdb0 con 0x7f04b410c3e0 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b419b0e0 con 0x7f04b410c3e0 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04ab400640 1 -- 172.21.15.7:0/1514254315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04ac005020 con 0x7f04b410c3e0 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04ab400640 1 -- 172.21.15.7:0/1514254315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0116d0 con 0x7f04b410c3e0 2024-04-23T15:30:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.019+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b41a7330 con 0x7f04b410c3e0 2024-04-23T15:30:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.024+0000 7f04bc5e1740 1 Processor -- start 2024-04-23T15:30:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.024+0000 7f04ab400640 1 -- 172.21.15.7:0/1514254315 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f04ac0051d0 con 0x7f04b410c3e0 2024-04-23T15:30:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 -- start start 2024-04-23T15:30:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d4320047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 0x55d43200f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d43200f5a0 0x55d432011990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d431f6a900 con 0x55d432004ce0 2024-04-23T15:30:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d431f10f20 con 0x55d4320043c0 2024-04-23T15:30:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.025+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d431f668c0 con 0x55d43200f5a0 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 0x55d43200f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 0x55d43200f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42720/0 (socket says 172.21.15.7:42720) 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d4320047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 -- 172.21.15.7:0/2838993994 learned_addr learned my addr 172.21.15.7:0/2838993994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2000640 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d43200f5a0 0x55d432011990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04ab400640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04980a3d90 0x7f04980a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 -- 172.21.15.7:0/2838993994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d43200f5a0 msgr2=0x55d432011990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d43200f5a0 0x55d432011990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 -- 172.21.15.7:0/2838993994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 msgr2=0x55d4320047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d4320047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04b2a00640 1 -- 172.21.15.7:0/2838993994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d431f35e10 con 0x55d432004ce0 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.026+0000 7f04ab400640 1 -- 172.21.15.7:0/1514254315 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7f04ac0d0cf0 con 0x7f04b410c3e0 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.027+0000 7f04b3400640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04980a3d90 0x7f04980a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.027+0000 7f04b2a00640 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 0x55d43200f060 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009900 tx=0x7f04a4032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaebac28015dd85 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.027+0000 7f049fe00640 1 -- 172.21.15.7:0/2838993994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a403f070 con 0x55d432004ce0 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.027+0000 7f049fe00640 1 -- 172.21.15.7:0/2838993994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a40316a0 con 0x55d432004ce0 2024-04-23T15:30:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.027+0000 7f049fe00640 1 -- 172.21.15.7:0/2838993994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4035070 con 0x55d432004ce0 2024-04-23T15:30:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 -- 172.21.15.7:0/2838993994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 msgr2=0x55d43200f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 0x55d43200f060 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009900 tx=0x7f04a4032cb0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04b3400640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04980a3d90 0x7f04980a6250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f04ac09c810 tx=0x7f04ac009270 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 -- 172.21.15.7:0/2838993994 shutdown_connections 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d43200f5a0 0x55d432011990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d432004ce0 0x55d43200f060 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/2838993994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d4320047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 -- 172.21.15.7:0/2838993994 >> 172.21.15.7:0/2838993994 conn(0x55d4320008d0 msgr2=0x55d432000cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 -- 172.21.15.7:0/2838993994 shutdown_connections 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.028+0000 7f04bc5e1740 1 -- 172.21.15.7:0/2838993994 wait complete. 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.029+0000 7f04bc5e1740 1 -- start start 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.029+0000 7f04bc5e1740 1 Processor -- start 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.029+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d43200c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43200ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 0x55d43200cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d4320120e0 con 0x55d4320043c0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d431f242c0 con 0x55d43200f5a0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d432012260 con 0x55d432004ce0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04bc5e1740 10 client.0 _ll_register_callbacks cb 0x55d431c7ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d43200c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d43200c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42726/0 (socket says 172.21.15.7:42726) 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 -- 172.21.15.7:0/1076515633 learned_addr learned my addr 172.21.15.7:0/1076515633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2a00640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43200ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 -- 172.21.15.7:0/1076515633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 msgr2=0x55d43200ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43200ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 -- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 msgr2=0x55d43200cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 0x55d43200cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2000640 1 -- 172.21.15.7:0/1076515633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d431f34fd0 con 0x55d4320043c0 2024-04-23T15:30:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.030+0000 7f04b2a00640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43200ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:30:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.031+0000 7f04b2000640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d43200c520 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f04b410ead0 tx=0x7f04a00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbff608b465d4e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.031+0000 7f049cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.031+0000 7f049cc00640 1 -- 172.21.15.7:0/1076515633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005020 con 0x55d4320043c0 2024-04-23T15:30:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.031+0000 7f049cc00640 1 -- 172.21.15.7:0/1076515633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7f04a00051c0 con 0x55d4320043c0 2024-04-23T15:30:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.031+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a40316a0 con 0x55d4320043c0 2024-04-23T15:30:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f049cc00640 1 -- 172.21.15.7:0/1076515633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f04a0028050 con 0x55d4320043c0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 10 client.18837 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d431c7d210 con 0x55d4320043c0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f049cc00640 1 -- 172.21.15.7:0/1076515633 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a40316a0 con 0x55d4320043c0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f049cc00640 1 -- 172.21.15.7:0/1076515633 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f04a0012690 con 0x55d4320043c0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 10 client.18837 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 10 client.18837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 20 client.18837 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d43201f6d0 0x55d432021ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 4 client.18837 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.032+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d431f78320 con 0x55d43201f6d0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.033+0000 7f04b2a00640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d43201f6d0 0x55d432021ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.034+0000 7f04b2a00640 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d43201f6d0 0x55d432021ae0 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60713763d040ba9 server_cookie=f304e833424144cd in_seq=0 out_seq=0 2024-04-23T15:30:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.034+0000 7f049cc00640 10 client.18837 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f049cc00640 1 -- 172.21.15.7:0/1076515633 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d431f78320 con 0x55d43201f6d0 2024-04-23T15:30:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f049cc00640 10 client.18837 handle_command_reply: tid=0 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 client.18837 shutdown 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 msgr2=0x55d43200c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d43200c520 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f04b410ead0 tx=0x7f04a00039c0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 shutdown_connections 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d43201f6d0 0x55d432021ae0 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 0x55d43200cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43200ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/1076515633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d43200c520 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f049cc00640 0 client.18837 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 >> 172.21.15.7:0/1076515633 conn(0x55d4320008d0 msgr2=0x55d432006650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 shutdown_connections 2024-04-23T15:30:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 1 -- 172.21.15.7:0/1076515633 wait complete. 2024-04-23T15:30:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.036+0000 7f04bc5e1740 20 client.18837 trim_cache size 0 max 16384 2024-04-23T15:30:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.055+0000 7f04bc5e1740 1 Processor -- start 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.055+0000 7f04bc5e1740 1 -- start start 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d43200ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43201b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 0x55d432000cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41b1430 con 0x55d43200f5a0 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41b2f70 con 0x55d4320043c0 2024-04-23T15:30:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41b1b00 con 0x55d432004ce0 2024-04-23T15:30:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 0x55d432000cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 0x55d432000cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42734/0 (socket says 172.21.15.7:42734) 2024-04-23T15:30:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04b2000640 1 -- 172.21.15.7:0/3214246710 learned_addr learned my addr 172.21.15.7:0/3214246710 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.056+0000 7f04b2a00640 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43201b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d43200ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 -- 172.21.15.7:0/3214246710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 msgr2=0x55d43201b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43201b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 -- 172.21.15.7:0/3214246710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 msgr2=0x55d43200ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d43200ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 -- 172.21.15.7:0/3214246710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d432004b10 con 0x55d43200f5a0 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.057+0000 7f04b2000640 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 0x55d432000cb0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f04a0005bc0 tx=0x7f04a0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d17e1340127114d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.058+0000 7f049f400640 1 -- 172.21.15.7:0/3214246710 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a000b2e0 con 0x55d43200f5a0 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.058+0000 7f049f400640 1 -- 172.21.15.7:0/3214246710 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a0003ec0 con 0x55d43200f5a0 2024-04-23T15:30:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.058+0000 7f049f400640 1 -- 172.21.15.7:0/3214246710 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a00053b0 con 0x55d43200f5a0 2024-04-23T15:30:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.058+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3214246710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 msgr2=0x55d432000cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.058+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 0x55d432000cb0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f04a0005bc0 tx=0x7f04a0001e50 comp rx=0 tx=0).stop 2024-04-23T15:30:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3214246710 shutdown_connections 2024-04-23T15:30:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d43200f5a0 0x55d432000cb0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d43201b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3214246710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4320043c0 0x55d43200ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3214246710 >> 172.21.15.7:0/3214246710 conn(0x55d4320008d0 msgr2=0x55d43200bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3214246710 shutdown_connections 2024-04-23T15:30:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3214246710 wait complete. 2024-04-23T15:30:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 -- start start 2024-04-23T15:30:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.059+0000 7f04bc5e1740 1 Processor -- start 2024-04-23T15:30:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d432017850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d432008d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 0x55d4320092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41b28a0 con 0x55d4320043c0 2024-04-23T15:30:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41b21d0 con 0x55d43200f5a0 2024-04-23T15:30:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41af430 con 0x55d432004ce0 2024-04-23T15:30:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04bc5e1740 10 client.0 _ll_register_callbacks cb 0x7f04a000b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:43.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d432017850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d432017850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42750/0 (socket says 172.21.15.7:42750) 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.060+0000 7f04b2000640 1 -- 172.21.15.7:0/3462209625 learned_addr learned my addr 172.21.15.7:0/3462209625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2a00640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d432008d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2000640 1 -- 172.21.15.7:0/3462209625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 msgr2=0x55d432008d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2000640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d432008d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2000640 1 -- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 msgr2=0x55d4320092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2000640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 0x55d4320092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2000640 1 -- 172.21.15.7:0/3462209625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d431d49620 con 0x55d4320043c0 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2a00640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d432008d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:30:43.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f04b2000640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d432017850 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f04a0012a90 tx=0x7f04a0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a2fde3670b25f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.061+0000 7f049cc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f049cc00640 1 -- 172.21.15.7:0/3462209625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0004590 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f049cc00640 1 -- 172.21.15.7:0/3462209625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7f04a0005230 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a0003ec0 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f049cc00640 1 -- 172.21.15.7:0/3462209625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f04a0004e50 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f04bc5e1740 10 client.18843 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d4320858f0 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.062+0000 7f049cc00640 1 -- 172.21.15.7:0/3462209625 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a0003ec0 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f049cc00640 1 -- 172.21.15.7:0/3462209625 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f04a002b040 con 0x55d4320043c0 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04bc5e1740 10 client.18843 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04bc5e1740 10 client.18843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04bc5e1740 20 client.18843 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d432085f20 0x55d432088340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:43.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04bc5e1740 4 client.18843 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:30:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d431f72190 con 0x55d432085f20 2024-04-23T15:30:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.063+0000 7f04b2a00640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d432085f20 0x55d432088340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.064+0000 7f04b2a00640 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d432085f20 0x55d432088340 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29db99ff7948f097 server_cookie=82e0ab95ccc16b81 in_seq=0 out_seq=0 2024-04-23T15:30:43.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.064+0000 7f049cc00640 10 client.18843 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:43.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:42 smithi007 ceph-mon[27906]: pgmap v1247: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:30:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.099+0000 7f049cc00640 1 -- 172.21.15.7:0/3462209625 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d431f72190 con 0x55d432085f20 2024-04-23T15:30:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.099+0000 7f049cc00640 10 client.18843 handle_command_reply: tid=0 2024-04-23T15:30:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.099+0000 7f04bc5e1740 1 client.18843 shutdown 2024-04-23T15:30:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 msgr2=0x55d432017850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d432017850 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f04a0012a90 tx=0x7f04a0005c50 comp rx=0 tx=0).stop 2024-04-23T15:30:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 shutdown_connections 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d432085f20 0x55d432088340 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d43200f5a0 0x55d4320092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d432004ce0 0x55d432008d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 --2- 172.21.15.7:0/3462209625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4320043c0 0x55d432017850 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 >> 172.21.15.7:0/3462209625 conn(0x55d4320008d0 msgr2=0x55d432000cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f049cc00640 0 client.18843 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 shutdown_connections 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 1 -- 172.21.15.7:0/3462209625 wait complete. 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.100+0000 7f04bc5e1740 20 client.18843 trim_cache size 0 max 16384 2024-04-23T15:30:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:30:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:30:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:30:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04980a3d90 msgr2=0x7f04980a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04980a3d90 0x7f04980a6250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f04ac09c810 tx=0x7f04ac009270 comp rx=0 tx=0).stop 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 msgr2=0x7f04b419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 0x7f04b419a670 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00eaa0 tx=0x7f04ac00ef60 comp rx=0 tx=0).stop 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 shutdown_connections 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f04980a3d90 0x7f04980a6250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04b410c3e0 0x7f04b419a670 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04b41038e0 0x7f04b41a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 --2- 172.21.15.7:0/1514254315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04b4102fc0 0x7f04b41a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.101+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 >> 172.21.15.7:0/1514254315 conn(0x7f04b40fc820 msgr2=0x7f04b4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.102+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 shutdown_connections 2024-04-23T15:30:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:43.102+0000 7f04b3e00640 1 -- 172.21.15.7:0/1514254315 wait complete. 2024-04-23T15:30:43.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:42 smithi186 ceph-mon[31814]: pgmap v1247: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:30:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:42 smithi137 ceph-mon[31694]: pgmap v1247: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:30:45.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:44 smithi007 ceph-mon[27906]: pgmap v1248: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:30:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:44 smithi186 ceph-mon[31814]: pgmap v1248: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:30:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:44 smithi137 ceph-mon[31694]: pgmap v1248: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:30:46.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:46 smithi007 ceph-mon[27906]: pgmap v1249: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:30:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:46 smithi186 ceph-mon[31814]: pgmap v1249: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:30:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:46 smithi137 ceph-mon[31694]: pgmap v1249: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:30:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:48 smithi007 ceph-mon[27906]: pgmap v1250: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:30:49.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:48 smithi186 ceph-mon[31814]: pgmap v1250: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:30:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:48 smithi137 ceph-mon[31694]: pgmap v1250: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:30:51.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:50 smithi186 ceph-mon[31814]: pgmap v1251: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:30:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:50 smithi137 ceph-mon[31694]: pgmap v1251: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:30:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:50 smithi007 ceph-mon[27906]: pgmap v1251: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:30:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:52 smithi186 ceph-mon[31814]: pgmap v1252: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:30:53.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:52 smithi137 ceph-mon[31694]: pgmap v1252: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:30:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:52 smithi007 ceph-mon[27906]: pgmap v1252: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:30:55.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:54 smithi186 ceph-mon[31814]: pgmap v1253: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:54 smithi137 ceph-mon[31694]: pgmap v1253: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:54 smithi007 ceph-mon[27906]: pgmap v1253: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.298+0000 7efce6800640 1 -- 172.21.15.7:0/3157236289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 msgr2=0x7efce01154c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.298+0000 7efce6800640 1 --2- 172.21.15.7:0/3157236289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01154c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7efccc009930 tx=0x7efccc02a420 comp rx=0 tx=0).stop 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.298+0000 7efce6800640 1 -- 172.21.15.7:0/3157236289 shutdown_connections 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.298+0000 7efce6800640 1 --2- 172.21.15.7:0/3157236289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efce01085f0 0x7efce0108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.298+0000 7efce6800640 1 --2- 172.21.15.7:0/3157236289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01154c0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.298+0000 7efce6800640 1 --2- 172.21.15.7:0/3157236289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010e690 0x7efce010ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.299+0000 7efce6800640 1 -- 172.21.15.7:0/3157236289 >> 172.21.15.7:0/3157236289 conn(0x7efce0076590 msgr2=0x7efce00789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.299+0000 7efce6800640 1 -- 172.21.15.7:0/3157236289 shutdown_connections 2024-04-23T15:30:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.299+0000 7efce6800640 1 -- 172.21.15.7:0/3157236289 wait complete. 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 Processor -- start 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 -- start start 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efce01085f0 0x7efce01a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010e690 0x7efce019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efce01188d0 con 0x7efce0108fb0 2024-04-23T15:30:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efce0118750 con 0x7efce01085f0 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.300+0000 7efce6800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efce0118a50 con 0x7efce010e690 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41506/0 (socket says 172.21.15.7:41506) 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 -- 172.21.15.7:0/3902453534 learned_addr learned my addr 172.21.15.7:0/3902453534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdf400640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efce01085f0 0x7efce01a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdfe00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010e690 0x7efce019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 -- 172.21.15.7:0/3902453534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010e690 msgr2=0x7efce019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010e690 0x7efce019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 -- 172.21.15.7:0/3902453534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efce01085f0 msgr2=0x7efce01a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efce01085f0 0x7efce01a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.301+0000 7efcdea00640 1 -- 172.21.15.7:0/3902453534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce019f250 con 0x7efce0108fb0 2024-04-23T15:30:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.302+0000 7efcdea00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01a4e60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7efcd000d950 tx=0x7efcd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.302+0000 7efcd7e00640 1 -- 172.21.15.7:0/3902453534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0017070 con 0x7efce0108fb0 2024-04-23T15:30:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.302+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce019f540 con 0x7efce0108fb0 2024-04-23T15:30:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.302+0000 7efcd7e00640 1 -- 172.21.15.7:0/3902453534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd0009c30 con 0x7efce0108fb0 2024-04-23T15:30:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.302+0000 7efcd7e00640 1 -- 172.21.15.7:0/3902453534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd000f620 con 0x7efce0108fb0 2024-04-23T15:30:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.302+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce01ab7e0 con 0x7efce0108fb0 2024-04-23T15:30:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.306+0000 7efce961c740 1 Processor -- start 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.306+0000 7efcd7e00640 1 -- 172.21.15.7:0/3902453534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7efcd00109a0 con 0x7efce0108fb0 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 -- start start 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d40590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ecb1ca6900 con 0x55ecb1d4b390 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ecb1c4cf20 con 0x55ecb1d401b0 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efce961c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ecb1ca28c0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.307+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41512/0 (socket says 172.21.15.7:41512) 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 -- 172.21.15.7:0/2082961603 learned_addr learned my addr 172.21.15.7:0/2082961603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdfe00640 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d40590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdf400640 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 -- 172.21.15.7:0/2082961603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 msgr2=0x55ecb1d4ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 -- 172.21.15.7:0/2082961603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 msgr2=0x55ecb1d40590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d40590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcdea00640 1 -- 172.21.15.7:0/2082961603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecb1c71e10 con 0x55ecb1d4b390 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.308+0000 7efcd7e00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efcc40a3dc0 0x7efcc40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.309+0000 7efcdea00640 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4d780 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cdb70 tx=0x7efcd00d8690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31be535745aa941e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.309+0000 7efcdfe00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efcc40a3dc0 0x7efcc40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.309+0000 7efcd7e00640 1 -- 172.21.15.7:0/3902453534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7efcd00d0860 con 0x7efce0108fb0 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.309+0000 7efcd4c00640 1 -- 172.21.15.7:0/2082961603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd00986f0 con 0x55ecb1d4b390 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.309+0000 7efcd4c00640 1 -- 172.21.15.7:0/2082961603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd0009de0 con 0x55ecb1d4b390 2024-04-23T15:30:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.309+0000 7efcd4c00640 1 -- 172.21.15.7:0/2082961603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd009bdb0 con 0x55ecb1d4b390 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efcdfe00640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efcc40a3dc0 0x7efcc40a6280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efccc006010 tx=0x7efccc005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 -- 172.21.15.7:0/2082961603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 msgr2=0x55ecb1d4d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4d780 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cdb70 tx=0x7efcd00d8690 comp rx=0 tx=0).stop 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 -- 172.21.15.7:0/2082961603 shutdown_connections 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4d780 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 --2- 172.21.15.7:0/2082961603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d40590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.310+0000 7efce961c740 1 -- 172.21.15.7:0/2082961603 >> 172.21.15.7:0/2082961603 conn(0x55ecb1d3c6c0 msgr2=0x55ecb1d3caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.311+0000 7efce961c740 1 -- 172.21.15.7:0/2082961603 shutdown_connections 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.311+0000 7efce961c740 1 -- 172.21.15.7:0/2082961603 wait complete. 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.311+0000 7efce961c740 1 -- start start 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.311+0000 7efce961c740 1 Processor -- start 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d48330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d48870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d4b390 0x55ecb1d48db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ecb1d4df60 con 0x55ecb1d40ad0 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ecb1c602c0 con 0x55ecb1d401b0 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ecb1d4e0e0 con 0x55ecb1d4b390 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efce961c740 10 client.0 _ll_register_callbacks cb 0x55ecb19b8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d48870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d48870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41522/0 (socket says 172.21.15.7:41522) 2024-04-23T15:30:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efcdea00640 1 -- 172.21.15.7:0/1237430290 learned_addr learned my addr 172.21.15.7:0/1237430290 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.312+0000 7efcdf400640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d48330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdfe00640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d4b390 0x55ecb1d48db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdea00640 1 -- 172.21.15.7:0/1237430290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d4b390 msgr2=0x55ecb1d48db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdea00640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d4b390 0x55ecb1d48db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdea00640 1 -- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 msgr2=0x55ecb1d48330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdea00640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d48330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdea00640 1 -- 172.21.15.7:0/1237430290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecb1c70fd0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdfe00640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d4b390 0x55ecb1d48db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcdea00640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d48870 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cdcb0 tx=0x7efcd0005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca1c64c0f3ee3d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcc9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcc9600640 1 -- 172.21.15.7:0/1237430290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0020070 con 0x55ecb1d40ad0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efcc9600640 1 -- 172.21.15.7:0/1237430290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7efcd00cde80 con 0x55ecb1d40ad0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.313+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd0009de0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efcc9600640 1 -- 172.21.15.7:0/1237430290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efcd009bf90 con 0x55ecb1d40ad0 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 10 client.18855 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ecb19b9210 con 0x55ecb1d40ad0 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efcc9600640 1 -- 172.21.15.7:0/1237430290 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd0009de0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efcc9600640 1 -- 172.21.15.7:0/1237430290 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7efcd0098ac0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 10 client.18855 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 10 client.18855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 20 client.18855 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1d5b320 0x55ecb1d5d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 4 client.18855 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.314+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecb1cb4320 con 0x55ecb1d5b320 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.315+0000 7efcdf400640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1d5b320 0x55ecb1d5d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.316+0000 7efcdf400640 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1d5b320 0x55ecb1d5d710 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ad1107b1be00e7d server_cookie=d0ff8f4f303840b4 in_seq=0 out_seq=0 2024-04-23T15:30:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.316+0000 7efcc9600640 10 client.18855 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.318+0000 7efcc9600640 1 -- 172.21.15.7:0/1237430290 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ecb1cb4320 con 0x55ecb1d5b320 2024-04-23T15:30:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.318+0000 7efcc9600640 10 client.18855 handle_command_reply: tid=0 2024-04-23T15:30:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.318+0000 7efce961c740 1 client.18855 shutdown 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.318+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 msgr2=0x55ecb1d48870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.318+0000 7efce961c740 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d48870 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cdcb0 tx=0x7efcd0005f70 comp rx=0 tx=0).stop 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 shutdown_connections 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1d5b320 0x55ecb1d5d710 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d4b390 0x55ecb1d48db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d48870 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 --2- 172.21.15.7:0/1237430290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d48330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efcc9600640 0 client.18855 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 >> 172.21.15.7:0/1237430290 conn(0x55ecb1d3c6c0 msgr2=0x55ecb1d423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 shutdown_connections 2024-04-23T15:30:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 1 -- 172.21.15.7:0/1237430290 wait complete. 2024-04-23T15:30:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.319+0000 7efce961c740 20 client.18855 trim_cache size 0 max 16384 2024-04-23T15:30:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 Processor -- start 2024-04-23T15:30:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 -- start start 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d401b0 0x55ecb1d3bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d42b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efce01b58a0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efce01b73e0 con 0x55ecb1d4b390 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efce961c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efce01b5f70 con 0x55ecb1d401b0 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d42b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efcdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d42b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41526/0 (socket says 172.21.15.7:41526) 2024-04-23T15:30:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.336+0000 7efcdea00640 1 -- 172.21.15.7:0/781831684 learned_addr learned my addr 172.21.15.7:0/781831684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdf400640 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d401b0 0x55ecb1d3bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdfe00640 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdea00640 1 -- 172.21.15.7:0/781831684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d401b0 msgr2=0x55ecb1d3bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdea00640 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d401b0 0x55ecb1d3bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdea00640 1 -- 172.21.15.7:0/781831684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d4b390 msgr2=0x55ecb1d4a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdea00640 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdea00640 1 -- 172.21.15.7:0/781831684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecb1a85620 con 0x55ecb1d40ad0 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdf400640 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d401b0 0x55ecb1d3bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.337+0000 7efcdea00640 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d42b70 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cdc60 tx=0x7efcd000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8608a3f52a9913c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.338+0000 7efccbe00640 1 -- 172.21.15.7:0/781831684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0020070 con 0x55ecb1d40ad0 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.338+0000 7efccbe00640 1 -- 172.21.15.7:0/781831684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd0009de0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.338+0000 7efccbe00640 1 -- 172.21.15.7:0/781831684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd009c220 con 0x55ecb1d40ad0 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.338+0000 7efce961c740 1 -- 172.21.15.7:0/781831684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 msgr2=0x55ecb1d42b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.338+0000 7efce961c740 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d42b70 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7efcd00cdc60 tx=0x7efcd000bf60 comp rx=0 tx=0).stop 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 -- 172.21.15.7:0/781831684 shutdown_connections 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d42b70 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 --2- 172.21.15.7:0/781831684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d401b0 0x55ecb1d3bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 -- 172.21.15.7:0/781831684 >> 172.21.15.7:0/781831684 conn(0x55ecb1d3c6c0 msgr2=0x55ecb1d49b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 -- 172.21.15.7:0/781831684 shutdown_connections 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 -- 172.21.15.7:0/781831684 wait complete. 2024-04-23T15:30:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 -- start start 2024-04-23T15:30:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.339+0000 7efce961c740 1 Processor -- start 2024-04-23T15:30:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d53750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efce01b6d10 con 0x55ecb1d4b390 2024-04-23T15:30:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efce01b6640 con 0x55ecb1d401b0 2024-04-23T15:30:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efce01b38a0 con 0x55ecb1d40ad0 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efce961c740 10 client.0 _ll_register_callbacks cb 0x7efcd00d6a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efcdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efcdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41538/0 (socket says 172.21.15.7:41538) 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.340+0000 7efcdfe00640 1 -- 172.21.15.7:0/1593750440 learned_addr learned my addr 172.21.15.7:0/1593750440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdf400640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d53750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdea00640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdfe00640 1 -- 172.21.15.7:0/1593750440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 msgr2=0x55ecb1d4eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdfe00640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdfe00640 1 -- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 msgr2=0x55ecb1d53750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdfe00640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d53750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdfe00640 1 -- 172.21.15.7:0/1593750440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecb1d4f8a0 con 0x55ecb1d4b390 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdf400640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d53750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcdfe00640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4f020 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7efccc031440 tx=0x7efccc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571f1f551c08ed88 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:30:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.341+0000 7efcc9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efcc9600640 1 -- 172.21.15.7:0/1593750440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc035050 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efcc9600640 1 -- 172.21.15.7:0/1593750440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9467+0+0 (secure 0 0 0) 0x7efccc0037f0 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd0009de0 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efcc9600640 1 -- 172.21.15.7:0/1593750440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efccc05a050 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efce961c740 10 client.18861 fetch_fsmap learned FSMap version 32 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ecb1dc15a0 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.342+0000 7efcc9600640 1 -- 172.21.15.7:0/1593750440 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd0009de0 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efcc9600640 1 -- 172.21.15.7:0/1593750440 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7efccc032950 con 0x55ecb1d4b390 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efce961c740 10 client.18861 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efce961c740 10 client.18861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efce961c740 20 client.18861 populate_metadata read hostname 'smithi007' 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efce961c740 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1dc1d20 0x55ecb1dc4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efce961c740 4 client.18861 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ecb1cae190 con 0x55ecb1dc1d20 2024-04-23T15:30:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.343+0000 7efcdf400640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1dc1d20 0x55ecb1dc4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:30:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.344+0000 7efcdf400640 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1dc1d20 0x55ecb1dc4140 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=459d77f1b3e68e50 server_cookie=6fe481494637b6c4 in_seq=0 out_seq=0 2024-04-23T15:30:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.344+0000 7efcc9600640 10 client.18861 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efcc9600640 1 -- 172.21.15.7:0/1593750440 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ecb1cae190 con 0x55ecb1dc1d20 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efcc9600640 10 client.18861 handle_command_reply: tid=0 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 client.18861 shutdown 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 msgr2=0x55ecb1d4f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4f020 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7efccc031440 tx=0x7efccc009260 comp rx=0 tx=0).stop 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 shutdown_connections 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ecb1dc1d20 0x55ecb1dc4140 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecb1d4b390 0x55ecb1d4f020 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efcc9600640 0 client.18861 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:30:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecb1d40ad0 0x55ecb1d4eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 --2- 172.21.15.7:0/1593750440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ecb1d401b0 0x55ecb1d53750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.373+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 >> 172.21.15.7:0/1593750440 conn(0x55ecb1d3c6c0 msgr2=0x55ecb1d4a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 shutdown_connections 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce961c740 1 -- 172.21.15.7:0/1593750440 wait complete. 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce961c740 20 client.18861 trim_cache size 0 max 16384 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:30:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efcc40a3dc0 msgr2=0x7efcc40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce6800640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efcc40a3dc0 0x7efcc40a6280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efccc006010 tx=0x7efccc005a20 comp rx=0 tx=0).stop 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 msgr2=0x7efce01a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.374+0000 7efce6800640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01a4e60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7efcd000d950 tx=0x7efcd000de10 comp rx=0 tx=0).stop 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 shutdown_connections 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7efcc40a3dc0 0x7efcc40a6280 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010e690 0x7efce019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce0108fb0 0x7efce01a4e60 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 --2- 172.21.15.7:0/3902453534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efce01085f0 0x7efce01a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:30:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 >> 172.21.15.7:0/3902453534 conn(0x7efce0076590 msgr2=0x7efce0077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:30:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 shutdown_connections 2024-04-23T15:30:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:30:56.375+0000 7efce6800640 1 -- 172.21.15.7:0/3902453534 wait complete. 2024-04-23T15:30:57.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:56 smithi186 ceph-mon[31814]: pgmap v1254: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:56 smithi137 ceph-mon[31694]: pgmap v1254: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:56 smithi007 ceph-mon[27906]: pgmap v1254: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:30:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:30:58 smithi137 ceph-mon[31694]: pgmap v1255: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:30:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:30:58 smithi007 ceph-mon[27906]: pgmap v1255: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:30:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:30:58 smithi186 ceph-mon[31814]: pgmap v1255: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 20 op/s 2024-04-23T15:31:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:00 smithi137 ceph-mon[31694]: pgmap v1256: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:31:01.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:00 smithi007 ceph-mon[27906]: pgmap v1256: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:31:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:00 smithi186 ceph-mon[31814]: pgmap v1256: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:31:03.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:02 smithi007 ceph-mon[27906]: pgmap v1257: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 35 op/s 2024-04-23T15:31:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:02 smithi137 ceph-mon[31694]: pgmap v1257: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 35 op/s 2024-04-23T15:31:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:02 smithi186 ceph-mon[31814]: pgmap v1257: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 35 op/s 2024-04-23T15:31:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:04 smithi137 ceph-mon[31694]: pgmap v1258: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:31:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:04 smithi007 ceph-mon[27906]: pgmap v1258: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:31:05.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:04 smithi186 ceph-mon[31814]: pgmap v1258: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:31:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:06 smithi137 ceph-mon[31694]: pgmap v1259: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:31:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:06 smithi007 ceph-mon[27906]: pgmap v1259: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:31:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:06 smithi186 ceph-mon[31814]: pgmap v1259: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.2 MiB/s wr, 30 op/s 2024-04-23T15:31:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:08 smithi137 ceph-mon[31694]: pgmap v1260: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:31:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:08 smithi137 ceph-mon[31694]: osdmap e159: 12 total, 12 up, 12 in 2024-04-23T15:31:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:31:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:08 smithi007 ceph-mon[27906]: pgmap v1260: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:31:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:08 smithi007 ceph-mon[27906]: osdmap e159: 12 total, 12 up, 12 in 2024-04-23T15:31:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:31:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:08 smithi186 ceph-mon[31814]: pgmap v1260: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:31:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:08 smithi186 ceph-mon[31814]: osdmap e159: 12 total, 12 up, 12 in 2024-04-23T15:31:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:31:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 -- 172.21.15.7:0/2208764746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 msgr2=0x7f14841033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 --2- 172.21.15.7:0/2208764746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841033a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1474009900 tx=0x7f147402a480 comp rx=0 tx=0).stop 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 -- 172.21.15.7:0/2208764746 shutdown_connections 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 --2- 172.21.15.7:0/2208764746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 0x7f148410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 --2- 172.21.15.7:0/2208764746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14841038e0 0x7f148410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 --2- 172.21.15.7:0/2208764746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841033a0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.534+0000 7f1488c00640 1 -- 172.21.15.7:0/2208764746 >> 172.21.15.7:0/2208764746 conn(0x7f14840fc820 msgr2=0x7f14840fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.535+0000 7f1488c00640 1 -- 172.21.15.7:0/2208764746 shutdown_connections 2024-04-23T15:31:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.535+0000 7f1488c00640 1 -- 172.21.15.7:0/2208764746 wait complete. 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 Processor -- start 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 -- start start 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14841038e0 0x7f14841a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 0x7f148419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1484112140 con 0x7f1484102fc0 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1484111fc0 con 0x7f148410c3e0 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.536+0000 7f1488c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14841122c0 con 0x7f14841038e0 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41230/0 (socket says 172.21.15.7:41230) 2024-04-23T15:31:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 -- 172.21.15.7:0/473049626 learned_addr learned my addr 172.21.15.7:0/473049626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483e00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 0x7f148419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f147be00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14841038e0 0x7f14841a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 -- 172.21.15.7:0/473049626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14841038e0 msgr2=0x7f14841a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14841038e0 0x7f14841a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 -- 172.21.15.7:0/473049626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 msgr2=0x7f148419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 0x7f148419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.537+0000 7f1483400640 1 -- 172.21.15.7:0/473049626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148419afb0 con 0x7f1484102fc0 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1483e00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 0x7f148419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1483400640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841a0580 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1474005ab0 tx=0x7f1474003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1480c00640 1 -- 172.21.15.7:0/473049626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147403f070 con 0x7f1484102fc0 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1480c00640 1 -- 172.21.15.7:0/473049626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1474031d60 con 0x7f1484102fc0 2024-04-23T15:31:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148419b240 con 0x7f1484102fc0 2024-04-23T15:31:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1480c00640 1 -- 172.21.15.7:0/473049626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474035030 con 0x7f1484102fc0 2024-04-23T15:31:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.538+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14841a73d0 con 0x7f1484102fc0 2024-04-23T15:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.543+0000 7f1480c00640 1 -- 172.21.15.7:0/473049626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1474042070 con 0x7f1484102fc0 2024-04-23T15:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 Processor -- start 2024-04-23T15:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 -- start start 2024-04-23T15:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x56433308c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333097060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333099990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564332ff2900 con 0x5643330975a0 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564332f98f20 con 0x56433308cce0 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.544+0000 7f148d019740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564332fee8c0 con 0x56433308c3c0 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333099990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333099990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41246/0 (socket says 172.21.15.7:41246) 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 -- 172.21.15.7:0/3690248101 learned_addr learned my addr 172.21.15.7:0/3690248101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f1483e00640 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x56433308c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f1483400640 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333097060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 -- 172.21.15.7:0/3690248101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 msgr2=0x56433308c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x56433308c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 -- 172.21.15.7:0/3690248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 msgr2=0x564333097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333097060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.545+0000 7f147be00640 1 -- 172.21.15.7:0/3690248101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564332fbde10 con 0x5643330975a0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.546+0000 7f1480c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14680a3d10 0x7f14680a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.546+0000 7f1480c00640 1 -- 172.21.15.7:0/473049626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 9555+0+0 (secure 0 0 0) 0x7f14740f15b0 con 0x7f1484102fc0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.546+0000 7f1483e00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14680a3d10 0x7f14680a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.546+0000 7f147be00640 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333099990 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f146c00bc60 tx=0x7f146c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e41ddc71388a9dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.546+0000 7f1473e00640 1 -- 172.21.15.7:0/3690248101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c015070 con 0x5643330975a0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.547+0000 7f1473e00640 1 -- 172.21.15.7:0/3690248101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f146c0118f0 con 0x5643330975a0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.547+0000 7f1473e00640 1 -- 172.21.15.7:0/3690248101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c010810 con 0x5643330975a0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 -- 172.21.15.7:0/3690248101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 msgr2=0x564333099990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f1483e00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14680a3d10 0x7f14680a61d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f147c00a400 tx=0x7f147c009610 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333099990 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f146c00bc60 tx=0x7f146c00f730 comp rx=0 tx=0).stop 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 -- 172.21.15.7:0/3690248101 shutdown_connections 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333099990 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 --2- 172.21.15.7:0/3690248101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x56433308c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 -- 172.21.15.7:0/3690248101 >> 172.21.15.7:0/3690248101 conn(0x5643330888d0 msgr2=0x564333088cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 -- 172.21.15.7:0/3690248101 shutdown_connections 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.548+0000 7f148d019740 1 -- 172.21.15.7:0/3690248101 wait complete. 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 -- start start 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 Processor -- start 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x564333094560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333094aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333094fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56433309a0e0 con 0x5643330975a0 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564332fac2c0 con 0x56433308cce0 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56433309a260 con 0x56433308c3c0 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.549+0000 7f148d019740 10 client.0 _ll_register_callbacks cb 0x564332d04a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333094fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x564333094560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333094fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41262/0 (socket says 172.21.15.7:41262) 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f147be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333094aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 -- 172.21.15.7:0/2199143464 learned_addr learned my addr 172.21.15.7:0/2199143464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 -- 172.21.15.7:0/2199143464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 msgr2=0x564333094560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x564333094560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 -- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 msgr2=0x564333094aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333094aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.550+0000 7f1483e00640 1 -- 172.21.15.7:0/2199143464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564332fbcfd0 con 0x5643330975a0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.551+0000 7f1483e00640 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333094fe0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f147c01ae30 tx=0x7f147c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7568fbdea93d6a7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.551+0000 7f1470c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.551+0000 7f1470c00640 1 -- 172.21.15.7:0/2199143464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c028060 con 0x5643330975a0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.551+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f146c0118f0 con 0x5643330975a0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.551+0000 7f1470c00640 1 -- 172.21.15.7:0/2199143464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(159..159 src has 1..159) ==== 9555+0+0 (secure 0 0 0) 0x7f147c0178a0 con 0x5643330975a0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f1470c00640 1 -- 172.21.15.7:0/2199143464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f147c02f050 con 0x5643330975a0 2024-04-23T15:31:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f148d019740 10 client.18873 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564332d05210 con 0x5643330975a0 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f1470c00640 1 -- 172.21.15.7:0/2199143464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f146c0118f0 con 0x5643330975a0 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f1470c00640 1 -- 172.21.15.7:0/2199143464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f147c023b90 con 0x5643330975a0 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f148d019740 10 client.18873 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.552+0000 7f148d019740 10 client.18873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.553+0000 7f148d019740 20 client.18873 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.553+0000 7f148d019740 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643330a76f0 0x5643330a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.553+0000 7f148d019740 4 client.18873 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.553+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564333000320 con 0x5643330a76f0 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.553+0000 7f1483400640 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643330a76f0 0x5643330a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.554+0000 7f1483400640 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643330a76f0 0x5643330a9b00 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b41c8b30aba078a server_cookie=d59fd7260b500e99 in_seq=0 out_seq=0 2024-04-23T15:31:09.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.554+0000 7f1470c00640 10 client.18873 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:09.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f1470c00640 1 -- 172.21.15.7:0/2199143464 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564333000320 con 0x5643330a76f0 2024-04-23T15:31:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f1470c00640 10 client.18873 handle_command_reply: tid=0 2024-04-23T15:31:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 client.18873 shutdown 2024-04-23T15:31:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 msgr2=0x564333094fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333094fe0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f147c01ae30 tx=0x7f147c004b50 comp rx=0 tx=0).stop 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 shutdown_connections 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5643330a76f0 0x5643330a9b00 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x564333094aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643330975a0 0x564333094fe0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f1470c00640 0 client.18873 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 --2- 172.21.15.7:0/2199143464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308c3c0 0x564333094560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.556+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 >> 172.21.15.7:0/2199143464 conn(0x5643330888d0 msgr2=0x564333087a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.557+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 shutdown_connections 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.557+0000 7f148d019740 1 -- 172.21.15.7:0/2199143464 wait complete. 2024-04-23T15:31:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.557+0000 7f148d019740 20 client.18873 trim_cache size 0 max 16384 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.577+0000 7f148d019740 1 Processor -- start 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 -- start start 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x564333088210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x5643330a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5643330975a0 0x5643330af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14841b15b0 con 0x56433308c3c0 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f14841b30f0 con 0x56433308cce0 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f148d019740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14841b1c80 con 0x5643330975a0 2024-04-23T15:31:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f1483400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x564333088210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f1483400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x564333088210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41270/0 (socket says 172.21.15.7:41270) 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f1483400640 1 -- 172.21.15.7:0/1700173106 learned_addr learned my addr 172.21.15.7:0/1700173106 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.578+0000 7f147be00640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x5643330a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483e00640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5643330975a0 0x5643330af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483400640 1 -- 172.21.15.7:0/1700173106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5643330975a0 msgr2=0x5643330af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483400640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5643330975a0 0x5643330af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483400640 1 -- 172.21.15.7:0/1700173106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 msgr2=0x5643330a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483400640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x5643330a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483400640 1 -- 172.21.15.7:0/1700173106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564333099d00 con 0x56433308c3c0 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f147be00640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x5643330a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483e00640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5643330975a0 0x5643330af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1483400640 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x564333088210 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f14740bd0d0 tx=0x7f14740f3ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c95ebed7b1220b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.579+0000 7f1473400640 1 -- 172.21.15.7:0/1700173106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474049030 con 0x56433308c3c0 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f1473400640 1 -- 172.21.15.7:0/1700173106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14740bd140 con 0x56433308c3c0 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f1473400640 1 -- 172.21.15.7:0/1700173106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740b97b0 con 0x56433308c3c0 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 -- 172.21.15.7:0/1700173106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 msgr2=0x564333088210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x564333088210 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f14740bd0d0 tx=0x7f14740f3ac0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 -- 172.21.15.7:0/1700173106 shutdown_connections 2024-04-23T15:31:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56433308cce0 0x5643330a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5643330975a0 0x5643330af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 --2- 172.21.15.7:0/1700173106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x564333088210 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.580+0000 7f148d019740 1 -- 172.21.15.7:0/1700173106 >> 172.21.15.7:0/1700173106 conn(0x5643330888d0 msgr2=0x56433308e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.581+0000 7f148d019740 1 -- 172.21.15.7:0/1700173106 shutdown_connections 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.581+0000 7f148d019740 1 -- 172.21.15.7:0/1700173106 wait complete. 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.581+0000 7f148d019740 1 -- start start 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.581+0000 7f148d019740 1 Processor -- start 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x56433309f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308cce0 0x56433309fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5643330975a0 0x56433309c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14841b2a20 con 0x56433308c3c0 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f14841b2350 con 0x5643330975a0 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14841af5b0 con 0x56433308cce0 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f148d019740 10 client.0 _ll_register_callbacks cb 0x7f147c009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f1483400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x56433309f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f1483400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x56433309f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41274/0 (socket says 172.21.15.7:41274) 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.582+0000 7f1483400640 1 -- 172.21.15.7:0/2078733826 learned_addr learned my addr 172.21.15.7:0/2078733826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483400640 1 -- 172.21.15.7:0/2078733826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308cce0 msgr2=0x56433309fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f147be00640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308cce0 0x56433309fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483e00640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5643330975a0 0x56433309c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483400640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308cce0 0x56433309fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483400640 1 -- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5643330975a0 msgr2=0x56433309c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483400640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5643330975a0 0x56433309c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483400640 1 -- 172.21.15.7:0/2078733826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564332dd1620 con 0x56433308c3c0 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f147be00640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308cce0 0x56433309fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483e00640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5643330975a0 0x56433309c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1483400640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x56433309f540 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f14740b95a0 tx=0x7f147402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cded06f8d118d2b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.583+0000 7f1470c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.584+0000 7f1470c00640 1 -- 172.21.15.7:0/2078733826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474049040 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.584+0000 7f1470c00640 1 -- 172.21.15.7:0/2078733826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(159..159 src has 1..159) ==== 9555+0+0 (secure 0 0 0) 0x7f14740b97b0 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.584+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14740bd140 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.584+0000 7f1470c00640 1 -- 172.21.15.7:0/2078733826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f14740c5db0 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.584+0000 7f148d019740 10 client.18879 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.584+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56433310e330 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f1470c00640 1 -- 172.21.15.7:0/2078733826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14740bd140 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f1470c00640 1 -- 172.21.15.7:0/2078733826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f14740d1be0 con 0x56433308c3c0 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f148d019740 10 client.18879 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f148d019740 10 client.18879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f148d019740 20 client.18879 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f148d019740 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56433310e820 0x564333110c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f148d019740 4 client.18879 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.585+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564332ffa190 con 0x56433310e820 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.586+0000 7f147be00640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56433310e820 0x564333110c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.586+0000 7f147be00640 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56433310e820 0x564333110c10 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f302c7a8aafdc24 server_cookie=b05e49933aeac2f in_seq=0 out_seq=0 2024-04-23T15:31:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.586+0000 7f1470c00640 10 client.18879 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f1470c00640 1 -- 172.21.15.7:0/2078733826 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564332ffa190 con 0x56433310e820 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f1470c00640 10 client.18879 handle_command_reply: tid=0 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 client.18879 shutdown 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 msgr2=0x56433309f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x56433309f540 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f14740b95a0 tx=0x7f147402a480 comp rx=0 tx=0).stop 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 shutdown_connections 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56433310e820 0x564333110c10 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5643330975a0 0x56433309c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56433308cce0 0x56433309fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f148d019740 1 --2- 172.21.15.7:0/2078733826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56433308c3c0 0x56433309f540 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.612+0000 7f1470c00640 0 client.18879 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.613+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 >> 172.21.15.7:0/2078733826 conn(0x5643330888d0 msgr2=0x56433308dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.613+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 shutdown_connections 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.613+0000 7f148d019740 1 -- 172.21.15.7:0/2078733826 wait complete. 2024-04-23T15:31:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.613+0000 7f148d019740 20 client.18879 trim_cache size 0 max 16384 2024-04-23T15:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14680a3d10 msgr2=0x7f14680a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14680a3d10 0x7f14680a61d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f147c00a400 tx=0x7f147c009610 comp rx=0 tx=0).stop 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 msgr2=0x7f14841a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841a0580 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1474005ab0 tx=0x7f1474003cd0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 shutdown_connections 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f14680a3d10 0x7f14680a61d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f148410c3e0 0x7f148419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14841038e0 0x7f14841a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 --2- 172.21.15.7:0/473049626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102fc0 0x7f14841a0580 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 >> 172.21.15.7:0/473049626 conn(0x7f14840fc820 msgr2=0x7f1484101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 shutdown_connections 2024-04-23T15:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:09.614+0000 7f1488c00640 1 -- 172.21.15.7:0/473049626 wait complete. 2024-04-23T15:31:10.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:10.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:10.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:10.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:10.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:10 smithi007 ceph-mon[27906]: pgmap v1262: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.5 MiB/s wr, 34 op/s 2024-04-23T15:31:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:31:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:31:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:10 smithi186 ceph-mon[31814]: pgmap v1262: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.5 MiB/s wr, 34 op/s 2024-04-23T15:31:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:31:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:31:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:10 smithi137 ceph-mon[31694]: pgmap v1262: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.5 MiB/s wr, 34 op/s 2024-04-23T15:31:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:31:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:31:11.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:31:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:12 smithi007 ceph-mon[27906]: pgmap v1263: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:12 smithi186 ceph-mon[31814]: pgmap v1263: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:12 smithi137 ceph-mon[31694]: pgmap v1263: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:14 smithi007 ceph-mon[27906]: pgmap v1264: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:14 smithi186 ceph-mon[31814]: pgmap v1264: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:14 smithi137 ceph-mon[31694]: pgmap v1264: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:16 smithi007 ceph-mon[27906]: pgmap v1265: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:16 smithi007 ceph-mon[27906]: osdmap e160: 12 total, 12 up, 12 in 2024-04-23T15:31:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:16 smithi186 ceph-mon[31814]: pgmap v1265: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:16 smithi186 ceph-mon[31814]: osdmap e160: 12 total, 12 up, 12 in 2024-04-23T15:31:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:16 smithi137 ceph-mon[31694]: pgmap v1265: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 16 op/s 2024-04-23T15:31:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:16 smithi137 ceph-mon[31694]: osdmap e160: 12 total, 12 up, 12 in 2024-04-23T15:31:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:18 smithi007 ceph-mon[27906]: pgmap v1267: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T15:31:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:18 smithi186 ceph-mon[31814]: pgmap v1267: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T15:31:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:18 smithi137 ceph-mon[31694]: pgmap v1267: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.3 MiB/s wr, 17 op/s 2024-04-23T15:31:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:20 smithi007 ceph-mon[27906]: pgmap v1268: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:31:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:20 smithi186 ceph-mon[31814]: pgmap v1268: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:31:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:20 smithi137 ceph-mon[31694]: pgmap v1268: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.0 MiB/s wr, 16 op/s 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 -- 172.21.15.7:0/9938235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 msgr2=0x7f639010e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 --2- 172.21.15.7:0/9938235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f639010e1b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f6378009900 tx=0x7f637802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 -- 172.21.15.7:0/9938235 shutdown_connections 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 --2- 172.21.15.7:0/9938235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f639010e780 0x7f6390110b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 --2- 172.21.15.7:0/9938235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f639010e1b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 --2- 172.21.15.7:0/9938235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6390100bd0 0x7f6390100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.773+0000 7f6394a00640 1 -- 172.21.15.7:0/9938235 >> 172.21.15.7:0/9938235 conn(0x7f63900fc820 msgr2=0x7f63900fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.774+0000 7f6394a00640 1 -- 172.21.15.7:0/9938235 shutdown_connections 2024-04-23T15:31:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.774+0000 7f6394a00640 1 -- 172.21.15.7:0/9938235 wait complete. 2024-04-23T15:31:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.775+0000 7f6394a00640 1 Processor -- start 2024-04-23T15:31:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.775+0000 7f6394a00640 1 -- start start 2024-04-23T15:31:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.775+0000 7f6394a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6390100bd0 0x7f63901a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.775+0000 7f6394a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f63901a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6394a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f639010e780 0x7f639019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6394a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6390114320 con 0x7f6390101580 2024-04-23T15:31:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6394a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63901141a0 con 0x7f639010e780 2024-04-23T15:31:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6394a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63901144a0 con 0x7f6390100bd0 2024-04-23T15:31:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6387e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f63901a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6387e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f63901a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41060/0 (socket says 172.21.15.7:41060) 2024-04-23T15:31:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6387e00640 1 -- 172.21.15.7:0/3228998591 learned_addr learned my addr 172.21.15.7:0/3228998591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f638e800640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6390100bd0 0x7f63901a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f638f200640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f639010e780 0x7f639019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.776+0000 7f6387e00640 1 -- 172.21.15.7:0/3228998591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6390100bd0 msgr2=0x7f63901a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387e00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6390100bd0 0x7f63901a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387e00640 1 -- 172.21.15.7:0/3228998591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f639010e780 msgr2=0x7f639019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387e00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f639010e780 0x7f639019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387e00640 1 -- 172.21.15.7:0/3228998591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639019af60 con 0x7f6390101580 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387e00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f63901a0b20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f6378005ab0 tx=0x7f6378003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387400640 1 -- 172.21.15.7:0/3228998591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637803f070 con 0x7f6390101580 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387400640 1 -- 172.21.15.7:0/3228998591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6378031d60 con 0x7f6390101580 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6387400640 1 -- 172.21.15.7:0/3228998591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378035030 con 0x7f6390101580 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.777+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639019b1f0 con 0x7f6390101580 2024-04-23T15:31:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.778+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63901a7560 con 0x7f6390101580 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.781+0000 7f6398231740 1 Processor -- start 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 -- start start 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6387400640 1 -- 172.21.15.7:0/3228998591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6378042070 con 0x7f6390101580 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bbff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc0a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc0c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56483bb65900 con 0x56483bbff3c0 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56483bb0bf20 con 0x56483bbffce0 2024-04-23T15:31:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f6398231740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56483bb618c0 con 0x56483bc0a5a0 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f638f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bbff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f638f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bbff7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41074/0 (socket says 172.21.15.7:41074) 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.782+0000 7f638f200640 1 -- 172.21.15.7:0/1705390317 learned_addr learned my addr 172.21.15.7:0/1705390317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638e800640 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc0a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f6387e00640 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc0c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638f200640 1 -- 172.21.15.7:0/1705390317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 msgr2=0x56483bc0c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638f200640 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc0c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638f200640 1 -- 172.21.15.7:0/1705390317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 msgr2=0x56483bc0a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638f200640 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc0a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638f200640 1 -- 172.21.15.7:0/1705390317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483bb30e10 con 0x56483bbff3c0 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.783+0000 7f638f200640 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bbff7a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f6388009e00 tx=0x7f6388010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68785647c71b48f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.784+0000 7f637f400640 1 -- 172.21.15.7:0/1705390317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388016070 con 0x56483bbff3c0 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.784+0000 7f637f400640 1 -- 172.21.15.7:0/1705390317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6388004d20 con 0x56483bbff3c0 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.784+0000 7f637f400640 1 -- 172.21.15.7:0/1705390317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388012690 con 0x56483bbff3c0 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.784+0000 7f6387400640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63740a3d90 0x7f63740a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.784+0000 7f6387400640 1 -- 172.21.15.7:0/3228998591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7f63780f1110 con 0x7f6390101580 2024-04-23T15:31:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.784+0000 7f638e800640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63740a3d90 0x7f63740a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 -- 172.21.15.7:0/1705390317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 msgr2=0x56483bbff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bbff7a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f6388009e00 tx=0x7f6388010740 comp rx=0 tx=0).stop 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 -- 172.21.15.7:0/1705390317 shutdown_connections 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc0a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc0c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 --2- 172.21.15.7:0/1705390317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bbff7a0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 -- 172.21.15.7:0/1705390317 >> 172.21.15.7:0/1705390317 conn(0x56483bbfb8d0 msgr2=0x56483bbfbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 -- 172.21.15.7:0/1705390317 shutdown_connections 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f6398231740 1 -- 172.21.15.7:0/1705390317 wait complete. 2024-04-23T15:31:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.785+0000 7f638e800640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63740a3d90 0x7f63740a6250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56483bc00960 tx=0x7f638000b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.786+0000 7f6398231740 1 -- start start 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.786+0000 7f6398231740 1 Processor -- start 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.786+0000 7f6398231740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.786+0000 7f6398231740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc07b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.786+0000 7f6398231740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc08040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.786+0000 7f6398231740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56483bc0d0e0 con 0x56483bbff3c0 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f6398231740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56483bb1f2c0 con 0x56483bbffce0 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f6398231740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56483bc0d260 con 0x56483bc0a5a0 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f6398231740 10 client.0 _ll_register_callbacks cb 0x56483b877a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41086/0 (socket says 172.21.15.7:41086) 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 -- 172.21.15.7:0/1352600141 learned_addr learned my addr 172.21.15.7:0/1352600141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638f200640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc08040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f6387e00640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc07b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 -- 172.21.15.7:0/1352600141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 msgr2=0x56483bc08040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc08040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 -- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 msgr2=0x56483bc07b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc07b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.787+0000 7f638e800640 1 -- 172.21.15.7:0/1352600141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483bb2ffd0 con 0x56483bbff3c0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.788+0000 7f638e800640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc075c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f6380004530 tx=0x7f63800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622fb5e54be07027 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.788+0000 7f6373e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.788+0000 7f6373e00640 1 -- 172.21.15.7:0/1352600141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638001b670 con 0x56483bbff3c0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.788+0000 7f6373e00640 1 -- 172.21.15.7:0/1352600141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7f638001b810 con 0x56483bbff3c0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.788+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6388004d20 con 0x56483bbff3c0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6373e00640 1 -- 172.21.15.7:0/1352600141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f638001ba10 con 0x56483bbff3c0 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 10 client.18891 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56483b878210 con 0x56483bbff3c0 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6373e00640 1 -- 172.21.15.7:0/1352600141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6388004d20 con 0x56483bbff3c0 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6373e00640 1 -- 172.21.15.7:0/1352600141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6380024070 con 0x56483bbff3c0 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 10 client.18891 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 10 client.18891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 20 client.18891 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc1a7d0 0x56483bc1cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 4 client.18891 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.789+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56483bb73320 con 0x56483bc1a7d0 2024-04-23T15:31:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.790+0000 7f6387e00640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc1a7d0 0x56483bc1cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.791+0000 7f6373e00640 10 client.18891 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.791+0000 7f6387e00640 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc1a7d0 0x56483bc1cc20 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e23ffdc7a5602c61 server_cookie=cfa4a4d945f658da in_seq=0 out_seq=0 2024-04-23T15:31:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6373e00640 1 -- 172.21.15.7:0/1352600141 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56483bb73320 con 0x56483bc1a7d0 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6373e00640 10 client.18891 handle_command_reply: tid=0 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 client.18891 shutdown 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 msgr2=0x56483bc075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc075c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f6380004530 tx=0x7f63800046c0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 shutdown_connections 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc1a7d0 0x56483bc1cc20 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc07b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bc08040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 --2- 172.21.15.7:0/1352600141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc075c0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6373e00640 0 client.18891 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.793+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 >> 172.21.15.7:0/1352600141 conn(0x56483bbfb8d0 msgr2=0x56483bc01650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.794+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 shutdown_connections 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.794+0000 7f6398231740 1 -- 172.21.15.7:0/1352600141 wait complete. 2024-04-23T15:31:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.794+0000 7f6398231740 20 client.18891 trim_cache size 0 max 16384 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 Processor -- start 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 -- start start 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc160b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc01dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bbfa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b1500 con 0x56483bbff3c0 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b3040 con 0x56483bbffce0 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.811+0000 7f6398231740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b1bd0 con 0x56483bc0a5a0 2024-04-23T15:31:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41090/0 (socket says 172.21.15.7:41090) 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 -- 172.21.15.7:0/1209732870 learned_addr learned my addr 172.21.15.7:0/1209732870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f6387e00640 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc01dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638f200640 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bbfa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 -- 172.21.15.7:0/1209732870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 msgr2=0x56483bbfa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bbfa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 -- 172.21.15.7:0/1209732870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 msgr2=0x56483bc01dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc01dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 -- 172.21.15.7:0/1209732870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483b944620 con 0x56483bbff3c0 2024-04-23T15:31:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.812+0000 7f638e800640 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc160b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6380017040 tx=0x7f638000b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5878de6becc2f091 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.813+0000 7f637ea00640 1 -- 172.21.15.7:0/1209732870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638001b670 con 0x56483bbff3c0 2024-04-23T15:31:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.813+0000 7f637ea00640 1 -- 172.21.15.7:0/1209732870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f638001b810 con 0x56483bbff3c0 2024-04-23T15:31:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.813+0000 7f637ea00640 1 -- 172.21.15.7:0/1209732870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380004ab0 con 0x56483bbff3c0 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 -- 172.21.15.7:0/1209732870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 msgr2=0x56483bc160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc160b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6380017040 tx=0x7f638000b400 comp rx=0 tx=0).stop 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 -- 172.21.15.7:0/1209732870 shutdown_connections 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc01dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bc0a5a0 0x56483bbfa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 --2- 172.21.15.7:0/1209732870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bbff3c0 0x56483bc160b0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 -- 172.21.15.7:0/1209732870 >> 172.21.15.7:0/1209732870 conn(0x56483bbfb8d0 msgr2=0x56483bbfa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 -- 172.21.15.7:0/1209732870 shutdown_connections 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 -- 172.21.15.7:0/1209732870 wait complete. 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 -- start start 2024-04-23T15:31:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.814+0000 7f6398231740 1 Processor -- start 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bbff3c0 0x56483bc04570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc04ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 0x56483bc04ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b2970 con 0x56483bc0a5a0 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b22a0 con 0x56483bbffce0 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63901af500 con 0x56483bbff3c0 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f6398231740 10 client.0 _ll_register_callbacks cb 0x7f63800043a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f638f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 0x56483bc04ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f638f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 0x56483bc04ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41094/0 (socket says 172.21.15.7:41094) 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.815+0000 7f638f200640 1 -- 172.21.15.7:0/442004430 learned_addr learned my addr 172.21.15.7:0/442004430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f6387e00640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc04ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638e800640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bbff3c0 0x56483bc04570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638f200640 1 -- 172.21.15.7:0/442004430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bbff3c0 msgr2=0x56483bc04570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638f200640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bbff3c0 0x56483bc04570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638f200640 1 -- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 msgr2=0x56483bc04ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638f200640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc04ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638f200640 1 -- 172.21.15.7:0/442004430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483bc88850 con 0x56483bc0a5a0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f638f200640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 0x56483bc04ff0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f6388000f80 tx=0x7f6388012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7464c6ccb6de1de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.816+0000 7f6373e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6373e00640 1 -- 172.21.15.7:0/442004430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388016040 con 0x56483bc0a5a0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f638001b810 con 0x56483bc0a5a0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6373e00640 1 -- 172.21.15.7:0/442004430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7f6388012b80 con 0x56483bc0a5a0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6373e00640 1 -- 172.21.15.7:0/442004430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6388032050 con 0x56483bc0a5a0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6398231740 10 client.18897 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56483bc89b40 con 0x56483bc0a5a0 2024-04-23T15:31:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.817+0000 7f6373e00640 1 -- 172.21.15.7:0/442004430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f638001b810 con 0x56483bc0a5a0 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6373e00640 1 -- 172.21.15.7:0/442004430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f638800f040 con 0x56483bc0a5a0 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6398231740 10 client.18897 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6398231740 10 client.18897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6398231740 20 client.18897 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6398231740 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc89f50 0x56483bc8c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6398231740 4 client.18897 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56483bb6d190 con 0x56483bc89f50 2024-04-23T15:31:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.818+0000 7f638e800640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc89f50 0x56483bc8c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.819+0000 7f638e800640 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc89f50 0x56483bc8c370 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37620e55afaee2f8 server_cookie=894830071f73cf62 in_seq=0 out_seq=0 2024-04-23T15:31:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.819+0000 7f6373e00640 10 client.18897 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.849+0000 7f6373e00640 1 -- 172.21.15.7:0/442004430 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56483bb6d190 con 0x56483bc89f50 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.849+0000 7f6373e00640 10 client.18897 handle_command_reply: tid=0 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.849+0000 7f6398231740 1 client.18897 shutdown 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.849+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 msgr2=0x56483bc04ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.849+0000 7f6398231740 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 0x56483bc04ff0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f6388000f80 tx=0x7f6388012680 comp rx=0 tx=0).stop 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 shutdown_connections 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56483bc89f50 0x56483bc8c370 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56483bbffce0 0x56483bc04ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56483bc0a5a0 0x56483bc04ff0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 --2- 172.21.15.7:0/442004430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56483bbff3c0 0x56483bc04570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6373e00640 0 client.18897 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 >> 172.21.15.7:0/442004430 conn(0x56483bbfb8d0 msgr2=0x56483bbfaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 shutdown_connections 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 1 -- 172.21.15.7:0/442004430 wait complete. 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.850+0000 7f6398231740 20 client.18897 trim_cache size 0 max 16384 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:31:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63740a3d90 msgr2=0x7f63740a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63740a3d90 0x7f63740a6250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56483bc00960 tx=0x7f638000b390 comp rx=0 tx=0).stop 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 msgr2=0x7f63901a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f63901a0b20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f6378005ab0 tx=0x7f6378003cd0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 shutdown_connections 2024-04-23T15:31:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63740a3d90 0x7f63740a6250 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f639010e780 0x7f639019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390101580 0x7f63901a0b20 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 --2- 172.21.15.7:0/3228998591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6390100bd0 0x7f63901a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 >> 172.21.15.7:0/3228998591 conn(0x7f63900fc820 msgr2=0x7f63900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 shutdown_connections 2024-04-23T15:31:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:22.851+0000 7f6394a00640 1 -- 172.21.15.7:0/3228998591 wait complete. 2024-04-23T15:31:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:22 smithi007 ceph-mon[27906]: pgmap v1269: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:22 smithi186 ceph-mon[31814]: pgmap v1269: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:22 smithi137 ceph-mon[31694]: pgmap v1269: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:24 smithi007 ceph-mon[27906]: pgmap v1270: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:24 smithi186 ceph-mon[31814]: pgmap v1270: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:24 smithi137 ceph-mon[31694]: pgmap v1270: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:26 smithi007 ceph-mon[27906]: pgmap v1271: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:26 smithi186 ceph-mon[31814]: pgmap v1271: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:26 smithi137 ceph-mon[31694]: pgmap v1271: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 12 op/s 2024-04-23T15:31:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:29 smithi007 ceph-mon[27906]: pgmap v1272: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:31:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:29 smithi186 ceph-mon[31814]: pgmap v1272: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:31:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:29 smithi137 ceph-mon[31694]: pgmap v1272: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.4 MiB/s wr, 20 op/s 2024-04-23T15:31:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:31 smithi007 ceph-mon[27906]: pgmap v1273: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:31:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:31 smithi186 ceph-mon[31814]: pgmap v1273: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:31:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:31 smithi137 ceph-mon[31694]: pgmap v1273: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:31:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:33 smithi007 ceph-mon[27906]: pgmap v1274: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:31:33.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:33 smithi186 ceph-mon[31814]: pgmap v1274: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:31:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:33 smithi137 ceph-mon[31694]: pgmap v1274: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:31:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:35 smithi007 ceph-mon[27906]: pgmap v1275: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:35 smithi186 ceph-mon[31814]: pgmap v1275: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:35 smithi137 ceph-mon[31694]: pgmap v1275: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 -- 172.21.15.7:0/444267701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd51410e4d0 msgr2=0x7fd51410e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 --2- 172.21.15.7:0/444267701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd51410e4d0 0x7fd51410e8b0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fd508009930 tx=0x7fd50802a420 comp rx=0 tx=0).stop 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 -- 172.21.15.7:0/444267701 shutdown_connections 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 --2- 172.21.15.7:0/444267701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd514108540 0x7fd514108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 --2- 172.21.15.7:0/444267701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd514108ec0 0x7fd514115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 --2- 172.21.15.7:0/444267701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd51410e4d0 0x7fd51410e8b0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.029+0000 7fd51ac00640 1 -- 172.21.15.7:0/444267701 >> 172.21.15.7:0/444267701 conn(0x7fd514077de0 msgr2=0x7fd514106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.030+0000 7fd51ac00640 1 -- 172.21.15.7:0/444267701 shutdown_connections 2024-04-23T15:31:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.030+0000 7fd51ac00640 1 -- 172.21.15.7:0/444267701 wait complete. 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 Processor -- start 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 -- start start 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd514108540 0x7fd5141a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 0x7fd5141a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd51410e4d0 0x7fd51419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd514118700 con 0x7fd514108ec0 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd514118580 con 0x7fd514108540 2024-04-23T15:31:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.031+0000 7fd51ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd514118880 con 0x7fd51410e4d0 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 0x7fd5141a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 0x7fd5141a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33954/0 (socket says 172.21.15.7:33954) 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 -- 172.21.15.7:0/3338271475 learned_addr learned my addr 172.21.15.7:0/3338271475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd519800640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd514108540 0x7fd5141a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd51a200640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd51410e4d0 0x7fd51419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 -- 172.21.15.7:0/3338271475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd51410e4d0 msgr2=0x7fd51419eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd51410e4d0 0x7fd51419eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 -- 172.21.15.7:0/3338271475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd514108540 msgr2=0x7fd5141a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd514108540 0x7fd5141a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd518e00640 1 -- 172.21.15.7:0/3338271475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51419f220 con 0x7fd514108ec0 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.032+0000 7fd51a200640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd51410e4d0 0x7fd51419eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.033+0000 7fd518e00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 0x7fd5141a4e30 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e9f0 tx=0x7fd50000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.033+0000 7fd512000640 1 -- 172.21.15.7:0/3338271475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50000cd80 con 0x7fd514108ec0 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.033+0000 7fd512000640 1 -- 172.21.15.7:0/3338271475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5000108e0 con 0x7fd514108ec0 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.033+0000 7fd512000640 1 -- 172.21.15.7:0/3338271475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500018920 con 0x7fd514108ec0 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.033+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51419f510 con 0x7fd514108ec0 2024-04-23T15:31:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.033+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5141ab7b0 con 0x7fd514108ec0 2024-04-23T15:31:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.038+0000 7fd51f012740 1 Processor -- start 2024-04-23T15:31:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.038+0000 7fd512000640 1 -- 172.21.15.7:0/3338271475 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd500010a90 con 0x7fd514108ec0 2024-04-23T15:31:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.038+0000 7fd51f012740 1 -- start start 2024-04-23T15:31:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51f012740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 0x55dbabbaa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51f012740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbb5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51f012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbb55a0 0x55dbabbb7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51f012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dbabb10900 con 0x55dbabbb55a0 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51f012740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dbabab6f20 con 0x55dbabbaa3c0 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51f012740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55dbabb0c8c0 con 0x55dbabbaace0 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 0x55dbabbaa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 0x55dbabbaa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:59472/0 (socket says 172.21.15.7:59472) 2024-04-23T15:31:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.039+0000 7fd51a200640 1 -- 172.21.15.7:0/82295246 learned_addr learned my addr 172.21.15.7:0/82295246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd519800640 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbb5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd518e00640 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbb55a0 0x55dbabbb7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd51a200640 1 -- 172.21.15.7:0/82295246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 msgr2=0x55dbabbb5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd51a200640 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbb5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd51a200640 1 -- 172.21.15.7:0/82295246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbb55a0 msgr2=0x55dbabbb7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd51a200640 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbb55a0 0x55dbabbb7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.040+0000 7fd51a200640 1 -- 172.21.15.7:0/82295246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbabadbe10 con 0x55dbabbaa3c0 2024-04-23T15:31:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.041+0000 7fd512000640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd4fc0a3d10 0x7fd4fc0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.041+0000 7fd512000640 1 -- 172.21.15.7:0/3338271475 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7fd5000d1000 con 0x7fd514108ec0 2024-04-23T15:31:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.041+0000 7fd519800640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd4fc0a3d10 0x7fd4fc0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.041+0000 7fd51a200640 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 0x55dbabbaa7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009f10 tx=0x7fd50c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8b5338b7df0604 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.042+0000 7fd506a00640 1 -- 172.21.15.7:0/82295246 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c003b70 con 0x55dbabbaa3c0 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.042+0000 7fd506a00640 1 -- 172.21.15.7:0/82295246 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd50c003d10 con 0x55dbabbaa3c0 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.042+0000 7fd506a00640 1 -- 172.21.15.7:0/82295246 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c011940 con 0x55dbabbaa3c0 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.042+0000 7fd519800640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd4fc0a3d10 0x7fd4fc0a61d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd51419fbe0 tx=0x7fd508000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 -- 172.21.15.7:0/82295246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 msgr2=0x55dbabbaa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 0x55dbabbaa7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009f10 tx=0x7fd50c00f730 comp rx=0 tx=0).stop 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 -- 172.21.15.7:0/82295246 shutdown_connections 2024-04-23T15:31:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbb55a0 0x55dbabbb7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbb5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 --2- 172.21.15.7:0/82295246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaa3c0 0x55dbabbaa7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 -- 172.21.15.7:0/82295246 >> 172.21.15.7:0/82295246 conn(0x55dbabba68d0 msgr2=0x55dbabba6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 -- 172.21.15.7:0/82295246 shutdown_connections 2024-04-23T15:31:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.043+0000 7fd51f012740 1 -- 172.21.15.7:0/82295246 wait complete. 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.044+0000 7fd51f012740 1 -- start start 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.044+0000 7fd51f012740 1 Processor -- start 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbb2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaace0 0x55dbabbb2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbb55a0 0x55dbabbb2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dbabbb80e0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dbabaca2c0 con 0x55dbabbaace0 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55dbabbb8260 con 0x55dbabbb55a0 2024-04-23T15:31:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd51f012740 10 client.0 _ll_register_callbacks cb 0x55dbab822a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd519800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbb2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd519800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbb2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33966/0 (socket says 172.21.15.7:33966) 2024-04-23T15:31:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd519800640 1 -- 172.21.15.7:0/147106110 learned_addr learned my addr 172.21.15.7:0/147106110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.045+0000 7fd518e00640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaace0 0x55dbabbb2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd51a200640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbb55a0 0x55dbabbb2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd519800640 1 -- 172.21.15.7:0/147106110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbb55a0 msgr2=0x55dbabbb2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd519800640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbb55a0 0x55dbabbb2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd519800640 1 -- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaace0 msgr2=0x55dbabbb2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd519800640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaace0 0x55dbabbb2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd519800640 1 -- 172.21.15.7:0/147106110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbabadafd0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd519800640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbb2530 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fd508009930 tx=0x7fd508009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ccf732fdc15049 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.046+0000 7fd4fb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.047+0000 7fd4fb400640 1 -- 172.21.15.7:0/147106110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50804d070 con 0x55dbabbaa3c0 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.047+0000 7fd4fb400640 1 -- 172.21.15.7:0/147106110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7fd5080035f0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.047+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd50c003d10 con 0x55dbabbaa3c0 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.047+0000 7fd4fb400640 1 -- 172.21.15.7:0/147106110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd508059050 con 0x55dbabbaa3c0 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.047+0000 7fd51f012740 10 client.18909 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.047+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dbab823210 con 0x55dbabbaa3c0 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd4fb400640 1 -- 172.21.15.7:0/147106110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd50c003d10 con 0x55dbabbaa3c0 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd4fb400640 1 -- 172.21.15.7:0/147106110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd508032760 con 0x55dbabbaa3c0 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd51f012740 10 client.18909 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd51f012740 10 client.18909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd51f012740 20 client.18909 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd51f012740 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabbc56e0 0x55dbabbc7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd51f012740 4 client.18909 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:31:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.048+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbabb1e320 con 0x55dbabbc56e0 2024-04-23T15:31:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.049+0000 7fd518e00640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabbc56e0 0x55dbabbc7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.050+0000 7fd4fb400640 10 client.18909 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.050+0000 7fd518e00640 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabbc56e0 0x55dbabbc7af0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a8ae27d5e4488c server_cookie=9538341d64ec8da2 in_seq=0 out_seq=0 2024-04-23T15:31:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.053+0000 7fd4fb400640 1 -- 172.21.15.7:0/147106110 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dbabb1e320 con 0x55dbabbc56e0 2024-04-23T15:31:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.053+0000 7fd4fb400640 10 client.18909 handle_command_reply: tid=0 2024-04-23T15:31:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.053+0000 7fd51f012740 1 client.18909 shutdown 2024-04-23T15:31:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 msgr2=0x55dbabbb2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbb2530 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fd508009930 tx=0x7fd508009260 comp rx=0 tx=0).stop 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 shutdown_connections 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabbc56e0 0x55dbabbc7af0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbaace0 0x55dbabbb2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbb55a0 0x55dbabbb2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 --2- 172.21.15.7:0/147106110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbb2530 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 >> 172.21.15.7:0/147106110 conn(0x55dbabba68d0 msgr2=0x55dbabbac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd4fb400640 0 client.18909 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 shutdown_connections 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.054+0000 7fd51f012740 1 -- 172.21.15.7:0/147106110 wait complete. 2024-04-23T15:31:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.055+0000 7fd51f012740 20 client.18909 trim_cache size 0 max 16384 2024-04-23T15:31:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.075+0000 7fd51f012740 1 Processor -- start 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.075+0000 7fd51f012740 1 -- start start 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51f012740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaa3c0 0x55dbabbc10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51f012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 0x55dbabbb2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51f012740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbcd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51f012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141b59d0 con 0x55dbabbaace0 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51f012740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141b7510 con 0x55dbabbb55a0 2024-04-23T15:31:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51f012740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141b60a0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 0x55dbabbb2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 0x55dbabbb2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33970/0 (socket says 172.21.15.7:33970) 2024-04-23T15:31:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 -- 172.21.15.7:0/3791631941 learned_addr learned my addr 172.21.15.7:0/3791631941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd519800640 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaa3c0 0x55dbabbc10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd51a200640 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbcd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 -- 172.21.15.7:0/3791631941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaa3c0 msgr2=0x55dbabbc10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaa3c0 0x55dbabbc10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 -- 172.21.15.7:0/3791631941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 msgr2=0x55dbabbcd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbcd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.076+0000 7fd518e00640 1 -- 172.21.15.7:0/3791631941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbabbb7d00 con 0x55dbabbaace0 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.077+0000 7fd518e00640 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 0x55dbabbb2dd0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e9c0 tx=0x7fd5000d34e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac96e8c71cf9d15 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.077+0000 7fd506000640 1 -- 172.21.15.7:0/3791631941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50009d2f0 con 0x55dbabbaace0 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.077+0000 7fd506000640 1 -- 172.21.15.7:0/3791631941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd50009cbf0 con 0x55dbabbaace0 2024-04-23T15:31:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.077+0000 7fd506000640 1 -- 172.21.15.7:0/3791631941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5000bd0b0 con 0x55dbabbaace0 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 -- 172.21.15.7:0/3791631941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 msgr2=0x55dbabbb2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 0x55dbabbb2dd0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e9c0 tx=0x7fd5000d34e0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 -- 172.21.15.7:0/3791631941 shutdown_connections 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbcd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaace0 0x55dbabbb2dd0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 --2- 172.21.15.7:0/3791631941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaa3c0 0x55dbabbc10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 -- 172.21.15.7:0/3791631941 >> 172.21.15.7:0/3791631941 conn(0x55dbabba68d0 msgr2=0x55dbabba5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.078+0000 7fd51f012740 1 -- 172.21.15.7:0/3791631941 shutdown_connections 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.079+0000 7fd51f012740 1 -- 172.21.15.7:0/3791631941 wait complete. 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.079+0000 7fd51f012740 1 -- start start 2024-04-23T15:31:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.079+0000 7fd51f012740 1 Processor -- start 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbbd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbbdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141b6e40 con 0x55dbabbaa3c0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141b6770 con 0x55dbabbb55a0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141b39d0 con 0x55dbabbaace0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51f012740 10 client.0 _ll_register_callbacks cb 0x7fd50c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd519800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbbd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd519800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbbd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33986/0 (socket says 172.21.15.7:33986) 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd519800640 1 -- 172.21.15.7:0/2356013236 learned_addr learned my addr 172.21.15.7:0/2356013236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd51a200640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.080+0000 7fd518e00640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbbdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd519800640 1 -- 172.21.15.7:0/2356013236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 msgr2=0x55dbabbbdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd519800640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbbdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd519800640 1 -- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 msgr2=0x55dbabbba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd519800640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd519800640 1 -- 172.21.15.7:0/2356013236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbab8ef620 con 0x55dbabbaa3c0 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd518e00640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbbdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd51a200640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd519800640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbbd5c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fd50802a460 tx=0x7fd50802aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a646d60651a73e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd4fb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd4fb400640 1 -- 172.21.15.7:0/2356013236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508061020 con 0x55dbabbaa3c0 2024-04-23T15:31:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd4fb400640 1 -- 172.21.15.7:0/2356013236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7fd5080326b0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.081+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd50009cbf0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd4fb400640 1 -- 172.21.15.7:0/2356013236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd50806c050 con 0x55dbabbaa3c0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 10 client.18915 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dbabc2c330 con 0x55dbabbaa3c0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd4fb400640 1 -- 172.21.15.7:0/2356013236 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd50009cbf0 con 0x55dbabbaa3c0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd4fb400640 1 -- 172.21.15.7:0/2356013236 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd508049450 con 0x55dbabbaa3c0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 10 client.18915 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 10 client.18915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 20 client.18915 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabc2caf0 0x55dbabc2ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 4 client.18915 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.082+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbabb18190 con 0x55dbabc2caf0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.083+0000 7fd518e00640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabc2caf0 0x55dbabc2ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.084+0000 7fd518e00640 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabc2caf0 0x55dbabc2ef10 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56cecdb6eb0d7b8a server_cookie=d401a2e71ed8b5ba in_seq=0 out_seq=0 2024-04-23T15:31:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.084+0000 7fd4fb400640 10 client.18915 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.109+0000 7fd4fb400640 1 -- 172.21.15.7:0/2356013236 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbabb18190 con 0x55dbabc2caf0 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.109+0000 7fd4fb400640 10 client.18915 handle_command_reply: tid=0 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 client.18915 shutdown 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 msgr2=0x55dbabbbd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbbd5c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fd50802a460 tx=0x7fd50802aa60 comp rx=0 tx=0).stop 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 shutdown_connections 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55dbabc2caf0 0x55dbabc2ef10 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dbabbb55a0 0x55dbabbba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dbabbaace0 0x55dbabbbdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 --2- 172.21.15.7:0/2356013236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbabbaa3c0 0x55dbabbbd5c0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd4fb400640 0 client.18915 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 >> 172.21.15.7:0/2356013236 conn(0x55dbabba68d0 msgr2=0x55dbabbabd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 shutdown_connections 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.110+0000 7fd51f012740 1 -- 172.21.15.7:0/2356013236 wait complete. 2024-04-23T15:31:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51f012740 20 client.18915 trim_cache size 0 max 16384 2024-04-23T15:31:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:31:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:31:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:31:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:31:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd4fc0a3d10 msgr2=0x7fd4fc0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd4fc0a3d10 0x7fd4fc0a61d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd51419fbe0 tx=0x7fd508000bc0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 msgr2=0x7fd5141a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 0x7fd5141a4e30 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e9f0 tx=0x7fd50000eeb0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 shutdown_connections 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd4fc0a3d10 0x7fd4fc0a61d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd51410e4d0 0x7fd51419eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd514108ec0 0x7fd5141a4e30 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 --2- 172.21.15.7:0/3338271475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd514108540 0x7fd5141a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.111+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 >> 172.21.15.7:0/3338271475 conn(0x7fd514077de0 msgr2=0x7fd514078440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.112+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 shutdown_connections 2024-04-23T15:31:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:36.112+0000 7fd51ac00640 1 -- 172.21.15.7:0/3338271475 wait complete. 2024-04-23T15:31:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:37 smithi007 ceph-mon[27906]: pgmap v1276: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:37 smithi186 ceph-mon[31814]: pgmap v1276: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:37 smithi137 ceph-mon[31694]: pgmap v1276: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:39 smithi007 ceph-mon[27906]: pgmap v1277: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:31:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:39 smithi186 ceph-mon[31814]: pgmap v1277: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:31:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:39 smithi137 ceph-mon[31694]: pgmap v1277: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 21 op/s 2024-04-23T15:31:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:41 smithi007 ceph-mon[27906]: pgmap v1278: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:31:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:41 smithi186 ceph-mon[31814]: pgmap v1278: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:31:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:41 smithi137 ceph-mon[31694]: pgmap v1278: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.0 MiB/s wr, 12 op/s 2024-04-23T15:31:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:43 smithi007 ceph-mon[27906]: pgmap v1279: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:31:43.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:43 smithi186 ceph-mon[31814]: pgmap v1279: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:31:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:43 smithi137 ceph-mon[31694]: pgmap v1279: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 17 op/s 2024-04-23T15:31:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:45 smithi007 ceph-mon[27906]: pgmap v1280: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:45 smithi186 ceph-mon[31814]: pgmap v1280: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:45 smithi137 ceph-mon[31694]: pgmap v1280: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:47 smithi007 ceph-mon[27906]: pgmap v1281: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:47 smithi186 ceph-mon[31814]: pgmap v1281: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:47 smithi137 ceph-mon[31694]: pgmap v1281: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 -- 172.21.15.7:0/2306225284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 msgr2=0x7f7a80101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 --2- 172.21.15.7:0/2306225284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a80101580 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009ca0 tx=0x7f7a7002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 -- 172.21.15.7:0/2306225284 shutdown_connections 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 --2- 172.21.15.7:0/2306225284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a80101b50 0x7f7a80105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 --2- 172.21.15.7:0/2306225284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 0x7f7a8010ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 --2- 172.21.15.7:0/2306225284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a80101580 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.324+0000 7f7a86a00640 1 -- 172.21.15.7:0/2306225284 >> 172.21.15.7:0/2306225284 conn(0x7f7a80078080 msgr2=0x7f7a80078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.325+0000 7f7a86a00640 1 -- 172.21.15.7:0/2306225284 shutdown_connections 2024-04-23T15:31:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.325+0000 7f7a86a00640 1 -- 172.21.15.7:0/2306225284 wait complete. 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 Processor -- start 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 -- start start 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a801a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 0x7f7a801a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a8019a780 0x7f7a8019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801100c0 con 0x7f7a801011a0 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8010ff40 con 0x7f7a8019a780 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.326+0000 7f7a86a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80110240 con 0x7f7a80106220 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.327+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a801a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.327+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a801a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41396/0 (socket says 172.21.15.7:41396) 2024-04-23T15:31:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.327+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1034904064 learned_addr learned my addr 172.21.15.7:0/1034904064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.327+0000 7f7a84a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a8019a780 0x7f7a8019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.327+0000 7f7a77400640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 0x7f7a801a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.327+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1034904064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 msgr2=0x7f7a801a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 0x7f7a801a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1034904064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a8019a780 msgr2=0x7f7a8019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a8019a780 0x7f7a8019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1034904064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8019b310 con 0x7f7a801011a0 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a77400640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 0x7f7a801a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a84a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a8019a780 0x7f7a8019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a801a0610 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7a70031040 tx=0x7f7a70032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7d600640 1 -- 172.21.15.7:0/1034904064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003b70 con 0x7f7a801011a0 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.328+0000 7f7a7d600640 1 -- 172.21.15.7:0/1034904064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a70003d10 con 0x7f7a801011a0 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.329+0000 7f7a7d600640 1 -- 172.21.15.7:0/1034904064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70030a80 con 0x7f7a801011a0 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.329+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8019b5a0 con 0x7f7a801011a0 2024-04-23T15:31:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.329+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a801a7730 con 0x7f7a801011a0 2024-04-23T15:31:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a7d600640 1 -- 172.21.15.7:0/1034904064 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7a70004660 con 0x7f7a801011a0 2024-04-23T15:31:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 Processor -- start 2024-04-23T15:31:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 -- start start 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be4d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be57e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 0x561f8be5a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561f8bdb3900 con 0x561f8be58390 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f8bd59f20 con 0x561f8be4d1b0 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.333+0000 7f7a899ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561f8bdaf8c0 con 0x561f8be4dad0 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.334+0000 7f7a77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 0x561f8be5a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.334+0000 7f7a77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 0x561f8be5a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41400/0 (socket says 172.21.15.7:41400) 2024-04-23T15:31:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.334+0000 7f7a77400640 1 -- 172.21.15.7:0/3894484121 learned_addr learned my addr 172.21.15.7:0/3894484121 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.334+0000 7f7a84a00640 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be4d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.334+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be57e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:49 smithi007 ceph-mon[27906]: pgmap v1282: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:31:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a7d600640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a640a3dc0 0x7f7a640a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a77400640 1 -- 172.21.15.7:0/3894484121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 msgr2=0x561f8be57e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a77400640 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be57e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a77400640 1 -- 172.21.15.7:0/3894484121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 msgr2=0x561f8be4d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a77400640 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be4d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a77400640 1 -- 172.21.15.7:0/3894484121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8bd7ee10 con 0x561f8be58390 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a7d600640 1 -- 172.21.15.7:0/1034904064 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7f7a700f1df0 con 0x7f7a801011a0 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.335+0000 7f7a84a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a640a3dc0 0x7f7a640a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.336+0000 7f7a77400640 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 0x561f8be5a780 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009c70 tx=0x7f7a680117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7845fb9c95a3ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.336+0000 7f7a75200640 1 -- 172.21.15.7:0/3894484121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68012450 con 0x561f8be58390 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.336+0000 7f7a75200640 1 -- 172.21.15.7:0/3894484121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a68012aa0 con 0x561f8be58390 2024-04-23T15:31:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.336+0000 7f7a75200640 1 -- 172.21.15.7:0/3894484121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800fb20 con 0x561f8be58390 2024-04-23T15:31:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 -- 172.21.15.7:0/3894484121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 msgr2=0x561f8be5a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 0x561f8be5a780 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009c70 tx=0x7f7a680117b0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a84a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a640a3dc0 0x7f7a640a6280 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009cf0 tx=0x7f7a780046c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 -- 172.21.15.7:0/3894484121 shutdown_connections 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be58390 0x561f8be5a780 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be57e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 --2- 172.21.15.7:0/3894484121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be4d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 -- 172.21.15.7:0/3894484121 >> 172.21.15.7:0/3894484121 conn(0x561f8be496c0 msgr2=0x561f8be49aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 -- 172.21.15.7:0/3894484121 shutdown_connections 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.337+0000 7f7a899ec740 1 -- 172.21.15.7:0/3894484121 wait complete. 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.338+0000 7f7a899ec740 1 -- start start 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.338+0000 7f7a899ec740 1 Processor -- start 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be55350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be55890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be55dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561f8be5afc0 con 0x561f8be4dad0 2024-04-23T15:31:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f8bd6d2c0 con 0x561f8be4d1b0 2024-04-23T15:31:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561f8be5b140 con 0x561f8be58390 2024-04-23T15:31:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a899ec740 10 client.0 _ll_register_callbacks cb 0x561f8bac5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be55890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be55890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41414/0 (socket says 172.21.15.7:41414) 2024-04-23T15:31:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a77400640 1 -- 172.21.15.7:0/4170328675 learned_addr learned my addr 172.21.15.7:0/4170328675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.339+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be55350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a84a00640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be55dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a77400640 1 -- 172.21.15.7:0/4170328675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 msgr2=0x561f8be55dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a77400640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be55dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a77400640 1 -- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 msgr2=0x561f8be55350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a77400640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be55350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a77400640 1 -- 172.21.15.7:0/4170328675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8bd7dfd0 con 0x561f8be4dad0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a84a00640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be55dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a77400640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be55890 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009c40 tx=0x7f7a6800f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50d0b0ee270542e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.340+0000 7f7a6d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a6d600640 1 -- 172.21.15.7:0/4170328675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68029020 con 0x561f8be4dad0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a68012aa0 con 0x561f8be4dad0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a6d600640 1 -- 172.21.15.7:0/4170328675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7f7a68012450 con 0x561f8be4dad0 2024-04-23T15:31:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a6d600640 1 -- 172.21.15.7:0/4170328675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7a68034050 con 0x561f8be4dad0 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a899ec740 10 client.18927 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561f8bac6210 con 0x561f8be4dad0 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.341+0000 7f7a6d600640 1 -- 172.21.15.7:0/4170328675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a68012aa0 con 0x561f8be4dad0 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a6d600640 1 -- 172.21.15.7:0/4170328675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7a6800fac0 con 0x561f8be4dad0 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a899ec740 10 client.18927 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a899ec740 10 client.18927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a899ec740 20 client.18927 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a899ec740 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8be684b0 0x561f8be6a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a899ec740 4 client.18927 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.342+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f8bdc1320 con 0x561f8be684b0 2024-04-23T15:31:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.343+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8be684b0 0x561f8be6a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.344+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8be684b0 0x561f8be6a8a0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e614a985181308 server_cookie=25bf1cddb5045a8b in_seq=0 out_seq=0 2024-04-23T15:31:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.344+0000 7f7a6d600640 10 client.18927 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.345+0000 7f7a6d600640 1 -- 172.21.15.7:0/4170328675 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561f8bdc1320 con 0x561f8be684b0 2024-04-23T15:31:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.345+0000 7f7a6d600640 10 client.18927 handle_command_reply: tid=0 2024-04-23T15:31:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 client.18927 shutdown 2024-04-23T15:31:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 msgr2=0x561f8be55890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be55890 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009c40 tx=0x7f7a6800f770 comp rx=0 tx=0).stop 2024-04-23T15:31:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 shutdown_connections 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8be684b0 0x561f8be6a8a0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be55dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be55890 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 --2- 172.21.15.7:0/4170328675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be55350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 >> 172.21.15.7:0/4170328675 conn(0x561f8be496c0 msgr2=0x561f8be48840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a6d600640 0 client.18927 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 shutdown_connections 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 1 -- 172.21.15.7:0/4170328675 wait complete. 2024-04-23T15:31:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.346+0000 7f7a899ec740 20 client.18927 trim_cache size 0 max 16384 2024-04-23T15:31:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:49 smithi186 ceph-mon[31814]: pgmap v1282: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:31:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.363+0000 7f7a899ec740 1 Processor -- start 2024-04-23T15:31:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.363+0000 7f7a899ec740 1 -- start start 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 0x561f8be4fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be486c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be58390 0x561f8be6ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a899ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801b1560 con 0x561f8be4d1b0 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a899ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801b30a0 con 0x561f8be58390 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a899ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801b1c30 con 0x561f8be4dad0 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 0x561f8be4fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 0x561f8be4fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41430/0 (socket says 172.21.15.7:41430) 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1714725276 learned_addr learned my addr 172.21.15.7:0/1714725276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.364+0000 7f7a77400640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1714725276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 msgr2=0x561f8be486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1714725276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be58390 msgr2=0x561f8be6ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a84a00640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be58390 0x561f8be6ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be58390 0x561f8be6ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a7fe00640 1 -- 172.21.15.7:0/1714725276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8be44ea0 con 0x561f8be4d1b0 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a77400640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a84a00640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be58390 0x561f8be6ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 0x561f8be4fb70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7a700bd820 tx=0x7f7a700f4240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cf6ec25fa4e84a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a6fe00640 1 -- 172.21.15.7:0/1714725276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700bd8f0 con 0x561f8be4d1b0 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a6fe00640 1 -- 172.21.15.7:0/1714725276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a700bee50 con 0x561f8be4d1b0 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.365+0000 7f7a6fe00640 1 -- 172.21.15.7:0/1714725276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700bd480 con 0x561f8be4d1b0 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 -- 172.21.15.7:0/1714725276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 msgr2=0x561f8be4fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 0x561f8be4fb70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7a700bd820 tx=0x7f7a700f4240 comp rx=0 tx=0).stop 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 -- 172.21.15.7:0/1714725276 shutdown_connections 2024-04-23T15:31:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be58390 0x561f8be6ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be4dad0 0x561f8be486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 --2- 172.21.15.7:0/1714725276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4d1b0 0x561f8be4fb70 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 -- 172.21.15.7:0/1714725276 >> 172.21.15.7:0/1714725276 conn(0x561f8be496c0 msgr2=0x561f8be47fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 -- 172.21.15.7:0/1714725276 shutdown_connections 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.366+0000 7f7a899ec740 1 -- 172.21.15.7:0/1714725276 wait complete. 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.367+0000 7f7a899ec740 1 -- start start 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.367+0000 7f7a899ec740 1 Processor -- start 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be52c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801b29d0 con 0x561f8be4dad0 2024-04-23T15:31:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801b2300 con 0x561f8be4d1b0 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801af560 con 0x561f8be58390 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a899ec740 10 client.0 _ll_register_callbacks cb 0x7f7a78009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41432/0 (socket says 172.21.15.7:41432) 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 -- 172.21.15.7:0/2187718842 learned_addr learned my addr 172.21.15.7:0/2187718842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a84a00640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be52c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 -- 172.21.15.7:0/2187718842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 msgr2=0x561f8be52c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be52c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 -- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 msgr2=0x561f8be521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.368+0000 7f7a77400640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a77400640 1 -- 172.21.15.7:0/2187718842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8bb92620 con 0x561f8be4dad0 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a84a00640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be52c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:31:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a77400640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be526e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000c00 tx=0x7f7a68004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a31189771c76148 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:31:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a6d600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:31:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a6d600640 1 -- 172.21.15.7:0/2187718842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6803d060 con 0x561f8be4dad0 2024-04-23T15:31:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a6d600640 1 -- 172.21.15.7:0/2187718842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7f7a6800fc00 con 0x561f8be4dad0 2024-04-23T15:31:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.369+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a700bee50 con 0x561f8be4dad0 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a6d600640 1 -- 172.21.15.7:0/2187718842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7a68044050 con 0x561f8be4dad0 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 10 client.18933 fetch_fsmap learned FSMap version 32 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561f8bece960 con 0x561f8be4dad0 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a6d600640 1 -- 172.21.15.7:0/2187718842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a700bee50 con 0x561f8be4dad0 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a6d600640 1 -- 172.21.15.7:0/2187718842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7a68004f00 con 0x561f8be4dad0 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 10 client.18933 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 10 client.18933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 20 client.18933 populate_metadata read hostname 'smithi007' 2024-04-23T15:31:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8becf0b0 0x561f8bed14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:31:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 4 client.18933 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:31:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.370+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561f8be49510 con 0x561f8becf0b0 2024-04-23T15:31:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.371+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8becf0b0 0x561f8bed14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:31:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.372+0000 7f7a7fe00640 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8becf0b0 0x561f8bed14d0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=470c415f4effd1ef server_cookie=95f7f670bccb750a in_seq=0 out_seq=0 2024-04-23T15:31:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.372+0000 7f7a6d600640 10 client.18933 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.399+0000 7f7a6d600640 1 -- 172.21.15.7:0/2187718842 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561f8be49510 con 0x561f8becf0b0 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.399+0000 7f7a6d600640 10 client.18933 handle_command_reply: tid=0 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.399+0000 7f7a899ec740 1 client.18933 shutdown 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.399+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 msgr2=0x561f8be526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.399+0000 7f7a899ec740 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be526e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000c00 tx=0x7f7a68004d10 comp rx=0 tx=0).stop 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 shutdown_connections 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561f8becf0b0 0x561f8bed14d0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f8be58390 0x561f8be52c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561f8be4dad0 0x561f8be526e0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 --2- 172.21.15.7:0/2187718842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f8be4d1b0 0x561f8be521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 >> 172.21.15.7:0/2187718842 conn(0x561f8be496c0 msgr2=0x561f8be48840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a6d600640 0 client.18933 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 shutdown_connections 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 1 -- 172.21.15.7:0/2187718842 wait complete. 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.400+0000 7f7a899ec740 20 client.18933 trim_cache size 0 max 16384 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:31:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:31:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:31:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a640a3dc0 msgr2=0x7f7a640a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a640a3dc0 0x7f7a640a6280 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009cf0 tx=0x7f7a780046c0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 msgr2=0x7f7a801a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a801a0610 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f7a70031040 tx=0x7f7a70032ff0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 shutdown_connections 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a640a3dc0 0x7f7a640a6280 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a8019a780 0x7f7a8019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a80106220 0x7f7a801a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 --2- 172.21.15.7:0/1034904064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a801011a0 0x7f7a801a0610 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 >> 172.21.15.7:0/1034904064 conn(0x7f7a80078080 msgr2=0x7f7a800fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 shutdown_connections 2024-04-23T15:31:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:31:49.401+0000 7f7a86a00640 1 -- 172.21.15.7:0/1034904064 wait complete. 2024-04-23T15:31:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:49 smithi137 ceph-mon[31694]: pgmap v1282: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:31:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:51 smithi007 ceph-mon[27906]: pgmap v1283: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:31:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:51 smithi186 ceph-mon[31814]: pgmap v1283: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:31:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:51 smithi137 ceph-mon[31694]: pgmap v1283: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:31:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:53 smithi007 ceph-mon[27906]: pgmap v1284: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:31:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:53 smithi186 ceph-mon[31814]: pgmap v1284: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:31:53.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:53 smithi137 ceph-mon[31694]: pgmap v1284: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:31:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:55 smithi186 ceph-mon[31814]: pgmap v1285: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:55 smithi137 ceph-mon[31694]: pgmap v1285: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:55.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:55 smithi007 ceph-mon[27906]: pgmap v1285: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:57 smithi186 ceph-mon[31814]: pgmap v1286: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:57 smithi137 ceph-mon[31694]: pgmap v1286: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:57.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:57 smithi007 ceph-mon[27906]: pgmap v1286: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:31:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:31:59 smithi186 ceph-mon[31814]: pgmap v1287: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:31:59.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:31:59 smithi137 ceph-mon[31694]: pgmap v1287: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:31:59.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:31:59 smithi007 ceph-mon[27906]: pgmap v1287: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:32:00.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:00 smithi137 ceph-mon[31694]: pgmap v1288: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:32:00.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:00 smithi007 ceph-mon[27906]: pgmap v1288: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:32:00.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:00 smithi186 ceph-mon[31814]: pgmap v1288: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:32:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 -- 172.21.15.7:0/2810451635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac109530 msgr2=0x7fe5ac111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/2810451635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac109530 0x7fe5ac111100 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009ca0 tx=0x7fe5a402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 -- 172.21.15.7:0/2810451635 shutdown_connections 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/2810451635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac104e10 0x7fe5ac108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/2810451635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac109530 0x7fe5ac111100 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/2810451635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 0x7fe5ac104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 -- 172.21.15.7:0/2810451635 >> 172.21.15.7:0/2810451635 conn(0x7fe5ac0ffd00 msgr2=0x7fe5ac102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 -- 172.21.15.7:0/2810451635 shutdown_connections 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.568+0000 7fe5b3a00640 1 -- 172.21.15.7:0/2810451635 wait complete. 2024-04-23T15:32:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.569+0000 7fe5b3a00640 1 Processor -- start 2024-04-23T15:32:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 -- start start 2024-04-23T15:32:02.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 0x7fe5ac1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac109530 0x7fe5ac1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 0x7fe5ac19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1144d0 con 0x7fe5ac19a730 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac114350 con 0x7fe5ac109530 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.570+0000 7fe5b3a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac114650 con 0x7fe5ac104460 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 0x7fe5ac19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 0x7fe5ac19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39444/0 (socket says 172.21.15.7:39444) 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4055513566 learned_addr learned my addr 172.21.15.7:0/4055513566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac109530 0x7fe5ac1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 0x7fe5ac1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4055513566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 msgr2=0x7fe5ac1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 0x7fe5ac1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4055513566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac109530 msgr2=0x7fe5ac1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac109530 0x7fe5ac1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4055513566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac19b330 con 0x7fe5ac19a730 2024-04-23T15:32:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac109530 0x7fe5ac1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.571+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 0x7fe5ac1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.572+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 0x7fe5ac19abb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4031040 tx=0x7fe5a4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.572+0000 7fe5aa000640 1 -- 172.21.15.7:0/4055513566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4003ce0 con 0x7fe5ac19a730 2024-04-23T15:32:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.572+0000 7fe5aa000640 1 -- 172.21.15.7:0/4055513566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5a40044f0 con 0x7fe5ac19a730 2024-04-23T15:32:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.572+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac19b5c0 con 0x7fe5ac19a730 2024-04-23T15:32:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.572+0000 7fe5aa000640 1 -- 172.21.15.7:0/4055513566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4030c90 con 0x7fe5ac19a730 2024-04-23T15:32:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.572+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac1a77b0 con 0x7fe5ac19a730 2024-04-23T15:32:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.575+0000 7fe5b6801740 1 Processor -- start 2024-04-23T15:32:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.576+0000 7fe5aa000640 1 -- 172.21.15.7:0/4055513566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe5a40046a0 con 0x7fe5ac19a730 2024-04-23T15:32:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.576+0000 7fe5b6801740 1 -- start start 2024-04-23T15:32:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.576+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cbe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 0x559065ccb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5b6801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559065c24900 con 0x559065cc9390 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5b6801740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559065bcaf20 con 0x559065cbead0 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5b6801740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559065c208c0 con 0x559065cbe1b0 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 0x559065ccb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 0x559065ccb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39460/0 (socket says 172.21.15.7:39460) 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5a3e00640 1 -- 172.21.15.7:0/337483673 learned_addr learned my addr 172.21.15.7:0/337483673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cbe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.577+0000 7fe5b1000640 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a3e00640 1 -- 172.21.15.7:0/337483673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 msgr2=0x559065cbe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cbe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a3e00640 1 -- 172.21.15.7:0/337483673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 msgr2=0x559065cc8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a3e00640 1 -- 172.21.15.7:0/337483673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559065befe10 con 0x559065cc9390 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5b1000640 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5aa000640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe5900a3e40 0x7fe5900a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 0x559065ccb780 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe5940135b0 tx=0x7fe59400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b0c6320e86a378 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5aa000640 1 -- 172.21.15.7:0/4055513566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7fe5a40f2140 con 0x7fe5ac19a730 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe5900a3e40 0x7fe5900a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.578+0000 7fe5a2000640 1 -- 172.21.15.7:0/337483673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59400f520 con 0x559065cc9390 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.579+0000 7fe5a2000640 1 -- 172.21.15.7:0/337483673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe59400fb70 con 0x559065cc9390 2024-04-23T15:32:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.579+0000 7fe5a2000640 1 -- 172.21.15.7:0/337483673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594011bc0 con 0x559065cc9390 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.579+0000 7fe5b6801740 1 -- 172.21.15.7:0/337483673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 msgr2=0x559065ccb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.579+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe5900a3e40 0x7fe5900a6300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x559065cbf750 tx=0x7fe59c00b7d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.579+0000 7fe5b6801740 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 0x559065ccb780 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe5940135b0 tx=0x7fe59400c4d0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 -- 172.21.15.7:0/337483673 shutdown_connections 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cc9390 0x559065ccb780 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 --2- 172.21.15.7:0/337483673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cbe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 -- 172.21.15.7:0/337483673 >> 172.21.15.7:0/337483673 conn(0x559065cba6c0 msgr2=0x559065cbaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 -- 172.21.15.7:0/337483673 shutdown_connections 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 -- 172.21.15.7:0/337483673 wait complete. 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.580+0000 7fe5b6801740 1 -- start start 2024-04-23T15:32:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 Processor -- start 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 0x559065cc6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559065ccbfc0 con 0x559065cbe1b0 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559065bde2c0 con 0x559065cbead0 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559065ccc140 con 0x559065cc9390 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.581+0000 7fe5b6801740 10 client.0 _ll_register_callbacks cb 0x559065936a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.582+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.582+0000 7fe5b1a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 0x559065cc6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.582+0000 7fe5b1a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 0x559065cc6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:43446/0 (socket says 172.21.15.7:43446) 2024-04-23T15:32:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.582+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4067878901 learned_addr learned my addr 172.21.15.7:0/4067878901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.582+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 msgr2=0x559065cc6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4067878901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 msgr2=0x559065cc6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe5b1a00640 1 -- 172.21.15.7:0/4067878901 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559065beefd0 con 0x559065cc9390 2024-04-23T15:32:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 0x559065cc6e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40049d0 tx=0x7fe5a40bd7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ebf8853a6222e8a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.583+0000 7fe59aa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:32:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.591+0000 7fe59aa00640 1 -- 172.21.15.7:0/4067878901 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4039e10 con 0x559065cc9390 2024-04-23T15:32:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.591+0000 7fe59aa00640 1 -- 172.21.15.7:0/4067878901 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 9467+0+0 (secure 0 0 0) 0x7fe5a40d7260 con 0x559065cc9390 2024-04-23T15:32:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.591+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe59400fb70 con 0x559065cc9390 2024-04-23T15:32:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.602+0000 7fe59aa00640 1 -- 172.21.15.7:0/4067878901 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe5a40bdde0 con 0x559065cc9390 2024-04-23T15:32:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.603+0000 7fe5b6801740 10 client.27859 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.603+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559065937210 con 0x559065cc9390 2024-04-23T15:32:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.604+0000 7fe59aa00640 1 -- 172.21.15.7:0/4067878901 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe59400fb70 con 0x559065cc9390 2024-04-23T15:32:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.604+0000 7fe59aa00640 1 -- 172.21.15.7:0/4067878901 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe5a40ba450 con 0x559065cc9390 2024-04-23T15:32:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.605+0000 7fe5b6801740 10 client.27859 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.605+0000 7fe5b6801740 10 client.27859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.605+0000 7fe5b6801740 20 client.27859 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.605+0000 7fe5b6801740 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065cd9610 0x559065cdba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.605+0000 7fe5b6801740 4 client.27859 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:32:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.605+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559065c32320 con 0x559065cd9610 2024-04-23T15:32:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.606+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065cd9610 0x559065cdba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.608+0000 7fe5b1000640 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065cd9610 0x559065cdba50 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c539f955b13fef server_cookie=974ae980112665bb in_seq=0 out_seq=0 2024-04-23T15:32:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.608+0000 7fe59aa00640 10 client.27859 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe59aa00640 1 -- 172.21.15.7:0/4067878901 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559065c32320 con 0x559065cd9610 2024-04-23T15:32:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe59aa00640 10 client.27859 handle_command_reply: tid=0 2024-04-23T15:32:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 client.27859 shutdown 2024-04-23T15:32:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 msgr2=0x559065cc6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 0x559065cc6e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40049d0 tx=0x7fe5a40bd7c0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 shutdown_connections 2024-04-23T15:32:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065cd9610 0x559065cdba50 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cbead0 0x559065cc6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cc9390 0x559065cc6e90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 --2- 172.21.15.7:0/4067878901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe59aa00640 0 client.27859 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.611+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 >> 172.21.15.7:0/4067878901 conn(0x559065cba6c0 msgr2=0x559065cc03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.612+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 shutdown_connections 2024-04-23T15:32:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.612+0000 7fe5b6801740 1 -- 172.21.15.7:0/4067878901 wait complete. 2024-04-23T15:32:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.612+0000 7fe5b6801740 20 client.27859 trim_cache size 0 max 16384 2024-04-23T15:32:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 Processor -- start 2024-04-23T15:32:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 -- start start 2024-04-23T15:32:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cc0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 0x559065ce1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065ce1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1b13c0 con 0x559065cbead0 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1b2f00 con 0x559065cc9390 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.629+0000 7fe5b6801740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1b1a90 con 0x559065cbe1b0 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 0x559065ce1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 0x559065ce1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39466/0 (socket says 172.21.15.7:39466) 2024-04-23T15:32:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 -- 172.21.15.7:0/2949926800 learned_addr learned my addr 172.21.15.7:0/2949926800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5b1000640 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cc0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065ce1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 -- 172.21.15.7:0/2949926800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 msgr2=0x559065cc0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cc0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 -- 172.21.15.7:0/2949926800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 msgr2=0x559065ce1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065ce1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 -- 172.21.15.7:0/2949926800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559065a03620 con 0x559065cbead0 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.630+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 0x559065ce1320 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe5940058c0 tx=0x7fe594005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498ea81c43443e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.631+0000 7fe5a1600640 1 -- 172.21.15.7:0/2949926800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59402d070 con 0x559065cbead0 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.631+0000 7fe5a1600640 1 -- 172.21.15.7:0/2949926800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe594011440 con 0x559065cbead0 2024-04-23T15:32:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.631+0000 7fe5a1600640 1 -- 172.21.15.7:0/2949926800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940055a0 con 0x559065cbead0 2024-04-23T15:32:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 -- 172.21.15.7:0/2949926800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 msgr2=0x559065ce1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 0x559065ce1320 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe5940058c0 tx=0x7fe594005850 comp rx=0 tx=0).stop 2024-04-23T15:32:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 -- 172.21.15.7:0/2949926800 shutdown_connections 2024-04-23T15:32:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065ce1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbead0 0x559065ce1320 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 --2- 172.21.15.7:0/2949926800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbe1b0 0x559065cc0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 -- 172.21.15.7:0/2949926800 >> 172.21.15.7:0/2949926800 conn(0x559065cba6c0 msgr2=0x559065cb9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 -- 172.21.15.7:0/2949926800 shutdown_connections 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.632+0000 7fe5b6801740 1 -- 172.21.15.7:0/2949926800 wait complete. 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 -- start start 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 Processor -- start 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbead0 0x559065cc35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065cc3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1b2830 con 0x559065cbe1b0 2024-04-23T15:32:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1b2160 con 0x559065cc9390 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1af3c0 con 0x559065cbead0 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.633+0000 7fe5b6801740 10 client.0 _ll_register_callbacks cb 0x7fe5a4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39472/0 (socket says 172.21.15.7:39472) 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 -- 172.21.15.7:0/1261193170 learned_addr learned my addr 172.21.15.7:0/1261193170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065cc3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbead0 0x559065cc35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 -- 172.21.15.7:0/1261193170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbead0 msgr2=0x559065cc35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbead0 0x559065cc35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 -- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 msgr2=0x559065cc3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065cc3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 -- 172.21.15.7:0/1261193170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559065d3eb90 con 0x559065cbe1b0 2024-04-23T15:32:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1a00640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065cc3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe5b1000640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc30a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00b410 tx=0x7fe59c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eaec5558db2905 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.634+0000 7fe59aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.635+0000 7fe59aa00640 1 -- 172.21.15.7:0/1261193170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c02d070 con 0x559065cbe1b0 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.635+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe594011440 con 0x559065cbe1b0 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.635+0000 7fe59aa00640 1 -- 172.21.15.7:0/1261193170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(161..161 src has 1..161) ==== 9555+0+0 (secure 0 0 0) 0x7fe59c028450 con 0x559065cbe1b0 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.635+0000 7fe59aa00640 1 -- 172.21.15.7:0/1261193170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe59c035050 con 0x559065cbe1b0 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.635+0000 7fe5b6801740 10 client.18951 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.635+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559065d3feb0 con 0x559065cbe1b0 2024-04-23T15:32:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe59aa00640 1 -- 172.21.15.7:0/1261193170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe594011440 con 0x559065cbe1b0 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe59aa00640 1 -- 172.21.15.7:0/1261193170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe59c030030 con 0x559065cbe1b0 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe5b6801740 10 client.18951 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe5b6801740 10 client.18951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe5b6801740 20 client.18951 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe5b6801740 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065d40610 0x559065d42a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe5b6801740 4 client.18951 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.636+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559065c2c190 con 0x559065d40610 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.637+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065d40610 0x559065d42a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.637+0000 7fe5a3e00640 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065d40610 0x559065d42a30 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17e734ccb8da846e server_cookie=82b612fdf45b8765 in_seq=0 out_seq=0 2024-04-23T15:32:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.637+0000 7fe59aa00640 10 client.18951 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe59aa00640 1 -- 172.21.15.7:0/1261193170 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559065c2c190 con 0x559065d40610 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe59aa00640 10 client.18951 handle_command_reply: tid=0 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 client.18951 shutdown 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 msgr2=0x559065cc30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc30a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00b410 tx=0x7fe59c0046c0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 shutdown_connections 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559065d40610 0x559065d42a30 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559065cc9390 0x559065cc3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559065cbead0 0x559065cc35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 --2- 172.21.15.7:0/1261193170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559065cbe1b0 0x559065cc30a0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 >> 172.21.15.7:0/1261193170 conn(0x559065cba6c0 msgr2=0x559065cc6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.703+0000 7fe59aa00640 0 client.18951 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.704+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 shutdown_connections 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.704+0000 7fe5b6801740 1 -- 172.21.15.7:0/1261193170 wait complete. 2024-04-23T15:32:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.704+0000 7fe5b6801740 20 client.18951 trim_cache size 0 max 16384 2024-04-23T15:32:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:32:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:32:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:32:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:32:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe5900a3e40 msgr2=0x7fe5900a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe5900a3e40 0x7fe5900a6300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x559065cbf750 tx=0x7fe59c00b7d0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 msgr2=0x7fe5ac19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 0x7fe5ac19abb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4031040 tx=0x7fe5a4003970 comp rx=0 tx=0).stop 2024-04-23T15:32:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 shutdown_connections 2024-04-23T15:32:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe5900a3e40 0x7fe5900a6300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5ac109530 0x7fe5ac1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5ac19a730 0x7fe5ac19abb0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 --2- 172.21.15.7:0/4055513566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5ac104460 0x7fe5ac1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 >> 172.21.15.7:0/4055513566 conn(0x7fe5ac0ffd00 msgr2=0x7fe5ac101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 shutdown_connections 2024-04-23T15:32:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:02.705+0000 7fe5b3a00640 1 -- 172.21.15.7:0/4055513566 wait complete. 2024-04-23T15:32:02.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:02 smithi007 ceph-mon[27906]: pgmap v1289: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:32:02.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:02 smithi186 ceph-mon[31814]: pgmap v1289: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:32:02.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:02 smithi137 ceph-mon[31694]: pgmap v1289: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:32:03.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:03 smithi186 ceph-mon[31814]: osdmap e161: 12 total, 12 up, 12 in 2024-04-23T15:32:03.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:03 smithi137 ceph-mon[31694]: osdmap e161: 12 total, 12 up, 12 in 2024-04-23T15:32:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:03 smithi007 ceph-mon[27906]: osdmap e161: 12 total, 12 up, 12 in 2024-04-23T15:32:04.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:04 smithi186 ceph-mon[31814]: pgmap v1291: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:32:04.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:04 smithi137 ceph-mon[31694]: pgmap v1291: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:32:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:04 smithi007 ceph-mon[27906]: pgmap v1291: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:32:06.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:06 smithi137 ceph-mon[31694]: pgmap v1292: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:32:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:06 smithi007 ceph-mon[27906]: pgmap v1292: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:32:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:06 smithi186 ceph-mon[31814]: pgmap v1292: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:32:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:08 smithi137 ceph-mon[31694]: pgmap v1293: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:32:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:08 smithi007 ceph-mon[27906]: pgmap v1293: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:32:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:08 smithi186 ceph-mon[31814]: pgmap v1293: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:32:10.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:10 smithi137 ceph-mon[31694]: pgmap v1294: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:32:11.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:10 smithi007 ceph-mon[27906]: pgmap v1294: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:32:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:10 smithi186 ceph-mon[31814]: pgmap v1294: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:32:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:11 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:32:11.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:11 smithi137 ceph-mon[31694]: osdmap e162: 12 total, 12 up, 12 in 2024-04-23T15:32:12.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:11 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:32:12.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:11 smithi007 ceph-mon[27906]: osdmap e162: 12 total, 12 up, 12 in 2024-04-23T15:32:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:11 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:32:12.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:11 smithi186 ceph-mon[31814]: osdmap e162: 12 total, 12 up, 12 in 2024-04-23T15:32:12.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:12 smithi137 ceph-mon[31694]: pgmap v1296: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.0 MiB/s wr, 18 op/s 2024-04-23T15:32:12.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:12 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:32:12.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:12 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:32:12.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:12 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:32:13.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:12 smithi007 ceph-mon[27906]: pgmap v1296: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.0 MiB/s wr, 18 op/s 2024-04-23T15:32:13.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:12 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:32:13.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:12 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:32:13.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:12 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:32:13.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:12 smithi186 ceph-mon[31814]: pgmap v1296: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.0 MiB/s wr, 18 op/s 2024-04-23T15:32:13.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:12 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:32:13.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:12 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:32:13.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:12 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:32:14.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:14 smithi137 ceph-mon[31694]: pgmap v1297: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:32:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:14 smithi007 ceph-mon[27906]: pgmap v1297: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:32:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:14 smithi186 ceph-mon[31814]: pgmap v1297: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:32:16.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 -- 172.21.15.7:0/2389536538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7054104c50 msgr2=0x7f7054108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 --2- 172.21.15.7:0/2389536538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7054104c50 0x7f7054108c90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f7040009900 tx=0x7f704002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 -- 172.21.15.7:0/2389536538 shutdown_connections 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 --2- 172.21.15.7:0/2389536538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054109370 0x7f7054110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 --2- 172.21.15.7:0/2389536538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7054104c50 0x7f7054108c90 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 --2- 172.21.15.7:0/2389536538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70541042a0 0x7f7054104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 -- 172.21.15.7:0/2389536538 >> 172.21.15.7:0/2389536538 conn(0x7f70540ffae0 msgr2=0x7f7054101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 -- 172.21.15.7:0/2389536538 shutdown_connections 2024-04-23T15:32:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.538+0000 7f705ae00640 1 -- 172.21.15.7:0/2389536538 wait complete. 2024-04-23T15:32:16.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.539+0000 7f705ae00640 1 Processor -- start 2024-04-23T15:32:16.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.539+0000 7f705ae00640 1 -- start start 2024-04-23T15:32:16.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705ae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70541042a0 0x7f70541a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7054109370 0x7f70541a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 0x7f705419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7054114300 con 0x7f705419a6c0 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7054114180 con 0x7f7054109370 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705ae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7054114480 con 0x7f70541042a0 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 0x7f705419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 0x7f705419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35012/0 (socket says 172.21.15.7:35012) 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.540+0000 7f705a400640 1 -- 172.21.15.7:0/3689433921 learned_addr learned my addr 172.21.15.7:0/3689433921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f7059000640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7054109370 0x7f70541a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f7059a00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70541042a0 0x7f70541a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f705a400640 1 -- 172.21.15.7:0/3689433921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70541042a0 msgr2=0x7f70541a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f705a400640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70541042a0 0x7f70541a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f705a400640 1 -- 172.21.15.7:0/3689433921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7054109370 msgr2=0x7f70541a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f705a400640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7054109370 0x7f70541a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f705a400640 1 -- 172.21.15.7:0/3689433921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705419b2c0 con 0x7f705419a6c0 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f7059000640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7054109370 0x7f70541a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.541+0000 7f705a400640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 0x7f705419ab40 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f704c00eaa0 tx=0x7f704c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.542+0000 7f7052000640 1 -- 172.21.15.7:0/3689433921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c00cdb0 con 0x7f705419a6c0 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.542+0000 7f7052000640 1 -- 172.21.15.7:0/3689433921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f704c005020 con 0x7f705419a6c0 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.542+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70541a7350 con 0x7f705419a6c0 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.542+0000 7f7052000640 1 -- 172.21.15.7:0/3689433921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c0116d0 con 0x7f705419a6c0 2024-04-23T15:32:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.542+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70541a7700 con 0x7f705419a6c0 2024-04-23T15:32:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.546+0000 7f705f256740 1 Processor -- start 2024-04-23T15:32:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.546+0000 7f7052000640 1 -- 172.21.15.7:0/3689433921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f704c0051d0 con 0x7f705419a6c0 2024-04-23T15:32:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.546+0000 7f705f256740 1 -- start start 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f705f256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caeb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f705f256740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082caf6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f705f256740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caf65a0 0x56082caf8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f705f256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56082ca51900 con 0x56082caeb3c0 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f705f256740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56082c9f7f20 con 0x56082caf65a0 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f705f256740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56082ca4d8c0 con 0x56082caebce0 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f7059000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caeb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f7059000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caeb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35018/0 (socket says 172.21.15.7:35018) 2024-04-23T15:32:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f7059000640 1 -- 172.21.15.7:0/3357758237 learned_addr learned my addr 172.21.15.7:0/3357758237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.547+0000 7f7059a00640 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082caf6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caf65a0 0x56082caf8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 -- 172.21.15.7:0/3357758237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 msgr2=0x56082caf6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082caf6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 -- 172.21.15.7:0/3357758237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caf65a0 msgr2=0x56082caf8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caf65a0 0x56082caf8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 -- 172.21.15.7:0/3357758237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082ca1ce10 con 0x56082caeb3c0 2024-04-23T15:32:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7052000640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f703c0a3d10 0x7f703c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7052000640 1 -- 172.21.15.7:0/3689433921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7f704c0d0d50 con 0x7f705419a6c0 2024-04-23T15:32:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059000640 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caeb7a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7040005ec0 tx=0x7f7040000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919e9ec6431eeda server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.548+0000 7f7059a00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f703c0a3d10 0x7f703c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.549+0000 7f7046a00640 1 -- 172.21.15.7:0/3357758237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040043020 con 0x56082caeb3c0 2024-04-23T15:32:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.549+0000 7f7046a00640 1 -- 172.21.15.7:0/3357758237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70400046c0 con 0x56082caeb3c0 2024-04-23T15:32:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.549+0000 7f7046a00640 1 -- 172.21.15.7:0/3357758237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040035070 con 0x56082caeb3c0 2024-04-23T15:32:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 -- 172.21.15.7:0/3357758237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 msgr2=0x56082caeb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caeb7a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7040005ec0 tx=0x7f7040000bc0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f7059a00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f703c0a3d10 0x7f703c0a61d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56082caec960 tx=0x7f704800b4d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 -- 172.21.15.7:0/3357758237 shutdown_connections 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caf65a0 0x56082caf8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082caf6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 --2- 172.21.15.7:0/3357758237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caeb7a0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 -- 172.21.15.7:0/3357758237 >> 172.21.15.7:0/3357758237 conn(0x56082cae78d0 msgr2=0x56082cae7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 -- 172.21.15.7:0/3357758237 shutdown_connections 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.550+0000 7f705f256740 1 -- 172.21.15.7:0/3357758237 wait complete. 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 -- start start 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 Processor -- start 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caf3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082caf3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caf65a0 0x56082caf40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56082caf9080 con 0x56082caeb3c0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56082ca0b2c0 con 0x56082caebce0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56082caf9200 con 0x56082caf65a0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.551+0000 7f705f256740 10 client.0 _ll_register_callbacks cb 0x56082c763a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caf3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caf3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35032/0 (socket says 172.21.15.7:35032) 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 -- 172.21.15.7:0/450441558 learned_addr learned my addr 172.21.15.7:0/450441558 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f705a400640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caf65a0 0x56082caf40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059000640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082caf3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 -- 172.21.15.7:0/450441558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caf65a0 msgr2=0x56082caf40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caf65a0 0x56082caf40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 -- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 msgr2=0x56082caf3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082caf3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.552+0000 7f7059a00640 1 -- 172.21.15.7:0/450441558 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082ca1bfd0 con 0x56082caeb3c0 2024-04-23T15:32:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f7059a00640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caf3660 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f704801d6f0 tx=0x7f70480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad30f84a1f49d26 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f703b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f703b400640 1 -- 172.21.15.7:0/450441558 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704801de60 con 0x56082caeb3c0 2024-04-23T15:32:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f703b400640 1 -- 172.21.15.7:0/450441558 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7f704801e820 con 0x56082caeb3c0 2024-04-23T15:32:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70400046c0 con 0x56082caeb3c0 2024-04-23T15:32:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f703b400640 1 -- 172.21.15.7:0/450441558 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f704801ea20 con 0x56082caeb3c0 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f705f256740 10 client.18963 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.553+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56082c764210 con 0x56082caeb3c0 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f703b400640 1 -- 172.21.15.7:0/450441558 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70400046c0 con 0x56082caeb3c0 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f703b400640 1 -- 172.21.15.7:0/450441558 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f704801b390 con 0x56082caeb3c0 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f705f256740 10 client.18963 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f705f256740 10 client.18963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f705f256740 20 client.18963 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f705f256740 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082cb06790 0x56082cb08b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f705f256740 4 client.18963 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.554+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56082ca5f320 con 0x56082cb06790 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.555+0000 7f7059000640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082cb06790 0x56082cb08b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.555+0000 7f7059000640 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082cb06790 0x56082cb08b80 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6e04a9a2322219 server_cookie=7995e6e85a7f7dab in_seq=0 out_seq=0 2024-04-23T15:32:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.555+0000 7f703b400640 10 client.18963 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.557+0000 7f703b400640 1 -- 172.21.15.7:0/450441558 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56082ca5f320 con 0x56082cb06790 2024-04-23T15:32:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.557+0000 7f703b400640 10 client.18963 handle_command_reply: tid=0 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 client.18963 shutdown 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 msgr2=0x56082caf3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caf3660 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f704801d6f0 tx=0x7f70480046c0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 shutdown_connections 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082cb06790 0x56082cb08b80 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082caf3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caf65a0 0x56082caf40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 --2- 172.21.15.7:0/450441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caf3660 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f703b400640 0 client.18963 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 >> 172.21.15.7:0/450441558 conn(0x56082cae78d0 msgr2=0x56082caed650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 shutdown_connections 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 1 -- 172.21.15.7:0/450441558 wait complete. 2024-04-23T15:32:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.558+0000 7f705f256740 20 client.18963 trim_cache size 0 max 16384 2024-04-23T15:32:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.575+0000 7f705f256740 1 Processor -- start 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.575+0000 7f705f256740 1 -- start start 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705f256740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082cae78d0 0x56082cae7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705f256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caedd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705f256740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082cb0e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705f256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70541b13f0 con 0x56082caeb3c0 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705f256740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70541b2f30 con 0x56082cae78d0 2024-04-23T15:32:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705f256740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70541b1ac0 con 0x56082caebce0 2024-04-23T15:32:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f7059000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caedd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f7059000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caedd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35034/0 (socket says 172.21.15.7:35034) 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f7059000640 1 -- 172.21.15.7:0/110406662 learned_addr learned my addr 172.21.15.7:0/110406662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f7059a00640 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082cae78d0 0x56082cae7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.576+0000 7f705a400640 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082cb0e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7059000640 1 -- 172.21.15.7:0/110406662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 msgr2=0x56082cb0e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7059000640 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082cb0e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7059000640 1 -- 172.21.15.7:0/110406662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082cae78d0 msgr2=0x56082cae7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7059000640 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082cae78d0 0x56082cae7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7059000640 1 -- 172.21.15.7:0/110406662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082cb08ef0 con 0x56082caeb3c0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7059000640 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caedd80 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f704002a9e0 tx=0x7f7040005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e06fbe180fe38e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7046000640 1 -- 172.21.15.7:0/110406662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040035070 con 0x56082caeb3c0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7046000640 1 -- 172.21.15.7:0/110406662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7040005520 con 0x56082caeb3c0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.577+0000 7f7046000640 1 -- 172.21.15.7:0/110406662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040043040 con 0x56082caeb3c0 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 -- 172.21.15.7:0/110406662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 msgr2=0x56082caedd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caedd80 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f704002a9e0 tx=0x7f7040005d80 comp rx=0 tx=0).stop 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 -- 172.21.15.7:0/110406662 shutdown_connections 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082caebce0 0x56082cb0e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082caedd80 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 --2- 172.21.15.7:0/110406662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082cae78d0 0x56082cae7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 -- 172.21.15.7:0/110406662 >> 172.21.15.7:0/110406662 conn(0x56082cae2e60 msgr2=0x56082caf3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 -- 172.21.15.7:0/110406662 shutdown_connections 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.578+0000 7f705f256740 1 -- 172.21.15.7:0/110406662 wait complete. 2024-04-23T15:32:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 -- start start 2024-04-23T15:32:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 Processor -- start 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082cae78d0 0x56082cafe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082cafeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082cafb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f70541b2860 con 0x56082caeb3c0 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70541b2190 con 0x56082caebce0 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.579+0000 7f705f256740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f70541af3f0 con 0x56082cae78d0 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f705f256740 10 client.0 _ll_register_callbacks cb 0x7f704800b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082cafeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082cafeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35050/0 (socket says 172.21.15.7:35050) 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 -- 172.21.15.7:0/1267270790 learned_addr learned my addr 172.21.15.7:0/1267270790 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059a00640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082cae78d0 0x56082cafe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f705a400640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082cafb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 -- 172.21.15.7:0/1267270790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082cae78d0 msgr2=0x56082cafe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082cae78d0 0x56082cafe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 -- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 msgr2=0x56082cafb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082cafb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059000640 1 -- 172.21.15.7:0/1267270790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082c830620 con 0x56082caeb3c0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f705a400640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082cafb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.580+0000 7f7059a00640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082cae78d0 0x56082cafe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f7059000640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082cafeaa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7040006010 tx=0x7f704002aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575e64520ea055eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f703b400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f703b400640 1 -- 172.21.15.7:0/1267270790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040043070 con 0x56082caeb3c0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f703b400640 1 -- 172.21.15.7:0/1267270790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7f70400504e0 con 0x56082caeb3c0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7040005520 con 0x56082caeb3c0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f703b400640 1 -- 172.21.15.7:0/1267270790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7040035040 con 0x56082caeb3c0 2024-04-23T15:32:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f705f256740 10 client.18969 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.581+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56082cb6d6a0 con 0x56082caeb3c0 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f703b400640 1 -- 172.21.15.7:0/1267270790 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7040005520 con 0x56082caeb3c0 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f703b400640 1 -- 172.21.15.7:0/1267270790 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f7040057030 con 0x56082caeb3c0 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f705f256740 10 client.18969 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f705f256740 10 client.18969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f705f256740 20 client.18969 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f705f256740 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082caf65a0 0x56082cb6f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f705f256740 4 client.18969 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.582+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56082ca59190 con 0x56082caf65a0 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.583+0000 7f7059a00640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082caf65a0 0x56082cb6f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.584+0000 7f7059a00640 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082caf65a0 0x56082cb6f880 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd05b16a8d72df9b server_cookie=86e07ea15db3536e in_seq=0 out_seq=0 2024-04-23T15:32:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.584+0000 7f703b400640 10 client.18969 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f703b400640 1 -- 172.21.15.7:0/1267270790 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56082ca59190 con 0x56082caf65a0 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f703b400640 10 client.18969 handle_command_reply: tid=0 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 client.18969 shutdown 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 msgr2=0x56082cafeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082cafeaa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7040006010 tx=0x7f704002aa70 comp rx=0 tx=0).stop 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 shutdown_connections 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56082caf65a0 0x56082cb6f880 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56082caebce0 0x56082cafb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f703b400640 0 client.18969 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56082caeb3c0 0x56082cafeaa0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 --2- 172.21.15.7:0/1267270790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56082cae78d0 0x56082cafe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 >> 172.21.15.7:0/1267270790 conn(0x56082cae2e60 msgr2=0x56082cae6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 shutdown_connections 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.615+0000 7f705f256740 1 -- 172.21.15.7:0/1267270790 wait complete. 2024-04-23T15:32:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.616+0000 7f705f256740 20 client.18969 trim_cache size 0 max 16384 2024-04-23T15:32:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:32:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:32:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:32:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:32:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f703c0a3d10 msgr2=0x7f703c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f703c0a3d10 0x7f703c0a61d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56082caec960 tx=0x7f704800b4d0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 msgr2=0x7f705419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 0x7f705419ab40 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f704c00eaa0 tx=0x7f704c00ef60 comp rx=0 tx=0).stop 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 shutdown_connections 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f703c0a3d10 0x7f703c0a61d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7054109370 0x7f70541a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f705419a6c0 0x7f705419ab40 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 --2- 172.21.15.7:0/3689433921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70541042a0 0x7f70541a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 >> 172.21.15.7:0/3689433921 conn(0x7f70540ffae0 msgr2=0x7f7054100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 shutdown_connections 2024-04-23T15:32:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:16.617+0000 7f705ae00640 1 -- 172.21.15.7:0/3689433921 wait complete. 2024-04-23T15:32:16.916 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:16 smithi186 ceph-mon[31814]: pgmap v1298: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:32:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:16 smithi137 ceph-mon[31694]: pgmap v1298: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:32:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:16 smithi007 ceph-mon[27906]: pgmap v1298: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:32:18.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:18 smithi137 ceph-mon[31694]: pgmap v1299: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:32:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:18 smithi007 ceph-mon[27906]: pgmap v1299: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:32:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:18 smithi186 ceph-mon[31814]: pgmap v1299: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:32:20.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:20 smithi137 ceph-mon[31694]: pgmap v1300: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:32:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:20 smithi007 ceph-mon[27906]: pgmap v1300: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:32:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:20 smithi186 ceph-mon[31814]: pgmap v1300: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 11 op/s 2024-04-23T15:32:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:22 smithi007 ceph-mon[27906]: pgmap v1301: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 20 op/s 2024-04-23T15:32:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:22 smithi186 ceph-mon[31814]: pgmap v1301: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 20 op/s 2024-04-23T15:32:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:22 smithi137 ceph-mon[31694]: pgmap v1301: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 20 op/s 2024-04-23T15:32:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:24 smithi007 ceph-mon[27906]: pgmap v1302: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:32:25.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:24 smithi186 ceph-mon[31814]: pgmap v1302: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:32:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:24 smithi137 ceph-mon[31694]: pgmap v1302: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:32:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:26 smithi007 ceph-mon[27906]: pgmap v1303: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:32:27.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:26 smithi186 ceph-mon[31814]: pgmap v1303: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:32:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:26 smithi137 ceph-mon[31694]: pgmap v1303: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.7 MiB/s wr, 12 op/s 2024-04-23T15:32:28.971 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:28 smithi137 ceph-mon[31694]: pgmap v1304: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:28 smithi007 ceph-mon[27906]: pgmap v1304: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:29.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:28 smithi186 ceph-mon[31814]: pgmap v1304: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 -- 172.21.15.7:0/1726505762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c1038e0 msgr2=0x7fbe0c10bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 --2- 172.21.15.7:0/1726505762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c1038e0 0x7fbe0c10bdc0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009900 tx=0x7fbdf402a480 comp rx=0 tx=0).stop 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 -- 172.21.15.7:0/1726505762 shutdown_connections 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 --2- 172.21.15.7:0/1726505762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c10e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 --2- 172.21.15.7:0/1726505762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c1038e0 0x7fbe0c10bdc0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 --2- 172.21.15.7:0/1726505762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe0c102fc0 0x7fbe0c1033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.799+0000 7fbe11800640 1 -- 172.21.15.7:0/1726505762 >> 172.21.15.7:0/1726505762 conn(0x7fbe0c0fc820 msgr2=0x7fbe0c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.800+0000 7fbe11800640 1 -- 172.21.15.7:0/1726505762 shutdown_connections 2024-04-23T15:32:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.800+0000 7fbe11800640 1 -- 172.21.15.7:0/1726505762 wait complete. 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 Processor -- start 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 -- start start 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe0c102fc0 0x7fbe0c1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe0c1038e0 0x7fbe0c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1120c0 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c111f40 con 0x7fbe0c1038e0 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.801+0000 7fbe11800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c112240 con 0x7fbe0c102fc0 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42404/0 (socket says 172.21.15.7:42404) 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 -- 172.21.15.7:0/2124112254 learned_addr learned my addr 172.21.15.7:0/2124112254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe0c102fc0 0x7fbe0c1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe03e00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe0c1038e0 0x7fbe0c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 -- 172.21.15.7:0/2124112254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe0c102fc0 msgr2=0x7fbe0c1a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe0c102fc0 0x7fbe0c1a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 -- 172.21.15.7:0/2124112254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe0c1038e0 msgr2=0x7fbe0c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe0c1038e0 0x7fbe0c1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.802+0000 7fbe10e00640 1 -- 172.21.15.7:0/2124112254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c19af60 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.803+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c19a6a0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400eaa0 tx=0x7fbe0400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.803+0000 7fbe09600640 1 -- 172.21.15.7:0/2124112254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400cdb0 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.803+0000 7fbe09600640 1 -- 172.21.15.7:0/2124112254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe04005020 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.803+0000 7fbe09600640 1 -- 172.21.15.7:0/2124112254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040116d0 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.803+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c19b250 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.803+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c1a7510 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 Processor -- start 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe09600640 1 -- 172.21.15.7:0/2124112254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbe040051d0 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 -- start start 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da853c0 0x56035da857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da85ce0 0x56035da90060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035da92990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56035d9eb900 con 0x56035da905a0 2024-04-23T15:32:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56035d991f20 con 0x56035da85ce0 2024-04-23T15:32:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.807+0000 7fbe15c81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56035d9e78c0 con 0x56035da853c0 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035da92990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035da92990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42416/0 (socket says 172.21.15.7:42416) 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe03e00640 1 -- 172.21.15.7:0/542825887 learned_addr learned my addr 172.21.15.7:0/542825887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe03e00640 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da853c0 0x56035da857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe0be00640 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da85ce0 0x56035da90060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe03e00640 1 -- 172.21.15.7:0/542825887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da853c0 msgr2=0x56035da857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.808+0000 7fbe03e00640 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da853c0 0x56035da857a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe03e00640 1 -- 172.21.15.7:0/542825887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da85ce0 msgr2=0x56035da90060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe03e00640 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da85ce0 0x56035da90060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe03e00640 1 -- 172.21.15.7:0/542825887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035d9b6e10 con 0x56035da905a0 2024-04-23T15:32:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe03e00640 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035da92990 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005c40 tx=0x7fbdf4005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97703cc8b58ed3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe09600640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbdf00a3d90 0x7fbdf00a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe01600640 1 -- 172.21.15.7:0/542825887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4035040 con 0x56035da905a0 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe09600640 1 -- 172.21.15.7:0/2124112254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7fbe040d0cc0 con 0x7fbe0c10c3e0 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe01600640 1 -- 172.21.15.7:0/542825887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdf40040c0 con 0x56035da905a0 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.809+0000 7fbe01600640 1 -- 172.21.15.7:0/542825887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4031d60 con 0x56035da905a0 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.810+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbdf00a3d90 0x7fbdf00a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.810+0000 7fbe15c81740 1 -- 172.21.15.7:0/542825887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 msgr2=0x56035da92990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.810+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbdf00a3d90 0x7fbdf00a6250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x56035da86960 tx=0x7fbdfc00b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.810+0000 7fbe15c81740 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035da92990 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005c40 tx=0x7fbdf4005bb0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 -- 172.21.15.7:0/542825887 shutdown_connections 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da85ce0 0x56035da90060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035da92990 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 --2- 172.21.15.7:0/542825887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da853c0 0x56035da857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 -- 172.21.15.7:0/542825887 >> 172.21.15.7:0/542825887 conn(0x56035da818d0 msgr2=0x56035da81cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 -- 172.21.15.7:0/542825887 shutdown_connections 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 -- 172.21.15.7:0/542825887 wait complete. 2024-04-23T15:32:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.811+0000 7fbe15c81740 1 -- start start 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 Processor -- start 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da8d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035da8dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035da8e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56035da93080 con 0x56035da85ce0 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56035d9a52c0 con 0x56035da853c0 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x56035da93200 con 0x56035da905a0 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe15c81740 10 client.0 _ll_register_callbacks cb 0x56035d6fda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.812+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035da8dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035da8dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42422/0 (socket says 172.21.15.7:42422) 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 -- 172.21.15.7:0/3621487389 learned_addr learned my addr 172.21.15.7:0/3621487389 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe0be00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da8d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe10e00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035da8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 -- 172.21.15.7:0/3621487389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 msgr2=0x56035da8e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035da8e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 -- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 msgr2=0x56035da8d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da8d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 -- 172.21.15.7:0/3621487389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035d9b5fd0 con 0x56035da85ce0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbe03e00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035da8dbc0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fbdf402a9a0 tx=0x7fbdf40317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf694e24d770eaf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.813+0000 7fbdfa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbdfa000640 1 -- 172.21.15.7:0/3621487389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf404d020 con 0x56035da85ce0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbdfa000640 1 -- 172.21.15.7:0/3621487389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7fbdf4031df0 con 0x56035da85ce0 2024-04-23T15:32:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdf40040c0 con 0x56035da85ce0 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbdfa000640 1 -- 172.21.15.7:0/3621487389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbdf4058050 con 0x56035da85ce0 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbe15c81740 10 client.18981 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56035d6fe210 con 0x56035da85ce0 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.814+0000 7fbdfa000640 1 -- 172.21.15.7:0/3621487389 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdf40040c0 con 0x56035da85ce0 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbdfa000640 1 -- 172.21.15.7:0/3621487389 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbdf403a040 con 0x56035da85ce0 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbe15c81740 10 client.18981 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbe15c81740 10 client.18981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbe15c81740 20 client.18981 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbe15c81740 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035daa0640 0x56035daa2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbe15c81740 4 client.18981 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:32:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.815+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56035d9f9320 con 0x56035daa0640 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.816+0000 7fbe0be00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035daa0640 0x56035daa2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.816+0000 7fbe0be00640 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035daa0640 0x56035daa2a30 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a17d5c2bd48fcf9 server_cookie=46e34981cc51d33e in_seq=0 out_seq=0 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.816+0000 7fbdfa000640 10 client.18981 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.818+0000 7fbdfa000640 1 -- 172.21.15.7:0/3621487389 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56035d9f9320 con 0x56035daa0640 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.818+0000 7fbdfa000640 10 client.18981 handle_command_reply: tid=0 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.818+0000 7fbe15c81740 1 client.18981 shutdown 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.818+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 msgr2=0x56035da8dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.818+0000 7fbe15c81740 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035da8dbc0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fbdf402a9a0 tx=0x7fbdf40317f0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.818+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 shutdown_connections 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035daa0640 0x56035daa2a30 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035da8e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035da8dbc0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 --2- 172.21.15.7:0/3621487389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da8d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 >> 172.21.15.7:0/3621487389 conn(0x56035da818d0 msgr2=0x56035da80a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbdfa000640 0 client.18981 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 shutdown_connections 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 1 -- 172.21.15.7:0/3621487389 wait complete. 2024-04-23T15:32:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.819+0000 7fbe15c81740 20 client.18981 trim_cache size 0 max 16384 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 Processor -- start 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 -- start start 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da87d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da85ce0 0x56035daa5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035daa5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1b14c0 con 0x56035da905a0 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1b3000 con 0x56035da853c0 2024-04-23T15:32:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe15c81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1b1b90 con 0x56035da85ce0 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.839+0000 7fbe10e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035daa5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035daa5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42438/0 (socket says 172.21.15.7:42438) 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 -- 172.21.15.7:0/2889980531 learned_addr learned my addr 172.21.15.7:0/2889980531 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe03e00640 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da85ce0 0x56035daa5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da87d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 -- 172.21.15.7:0/2889980531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da85ce0 msgr2=0x56035daa5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da85ce0 0x56035daa5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 -- 172.21.15.7:0/2889980531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 msgr2=0x56035da87d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da87d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 -- 172.21.15.7:0/2889980531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035d7ca620 con 0x56035da905a0 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe03e00640 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da85ce0 0x56035daa5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.840+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035daa5bb0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ce060 tx=0x7fbe0409c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c7d86e45867901 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.841+0000 7fbe00c00640 1 -- 172.21.15.7:0/2889980531 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0401f040 con 0x56035da905a0 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.841+0000 7fbe00c00640 1 -- 172.21.15.7:0/2889980531 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe040a0c00 con 0x56035da905a0 2024-04-23T15:32:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.841+0000 7fbe00c00640 1 -- 172.21.15.7:0/2889980531 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040870b0 con 0x56035da905a0 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.841+0000 7fbe15c81740 1 -- 172.21.15.7:0/2889980531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 msgr2=0x56035daa5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.841+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035daa5bb0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ce060 tx=0x7fbe0409c270 comp rx=0 tx=0).stop 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 -- 172.21.15.7:0/2889980531 shutdown_connections 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da905a0 0x56035daa5bb0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da85ce0 0x56035daa5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2889980531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035da87d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 -- 172.21.15.7:0/2889980531 >> 172.21.15.7:0/2889980531 conn(0x56035da818d0 msgr2=0x56035da80a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 -- 172.21.15.7:0/2889980531 shutdown_connections 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 -- 172.21.15.7:0/2889980531 wait complete. 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 -- start start 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.842+0000 7fbe15c81740 1 Processor -- start 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035daa5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035daa2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035daa3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1b2930 con 0x56035da85ce0 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1b2260 con 0x56035da853c0 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1af4c0 con 0x56035da905a0 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe15c81740 10 client.0 _ll_register_callbacks cb 0x7fbdfc00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035daa2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035daa2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42452/0 (socket says 172.21.15.7:42452) 2024-04-23T15:32:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.843+0000 7fbe03e00640 1 -- 172.21.15.7:0/2665471575 learned_addr learned my addr 172.21.15.7:0/2665471575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035daa5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe10e00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035daa3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe03e00640 1 -- 172.21.15.7:0/2665471575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 msgr2=0x56035daa3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe03e00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035daa3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe03e00640 1 -- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 msgr2=0x56035daa5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe03e00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035daa5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe03e00640 1 -- 172.21.15.7:0/2665471575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035daa3940 con 0x56035da85ce0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbe03e00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035daa2d10 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4031440 tx=0x7fbdf403d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13af95628a67bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.844+0000 7fbdfa000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbdfa000640 1 -- 172.21.15.7:0/2665471575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4061060 con 0x56035da85ce0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbdfa000640 1 -- 172.21.15.7:0/2665471575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7fbdf403a680 con 0x56035da85ce0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe040a0c00 con 0x56035da85ce0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbdfa000640 1 -- 172.21.15.7:0/2665471575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbdf4068050 con 0x56035da85ce0 2024-04-23T15:32:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbe15c81740 10 client.18987 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56035db06730 con 0x56035da85ce0 2024-04-23T15:32:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbdfa000640 1 -- 172.21.15.7:0/2665471575 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe040a0c00 con 0x56035da85ce0 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.845+0000 7fbdfa000640 1 -- 172.21.15.7:0/2665471575 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbdf405c760 con 0x56035da85ce0 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe15c81740 10 client.18987 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe15c81740 10 client.18987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe15c81740 20 client.18987 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035db06e20 0x56035db09240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe15c81740 4 client.18987 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56035d9f3190 con 0x56035db06e20 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.846+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035db06e20 0x56035db09240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.847+0000 7fbe0be00640 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035db06e20 0x56035db09240 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e83568b678572 server_cookie=de9e5a4061f88cfc in_seq=0 out_seq=0 2024-04-23T15:32:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.847+0000 7fbdfa000640 10 client.18987 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.895+0000 7fbdfa000640 1 -- 172.21.15.7:0/2665471575 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56035d9f3190 con 0x56035db06e20 2024-04-23T15:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.895+0000 7fbdfa000640 10 client.18987 handle_command_reply: tid=0 2024-04-23T15:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.895+0000 7fbe15c81740 1 client.18987 shutdown 2024-04-23T15:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 msgr2=0x56035daa2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035daa2d10 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4031440 tx=0x7fbdf403d930 comp rx=0 tx=0).stop 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 shutdown_connections 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56035db06e20 0x56035db09240 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56035da905a0 0x56035daa3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56035da85ce0 0x56035daa2d10 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 --2- 172.21.15.7:0/2665471575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56035da853c0 0x56035daa5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 >> 172.21.15.7:0/2665471575 conn(0x56035da818d0 msgr2=0x56035da9b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbdfa000640 0 client.18987 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 shutdown_connections 2024-04-23T15:32:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.896+0000 7fbe15c81740 1 -- 172.21.15.7:0/2665471575 wait complete. 2024-04-23T15:32:29.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.897+0000 7fbe15c81740 20 client.18987 trim_cache size 0 max 16384 2024-04-23T15:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:32:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:32:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.898+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbdf00a3d90 msgr2=0x7fbdf00a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.898+0000 7fbe11800640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbdf00a3d90 0x7fbdf00a6250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x56035da86960 tx=0x7fbdfc00b390 comp rx=0 tx=0).stop 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.898+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 msgr2=0x7fbe0c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.898+0000 7fbe11800640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c19a6a0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400eaa0 tx=0x7fbe0400ef60 comp rx=0 tx=0).stop 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 shutdown_connections 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbdf00a3d90 0x7fbdf00a6250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe0c1038e0 0x7fbe0c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe0c10c3e0 0x7fbe0c19a6a0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 --2- 172.21.15.7:0/2124112254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe0c102fc0 0x7fbe0c1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 >> 172.21.15.7:0/2124112254 conn(0x7fbe0c0fc820 msgr2=0x7fbe0c101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 shutdown_connections 2024-04-23T15:32:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:29.899+0000 7fbe11800640 1 -- 172.21.15.7:0/2124112254 wait complete. 2024-04-23T15:32:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:30 smithi007 ceph-mon[27906]: pgmap v1305: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:32:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:30 smithi186 ceph-mon[31814]: pgmap v1305: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:32:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:30 smithi137 ceph-mon[31694]: pgmap v1305: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:32:33.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:32 smithi007 ceph-mon[27906]: pgmap v1306: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:32:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:32 smithi186 ceph-mon[31814]: pgmap v1306: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:32:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:32 smithi137 ceph-mon[31694]: pgmap v1306: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 22 op/s 2024-04-23T15:32:35.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:34 smithi007 ceph-mon[27906]: pgmap v1307: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:32:35.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:34 smithi186 ceph-mon[31814]: pgmap v1307: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:32:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:34 smithi137 ceph-mon[31694]: pgmap v1307: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:32:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:36 smithi007 ceph-mon[27906]: pgmap v1308: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:32:37.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:36 smithi186 ceph-mon[31814]: pgmap v1308: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:32:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:36 smithi137 ceph-mon[31694]: pgmap v1308: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:32:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:38 smithi007 ceph-mon[27906]: pgmap v1309: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:32:39.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:38 smithi186 ceph-mon[31814]: pgmap v1309: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:32:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:38 smithi137 ceph-mon[31694]: pgmap v1309: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:32:41.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:40 smithi007 ceph-mon[27906]: pgmap v1310: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:41.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:40 smithi186 ceph-mon[31814]: pgmap v1310: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:40 smithi137 ceph-mon[31694]: pgmap v1310: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:43.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:42 smithi007 ceph-mon[27906]: pgmap v1311: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.083+0000 7f8f0a000640 1 -- 172.21.15.7:0/771860995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f0410c3e0 msgr2=0x7f8f0410e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.083+0000 7f8f0a000640 1 --2- 172.21.15.7:0/771860995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f0410c3e0 0x7f8f0410e880 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009900 tx=0x7f8efc02a480 comp rx=0 tx=0).stop 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 -- 172.21.15.7:0/771860995 shutdown_connections 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 --2- 172.21.15.7:0/771860995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f041038e0 0x7f8f0410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 --2- 172.21.15.7:0/771860995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f0410c3e0 0x7f8f0410e880 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 --2- 172.21.15.7:0/771860995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f04102fc0 0x7f8f041033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 -- 172.21.15.7:0/771860995 >> 172.21.15.7:0/771860995 conn(0x7f8f040fc820 msgr2=0x7f8f040fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 -- 172.21.15.7:0/771860995 shutdown_connections 2024-04-23T15:32:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.084+0000 7f8f0a000640 1 -- 172.21.15.7:0/771860995 wait complete. 2024-04-23T15:32:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 Processor -- start 2024-04-23T15:32:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 -- start start 2024-04-23T15:32:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f04102fc0 0x7f8f041985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 0x7f8f04198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f0410c3e0 0x7f8f0419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04112050 con 0x7f8f041038e0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04111ed0 con 0x7f8f04102fc0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.085+0000 7f8f0a000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041121d0 con 0x7f8f0410c3e0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 0x7f8f04198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 0x7f8f04198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54284/0 (socket says 172.21.15.7:54284) 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 -- 172.21.15.7:0/2659184812 learned_addr learned my addr 172.21.15.7:0/2659184812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8f08c00640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f04102fc0 0x7f8f041985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8f09600640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f0410c3e0 0x7f8f0419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 -- 172.21.15.7:0/2659184812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f0410c3e0 msgr2=0x7f8f0419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f0410c3e0 0x7f8f0419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 -- 172.21.15.7:0/2659184812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f04102fc0 msgr2=0x7f8f041985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f04102fc0 0x7f8f041985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8efbe00640 1 -- 172.21.15.7:0/2659184812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0419d5c0 con 0x7f8f041038e0 2024-04-23T15:32:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.086+0000 7f8f08c00640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f04102fc0 0x7f8f041985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.087+0000 7f8efbe00640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 0x7f8f04198b10 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00d740 tx=0x7f8eec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.087+0000 7f8f02000640 1 -- 172.21.15.7:0/2659184812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec017070 con 0x7f8f041038e0 2024-04-23T15:32:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.087+0000 7f8f02000640 1 -- 172.21.15.7:0/2659184812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8eec00de50 con 0x7f8f041038e0 2024-04-23T15:32:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.087+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0419d8b0 con 0x7f8f041038e0 2024-04-23T15:32:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.087+0000 7f8f02000640 1 -- 172.21.15.7:0/2659184812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00f620 con 0x7f8f041038e0 2024-04-23T15:32:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.087+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f041a5140 con 0x7f8f041038e0 2024-04-23T15:32:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 Processor -- start 2024-04-23T15:32:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 -- start start 2024-04-23T15:32:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242f2e0 0x55c96242f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c96243e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962440da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c962395900 con 0x55c96243e9b0 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c96233bf20 con 0x55c96242fc00 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.092+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c9623918c0 con 0x55c96242f2e0 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.093+0000 7f8f02000640 1 -- 172.21.15.7:0/2659184812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f8eec009c30 con 0x7f8f041038e0 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.093+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962440da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.093+0000 7f8f09600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242f2e0 0x55c96242f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.093+0000 7f8f08c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c96243e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.093+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962440da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54298/0 (socket says 172.21.15.7:54298) 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.093+0000 7f8efbe00640 1 -- 172.21.15.7:0/168888529 learned_addr learned my addr 172.21.15.7:0/168888529 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.094+0000 7f8efbe00640 1 -- 172.21.15.7:0/168888529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242f2e0 msgr2=0x55c96242f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.094+0000 7f8efbe00640 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242f2e0 0x55c96242f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.094+0000 7f8efbe00640 1 -- 172.21.15.7:0/168888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 msgr2=0x55c96243e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.094+0000 7f8efbe00640 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c96243e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.094+0000 7f8efbe00640 1 -- 172.21.15.7:0/168888529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c962360e10 con 0x55c96243e9b0 2024-04-23T15:32:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.094+0000 7f8efbe00640 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962440da0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0cda70 tx=0x7f8eec0d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c93b75e59a011d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.095+0000 7f8ef9c00640 1 -- 172.21.15.7:0/168888529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0df070 con 0x55c96243e9b0 2024-04-23T15:32:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.095+0000 7f8ef9c00640 1 -- 172.21.15.7:0/168888529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8eec0d0de0 con 0x55c96243e9b0 2024-04-23T15:32:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.095+0000 7f8ef9c00640 1 -- 172.21.15.7:0/168888529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0db680 con 0x55c96243e9b0 2024-04-23T15:32:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.095+0000 7f8f02000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ee80a3d10 0x7f8ee80a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/168888529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 msgr2=0x55c962440da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962440da0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0cda70 tx=0x7f8eec0d8670 comp rx=0 tx=0).stop 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f02000640 1 -- 172.21.15.7:0/2659184812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7f8eec0d07f0 con 0x7f8f041038e0 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f09600640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ee80a3d10 0x7f8ee80a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/168888529 shutdown_connections 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c96243e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962440da0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/168888529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242f2e0 0x55c96242f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/168888529 >> 172.21.15.7:0/168888529 conn(0x55c96242b8d0 msgr2=0x55c96242bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.096+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/168888529 shutdown_connections 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.097+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/168888529 wait complete. 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.097+0000 7f8f09600640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ee80a3d10 0x7f8ee80a61d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005ab0 tx=0x7f8efc005a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.097+0000 7f8f0e5d7740 1 -- start start 2024-04-23T15:32:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.097+0000 7f8f0e5d7740 1 Processor -- start 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242f2e0 0x55c96243e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c962437580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962437ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c9624415e0 con 0x55c96243e9b0 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c96234f2c0 con 0x55c96242f2e0 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c962441760 con 0x55c96242fc00 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f0e5d7740 10 client.0 _ll_register_callbacks cb 0x55c9620a7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f09600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962437ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f09600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962437ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54310/0 (socket says 172.21.15.7:54310) 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f09600640 1 -- 172.21.15.7:0/3365522864 learned_addr learned my addr 172.21.15.7:0/3365522864 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.098+0000 7f8f08c00640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242f2e0 0x55c96243e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8efbe00640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c962437580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8f09600640 1 -- 172.21.15.7:0/3365522864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 msgr2=0x55c962437580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8f09600640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c962437580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8f09600640 1 -- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242f2e0 msgr2=0x55c96243e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8f09600640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242f2e0 0x55c96243e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8f09600640 1 -- 172.21.15.7:0/3365522864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c96235ffd0 con 0x55c96243e9b0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8f09600640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962437ac0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f8efc032fd0 tx=0x7f8efc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b9eba0ab53408b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.099+0000 7f8ef2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8ef2000640 1 -- 172.21.15.7:0/3365522864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc04c030 con 0x55c96243e9b0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eec0d0de0 con 0x55c96243e9b0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8ef2000640 1 -- 172.21.15.7:0/3365522864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7f8efc003b40 con 0x55c96243e9b0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8ef2000640 1 -- 172.21.15.7:0/3365522864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8efc059050 con 0x55c96243e9b0 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8f0e5d7740 10 client.18999 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9620a8210 con 0x55c96243e9b0 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.100+0000 7f8ef2000640 1 -- 172.21.15.7:0/3365522864 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8eec0d0de0 con 0x55c96243e9b0 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8ef2000640 1 -- 172.21.15.7:0/3365522864 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8efc048cc0 con 0x55c96243e9b0 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8f0e5d7740 10 client.18999 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8f0e5d7740 10 client.18999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8f0e5d7740 20 client.18999 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c962452e00 0x55c9624551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8f0e5d7740 4 client.18999 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.101+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9623a3320 con 0x55c962452e00 2024-04-23T15:32:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.102+0000 7f8f08c00640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c962452e00 0x55c9624551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.103+0000 7f8f08c00640 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c962452e00 0x55c9624551f0 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a7a8c379d2ef611 server_cookie=98c5ed9d71d0b047 in_seq=0 out_seq=0 2024-04-23T15:32:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.103+0000 7f8ef2000640 10 client.18999 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.104+0000 7f8ef2000640 1 -- 172.21.15.7:0/3365522864 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c9623a3320 con 0x55c962452e00 2024-04-23T15:32:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.104+0000 7f8ef2000640 10 client.18999 handle_command_reply: tid=0 2024-04-23T15:32:43.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 client.18999 shutdown 2024-04-23T15:32:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 msgr2=0x55c962437ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962437ac0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f8efc032fd0 tx=0x7f8efc009260 comp rx=0 tx=0).stop 2024-04-23T15:32:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 shutdown_connections 2024-04-23T15:32:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c962452e00 0x55c9624551f0 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96243e9b0 0x55c962437ac0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c962437580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/3365522864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242f2e0 0x55c96243e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 >> 172.21.15.7:0/3365522864 conn(0x55c96242b8d0 msgr2=0x55c962431740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8ef2000640 0 client.18999 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 shutdown_connections 2024-04-23T15:32:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.105+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/3365522864 wait complete. 2024-04-23T15:32:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.106+0000 7f8f0e5d7740 20 client.18999 trim_cache size 0 max 16384 2024-04-23T15:32:43.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:42 smithi186 ceph-mon[31814]: pgmap v1311: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.132+0000 7f8f0e5d7740 1 Processor -- start 2024-04-23T15:32:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.132+0000 7f8f0e5d7740 1 -- start start 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96243de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c96245aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96243e9b0 0x55c96245aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041ad0b0 con 0x55c96242f2e0 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041aebf0 con 0x55c96243e9b0 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041ad780 con 0x55c96242fc00 2024-04-23T15:32:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f08c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96243de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f08c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96243de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54312/0 (socket says 172.21.15.7:54312) 2024-04-23T15:32:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f08c00640 1 -- 172.21.15.7:0/1970930089 learned_addr learned my addr 172.21.15.7:0/1970930089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.133+0000 7f8f09600640 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96243e9b0 0x55c96245aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8efbe00640 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c96245aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8f08c00640 1 -- 172.21.15.7:0/1970930089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 msgr2=0x55c96245aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8f08c00640 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c96245aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8f08c00640 1 -- 172.21.15.7:0/1970930089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96243e9b0 msgr2=0x55c96245aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8f08c00640 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96243e9b0 0x55c96245aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8f08c00640 1 -- 172.21.15.7:0/1970930089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c962174620 con 0x55c96242f2e0 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.134+0000 7f8f08c00640 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96243de00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400af50 tx=0x7f8ef4013c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d557bc7110cdb6fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.135+0000 7f8ef9200640 1 -- 172.21.15.7:0/1970930089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4004d20 con 0x55c96242f2e0 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.135+0000 7f8ef9200640 1 -- 172.21.15.7:0/1970930089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ef4003970 con 0x55c96242f2e0 2024-04-23T15:32:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.135+0000 7f8ef9200640 1 -- 172.21.15.7:0/1970930089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4010c10 con 0x55c96242f2e0 2024-04-23T15:32:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/1970930089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 msgr2=0x55c96243de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96243de00 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400af50 tx=0x7f8ef4013c20 comp rx=0 tx=0).stop 2024-04-23T15:32:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/1970930089 shutdown_connections 2024-04-23T15:32:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96243e9b0 0x55c96245aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96242fc00 0x55c96245aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/1970930089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96243de00 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/1970930089 >> 172.21.15.7:0/1970930089 conn(0x55c96242b8d0 msgr2=0x55c962432880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/1970930089 shutdown_connections 2024-04-23T15:32:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/1970930089 wait complete. 2024-04-23T15:32:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 -- start start 2024-04-23T15:32:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.136+0000 7f8f0e5d7740 1 Processor -- start 2024-04-23T15:32:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96244f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c962434210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96243e9b0 0x55c962434750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041ae520 con 0x55c96242f2e0 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041ade50 con 0x55c96242fc00 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041ab0b0 con 0x55c96243e9b0 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f0e5d7740 10 client.0 _ll_register_callbacks cb 0x7f8efc009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f08c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96244f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f08c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96244f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54316/0 (socket says 172.21.15.7:54316) 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.137+0000 7f8f08c00640 1 -- 172.21.15.7:0/2934917137 learned_addr learned my addr 172.21.15.7:0/2934917137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8efbe00640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c962434210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f09600640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96243e9b0 0x55c962434750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f08c00640 1 -- 172.21.15.7:0/2934917137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96243e9b0 msgr2=0x55c962434750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f08c00640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96243e9b0 0x55c962434750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f08c00640 1 -- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 msgr2=0x55c962434210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f08c00640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c962434210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f08c00640 1 -- 172.21.15.7:0/2934917137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c962434cc0 con 0x55c96242f2e0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8f08c00640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96244f920 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4000f80 tx=0x7f8ef4003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275678489e8c8a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8ef2000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.138+0000 7f8ef2000640 1 -- 172.21.15.7:0/2934917137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4004cb0 con 0x55c96242f2e0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8ef2000640 1 -- 172.21.15.7:0/2934917137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7f8ef401f500 con 0x55c96242f2e0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef4003970 con 0x55c96242f2e0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8ef2000640 1 -- 172.21.15.7:0/2934917137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8ef403a050 con 0x55c96242f2e0 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 10 client.19005 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9624b9090 con 0x55c96242f2e0 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8ef2000640 1 -- 172.21.15.7:0/2934917137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ef4003970 con 0x55c96242f2e0 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8ef2000640 1 -- 172.21.15.7:0/2934917137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f8ef402f020 con 0x55c96242f2e0 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 10 client.19005 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 10 client.19005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 20 client.19005 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.139+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c9624b9780 0x55c9624bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.140+0000 7f8f0e5d7740 4 client.19005 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:32:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.140+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c96239d190 con 0x55c9624b9780 2024-04-23T15:32:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.140+0000 7f8efbe00640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c9624b9780 0x55c9624bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.141+0000 7f8ef2000640 10 client.19005 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.141+0000 7f8efbe00640 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c9624b9780 0x55c9624bbba0 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf41e298a00b651 server_cookie=ecf544f201318926 in_seq=0 out_seq=0 2024-04-23T15:32:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:42 smithi137 ceph-mon[31694]: pgmap v1311: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8ef2000640 1 -- 172.21.15.7:0/2934917137 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c96239d190 con 0x55c9624b9780 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8ef2000640 10 client.19005 handle_command_reply: tid=0 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 client.19005 shutdown 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 msgr2=0x55c96244f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96244f920 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4000f80 tx=0x7f8ef4003b20 comp rx=0 tx=0).stop 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 shutdown_connections 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c9624b9780 0x55c9624bbba0 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c96242fc00 0x55c962434210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c96243e9b0 0x55c962434750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 --2- 172.21.15.7:0/2934917137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c96242f2e0 0x55c96244f920 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8ef2000640 0 client.19005 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.173+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 >> 172.21.15.7:0/2934917137 conn(0x55c96242b8d0 msgr2=0x55c96242a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.174+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 shutdown_connections 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.174+0000 7f8f0e5d7740 1 -- 172.21.15.7:0/2934917137 wait complete. 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.174+0000 7f8f0e5d7740 20 client.19005 trim_cache size 0 max 16384 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:32:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ee80a3d10 msgr2=0x7f8ee80a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ee80a3d10 0x7f8ee80a61d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005ab0 tx=0x7f8efc005a40 comp rx=0 tx=0).stop 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 msgr2=0x7f8f04198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 0x7f8f04198b10 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00d740 tx=0x7f8eec00dc00 comp rx=0 tx=0).stop 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 shutdown_connections 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f8ee80a3d10 0x7f8ee80a61d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f0410c3e0 0x7f8f0419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f041038e0 0x7f8f04198b10 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 --2- 172.21.15.7:0/2659184812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f04102fc0 0x7f8f041985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 >> 172.21.15.7:0/2659184812 conn(0x7f8f040fc820 msgr2=0x7f8f040fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 shutdown_connections 2024-04-23T15:32:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:43.175+0000 7f8f0a000640 1 -- 172.21.15.7:0/2659184812 wait complete. 2024-04-23T15:32:45.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:44 smithi007 ceph-mon[27906]: pgmap v1312: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:32:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:44 smithi186 ceph-mon[31814]: pgmap v1312: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:32:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:44 smithi137 ceph-mon[31694]: pgmap v1312: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:32:47.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:46 smithi007 ceph-mon[27906]: pgmap v1313: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:32:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:46 smithi186 ceph-mon[31814]: pgmap v1313: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:32:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:46 smithi137 ceph-mon[31694]: pgmap v1313: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:32:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:48 smithi007 ceph-mon[27906]: pgmap v1314: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:49.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:48 smithi186 ceph-mon[31814]: pgmap v1314: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:48 smithi137 ceph-mon[31694]: pgmap v1314: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:50 smithi007 ceph-mon[27906]: pgmap v1315: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:51.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:50 smithi186 ceph-mon[31814]: pgmap v1315: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:50 smithi137 ceph-mon[31694]: pgmap v1315: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:53.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:52 smithi007 ceph-mon[27906]: pgmap v1316: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:52 smithi186 ceph-mon[31814]: pgmap v1316: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:52 smithi137 ceph-mon[31694]: pgmap v1316: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:32:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:54 smithi007 ceph-mon[27906]: pgmap v1317: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:55.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:54 smithi186 ceph-mon[31814]: pgmap v1317: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:54 smithi137 ceph-mon[31694]: pgmap v1317: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.336+0000 7ff6f1400640 1 -- 172.21.15.7:0/3113043139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 msgr2=0x7ff6ec110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.336+0000 7ff6f1400640 1 --2- 172.21.15.7:0/3113043139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec110f40 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009ca0 tx=0x7ff6e402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 -- 172.21.15.7:0/3113043139 shutdown_connections 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 --2- 172.21.15.7:0/3113043139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec104c50 0x7ff6ec108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 --2- 172.21.15.7:0/3113043139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec110f40 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 --2- 172.21.15.7:0/3113043139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ec1042a0 0x7ff6ec104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 -- 172.21.15.7:0/3113043139 >> 172.21.15.7:0/3113043139 conn(0x7ff6ec0ffae0 msgr2=0x7ff6ec101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 -- 172.21.15.7:0/3113043139 shutdown_connections 2024-04-23T15:32:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.337+0000 7ff6f1400640 1 -- 172.21.15.7:0/3113043139 wait complete. 2024-04-23T15:32:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 Processor -- start 2024-04-23T15:32:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 -- start start 2024-04-23T15:32:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec1042a0 0x7ff6ec1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ec19a640 0x7ff6ec19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1142e0 con 0x7ff6ec109370 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec114160 con 0x7ff6ec1042a0 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.338+0000 7ff6f1400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec114460 con 0x7ff6ec19a640 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec1a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35422/0 (socket says 172.21.15.7:35422) 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 -- 172.21.15.7:0/2112842048 learned_addr learned my addr 172.21.15.7:0/2112842048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec1042a0 0x7ff6ec1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ec19a640 0x7ff6ec19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 -- 172.21.15.7:0/2112842048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ec19a640 msgr2=0x7ff6ec19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ec19a640 0x7ff6ec19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 -- 172.21.15.7:0/2112842048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec1042a0 msgr2=0x7ff6ec1a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec1042a0 0x7ff6ec1a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6e3400640 1 -- 172.21.15.7:0/2112842048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec19b240 con 0x7ff6ec109370 2024-04-23T15:32:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.339+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec1042a0 0x7ff6ec1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.340+0000 7ff6e3400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec1a0ac0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400d770 tx=0x7ff6d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.340+0000 7ff6e9600640 1 -- 172.21.15.7:0/2112842048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4017070 con 0x7ff6ec109370 2024-04-23T15:32:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.340+0000 7ff6e9600640 1 -- 172.21.15.7:0/2112842048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d4009c30 con 0x7ff6ec109370 2024-04-23T15:32:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.340+0000 7ff6e9600640 1 -- 172.21.15.7:0/2112842048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400f620 con 0x7ff6ec109370 2024-04-23T15:32:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.340+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1a7320 con 0x7ff6ec109370 2024-04-23T15:32:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.340+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec1a7780 con 0x7ff6ec109370 2024-04-23T15:32:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 Processor -- start 2024-04-23T15:32:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 -- start start 2024-04-23T15:32:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6e9600640 1 -- 172.21.15.7:0/2112842048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff6d401a070 con 0x7ff6ec109370 2024-04-23T15:32:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdcb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdd6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5639bcd31900 con 0x5639bcdd65a0 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5639bccd7f20 con 0x5639bcdcbce0 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.344+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5639bcd2d8c0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35430/0 (socket says 172.21.15.7:35430) 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6e3400640 1 -- 172.21.15.7:0/3598027203 learned_addr learned my addr 172.21.15.7:0/3598027203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdcb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdd6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6e3400640 1 -- 172.21.15.7:0/3598027203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 msgr2=0x5639bcdcb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.345+0000 7ff6e3400640 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdcb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e3400640 1 -- 172.21.15.7:0/3598027203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 msgr2=0x5639bcdd6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e3400640 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdd6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e3400640 1 -- 172.21.15.7:0/3598027203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639bccfce10 con 0x5639bcdd65a0 2024-04-23T15:32:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdd6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e3400640 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd8990 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40cd890 tx=0x7ff6d40d82a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c48880a4a9e4c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e9600640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6d00a3d90 0x7ff6d00a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e9600640 1 -- 172.21.15.7:0/2112842048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7ff6d40d0610 con 0x7ff6ec109370 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.346+0000 7ff6e1200640 1 -- 172.21.15.7:0/3598027203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40df070 con 0x5639bcdd65a0 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.347+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6d00a3d90 0x7ff6d00a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.347+0000 7ff6e1200640 1 -- 172.21.15.7:0/3598027203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d4009de0 con 0x5639bcdd65a0 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.347+0000 7ff6e1200640 1 -- 172.21.15.7:0/3598027203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d409bce0 con 0x5639bcdd65a0 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.347+0000 7ff6f57d2740 1 -- 172.21.15.7:0/3598027203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 msgr2=0x5639bcdd8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.347+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd8990 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40cd890 tx=0x7ff6d40d82a0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.347+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6d00a3d90 0x7ff6d00a6250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009430 tx=0x7ff6e4009360 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 -- 172.21.15.7:0/3598027203 shutdown_connections 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdd6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd8990 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/3598027203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdcb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 -- 172.21.15.7:0/3598027203 >> 172.21.15.7:0/3598027203 conn(0x5639bcdc78d0 msgr2=0x5639bcdc7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 -- 172.21.15.7:0/3598027203 shutdown_connections 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 -- 172.21.15.7:0/3598027203 wait complete. 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 -- start start 2024-04-23T15:32:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.348+0000 7ff6f57d2740 1 Processor -- start 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcbce0 0x5639bcdd3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdd65a0 0x5639bcdd4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5639bcdd90e0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5639bcceb2c0 con 0x5639bcdd65a0 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5639bcdd9260 con 0x5639bcdcbce0 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6f57d2740 10 client.0 _ll_register_callbacks cb 0x5639bca43a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6ebe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35446/0 (socket says 172.21.15.7:35446) 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.349+0000 7ff6ebe00640 1 -- 172.21.15.7:0/1455243766 learned_addr learned my addr 172.21.15.7:0/1455243766 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdd65a0 0x5639bcdd4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6e3400640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcbce0 0x5639bcdd3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6ebe00640 1 -- 172.21.15.7:0/1455243766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcbce0 msgr2=0x5639bcdd3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcbce0 0x5639bcdd3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6ebe00640 1 -- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdd65a0 msgr2=0x5639bcdd4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdd65a0 0x5639bcdd4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6ebe00640 1 -- 172.21.15.7:0/1455243766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639bccfbfd0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd35a0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00be20 tx=0x7ff6dc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c316aee0800ec6ff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6d9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6d9600640 1 -- 172.21.15.7:0/1455243766 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc012650 con 0x5639bcdcb3c0 2024-04-23T15:32:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6d9600640 1 -- 172.21.15.7:0/1455243766 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7ff6dc0127f0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.350+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4009de0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6d9600640 1 -- 172.21.15.7:0/1455243766 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff6dc0129f0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 10 client.19017 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5639bca44210 con 0x5639bcdcb3c0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6d9600640 1 -- 172.21.15.7:0/1455243766 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d4009de0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6d9600640 1 -- 172.21.15.7:0/1455243766 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff6dc01bc80 con 0x5639bcdcb3c0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 10 client.19017 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 10 client.19017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 20 client.19017 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bcde67d0 0x5639bcde8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 4 client.19017 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.351+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639bcd3f320 con 0x5639bcde67d0 2024-04-23T15:32:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.352+0000 7ff6e3400640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bcde67d0 0x5639bcde8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.353+0000 7ff6e3400640 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bcde67d0 0x5639bcde8c00 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77708d859ef5fbd9 server_cookie=b6363a24eb7085ca in_seq=0 out_seq=0 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.353+0000 7ff6d9600640 10 client.19017 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6d9600640 1 -- 172.21.15.7:0/1455243766 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5639bcd3f320 con 0x5639bcde67d0 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6d9600640 10 client.19017 handle_command_reply: tid=0 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 client.19017 shutdown 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 msgr2=0x5639bcdd35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd35a0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00be20 tx=0x7ff6dc0117b0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 shutdown_connections 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bcde67d0 0x5639bcde8c00 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdd65a0 0x5639bcdd4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcbce0 0x5639bcdd3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/1455243766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd35a0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 >> 172.21.15.7:0/1455243766 conn(0x5639bcdc78d0 msgr2=0x5639bcdcd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6d9600640 0 client.19017 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 shutdown_connections 2024-04-23T15:32:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.355+0000 7ff6f57d2740 1 -- 172.21.15.7:0/1455243766 wait complete. 2024-04-23T15:32:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.356+0000 7ff6f57d2740 20 client.19017 trim_cache size 0 max 16384 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.377+0000 7ff6f57d2740 1 Processor -- start 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 -- start start 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdcdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1b14d0 con 0x5639bcdd65a0 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1b3010 con 0x5639bcdcbce0 2024-04-23T15:32:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1b1ba0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.378+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35462/0 (socket says 172.21.15.7:35462) 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4255437857 learned_addr learned my addr 172.21.15.7:0/4255437857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6e3400640 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdcdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4255437857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 msgr2=0x5639bcdd5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4255437857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 msgr2=0x5639bcdcdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdcdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4255437857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639bcb10620 con 0x5639bcdd65a0 2024-04-23T15:32:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6e3400640 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdcdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:32:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.379+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd3c70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4035000 tx=0x7ff6e4041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d74232cb1c0582 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.380+0000 7ff6dbe00640 1 -- 172.21.15.7:0/4255437857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40305c0 con 0x5639bcdd65a0 2024-04-23T15:32:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.380+0000 7ff6dbe00640 1 -- 172.21.15.7:0/4255437857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6e4036050 con 0x5639bcdd65a0 2024-04-23T15:32:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.380+0000 7ff6dbe00640 1 -- 172.21.15.7:0/4255437857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e402fa30 con 0x5639bcdd65a0 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4255437857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 msgr2=0x5639bcdd3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd3c70 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4035000 tx=0x7ff6e4041000 comp rx=0 tx=0).stop 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4255437857 shutdown_connections 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcdcdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcdd3c70 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4255437857 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdd5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4255437857 >> 172.21.15.7:0/4255437857 conn(0x5639bcdc78d0 msgr2=0x5639bcdd3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4255437857 shutdown_connections 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4255437857 wait complete. 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.381+0000 7ff6f57d2740 1 -- start start 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 Processor -- start 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdde5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcddeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcddb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1b2940 con 0x5639bcdd65a0 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1b2270 con 0x5639bcdcbce0 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1af4d0 con 0x5639bcdcb3c0 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.382+0000 7ff6f57d2740 10 client.0 _ll_register_callbacks cb 0x7ff6dc00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcddb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcddb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35466/0 (socket says 172.21.15.7:35466) 2024-04-23T15:32:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4288536545 learned_addr learned my addr 172.21.15.7:0/4288536545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6e3400640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcddeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdde5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4288536545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 msgr2=0x5639bcdde5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdde5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 msgr2=0x5639bcddeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcddeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.383+0000 7ff6f0a00640 1 -- 172.21.15.7:0/4288536545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639bcddbbb0 con 0x5639bcdd65a0 2024-04-23T15:32:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6f0a00640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcddb570 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff6e402a900 tx=0x7ff6e402fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae837813b89cac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:32:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6d9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6d9600640 1 -- 172.21.15.7:0/4288536545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40307d0 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6d9600640 1 -- 172.21.15.7:0/4288536545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 9467+0+0 (secure 0 0 0) 0x7ff6e4050040 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6e4036050 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6d9600640 1 -- 172.21.15.7:0/4288536545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff6e4030970 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6f57d2740 10 client.19023 fetch_fsmap learned FSMap version 32 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.384+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5639bce4d6e0 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6d9600640 1 -- 172.21.15.7:0/4288536545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6e4036050 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6d9600640 1 -- 172.21.15.7:0/4288536545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff6e4049950 con 0x5639bcdd65a0 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6f57d2740 10 client.19023 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6f57d2740 10 client.19023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6f57d2740 20 client.19023 populate_metadata read hostname 'smithi007' 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bce4de60 0x5639bce50280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:32:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6f57d2740 4 client.19023 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:32:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.385+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5639bcd39190 con 0x5639bce4de60 2024-04-23T15:32:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.386+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bce4de60 0x5639bce50280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:32:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.387+0000 7ff6ebe00640 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bce4de60 0x5639bce50280 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98c07b0d269de2a2 server_cookie=6007fbf2d83d9658 in_seq=0 out_seq=0 2024-04-23T15:32:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.387+0000 7ff6d9600640 10 client.19023 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.420+0000 7ff6d9600640 1 -- 172.21.15.7:0/4288536545 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5639bcd39190 con 0x5639bce4de60 2024-04-23T15:32:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.420+0000 7ff6d9600640 10 client.19023 handle_command_reply: tid=0 2024-04-23T15:32:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.420+0000 7ff6f57d2740 1 client.19023 shutdown 2024-04-23T15:32:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 msgr2=0x5639bcddb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcddb570 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff6e402a900 tx=0x7ff6e402fe70 comp rx=0 tx=0).stop 2024-04-23T15:32:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 shutdown_connections 2024-04-23T15:32:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5639bce4de60 0x5639bce50280 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5639bcdcbce0 0x5639bcddeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5639bcdd65a0 0x5639bcddb570 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 --2- 172.21.15.7:0/4288536545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5639bcdcb3c0 0x5639bcdde5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6d9600640 0 client.19023 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 >> 172.21.15.7:0/4288536545 conn(0x5639bcdc78d0 msgr2=0x5639bcdd3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 shutdown_connections 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 1 -- 172.21.15.7:0/4288536545 wait complete. 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.421+0000 7ff6f57d2740 20 client.19023 trim_cache size 0 max 16384 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:32:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6d00a3d90 msgr2=0x7ff6d00a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6d00a3d90 0x7ff6d00a6250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009430 tx=0x7ff6e4009360 comp rx=0 tx=0).stop 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 msgr2=0x7ff6ec1a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec1a0ac0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400d770 tx=0x7ff6d400dc30 comp rx=0 tx=0).stop 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 shutdown_connections 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6d00a3d90 0x7ff6d00a6250 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ec19a640 0x7ff6ec19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6ec109370 0x7ff6ec1a0ac0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 --2- 172.21.15.7:0/2112842048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6ec1042a0 0x7ff6ec1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:32:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 >> 172.21.15.7:0/2112842048 conn(0x7ff6ec0ffae0 msgr2=0x7ff6ec100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:32:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 shutdown_connections 2024-04-23T15:32:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:32:56.422+0000 7ff6f1400640 1 -- 172.21.15.7:0/2112842048 wait complete. 2024-04-23T15:32:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:56 smithi007 ceph-mon[27906]: pgmap v1318: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:57.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:56 smithi186 ceph-mon[31814]: pgmap v1318: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:56 smithi137 ceph-mon[31694]: pgmap v1318: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:32:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:32:58 smithi007 ceph-mon[27906]: pgmap v1319: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:32:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:32:58 smithi186 ceph-mon[31814]: pgmap v1319: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:32:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:32:58 smithi137 ceph-mon[31694]: pgmap v1319: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:33:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:00 smithi007 ceph-mon[27906]: pgmap v1320: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:33:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:00 smithi186 ceph-mon[31814]: pgmap v1320: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:33:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:00 smithi137 ceph-mon[31694]: pgmap v1320: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 11 op/s 2024-04-23T15:33:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:02 smithi007 ceph-mon[27906]: pgmap v1321: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:33:03.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:02 smithi186 ceph-mon[31814]: pgmap v1321: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:33:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:02 smithi137 ceph-mon[31694]: pgmap v1321: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.0 MiB/s wr, 35 op/s 2024-04-23T15:33:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:04 smithi007 ceph-mon[27906]: pgmap v1322: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 30 op/s 2024-04-23T15:33:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:04 smithi186 ceph-mon[31814]: pgmap v1322: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 30 op/s 2024-04-23T15:33:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:04 smithi137 ceph-mon[31694]: pgmap v1322: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 30 op/s 2024-04-23T15:33:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:06 smithi007 ceph-mon[27906]: pgmap v1323: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 30 op/s 2024-04-23T15:33:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:06 smithi186 ceph-mon[31814]: pgmap v1323: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 30 op/s 2024-04-23T15:33:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:06 smithi137 ceph-mon[31694]: pgmap v1323: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.0 MiB/s wr, 30 op/s 2024-04-23T15:33:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:08 smithi186 ceph-mon[31814]: pgmap v1324: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:33:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:08 smithi186 ceph-mon[31814]: osdmap e163: 12 total, 12 up, 12 in 2024-04-23T15:33:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:08 smithi137 ceph-mon[31694]: pgmap v1324: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:33:09.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:08 smithi137 ceph-mon[31694]: osdmap e163: 12 total, 12 up, 12 in 2024-04-23T15:33:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:08 smithi007 ceph-mon[27906]: pgmap v1324: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 35 op/s 2024-04-23T15:33:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:08 smithi007 ceph-mon[27906]: osdmap e163: 12 total, 12 up, 12 in 2024-04-23T15:33:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 -- 172.21.15.7:0/1739111066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0738109370 msgr2=0x7f0738110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 --2- 172.21.15.7:0/1739111066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0738109370 0x7f0738110f40 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f0730009ca0 tx=0x7f073002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 -- 172.21.15.7:0/1739111066 shutdown_connections 2024-04-23T15:33:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 --2- 172.21.15.7:0/1739111066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0738109370 0x7f0738110f40 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.576 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 --2- 172.21.15.7:0/1739111066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0738104c50 0x7f0738108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 --2- 172.21.15.7:0/1739111066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07381042a0 0x7f0738104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 -- 172.21.15.7:0/1739111066 >> 172.21.15.7:0/1739111066 conn(0x7f07380ffae0 msgr2=0x7f0738101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 -- 172.21.15.7:0/1739111066 shutdown_connections 2024-04-23T15:33:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.576+0000 7f0737e00640 1 -- 172.21.15.7:0/1739111066 wait complete. 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.577+0000 7f0737e00640 1 Processor -- start 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.577+0000 7f0737e00640 1 -- start start 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0737e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 0x7f07381a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0737e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0738109370 0x7f07381a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0737e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f073819a620 0x7f073819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0737e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07381142c0 con 0x7f07381042a0 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0737e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0738114140 con 0x7f073819a620 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0737e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0738114440 con 0x7f0738109370 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0736a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 0x7f07381a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0736a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 0x7f07381a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42516/0 (socket says 172.21.15.7:42516) 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f0736a00640 1 -- 172.21.15.7:0/2946493934 learned_addr learned my addr 172.21.15.7:0/2946493934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.578+0000 7f072fe00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0738109370 0x7f07381a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0737400640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f073819a620 0x7f073819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0736a00640 1 -- 172.21.15.7:0/2946493934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0738109370 msgr2=0x7f07381a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0736a00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0738109370 0x7f07381a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0736a00640 1 -- 172.21.15.7:0/2946493934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f073819a620 msgr2=0x7f073819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0736a00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f073819a620 0x7f073819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0736a00640 1 -- 172.21.15.7:0/2946493934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073819b140 con 0x7f07381042a0 2024-04-23T15:33:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f0736a00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 0x7f07381a0470 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f072800e9f0 tx=0x7f072800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.579+0000 7f073ca00640 1 -- 172.21.15.7:0/2946493934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072800cd80 con 0x7f07381042a0 2024-04-23T15:33:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.580+0000 7f073ca00640 1 -- 172.21.15.7:0/2946493934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07280108e0 con 0x7f07381042a0 2024-04-23T15:33:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.580+0000 7f073ca00640 1 -- 172.21.15.7:0/2946493934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728018920 con 0x7f07381042a0 2024-04-23T15:33:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.580+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073819b430 con 0x7f07381042a0 2024-04-23T15:33:09.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.580+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07381a76d0 con 0x7f07381042a0 2024-04-23T15:33:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.583+0000 7f073ca00640 1 -- 172.21.15.7:0/2946493934 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0728010a90 con 0x7f07381042a0 2024-04-23T15:33:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 Processor -- start 2024-04-23T15:33:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 -- start start 2024-04-23T15:33:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69ef87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f03060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f05990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f69e5e900 con 0x563f69f035a0 2024-04-23T15:33:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f69e04f20 con 0x563f69ef8ce0 2024-04-23T15:33:09.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.584+0000 7f0740be3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563f69e5a8c0 con 0x563f69ef83c0 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f072fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f05990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f072fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f05990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42528/0 (socket says 172.21.15.7:42528) 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f072fe00640 1 -- 172.21.15.7:0/332994896 learned_addr learned my addr 172.21.15.7:0/332994896 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f0737400640 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69ef87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f0736a00640 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f03060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f073ca00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f071c0a3d90 0x7f071c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f072fe00640 1 -- 172.21.15.7:0/332994896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 msgr2=0x563f69ef87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.585+0000 7f072fe00640 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69ef87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.586+0000 7f072fe00640 1 -- 172.21.15.7:0/332994896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 msgr2=0x563f69f03060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.586+0000 7f072fe00640 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f03060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.586+0000 7f072fe00640 1 -- 172.21.15.7:0/332994896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69e29e10 con 0x563f69f035a0 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.586+0000 7f073ca00640 1 -- 172.21.15.7:0/2946493934 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 9555+0+0 (secure 0 0 0) 0x7f07280d0fe0 con 0x7f07381042a0 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.586+0000 7f0737400640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f071c0a3d90 0x7f071c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.586+0000 7f072fe00640 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f05990 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0720009b30 tx=0x7f07200113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b70474282ec5094 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.587+0000 7f0727e00640 1 -- 172.21.15.7:0/332994896 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720011e10 con 0x563f69f035a0 2024-04-23T15:33:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.587+0000 7f0727e00640 1 -- 172.21.15.7:0/332994896 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0720016070 con 0x563f69f035a0 2024-04-23T15:33:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.587+0000 7f0727e00640 1 -- 172.21.15.7:0/332994896 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072001b470 con 0x563f69f035a0 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 -- 172.21.15.7:0/332994896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 msgr2=0x563f69f05990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f05990 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0720009b30 tx=0x7f07200113e0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0737400640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f071c0a3d90 0x7f071c0a6250 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0730031040 tx=0x7f07300095c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 -- 172.21.15.7:0/332994896 shutdown_connections 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f03060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f05990 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 --2- 172.21.15.7:0/332994896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69ef87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 -- 172.21.15.7:0/332994896 >> 172.21.15.7:0/332994896 conn(0x563f69ef48d0 msgr2=0x563f69ef4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 -- 172.21.15.7:0/332994896 shutdown_connections 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.588+0000 7f0740be3740 1 -- 172.21.15.7:0/332994896 wait complete. 2024-04-23T15:33:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.589+0000 7f0740be3740 1 -- start start 2024-04-23T15:33:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.589+0000 7f0740be3740 1 Processor -- start 2024-04-23T15:33:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.589+0000 7f0740be3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69f00540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0740be3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f00a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0740be3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69f00fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0740be3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f69f060e0 con 0x563f69ef83c0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0740be3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f69e182c0 con 0x563f69ef8ce0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0740be3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563f69f06260 con 0x563f69f035a0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0740be3740 10 client.0 _ll_register_callbacks cb 0x563f69b70a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69f00540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69f00540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42536/0 (socket says 172.21.15.7:42536) 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 -- 172.21.15.7:0/1891790678 learned_addr learned my addr 172.21.15.7:0/1891790678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0737400640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69f00fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f072fe00640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f00a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 -- 172.21.15.7:0/1891790678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 msgr2=0x563f69f00fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69f00fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 -- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 msgr2=0x563f69f00a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f00a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.590+0000 7f0736a00640 1 -- 172.21.15.7:0/1891790678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f69e28fd0 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0736a00640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69f00540 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f072809cb00 tx=0x7f072809b080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38de014e0ad8082d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0724c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0724c00640 1 -- 172.21.15.7:0/1891790678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072809d270 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0724c00640 1 -- 172.21.15.7:0/1891790678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 9555+0+0 (secure 0 0 0) 0x7f07280d30d0 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0720016070 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0724c00640 1 -- 172.21.15.7:0/1891790678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f07280d32d0 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0740be3740 10 client.19035 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.591+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f69b71210 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0724c00640 1 -- 172.21.15.7:0/1891790678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0720016070 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0724c00640 1 -- 172.21.15.7:0/1891790678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f07280b7080 con 0x563f69ef83c0 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0740be3740 10 client.19035 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0740be3740 10 client.19035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0740be3740 20 client.19035 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0740be3740 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f136c0 0x563f69f15ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0740be3740 4 client.19035 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:33:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.592+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f69e6c320 con 0x563f69f136c0 2024-04-23T15:33:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.593+0000 7f072fe00640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f136c0 0x563f69f15ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.594+0000 7f072fe00640 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f136c0 0x563f69f15ab0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a420ccd3ba4e252e server_cookie=c8bff8b6c3c6a6a9 in_seq=0 out_seq=0 2024-04-23T15:33:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.594+0000 7f0724c00640 10 client.19035 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0724c00640 1 -- 172.21.15.7:0/1891790678 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563f69e6c320 con 0x563f69f136c0 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0724c00640 10 client.19035 handle_command_reply: tid=0 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 client.19035 shutdown 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 msgr2=0x563f69f00540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69f00540 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f072809cb00 tx=0x7f072809b080 comp rx=0 tx=0).stop 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 shutdown_connections 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f136c0 0x563f69f15ab0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f00a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69f00fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 --2- 172.21.15.7:0/1891790678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69f00540 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 >> 172.21.15.7:0/1891790678 conn(0x563f69ef48d0 msgr2=0x563f69ef3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0724c00640 0 client.19035 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 shutdown_connections 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 1 -- 172.21.15.7:0/1891790678 wait complete. 2024-04-23T15:33:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.596+0000 7f0740be3740 20 client.19035 trim_cache size 0 max 16384 2024-04-23T15:33:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.616+0000 7f0740be3740 1 Processor -- start 2024-04-23T15:33:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 -- start start 2024-04-23T15:33:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69f02c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f0f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f1b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b15a0 con 0x563f69f035a0 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b30e0 con 0x563f69ef8ce0 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0740be3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b1c70 con 0x563f69ef83c0 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0737400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f1b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0737400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f1b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42552/0 (socket says 172.21.15.7:42552) 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.617+0000 7f0737400640 1 -- 172.21.15.7:0/3240411940 learned_addr learned my addr 172.21.15.7:0/3240411940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f072fe00640 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f0f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0736a00640 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69f02c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0737400640 1 -- 172.21.15.7:0/3240411940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 msgr2=0x563f69f02c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0737400640 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69f02c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0737400640 1 -- 172.21.15.7:0/3240411940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 msgr2=0x563f69f0f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0737400640 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f0f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0737400640 1 -- 172.21.15.7:0/3240411940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69ef8b10 con 0x563f69f035a0 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.618+0000 7f0737400640 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f1b350 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f0730035000 tx=0x7f0730040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4ebbbf050c501 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0727400640 1 -- 172.21.15.7:0/3240411940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730052070 con 0x563f69f035a0 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0727400640 1 -- 172.21.15.7:0/3240411940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0730036040 con 0x563f69f035a0 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0727400640 1 -- 172.21.15.7:0/3240411940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07300309e0 con 0x563f69f035a0 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 -- 172.21.15.7:0/3240411940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 msgr2=0x563f69f1b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f1b350 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f0730035000 tx=0x7f0730040000 comp rx=0 tx=0).stop 2024-04-23T15:33:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 -- 172.21.15.7:0/3240411940 shutdown_connections 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69f0f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69f035a0 0x563f69f1b350 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 --2- 172.21.15.7:0/3240411940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69ef83c0 0x563f69f02c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.619+0000 7f0740be3740 1 -- 172.21.15.7:0/3240411940 >> 172.21.15.7:0/3240411940 conn(0x563f69ef48d0 msgr2=0x563f69efb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.620+0000 7f0740be3740 1 -- 172.21.15.7:0/3240411940 shutdown_connections 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.620+0000 7f0740be3740 1 -- 172.21.15.7:0/3240411940 wait complete. 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.620+0000 7f0740be3740 1 -- start start 2024-04-23T15:33:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.620+0000 7f0740be3740 1 Processor -- start 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69efd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69efd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69efdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b2a10 con 0x563f69ef83c0 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b2340 con 0x563f69ef8ce0 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f07381af5a0 con 0x563f69f035a0 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0740be3740 10 client.0 _ll_register_callbacks cb 0x7f072800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0736a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69efd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0736a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69efd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42556/0 (socket says 172.21.15.7:42556) 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0736a00640 1 -- 172.21.15.7:0/1935030544 learned_addr learned my addr 172.21.15.7:0/1935030544 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f072fe00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69efd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0737400640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69efdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.621+0000 7f0736a00640 1 -- 172.21.15.7:0/1935030544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 msgr2=0x563f69efdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0736a00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69efdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0736a00640 1 -- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 msgr2=0x563f69efd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0736a00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69efd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0736a00640 1 -- 172.21.15.7:0/1935030544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f69c3d620 con 0x563f69ef83c0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f072fe00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69efd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0737400640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69efdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0736a00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69efd0f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f072809c870 tx=0x7f0728098cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dbe794bb15fb52 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0724c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0724c00640 1 -- 172.21.15.7:0/1935030544 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072809c4d0 con 0x563f69ef83c0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0724c00640 1 -- 172.21.15.7:0/1935030544 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 9555+0+0 (secure 0 0 0) 0x7f0728010640 con 0x563f69ef83c0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0730036040 con 0x563f69ef83c0 2024-04-23T15:33:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0724c00640 1 -- 172.21.15.7:0/1935030544 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f072809d270 con 0x563f69ef83c0 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0740be3740 10 client.19041 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.622+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563f69f79bb0 con 0x563f69ef83c0 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0724c00640 1 -- 172.21.15.7:0/1935030544 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0730036040 con 0x563f69ef83c0 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0724c00640 1 -- 172.21.15.7:0/1935030544 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f07280b7020 con 0x563f69ef83c0 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0740be3740 10 client.19041 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0740be3740 10 client.19041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0740be3740 20 client.19041 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0740be3740 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f7a150 0x563f69f7c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0740be3740 4 client.19041 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.623+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f69e66190 con 0x563f69f7a150 2024-04-23T15:33:09.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.624+0000 7f072fe00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f7a150 0x563f69f7c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.624+0000 7f072fe00640 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f7a150 0x563f69f7c570 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5c6be977efe0a10 server_cookie=8121cd229fc04379 in_seq=0 out_seq=0 2024-04-23T15:33:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.624+0000 7f0724c00640 10 client.19041 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.661+0000 7f0724c00640 1 -- 172.21.15.7:0/1935030544 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f69e66190 con 0x563f69f7a150 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.661+0000 7f0724c00640 10 client.19041 handle_command_reply: tid=0 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.661+0000 7f0740be3740 1 client.19041 shutdown 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 msgr2=0x563f69efd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69efd0f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f072809c870 tx=0x7f0728098cb0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 shutdown_connections 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563f69f7a150 0x563f69f7c570 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f69ef8ce0 0x563f69efd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f69f035a0 0x563f69efdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 --2- 172.21.15.7:0/1935030544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f69ef83c0 0x563f69efd0f0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0724c00640 0 client.19041 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 >> 172.21.15.7:0/1935030544 conn(0x563f69ef48d0 msgr2=0x563f69ef3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 shutdown_connections 2024-04-23T15:33:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 1 -- 172.21.15.7:0/1935030544 wait complete. 2024-04-23T15:33:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.662+0000 7f0740be3740 20 client.19041 trim_cache size 0 max 16384 2024-04-23T15:33:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:33:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:33:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:33:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f071c0a3d90 msgr2=0x7f071c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f071c0a3d90 0x7f071c0a6250 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0730031040 tx=0x7f07300095c0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 msgr2=0x7f07381a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 0x7f07381a0470 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f072800e9f0 tx=0x7f072800eeb0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 shutdown_connections 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f071c0a3d90 0x7f071c0a6250 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f073819a620 0x7f073819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0738109370 0x7f07381a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 --2- 172.21.15.7:0/2946493934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07381042a0 0x7f07381a0470 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.663+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 >> 172.21.15.7:0/2946493934 conn(0x7f07380ffae0 msgr2=0x7f0738100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.664+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 shutdown_connections 2024-04-23T15:33:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:09.664+0000 7f0737e00640 1 -- 172.21.15.7:0/2946493934 wait complete. 2024-04-23T15:33:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:10 smithi186 ceph-mon[31814]: pgmap v1326: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 35 op/s 2024-04-23T15:33:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:10 smithi137 ceph-mon[31694]: pgmap v1326: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 35 op/s 2024-04-23T15:33:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:10 smithi007 ceph-mon[27906]: pgmap v1326: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 35 op/s 2024-04-23T15:33:13.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:12 smithi186 ceph-mon[31814]: pgmap v1327: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:13.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:12 smithi137 ceph-mon[31694]: pgmap v1327: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:12 smithi007 ceph-mon[27906]: pgmap v1327: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:14.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:13 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:33:14.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:13 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:33:14.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:13 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:33:15.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:14 smithi007 ceph-mon[27906]: pgmap v1328: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:15.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:14 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:15.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:14 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:15.214 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:14 smithi186 ceph-mon[31814]: pgmap v1328: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:15.214 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:14 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:15.214 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:14 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:14 smithi137 ceph-mon[31694]: pgmap v1328: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:14 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:14 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:16 smithi137 ceph-mon[31694]: pgmap v1329: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:16 smithi137 ceph-mon[31694]: osdmap e164: 12 total, 12 up, 12 in 2024-04-23T15:33:17.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:16 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:16 smithi007 ceph-mon[27906]: pgmap v1329: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:16 smithi007 ceph-mon[27906]: osdmap e164: 12 total, 12 up, 12 in 2024-04-23T15:33:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:16 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:16 smithi186 ceph-mon[31814]: pgmap v1329: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 17 op/s 2024-04-23T15:33:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:16 smithi186 ceph-mon[31814]: osdmap e164: 12 total, 12 up, 12 in 2024-04-23T15:33:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:17.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:16 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:18.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:17 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:17 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:18.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:17 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: pgmap v1331: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:33:19.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:18 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: pgmap v1331: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:33:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:18 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: pgmap v1331: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 17 op/s 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:33:19.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:18 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:33:20.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:33:20.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:33:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:33:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:20 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:33:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:20 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:33:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:20 smithi137 ceph-mon[31694]: pgmap v1332: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.6 MiB/s wr, 17 op/s 2024-04-23T15:33:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:20 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:33:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:20 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:33:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:20 smithi007 ceph-mon[27906]: pgmap v1332: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.6 MiB/s wr, 17 op/s 2024-04-23T15:33:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:20 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:33:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:20 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:33:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:20 smithi186 ceph-mon[31814]: pgmap v1332: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.6 MiB/s wr, 17 op/s 2024-04-23T15:33:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 -- 172.21.15.7:0/4052568400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0528102a30 msgr2=0x7f0528106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 --2- 172.21.15.7:0/4052568400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0528102a30 0x7f0528106a70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f0510009900 tx=0x7f051002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 -- 172.21.15.7:0/4052568400 shutdown_connections 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 --2- 172.21.15.7:0/4052568400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528107150 0x7f052810ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 --2- 172.21.15.7:0/4052568400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0528102a30 0x7f0528106a70 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 --2- 172.21.15.7:0/4052568400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0528102080 0x7f0528102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 -- 172.21.15.7:0/4052568400 >> 172.21.15.7:0/4052568400 conn(0x7f05280fd980 msgr2=0x7f05280ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 -- 172.21.15.7:0/4052568400 shutdown_connections 2024-04-23T15:33:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.821+0000 7f052e600640 1 -- 172.21.15.7:0/4052568400 wait complete. 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.822+0000 7f052e600640 1 Processor -- start 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.822+0000 7f052e600640 1 -- start start 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528102080 0x7f05281a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052e600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0528107150 0x7f05281a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 0x7f052819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0528112070 con 0x7f052819a6a0 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052e600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111ef0 con 0x7f0528107150 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05281121f0 con 0x7f0528102080 2024-04-23T15:33:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 0x7f052819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 0x7f052819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49516/0 (socket says 172.21.15.7:49516) 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f052dc00640 1 -- 172.21.15.7:0/666091537 learned_addr learned my addr 172.21.15.7:0/666091537 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.823+0000 7f051fe00640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0528107150 0x7f05281a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052d200640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528102080 0x7f05281a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052dc00640 1 -- 172.21.15.7:0/666091537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528102080 msgr2=0x7f05281a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052dc00640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528102080 0x7f05281a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052dc00640 1 -- 172.21.15.7:0/666091537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0528107150 msgr2=0x7f05281a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052dc00640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0528107150 0x7f05281a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052dc00640 1 -- 172.21.15.7:0/666091537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052819b2a0 con 0x7f052819a6a0 2024-04-23T15:33:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052d200640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528102080 0x7f05281a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.824+0000 7f052dc00640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 0x7f052819ab20 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f052000d750 tx=0x7f052000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.825+0000 7f0526000640 1 -- 172.21.15.7:0/666091537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520017070 con 0x7f052819a6a0 2024-04-23T15:33:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.825+0000 7f0526000640 1 -- 172.21.15.7:0/666091537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05200054d0 con 0x7f052819a6a0 2024-04-23T15:33:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.825+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05281a7380 con 0x7f052819a6a0 2024-04-23T15:33:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.825+0000 7f0526000640 1 -- 172.21.15.7:0/666091537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520004c60 con 0x7f052819a6a0 2024-04-23T15:33:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.825+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05281a7730 con 0x7f052819a6a0 2024-04-23T15:33:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.829+0000 7f0532b8b740 1 Processor -- start 2024-04-23T15:33:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.829+0000 7f0526000640 1 -- 172.21.15.7:0/666091537 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0520004e00 con 0x7f052819a6a0 2024-04-23T15:33:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.829+0000 7f0532b8b740 1 -- start start 2024-04-23T15:33:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x5598383187a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838323060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838325990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f0532b8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55983827e900 con 0x559838318ce0 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f0532b8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559838224f20 con 0x5598383183c0 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f0532b8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55983827a8c0 con 0x5598383235a0 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f052d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838323060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f052d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838323060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49532/0 (socket says 172.21.15.7:49532) 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f052d200640 1 -- 172.21.15.7:0/1886320355 learned_addr learned my addr 172.21.15.7:0/1886320355 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.830+0000 7f051fe00640 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x5598383187a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f051fe00640 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838325990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f052d200640 1 -- 172.21.15.7:0/1886320355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 msgr2=0x559838325990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f052d200640 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838325990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f052d200640 1 -- 172.21.15.7:0/1886320355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 msgr2=0x5598383187a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f052d200640 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x5598383187a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f052d200640 1 -- 172.21.15.7:0/1886320355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559838249e10 con 0x559838318ce0 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f051fe00640 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x5598383187a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f052d200640 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838323060 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f05180103a0 tx=0x7f0518010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d220770f5a52c102 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f0526000640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f050c0a3d10 0x7f050c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.831+0000 7f051e000640 1 -- 172.21.15.7:0/1886320355 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518016070 con 0x559838318ce0 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.832+0000 7f0526000640 1 -- 172.21.15.7:0/666091537 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f05200d0540 con 0x7f052819a6a0 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.832+0000 7f051e000640 1 -- 172.21.15.7:0/1886320355 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0518012bc0 con 0x559838318ce0 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.832+0000 7f051e000640 1 -- 172.21.15.7:0/1886320355 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051801bc50 con 0x559838318ce0 2024-04-23T15:33:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.832+0000 7f051fe00640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f050c0a3d10 0x7f050c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.832+0000 7f0532b8b740 1 -- 172.21.15.7:0/1886320355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 msgr2=0x559838323060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.832+0000 7f0532b8b740 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838323060 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f05180103a0 tx=0x7f0518010860 comp rx=0 tx=0).stop 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f051fe00640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f050c0a3d10 0x7f050c0a61d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0510000c00 tx=0x7f0510005780 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 -- 172.21.15.7:0/1886320355 shutdown_connections 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838325990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838323060 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 --2- 172.21.15.7:0/1886320355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x5598383187a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 -- 172.21.15.7:0/1886320355 >> 172.21.15.7:0/1886320355 conn(0x5598383148d0 msgr2=0x559838314cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 -- 172.21.15.7:0/1886320355 shutdown_connections 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 -- 172.21.15.7:0/1886320355 wait complete. 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.833+0000 7f0532b8b740 1 -- start start 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 Processor -- start 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383183c0 0x5598383204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x5598383209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383235a0 0x559838320f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559838326140 con 0x559838318ce0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5598382382c0 con 0x5598383235a0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5598383262c0 con 0x5598383183c0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.834+0000 7f0532b8b740 10 client.0 _ll_register_callbacks cb 0x559837f90a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x5598383209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x5598383209e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49540/0 (socket says 172.21.15.7:49540) 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 -- 172.21.15.7:0/2882262043 learned_addr learned my addr 172.21.15.7:0/2882262043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f052d200640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383183c0 0x5598383204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f052dc00640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383235a0 0x559838320f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 -- 172.21.15.7:0/2882262043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383183c0 msgr2=0x5598383204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383183c0 0x5598383204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 -- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383235a0 msgr2=0x559838320f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383235a0 0x559838320f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.835+0000 7f051fe00640 1 -- 172.21.15.7:0/2882262043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559838248fd0 con 0x559838318ce0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.836+0000 7f051fe00640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x5598383209e0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f0510033000 tx=0x7f0510031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5703a5e284f23ad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.836+0000 7f0516a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.836+0000 7f0516a00640 1 -- 172.21.15.7:0/2882262043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510051020 con 0x559838318ce0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.836+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0518012bc0 con 0x559838318ce0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.836+0000 7f0516a00640 1 -- 172.21.15.7:0/2882262043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f0510003a00 con 0x559838318ce0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0516a00640 1 -- 172.21.15.7:0/2882262043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f051005c050 con 0x559838318ce0 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 10 client.19053 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559837f91210 con 0x559838318ce0 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0516a00640 1 -- 172.21.15.7:0/2882262043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0518012bc0 con 0x559838318ce0 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0516a00640 1 -- 172.21.15.7:0/2882262043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f051003dcb0 con 0x559838318ce0 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 10 client.19053 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 10 client.19053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 20 client.19053 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559838333780 0x559838335bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 4 client.19053 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:33:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.837+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55983828c320 con 0x559838333780 2024-04-23T15:33:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.838+0000 7f052d200640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559838333780 0x559838335bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.839+0000 7f052d200640 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559838333780 0x559838335bd0 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4541d7bbb66e9c56 server_cookie=f33913bf839e7f7a in_seq=0 out_seq=0 2024-04-23T15:33:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.839+0000 7f0516a00640 10 client.19053 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0516a00640 1 -- 172.21.15.7:0/2882262043 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55983828c320 con 0x559838333780 2024-04-23T15:33:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0516a00640 10 client.19053 handle_command_reply: tid=0 2024-04-23T15:33:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 client.19053 shutdown 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 msgr2=0x5598383209e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x5598383209e0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f0510033000 tx=0x7f0510031400 comp rx=0 tx=0).stop 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 shutdown_connections 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559838333780 0x559838335bd0 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383235a0 0x559838320f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x5598383209e0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 --2- 172.21.15.7:0/2882262043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383183c0 0x5598383204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0516a00640 0 client.19053 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 >> 172.21.15.7:0/2882262043 conn(0x5598383148d0 msgr2=0x55983831a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.841+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 shutdown_connections 2024-04-23T15:33:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.842+0000 7f0532b8b740 1 -- 172.21.15.7:0/2882262043 wait complete. 2024-04-23T15:33:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.842+0000 7f0532b8b740 20 client.19053 trim_cache size 0 max 16384 2024-04-23T15:33:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.859+0000 7f0532b8b740 1 Processor -- start 2024-04-23T15:33:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 -- start start 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838322bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x55983832f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838313910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b1420 con 0x559838318ce0 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b2f60 con 0x5598383183c0 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f0532b8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b1af0 con 0x5598383235a0 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f051fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x55983832f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f051fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x55983832f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49542/0 (socket says 172.21.15.7:49542) 2024-04-23T15:33:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.860+0000 7f051fe00640 1 -- 172.21.15.7:0/778017144 learned_addr learned my addr 172.21.15.7:0/778017144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f052d200640 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838322bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f052dc00640 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838313910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051fe00640 1 -- 172.21.15.7:0/778017144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 msgr2=0x559838313910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051fe00640 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838313910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051fe00640 1 -- 172.21.15.7:0/778017144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 msgr2=0x559838322bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051fe00640 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838322bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051fe00640 1 -- 172.21.15.7:0/778017144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559838319790 con 0x559838318ce0 2024-04-23T15:33:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051fe00640 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x55983832f140 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f051002a910 tx=0x7f0510009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ec47fbe72425ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051d600640 1 -- 172.21.15.7:0/778017144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510065070 con 0x559838318ce0 2024-04-23T15:33:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051d600640 1 -- 172.21.15.7:0/778017144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f051004d710 con 0x559838318ce0 2024-04-23T15:33:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.861+0000 7f051d600640 1 -- 172.21.15.7:0/778017144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510051070 con 0x559838318ce0 2024-04-23T15:33:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.862+0000 7f0532b8b740 1 -- 172.21.15.7:0/778017144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 msgr2=0x55983832f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.862+0000 7f0532b8b740 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x55983832f140 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f051002a910 tx=0x7f0510009830 comp rx=0 tx=0).stop 2024-04-23T15:33:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 -- 172.21.15.7:0/778017144 shutdown_connections 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838313910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x55983832f140 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 --2- 172.21.15.7:0/778017144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838322bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 -- 172.21.15.7:0/778017144 >> 172.21.15.7:0/778017144 conn(0x5598383148d0 msgr2=0x559838313200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 -- 172.21.15.7:0/778017144 shutdown_connections 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 -- 172.21.15.7:0/778017144 wait complete. 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 -- start start 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.863+0000 7f0532b8b740 1 Processor -- start 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838327430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838327970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838398d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b2890 con 0x559838318ce0 2024-04-23T15:33:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b21c0 con 0x5598383183c0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05281af420 con 0x5598383235a0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f0532b8b740 10 client.0 _ll_register_callbacks cb 0x7f05100314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f051fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838327970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f051fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838327970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60158/0 (socket says 172.21.15.7:60158) 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f051fe00640 1 -- 172.21.15.7:0/401375547 learned_addr learned my addr 172.21.15.7:0/401375547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.864+0000 7f052d200640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838327430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f052dc00640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838398d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f051fe00640 1 -- 172.21.15.7:0/401375547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 msgr2=0x559838398d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f051fe00640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838398d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f051fe00640 1 -- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 msgr2=0x559838327430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f051fe00640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838327430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f051fe00640 1 -- 172.21.15.7:0/401375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55983805d620 con 0x559838318ce0 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f052d200640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838327430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f051fe00640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838327970 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f051002a430 tx=0x7f051004db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b0af598cd0eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.865+0000 7f0516a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0516a00640 1 -- 172.21.15.7:0/401375547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510065040 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0516a00640 1 -- 172.21.15.7:0/401375547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f0510003800 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051004d710 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0516a00640 1 -- 172.21.15.7:0/401375547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0510076050 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0532b8b740 10 client.19059 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55983839a250 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.866+0000 7f0516a00640 1 -- 172.21.15.7:0/401375547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f051004d710 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0516a00640 1 -- 172.21.15.7:0/401375547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0510071030 con 0x559838318ce0 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0532b8b740 10 client.19059 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0532b8b740 10 client.19059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0532b8b740 20 client.19059 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0532b8b740 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55983839a8b0 0x55983839ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0532b8b740 4 client.19059 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559838286190 con 0x55983839a8b0 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.867+0000 7f052d200640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55983839a8b0 0x55983839ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.868+0000 7f052d200640 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55983839a8b0 0x55983839ccd0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e8e7514db1950b8 server_cookie=be44f0d7c72ef6cc in_seq=0 out_seq=0 2024-04-23T15:33:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.868+0000 7f0516a00640 10 client.19059 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.905+0000 7f0516a00640 1 -- 172.21.15.7:0/401375547 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559838286190 con 0x55983839a8b0 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.905+0000 7f0516a00640 10 client.19059 handle_command_reply: tid=0 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.905+0000 7f0532b8b740 1 client.19059 shutdown 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 msgr2=0x559838327970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838327970 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f051002a430 tx=0x7f051004db70 comp rx=0 tx=0).stop 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 shutdown_connections 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55983839a8b0 0x55983839ccd0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5598383235a0 0x559838398d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559838318ce0 0x559838327970 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 --2- 172.21.15.7:0/401375547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5598383183c0 0x559838327430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 >> 172.21.15.7:0/401375547 conn(0x5598383148d0 msgr2=0x55983831a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0516a00640 0 client.19059 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 shutdown_connections 2024-04-23T15:33:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.906+0000 7f0532b8b740 1 -- 172.21.15.7:0/401375547 wait complete. 2024-04-23T15:33:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:33:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:33:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:33:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:33:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.907+0000 7f0532b8b740 20 client.19059 trim_cache size 0 max 16384 2024-04-23T15:33:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.907+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f050c0a3d10 msgr2=0x7f050c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.907+0000 7f052e600640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f050c0a3d10 0x7f050c0a61d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0510000c00 tx=0x7f0510005780 comp rx=0 tx=0).stop 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.907+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 msgr2=0x7f052819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.907+0000 7f052e600640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 0x7f052819ab20 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f052000d750 tx=0x7f052000dc10 comp rx=0 tx=0).stop 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 shutdown_connections 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f050c0a3d10 0x7f050c0a61d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0528107150 0x7f05281a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052819a6a0 0x7f052819ab20 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 --2- 172.21.15.7:0/666091537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0528102080 0x7f05281a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 >> 172.21.15.7:0/666091537 conn(0x7f05280fd980 msgr2=0x7f05280ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 shutdown_connections 2024-04-23T15:33:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:22.908+0000 7f052e600640 1 -- 172.21.15.7:0/666091537 wait complete. 2024-04-23T15:33:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:22 smithi137 ceph-mon[31694]: pgmap v1333: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:22 smithi007 ceph-mon[27906]: pgmap v1333: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:22 smithi186 ceph-mon[31814]: pgmap v1333: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:24 smithi007 ceph-mon[27906]: pgmap v1334: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:24 smithi186 ceph-mon[31814]: pgmap v1334: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:24 smithi137 ceph-mon[31694]: pgmap v1334: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:26 smithi007 ceph-mon[27906]: pgmap v1335: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:26 smithi186 ceph-mon[31814]: pgmap v1335: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:26 smithi137 ceph-mon[31694]: pgmap v1335: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 12 op/s 2024-04-23T15:33:29.221 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:28 smithi137 ceph-mon[31694]: pgmap v1336: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.7 MiB/s wr, 20 op/s 2024-04-23T15:33:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:28 smithi007 ceph-mon[27906]: pgmap v1336: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.7 MiB/s wr, 20 op/s 2024-04-23T15:33:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:28 smithi186 ceph-mon[31814]: pgmap v1336: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.7 MiB/s wr, 20 op/s 2024-04-23T15:33:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:30 smithi007 ceph-mon[27906]: pgmap v1337: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:33:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:30 smithi186 ceph-mon[31814]: pgmap v1337: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:33:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:30 smithi137 ceph-mon[31694]: pgmap v1337: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:33:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:32 smithi007 ceph-mon[27906]: pgmap v1338: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:33:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:32 smithi186 ceph-mon[31814]: pgmap v1338: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:33:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:32 smithi137 ceph-mon[31694]: pgmap v1338: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:33:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:34 smithi007 ceph-mon[27906]: pgmap v1339: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:33:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:34 smithi186 ceph-mon[31814]: pgmap v1339: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:33:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:34 smithi137 ceph-mon[31694]: pgmap v1339: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:33:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.076+0000 7f681fe00640 1 -- 172.21.15.7:0/2763214354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 msgr2=0x7f682010bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.076+0000 7f681fe00640 1 --2- 172.21.15.7:0/2763214354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f682010bdc0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f6808009900 tx=0x7f680802a480 comp rx=0 tx=0).stop 2024-04-23T15:33:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 -- 172.21.15.7:0/2763214354 shutdown_connections 2024-04-23T15:33:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 --2- 172.21.15.7:0/2763214354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f682010c3e0 0x7f682010e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 --2- 172.21.15.7:0/2763214354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f682010bdc0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 --2- 172.21.15.7:0/2763214354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6820102fc0 0x7f68201033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 -- 172.21.15.7:0/2763214354 >> 172.21.15.7:0/2763214354 conn(0x7f68200fc820 msgr2=0x7f68200fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 -- 172.21.15.7:0/2763214354 shutdown_connections 2024-04-23T15:33:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.077+0000 7f681fe00640 1 -- 172.21.15.7:0/2763214354 wait complete. 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.078+0000 7f681fe00640 1 Processor -- start 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.078+0000 7f681fe00640 1 -- start start 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6820102fc0 0x7f68201a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f68201a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f682010c3e0 0x7f682019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6820112070 con 0x7f68201038e0 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6820111ef0 con 0x7f6820102fc0 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f68201121f0 con 0x7f682010c3e0 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f6817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f68201a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f6817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f68201a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39416/0 (socket says 172.21.15.7:39416) 2024-04-23T15:33:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f6817e00640 1 -- 172.21.15.7:0/4206648480 learned_addr learned my addr 172.21.15.7:0/4206648480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681ea00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6820102fc0 0x7f68201a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817e00640 1 -- 172.21.15.7:0/4206648480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f682010c3e0 msgr2=0x7f682019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.079+0000 7f681f400640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f682010c3e0 0x7f682019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817e00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f682010c3e0 0x7f682019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817e00640 1 -- 172.21.15.7:0/4206648480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6820102fc0 msgr2=0x7f68201a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817e00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6820102fc0 0x7f68201a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817e00640 1 -- 172.21.15.7:0/4206648480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682019af30 con 0x7f68201038e0 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f681f400640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f682010c3e0 0x7f682019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f681ea00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6820102fc0 0x7f68201a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817e00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f68201a0af0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f6808005940 tx=0x7f68080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817400640 1 -- 172.21.15.7:0/4206648480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680803f030 con 0x7f68201038e0 2024-04-23T15:33:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817400640 1 -- 172.21.15.7:0/4206648480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6808003cb0 con 0x7f68201038e0 2024-04-23T15:33:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682019b1c0 con 0x7f68201038e0 2024-04-23T15:33:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.080+0000 7f6817400640 1 -- 172.21.15.7:0/4206648480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808035070 con 0x7f68201038e0 2024-04-23T15:33:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.081+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68201a7350 con 0x7f68201038e0 2024-04-23T15:33:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.084+0000 7f6828383740 1 Processor -- start 2024-04-23T15:33:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.084+0000 7f6828383740 1 -- start start 2024-04-23T15:33:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.084+0000 7f6817400640 1 -- 172.21.15.7:0/4206648480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6808042030 con 0x7f68201038e0 2024-04-23T15:33:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6828383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306b3c0 0x560b9306b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6828383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306bce0 0x560b93076060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6828383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b93078990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6828383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560b92fd1900 con 0x560b930765a0 2024-04-23T15:33:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6828383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560b92f77f20 con 0x560b9306bce0 2024-04-23T15:33:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6828383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560b92fcd8c0 con 0x560b9306b3c0 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b93078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b93078990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39418/0 (socket says 172.21.15.7:39418) 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f6817e00640 1 -- 172.21.15.7:0/1429639399 learned_addr learned my addr 172.21.15.7:0/1429639399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f681f400640 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306b3c0 0x560b9306b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.085+0000 7f681ea00640 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306bce0 0x560b93076060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817e00640 1 -- 172.21.15.7:0/1429639399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306b3c0 msgr2=0x560b9306b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817e00640 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306b3c0 0x560b9306b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817e00640 1 -- 172.21.15.7:0/1429639399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306bce0 msgr2=0x560b93076060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817e00640 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306bce0 0x560b93076060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817e00640 1 -- 172.21.15.7:0/1429639399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b92f9ce10 con 0x560b930765a0 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f681ea00640 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306bce0 0x560b93076060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817e00640 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b93078990 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f68080ee740 tx=0x7f68080f76a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0caabb13074ece1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.086+0000 7f6817400640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f68040a3d10 0x7f68040a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.087+0000 7f680f400640 1 -- 172.21.15.7:0/1429639399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68080b92c0 con 0x560b930765a0 2024-04-23T15:33:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.087+0000 7f680f400640 1 -- 172.21.15.7:0/1429639399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68080fe030 con 0x560b930765a0 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.087+0000 7f680f400640 1 -- 172.21.15.7:0/1429639399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68080bc470 con 0x560b930765a0 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.087+0000 7f6817400640 1 -- 172.21.15.7:0/4206648480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f68080f1490 con 0x7f68201038e0 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.087+0000 7f681f400640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f68040a3d10 0x7f68040a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 -- 172.21.15.7:0/1429639399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 msgr2=0x560b93078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b93078990 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f68080ee740 tx=0x7f68080f76a0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f681f400640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f68040a3d10 0x7f68040a61d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6818005fd0 tx=0x7f6818008370 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 -- 172.21.15.7:0/1429639399 shutdown_connections 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306bce0 0x560b93076060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b93078990 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 --2- 172.21.15.7:0/1429639399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306b3c0 0x560b9306b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 -- 172.21.15.7:0/1429639399 >> 172.21.15.7:0/1429639399 conn(0x560b930678d0 msgr2=0x560b93067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 -- 172.21.15.7:0/1429639399 shutdown_connections 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 -- 172.21.15.7:0/1429639399 wait complete. 2024-04-23T15:33:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.088+0000 7f6828383740 1 -- start start 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 Processor -- start 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 0x560b93073a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b930765a0 0x560b93073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560b93078f90 con 0x560b9306bce0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560b92f8b2c0 con 0x560b9306b3c0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560b93079110 con 0x560b930765a0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6828383740 10 client.0 _ll_register_callbacks cb 0x560b92ce3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.089+0000 7f6817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 0x560b93073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 0x560b93073a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39430/0 (socket says 172.21.15.7:39430) 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 -- 172.21.15.7:0/317946646 learned_addr learned my addr 172.21.15.7:0/317946646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f681ea00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f681f400640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b930765a0 0x560b93073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 -- 172.21.15.7:0/317946646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b930765a0 msgr2=0x560b93073fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b930765a0 0x560b93073fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 -- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 msgr2=0x560b93073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 -- 172.21.15.7:0/317946646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b92f9bfd0 con 0x560b9306bce0 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f681ea00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6817e00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 0x560b93073a60 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f68080c5760 tx=0x7f6808005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620eeed97c8c0433 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6803e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.090+0000 7f6803e00640 1 -- 172.21.15.7:0/317946646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808049030 con 0x560b9306bce0 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6803e00640 1 -- 172.21.15.7:0/317946646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f68080f7160 con 0x560b9306bce0 2024-04-23T15:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68080fe030 con 0x560b9306bce0 2024-04-23T15:33:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6803e00640 1 -- 172.21.15.7:0/317946646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f68080bc7a0 con 0x560b9306bce0 2024-04-23T15:33:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6828383740 10 client.19071 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560b92ce4210 con 0x560b9306bce0 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6803e00640 1 -- 172.21.15.7:0/317946646 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68080fe030 con 0x560b9306bce0 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.091+0000 7f6803e00640 1 -- 172.21.15.7:0/317946646 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f68080bc470 con 0x560b9306bce0 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f6828383740 10 client.19071 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f6828383740 10 client.19071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f6828383740 20 client.19071 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f6828383740 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b93086280 0x560b93088670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f6828383740 4 client.19071 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b92fdf320 con 0x560b93086280 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.092+0000 7f681ea00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b93086280 0x560b93088670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.093+0000 7f681ea00640 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b93086280 0x560b93088670 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d87e6d5146960d server_cookie=d74cb69afda18723 in_seq=0 out_seq=0 2024-04-23T15:33:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.093+0000 7f6803e00640 10 client.19071 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6803e00640 1 -- 172.21.15.7:0/317946646 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560b92fdf320 con 0x560b93086280 2024-04-23T15:33:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6803e00640 10 client.19071 handle_command_reply: tid=0 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 client.19071 shutdown 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 msgr2=0x560b93073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 0x560b93073a60 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f68080c5760 tx=0x7f6808005b50 comp rx=0 tx=0).stop 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 shutdown_connections 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b93086280 0x560b93088670 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b930765a0 0x560b93073fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b9306bce0 0x560b93073a60 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 --2- 172.21.15.7:0/317946646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6803e00640 0 client.19071 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.095+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 >> 172.21.15.7:0/317946646 conn(0x560b930678d0 msgr2=0x560b9306d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.096+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 shutdown_connections 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.096+0000 7f6828383740 1 -- 172.21.15.7:0/317946646 wait complete. 2024-04-23T15:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.096+0000 7f6828383740 20 client.19071 trim_cache size 0 max 16384 2024-04-23T15:33:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 Processor -- start 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 -- start start 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93081d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b9306dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68201b1490 con 0x560b930765a0 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68201b2fd0 con 0x560b9306b3c0 2024-04-23T15:33:36.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.116+0000 7f6828383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f68201b1b60 con 0x560b9306bce0 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b9306dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b9306dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39440/0 (socket says 172.21.15.7:39440) 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 -- 172.21.15.7:0/1407644147 learned_addr learned my addr 172.21.15.7:0/1407644147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681ea00640 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93081d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f6817e00640 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 -- 172.21.15.7:0/1407644147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 msgr2=0x560b93073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 -- 172.21.15.7:0/1407644147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 msgr2=0x560b93081d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93081d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f681f400640 1 -- 172.21.15.7:0/1407644147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b93078d00 con 0x560b930765a0 2024-04-23T15:33:36.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.117+0000 7f6817e00640 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:36.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.118+0000 7f681f400640 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b9306dd80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f68180107e0 tx=0x7f6818012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b511f54c87c9fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:36.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.118+0000 7f680ea00640 1 -- 172.21.15.7:0/1407644147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681801d940 con 0x560b930765a0 2024-04-23T15:33:36.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.118+0000 7f680ea00640 1 -- 172.21.15.7:0/1407644147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f681801e430 con 0x560b930765a0 2024-04-23T15:33:36.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.118+0000 7f680ea00640 1 -- 172.21.15.7:0/1407644147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818026610 con 0x560b930765a0 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 -- 172.21.15.7:0/1407644147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 msgr2=0x560b9306dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b9306dd80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f68180107e0 tx=0x7f6818012000 comp rx=0 tx=0).stop 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 -- 172.21.15.7:0/1407644147 shutdown_connections 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b9306dd80 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 --2- 172.21.15.7:0/1407644147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b93081d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 -- 172.21.15.7:0/1407644147 >> 172.21.15.7:0/1407644147 conn(0x560b930678d0 msgr2=0x560b93074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 -- 172.21.15.7:0/1407644147 shutdown_connections 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.119+0000 7f6828383740 1 -- 172.21.15.7:0/1407644147 wait complete. 2024-04-23T15:33:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.120+0000 7f6828383740 1 -- start start 2024-04-23T15:33:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.120+0000 7f6828383740 1 Processor -- start 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b930709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b930eb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68201b2900 con 0x560b930765a0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68201b2230 con 0x560b9306b3c0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f68201af490 con 0x560b9306bce0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6828383740 10 client.0 _ll_register_callbacks cb 0x7f68080f7460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f681f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b930eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f681f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b930eb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39456/0 (socket says 172.21.15.7:39456) 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f681f400640 1 -- 172.21.15.7:0/1495197908 learned_addr learned my addr 172.21.15.7:0/1495197908 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f6817e00640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.121+0000 7f681ea00640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b930709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f681f400640 1 -- 172.21.15.7:0/1495197908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 msgr2=0x560b93070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f681f400640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f681f400640 1 -- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 msgr2=0x560b930709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f681f400640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b930709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f681f400640 1 -- 172.21.15.7:0/1495197908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b92db0620 con 0x560b930765a0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f681f400640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b930eb690 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f681801eeb0 tx=0x7f681801eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae94ebf32bcc4d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f6803e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.122+0000 7f6803e00640 1 -- 172.21.15.7:0/1495197908 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818034020 con 0x560b930765a0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6803e00640 1 -- 172.21.15.7:0/1495197908 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f6818004b40 con 0x560b930765a0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f681801e430 con 0x560b930765a0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6803e00640 1 -- 172.21.15.7:0/1495197908 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f681803f050 con 0x560b930765a0 2024-04-23T15:33:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6828383740 10 client.19077 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560b930ecd60 con 0x560b930765a0 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6803e00640 1 -- 172.21.15.7:0/1495197908 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f681801e430 con 0x560b930765a0 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6803e00640 1 -- 172.21.15.7:0/1495197908 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f681801dc80 con 0x560b930765a0 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6828383740 10 client.19077 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.123+0000 7f6828383740 10 client.19077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.124+0000 7f6828383740 20 client.19077 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.124+0000 7f6828383740 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b930ed470 0x560b930ef890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.124+0000 7f6828383740 4 client.19077 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.124+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b92fd9190 con 0x560b930ed470 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.124+0000 7f681ea00640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b930ed470 0x560b930ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.125+0000 7f681ea00640 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b930ed470 0x560b930ef890 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773a48cf4a1cfd06 server_cookie=79c8c8fef2e65be0 in_seq=0 out_seq=0 2024-04-23T15:33:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.125+0000 7f6803e00640 10 client.19077 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6803e00640 1 -- 172.21.15.7:0/1495197908 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b92fd9190 con 0x560b930ed470 2024-04-23T15:33:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6803e00640 10 client.19077 handle_command_reply: tid=0 2024-04-23T15:33:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 client.19077 shutdown 2024-04-23T15:33:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 msgr2=0x560b930eb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b930eb690 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f681801eeb0 tx=0x7f681801eee0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 shutdown_connections 2024-04-23T15:33:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560b930ed470 0x560b930ef890 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b930765a0 0x560b930eb690 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b9306bce0 0x560b93070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6803e00640 0 client.19077 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 --2- 172.21.15.7:0/1495197908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560b9306b3c0 0x560b930709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.167+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 >> 172.21.15.7:0/1495197908 conn(0x560b930678d0 msgr2=0x560b930755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.168+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 shutdown_connections 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.168+0000 7f6828383740 1 -- 172.21.15.7:0/1495197908 wait complete. 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.168+0000 7f6828383740 20 client.19077 trim_cache size 0 max 16384 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:33:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f68040a3d10 msgr2=0x7f68040a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f68040a3d10 0x7f68040a61d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6818005fd0 tx=0x7f6818008370 comp rx=0 tx=0).stop 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 msgr2=0x7f68201a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f68201a0af0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f6808005940 tx=0x7f68080042f0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 shutdown_connections 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f68040a3d10 0x7f68040a61d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f682010c3e0 0x7f682019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68201038e0 0x7f68201a0af0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 --2- 172.21.15.7:0/4206648480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6820102fc0 0x7f68201a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.169+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 >> 172.21.15.7:0/4206648480 conn(0x7f68200fc820 msgr2=0x7f6820101de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.170+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 shutdown_connections 2024-04-23T15:33:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:36.170+0000 7f681fe00640 1 -- 172.21.15.7:0/4206648480 wait complete. 2024-04-23T15:33:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:36 smithi007 ceph-mon[27906]: pgmap v1340: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:33:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:36 smithi186 ceph-mon[31814]: pgmap v1340: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:33:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:36 smithi137 ceph-mon[31694]: pgmap v1340: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 14 op/s 2024-04-23T15:33:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:38 smithi007 ceph-mon[27906]: pgmap v1341: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 22 op/s 2024-04-23T15:33:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:38 smithi186 ceph-mon[31814]: pgmap v1341: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 22 op/s 2024-04-23T15:33:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:38 smithi137 ceph-mon[31694]: pgmap v1341: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 22 op/s 2024-04-23T15:33:41.291 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:40 smithi137 ceph-mon[31694]: pgmap v1342: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:40 smithi007 ceph-mon[27906]: pgmap v1342: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:40 smithi186 ceph-mon[31814]: pgmap v1342: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:42 smithi007 ceph-mon[27906]: pgmap v1343: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:33:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:42 smithi186 ceph-mon[31814]: pgmap v1343: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:33:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:42 smithi137 ceph-mon[31694]: pgmap v1343: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:33:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:44 smithi007 ceph-mon[27906]: pgmap v1344: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:44 smithi186 ceph-mon[31814]: pgmap v1344: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:44 smithi137 ceph-mon[31694]: pgmap v1344: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:46 smithi007 ceph-mon[27906]: pgmap v1345: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:46 smithi186 ceph-mon[31814]: pgmap v1345: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:46 smithi137 ceph-mon[31694]: pgmap v1345: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 -- 172.21.15.7:0/1904882926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 msgr2=0x7f3a84074780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 --2- 172.21.15.7:0/1904882926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a84074780 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009900 tx=0x7f3a7402a480 comp rx=0 tx=0).stop 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 -- 172.21.15.7:0/1904882926 shutdown_connections 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 --2- 172.21.15.7:0/1904882926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a84112e10 0x7f3a84115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 --2- 172.21.15.7:0/1904882926 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a84074cc0 0x7f3a841128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 --2- 172.21.15.7:0/1904882926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a84074780 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 -- 172.21.15.7:0/1904882926 >> 172.21.15.7:0/1904882926 conn(0x7f3a840fd950 msgr2=0x7f3a840ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 -- 172.21.15.7:0/1904882926 shutdown_connections 2024-04-23T15:33:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.326+0000 7f3a83200640 1 -- 172.21.15.7:0/1904882926 wait complete. 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.327+0000 7f3a83200640 1 Processor -- start 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 -- start start 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a841a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a84074cc0 0x7f3a841a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a84112e10 0x7f3a8419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84118700 con 0x7f3a840743a0 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84118580 con 0x7f3a84112e10 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a83200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84118880 con 0x7f3a84074cc0 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a81e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a841a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.328+0000 7f3a81e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a841a48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59078/0 (socket says 172.21.15.7:59078) 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 -- 172.21.15.7:0/3816575951 learned_addr learned my addr 172.21.15.7:0/3816575951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a79400640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a84074cc0 0x7f3a841a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a82800640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a84112e10 0x7f3a8419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 -- 172.21.15.7:0/3816575951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a84074cc0 msgr2=0x7f3a841a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a84074cc0 0x7f3a841a4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 -- 172.21.15.7:0/3816575951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a84112e10 msgr2=0x7f3a8419eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a84112e10 0x7f3a8419eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 -- 172.21.15.7:0/3816575951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8419f220 con 0x7f3a840743a0 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.329+0000 7f3a81e00640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a841a48f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3a74005ab0 tx=0x7f3a74003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.330+0000 7f3a7b400640 1 -- 172.21.15.7:0/3816575951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7403f070 con 0x7f3a840743a0 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.330+0000 7f3a7b400640 1 -- 172.21.15.7:0/3816575951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a74031d60 con 0x7f3a840743a0 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.330+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8419f4b0 con 0x7f3a840743a0 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.330+0000 7f3a7b400640 1 -- 172.21.15.7:0/3816575951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74035030 con 0x7f3a840743a0 2024-04-23T15:33:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.330+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a841ab7b0 con 0x7f3a840743a0 2024-04-23T15:33:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:48 smithi007 ceph-mon[27906]: pgmap v1346: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.334+0000 7f3a7b400640 1 -- 172.21.15.7:0/3816575951 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3a74042070 con 0x7f3a840743a0 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.334+0000 7f3a8c00b740 1 Processor -- start 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.334+0000 7f3a8c00b740 1 -- start start 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c54f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c55a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d5c4b5900 con 0x560d5c54f3c0 2024-04-23T15:33:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560d5c45bf20 con 0x560d5c55a5a0 2024-04-23T15:33:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560d5c4b18c0 con 0x560d5c54fce0 2024-04-23T15:33:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c54f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c54f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59086/0 (socket says 172.21.15.7:59086) 2024-04-23T15:33:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a82800640 1 -- 172.21.15.7:0/2665031262 learned_addr learned my addr 172.21.15.7:0/2665031262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a79400640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a82800640 1 -- 172.21.15.7:0/2665031262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 msgr2=0x560d5c55a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.335+0000 7f3a81e00640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c55a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a82800640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c55a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a82800640 1 -- 172.21.15.7:0/2665031262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 msgr2=0x560d5c55c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a82800640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a82800640 1 -- 172.21.15.7:0/2665031262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d5c480e10 con 0x560d5c54f3c0 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a79400640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a81e00640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c55a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a7b400640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a640a3d90 0x7f3a640a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a82800640 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c54f7a0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009e30 tx=0x7f3a7c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312f095749612f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a7b400640 1 -- 172.21.15.7:0/3816575951 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f3a740f1540 con 0x7f3a840743a0 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a81e00640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a640a3d90 0x7f3a640a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.336+0000 7f3a73400640 1 -- 172.21.15.7:0/2665031262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c016070 con 0x560d5c54f3c0 2024-04-23T15:33:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.337+0000 7f3a73400640 1 -- 172.21.15.7:0/2665031262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a7c004d20 con 0x560d5c54f3c0 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.337+0000 7f3a73400640 1 -- 172.21.15.7:0/2665031262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c012650 con 0x560d5c54f3c0 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.337+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2665031262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 msgr2=0x560d5c54f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.337+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c54f7a0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009e30 tx=0x7f3a7c010740 comp rx=0 tx=0).stop 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.337+0000 7f3a81e00640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a640a3d90 0x7f3a640a6250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560d5c550960 tx=0x7f3a7402a480 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2665031262 shutdown_connections 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c55a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2665031262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c54f7a0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2665031262 >> 172.21.15.7:0/2665031262 conn(0x560d5c54b8d0 msgr2=0x560d5c54bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2665031262 shutdown_connections 2024-04-23T15:33:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2665031262 wait complete. 2024-04-23T15:33:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 -- start start 2024-04-23T15:33:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.338+0000 7f3a8c00b740 1 Processor -- start 2024-04-23T15:33:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54f3c0 0x560d5c5575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 0x560d5c557af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c558030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d5c55d0e0 con 0x560d5c54fce0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560d5c46f2c0 con 0x560d5c54f3c0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x560d5c55d260 con 0x560d5c55a5a0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a8c00b740 10 client.0 _ll_register_callbacks cb 0x560d5c1c7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a79400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 0x560d5c557af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a79400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 0x560d5c557af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59090/0 (socket says 172.21.15.7:59090) 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a79400640 1 -- 172.21.15.7:0/2349580665 learned_addr learned my addr 172.21.15.7:0/2349580665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.339+0000 7f3a82800640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54f3c0 0x560d5c5575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a82800640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c558030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a79400640 1 -- 172.21.15.7:0/2349580665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 msgr2=0x560d5c558030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a79400640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c558030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a79400640 1 -- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54f3c0 msgr2=0x560d5c5575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a79400640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54f3c0 0x560d5c5575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a79400640 1 -- 172.21.15.7:0/2349580665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d5c47ffd0 con 0x560d5c54fce0 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a82800640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54f3c0 0x560d5c5575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:33:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a79400640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 0x560d5c557af0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00bdb0 tx=0x7f3a6c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342ed3a30bd85c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a6be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a6be00640 1 -- 172.21.15.7:0/2349580665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c005220 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a7c004d20 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.340+0000 7f3a6be00640 1 -- 172.21.15.7:0/2349580665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f3a6c0053c0 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.341+0000 7f3a6be00640 1 -- 172.21.15.7:0/2349580665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a6c0055c0 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.341+0000 7f3a8c00b740 10 client.19089 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.341+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560d5c1c8210 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.341+0000 7f3a6be00640 1 -- 172.21.15.7:0/2349580665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a7c004d20 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.341+0000 7f3a6be00640 1 -- 172.21.15.7:0/2349580665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3a6c01b920 con 0x560d5c54fce0 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.341+0000 7f3a8c00b740 10 client.19089 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.342+0000 7f3a8c00b740 10 client.19089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.342+0000 7f3a8c00b740 20 client.19089 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.342+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c56a690 0x560d5c56caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.342+0000 7f3a8c00b740 4 client.19089 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:33:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.342+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d5c4c3320 con 0x560d5c56a690 2024-04-23T15:33:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.342+0000 7f3a82800640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c56a690 0x560d5c56caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.343+0000 7f3a82800640 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c56a690 0x560d5c56caa0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e93bcae50432d24 server_cookie=7e573c8729329f82 in_seq=0 out_seq=0 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.343+0000 7f3a6be00640 10 client.19089 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.345+0000 7f3a6be00640 1 -- 172.21.15.7:0/2349580665 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560d5c4c3320 con 0x560d5c56a690 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.345+0000 7f3a6be00640 10 client.19089 handle_command_reply: tid=0 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.345+0000 7f3a8c00b740 1 client.19089 shutdown 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.345+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 msgr2=0x560d5c557af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.345+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 0x560d5c557af0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00bdb0 tx=0x7f3a6c0117b0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 shutdown_connections 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c56a690 0x560d5c56caa0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c558030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54fce0 0x560d5c557af0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2349580665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54f3c0 0x560d5c5575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a6be00640 0 client.19089 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 >> 172.21.15.7:0/2349580665 conn(0x560d5c54b8d0 msgr2=0x560d5c551600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 shutdown_connections 2024-04-23T15:33:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2349580665 wait complete. 2024-04-23T15:33:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.346+0000 7f3a8c00b740 20 client.19089 trim_cache size 0 max 16384 2024-04-23T15:33:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:48 smithi186 ceph-mon[31814]: pgmap v1346: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:33:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.365+0000 7f3a8c00b740 1 Processor -- start 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.365+0000 7f3a8c00b740 1 -- start start 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c566090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54fce0 0x560d5c54b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c5723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b58f0 con 0x560d5c54f3c0 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b7430 con 0x560d5c54fce0 2024-04-23T15:33:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b5fc0 con 0x560d5c55a5a0 2024-04-23T15:33:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c566090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c566090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59094/0 (socket says 172.21.15.7:59094) 2024-04-23T15:33:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 -- 172.21.15.7:0/287181849 learned_addr learned my addr 172.21.15.7:0/287181849 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 -- 172.21.15.7:0/287181849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 msgr2=0x560d5c5723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c5723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 -- 172.21.15.7:0/287181849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54fce0 msgr2=0x560d5c54b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54fce0 0x560d5c54b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.366+0000 7f3a82800640 1 -- 172.21.15.7:0/287181849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d5c556560 con 0x560d5c54f3c0 2024-04-23T15:33:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.367+0000 7f3a82800640 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c566090 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c005a40 tx=0x7f3a7c005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7271c8d44eaa8890 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.367+0000 7f3a72a00640 1 -- 172.21.15.7:0/287181849 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c016040 con 0x560d5c54f3c0 2024-04-23T15:33:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.367+0000 7f3a72a00640 1 -- 172.21.15.7:0/287181849 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a7c005bd0 con 0x560d5c54f3c0 2024-04-23T15:33:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.367+0000 7f3a72a00640 1 -- 172.21.15.7:0/287181849 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c012450 con 0x560d5c54f3c0 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 -- 172.21.15.7:0/287181849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 msgr2=0x560d5c566090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c566090 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c005a40 tx=0x7f3a7c005a70 comp rx=0 tx=0).stop 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 -- 172.21.15.7:0/287181849 shutdown_connections 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c54fce0 0x560d5c54b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c55a5a0 0x560d5c5723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/287181849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c566090 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 -- 172.21.15.7:0/287181849 >> 172.21.15.7:0/287181849 conn(0x560d5c54b8d0 msgr2=0x560d5c557e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 -- 172.21.15.7:0/287181849 shutdown_connections 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.368+0000 7f3a8c00b740 1 -- 172.21.15.7:0/287181849 wait complete. 2024-04-23T15:33:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 -- start start 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 Processor -- start 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c5625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c562ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b6d60 con 0x560d5c54f3c0 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b6690 con 0x560d5c55a5a0 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b38f0 con 0x560d5c54fce0 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.369+0000 7f3a8c00b740 10 client.0 _ll_register_callbacks cb 0x7f3a6c00b970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c5625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c5625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59108/0 (socket says 172.21.15.7:59108) 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 -- 172.21.15.7:0/2069607023 learned_addr learned my addr 172.21.15.7:0/2069607023 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a79400640 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c562ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 -- 172.21.15.7:0/2069607023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 msgr2=0x560d5c562ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c562ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 -- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 msgr2=0x560d5c55f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:33:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 -- 172.21.15.7:0/2069607023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d5c55cd00 con 0x560d5c54f3c0 2024-04-23T15:33:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.370+0000 7f3a82800640 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c5625a0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c010780 tx=0x7f3a7c027820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf90fbb930f95f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:33:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a6be00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a6be00640 1 -- 172.21.15.7:0/2069607023 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c033020 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a7c005bd0 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a6be00640 1 -- 172.21.15.7:0/2069607023 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f3a7c004f00 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a6be00640 1 -- 172.21.15.7:0/2069607023 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a7c03e050 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a8c00b740 10 client.19095 fetch_fsmap learned FSMap version 32 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.371+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560d5c294620 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a6be00640 1 -- 172.21.15.7:0/2069607023 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a7c005bd0 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a6be00640 1 -- 172.21.15.7:0/2069607023 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3a7c02e070 con 0x560d5c54f3c0 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a8c00b740 10 client.19095 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a8c00b740 10 client.19095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a8c00b740 20 client.19095 populate_metadata read hostname 'smithi007' 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c5d1700 0x560d5c5d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a8c00b740 4 client.19095 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:33:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.372+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d5c4bd190 con 0x560d5c5d1700 2024-04-23T15:33:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.373+0000 7f3a79400640 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c5d1700 0x560d5c5d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:33:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.373+0000 7f3a79400640 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c5d1700 0x560d5c5d3af0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c266c492c84f21be server_cookie=864ccebfa0021728 in_seq=0 out_seq=0 2024-04-23T15:33:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.373+0000 7f3a6be00640 10 client.19095 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:48 smithi137 ceph-mon[31694]: pgmap v1346: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a6be00640 1 -- 172.21.15.7:0/2069607023 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d5c4bd190 con 0x560d5c5d1700 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a6be00640 10 client.19095 handle_command_reply: tid=0 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 client.19095 shutdown 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 msgr2=0x560d5c5625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c5625a0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c010780 tx=0x7f3a7c027820 comp rx=0 tx=0).stop 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 shutdown_connections 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x560d5c5d1700 0x560d5c5d3af0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d5c55a5a0 0x560d5c55f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d5c54fce0 0x560d5c562ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 --2- 172.21.15.7:0/2069607023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d5c54f3c0 0x560d5c5625a0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a6be00640 0 client.19095 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.417+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 >> 172.21.15.7:0/2069607023 conn(0x560d5c54b8d0 msgr2=0x560d5c557570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.418+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 shutdown_connections 2024-04-23T15:33:49.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.418+0000 7f3a8c00b740 1 -- 172.21.15.7:0/2069607023 wait complete. 2024-04-23T15:33:49.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.418+0000 7f3a8c00b740 20 client.19095 trim_cache size 0 max 16384 2024-04-23T15:33:49.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:33:49.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:33:49.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:33:49.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a640a3d90 msgr2=0x7f3a640a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a640a3d90 0x7f3a640a6250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560d5c550960 tx=0x7f3a7402a480 comp rx=0 tx=0).stop 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 msgr2=0x7f3a841a48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a841a48f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3a74005ab0 tx=0x7f3a74003cd0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 shutdown_connections 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a640a3d90 0x7f3a640a6250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a84112e10 0x7f3a8419eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a84074cc0 0x7f3a841a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 --2- 172.21.15.7:0/3816575951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a840743a0 0x7f3a841a48f0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 >> 172.21.15.7:0/3816575951 conn(0x7f3a840fd950 msgr2=0x7f3a840fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:33:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 shutdown_connections 2024-04-23T15:33:49.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:33:49.419+0000 7f3a83200640 1 -- 172.21.15.7:0/3816575951 wait complete. 2024-04-23T15:33:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:51 smithi007 ceph-mon[27906]: pgmap v1347: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:33:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:51 smithi186 ceph-mon[31814]: pgmap v1347: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:33:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:51 smithi137 ceph-mon[31694]: pgmap v1347: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:33:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:53 smithi007 ceph-mon[27906]: pgmap v1348: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:33:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:53 smithi186 ceph-mon[31814]: pgmap v1348: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:33:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:53 smithi137 ceph-mon[31694]: pgmap v1348: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:33:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:55 smithi007 ceph-mon[27906]: pgmap v1349: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:33:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:55 smithi186 ceph-mon[31814]: pgmap v1349: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:33:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:55 smithi137 ceph-mon[31694]: pgmap v1349: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:33:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:57 smithi007 ceph-mon[27906]: pgmap v1350: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:33:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:57 smithi186 ceph-mon[31814]: pgmap v1350: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:33:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:57 smithi137 ceph-mon[31694]: pgmap v1350: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:33:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:33:59 smithi007 ceph-mon[27906]: pgmap v1351: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:33:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:33:59 smithi186 ceph-mon[31814]: pgmap v1351: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:33:59.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:33:59 smithi137 ceph-mon[31694]: pgmap v1351: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-04-23T15:34:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:01 smithi007 ceph-mon[27906]: pgmap v1352: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:01 smithi186 ceph-mon[31814]: pgmap v1352: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:01.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:01 smithi137 ceph-mon[31694]: pgmap v1352: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 -- 172.21.15.7:0/3275085294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d8104c50 msgr2=0x7f78d8108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 --2- 172.21.15.7:0/3275085294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d8104c50 0x7f78d8108c90 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009900 tx=0x7f78c402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 -- 172.21.15.7:0/3275085294 shutdown_connections 2024-04-23T15:34:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 --2- 172.21.15.7:0/3275085294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78d8109370 0x7f78d8110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 --2- 172.21.15.7:0/3275085294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d8104c50 0x7f78d8108c90 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 --2- 172.21.15.7:0/3275085294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d81042a0 0x7f78d8104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 -- 172.21.15.7:0/3275085294 >> 172.21.15.7:0/3275085294 conn(0x7f78d80ffae0 msgr2=0x7f78d8101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 -- 172.21.15.7:0/3275085294 shutdown_connections 2024-04-23T15:34:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.594+0000 7f78df000640 1 -- 172.21.15.7:0/3275085294 wait complete. 2024-04-23T15:34:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.595+0000 7f78df000640 1 Processor -- start 2024-04-23T15:34:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.595+0000 7f78df000640 1 -- start start 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78df000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 0x7f78d81a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78df000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d8109370 0x7f78d81a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78df000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78d819a6c0 0x7f78d819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78df000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8114300 con 0x7f78d81042a0 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78df000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8114180 con 0x7f78d8109370 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78df000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8114480 con 0x7f78d819a6c0 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78ddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 0x7f78d81a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78ddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 0x7f78d81a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47400/0 (socket says 172.21.15.7:47400) 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.596+0000 7f78ddc00640 1 -- 172.21.15.7:0/1121564477 learned_addr learned my addr 172.21.15.7:0/1121564477 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78dd200640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d8109370 0x7f78d81a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78de600640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78d819a6c0 0x7f78d819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78ddc00640 1 -- 172.21.15.7:0/1121564477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78d819a6c0 msgr2=0x7f78d819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78ddc00640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78d819a6c0 0x7f78d819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78ddc00640 1 -- 172.21.15.7:0/1121564477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d8109370 msgr2=0x7f78d81a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78ddc00640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d8109370 0x7f78d81a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78ddc00640 1 -- 172.21.15.7:0/1121564477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d819b2c0 con 0x7f78d81042a0 2024-04-23T15:34:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78ddc00640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 0x7f78d81a05b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00eab0 tx=0x7f78cc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.597+0000 7f78d6000640 1 -- 172.21.15.7:0/1121564477 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00ce40 con 0x7f78d81042a0 2024-04-23T15:34:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.598+0000 7f78d6000640 1 -- 172.21.15.7:0/1121564477 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78cc011920 con 0x7f78d81042a0 2024-04-23T15:34:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.598+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d81a7350 con 0x7f78d81042a0 2024-04-23T15:34:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.598+0000 7f78d6000640 1 -- 172.21.15.7:0/1121564477 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc010a00 con 0x7f78d81042a0 2024-04-23T15:34:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.598+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d81a7750 con 0x7f78d81042a0 2024-04-23T15:34:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.601+0000 7f78e35ba740 1 Processor -- start 2024-04-23T15:34:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 -- start start 2024-04-23T15:34:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5bc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55beed522900 con 0x55beed5bcce0 2024-04-23T15:34:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55beed4c8f20 con 0x55beed5c75a0 2024-04-23T15:34:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78e35ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55beed51e8c0 con 0x55beed5bc3c0 2024-04-23T15:34:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.602+0000 7f78d6000640 1 -- 172.21.15.7:0/1121564477 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f78cc011ad0 con 0x7f78d81042a0 2024-04-23T15:34:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78de600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5bc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78ddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78dd200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78de600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5bc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:58470/0 (socket says 172.21.15.7:58470) 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78de600640 1 -- 172.21.15.7:0/597578980 learned_addr learned my addr 172.21.15.7:0/597578980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78ddc00640 1 -- 172.21.15.7:0/597578980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 msgr2=0x55beed5bc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78ddc00640 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5bc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78ddc00640 1 -- 172.21.15.7:0/597578980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 msgr2=0x55beed5c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78ddc00640 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.603+0000 7f78ddc00640 1 -- 172.21.15.7:0/597578980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beed4ede10 con 0x55beed5bcce0 2024-04-23T15:34:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78ddc00640 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5c7060 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0ce5e0 tx=0x7f78cc0d9540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fb3d54570561db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78caa00640 1 -- 172.21.15.7:0/597578980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0e4070 con 0x55beed5bcce0 2024-04-23T15:34:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78d6000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78c00a3d90 0x7f78c00a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78caa00640 1 -- 172.21.15.7:0/597578980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78cc0d32d0 con 0x55beed5bcce0 2024-04-23T15:34:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78caa00640 1 -- 172.21.15.7:0/597578980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0df770 con 0x55beed5bcce0 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78d6000640 1 -- 172.21.15.7:0/1121564477 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f78cc0d12a0 con 0x7f78d81042a0 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.604+0000 7f78de600640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78c00a3d90 0x7f78c00a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 -- 172.21.15.7:0/597578980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 msgr2=0x55beed5c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5c7060 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0ce5e0 tx=0x7f78cc0d9540 comp rx=0 tx=0).stop 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 -- 172.21.15.7:0/597578980 shutdown_connections 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5c7060 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 --2- 172.21.15.7:0/597578980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5bc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 -- 172.21.15.7:0/597578980 >> 172.21.15.7:0/597578980 conn(0x55beed5b88d0 msgr2=0x55beed5b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 -- 172.21.15.7:0/597578980 shutdown_connections 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78de600640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78c00a3d90 0x7f78c00a6250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f78d000bce0 tx=0x7f78d000b4d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.605+0000 7f78e35ba740 1 -- 172.21.15.7:0/597578980 wait complete. 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.606+0000 7f78e35ba740 1 -- start start 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.606+0000 7f78e35ba740 1 Processor -- start 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bcce0 0x55beed5c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 0x55beed5c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55beed5ca140 con 0x55beed5c75a0 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55beed4dc2c0 con 0x55beed5bcce0 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55beed5ca2c0 con 0x55beed5bc3c0 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78e35ba740 10 client.0 _ll_register_callbacks cb 0x55beed234a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78de600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 0x55beed5c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78de600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 0x55beed5c4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47408/0 (socket says 172.21.15.7:47408) 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78de600640 1 -- 172.21.15.7:0/243907981 learned_addr learned my addr 172.21.15.7:0/243907981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78ddc00640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.607+0000 7f78dd200640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bcce0 0x55beed5c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78de600640 1 -- 172.21.15.7:0/243907981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 msgr2=0x55beed5c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78de600640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78de600640 1 -- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bcce0 msgr2=0x55beed5c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78de600640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bcce0 0x55beed5c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78de600640 1 -- 172.21.15.7:0/243907981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beed4ecfd0 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78de600640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 0x55beed5c4fa0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f78d0013fd0 tx=0x7f78d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7eeaf12eebea61 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.608+0000 7f78bf400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78bf400640 1 -- 172.21.15.7:0/243907981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0005220 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78bf400640 1 -- 172.21.15.7:0/243907981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f78d00053c0 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78cc0d32d0 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78bf400640 1 -- 172.21.15.7:0/243907981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f78d0031050 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78e35ba740 10 client.19107 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55beed235210 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.609+0000 7f78bf400640 1 -- 172.21.15.7:0/243907981 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78cc0d32d0 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78bf400640 1 -- 172.21.15.7:0/243907981 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f78d001e700 con 0x55beed5c75a0 2024-04-23T15:34:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78e35ba740 10 client.19107 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78e35ba740 10 client.19107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78e35ba740 20 client.19107 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78e35ba740 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed5d7730 0x55beed5d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78e35ba740 4 client.19107 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.610+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beed530320 con 0x55beed5d7730 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.611+0000 7f78ddc00640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed5d7730 0x55beed5d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.611+0000 7f78ddc00640 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed5d7730 0x55beed5d9b20 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a66a18b46568890 server_cookie=c4e5998267ef4008 in_seq=0 out_seq=0 2024-04-23T15:34:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.611+0000 7f78bf400640 10 client.19107 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.613+0000 7f78bf400640 1 -- 172.21.15.7:0/243907981 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55beed530320 con 0x55beed5d7730 2024-04-23T15:34:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.613+0000 7f78bf400640 10 client.19107 handle_command_reply: tid=0 2024-04-23T15:34:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.613+0000 7f78e35ba740 1 client.19107 shutdown 2024-04-23T15:34:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 msgr2=0x55beed5c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 0x55beed5c4fa0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f78d0013fd0 tx=0x7f78d00046c0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 shutdown_connections 2024-04-23T15:34:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed5d7730 0x55beed5d9b20 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bcce0 0x55beed5c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5c75a0 0x55beed5c4fa0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 --2- 172.21.15.7:0/243907981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bc3c0 0x55beed5c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78bf400640 0 client.19107 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 >> 172.21.15.7:0/243907981 conn(0x55beed5b88d0 msgr2=0x55beed5b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 shutdown_connections 2024-04-23T15:34:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 1 -- 172.21.15.7:0/243907981 wait complete. 2024-04-23T15:34:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.614+0000 7f78e35ba740 20 client.19107 trim_cache size 0 max 16384 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.638+0000 7f78e35ba740 1 Processor -- start 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 -- start start 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 0x55beed5d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bcce0 0x55beed5bed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81b14b0 con 0x55beed5bc3c0 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81b2ff0 con 0x55beed5c75a0 2024-04-23T15:34:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78e35ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81b1b80 con 0x55beed5bcce0 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78ddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 0x55beed5d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78ddc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 0x55beed5d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47418/0 (socket says 172.21.15.7:47418) 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.639+0000 7f78ddc00640 1 -- 172.21.15.7:0/2128093015 learned_addr learned my addr 172.21.15.7:0/2128093015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78de600640 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78dd200640 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bcce0 0x55beed5bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78ddc00640 1 -- 172.21.15.7:0/2128093015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bcce0 msgr2=0x55beed5bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78ddc00640 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bcce0 0x55beed5bed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78ddc00640 1 -- 172.21.15.7:0/2128093015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 msgr2=0x55beed5df410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78ddc00640 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5df410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78ddc00640 1 -- 172.21.15.7:0/2128093015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beed5bcb10 con 0x55beed5bc3c0 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.640+0000 7f78ddc00640 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 0x55beed5d3110 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f78cc099290 tx=0x7f78cc0d1e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05ddb8ae27c0738 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78ca000640 1 -- 172.21.15.7:0/2128093015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0d4e60 con 0x55beed5bc3c0 2024-04-23T15:34:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78ca000640 1 -- 172.21.15.7:0/2128093015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78cc0d4b20 con 0x55beed5bc3c0 2024-04-23T15:34:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78ca000640 1 -- 172.21.15.7:0/2128093015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc011e00 con 0x55beed5bc3c0 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 -- 172.21.15.7:0/2128093015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 msgr2=0x55beed5d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 0x55beed5d3110 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f78cc099290 tx=0x7f78cc0d1e70 comp rx=0 tx=0).stop 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 -- 172.21.15.7:0/2128093015 shutdown_connections 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5c75a0 0x55beed5df410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5bcce0 0x55beed5bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 --2- 172.21.15.7:0/2128093015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bc3c0 0x55beed5d3110 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.641+0000 7f78e35ba740 1 -- 172.21.15.7:0/2128093015 >> 172.21.15.7:0/2128093015 conn(0x55beed5b88d0 msgr2=0x55beed5b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.642+0000 7f78e35ba740 1 -- 172.21.15.7:0/2128093015 shutdown_connections 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.642+0000 7f78e35ba740 1 -- 172.21.15.7:0/2128093015 wait complete. 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.642+0000 7f78e35ba740 1 -- start start 2024-04-23T15:34:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.642+0000 7f78e35ba740 1 Processor -- start 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bc3c0 0x55beed5cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5c75a0 0x55beed5cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81b2920 con 0x55beed5bcce0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81b2250 con 0x55beed5bc3c0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81af4b0 con 0x55beed5c75a0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78e35ba740 10 client.0 _ll_register_callbacks cb 0x7f78d000b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78dd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78dd200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47422/0 (socket says 172.21.15.7:47422) 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78dd200640 1 -- 172.21.15.7:0/4280490503 learned_addr learned my addr 172.21.15.7:0/4280490503 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.643+0000 7f78ddc00640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bc3c0 0x55beed5cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78de600640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5c75a0 0x55beed5cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78dd200640 1 -- 172.21.15.7:0/4280490503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5c75a0 msgr2=0x55beed5cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78dd200640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5c75a0 0x55beed5cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78dd200640 1 -- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bc3c0 msgr2=0x55beed5cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78dd200640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bc3c0 0x55beed5cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78dd200640 1 -- 172.21.15.7:0/4280490503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beed301620 con 0x55beed5bcce0 2024-04-23T15:34:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78ddc00640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bc3c0 0x55beed5cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:34:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78dd200640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5cb690 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f78d806b460 tx=0x7f78c4005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84926fd74191acad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78bf400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.644+0000 7f78bf400640 1 -- 172.21.15.7:0/4280490503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4035040 con 0x55beed5bcce0 2024-04-23T15:34:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78bf400640 1 -- 172.21.15.7:0/4280490503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(164..164 src has 1..164) ==== 9467+0+0 (secure 0 0 0) 0x7f78c40046c0 con 0x55beed5bcce0 2024-04-23T15:34:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78cc0d4b20 con 0x55beed5bcce0 2024-04-23T15:34:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78bf400640 1 -- 172.21.15.7:0/4280490503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f78c40048c0 con 0x55beed5bcce0 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78e35ba740 10 client.19113 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55beed63def0 con 0x55beed5bcce0 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78bf400640 1 -- 172.21.15.7:0/4280490503 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78cc0d4b20 con 0x55beed5bcce0 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78bf400640 1 -- 172.21.15.7:0/4280490503 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f78c40314a0 con 0x55beed5bcce0 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.645+0000 7f78e35ba740 10 client.19113 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.646+0000 7f78e35ba740 10 client.19113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.646+0000 7f78e35ba740 20 client.19113 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.646+0000 7f78e35ba740 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed63e720 0x55beed640b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.646+0000 7f78e35ba740 4 client.19113 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.646+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55beed52a190 con 0x55beed63e720 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.646+0000 7f78ddc00640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed63e720 0x55beed640b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.647+0000 7f78ddc00640 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed63e720 0x55beed640b40 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1cdd331b89a8da server_cookie=1e0d94b82307c750 in_seq=0 out_seq=0 2024-04-23T15:34:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.647+0000 7f78bf400640 10 client.19113 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.683+0000 7f78bf400640 1 -- 172.21.15.7:0/4280490503 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55beed52a190 con 0x55beed63e720 2024-04-23T15:34:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.683+0000 7f78bf400640 10 client.19113 handle_command_reply: tid=0 2024-04-23T15:34:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.683+0000 7f78e35ba740 1 client.19113 shutdown 2024-04-23T15:34:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 msgr2=0x55beed5cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5cb690 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f78d806b460 tx=0x7f78c4005480 comp rx=0 tx=0).stop 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 shutdown_connections 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55beed63e720 0x55beed640b40 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55beed5c75a0 0x55beed5cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55beed5bcce0 0x55beed5cb690 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78bf400640 0 client.19113 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 --2- 172.21.15.7:0/4280490503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55beed5bc3c0 0x55beed5cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 >> 172.21.15.7:0/4280490503 conn(0x55beed5b88d0 msgr2=0x55beed5b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 shutdown_connections 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.684+0000 7f78e35ba740 1 -- 172.21.15.7:0/4280490503 wait complete. 2024-04-23T15:34:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.685+0000 7f78e35ba740 20 client.19113 trim_cache size 0 max 16384 2024-04-23T15:34:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:34:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:34:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:34:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.685+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78c00a3d90 msgr2=0x7f78c00a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.685+0000 7f78df000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78c00a3d90 0x7f78c00a6250 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f78d000bce0 tx=0x7f78d000b4d0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.685+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 msgr2=0x7f78d81a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.685+0000 7f78df000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 0x7f78d81a05b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00eab0 tx=0x7f78cc00ef70 comp rx=0 tx=0).stop 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 shutdown_connections 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78c00a3d90 0x7f78c00a6250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d8109370 0x7f78d81a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78d819a6c0 0x7f78d819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 --2- 172.21.15.7:0/1121564477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78d81042a0 0x7f78d81a05b0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 >> 172.21.15.7:0/1121564477 conn(0x7f78d80ffae0 msgr2=0x7f78d8100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 shutdown_connections 2024-04-23T15:34:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:02.686+0000 7f78df000640 1 -- 172.21.15.7:0/1121564477 wait complete. 2024-04-23T15:34:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:03 smithi007 ceph-mon[27906]: pgmap v1353: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:34:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:03 smithi186 ceph-mon[31814]: pgmap v1353: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:34:03.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:03 smithi137 ceph-mon[31694]: pgmap v1353: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 36 op/s 2024-04-23T15:34:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:05 smithi007 ceph-mon[27906]: pgmap v1354: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 27 op/s 2024-04-23T15:34:05.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:05 smithi186 ceph-mon[31814]: pgmap v1354: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 27 op/s 2024-04-23T15:34:05.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:05 smithi137 ceph-mon[31694]: pgmap v1354: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 27 op/s 2024-04-23T15:34:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:07 smithi007 ceph-mon[27906]: pgmap v1355: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 27 op/s 2024-04-23T15:34:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:07 smithi186 ceph-mon[31814]: pgmap v1355: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 27 op/s 2024-04-23T15:34:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:07 smithi137 ceph-mon[31694]: pgmap v1355: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.4 MiB/s wr, 27 op/s 2024-04-23T15:34:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:09 smithi007 ceph-mon[27906]: pgmap v1356: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:34:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:09 smithi007 ceph-mon[27906]: osdmap e165: 12 total, 12 up, 12 in 2024-04-23T15:34:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:09 smithi186 ceph-mon[31814]: pgmap v1356: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:34:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:09 smithi186 ceph-mon[31814]: osdmap e165: 12 total, 12 up, 12 in 2024-04-23T15:34:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:09 smithi137 ceph-mon[31694]: pgmap v1356: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 35 op/s 2024-04-23T15:34:09.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:09 smithi137 ceph-mon[31694]: osdmap e165: 12 total, 12 up, 12 in 2024-04-23T15:34:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:11 smithi007 ceph-mon[27906]: pgmap v1358: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:34:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:11 smithi186 ceph-mon[31814]: pgmap v1358: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:34:11.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:11 smithi137 ceph-mon[31694]: pgmap v1358: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:34:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:13 smithi186 ceph-mon[31814]: pgmap v1359: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:13 smithi137 ceph-mon[31694]: pgmap v1359: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:13.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:13 smithi007 ceph-mon[27906]: pgmap v1359: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:15 smithi186 ceph-mon[31814]: pgmap v1360: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:15 smithi137 ceph-mon[31694]: pgmap v1360: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:15.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:15 smithi007 ceph-mon[27906]: pgmap v1360: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 -- 172.21.15.7:0/1192949738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968102090 msgr2=0x7f2968102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 --2- 172.21.15.7:0/1192949738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968102090 0x7f2968102470 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f2958009900 tx=0x7f295802a410 comp rx=0 tx=0).stop 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 -- 172.21.15.7:0/1192949738 shutdown_connections 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 --2- 172.21.15.7:0/1192949738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2968107160 0x7f296810ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 --2- 172.21.15.7:0/1192949738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102a40 0x7f2968106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 --2- 172.21.15.7:0/1192949738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968102090 0x7f2968102470 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 -- 172.21.15.7:0/1192949738 >> 172.21.15.7:0/1192949738 conn(0x7f29680fd950 msgr2=0x7f29680ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 -- 172.21.15.7:0/1192949738 shutdown_connections 2024-04-23T15:34:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.851+0000 7f296d000640 1 -- 172.21.15.7:0/1192949738 wait complete. 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.852+0000 7f296d000640 1 Processor -- start 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 -- start start 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102090 0x7f29681a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 0x7f29681a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f296819a730 0x7f296819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2968112110 con 0x7f2968107160 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2968111f90 con 0x7f296819a730 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f296d000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2968112290 con 0x7f2968102090 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f2966a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 0x7f29681a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f2966a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 0x7f29681a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57030/0 (socket says 172.21.15.7:57030) 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.853+0000 7f2966a00640 1 -- 172.21.15.7:0/1358841398 learned_addr learned my addr 172.21.15.7:0/1358841398 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2967400640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102090 0x7f29681a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2967e00640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f296819a730 0x7f296819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2966a00640 1 -- 172.21.15.7:0/1358841398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102090 msgr2=0x7f29681a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2966a00640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102090 0x7f29681a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2966a00640 1 -- 172.21.15.7:0/1358841398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f296819a730 msgr2=0x7f296819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2966a00640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f296819a730 0x7f296819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2966a00640 1 -- 172.21.15.7:0/1358841398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296819b330 con 0x7f2968107160 2024-04-23T15:34:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2967400640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102090 0x7f29681a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:34:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.854+0000 7f2966a00640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 0x7f29681a0b60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f295400d740 tx=0x7f295400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.855+0000 7f295fe00640 1 -- 172.21.15.7:0/1358841398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954017070 con 0x7f2968107160 2024-04-23T15:34:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.855+0000 7f295fe00640 1 -- 172.21.15.7:0/1358841398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f295400de50 con 0x7f2968107160 2024-04-23T15:34:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.855+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29681a73c0 con 0x7f2968107160 2024-04-23T15:34:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.855+0000 7f295fe00640 1 -- 172.21.15.7:0/1358841398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954004d60 con 0x7f2968107160 2024-04-23T15:34:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.855+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29681a7770 con 0x7f2968107160 2024-04-23T15:34:15.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.859+0000 7f2971447740 1 Processor -- start 2024-04-23T15:34:15.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.859+0000 7f2971447740 1 -- start start 2024-04-23T15:34:15.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.859+0000 7f295fe00640 1 -- 172.21.15.7:0/1358841398 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2954004f00 con 0x7f2968107160 2024-04-23T15:34:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.859+0000 7f2971447740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 0x55fb5aef37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2971447740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2971447740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aefe5a0 0x55fb5af00990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2971447740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb5ae59900 con 0x55fb5aef33c0 2024-04-23T15:34:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2971447740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fb5adfff20 con 0x55fb5aef3ce0 2024-04-23T15:34:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2971447740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fb5ae558c0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 0x55fb5aef37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 0x55fb5aef37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57034/0 (socket says 172.21.15.7:57034) 2024-04-23T15:34:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2967e00640 1 -- 172.21.15.7:0/4242571995 learned_addr learned my addr 172.21.15.7:0/4242571995 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2967400640 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.860+0000 7f2966a00640 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aefe5a0 0x55fb5af00990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f2967e00640 1 -- 172.21.15.7:0/4242571995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aefe5a0 msgr2=0x55fb5af00990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f2967e00640 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aefe5a0 0x55fb5af00990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f2967e00640 1 -- 172.21.15.7:0/4242571995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 msgr2=0x55fb5aefe060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f2967e00640 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefe060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f2967e00640 1 -- 172.21.15.7:0/4242571995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5ae24e10 con 0x55fb5aef33c0 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f2967e00640 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 0x55fb5aef37a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2960009e60 tx=0x7f2960010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daed0e4f96dc842e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.861+0000 7f295fe00640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f294c0a3d10 0x7f294c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.862+0000 7f295fe00640 1 -- 172.21.15.7:0/1358841398 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 9555+0+0 (secure 0 0 0) 0x7f29540d0690 con 0x7f2968107160 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.862+0000 7f2967400640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f294c0a3d10 0x7f294c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.862+0000 7f295cc00640 1 -- 172.21.15.7:0/4242571995 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960016070 con 0x55fb5aef33c0 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.862+0000 7f295cc00640 1 -- 172.21.15.7:0/4242571995 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2960004d20 con 0x55fb5aef33c0 2024-04-23T15:34:15.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.862+0000 7f295cc00640 1 -- 172.21.15.7:0/4242571995 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960012740 con 0x55fb5aef33c0 2024-04-23T15:34:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 -- 172.21.15.7:0/4242571995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 msgr2=0x55fb5aef37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2967400640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f294c0a3d10 0x7f294c0a61d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2958000c00 tx=0x7f2958005b50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 0x55fb5aef37a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2960009e60 tx=0x7f2960010740 comp rx=0 tx=0).stop 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 -- 172.21.15.7:0/4242571995 shutdown_connections 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aefe5a0 0x55fb5af00990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 --2- 172.21.15.7:0/4242571995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aef33c0 0x55fb5aef37a0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 -- 172.21.15.7:0/4242571995 >> 172.21.15.7:0/4242571995 conn(0x55fb5aeef8d0 msgr2=0x55fb5aeefcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 -- 172.21.15.7:0/4242571995 shutdown_connections 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 -- 172.21.15.7:0/4242571995 wait complete. 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.863+0000 7f2971447740 1 -- start start 2024-04-23T15:34:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 Processor -- start 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aefc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb5af010e0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fb5ae132c0 con 0x55fb5aef3ce0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55fb5af01260 con 0x55fb5aef33c0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.864+0000 7f2971447740 10 client.0 _ll_register_callbacks cb 0x55fb5ab6ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aefc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aefc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57042/0 (socket says 172.21.15.7:57042) 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 -- 172.21.15.7:0/2470327818 learned_addr learned my addr 172.21.15.7:0/2470327818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967400640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2966a00640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 -- 172.21.15.7:0/2470327818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 msgr2=0x55fb5aefb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 -- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 msgr2=0x55fb5aefbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 -- 172.21.15.7:0/2470327818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5ae23fd0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2967e00640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aefc010 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2960004c70 tx=0x7f2960004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d382a98b03ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.865+0000 7f2951600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2951600640 1 -- 172.21.15.7:0/2470327818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960016040 con 0x55fb5aefe5a0 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2951600640 1 -- 172.21.15.7:0/2470327818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 9555+0+0 (secure 0 0 0) 0x7f29600052e0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2960004d20 con 0x55fb5aefe5a0 2024-04-23T15:34:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2951600640 1 -- 172.21.15.7:0/2470327818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2960030050 con 0x55fb5aefe5a0 2024-04-23T15:34:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2971447740 10 client.19125 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb5ab6c210 con 0x55fb5aefe5a0 2024-04-23T15:34:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.866+0000 7f2951600640 1 -- 172.21.15.7:0/2470327818 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2960004d20 con 0x55fb5aefe5a0 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2951600640 1 -- 172.21.15.7:0/2470327818 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f296002b030 con 0x55fb5aefe5a0 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2971447740 10 client.19125 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2971447740 10 client.19125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2971447740 20 client.19125 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2971447740 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af0e620 0x55fb5af10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2971447740 4 client.19125 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.867+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb5ae67320 con 0x55fb5af0e620 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.868+0000 7f2967400640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af0e620 0x55fb5af10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.869+0000 7f2967400640 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af0e620 0x55fb5af10a10 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce57c72f90504660 server_cookie=2063ac5ade02c62e in_seq=0 out_seq=0 2024-04-23T15:34:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.869+0000 7f2951600640 10 client.19125 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:15.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.870+0000 7f2951600640 1 -- 172.21.15.7:0/2470327818 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fb5ae67320 con 0x55fb5af0e620 2024-04-23T15:34:15.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.870+0000 7f2951600640 10 client.19125 handle_command_reply: tid=0 2024-04-23T15:34:15.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.870+0000 7f2971447740 1 client.19125 shutdown 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 msgr2=0x55fb5aefc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aefc010 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2960004c70 tx=0x7f2960004ca0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 shutdown_connections 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af0e620 0x55fb5af10a10 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5aefbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aefc010 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 --2- 172.21.15.7:0/2470327818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 >> 172.21.15.7:0/2470327818 conn(0x55fb5aeef8d0 msgr2=0x55fb5aef5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2951600640 0 client.19125 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 shutdown_connections 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 1 -- 172.21.15.7:0/2470327818 wait complete. 2024-04-23T15:34:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.871+0000 7f2971447740 20 client.19125 trim_cache size 0 max 16384 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.890+0000 7f2971447740 1 Processor -- start 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.890+0000 7f2971447740 1 -- start start 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2971447740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2971447740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af0a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2971447740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aef4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2971447740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29681b1670 con 0x55fb5aefe5a0 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2971447740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29681b31b0 con 0x55fb5aef3ce0 2024-04-23T15:34:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2971447740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f29681b1d40 con 0x55fb5aef33c0 2024-04-23T15:34:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aef4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aef4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57058/0 (socket says 172.21.15.7:57058) 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2967e00640 1 -- 172.21.15.7:0/721624854 learned_addr learned my addr 172.21.15.7:0/721624854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2966a00640 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af0a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.891+0000 7f2967400640 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2967e00640 1 -- 172.21.15.7:0/721624854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 msgr2=0x55fb5aefdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2967e00640 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2967e00640 1 -- 172.21.15.7:0/721624854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 msgr2=0x55fb5af0a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2967e00640 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af0a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2967e00640 1 -- 172.21.15.7:0/721624854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb5aef54a0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2967e00640 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aef4dc0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f296000a010 tx=0x7f2960005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f6f6938d917dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2953e00640 1 -- 172.21.15.7:0/721624854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960016070 con 0x55fb5aefe5a0 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2953e00640 1 -- 172.21.15.7:0/721624854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2960009ce0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.892+0000 7f2953e00640 1 -- 172.21.15.7:0/721624854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29600129e0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 -- 172.21.15.7:0/721624854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 msgr2=0x55fb5aef4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aef4dc0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f296000a010 tx=0x7f2960005bd0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 -- 172.21.15.7:0/721624854 shutdown_connections 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af0a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5aef4dc0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 --2- 172.21.15.7:0/721624854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5aefdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 -- 172.21.15.7:0/721624854 >> 172.21.15.7:0/721624854 conn(0x55fb5aeef8d0 msgr2=0x55fb5aef6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.893+0000 7f2971447740 1 -- 172.21.15.7:0/721624854 shutdown_connections 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.894+0000 7f2971447740 1 -- 172.21.15.7:0/721624854 wait complete. 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.894+0000 7f2971447740 1 -- start start 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.894+0000 7f2971447740 1 Processor -- start 2024-04-23T15:34:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5af06260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5af03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29681b2ae0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29681b2410 con 0x55fb5aef3ce0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f29681af670 con 0x55fb5aef33c0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2971447740 10 client.0 _ll_register_callbacks cb 0x7f2958009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5af03760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2967e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5af03760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57064/0 (socket says 172.21.15.7:57064) 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2967e00640 1 -- 172.21.15.7:0/3339355305 learned_addr learned my addr 172.21.15.7:0/3339355305 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2967400640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5af06260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.895+0000 7f2966a00640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2967e00640 1 -- 172.21.15.7:0/3339355305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 msgr2=0x55fb5af06260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2967e00640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5af06260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2967e00640 1 -- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 msgr2=0x55fb5af067a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2967e00640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af067a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2967e00640 1 -- 172.21.15.7:0/3339355305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5ac38620 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2967e00640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5af03760 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f2960012e90 tx=0x7f2960009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118871b5e3a1543f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2951600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2951600640 1 -- 172.21.15.7:0/3339355305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960016040 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2951600640 1 -- 172.21.15.7:0/3339355305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 9555+0+0 (secure 0 0 0) 0x7f296001ad70 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.896+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2960009ce0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2951600640 1 -- 172.21.15.7:0/3339355305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f296004b050 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 10 client.19131 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb5af7c8d0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2951600640 1 -- 172.21.15.7:0/3339355305 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2960009ce0 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2951600640 1 -- 172.21.15.7:0/3339355305 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f296002b070 con 0x55fb5aefe5a0 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 10 client.19131 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 10 client.19131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 20 client.19131 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af7ced0 0x55fb5af7f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 4 client.19131 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:34:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.897+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb5ae61190 con 0x55fb5af7ced0 2024-04-23T15:34:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.898+0000 7f2967400640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af7ced0 0x55fb5af7f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.899+0000 7f2967400640 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af7ced0 0x55fb5af7f2c0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b08f0ad43c510e server_cookie=8a2c4f0d1d44da08 in_seq=0 out_seq=0 2024-04-23T15:34:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.899+0000 7f2951600640 10 client.19131 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.937+0000 7f2951600640 1 -- 172.21.15.7:0/3339355305 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb5ae61190 con 0x55fb5af7ced0 2024-04-23T15:34:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.937+0000 7f2951600640 10 client.19131 handle_command_reply: tid=0 2024-04-23T15:34:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.937+0000 7f2971447740 1 client.19131 shutdown 2024-04-23T15:34:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.937+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 msgr2=0x55fb5af03760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.937+0000 7f2971447740 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5af03760 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f2960012e90 tx=0x7f2960009b50 comp rx=0 tx=0).stop 2024-04-23T15:34:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 shutdown_connections 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55fb5af7ced0 0x55fb5af7f2c0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb5aef3ce0 0x55fb5af067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb5aefe5a0 0x55fb5af03760 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 --2- 172.21.15.7:0/3339355305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fb5aef33c0 0x55fb5af06260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2951600640 0 client.19131 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 >> 172.21.15.7:0/3339355305 conn(0x55fb5aeef8d0 msgr2=0x55fb5aefcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 shutdown_connections 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 1 -- 172.21.15.7:0/3339355305 wait complete. 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.938+0000 7f2971447740 20 client.19131 trim_cache size 0 max 16384 2024-04-23T15:34:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:34:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:34:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:34:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:34:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f294c0a3d10 msgr2=0x7f294c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f294c0a3d10 0x7f294c0a61d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2958000c00 tx=0x7f2958005b50 comp rx=0 tx=0).stop 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 msgr2=0x7f29681a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 0x7f29681a0b60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f295400d740 tx=0x7f295400dc00 comp rx=0 tx=0).stop 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 shutdown_connections 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f294c0a3d10 0x7f294c0a61d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f296819a730 0x7f296819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2968107160 0x7f29681a0b60 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 --2- 172.21.15.7:0/1358841398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2968102090 0x7f29681a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 >> 172.21.15.7:0/1358841398 conn(0x7f29680fd950 msgr2=0x7f29680fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 shutdown_connections 2024-04-23T15:34:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:15.939+0000 7f296d000640 1 -- 172.21.15.7:0/1358841398 wait complete. 2024-04-23T15:34:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:17 smithi186 ceph-mon[31814]: pgmap v1361: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:17 smithi186 ceph-mon[31814]: osdmap e166: 12 total, 12 up, 12 in 2024-04-23T15:34:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:17 smithi137 ceph-mon[31694]: pgmap v1361: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:17 smithi137 ceph-mon[31694]: osdmap e166: 12 total, 12 up, 12 in 2024-04-23T15:34:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:17 smithi007 ceph-mon[27906]: pgmap v1361: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 16 op/s 2024-04-23T15:34:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:17 smithi007 ceph-mon[27906]: osdmap e166: 12 total, 12 up, 12 in 2024-04-23T15:34:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:19 smithi186 ceph-mon[31814]: pgmap v1363: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.1 MiB/s wr, 17 op/s 2024-04-23T15:34:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:19 smithi137 ceph-mon[31694]: pgmap v1363: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.1 MiB/s wr, 17 op/s 2024-04-23T15:34:19.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:19 smithi007 ceph-mon[27906]: pgmap v1363: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.1 MiB/s wr, 17 op/s 2024-04-23T15:34:20.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:34:20.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:34:20.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:34:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:21 smithi137 ceph-mon[31694]: pgmap v1364: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:21.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:21 smithi007 ceph-mon[27906]: pgmap v1364: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:21.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:21 smithi186 ceph-mon[31814]: pgmap v1364: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:22.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:34:22.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:34:22.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:34:22.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:34:22.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:34:22.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:34:22.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:34:22.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:34:22.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:34:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:23 smithi137 ceph-mon[31694]: pgmap v1365: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:23.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:23 smithi007 ceph-mon[27906]: pgmap v1365: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:23.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:23 smithi186 ceph-mon[31814]: pgmap v1365: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:24.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:24 smithi137 ceph-mon[31694]: pgmap v1366: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:24.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:24 smithi007 ceph-mon[27906]: pgmap v1366: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:24.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:24 smithi186 ceph-mon[31814]: pgmap v1366: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:26.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:26 smithi137 ceph-mon[31694]: pgmap v1367: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:26 smithi007 ceph-mon[27906]: pgmap v1367: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:27.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:26 smithi186 ceph-mon[31814]: pgmap v1367: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:34:29.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:28 smithi007 ceph-mon[27906]: pgmap v1368: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.3 MiB/s wr, 19 op/s 2024-04-23T15:34:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 -- 172.21.15.7:0/3641582044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0106fe0 msgr2=0x7fc9f01073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 --2- 172.21.15.7:0/3641582044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0106fe0 0x7fc9f01073c0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009930 tx=0x7fc9e002a420 comp rx=0 tx=0).stop 2024-04-23T15:34:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 -- 172.21.15.7:0/3641582044 shutdown_connections 2024-04-23T15:34:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 --2- 172.21.15.7:0/3641582044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9f01018b0 0x7fc9f0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 --2- 172.21.15.7:0/3641582044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f0102270 0x7fc9f010dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 --2- 172.21.15.7:0/3641582044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0106fe0 0x7fc9f01073c0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 -- 172.21.15.7:0/3641582044 >> 172.21.15.7:0/3641582044 conn(0x7fc9f0076e60 msgr2=0x7fc9f00fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 -- 172.21.15.7:0/3641582044 shutdown_connections 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.102+0000 7fc9f5600640 1 -- 172.21.15.7:0/3641582044 wait complete. 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.103+0000 7fc9f5600640 1 Processor -- start 2024-04-23T15:34:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 -- start start 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9f01018b0 0x7fc9f01a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 0x7fc9f01a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f0106fe0 0x7fc9f019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01121b0 con 0x7fc9f0102270 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0112030 con 0x7fc9f01018b0 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9f5600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0112330 con 0x7fc9f0106fe0 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.104+0000 7fc9e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 0x7fc9f01a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 0x7fc9f01a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55676/0 (socket says 172.21.15.7:55676) 2024-04-23T15:34:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 -- 172.21.15.7:0/788191819 learned_addr learned my addr 172.21.15.7:0/788191819 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9efe00640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9f01018b0 0x7fc9f01a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f0106fe0 0x7fc9f019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 -- 172.21.15.7:0/788191819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f0106fe0 msgr2=0x7fc9f019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f0106fe0 0x7fc9f019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 -- 172.21.15.7:0/788191819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9f01018b0 msgr2=0x7fc9f01a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9f01018b0 0x7fc9f01a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 -- 172.21.15.7:0/788191819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f019afb0 con 0x7fc9f0102270 2024-04-23T15:34:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.105+0000 7fc9e7400640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 0x7fc9f01a0b70 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800d950 tx=0x7fc9d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.106+0000 7fc9ed600640 1 -- 172.21.15.7:0/788191819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8017070 con 0x7fc9f0102270 2024-04-23T15:34:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.106+0000 7fc9ed600640 1 -- 172.21.15.7:0/788191819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d8009c30 con 0x7fc9f0102270 2024-04-23T15:34:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.106+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f019b2a0 con 0x7fc9f0102270 2024-04-23T15:34:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.106+0000 7fc9ed600640 1 -- 172.21.15.7:0/788191819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d800f620 con 0x7fc9f0102270 2024-04-23T15:34:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.106+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f01a75b0 con 0x7fc9f0102270 2024-04-23T15:34:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9ed600640 1 -- 172.21.15.7:0/788191819 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc9d80109a0 con 0x7fc9f0102270 2024-04-23T15:34:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 Processor -- start 2024-04-23T15:34:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 -- start start 2024-04-23T15:34:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd17867a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd1791060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd1793990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561fd16ec900 con 0x561fd17863c0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.110+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561fd1692f20 con 0x561fd1786ce0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561fd16e88c0 con 0x561fd17915a0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd17867a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd17867a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55690/0 (socket says 172.21.15.7:55690) 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3973817722 learned_addr learned my addr 172.21.15.7:0/3973817722 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd1793990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd1791060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3973817722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 msgr2=0x561fd1793990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd1793990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3973817722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 msgr2=0x561fd1791060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd1791060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.111+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3973817722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd16b7e10 con 0x561fd17863c0 2024-04-23T15:34:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9ed600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9d40a3d10 0x7fc9d40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9ed600640 1 -- 172.21.15.7:0/788191819 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7fc9d80d08c0 con 0x7fc9f0102270 2024-04-23T15:34:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd17867a0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009ee0 tx=0x7fc9e8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1facc92a97274 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9efe00640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9d40a3d10 0x7fc9d40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9e5200640 1 -- 172.21.15.7:0/3973817722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8016070 con 0x561fd17863c0 2024-04-23T15:34:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9e5200640 1 -- 172.21.15.7:0/3973817722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9e8004d20 con 0x561fd17863c0 2024-04-23T15:34:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.112+0000 7fc9e5200640 1 -- 172.21.15.7:0/3973817722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8012760 con 0x561fd17863c0 2024-04-23T15:34:29.115 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:28 smithi186 ceph-mon[31814]: pgmap v1368: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.3 MiB/s wr, 19 op/s 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3973817722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 msgr2=0x561fd17867a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd17867a0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009ee0 tx=0x7fc9e8010740 comp rx=0 tx=0).stop 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9efe00640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9d40a3d10 0x7fc9d40a61d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000c00 tx=0x7fc9e00058b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3973817722 shutdown_connections 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd1791060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd1793990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3973817722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd17867a0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3973817722 >> 172.21.15.7:0/3973817722 conn(0x561fd17828d0 msgr2=0x561fd1782cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3973817722 shutdown_connections 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.113+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3973817722 wait complete. 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.114+0000 7fc9f9a09740 1 -- start start 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.114+0000 7fc9f9a09740 1 Processor -- start 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd178e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 0x561fd178f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561fd17940e0 con 0x561fd17915a0 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561fd16a62c0 con 0x561fd1786ce0 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x561fd1794260 con 0x561fd17863c0 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f9a09740 10 client.0 _ll_register_callbacks cb 0x561fd13fea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 0x561fd178f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 0x561fd178f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55706/0 (socket says 172.21.15.7:55706) 2024-04-23T15:34:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3955800486 learned_addr learned my addr 172.21.15.7:0/3955800486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd178e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.115+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3955800486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 msgr2=0x561fd178e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd178e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 msgr2=0x561fd178eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9f4c00640 1 -- 172.21.15.7:0/3955800486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd16b6fd0 con 0x561fd17915a0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 0x561fd178f0c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8000f80 tx=0x7fc9e8009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478693e98a988df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.116+0000 7fc9dd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9dd600640 1 -- 172.21.15.7:0/3955800486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8028060 con 0x561fd17915a0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e8004d20 con 0x561fd17915a0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9dd600640 1 -- 172.21.15.7:0/3955800486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7fc9e80050e0 con 0x561fd17915a0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9dd600640 1 -- 172.21.15.7:0/3955800486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9e802f050 con 0x561fd17915a0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9f9a09740 10 client.19143 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561fd13ff210 con 0x561fd17915a0 2024-04-23T15:34:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.117+0000 7fc9dd600640 1 -- 172.21.15.7:0/3955800486 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9e8004d20 con 0x561fd17915a0 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9dd600640 1 -- 172.21.15.7:0/3955800486 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc9e800f040 con 0x561fd17915a0 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9f9a09740 10 client.19143 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9f9a09740 10 client.19143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9f9a09740 20 client.19143 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd17a16c0 0x561fd17a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9f9a09740 4 client.19143 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:34:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fd16fa320 con 0x561fd17a16c0 2024-04-23T15:34:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.118+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd17a16c0 0x561fd17a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.119+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd17a16c0 0x561fd17a3ab0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11491ec1e9e07d76 server_cookie=41e11c363c8313c8 in_seq=0 out_seq=0 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.119+0000 7fc9dd600640 10 client.19143 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.121+0000 7fc9dd600640 1 -- 172.21.15.7:0/3955800486 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561fd16fa320 con 0x561fd17a16c0 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.121+0000 7fc9dd600640 10 client.19143 handle_command_reply: tid=0 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.121+0000 7fc9f9a09740 1 client.19143 shutdown 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 msgr2=0x561fd178f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 0x561fd178f0c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8000f80 tx=0x7fc9e8009c50 comp rx=0 tx=0).stop 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 shutdown_connections 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd17a16c0 0x561fd17a3ab0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17915a0 0x561fd178f0c0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3955800486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd178e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 >> 172.21.15.7:0/3955800486 conn(0x561fd17828d0 msgr2=0x561fd1788650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9dd600640 0 client.19143 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 shutdown_connections 2024-04-23T15:34:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3955800486 wait complete. 2024-04-23T15:34:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.122+0000 7fc9f9a09740 20 client.19143 trim_cache size 0 max 16384 2024-04-23T15:34:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 Processor -- start 2024-04-23T15:34:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 -- start start 2024-04-23T15:34:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd1790c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 0x561fd179d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd17915a0 0x561fd1788d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01b1500 con 0x561fd1786ce0 2024-04-23T15:34:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01b3040 con 0x561fd17915a0 2024-04-23T15:34:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01b1bd0 con 0x561fd17863c0 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 0x561fd179d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.139+0000 7fc9e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 0x561fd179d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55708/0 (socket says 172.21.15.7:55708) 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 -- 172.21.15.7:0/3738506489 learned_addr learned my addr 172.21.15.7:0/3738506489 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd1790c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd17915a0 0x561fd1788d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 -- 172.21.15.7:0/3738506489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 msgr2=0x561fd1790c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd1790c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 -- 172.21.15.7:0/3738506489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd17915a0 msgr2=0x561fd1788d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd17915a0 0x561fd1788d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 -- 172.21.15.7:0/3738506489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd14cb620 con 0x561fd1786ce0 2024-04-23T15:34:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.140+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 0x561fd179d080 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fc9d809c3e0 tx=0x7fc9d809bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0503daa06cee25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.141+0000 7fc9dfe00640 1 -- 172.21.15.7:0/3738506489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8020040 con 0x561fd1786ce0 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.141+0000 7fc9dfe00640 1 -- 172.21.15.7:0/3738506489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d809cb50 con 0x561fd1786ce0 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.141+0000 7fc9dfe00640 1 -- 172.21.15.7:0/3738506489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8098c50 con 0x561fd1786ce0 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3738506489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 msgr2=0x561fd179d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 0x561fd179d080 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fc9d809c3e0 tx=0x7fc9d809bf90 comp rx=0 tx=0).stop 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3738506489 shutdown_connections 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd17915a0 0x561fd1788d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd1786ce0 0x561fd179d080 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3738506489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17863c0 0x561fd1790c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3738506489 >> 172.21.15.7:0/3738506489 conn(0x561fd17828d0 msgr2=0x561fd178cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3738506489 shutdown_connections 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3738506489 wait complete. 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.142+0000 7fc9f9a09740 1 -- start start 2024-04-23T15:34:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 Processor -- start 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd1799780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd178b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01b2970 con 0x561fd17863c0 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01b22a0 con 0x561fd1786ce0 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01af500 con 0x561fd17915a0 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9f9a09740 10 client.0 _ll_register_callbacks cb 0x7fc9e8009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.143+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd1799780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd1799780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55718/0 (socket says 172.21.15.7:55718) 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 -- 172.21.15.7:0/3897656220 learned_addr learned my addr 172.21.15.7:0/3897656220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9f4c00640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd178b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 -- 172.21.15.7:0/3897656220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 msgr2=0x561fd178b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd178b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 -- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 msgr2=0x561fd178ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 -- 172.21.15.7:0/3897656220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd178b760 con 0x561fd17863c0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9efe00640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd1799780 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009930 tx=0x7fc9e0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f59ea4d12e4cb4f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.144+0000 7fc9dd600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9dd600640 1 -- 172.21.15.7:0/3897656220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0035050 con 0x561fd17863c0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9dd600640 1 -- 172.21.15.7:0/3897656220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7fc9e0005450 con 0x561fd17863c0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d809cb50 con 0x561fd17863c0 2024-04-23T15:34:29.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9dd600640 1 -- 172.21.15.7:0/3897656220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9e005e050 con 0x561fd17863c0 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9f9a09740 10 client.19149 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561fd1807660 con 0x561fd17863c0 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.145+0000 7fc9dd600640 1 -- 172.21.15.7:0/3897656220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d809cb50 con 0x561fd17863c0 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9dd600640 1 -- 172.21.15.7:0/3897656220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc9e0003680 con 0x561fd17863c0 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9f9a09740 10 client.19149 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9f9a09740 10 client.19149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9f9a09740 20 client.19149 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd1807d90 0x561fd180a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9f9a09740 4 client.19149 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fd16f4190 con 0x561fd1807d90 2024-04-23T15:34:29.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.146+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd1807d90 0x561fd180a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.147+0000 7fc9e7400640 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd1807d90 0x561fd180a1b0 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adbd04abf21fa7a server_cookie=b495e96969c93b6c in_seq=0 out_seq=0 2024-04-23T15:34:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.147+0000 7fc9dd600640 10 client.19149 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:29.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:28 smithi137 ceph-mon[31694]: pgmap v1368: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.3 MiB/s wr, 19 op/s 2024-04-23T15:34:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.184+0000 7fc9dd600640 1 -- 172.21.15.7:0/3897656220 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fd16f4190 con 0x561fd1807d90 2024-04-23T15:34:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.184+0000 7fc9dd600640 10 client.19149 handle_command_reply: tid=0 2024-04-23T15:34:29.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 client.19149 shutdown 2024-04-23T15:34:29.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 msgr2=0x561fd1799780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd1799780 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009930 tx=0x7fc9e0009260 comp rx=0 tx=0).stop 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 shutdown_connections 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x561fd1807d90 0x561fd180a1b0 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561fd1786ce0 0x561fd178ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561fd17915a0 0x561fd178b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 --2- 172.21.15.7:0/3897656220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561fd17863c0 0x561fd1799780 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9dd600640 0 client.19149 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 >> 172.21.15.7:0/3897656220 conn(0x561fd17828d0 msgr2=0x561fd179c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.185+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 shutdown_connections 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.186+0000 7fc9f9a09740 1 -- 172.21.15.7:0/3897656220 wait complete. 2024-04-23T15:34:29.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.186+0000 7fc9f9a09740 20 client.19149 trim_cache size 0 max 16384 2024-04-23T15:34:29.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:34:29.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:34:29.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:34:29.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9d40a3d10 msgr2=0x7fc9d40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9d40a3d10 0x7fc9d40a61d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000c00 tx=0x7fc9e00058b0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 msgr2=0x7fc9f01a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 0x7fc9f01a0b70 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800d950 tx=0x7fc9d800de10 comp rx=0 tx=0).stop 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 shutdown_connections 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9d40a3d10 0x7fc9d40a61d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f0106fe0 0x7fc9f019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9f0102270 0x7fc9f01a0b70 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 --2- 172.21.15.7:0/788191819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9f01018b0 0x7fc9f01a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 >> 172.21.15.7:0/788191819 conn(0x7fc9f0076e60 msgr2=0x7fc9f010d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 shutdown_connections 2024-04-23T15:34:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:29.187+0000 7fc9f5600640 1 -- 172.21.15.7:0/788191819 wait complete. 2024-04-23T15:34:30.971 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:30 smithi137 ceph-mon[31694]: pgmap v1369: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:34:31.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:30 smithi007 ceph-mon[27906]: pgmap v1369: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:34:31.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:30 smithi186 ceph-mon[31814]: pgmap v1369: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:34:33.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:32 smithi007 ceph-mon[27906]: pgmap v1370: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:33.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:32 smithi186 ceph-mon[31814]: pgmap v1370: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:32 smithi137 ceph-mon[31694]: pgmap v1370: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:35.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:34 smithi007 ceph-mon[27906]: pgmap v1371: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:34:35.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:34 smithi186 ceph-mon[31814]: pgmap v1371: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:34:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:34 smithi137 ceph-mon[31694]: pgmap v1371: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:34:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:36 smithi007 ceph-mon[27906]: pgmap v1372: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:34:37.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:36 smithi186 ceph-mon[31814]: pgmap v1372: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:34:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:36 smithi137 ceph-mon[31694]: pgmap v1372: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 14 op/s 2024-04-23T15:34:39.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:38 smithi007 ceph-mon[27906]: pgmap v1373: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:39.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:38 smithi186 ceph-mon[31814]: pgmap v1373: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:39.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:38 smithi137 ceph-mon[31694]: pgmap v1373: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:41.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:40 smithi007 ceph-mon[27906]: pgmap v1374: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:34:41.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:40 smithi186 ceph-mon[31814]: pgmap v1374: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:34:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:40 smithi137 ceph-mon[31694]: pgmap v1374: 129 pgs: 129 active+clean; 11 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:34:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 -- 172.21.15.7:0/3542615871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c8109370 msgr2=0x7fa9c8110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3542615871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c8109370 0x7fa9c8110f40 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009ca0 tx=0x7fa9c002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 -- 172.21.15.7:0/3542615871 shutdown_connections 2024-04-23T15:34:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3542615871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c8109370 0x7fa9c8110f40 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3542615871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9c8104c50 0x7fa9c8108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3542615871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9c81042a0 0x7fa9c8104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 -- 172.21.15.7:0/3542615871 >> 172.21.15.7:0/3542615871 conn(0x7fa9c80ffae0 msgr2=0x7fa9c8101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 -- 172.21.15.7:0/3542615871 shutdown_connections 2024-04-23T15:34:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.352+0000 7fa9c7200640 1 -- 172.21.15.7:0/3542615871 wait complete. 2024-04-23T15:34:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.353+0000 7fa9c7200640 1 Processor -- start 2024-04-23T15:34:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.353+0000 7fa9c7200640 1 -- start start 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 0x7fa9c81a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9c8109370 0x7fa9c81a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9c819a6a0 0x7fa9c819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81142c0 con 0x7fa9c81042a0 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c8114140 con 0x7fa9c8109370 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c8114440 con 0x7fa9c819a6a0 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 0x7fa9c81a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 0x7fa9c81a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45080/0 (socket says 172.21.15.7:45080) 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.354+0000 7fa9c5e00640 1 -- 172.21.15.7:0/3383039848 learned_addr learned my addr 172.21.15.7:0/3383039848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5400640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9c8109370 0x7fa9c81a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c6800640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9c819a6a0 0x7fa9c819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5e00640 1 -- 172.21.15.7:0/3383039848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9c819a6a0 msgr2=0x7fa9c819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9c819a6a0 0x7fa9c819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5e00640 1 -- 172.21.15.7:0/3383039848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9c8109370 msgr2=0x7fa9c81a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9c8109370 0x7fa9c81a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5e00640 1 -- 172.21.15.7:0/3383039848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c819b2a0 con 0x7fa9c81042a0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.355+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 0x7fa9c81a0590 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800d950 tx=0x7fa9b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.356+0000 7fa9bea00640 1 -- 172.21.15.7:0/3383039848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8017070 con 0x7fa9c81042a0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.356+0000 7fa9bea00640 1 -- 172.21.15.7:0/3383039848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9b8009c30 con 0x7fa9c81042a0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.356+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c81a7330 con 0x7fa9c81042a0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.356+0000 7fa9bea00640 1 -- 172.21.15.7:0/3383039848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800f620 con 0x7fa9c81042a0 2024-04-23T15:34:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.356+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c81a7790 con 0x7fa9c81042a0 2024-04-23T15:34:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.360+0000 7fa9cfc28740 1 Processor -- start 2024-04-23T15:34:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 -- start start 2024-04-23T15:34:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90987a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90a35a0 0x55ceb90a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8ffe900 con 0x55ceb9098ce0 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8fa4f20 con 0x55ceb90a35a0 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8ffa8c0 con 0x55ceb90983c0 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9bea00640 1 -- 172.21.15.7:0/3383039848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa9b80109a0 con 0x7fa9c81042a0 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.361+0000 7fa9c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45082/0 (socket says 172.21.15.7:45082) 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 -- 172.21.15.7:0/2284236611 learned_addr learned my addr 172.21.15.7:0/2284236611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c6800640 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5400640 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90a35a0 0x55ceb90a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 -- 172.21.15.7:0/2284236611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 msgr2=0x55ceb90987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 -- 172.21.15.7:0/2284236611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90a35a0 msgr2=0x55ceb90a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90a35a0 0x55ceb90a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.362+0000 7fa9c5e00640 1 -- 172.21.15.7:0/2284236611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb8fc9e10 con 0x55ceb9098ce0 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a3060 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cdb00 tx=0x7fa9b80d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5e8dfb29ff2b31 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9b3400640 1 -- 172.21.15.7:0/2284236611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b80df070 con 0x55ceb9098ce0 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9bea00640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9ac0a3d90 0x7fa9ac0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9b3400640 1 -- 172.21.15.7:0/2284236611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9b80d2780 con 0x55ceb9098ce0 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9b3400640 1 -- 172.21.15.7:0/2284236611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b80d3e60 con 0x55ceb9098ce0 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9bea00640 1 -- 172.21.15.7:0/3383039848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7fa9b80d0880 con 0x7fa9c81042a0 2024-04-23T15:34:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.363+0000 7fa9c6800640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9ac0a3d90 0x7fa9ac0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2284236611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 msgr2=0x55ceb90a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a3060 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cdb00 tx=0x7fa9b80d8670 comp rx=0 tx=0).stop 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2284236611 shutdown_connections 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90a35a0 0x55ceb90a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a3060 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2284236611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2284236611 >> 172.21.15.7:0/2284236611 conn(0x55ceb90948d0 msgr2=0x55ceb9094cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2284236611 shutdown_connections 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.364+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2284236611 wait complete. 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.365+0000 7fa9c6800640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9ac0a3d90 0x7fa9ac0a6250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0005cc0 tx=0x7fa9c0031b20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.365+0000 7fa9cfc28740 1 -- start start 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.365+0000 7fa9cfc28740 1 Processor -- start 2024-04-23T15:34:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90a35a0 0x55ceb90a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ceb90a6140 con 0x55ceb9098ce0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ceb8fb82c0 con 0x55ceb90983c0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ceb90a62c0 con 0x55ceb90a35a0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9cfc28740 10 client.0 _ll_register_callbacks cb 0x55ceb8d10a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9c5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9c5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45092/0 (socket says 172.21.15.7:45092) 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9c5400640 1 -- 172.21.15.7:0/233721755 learned_addr learned my addr 172.21.15.7:0/233721755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.366+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c6800640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90a35a0 0x55ceb90a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5400640 1 -- 172.21.15.7:0/233721755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90a35a0 msgr2=0x55ceb90a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5400640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90a35a0 0x55ceb90a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5400640 1 -- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 msgr2=0x55ceb90a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5400640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5400640 1 -- 172.21.15.7:0/233721755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb8fc8fd0 con 0x55ceb9098ce0 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9c5400640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a0a90 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400bd90 tx=0x7fa9b4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557e3c154f3dbd02 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.367+0000 7fa9a7e00640 1 -- 172.21.15.7:0/233721755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40107e0 con 0x55ceb9098ce0 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9a7e00640 1 -- 172.21.15.7:0/233721755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7fa9b4010980 con 0x55ceb9098ce0 2024-04-23T15:34:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b80d2780 con 0x55ceb9098ce0 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9a7e00640 1 -- 172.21.15.7:0/233721755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa9b4010b80 con 0x55ceb9098ce0 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9cfc28740 10 client.19161 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ceb8d11210 con 0x55ceb9098ce0 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9a7e00640 1 -- 172.21.15.7:0/233721755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9b80d2780 con 0x55ceb9098ce0 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.368+0000 7fa9a7e00640 1 -- 172.21.15.7:0/233721755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa9b4019070 con 0x55ceb9098ce0 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9cfc28740 10 client.19161 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9cfc28740 10 client.19161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9cfc28740 20 client.19161 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb90b3740 0x55ceb90b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9cfc28740 4 client.19161 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ceb900c320 con 0x55ceb90b3740 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.369+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb90b3740 0x55ceb90b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.370+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb90b3740 0x55ceb90b5bb0 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b423282c11f226 server_cookie=1a28113a1068d77 in_seq=0 out_seq=0 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.370+0000 7fa9a7e00640 10 client.19161 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.372+0000 7fa9a7e00640 1 -- 172.21.15.7:0/233721755 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ceb900c320 con 0x55ceb90b3740 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.372+0000 7fa9a7e00640 10 client.19161 handle_command_reply: tid=0 2024-04-23T15:34:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.372+0000 7fa9cfc28740 1 client.19161 shutdown 2024-04-23T15:34:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 msgr2=0x55ceb90a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a0a90 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400bd90 tx=0x7fa9b4012820 comp rx=0 tx=0).stop 2024-04-23T15:34:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 shutdown_connections 2024-04-23T15:34:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb90b3740 0x55ceb90b5bb0 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90a35a0 0x55ceb90a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb9098ce0 0x55ceb90a0a90 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/233721755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 >> 172.21.15.7:0/233721755 conn(0x55ceb90948d0 msgr2=0x55ceb9093a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9a7e00640 0 client.19161 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 shutdown_connections 2024-04-23T15:34:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 1 -- 172.21.15.7:0/233721755 wait complete. 2024-04-23T15:34:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.373+0000 7fa9cfc28740 20 client.19161 trim_cache size 0 max 16384 2024-04-23T15:34:42.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 Processor -- start 2024-04-23T15:34:42.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 -- start start 2024-04-23T15:34:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb9098ce0 0x55ceb90af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9093910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81b14b0 con 0x55ceb90a35a0 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81b2ff0 con 0x55ceb90983c0 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.393+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81b1b80 con 0x55ceb9098ce0 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9093910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9093910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45096/0 (socket says 172.21.15.7:45096) 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 -- 172.21.15.7:0/933533469 learned_addr learned my addr 172.21.15.7:0/933533469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c5400640 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb9098ce0 0x55ceb90af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 -- 172.21.15.7:0/933533469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb9098ce0 msgr2=0x55ceb90af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb9098ce0 0x55ceb90af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 -- 172.21.15.7:0/933533469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 msgr2=0x55ceb90a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.394+0000 7fa9c6800640 1 -- 172.21.15.7:0/933533469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceb8ddd620 con 0x55ceb90a35a0 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.395+0000 7fa9c6800640 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9093910 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009ca0 tx=0x7fa9c0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbcead084c8682d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.395+0000 7fa9b2a00640 1 -- 172.21.15.7:0/933533469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0003970 con 0x55ceb90a35a0 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.395+0000 7fa9b2a00640 1 -- 172.21.15.7:0/933533469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c0036040 con 0x55ceb90a35a0 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.395+0000 7fa9b2a00640 1 -- 172.21.15.7:0/933533469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00305c0 con 0x55ceb90a35a0 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 -- 172.21.15.7:0/933533469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 msgr2=0x55ceb9093910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9093910 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009ca0 tx=0x7fa9c0041000 comp rx=0 tx=0).stop 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 -- 172.21.15.7:0/933533469 shutdown_connections 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9093910 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb9098ce0 0x55ceb90af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/933533469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb90983c0 0x55ceb90a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.396+0000 7fa9cfc28740 1 -- 172.21.15.7:0/933533469 >> 172.21.15.7:0/933533469 conn(0x55ceb90948d0 msgr2=0x55ceb9093200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.397+0000 7fa9cfc28740 1 -- 172.21.15.7:0/933533469 shutdown_connections 2024-04-23T15:34:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.397+0000 7fa9cfc28740 1 -- 172.21.15.7:0/933533469 wait complete. 2024-04-23T15:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.397+0000 7fa9cfc28740 1 -- start start 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 Processor -- start 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90a7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb9098ce0 0x55ceb90a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9118d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81b2920 con 0x55ceb90a35a0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81b2250 con 0x55ceb9098ce0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.398+0000 7fa9cfc28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81af4b0 con 0x55ceb90983c0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9cfc28740 10 client.0 _ll_register_callbacks cb 0x7fa9b4005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9118d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9118d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45112/0 (socket says 172.21.15.7:45112) 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 -- 172.21.15.7:0/2388820921 learned_addr learned my addr 172.21.15.7:0/2388820921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c5400640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb9098ce0 0x55ceb90a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 -- 172.21.15.7:0/2388820921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 msgr2=0x55ceb90a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90a7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 -- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb9098ce0 msgr2=0x55ceb90a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb9098ce0 0x55ceb90a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c6800640 1 -- 172.21.15.7:0/2388820921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceb90a8120 con 0x55ceb90a35a0 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.399+0000 7fa9c5400640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb9098ce0 0x55ceb90a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9c6800640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9118d30 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0004780 tx=0x7fa9c0031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7637d0be3bf59413 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9a7e00640 1 -- 172.21.15.7:0/2388820921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00305c0 con 0x55ceb90a35a0 2024-04-23T15:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c0036040 con 0x55ceb90a35a0 2024-04-23T15:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9a7e00640 1 -- 172.21.15.7:0/2388820921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7fa9c0030760 con 0x55ceb90a35a0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9a7e00640 1 -- 172.21.15.7:0/2388820921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa9c0030960 con 0x55ceb90a35a0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9cfc28740 10 client.19167 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.400+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ceb911a350 con 0x55ceb90a35a0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9a7e00640 1 -- 172.21.15.7:0/2388820921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9c0036040 con 0x55ceb90a35a0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9a7e00640 1 -- 172.21.15.7:0/2388820921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa9c0054460 con 0x55ceb90a35a0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9cfc28740 10 client.19167 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9cfc28740 10 client.19167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9cfc28740 20 client.19167 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb911a9f0 0x55ceb911ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9cfc28740 4 client.19167 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.401+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ceb9006190 con 0x55ceb911a9f0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.402+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb911a9f0 0x55ceb911ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.403+0000 7fa9c5e00640 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb911a9f0 0x55ceb911ce10 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f6cc2ec9d31bc86 server_cookie=1801134bfd2fd23e in_seq=0 out_seq=0 2024-04-23T15:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.403+0000 7fa9a7e00640 10 client.19167 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.438+0000 7fa9a7e00640 1 -- 172.21.15.7:0/2388820921 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ceb9006190 con 0x55ceb911a9f0 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.438+0000 7fa9a7e00640 10 client.19167 handle_command_reply: tid=0 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 client.19167 shutdown 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 msgr2=0x55ceb9118d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9118d30 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0004780 tx=0x7fa9c0031970 comp rx=0 tx=0).stop 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 shutdown_connections 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ceb911a9f0 0x55ceb911ce10 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ceb9098ce0 0x55ceb90a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ceb90a35a0 0x55ceb9118d30 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 --2- 172.21.15.7:0/2388820921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ceb90983c0 0x55ceb90a7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9a7e00640 0 client.19167 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 >> 172.21.15.7:0/2388820921 conn(0x55ceb90948d0 msgr2=0x55ceb9093a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 shutdown_connections 2024-04-23T15:34:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.439+0000 7fa9cfc28740 1 -- 172.21.15.7:0/2388820921 wait complete. 2024-04-23T15:34:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.440+0000 7fa9cfc28740 20 client.19167 trim_cache size 0 max 16384 2024-04-23T15:34:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:34:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:34:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:34:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.440+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9ac0a3d90 msgr2=0x7fa9ac0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.440+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9ac0a3d90 0x7fa9ac0a6250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0005cc0 tx=0x7fa9c0031b20 comp rx=0 tx=0).stop 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.440+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 msgr2=0x7fa9c81a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.440+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 0x7fa9c81a0590 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800d950 tx=0x7fa9b800de10 comp rx=0 tx=0).stop 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 shutdown_connections 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa9ac0a3d90 0x7fa9ac0a6250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9c8109370 0x7fa9c81a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9c819a6a0 0x7fa9c819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 --2- 172.21.15.7:0/3383039848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c81042a0 0x7fa9c81a0590 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 >> 172.21.15.7:0/3383039848 conn(0x7fa9c80ffae0 msgr2=0x7fa9c8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 shutdown_connections 2024-04-23T15:34:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:42.441+0000 7fa9c7200640 1 -- 172.21.15.7:0/3383039848 wait complete. 2024-04-23T15:34:43.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:42 smithi007 ceph-mon[27906]: pgmap v1375: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:43.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:42 smithi186 ceph-mon[31814]: pgmap v1375: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:42 smithi137 ceph-mon[31694]: pgmap v1375: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:34:45.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:44 smithi007 ceph-mon[27906]: pgmap v1376: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:34:45.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:44 smithi186 ceph-mon[31814]: pgmap v1376: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:34:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:44 smithi137 ceph-mon[31694]: pgmap v1376: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:34:47.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:46 smithi007 ceph-mon[27906]: pgmap v1377: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:34:47.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:46 smithi186 ceph-mon[31814]: pgmap v1377: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:34:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:46 smithi137 ceph-mon[31694]: pgmap v1377: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:34:49.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:48 smithi007 ceph-mon[27906]: pgmap v1378: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:34:49.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:48 smithi186 ceph-mon[31814]: pgmap v1378: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:34:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:48 smithi137 ceph-mon[31694]: pgmap v1378: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:34:51.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:50 smithi007 ceph-mon[27906]: pgmap v1379: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:51.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:50 smithi186 ceph-mon[31814]: pgmap v1379: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:50 smithi137 ceph-mon[31694]: pgmap v1379: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:53.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:52 smithi007 ceph-mon[27906]: pgmap v1380: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:34:53.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:52 smithi186 ceph-mon[31814]: pgmap v1380: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:34:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:52 smithi137 ceph-mon[31694]: pgmap v1380: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:34:55.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:54 smithi007 ceph-mon[27906]: pgmap v1381: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:55.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:54 smithi186 ceph-mon[31814]: pgmap v1381: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:55.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:54 smithi137 ceph-mon[31694]: pgmap v1381: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.618+0000 7f269fe00640 1 -- 172.21.15.7:0/364605484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a010c3f0 msgr2=0x7f26a010e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.618+0000 7f269fe00640 1 --2- 172.21.15.7:0/364605484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a010c3f0 0x7f26a010e870 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f2698009ca0 tx=0x7f269802a950 comp rx=0 tx=0).stop 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 -- 172.21.15.7:0/364605484 shutdown_connections 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 --2- 172.21.15.7:0/364605484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a010c3f0 0x7f26a010e870 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 --2- 172.21.15.7:0/364605484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103940 0x7f26a010be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 --2- 172.21.15.7:0/364605484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a0103020 0x7f26a0103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 -- 172.21.15.7:0/364605484 >> 172.21.15.7:0/364605484 conn(0x7f26a00fc820 msgr2=0x7f26a00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 -- 172.21.15.7:0/364605484 shutdown_connections 2024-04-23T15:34:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.619+0000 7f269fe00640 1 -- 172.21.15.7:0/364605484 wait complete. 2024-04-23T15:34:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.620+0000 7f269fe00640 1 Processor -- start 2024-04-23T15:34:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.620+0000 7f269fe00640 1 -- start start 2024-04-23T15:34:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103020 0x7f26a01a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 0x7f26a01a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a010c3f0 0x7f26a019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0112060 con 0x7f26a0103940 2024-04-23T15:34:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0111ee0 con 0x7f26a010c3f0 2024-04-23T15:34:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01121e0 con 0x7f26a0103020 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 0x7f26a01a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 0x7f26a01a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46936/0 (socket says 172.21.15.7:46936) 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269e000640 1 -- 172.21.15.7:0/1360262373 learned_addr learned my addr 172.21.15.7:0/1360262373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269ea00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103020 0x7f26a01a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.621+0000 7f269f400640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a010c3f0 0x7f26a019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269e000640 1 -- 172.21.15.7:0/1360262373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103020 msgr2=0x7f26a01a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269e000640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103020 0x7f26a01a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269e000640 1 -- 172.21.15.7:0/1360262373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a010c3f0 msgr2=0x7f26a019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269e000640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a010c3f0 0x7f26a019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269e000640 1 -- 172.21.15.7:0/1360262373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a019ad60 con 0x7f26a0103940 2024-04-23T15:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269ea00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103020 0x7f26a01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.622+0000 7f269e000640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 0x7f26a01a0970 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f268c00e9f0 tx=0x7f268c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.623+0000 7f2697400640 1 -- 172.21.15.7:0/1360262373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c00cd80 con 0x7f26a0103940 2024-04-23T15:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.623+0000 7f2697400640 1 -- 172.21.15.7:0/1360262373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f268c0054d0 con 0x7f26a0103940 2024-04-23T15:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.623+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a019b050 con 0x7f26a0103940 2024-04-23T15:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.623+0000 7f2697400640 1 -- 172.21.15.7:0/1360262373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c010490 con 0x7f26a0103940 2024-04-23T15:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.623+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a01a72f0 con 0x7f26a0103940 2024-04-23T15:34:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 Processor -- start 2024-04-23T15:34:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 -- start start 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c0e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c10990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557ec3b69900 con 0x557ec3c033c0 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557ec3b0ff20 con 0x557ec3c0e5a0 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f26a89c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557ec3b658c0 con 0x557ec3c03ce0 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.627+0000 7f2697400640 1 -- 172.21.15.7:0/1360262373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f268c005020 con 0x7f26a0103940 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c037a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46938/0 (socket says 172.21.15.7:46938) 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 -- 172.21.15.7:0/2861074163 learned_addr learned my addr 172.21.15.7:0/2861074163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269ea00640 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c0e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 -- 172.21.15.7:0/2861074163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 msgr2=0x557ec3c0e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c0e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 -- 172.21.15.7:0/2861074163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 msgr2=0x557ec3c10990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c10990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.628+0000 7f269f400640 1 -- 172.21.15.7:0/2861074163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec3b34e10 con 0x557ec3c033c0 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.629+0000 7f269f400640 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c037a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2698035000 tx=0x7f2698005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89359882968b3582 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.629+0000 7f268be00640 1 -- 172.21.15.7:0/2861074163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698048070 con 0x557ec3c033c0 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.629+0000 7f268be00640 1 -- 172.21.15.7:0/2861074163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2698003e20 con 0x557ec3c033c0 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.629+0000 7f268be00640 1 -- 172.21.15.7:0/2861074163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698034040 con 0x557ec3c033c0 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f2697400640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26840a3d10 0x7f26840a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f2697400640 1 -- 172.21.15.7:0/1360262373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7f268c0d0f90 con 0x7f26a0103940 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 -- 172.21.15.7:0/2861074163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 msgr2=0x557ec3c037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c037a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2698035000 tx=0x7f2698005fa0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f269ea00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26840a3d10 0x7f26840a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 -- 172.21.15.7:0/2861074163 shutdown_connections 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c10990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c0e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 --2- 172.21.15.7:0/2861074163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c037a0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 -- 172.21.15.7:0/2861074163 >> 172.21.15.7:0/2861074163 conn(0x557ec3bff8d0 msgr2=0x557ec3bffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 -- 172.21.15.7:0/2861074163 shutdown_connections 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.630+0000 7f26a89c6740 1 -- 172.21.15.7:0/2861074163 wait complete. 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.631+0000 7f26a89c6740 1 -- start start 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.631+0000 7f269ea00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26840a3d10 0x7f26840a61d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x557ec3c04960 tx=0x7f269000b7b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.631+0000 7f26a89c6740 1 Processor -- start 2024-04-23T15:34:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3c0b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 0x557ec3c0c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557ec3c11020 con 0x557ec3c0e5a0 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557ec3b232c0 con 0x557ec3c03ce0 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557ec3c111a0 con 0x557ec3c033c0 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f26a89c6740 10 client.0 _ll_register_callbacks cb 0x557ec387ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f269f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 0x557ec3c0c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f269f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 0x557ec3c0c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46944/0 (socket says 172.21.15.7:46944) 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f269f400640 1 -- 172.21.15.7:0/1005586621 learned_addr learned my addr 172.21.15.7:0/1005586621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.632+0000 7f269e000640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269ea00640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3c0b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269f400640 1 -- 172.21.15.7:0/1005586621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 msgr2=0x557ec3c0b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269f400640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3c0b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269f400640 1 -- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c03ce0 msgr2=0x557ec3c0bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269f400640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269f400640 1 -- 172.21.15.7:0/1005586621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec3b33fd0 con 0x557ec3c0e5a0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f269f400640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 0x557ec3c0c080 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f269802f3e0 tx=0x7f269802ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef057130e099e88 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f2688c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.633+0000 7f2688c00640 1 -- 172.21.15.7:0/1005586621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698050060 con 0x557ec3c0e5a0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2698003e20 con 0x557ec3c0e5a0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f2688c00640 1 -- 172.21.15.7:0/1005586621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7f2698003b80 con 0x557ec3c0e5a0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f2688c00640 1 -- 172.21.15.7:0/1005586621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2698057050 con 0x557ec3c0e5a0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f26a89c6740 10 client.19179 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557ec387c210 con 0x557ec3c0e5a0 2024-04-23T15:34:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f2688c00640 1 -- 172.21.15.7:0/1005586621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2698003e20 con 0x557ec3c0e5a0 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f2688c00640 1 -- 172.21.15.7:0/1005586621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f26980305e0 con 0x557ec3c0e5a0 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f26a89c6740 10 client.19179 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.634+0000 7f26a89c6740 10 client.19179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.635+0000 7f26a89c6740 20 client.19179 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.635+0000 7f26a89c6740 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c1e590 0x557ec3c20980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.635+0000 7f26a89c6740 4 client.19179 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.635+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ec3b77320 con 0x557ec3c1e590 2024-04-23T15:34:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.635+0000 7f269ea00640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c1e590 0x557ec3c20980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.636+0000 7f269ea00640 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c1e590 0x557ec3c20980 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75c912dbf0fff1b server_cookie=1fb38244858d591e in_seq=0 out_seq=0 2024-04-23T15:34:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.636+0000 7f2688c00640 10 client.19179 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:55.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.638+0000 7f2688c00640 1 -- 172.21.15.7:0/1005586621 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557ec3b77320 con 0x557ec3c1e590 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.638+0000 7f2688c00640 10 client.19179 handle_command_reply: tid=0 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.638+0000 7f26a89c6740 1 client.19179 shutdown 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.638+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 msgr2=0x557ec3c0c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.638+0000 7f26a89c6740 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 0x557ec3c0c080 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f269802f3e0 tx=0x7f269802ff00 comp rx=0 tx=0).stop 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.638+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 shutdown_connections 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c1e590 0x557ec3c20980 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c0e5a0 0x557ec3c0c080 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 --2- 172.21.15.7:0/1005586621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3c0b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f2688c00640 0 client.19179 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 >> 172.21.15.7:0/1005586621 conn(0x557ec3bff8d0 msgr2=0x557ec3c05600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 shutdown_connections 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 1 -- 172.21.15.7:0/1005586621 wait complete. 2024-04-23T15:34:55.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.639+0000 7f26a89c6740 20 client.19179 trim_cache size 0 max 16384 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.658+0000 7f26a89c6740 1 Processor -- start 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.658+0000 7f26a89c6740 1 -- start start 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3bff210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c25f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f26a89c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b1370 con 0x557ec3c03ce0 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f26a89c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b2eb0 con 0x557ec3c0e5a0 2024-04-23T15:34:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f26a89c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b1a40 con 0x557ec3c033c0 2024-04-23T15:34:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f269e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f269e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46958/0 (socket says 172.21.15.7:46958) 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f269e000640 1 -- 172.21.15.7:0/3977579118 learned_addr learned my addr 172.21.15.7:0/3977579118 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.659+0000 7f269f400640 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c25f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269ea00640 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3bff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269e000640 1 -- 172.21.15.7:0/3977579118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 msgr2=0x557ec3bff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269e000640 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3bff210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269e000640 1 -- 172.21.15.7:0/3977579118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 msgr2=0x557ec3c25f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269e000640 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c25f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269e000640 1 -- 172.21.15.7:0/3977579118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec3c20cf0 con 0x557ec3c03ce0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f269e000640 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bea0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f268c009380 tx=0x7f268c09c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a205f4e1620a9f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f268b400640 1 -- 172.21.15.7:0/3977579118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c0b6070 con 0x557ec3c03ce0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f268b400640 1 -- 172.21.15.7:0/3977579118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f268c09de50 con 0x557ec3c03ce0 2024-04-23T15:34:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.660+0000 7f268b400640 1 -- 172.21.15.7:0/3977579118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c0a5790 con 0x557ec3c03ce0 2024-04-23T15:34:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 -- 172.21.15.7:0/3977579118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 msgr2=0x557ec3c0bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bea0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f268c009380 tx=0x7f268c09c660 comp rx=0 tx=0).stop 2024-04-23T15:34:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 -- 172.21.15.7:0/3977579118 shutdown_connections 2024-04-23T15:34:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c25f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c03ce0 0x557ec3c0bea0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3977579118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c033c0 0x557ec3bff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.661+0000 7f26a89c6740 1 -- 172.21.15.7:0/3977579118 >> 172.21.15.7:0/3977579118 conn(0x557ec3bff8d0 msgr2=0x557ec3c18ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.662+0000 7f26a89c6740 1 -- 172.21.15.7:0/3977579118 shutdown_connections 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.662+0000 7f26a89c6740 1 -- 172.21.15.7:0/3977579118 wait complete. 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.662+0000 7f26a89c6740 1 -- start start 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.662+0000 7f26a89c6740 1 Processor -- start 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c08590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c08ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c09030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b27e0 con 0x557ec3c033c0 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b2110 con 0x557ec3c0e5a0 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01af370 con 0x557ec3c03ce0 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f26a89c6740 10 client.0 _ll_register_callbacks cb 0x7f2698046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f269ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c08590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f269ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c08590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46960/0 (socket says 172.21.15.7:46960) 2024-04-23T15:34:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.663+0000 7f269ea00640 1 -- 172.21.15.7:0/3604650644 learned_addr learned my addr 172.21.15.7:0/3604650644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:34:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269e000640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c08ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269f400640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c09030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269ea00640 1 -- 172.21.15.7:0/3604650644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 msgr2=0x557ec3c08ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269ea00640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c08ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269ea00640 1 -- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 msgr2=0x557ec3c09030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269ea00640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c09030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269ea00640 1 -- 172.21.15.7:0/3604650644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec3948620 con 0x557ec3c033c0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269e000640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c08ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f269ea00640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c08590 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x557ec3c20ec0 tx=0x7f26900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a20acf7a6210da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.664+0000 7f2688c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f2688c00640 1 -- 172.21.15.7:0/3604650644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690004220 con 0x557ec3c033c0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f2688c00640 1 -- 172.21.15.7:0/3604650644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9467+0+0 (secure 0 0 0) 0x7f26900043c0 con 0x557ec3c033c0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f268c09de50 con 0x557ec3c033c0 2024-04-23T15:34:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f2688c00640 1 -- 172.21.15.7:0/3604650644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2690029300 con 0x557ec3c033c0 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f26a89c6740 10 client.19185 fetch_fsmap learned FSMap version 32 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557ec3c84c30 con 0x557ec3c033c0 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.665+0000 7f2688c00640 1 -- 172.21.15.7:0/3604650644 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f269003a070 con 0x557ec3c033c0 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f2688c00640 1 -- 172.21.15.7:0/3604650644 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2690003a40 con 0x557ec3c033c0 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f26a89c6740 10 client.19185 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f26a89c6740 10 client.19185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f26a89c6740 20 client.19185 populate_metadata read hostname 'smithi007' 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c85300 0x557ec3c876f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f26a89c6740 4 client.19185 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ec3b71190 con 0x557ec3c85300 2024-04-23T15:34:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.666+0000 7f269e000640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c85300 0x557ec3c876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:34:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.667+0000 7f269e000640 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c85300 0x557ec3c876f0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d33d27ee5b1fff9c server_cookie=252be10832da64e in_seq=0 out_seq=0 2024-04-23T15:34:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.667+0000 7f2688c00640 10 client.19185 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f2688c00640 1 -- 172.21.15.7:0/3604650644 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ec3b71190 con 0x557ec3c85300 2024-04-23T15:34:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f2688c00640 10 client.19185 handle_command_reply: tid=0 2024-04-23T15:34:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f26a89c6740 1 client.19185 shutdown 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 msgr2=0x557ec3c08590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c08590 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x557ec3c20ec0 tx=0x7f26900046c0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 shutdown_connections 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557ec3c85300 0x557ec3c876f0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.701+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557ec3c0e5a0 0x557ec3c09030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ec3c03ce0 0x557ec3c08ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f26a89c6740 1 --2- 172.21.15.7:0/3604650644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ec3c033c0 0x557ec3c08590 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f2688c00640 0 client.19185 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 >> 172.21.15.7:0/3604650644 conn(0x557ec3bff8d0 msgr2=0x557ec3bfea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 shutdown_connections 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f26a89c6740 1 -- 172.21.15.7:0/3604650644 wait complete. 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.702+0000 7f26a89c6740 20 client.19185 trim_cache size 0 max 16384 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:34:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:34:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26840a3d10 msgr2=0x7f26840a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26840a3d10 0x7f26840a61d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x557ec3c04960 tx=0x7f269000b7b0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 msgr2=0x7f26a01a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:34:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 0x7f26a01a0970 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f268c00e9f0 tx=0x7f268c00edf0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 shutdown_connections 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f26840a3d10 0x7f26840a61d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26a010c3f0 0x7f26a019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26a0103940 0x7f26a01a0970 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 --2- 172.21.15.7:0/1360262373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a0103020 0x7f26a01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 >> 172.21.15.7:0/1360262373 conn(0x7f26a00fc820 msgr2=0x7f26a0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.703+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 shutdown_connections 2024-04-23T15:34:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:34:55.704+0000 7f269fe00640 1 -- 172.21.15.7:0/1360262373 wait complete. 2024-04-23T15:34:57.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:56 smithi007 ceph-mon[27906]: pgmap v1382: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:57.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:56 smithi186 ceph-mon[31814]: pgmap v1382: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:56 smithi137 ceph-mon[31694]: pgmap v1382: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:34:59.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:34:58 smithi007 ceph-mon[27906]: pgmap v1383: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:34:59.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:34:58 smithi186 ceph-mon[31814]: pgmap v1383: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:34:59.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:34:58 smithi137 ceph-mon[31694]: pgmap v1383: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 22 op/s 2024-04-23T15:35:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:00 smithi007 ceph-mon[27906]: pgmap v1384: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:35:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:00 smithi186 ceph-mon[31814]: pgmap v1384: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:35:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:00 smithi137 ceph-mon[31694]: pgmap v1384: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:35:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:02 smithi007 ceph-mon[27906]: pgmap v1385: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.3 MiB/s wr, 35 op/s 2024-04-23T15:35:03.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:02 smithi186 ceph-mon[31814]: pgmap v1385: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.3 MiB/s wr, 35 op/s 2024-04-23T15:35:03.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:02 smithi137 ceph-mon[31694]: pgmap v1385: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.3 MiB/s wr, 35 op/s 2024-04-23T15:35:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:03 smithi007 ceph-mon[27906]: osdmap e167: 12 total, 12 up, 12 in 2024-04-23T15:35:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:03 smithi186 ceph-mon[31814]: osdmap e167: 12 total, 12 up, 12 in 2024-04-23T15:35:04.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:03 smithi137 ceph-mon[31694]: osdmap e167: 12 total, 12 up, 12 in 2024-04-23T15:35:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:04 smithi007 ceph-mon[27906]: pgmap v1387: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.1 MiB/s wr, 36 op/s 2024-04-23T15:35:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:04 smithi186 ceph-mon[31814]: pgmap v1387: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.1 MiB/s wr, 36 op/s 2024-04-23T15:35:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:04 smithi137 ceph-mon[31694]: pgmap v1387: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.1 MiB/s wr, 36 op/s 2024-04-23T15:35:07.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:06 smithi007 ceph-mon[27906]: pgmap v1388: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.1 MiB/s wr, 36 op/s 2024-04-23T15:35:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:06 smithi186 ceph-mon[31814]: pgmap v1388: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.1 MiB/s wr, 36 op/s 2024-04-23T15:35:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:06 smithi137 ceph-mon[31694]: pgmap v1388: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.1 MiB/s wr, 36 op/s 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 -- 172.21.15.7:0/3983652403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 msgr2=0x7fbb44101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/3983652403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb44101190 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009900 tx=0x7fbb3802a470 comp rx=0 tx=0).stop 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 -- 172.21.15.7:0/3983652403 shutdown_connections 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/3983652403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441061b0 0x7fbb44106640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/3983652403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb441016d0 0x7fbb44105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/3983652403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb44101190 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.861+0000 7fbb4aa00640 1 -- 172.21.15.7:0/3983652403 >> 172.21.15.7:0/3983652403 conn(0x7fbb440fc820 msgr2=0x7fbb440fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.862+0000 7fbb4aa00640 1 -- 172.21.15.7:0/3983652403 shutdown_connections 2024-04-23T15:35:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.862+0000 7fbb4aa00640 1 -- 172.21.15.7:0/3983652403 wait complete. 2024-04-23T15:35:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 Processor -- start 2024-04-23T15:35:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 -- start start 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb441a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441016d0 0x7fbb441a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb441061b0 0x7fbb4419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441186b0 con 0x7fbb44100db0 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44118530 con 0x7fbb441016d0 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.863+0000 7fbb4aa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44118830 con 0x7fbb441061b0 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb441a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb441a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56620/0 (socket says 172.21.15.7:56620) 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 -- 172.21.15.7:0/2464781912 learned_addr learned my addr 172.21.15.7:0/2464781912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb48c00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441016d0 0x7fbb441a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb4a000640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb441061b0 0x7fbb4419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 -- 172.21.15.7:0/2464781912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb441061b0 msgr2=0x7fbb4419e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb441061b0 0x7fbb4419e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 -- 172.21.15.7:0/2464781912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441016d0 msgr2=0x7fbb441a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441016d0 0x7fbb441a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb49600640 1 -- 172.21.15.7:0/2464781912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4419f150 con 0x7fbb44100db0 2024-04-23T15:35:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.864+0000 7fbb48c00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441016d0 0x7fbb441a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.865+0000 7fbb49600640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb441a4820 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fbb38005ab0 tx=0x7fbb38003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.865+0000 7fbb42000640 1 -- 172.21.15.7:0/2464781912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3803f070 con 0x7fbb44100db0 2024-04-23T15:35:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.865+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4419f3e0 con 0x7fbb44100db0 2024-04-23T15:35:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.865+0000 7fbb42000640 1 -- 172.21.15.7:0/2464781912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb38031d60 con 0x7fbb44100db0 2024-04-23T15:35:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.865+0000 7fbb42000640 1 -- 172.21.15.7:0/2464781912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38035030 con 0x7fbb44100db0 2024-04-23T15:35:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.865+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb441ab6e0 con 0x7fbb44100db0 2024-04-23T15:35:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 Processor -- start 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 -- start start 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb42000640 1 -- 172.21.15.7:0/2464781912 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbb38042070 con 0x7fbb44100db0 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf5647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf564ce0 0x563bdf56f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 0x563bdf571990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bdf4ca900 con 0x563bdf56f5a0 2024-04-23T15:35:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563bdf470f20 con 0x563bdf5643c0 2024-04-23T15:35:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.869+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563bdf4c68c0 con 0x563bdf564ce0 2024-04-23T15:35:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 0x563bdf571990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 0x563bdf571990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56628/0 (socket says 172.21.15.7:56628) 2024-04-23T15:35:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 -- 172.21.15.7:0/788742228 learned_addr learned my addr 172.21.15.7:0/788742228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb49600640 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf564ce0 0x563bdf56f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb4a000640 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf5647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 -- 172.21.15.7:0/788742228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf564ce0 msgr2=0x563bdf56f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf564ce0 0x563bdf56f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 -- 172.21.15.7:0/788742228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 msgr2=0x563bdf5647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf5647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.870+0000 7fbb48c00640 1 -- 172.21.15.7:0/788742228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdf495e10 con 0x563bdf56f5a0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb49600640 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf564ce0 0x563bdf56f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb48c00640 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 0x563bdf571990 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000bbb0 tx=0x7fbb3000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de90bbbb65eaab7c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb42000640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb2c0a3d10 0x7fbb2c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb36600640 1 -- 172.21.15.7:0/788742228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30017620 con 0x563bdf56f5a0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb42000640 1 -- 172.21.15.7:0/2464781912 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 9555+0+0 (secure 0 0 0) 0x7fbb380f15b0 con 0x7fbb44100db0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb36600640 1 -- 172.21.15.7:0/788742228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb30017c70 con 0x563bdf56f5a0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb36600640 1 -- 172.21.15.7:0/788742228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000fc90 con 0x563bdf56f5a0 2024-04-23T15:35:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.871+0000 7fbb4a000640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb2c0a3d10 0x7fbb2c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 -- 172.21.15.7:0/788742228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 msgr2=0x563bdf571990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 0x563bdf571990 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000bbb0 tx=0x7fbb3000d710 comp rx=0 tx=0).stop 2024-04-23T15:35:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4a000640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb2c0a3d10 0x7fbb2c0a61d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c005fd0 tx=0x7fbb3c009760 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 -- 172.21.15.7:0/788742228 shutdown_connections 2024-04-23T15:35:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf56f5a0 0x563bdf571990 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf564ce0 0x563bdf56f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/788742228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf5647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 -- 172.21.15.7:0/788742228 >> 172.21.15.7:0/788742228 conn(0x563bdf5608d0 msgr2=0x563bdf560cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 -- 172.21.15.7:0/788742228 shutdown_connections 2024-04-23T15:35:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 -- 172.21.15.7:0/788742228 wait complete. 2024-04-23T15:35:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.873+0000 7fbb4ee35740 1 -- start start 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 Processor -- start 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf56c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 0x563bdf56cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf56f5a0 0x563bdf56d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bdf5720e0 con 0x563bdf564ce0 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563bdf4842c0 con 0x563bdf5643c0 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563bdf572260 con 0x563bdf56f5a0 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.874+0000 7fbb4ee35740 10 client.0 _ll_register_callbacks cb 0x563bdf1dca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 0x563bdf56cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 0x563bdf56cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56630/0 (socket says 172.21.15.7:56630) 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 -- 172.21.15.7:0/4257791188 learned_addr learned my addr 172.21.15.7:0/4257791188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb49600640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf56c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb4a000640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf56f5a0 0x563bdf56d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 -- 172.21.15.7:0/4257791188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf56f5a0 msgr2=0x563bdf56d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf56f5a0 0x563bdf56d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 -- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 msgr2=0x563bdf56c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf56c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.875+0000 7fbb48c00640 1 -- 172.21.15.7:0/4257791188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdf494fd0 con 0x563bdf564ce0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb48c00640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 0x563bdf56cae0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000bb80 tx=0x7fbb3000fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6332fa8fc2f89dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb2aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb2aa00640 1 -- 172.21.15.7:0/4257791188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30025020 con 0x563bdf564ce0 2024-04-23T15:35:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb30017c70 con 0x563bdf564ce0 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb2aa00640 1 -- 172.21.15.7:0/4257791188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 9555+0+0 (secure 0 0 0) 0x7fbb30005250 con 0x563bdf564ce0 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb2aa00640 1 -- 172.21.15.7:0/4257791188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbb30030050 con 0x563bdf564ce0 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb4ee35740 10 client.19197 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.876+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563bdf1dd210 con 0x563bdf564ce0 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb2aa00640 1 -- 172.21.15.7:0/4257791188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb30017c70 con 0x563bdf564ce0 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb2aa00640 1 -- 172.21.15.7:0/4257791188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbb300178d0 con 0x563bdf564ce0 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb4ee35740 10 client.19197 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb4ee35740 10 client.19197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb4ee35740 20 client.19197 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf57f670 0x563bdf581a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb4ee35740 4 client.19197 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:35:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.877+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bdf4d8320 con 0x563bdf57f670 2024-04-23T15:35:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.878+0000 7fbb49600640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf57f670 0x563bdf581a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.879+0000 7fbb49600640 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf57f670 0x563bdf581a60 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=237945b94fbc7a29 server_cookie=8fbeec604027d2bd in_seq=0 out_seq=0 2024-04-23T15:35:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.879+0000 7fbb2aa00640 10 client.19197 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb2aa00640 1 -- 172.21.15.7:0/4257791188 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563bdf4d8320 con 0x563bdf57f670 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb2aa00640 10 client.19197 handle_command_reply: tid=0 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 client.19197 shutdown 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 msgr2=0x563bdf56cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 0x563bdf56cae0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000bb80 tx=0x7fbb3000fef0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 shutdown_connections 2024-04-23T15:35:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf57f670 0x563bdf581a60 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf56f5a0 0x563bdf56d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf564ce0 0x563bdf56cae0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/4257791188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf5643c0 0x563bdf56c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb2aa00640 0 client.19197 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 >> 172.21.15.7:0/4257791188 conn(0x563bdf5608d0 msgr2=0x563bdf55fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 shutdown_connections 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 1 -- 172.21.15.7:0/4257791188 wait complete. 2024-04-23T15:35:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.881+0000 7fbb4ee35740 20 client.19197 trim_cache size 0 max 16384 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 Processor -- start 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 -- start start 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf56ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf57b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b5880 con 0x563bdf5643c0 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b73c0 con 0x563bdf564ce0 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.898+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b5f50 con 0x563bdf5608d0 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf57b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf57b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56634/0 (socket says 172.21.15.7:56634) 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 -- 172.21.15.7:0/2384429102 learned_addr learned my addr 172.21.15.7:0/2384429102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb49600640 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf56ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb4a000640 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 -- 172.21.15.7:0/2384429102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 msgr2=0x563bdf56ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf56ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 -- 172.21.15.7:0/2384429102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 msgr2=0x563bdf5655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb48c00640 1 -- 172.21.15.7:0/2384429102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdf2a9620 con 0x563bdf5643c0 2024-04-23T15:35:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.899+0000 7fbb4a000640 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.900+0000 7fbb48c00640 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf57b090 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fbb300057c0 tx=0x7fbb30001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e81ad32ed46300 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.900+0000 7fbb35c00640 1 -- 172.21.15.7:0/2384429102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30039070 con 0x563bdf5643c0 2024-04-23T15:35:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.900+0000 7fbb35c00640 1 -- 172.21.15.7:0/2384429102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb300178d0 con 0x563bdf5643c0 2024-04-23T15:35:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.900+0000 7fbb35c00640 1 -- 172.21.15.7:0/2384429102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30025070 con 0x563bdf5643c0 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 -- 172.21.15.7:0/2384429102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 msgr2=0x563bdf57b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf57b090 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fbb300057c0 tx=0x7fbb30001e70 comp rx=0 tx=0).stop 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 -- 172.21.15.7:0/2384429102 shutdown_connections 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf57b090 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/2384429102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf56ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 -- 172.21.15.7:0/2384429102 >> 172.21.15.7:0/2384429102 conn(0x563bdf55be60 msgr2=0x563bdf55f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 -- 172.21.15.7:0/2384429102 shutdown_connections 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 -- 172.21.15.7:0/2384429102 wait complete. 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.901+0000 7fbb4ee35740 1 -- start start 2024-04-23T15:35:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 Processor -- start 2024-04-23T15:35:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf577810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf572b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b6cf0 con 0x563bdf5643c0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b6620 con 0x563bdf564ce0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b3880 con 0x563bdf5608d0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.902+0000 7fbb4ee35740 10 client.0 _ll_register_callbacks cb 0x7fbb3c009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf572b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf572b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56650/0 (socket says 172.21.15.7:56650) 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 -- 172.21.15.7:0/40755247 learned_addr learned my addr 172.21.15.7:0/40755247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb49600640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf577810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 -- 172.21.15.7:0/40755247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 msgr2=0x563bdf577810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb4a000640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf577810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 -- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 msgr2=0x563bdf5730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5730c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb48c00640 1 -- 172.21.15.7:0/40755247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdf573760 con 0x563bdf5643c0 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.903+0000 7fbb49600640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf577810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb48c00640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf572b80 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fbb30006010 tx=0x7fbb300053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7cf6581a30e918 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb2aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb2aa00640 1 -- 172.21.15.7:0/40755247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30044060 con 0x563bdf5643c0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb2aa00640 1 -- 172.21.15.7:0/40755247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 9555+0+0 (secure 0 0 0) 0x7fbb3000f630 con 0x563bdf5643c0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb300178d0 con 0x563bdf5643c0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb2aa00640 1 -- 172.21.15.7:0/40755247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbb3004b050 con 0x563bdf5643c0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb4ee35740 10 client.19203 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.904+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563bdf5e5700 con 0x563bdf5643c0 2024-04-23T15:35:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb2aa00640 1 -- 172.21.15.7:0/40755247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb300178d0 con 0x563bdf5643c0 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb2aa00640 1 -- 172.21.15.7:0/40755247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fbb30021450 con 0x563bdf5643c0 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb4ee35740 10 client.19203 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb4ee35740 10 client.19203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb4ee35740 20 client.19203 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf56f5a0 0x563bdf5e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb4ee35740 4 client.19203 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.905+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563bdf4d2190 con 0x563bdf56f5a0 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.906+0000 7fbb49600640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf56f5a0 0x563bdf5e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.906+0000 7fbb49600640 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf56f5a0 0x563bdf5e7e00 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f68ee3a863ed8fe server_cookie=e9eb55e10afcb81e in_seq=0 out_seq=0 2024-04-23T15:35:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.906+0000 7fbb2aa00640 10 client.19203 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.944+0000 7fbb2aa00640 1 -- 172.21.15.7:0/40755247 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bdf4d2190 con 0x563bdf56f5a0 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.944+0000 7fbb2aa00640 10 client.19203 handle_command_reply: tid=0 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.944+0000 7fbb4ee35740 1 client.19203 shutdown 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 msgr2=0x563bdf572b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf572b80 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fbb30006010 tx=0x7fbb300053e0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 shutdown_connections 2024-04-23T15:35:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563bdf56f5a0 0x563bdf5e7e00 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bdf564ce0 0x563bdf5730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bdf5643c0 0x563bdf572b80 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 --2- 172.21.15.7:0/40755247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdf5608d0 0x563bdf577810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb2aa00640 0 client.19203 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 >> 172.21.15.7:0/40755247 conn(0x563bdf55be60 msgr2=0x563bdf55fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 shutdown_connections 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 1 -- 172.21.15.7:0/40755247 wait complete. 2024-04-23T15:35:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.945+0000 7fbb4ee35740 20 client.19203 trim_cache size 0 max 16384 2024-04-23T15:35:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:35:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:35:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:35:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:35:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb2c0a3d10 msgr2=0x7fbb2c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb2c0a3d10 0x7fbb2c0a61d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c005fd0 tx=0x7fbb3c009760 comp rx=0 tx=0).stop 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 msgr2=0x7fbb441a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb441a4820 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fbb38005ab0 tx=0x7fbb38003cd0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 shutdown_connections 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbb2c0a3d10 0x7fbb2c0a61d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb441016d0 0x7fbb441a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb441061b0 0x7fbb4419e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 --2- 172.21.15.7:0/2464781912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb44100db0 0x7fbb441a4820 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.946+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 >> 172.21.15.7:0/2464781912 conn(0x7fbb440fc820 msgr2=0x7fbb440fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.947+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 shutdown_connections 2024-04-23T15:35:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:08.947+0000 7fbb4aa00640 1 -- 172.21.15.7:0/2464781912 wait complete. 2024-04-23T15:35:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:08 smithi007 ceph-mon[27906]: pgmap v1389: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:35:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:08 smithi186 ceph-mon[31814]: pgmap v1389: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:35:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:08 smithi137 ceph-mon[31694]: pgmap v1389: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:35:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:10 smithi186 ceph-mon[31814]: pgmap v1390: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:35:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:10 smithi137 ceph-mon[31694]: pgmap v1390: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:35:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:10 smithi007 ceph-mon[27906]: pgmap v1390: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 32 op/s 2024-04-23T15:35:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:12 smithi007 ceph-mon[27906]: osdmap e168: 12 total, 12 up, 12 in 2024-04-23T15:35:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:12 smithi007 ceph-mon[27906]: pgmap v1392: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 19 op/s 2024-04-23T15:35:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:12 smithi186 ceph-mon[31814]: osdmap e168: 12 total, 12 up, 12 in 2024-04-23T15:35:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:12 smithi186 ceph-mon[31814]: pgmap v1392: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 19 op/s 2024-04-23T15:35:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:12 smithi137 ceph-mon[31694]: osdmap e168: 12 total, 12 up, 12 in 2024-04-23T15:35:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:12 smithi137 ceph-mon[31694]: pgmap v1392: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 19 op/s 2024-04-23T15:35:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:14 smithi007 ceph-mon[27906]: pgmap v1393: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:35:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:14 smithi186 ceph-mon[31814]: pgmap v1393: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:35:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:14 smithi137 ceph-mon[31694]: pgmap v1393: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:35:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:16 smithi007 ceph-mon[27906]: pgmap v1394: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:35:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:16 smithi186 ceph-mon[31814]: pgmap v1394: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:35:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:16 smithi137 ceph-mon[31694]: pgmap v1394: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 17 op/s 2024-04-23T15:35:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:18 smithi007 ceph-mon[27906]: pgmap v1395: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:35:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:18 smithi186 ceph-mon[31814]: pgmap v1395: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:35:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:18 smithi137 ceph-mon[31694]: pgmap v1395: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:35:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:20 smithi007 ceph-mon[27906]: pgmap v1396: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:35:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:20 smithi186 ceph-mon[31814]: pgmap v1396: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:35:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:20 smithi137 ceph-mon[31694]: pgmap v1396: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 17 op/s 2024-04-23T15:35:22.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 -- 172.21.15.7:0/186465642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103060 msgr2=0x7f0184103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 --2- 172.21.15.7:0/186465642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103060 0x7f0184103440 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f0174009900 tx=0x7f017402a480 comp rx=0 tx=0).stop 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 -- 172.21.15.7:0/186465642 shutdown_connections 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 --2- 172.21.15.7:0/186465642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018410c430 0x7f018410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 --2- 172.21.15.7:0/186465642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0184103980 0x7f018410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 --2- 172.21.15.7:0/186465642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103060 0x7f0184103440 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 -- 172.21.15.7:0/186465642 >> 172.21.15.7:0/186465642 conn(0x7f01840fc820 msgr2=0x7f01840fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 -- 172.21.15.7:0/186465642 shutdown_connections 2024-04-23T15:35:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.110+0000 7f0189a00640 1 -- 172.21.15.7:0/186465642 wait complete. 2024-04-23T15:35:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.111+0000 7f0189a00640 1 Processor -- start 2024-04-23T15:35:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.111+0000 7f0189a00640 1 -- start start 2024-04-23T15:35:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.111+0000 7f0189a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0184103060 0x7f0184198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0189a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 0x7f0184198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0189a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018410c430 0x7f018419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0189a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01841120c0 con 0x7f0184103980 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0189a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0184111f40 con 0x7f018410c430 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0189a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0184112240 con 0x7f0184103060 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0183400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 0x7f0184198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0183400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 0x7f0184198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40312/0 (socket says 172.21.15.7:40312) 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0183400640 1 -- 172.21.15.7:0/3653440530 learned_addr learned my addr 172.21.15.7:0/3653440530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0183e00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0184103060 0x7f0184198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.112+0000 7f0189000640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018410c430 0x7f018419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0183400640 1 -- 172.21.15.7:0/3653440530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0184103060 msgr2=0x7f0184198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0183400640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0184103060 0x7f0184198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0183400640 1 -- 172.21.15.7:0/3653440530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018410c430 msgr2=0x7f018419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0183400640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018410c430 0x7f018419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0183400640 1 -- 172.21.15.7:0/3653440530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018419d5c0 con 0x7f0184103980 2024-04-23T15:35:22.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:35:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0183400640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 0x7f0184198b60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f017000d770 tx=0x7f017000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0180c00640 1 -- 172.21.15.7:0/3653440530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170017070 con 0x7f0184103980 2024-04-23T15:35:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0180c00640 1 -- 172.21.15.7:0/3653440530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01700054d0 con 0x7f0184103980 2024-04-23T15:35:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018419d8b0 con 0x7f0184103980 2024-04-23T15:35:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.113+0000 7f0180c00640 1 -- 172.21.15.7:0/3653440530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170004cf0 con 0x7f0184103980 2024-04-23T15:35:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.114+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01841a5140 con 0x7f0184103980 2024-04-23T15:35:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.117+0000 7f018dfd4740 1 Processor -- start 2024-04-23T15:35:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 -- start start 2024-04-23T15:35:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c58bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c63470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f0180c00640 1 -- 172.21.15.7:0/3653440530 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f0170004e90 con 0x7f0184103980 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c65da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556da2bba900 con 0x556da2c587d0 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556da2b60f20 con 0x556da2c639b0 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.118+0000 7f018dfd4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556da2bb68c0 con 0x556da2c590f0 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c63470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c63470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:32990/0 (socket says 172.21.15.7:32990) 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183e00640 1 -- 172.21.15.7:0/2663284002 learned_addr learned my addr 172.21.15.7:0/2663284002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183400640 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c65da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0189000640 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c58bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183e00640 1 -- 172.21.15.7:0/2663284002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 msgr2=0x556da2c65da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183e00640 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c65da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.119+0000 7f0183e00640 1 -- 172.21.15.7:0/2663284002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 msgr2=0x556da2c58bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.120+0000 7f0183e00640 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c58bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.120+0000 7f0183e00640 1 -- 172.21.15.7:0/2663284002 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556da2b85e10 con 0x556da2c590f0 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.120+0000 7f0189000640 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c58bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:35:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.120+0000 7f0183e00640 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c63470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0174009230 tx=0x7f0174042e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b864ef71f3b75749 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.121+0000 7f0180c00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f01680a3d10 0x7f01680a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.121+0000 7f0179600640 1 -- 172.21.15.7:0/2663284002 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174035040 con 0x556da2c590f0 2024-04-23T15:35:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.121+0000 7f0180c00640 1 -- 172.21.15.7:0/3653440530 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7f01700d05e0 con 0x7f0184103980 2024-04-23T15:35:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.121+0000 7f0189000640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f01680a3d10 0x7f01680a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.121+0000 7f0179600640 1 -- 172.21.15.7:0/2663284002 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01740054f0 con 0x556da2c590f0 2024-04-23T15:35:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.121+0000 7f0179600640 1 -- 172.21.15.7:0/2663284002 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174004e10 con 0x556da2c590f0 2024-04-23T15:35:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 -- 172.21.15.7:0/2663284002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 msgr2=0x556da2c63470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c63470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0174009230 tx=0x7f0174042e40 comp rx=0 tx=0).stop 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f0189000640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f01680a3d10 0x7f01680a61d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f017c010540 tx=0x7f017c007520 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 -- 172.21.15.7:0/2663284002 shutdown_connections 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c65da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c63470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 --2- 172.21.15.7:0/2663284002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c58bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 -- 172.21.15.7:0/2663284002 >> 172.21.15.7:0/2663284002 conn(0x556da2c54ce0 msgr2=0x556da2c550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 -- 172.21.15.7:0/2663284002 shutdown_connections 2024-04-23T15:35:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.122+0000 7f018dfd4740 1 -- 172.21.15.7:0/2663284002 wait complete. 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.123+0000 7f018dfd4740 1 -- start start 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.123+0000 7f018dfd4740 1 Processor -- start 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c5ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c5cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c5d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556da2c50440 con 0x556da2c587d0 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556da2b742c0 con 0x556da2c639b0 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556da2c505c0 con 0x556da2c590f0 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f018dfd4740 10 client.0 _ll_register_callbacks cb 0x556da28cca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c5ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c5ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40332/0 (socket says 172.21.15.7:40332) 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183e00640 1 -- 172.21.15.7:0/1920828756 learned_addr learned my addr 172.21.15.7:0/1920828756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183400640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c5cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0189000640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c5d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183e00640 1 -- 172.21.15.7:0/1920828756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 msgr2=0x556da2c5cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183e00640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c5cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.124+0000 7f0183e00640 1 -- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 msgr2=0x556da2c5d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f0183e00640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c5d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f0183e00640 1 -- 172.21.15.7:0/1920828756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556da2b84fd0 con 0x556da2c587d0 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f0189000640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c5d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f0183400640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c5cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f0183e00640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c5ca80 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f017404c040 tx=0x7f017402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe98473d84a672a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f016e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f016e000640 1 -- 172.21.15.7:0/1920828756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174059020 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.125+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01740054f0 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.126+0000 7f016e000640 1 -- 172.21.15.7:0/1920828756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7f0174041d70 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.126+0000 7f016e000640 1 -- 172.21.15.7:0/1920828756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0174064050 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.126+0000 7f018dfd4740 10 client.19215 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.126+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556da28cd210 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.126+0000 7f016e000640 1 -- 172.21.15.7:0/1920828756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01740054f0 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.126+0000 7f016e000640 1 -- 172.21.15.7:0/1920828756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f0174049030 con 0x556da2c587d0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f018dfd4740 10 client.19215 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f018dfd4740 10 client.19215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f018dfd4740 20 client.19215 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f018dfd4740 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2c6f4f0 0x556da2c718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f018dfd4740 4 client.19215 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556da2bc8320 con 0x556da2c6f4f0 2024-04-23T15:35:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.127+0000 7f0183400640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2c6f4f0 0x556da2c718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.128+0000 7f0183400640 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2c6f4f0 0x556da2c718e0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1df0be28d922135 server_cookie=aeb85920d6e866f3 in_seq=0 out_seq=0 2024-04-23T15:35:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.128+0000 7f016e000640 10 client.19215 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f016e000640 1 -- 172.21.15.7:0/1920828756 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556da2bc8320 con 0x556da2c6f4f0 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f016e000640 10 client.19215 handle_command_reply: tid=0 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 client.19215 shutdown 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 msgr2=0x556da2c5ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c5ca80 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f017404c040 tx=0x7f017402a480 comp rx=0 tx=0).stop 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 shutdown_connections 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2c6f4f0 0x556da2c718e0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c639b0 0x556da2c5d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c590f0 0x556da2c5cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 --2- 172.21.15.7:0/1920828756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c587d0 0x556da2c5ca80 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 >> 172.21.15.7:0/1920828756 conn(0x556da2c54ce0 msgr2=0x556da2c4fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.130+0000 7f016e000640 0 client.19215 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.131+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 shutdown_connections 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.131+0000 7f018dfd4740 1 -- 172.21.15.7:0/1920828756 wait complete. 2024-04-23T15:35:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.131+0000 7f018dfd4740 20 client.19215 trim_cache size 0 max 16384 2024-04-23T15:35:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.150+0000 7f018dfd4740 1 Processor -- start 2024-04-23T15:35:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.150+0000 7f018dfd4740 1 -- start start 2024-04-23T15:35:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c587d0 0x556da2c630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c590f0 0x556da2c4f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 0x556da2c76e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f018dfd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01841acef0 con 0x556da2c639b0 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f018dfd4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01841aea30 con 0x556da2c590f0 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f018dfd4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f01841ad5c0 con 0x556da2c587d0 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f0189000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 0x556da2c76e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f0189000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 0x556da2c76e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40346/0 (socket says 172.21.15.7:40346) 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f0189000640 1 -- 172.21.15.7:0/3703947654 learned_addr learned my addr 172.21.15.7:0/3703947654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f0183e00640 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c587d0 0x556da2c630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.151+0000 7f0183400640 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c590f0 0x556da2c4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0189000640 1 -- 172.21.15.7:0/3703947654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c587d0 msgr2=0x556da2c630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0189000640 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c587d0 0x556da2c630f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0189000640 1 -- 172.21.15.7:0/3703947654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c590f0 msgr2=0x556da2c4f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0189000640 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c590f0 0x556da2c4f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0189000640 1 -- 172.21.15.7:0/3703947654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556da2999620 con 0x556da2c639b0 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0183e00640 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c587d0 0x556da2c630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.152+0000 7f0189000640 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 0x556da2c76e80 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f017c00f860 tx=0x7f017c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c3c69edb3e921d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.153+0000 7f0178c00640 1 -- 172.21.15.7:0/3703947654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c00fde0 con 0x556da2c639b0 2024-04-23T15:35:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.153+0000 7f0178c00640 1 -- 172.21.15.7:0/3703947654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f017c003e20 con 0x556da2c639b0 2024-04-23T15:35:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.153+0000 7f0178c00640 1 -- 172.21.15.7:0/3703947654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c004050 con 0x556da2c639b0 2024-04-23T15:35:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.153+0000 7f018dfd4740 1 -- 172.21.15.7:0/3703947654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 msgr2=0x556da2c76e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.153+0000 7f018dfd4740 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 0x556da2c76e80 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f017c00f860 tx=0x7f017c015000 comp rx=0 tx=0).stop 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.153+0000 7f018dfd4740 1 -- 172.21.15.7:0/3703947654 shutdown_connections 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c590f0 0x556da2c4f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c639b0 0x556da2c76e80 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 --2- 172.21.15.7:0/3703947654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c587d0 0x556da2c630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 -- 172.21.15.7:0/3703947654 >> 172.21.15.7:0/3703947654 conn(0x556da2c54ce0 msgr2=0x556da2c4f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 -- 172.21.15.7:0/3703947654 shutdown_connections 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 -- 172.21.15.7:0/3703947654 wait complete. 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.154+0000 7f018dfd4740 1 -- start start 2024-04-23T15:35:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 Processor -- start 2024-04-23T15:35:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c587d0 0x556da2c68d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 0x556da2c692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c639b0 0x556da2c66460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01841ae360 con 0x556da2c590f0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01841adc90 con 0x556da2c587d0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f01841aaef0 con 0x556da2c639b0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.155+0000 7f018dfd4740 10 client.0 _ll_register_callbacks cb 0x7f017c007860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 0x556da2c692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 0x556da2c692a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40354/0 (socket says 172.21.15.7:40354) 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 -- 172.21.15.7:0/440170159 learned_addr learned my addr 172.21.15.7:0/440170159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0189000640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c639b0 0x556da2c66460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183e00640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c587d0 0x556da2c68d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 -- 172.21.15.7:0/440170159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c639b0 msgr2=0x556da2c66460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c639b0 0x556da2c66460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 -- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c587d0 msgr2=0x556da2c68d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c587d0 0x556da2c68d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183400640 1 -- 172.21.15.7:0/440170159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556da2c66c60 con 0x556da2c590f0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.156+0000 7f0183e00640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c587d0 0x556da2c68d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f0183400640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 0x556da2c692a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f0170009610 tx=0x7f01700d2a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62151875259e9dac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f016e000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f016e000640 1 -- 172.21.15.7:0/440170159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170020040 con 0x556da2c590f0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f016e000640 1 -- 172.21.15.7:0/440170159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7f01700cdba0 con 0x556da2c590f0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f017c003e20 con 0x556da2c590f0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f016e000640 1 -- 172.21.15.7:0/440170159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f017009bb80 con 0x556da2c590f0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f018dfd4740 10 client.19221 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.157+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556da2cd53b0 con 0x556da2c590f0 2024-04-23T15:35:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f016e000640 1 -- 172.21.15.7:0/440170159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f017c003e20 con 0x556da2c590f0 2024-04-23T15:35:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f016e000640 1 -- 172.21.15.7:0/440170159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f01700a0110 con 0x556da2c590f0 2024-04-23T15:35:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f018dfd4740 10 client.19221 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f018dfd4740 10 client.19221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f018dfd4740 20 client.19221 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f018dfd4740 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2cd5ae0 0x556da2cd7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f018dfd4740 4 client.19221 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:35:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.158+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556da2bc2190 con 0x556da2cd5ae0 2024-04-23T15:35:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.159+0000 7f0183e00640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2cd5ae0 0x556da2cd7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.159+0000 7f016e000640 10 client.19221 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.159+0000 7f0183e00640 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2cd5ae0 0x556da2cd7f00 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa922e541bf91c6f server_cookie=d3a066b240ee70aa in_seq=0 out_seq=0 2024-04-23T15:35:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f016e000640 1 -- 172.21.15.7:0/440170159 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556da2bc2190 con 0x556da2cd5ae0 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f016e000640 10 client.19221 handle_command_reply: tid=0 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 client.19221 shutdown 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 msgr2=0x556da2c692a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 0x556da2c692a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f0170009610 tx=0x7f01700d2a30 comp rx=0 tx=0).stop 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 shutdown_connections 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556da2cd5ae0 0x556da2cd7f00 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da2c639b0 0x556da2c66460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556da2c590f0 0x556da2c692a0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 --2- 172.21.15.7:0/440170159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556da2c587d0 0x556da2c68d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 >> 172.21.15.7:0/440170159 conn(0x556da2c54ce0 msgr2=0x556da2c60b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.188+0000 7f016e000640 0 client.19221 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.189+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 shutdown_connections 2024-04-23T15:35:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.189+0000 7f018dfd4740 1 -- 172.21.15.7:0/440170159 wait complete. 2024-04-23T15:35:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.189+0000 7f018dfd4740 20 client.19221 trim_cache size 0 max 16384 2024-04-23T15:35:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:35:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:35:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:35:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f01680a3d10 msgr2=0x7f01680a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f01680a3d10 0x7f01680a61d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f017c010540 tx=0x7f017c007520 comp rx=0 tx=0).stop 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 msgr2=0x7f0184198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 0x7f0184198b60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f017000d770 tx=0x7f017000dc30 comp rx=0 tx=0).stop 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 shutdown_connections 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f01680a3d10 0x7f01680a61d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018410c430 0x7f018419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0184103980 0x7f0184198b60 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 --2- 172.21.15.7:0/3653440530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0184103060 0x7f0184198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 >> 172.21.15.7:0/3653440530 conn(0x7f01840fc820 msgr2=0x7f01840fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 shutdown_connections 2024-04-23T15:35:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:22.190+0000 7f0189a00640 1 -- 172.21.15.7:0/3653440530 wait complete. 2024-04-23T15:35:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:22 smithi007 ceph-mon[27906]: pgmap v1397: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.9 MiB/s wr, 22 op/s 2024-04-23T15:35:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:22 smithi186 ceph-mon[31814]: pgmap v1397: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.9 MiB/s wr, 22 op/s 2024-04-23T15:35:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:22 smithi137 ceph-mon[31694]: pgmap v1397: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.9 MiB/s wr, 22 op/s 2024-04-23T15:35:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:23 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:35:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:23 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:35:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:23 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:35:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:23 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:35:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:23 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:35:24.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:23 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:35:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:23 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:35:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:23 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:35:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:23 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:35:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:25 smithi007 ceph-mon[27906]: pgmap v1398: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:35:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:25 smithi186 ceph-mon[31814]: pgmap v1398: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:35:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:25 smithi137 ceph-mon[31694]: pgmap v1398: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:35:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:27 smithi007 ceph-mon[27906]: pgmap v1399: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:35:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:27 smithi186 ceph-mon[31814]: pgmap v1399: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:35:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:27 smithi137 ceph-mon[31694]: pgmap v1399: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:35:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:29 smithi007 ceph-mon[27906]: pgmap v1400: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:35:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:29 smithi186 ceph-mon[31814]: pgmap v1400: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:35:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:29 smithi137 ceph-mon[31694]: pgmap v1400: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:35:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:31 smithi007 ceph-mon[27906]: pgmap v1401: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:35:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:31 smithi186 ceph-mon[31814]: pgmap v1401: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:35:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:31 smithi137 ceph-mon[31694]: pgmap v1401: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:35:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:33 smithi007 ceph-mon[27906]: pgmap v1402: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:35:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:33 smithi186 ceph-mon[31814]: pgmap v1402: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:35:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:33 smithi137 ceph-mon[31694]: pgmap v1402: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.7 MiB/s wr, 19 op/s 2024-04-23T15:35:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:35 smithi007 ceph-mon[27906]: pgmap v1403: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.352+0000 7fe813e00640 1 -- 172.21.15.7:0/3812555607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 msgr2=0x7fe8141033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.352+0000 7fe813e00640 1 --2- 172.21.15.7:0/3812555607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141033a0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe804009900 tx=0x7fe80402a480 comp rx=0 tx=0).stop 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 -- 172.21.15.7:0/3812555607 shutdown_connections 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 --2- 172.21.15.7:0/3812555607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81410c3e0 0x7fe81410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 --2- 172.21.15.7:0/3812555607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8141038e0 0x7fe81410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 --2- 172.21.15.7:0/3812555607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141033a0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 -- 172.21.15.7:0/3812555607 >> 172.21.15.7:0/3812555607 conn(0x7fe8140fc820 msgr2=0x7fe8140fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 -- 172.21.15.7:0/3812555607 shutdown_connections 2024-04-23T15:35:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.353+0000 7fe813e00640 1 -- 172.21.15.7:0/3812555607 wait complete. 2024-04-23T15:35:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.354+0000 7fe813e00640 1 Processor -- start 2024-04-23T15:35:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.354+0000 7fe813e00640 1 -- start start 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8141038e0 0x7fe8141a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81410c3e0 0x7fe81419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141120c0 con 0x7fe814102fc0 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe814111f40 con 0x7fe81410c3e0 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe814112240 con 0x7fe8141038e0 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe812a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe812a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53028/0 (socket says 172.21.15.7:53028) 2024-04-23T15:35:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe812a00640 1 -- 172.21.15.7:0/194555540 learned_addr learned my addr 172.21.15.7:0/194555540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe813400640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81410c3e0 0x7fe81419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.355+0000 7fe812000640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8141038e0 0x7fe8141a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe812a00640 1 -- 172.21.15.7:0/194555540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8141038e0 msgr2=0x7fe8141a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe812a00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8141038e0 0x7fe8141a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe812a00640 1 -- 172.21.15.7:0/194555540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81410c3e0 msgr2=0x7fe81419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe812a00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81410c3e0 0x7fe81419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe812a00640 1 -- 172.21.15.7:0/194555540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81419afa0 con 0x7fe814102fc0 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe812a00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141a0620 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe804005ab0 tx=0x7fe804003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe80b400640 1 -- 172.21.15.7:0/194555540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80403f070 con 0x7fe814102fc0 2024-04-23T15:35:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe80b400640 1 -- 172.21.15.7:0/194555540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe804031d60 con 0x7fe814102fc0 2024-04-23T15:35:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.356+0000 7fe80b400640 1 -- 172.21.15.7:0/194555540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804035030 con 0x7fe814102fc0 2024-04-23T15:35:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.357+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81419b230 con 0x7fe814102fc0 2024-04-23T15:35:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.357+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8141a73c0 con 0x7fe814102fc0 2024-04-23T15:35:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.360+0000 7fe80b400640 1 -- 172.21.15.7:0/194555540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe804042070 con 0x7fe814102fc0 2024-04-23T15:35:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.360+0000 7fe81c7a7740 1 Processor -- start 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 -- start start 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d76c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 0x55660d777060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d779990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55660d6d2900 con 0x55660d76cce0 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55660d678f20 con 0x55660d7775a0 2024-04-23T15:35:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.361+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55660d6ce8c0 con 0x55660d76c3c0 2024-04-23T15:35:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:35 smithi186 ceph-mon[31814]: pgmap v1403: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:35:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 0x55660d777060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 0x55660d777060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53036/0 (socket says 172.21.15.7:53036) 2024-04-23T15:35:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 -- 172.21.15.7:0/791545667 learned_addr learned my addr 172.21.15.7:0/791545667 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812000640 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d779990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe813400640 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d76c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe80b400640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3d90 0x7fe7f80a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 -- 172.21.15.7:0/791545667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 msgr2=0x55660d76c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d76c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 -- 172.21.15.7:0/791545667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 msgr2=0x55660d779990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d779990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe812a00640 1 -- 172.21.15.7:0/791545667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660d69de10 con 0x55660d76cce0 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.362+0000 7fe813400640 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d76c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.363+0000 7fe80b400640 1 -- 172.21.15.7:0/194555540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7fe8040f1540 con 0x7fe814102fc0 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.363+0000 7fe813400640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3d90 0x7fe7f80a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.363+0000 7fe812a00640 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 0x55660d777060 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe8040ee7c0 tx=0x7fe8040876d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9fab5564da9da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.363+0000 7fe7ffe00640 1 -- 172.21.15.7:0/791545667 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040bcc10 con 0x55660d76cce0 2024-04-23T15:35:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.363+0000 7fe7ffe00640 1 -- 172.21.15.7:0/791545667 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8040a47c0 con 0x55660d76cce0 2024-04-23T15:35:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.363+0000 7fe7ffe00640 1 -- 172.21.15.7:0/791545667 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040f7150 con 0x55660d76cce0 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 -- 172.21.15.7:0/791545667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 msgr2=0x55660d777060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe813400640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3d90 0x7fe7f80a6250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005fd0 tx=0x7fe80c004a40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 0x55660d777060 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe8040ee7c0 tx=0x7fe8040876d0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 -- 172.21.15.7:0/791545667 shutdown_connections 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d779990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76cce0 0x55660d777060 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/791545667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d76c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 -- 172.21.15.7:0/791545667 >> 172.21.15.7:0/791545667 conn(0x55660d7688d0 msgr2=0x55660d768cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 -- 172.21.15.7:0/791545667 shutdown_connections 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.364+0000 7fe81c7a7740 1 -- 172.21.15.7:0/791545667 wait complete. 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.365+0000 7fe81c7a7740 1 -- start start 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.365+0000 7fe81c7a7740 1 Processor -- start 2024-04-23T15:35:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d774500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d774a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d774f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55660d779f90 con 0x55660d7775a0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55660d68c2c0 con 0x55660d76cce0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55660d77a110 con 0x55660d76c3c0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe81c7a7740 10 client.0 _ll_register_callbacks cb 0x55660d3e4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe813400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d774f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe813400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d774f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53044/0 (socket says 172.21.15.7:53044) 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe813400640 1 -- 172.21.15.7:0/788531858 learned_addr learned my addr 172.21.15.7:0/788531858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe812000640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d774a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.366+0000 7fe812a00640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d774500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe813400640 1 -- 172.21.15.7:0/788531858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 msgr2=0x55660d774500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe813400640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d774500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe813400640 1 -- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 msgr2=0x55660d774a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe813400640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d774a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe813400640 1 -- 172.21.15.7:0/788531858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660d69cfd0 con 0x55660d7775a0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe813400640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d774f80 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009470 tx=0x7fe80c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b1d3abb0ba551d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe7fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe7fcc00640 1 -- 172.21.15.7:0/788531858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c01db30 con 0x55660d7775a0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe7fcc00640 1 -- 172.21.15.7:0/788531858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7fe80c01dcd0 con 0x55660d7775a0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.367+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55660d6e0320 con 0x55660d7775a0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe7fcc00640 1 -- 172.21.15.7:0/788531858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe80c027470 con 0x55660d7775a0 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 10 client.19233 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55660d3e5210 con 0x55660d7775a0 2024-04-23T15:35:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe7fcc00640 1 -- 172.21.15.7:0/788531858 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55660d6e0320 con 0x55660d7775a0 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe7fcc00640 1 -- 172.21.15.7:0/788531858 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe80c00f040 con 0x55660d7775a0 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 10 client.19233 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 10 client.19233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 20 client.19233 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d787430 0x55660d789860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 4 client.19233 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.368+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55660d6da190 con 0x55660d787430 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.369+0000 7fe812a00640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d787430 0x55660d789860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.370+0000 7fe812a00640 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d787430 0x55660d789860 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e8a97fe9fd8823a server_cookie=50ed5af0da2986d in_seq=0 out_seq=0 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.370+0000 7fe7fcc00640 10 client.19233 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe7fcc00640 1 -- 172.21.15.7:0/788531858 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55660d6da190 con 0x55660d787430 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe7fcc00640 10 client.19233 handle_command_reply: tid=0 2024-04-23T15:35:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 client.19233 shutdown 2024-04-23T15:35:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 msgr2=0x55660d774f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d774f80 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009470 tx=0x7fe80c004ab0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 shutdown_connections 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d787430 0x55660d789860 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d774a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d774f80 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/788531858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d774500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 >> 172.21.15.7:0/788531858 conn(0x55660d7688d0 msgr2=0x55660d76e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe7fcc00640 0 client.19233 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 shutdown_connections 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.372+0000 7fe81c7a7740 1 -- 172.21.15.7:0/788531858 wait complete. 2024-04-23T15:35:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.373+0000 7fe81c7a7740 20 client.19233 trim_cache size 0 max 16384 2024-04-23T15:35:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 Processor -- start 2024-04-23T15:35:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 -- start start 2024-04-23T15:35:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 0x55660d782dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76cce0 0x55660d76ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d78f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b1480 con 0x55660d76c3c0 2024-04-23T15:35:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b2fc0 con 0x55660d7775a0 2024-04-23T15:35:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.389+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b1b50 con 0x55660d76cce0 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 0x55660d782dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 0x55660d782dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53046/0 (socket says 172.21.15.7:53046) 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 -- 172.21.15.7:0/625043070 learned_addr learned my addr 172.21.15.7:0/625043070 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812000640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76cce0 0x55660d76ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe813400640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d78f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 -- 172.21.15.7:0/625043070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76cce0 msgr2=0x55660d76ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76cce0 0x55660d76ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 -- 172.21.15.7:0/625043070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 msgr2=0x55660d78f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d78f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812a00640 1 -- 172.21.15.7:0/625043070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660d7734b0 con 0x55660d76c3c0 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe812000640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76cce0 0x55660d76ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.390+0000 7fe813400640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d78f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.391+0000 7fe812a00640 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 0x55660d782dc0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fe8040b9530 tx=0x7fe80402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59efd303b8776f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.391+0000 7fe7ff400640 1 -- 172.21.15.7:0/625043070 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804049040 con 0x55660d76c3c0 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.391+0000 7fe7ff400640 1 -- 172.21.15.7:0/625043070 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8040bd0d0 con 0x55660d76c3c0 2024-04-23T15:35:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.391+0000 7fe7ff400640 1 -- 172.21.15.7:0/625043070 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040bca30 con 0x55660d76c3c0 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 -- 172.21.15.7:0/625043070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 msgr2=0x55660d782dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 0x55660d782dc0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fe8040b9530 tx=0x7fe80402a480 comp rx=0 tx=0).stop 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 -- 172.21.15.7:0/625043070 shutdown_connections 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d7775a0 0x55660d78f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76cce0 0x55660d76ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/625043070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d76c3c0 0x55660d782dc0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 -- 172.21.15.7:0/625043070 >> 172.21.15.7:0/625043070 conn(0x55660d7688d0 msgr2=0x55660d768cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 -- 172.21.15.7:0/625043070 shutdown_connections 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.392+0000 7fe81c7a7740 1 -- 172.21.15.7:0/625043070 wait complete. 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 -- start start 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 Processor -- start 2024-04-23T15:35:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d77ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d77f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d77a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b28f0 con 0x55660d7775a0 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b2220 con 0x55660d76cce0 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141af480 con 0x55660d76c3c0 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.393+0000 7fe81c7a7740 10 client.0 _ll_register_callbacks cb 0x7fe80c009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d77a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d77a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53062/0 (socket says 172.21.15.7:53062) 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 -- 172.21.15.7:0/729819602 learned_addr learned my addr 172.21.15.7:0/729819602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe812a00640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d77ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe812000640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d77f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 -- 172.21.15.7:0/729819602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 msgr2=0x55660d77ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d77ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 -- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 msgr2=0x55660d77f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d77f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.394+0000 7fe813400640 1 -- 172.21.15.7:0/729819602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660d764000 con 0x55660d7775a0 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe813400640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d77a430 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fe80c01e870 tx=0x7fe80c01e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba135c75b220388 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe7fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe7fcc00640 1 -- 172.21.15.7:0/729819602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c038020 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe7fcc00640 1 -- 172.21.15.7:0/729819602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7fe80c01dbc0 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8040bd0d0 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe7fcc00640 1 -- 172.21.15.7:0/729819602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe80c01ddc0 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe81c7a7740 10 client.19239 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.395+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55660d4b1620 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe7fcc00640 1 -- 172.21.15.7:0/729819602 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8040bd0d0 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe7fcc00640 1 -- 172.21.15.7:0/729819602 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe80c034780 con 0x55660d7775a0 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe81c7a7740 10 client.19239 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe81c7a7740 10 client.19239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe81c7a7740 20 client.19239 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d7ed720 0x55660d7efb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe81c7a7740 4 client.19239 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:35:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.396+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55660d6564b0 con 0x55660d7ed720 2024-04-23T15:35:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.397+0000 7fe812a00640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d7ed720 0x55660d7efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.397+0000 7fe812a00640 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d7ed720 0x55660d7efb40 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4fbe88938f4766 server_cookie=b392500cc7449025 in_seq=0 out_seq=0 2024-04-23T15:35:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.397+0000 7fe7fcc00640 10 client.19239 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:35.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:35 smithi137 ceph-mon[31694]: pgmap v1403: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:35:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.433+0000 7fe7fcc00640 1 -- 172.21.15.7:0/729819602 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55660d6564b0 con 0x55660d7ed720 2024-04-23T15:35:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.433+0000 7fe7fcc00640 10 client.19239 handle_command_reply: tid=0 2024-04-23T15:35:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.433+0000 7fe81c7a7740 1 client.19239 shutdown 2024-04-23T15:35:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 msgr2=0x55660d77a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d77a430 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fe80c01e870 tx=0x7fe80c01e700 comp rx=0 tx=0).stop 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 shutdown_connections 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55660d7ed720 0x55660d7efb40 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55660d76cce0 0x55660d77f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe7fcc00640 0 client.19239 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55660d7775a0 0x55660d77a430 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 --2- 172.21.15.7:0/729819602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55660d76c3c0 0x55660d77ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 >> 172.21.15.7:0/729819602 conn(0x55660d7688d0 msgr2=0x55660d767200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.434+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 shutdown_connections 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.435+0000 7fe81c7a7740 1 -- 172.21.15.7:0/729819602 wait complete. 2024-04-23T15:35:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.435+0000 7fe81c7a7740 20 client.19239 trim_cache size 0 max 16384 2024-04-23T15:35:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:35:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:35:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:35:35.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.435+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3d90 msgr2=0x7fe7f80a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.435+0000 7fe813e00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3d90 0x7fe7f80a6250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005fd0 tx=0x7fe80c004a40 comp rx=0 tx=0).stop 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.435+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 msgr2=0x7fe8141a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.435+0000 7fe813e00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141a0620 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe804005ab0 tx=0x7fe804003cd0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 shutdown_connections 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe7f80a3d90 0x7fe7f80a6250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe81410c3e0 0x7fe81419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8141038e0 0x7fe8141a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 --2- 172.21.15.7:0/194555540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe814102fc0 0x7fe8141a0620 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 >> 172.21.15.7:0/194555540 conn(0x7fe8140fc820 msgr2=0x7fe814100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 shutdown_connections 2024-04-23T15:35:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:35.436+0000 7fe813e00640 1 -- 172.21.15.7:0/194555540 wait complete. 2024-04-23T15:35:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:37 smithi007 ceph-mon[27906]: pgmap v1404: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:35:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:37 smithi186 ceph-mon[31814]: pgmap v1404: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:35:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:37 smithi137 ceph-mon[31694]: pgmap v1404: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 14 op/s 2024-04-23T15:35:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:39 smithi186 ceph-mon[31814]: pgmap v1405: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 22 op/s 2024-04-23T15:35:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:39 smithi137 ceph-mon[31694]: pgmap v1405: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 22 op/s 2024-04-23T15:35:39.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:39 smithi007 ceph-mon[27906]: pgmap v1405: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 22 op/s 2024-04-23T15:35:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:41 smithi186 ceph-mon[31814]: pgmap v1406: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:35:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:41 smithi137 ceph-mon[31694]: pgmap v1406: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:35:41.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:41 smithi007 ceph-mon[27906]: pgmap v1406: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:35:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:43 smithi186 ceph-mon[31814]: pgmap v1407: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:35:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:43 smithi137 ceph-mon[31694]: pgmap v1407: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:35:43.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:43 smithi007 ceph-mon[27906]: pgmap v1407: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:35:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:45 smithi186 ceph-mon[31814]: pgmap v1408: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:35:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:45 smithi137 ceph-mon[31694]: pgmap v1408: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:35:45.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:45 smithi007 ceph-mon[27906]: pgmap v1408: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:35:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:47 smithi137 ceph-mon[31694]: pgmap v1409: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:35:47.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:47 smithi007 ceph-mon[27906]: pgmap v1409: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:35:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:47 smithi186 ceph-mon[31814]: pgmap v1409: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:35:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 -- 172.21.15.7:0/584426816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd8102a40 msgr2=0x7fafd8106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 --2- 172.21.15.7:0/584426816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd8102a40 0x7fafd8106a80 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009980 tx=0x7fafc002e830 comp rx=0 tx=0).stop 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 -- 172.21.15.7:0/584426816 shutdown_connections 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 --2- 172.21.15.7:0/584426816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafd8107160 0x7fafd810ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 --2- 172.21.15.7:0/584426816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd8102a40 0x7fafd8106a80 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 --2- 172.21.15.7:0/584426816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 0x7fafd8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 -- 172.21.15.7:0/584426816 >> 172.21.15.7:0/584426816 conn(0x7fafd80fd950 msgr2=0x7fafd80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.601+0000 7fafdd600640 1 -- 172.21.15.7:0/584426816 shutdown_connections 2024-04-23T15:35:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.602+0000 7fafdd600640 1 -- 172.21.15.7:0/584426816 wait complete. 2024-04-23T15:35:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.603+0000 7fafdd600640 1 Processor -- start 2024-04-23T15:35:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.603+0000 7fafdd600640 1 -- start start 2024-04-23T15:35:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdd600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 0x7fafd81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafd8107160 0x7fafd8196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdd600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 0x7fafd819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdd600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810ff00 con 0x7fafd819ad30 2024-04-23T15:35:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdd600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810fd80 con 0x7fafd8107160 2024-04-23T15:35:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdd600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8110080 con 0x7fafd8102090 2024-04-23T15:35:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 0x7fafd819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 0x7fafd819b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41686/0 (socket says 172.21.15.7:41686) 2024-04-23T15:35:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.604+0000 7fafdcc00640 1 -- 172.21.15.7:0/2500477704 learned_addr learned my addr 172.21.15.7:0/2500477704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7400640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafd8107160 0x7fafd8196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7e00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 0x7fafd81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7e00640 1 -- 172.21.15.7:0/2500477704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafd8107160 msgr2=0x7fafd8196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7e00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafd8107160 0x7fafd8196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7e00640 1 -- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 msgr2=0x7fafd819b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7e00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 0x7fafd819b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.605+0000 7fafd7e00640 1 -- 172.21.15.7:0/2500477704 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd819b820 con 0x7fafd8102090 2024-04-23T15:35:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.606+0000 7fafdcc00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 0x7fafd819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:35:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.606+0000 7fafd7e00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 0x7fafd81964c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d6d0 tx=0x7fafc800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.607+0000 7fafd4c00640 1 -- 172.21.15.7:0/2500477704 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8017070 con 0x7fafd8102090 2024-04-23T15:35:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.607+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd819bb10 con 0x7fafd8102090 2024-04-23T15:35:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.607+0000 7fafd4c00640 1 -- 172.21.15.7:0/2500477704 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafc8009820 con 0x7fafd8102090 2024-04-23T15:35:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.607+0000 7fafd4c00640 1 -- 172.21.15.7:0/2500477704 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8004c40 con 0x7fafd8102090 2024-04-23T15:35:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.607+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd81a3270 con 0x7fafd8102090 2024-04-23T15:35:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.612+0000 7fafe198a740 1 Processor -- start 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 -- start start 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 0x5599949b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b3ce0 0x5599949be060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949c0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559994919900 con 0x5599949b33c0 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5599948bff20 con 0x5599949be5a0 2024-04-23T15:35:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafe198a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5599949158c0 con 0x5599949b3ce0 2024-04-23T15:35:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.613+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 0x5599949b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 0x5599949b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41700/0 (socket says 172.21.15.7:41700) 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 -- 172.21.15.7:0/1818452564 learned_addr learned my addr 172.21.15.7:0/1818452564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafd7400640 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafd4c00640 1 -- 172.21.15.7:0/2500477704 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fafc80099d0 con 0x7fafd8102090 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 -- 172.21.15.7:0/1818452564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b3ce0 msgr2=0x5599949be060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b3ce0 0x5599949be060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 -- 172.21.15.7:0/1818452564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 msgr2=0x5599949c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949c0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.614+0000 7fafdcc00640 1 -- 172.21.15.7:0/1818452564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599948e4e10 con 0x5599949b33c0 2024-04-23T15:35:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.615+0000 7fafdcc00640 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 0x5599949b37a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fafd0010370 tx=0x7fafd0010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a217bf7901fd546 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.615+0000 7fafcd200640 1 -- 172.21.15.7:0/1818452564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0016070 con 0x5599949b33c0 2024-04-23T15:35:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.615+0000 7fafcd200640 1 -- 172.21.15.7:0/1818452564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafd0012bc0 con 0x5599949b33c0 2024-04-23T15:35:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.615+0000 7fafcd200640 1 -- 172.21.15.7:0/1818452564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0011c50 con 0x5599949b33c0 2024-04-23T15:35:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.616+0000 7fafd4c00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fafbc0a3d10 0x7fafbc0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.616+0000 7fafe198a740 1 -- 172.21.15.7:0/1818452564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 msgr2=0x5599949b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.616+0000 7fafe198a740 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 0x5599949b37a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fafd0010370 tx=0x7fafd0010830 comp rx=0 tx=0).stop 2024-04-23T15:35:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.616+0000 7fafd4c00640 1 -- 172.21.15.7:0/2500477704 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7fafc80d0720 con 0x7fafd8102090 2024-04-23T15:35:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.616+0000 7fafd7e00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fafbc0a3d10 0x7fafbc0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.616+0000 7fafe198a740 1 -- 172.21.15.7:0/1818452564 shutdown_connections 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafe198a740 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafe198a740 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b3ce0 0x5599949be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafe198a740 1 --2- 172.21.15.7:0/1818452564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b33c0 0x5599949b37a0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafe198a740 1 -- 172.21.15.7:0/1818452564 >> 172.21.15.7:0/1818452564 conn(0x5599949af8d0 msgr2=0x5599949afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafd7e00640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fafbc0a3d10 0x7fafbc0a61d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5599949b4960 tx=0x7fafc8009f30 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafe198a740 1 -- 172.21.15.7:0/1818452564 shutdown_connections 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.617+0000 7fafe198a740 1 -- 172.21.15.7:0/1818452564 wait complete. 2024-04-23T15:35:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.618+0000 7fafe198a740 1 -- start start 2024-04-23T15:35:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.618+0000 7fafe198a740 1 Processor -- start 2024-04-23T15:35:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949bb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 0x5599949bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949bbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5599949c1140 con 0x5599949b3ce0 2024-04-23T15:35:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5599948d32c0 con 0x5599949be5a0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5599949c12c0 con 0x5599949b33c0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafe198a740 10 client.0 _ll_register_callbacks cb 0x55999462ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafd7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 0x5599949bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafd7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 0x5599949bbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41704/0 (socket says 172.21.15.7:41704) 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafd7400640 1 -- 172.21.15.7:0/442265113 learned_addr learned my addr 172.21.15.7:0/442265113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafdcc00640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949bb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.619+0000 7fafdcc00640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949bbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafd7400640 1 -- 172.21.15.7:0/442265113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 msgr2=0x5599949bb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafd7400640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949bb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafd7400640 1 -- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 msgr2=0x5599949bbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafd7400640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949bbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafd7400640 1 -- 172.21.15.7:0/442265113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599948e3fd0 con 0x5599949b3ce0 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafdcc00640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949bbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafd7400640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 0x5599949bbab0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009980 tx=0x7fafc00041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afa7e703b1de469 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafc5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafc5600640 1 -- 172.21.15.7:0/442265113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc003a070 con 0x5599949b3ce0 2024-04-23T15:35:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafc5600640 1 -- 172.21.15.7:0/442265113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7fafc0005230 con 0x5599949b3ce0 2024-04-23T15:35:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.620+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafd0012bc0 con 0x5599949b3ce0 2024-04-23T15:35:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafc5600640 1 -- 172.21.15.7:0/442265113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fafc0051050 con 0x5599949b3ce0 2024-04-23T15:35:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafe198a740 10 client.19251 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55999462c210 con 0x5599949b3ce0 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafc5600640 1 -- 172.21.15.7:0/442265113 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafd0012bc0 con 0x5599949b3ce0 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafc5600640 1 -- 172.21.15.7:0/442265113 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fafc00035f0 con 0x5599949b3ce0 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafe198a740 10 client.19251 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.621+0000 7fafe198a740 10 client.19251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.622+0000 7fafe198a740 20 client.19251 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.622+0000 7fafe198a740 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599949ce7c0 0x5599949d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.622+0000 7fafe198a740 4 client.19251 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.622+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559994927320 con 0x5599949ce7c0 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.622+0000 7fafdcc00640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599949ce7c0 0x5599949d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.624+0000 7fafc5600640 10 client.19251 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.624+0000 7fafdcc00640 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599949ce7c0 0x5599949d0bd0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7b0f2488531316 server_cookie=28a7b42111a7a18a in_seq=0 out_seq=0 2024-04-23T15:35:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafc5600640 1 -- 172.21.15.7:0/442265113 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559994927320 con 0x5599949ce7c0 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafc5600640 10 client.19251 handle_command_reply: tid=0 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 client.19251 shutdown 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 msgr2=0x5599949bbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 0x5599949bbab0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009980 tx=0x7fafc00041a0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 shutdown_connections 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5599949ce7c0 0x5599949d0bd0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949be5a0 0x5599949bbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949b3ce0 0x5599949bbab0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 --2- 172.21.15.7:0/442265113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949bb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafc5600640 0 client.19251 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.626+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 >> 172.21.15.7:0/442265113 conn(0x5599949af8d0 msgr2=0x5599949b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.627+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 shutdown_connections 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.627+0000 7fafe198a740 1 -- 172.21.15.7:0/442265113 wait complete. 2024-04-23T15:35:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.627+0000 7fafe198a740 20 client.19251 trim_cache size 0 max 16384 2024-04-23T15:35:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 Processor -- start 2024-04-23T15:35:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 -- start start 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x5599949d64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81ad170 con 0x5599949be5a0 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81aecb0 con 0x5599949b3ce0 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.647+0000 7fafe198a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81ad840 con 0x5599949b33c0 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x5599949d64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x5599949d64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41706/0 (socket says 172.21.15.7:41706) 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 -- 172.21.15.7:0/3987812438 learned_addr learned my addr 172.21.15.7:0/3987812438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafd7400640 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 -- 172.21.15.7:0/3987812438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 msgr2=0x5599949ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 -- 172.21.15.7:0/3987812438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 msgr2=0x5599949b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafdcc00640 1 -- 172.21.15.7:0/3987812438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599946f8620 con 0x5599949be5a0 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.648+0000 7fafd7400640 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.649+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x5599949d64e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009f80 tx=0x7fafd001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9c758d2b62d862 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.649+0000 7fafc7e00640 1 -- 172.21.15.7:0/3987812438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0016040 con 0x5599949be5a0 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.649+0000 7fafc7e00640 1 -- 172.21.15.7:0/3987812438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafd0011df0 con 0x5599949be5a0 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.649+0000 7fafc7e00640 1 -- 172.21.15.7:0/3987812438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd002b2a0 con 0x5599949be5a0 2024-04-23T15:35:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 -- 172.21.15.7:0/3987812438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 msgr2=0x5599949d64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x5599949d64e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009f80 tx=0x7fafd001d040 comp rx=0 tx=0).stop 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 -- 172.21.15.7:0/3987812438 shutdown_connections 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x5599949d64e0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 --2- 172.21.15.7:0/3987812438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 -- 172.21.15.7:0/3987812438 >> 172.21.15.7:0/3987812438 conn(0x5599949af8d0 msgr2=0x5599949bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 -- 172.21.15.7:0/3987812438 shutdown_connections 2024-04-23T15:35:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 -- 172.21.15.7:0/3987812438 wait complete. 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.650+0000 7fafe198a740 1 -- start start 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 Processor -- start 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x559994a33d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81ae5e0 con 0x5599949be5a0 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81adf10 con 0x5599949b3ce0 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81ab170 con 0x5599949b33c0 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.651+0000 7fafe198a740 10 client.0 _ll_register_callbacks cb 0x7fafc0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x559994a33d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x559994a33d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41722/0 (socket says 172.21.15.7:41722) 2024-04-23T15:35:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 -- 172.21.15.7:0/3724318900 learned_addr learned my addr 172.21.15.7:0/3724318900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafd7400640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 -- 172.21.15.7:0/3724318900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 msgr2=0x5599949b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 -- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 msgr2=0x5599949b8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 -- 172.21.15.7:0/3724318900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559994a34290 con 0x5599949be5a0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafdcc00640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x559994a33d50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009770 tx=0x7fafd0005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59450814a118773d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.652+0000 7fafc5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafc5600640 1 -- 172.21.15.7:0/3724318900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0016040 con 0x5599949be5a0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafc5600640 1 -- 172.21.15.7:0/3724318900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7fafd0011bf0 con 0x5599949be5a0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafd0011df0 con 0x5599949be5a0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafc5600640 1 -- 172.21.15.7:0/3724318900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fafd00114e0 con 0x5599949be5a0 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafe198a740 10 client.19257 fetch_fsmap learned FSMap version 32 2024-04-23T15:35:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559994a353d0 con 0x5599949be5a0 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.653+0000 7fafc5600640 1 -- 172.21.15.7:0/3724318900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafd0011df0 con 0x5599949be5a0 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafc5600640 1 -- 172.21.15.7:0/3724318900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fafd000f040 con 0x5599949be5a0 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafe198a740 10 client.19257 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafe198a740 10 client.19257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafe198a740 20 client.19257 populate_metadata read hostname 'smithi007' 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafe198a740 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559994a35840 0x559994a37c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafe198a740 4 client.19257 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559994921190 con 0x559994a35840 2024-04-23T15:35:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.654+0000 7fafd7400640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559994a35840 0x559994a37c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:35:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.655+0000 7fafd7400640 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559994a35840 0x559994a37c30 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452042c47d7f27ce server_cookie=df18a96b1bd670e8 in_seq=0 out_seq=0 2024-04-23T15:35:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.655+0000 7fafc5600640 10 client.19257 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.693+0000 7fafc5600640 1 -- 172.21.15.7:0/3724318900 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559994921190 con 0x559994a35840 2024-04-23T15:35:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.693+0000 7fafc5600640 10 client.19257 handle_command_reply: tid=0 2024-04-23T15:35:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.693+0000 7fafe198a740 1 client.19257 shutdown 2024-04-23T15:35:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.693+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 msgr2=0x559994a33d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.693+0000 7fafe198a740 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x559994a33d50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009770 tx=0x7fafd0005cf0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 shutdown_connections 2024-04-23T15:35:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559994a35840 0x559994a37c30 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599949b3ce0 0x5599949b8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5599949be5a0 0x559994a33d50 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 --2- 172.21.15.7:0/3724318900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5599949b33c0 0x5599949b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafc5600640 0 client.19257 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 >> 172.21.15.7:0/3724318900 conn(0x5599949af8d0 msgr2=0x5599949c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 shutdown_connections 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 1 -- 172.21.15.7:0/3724318900 wait complete. 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.694+0000 7fafe198a740 20 client.19257 trim_cache size 0 max 16384 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:35:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fafbc0a3d10 msgr2=0x7fafbc0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fafbc0a3d10 0x7fafbc0a61d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5599949b4960 tx=0x7fafc8009f30 comp rx=0 tx=0).stop 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 msgr2=0x7fafd81964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 0x7fafd81964c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d6d0 tx=0x7fafc800db90 comp rx=0 tx=0).stop 2024-04-23T15:35:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 shutdown_connections 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fafbc0a3d10 0x7fafbc0a61d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafd8107160 0x7fafd8196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd819ad30 0x7fafd819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 --2- 172.21.15.7:0/2500477704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd8102090 0x7fafd81964c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 >> 172.21.15.7:0/2500477704 conn(0x7fafd80fd950 msgr2=0x7fafd80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 shutdown_connections 2024-04-23T15:35:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:35:48.695+0000 7fafdd600640 1 -- 172.21.15.7:0/2500477704 wait complete. 2024-04-23T15:35:49.415 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:49 smithi186 ceph-mon[31814]: pgmap v1410: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:35:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:49 smithi137 ceph-mon[31694]: pgmap v1410: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:35:49.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:49 smithi007 ceph-mon[27906]: pgmap v1410: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:35:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:51 smithi137 ceph-mon[31694]: pgmap v1411: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:35:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:51 smithi007 ceph-mon[27906]: pgmap v1411: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:35:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:51 smithi186 ceph-mon[31814]: pgmap v1411: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 10 op/s 2024-04-23T15:35:53.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:53 smithi137 ceph-mon[31694]: pgmap v1412: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:35:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:53 smithi007 ceph-mon[27906]: pgmap v1412: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:35:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:53 smithi186 ceph-mon[31814]: pgmap v1412: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:35:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:55 smithi137 ceph-mon[31694]: pgmap v1413: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:35:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:55 smithi007 ceph-mon[27906]: pgmap v1413: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:35:55.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:55 smithi186 ceph-mon[31814]: pgmap v1413: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:35:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:57 smithi137 ceph-mon[31694]: pgmap v1414: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:35:57.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:57 smithi007 ceph-mon[27906]: pgmap v1414: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:35:57.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:57 smithi186 ceph-mon[31814]: pgmap v1414: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 14 op/s 2024-04-23T15:35:58.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:35:58 smithi137 ceph-mon[31694]: pgmap v1415: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:35:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:35:58 smithi007 ceph-mon[27906]: pgmap v1415: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:35:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:35:58 smithi186 ceph-mon[31814]: pgmap v1415: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-04-23T15:36:01.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:00 smithi007 ceph-mon[27906]: pgmap v1416: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:36:01.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:00 smithi186 ceph-mon[31814]: pgmap v1416: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:36:01.121 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:00 smithi137 ceph-mon[31694]: pgmap v1416: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.4 MiB/s wr, 13 op/s 2024-04-23T15:36:01.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.862+0000 7ff64ca00640 1 -- 172.21.15.7:0/2388922619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644031880 con 0x7ff6481130c0 2024-04-23T15:36:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 -- 172.21.15.7:0/2388922619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6481130c0 msgr2=0x7ff6481154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 --2- 172.21.15.7:0/2388922619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6481130c0 0x7ff6481154b0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7ff644009930 tx=0x7ff64402a4d0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 -- 172.21.15.7:0/2388922619 shutdown_connections 2024-04-23T15:36:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 --2- 172.21.15.7:0/2388922619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6481130c0 0x7ff6481154b0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 --2- 172.21.15.7:0/2388922619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff648074bf0 0x7ff648112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 --2- 172.21.15.7:0/2388922619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6480742d0 0x7ff6480746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 -- 172.21.15.7:0/2388922619 >> 172.21.15.7:0/2388922619 conn(0x7ff648079490 msgr2=0x7ff6480798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 -- 172.21.15.7:0/2388922619 shutdown_connections 2024-04-23T15:36:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.863+0000 7ff650800640 1 -- 172.21.15.7:0/2388922619 wait complete. 2024-04-23T15:36:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.864+0000 7ff650800640 1 Processor -- start 2024-04-23T15:36:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.864+0000 7ff650800640 1 -- start start 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff650800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 0x7ff64819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff650800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff648074bf0 0x7ff64819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff650800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6481130c0 0x7ff6481a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff650800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff648118890 con 0x7ff6480742d0 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff650800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff648118710 con 0x7ff648074bf0 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff650800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff648118a10 con 0x7ff6481130c0 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff64de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 0x7ff64819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff64de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 0x7ff64819ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33252/0 (socket says 172.21.15.7:33252) 2024-04-23T15:36:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff64de00640 1 -- 172.21.15.7:0/1540362022 learned_addr learned my addr 172.21.15.7:0/1540362022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.865+0000 7ff64e800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6481130c0 0x7ff6481a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64d400640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff648074bf0 0x7ff64819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64de00640 1 -- 172.21.15.7:0/1540362022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6481130c0 msgr2=0x7ff6481a3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64de00640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6481130c0 0x7ff6481a3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64de00640 1 -- 172.21.15.7:0/1540362022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff648074bf0 msgr2=0x7ff64819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64de00640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff648074bf0 0x7ff64819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64de00640 1 -- 172.21.15.7:0/1540362022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6481a3d40 con 0x7ff6480742d0 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64e800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6481130c0 0x7ff6481a3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64d400640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff648074bf0 0x7ff64819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff64de00640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 0x7ff64819ed50 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7ff64000eab0 tx=0x7ff64000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.866+0000 7ff63ea00640 1 -- 172.21.15.7:0/1540362022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64000ce40 con 0x7ff6480742d0 2024-04-23T15:36:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.867+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6481a4030 con 0x7ff6480742d0 2024-04-23T15:36:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.867+0000 7ff63ea00640 1 -- 172.21.15.7:0/1540362022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff640011920 con 0x7ff6480742d0 2024-04-23T15:36:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.867+0000 7ff63ea00640 1 -- 172.21.15.7:0/1540362022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640010a00 con 0x7ff6480742d0 2024-04-23T15:36:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.867+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6481ab8c0 con 0x7ff6480742d0 2024-04-23T15:36:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.870+0000 7ff63ea00640 1 -- 172.21.15.7:0/1540362022 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff640011ad0 con 0x7ff6480742d0 2024-04-23T15:36:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 Processor -- start 2024-04-23T15:36:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 -- start start 2024-04-23T15:36:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 0x55c0faddc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddcad0 0x55c0fade6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0fade7390 0x55c0fade9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c0fad42900 con 0x55c0faddc1b0 2024-04-23T15:36:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c0face8f20 con 0x55c0faddcad0 2024-04-23T15:36:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.871+0000 7ff6535cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c0fad3e8c0 con 0x55c0fade7390 2024-04-23T15:36:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.872+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 0x55c0faddc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.872+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 0x55c0faddc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33266/0 (socket says 172.21.15.7:33266) 2024-04-23T15:36:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.872+0000 7ff64e800640 1 -- 172.21.15.7:0/2370078145 learned_addr learned my addr 172.21.15.7:0/2370078145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.872+0000 7ff64de00640 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddcad0 0x55c0fade6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.872+0000 7ff63ea00640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6340a3dc0 0x7ff6340a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.872+0000 7ff64d400640 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0fade7390 0x55c0fade9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 -- 172.21.15.7:0/2370078145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0fade7390 msgr2=0x55c0fade9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0fade7390 0x55c0fade9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 -- 172.21.15.7:0/2370078145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddcad0 msgr2=0x55c0fade6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddcad0 0x55c0fade6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff63ea00640 1 -- 172.21.15.7:0/1540362022 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7ff6400d1320 con 0x7ff6480742d0 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 -- 172.21.15.7:0/2370078145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fad0de10 con 0x55c0faddc1b0 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64d400640 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0fade7390 0x55c0fade9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6340a3dc0 0x7ff6340a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff64e800640 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 0x55c0faddc590 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7ff644005940 tx=0x7ff644032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8203943969e45461 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.873+0000 7ff633000640 1 -- 172.21.15.7:0/2370078145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64404c070 con 0x55c0faddc1b0 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.874+0000 7ff633000640 1 -- 172.21.15.7:0/2370078145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6440318e0 con 0x55c0faddc1b0 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.874+0000 7ff633000640 1 -- 172.21.15.7:0/2370078145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644035070 con 0x55c0faddc1b0 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.874+0000 7ff6535cb740 1 -- 172.21.15.7:0/2370078145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 msgr2=0x55c0faddc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.874+0000 7ff6535cb740 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 0x55c0faddc590 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7ff644005940 tx=0x7ff644032c70 comp rx=0 tx=0).stop 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.874+0000 7ff64e800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6340a3dc0 0x7ff6340a6280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6440096c0 tx=0x7ff64404a000 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 -- 172.21.15.7:0/2370078145 shutdown_connections 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddcad0 0x55c0fade6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0fade7390 0x55c0fade9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 --2- 172.21.15.7:0/2370078145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0faddc1b0 0x55c0faddc590 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 -- 172.21.15.7:0/2370078145 >> 172.21.15.7:0/2370078145 conn(0x55c0fadd86c0 msgr2=0x55c0fadd8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 -- 172.21.15.7:0/2370078145 shutdown_connections 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 -- 172.21.15.7:0/2370078145 wait complete. 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.875+0000 7ff6535cb740 1 -- start start 2024-04-23T15:36:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 Processor -- start 2024-04-23T15:36:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fade4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c0fade9fc0 con 0x55c0fade7390 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c0facfc2c0 con 0x55c0faddc1b0 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55c0fadea140 con 0x55c0faddcad0 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.876+0000 7ff6535cb740 10 client.0 _ll_register_callbacks cb 0x55c0faa54a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fade4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fade4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33274/0 (socket says 172.21.15.7:33274) 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 -- 172.21.15.7:0/3917178672 learned_addr learned my addr 172.21.15.7:0/3917178672 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64d400640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64de00640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 -- 172.21.15.7:0/3917178672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 msgr2=0x55c0fade48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 -- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 msgr2=0x55c0fade4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.877+0000 7ff64e800640 1 -- 172.21.15.7:0/3917178672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0fad0cfd0 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.878+0000 7ff64e800640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fade4e00 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7ff644031440 tx=0x7ff644046b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792c74f446b4b0b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.878+0000 7ff627400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.878+0000 7ff627400640 1 -- 172.21.15.7:0/3917178672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644057070 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.878+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0fad50320 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.878+0000 7ff627400640 1 -- 172.21.15.7:0/3917178672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7ff6440046c0 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff627400640 1 -- 172.21.15.7:0/3917178672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff644063050 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 10 client.19269 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c0faa55210 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff627400640 1 -- 172.21.15.7:0/3917178672 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55c0fad50320 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff627400640 1 -- 172.21.15.7:0/3917178672 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff644044040 con 0x55c0fade7390 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 10 client.19269 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 10 client.19269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 20 client.19269 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fadf7310 0x55c0fadf9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 4 client.19269 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:36:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.879+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0fad4a190 con 0x55c0fadf7310 2024-04-23T15:36:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.880+0000 7ff64de00640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fadf7310 0x55c0fadf9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.881+0000 7ff64de00640 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fadf7310 0x55c0fadf9700 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f75b6081c2d03b71 server_cookie=a5bd57f2ccbf3acb in_seq=0 out_seq=0 2024-04-23T15:36:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.881+0000 7ff627400640 10 client.19269 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff627400640 1 -- 172.21.15.7:0/3917178672 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c0fad4a190 con 0x55c0fadf7310 2024-04-23T15:36:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff627400640 10 client.19269 handle_command_reply: tid=0 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 client.19269 shutdown 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 msgr2=0x55c0fade4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fade4e00 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7ff644031440 tx=0x7ff644046b10 comp rx=0 tx=0).stop 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 shutdown_connections 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fadf7310 0x55c0fadf9700 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fade4e00 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 --2- 172.21.15.7:0/3917178672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff627400640 0 client.19269 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 >> 172.21.15.7:0/3917178672 conn(0x55c0fadd86c0 msgr2=0x55c0fadde440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 shutdown_connections 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.883+0000 7ff6535cb740 1 -- 172.21.15.7:0/3917178672 wait complete. 2024-04-23T15:36:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.884+0000 7ff6535cb740 20 client.19269 trim_cache size 0 max 16384 2024-04-23T15:36:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.902+0000 7ff6535cb740 1 Processor -- start 2024-04-23T15:36:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.902+0000 7ff6535cb740 1 -- start start 2024-04-23T15:36:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.902+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.902+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fadf2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fadd76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff6535cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b5990 con 0x55c0fade7390 2024-04-23T15:36:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff6535cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b74d0 con 0x55c0faddc1b0 2024-04-23T15:36:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff6535cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b6060 con 0x55c0faddcad0 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fadd76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fadd76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33282/0 (socket says 172.21.15.7:33282) 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff64e800640 1 -- 172.21.15.7:0/4238269158 learned_addr learned my addr 172.21.15.7:0/4238269158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff64de00640 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.903+0000 7ff64d400640 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fadf2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff64e800640 1 -- 172.21.15.7:0/4238269158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 msgr2=0x55c0fadf2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff64e800640 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fadf2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff64e800640 1 -- 172.21.15.7:0/4238269158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 msgr2=0x55c0fade6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff64e800640 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff64e800640 1 -- 172.21.15.7:0/4238269158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fab21620 con 0x55c0fade7390 2024-04-23T15:36:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff64e800640 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fadd76c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7ff6440057c0 tx=0x7ff644046f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a7edbdf3345eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff632600640 1 -- 172.21.15.7:0/4238269158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644057070 con 0x55c0fade7390 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.904+0000 7ff632600640 1 -- 172.21.15.7:0/4238269158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6440508c0 con 0x55c0fade7390 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff632600640 1 -- 172.21.15.7:0/4238269158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644035070 con 0x55c0fade7390 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 -- 172.21.15.7:0/4238269158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 msgr2=0x55c0fadd76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fadd76c0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7ff6440057c0 tx=0x7ff644046f40 comp rx=0 tx=0).stop 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 -- 172.21.15.7:0/4238269158 shutdown_connections 2024-04-23T15:36:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fadd76c0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fadf2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 --2- 172.21.15.7:0/4238269158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.905+0000 7ff6535cb740 1 -- 172.21.15.7:0/4238269158 >> 172.21.15.7:0/4238269158 conn(0x55c0fadd86c0 msgr2=0x55c0fadd6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.906+0000 7ff6535cb740 1 -- 172.21.15.7:0/4238269158 shutdown_connections 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.906+0000 7ff6535cb740 1 -- 172.21.15.7:0/4238269158 wait complete. 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.906+0000 7ff6535cb740 1 -- start start 2024-04-23T15:36:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.906+0000 7ff6535cb740 1 Processor -- start 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fae5c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b6e00 con 0x55c0fade7390 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b6730 con 0x55c0faddc1b0 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b3990 con 0x55c0faddcad0 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff6535cb740 10 client.0 _ll_register_callbacks cb 0x7ff64404a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fae5c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff64e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fae5c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33290/0 (socket says 172.21.15.7:33290) 2024-04-23T15:36:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff64e800640 1 -- 172.21.15.7:0/1257977865 learned_addr learned my addr 172.21.15.7:0/1257977865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff64de00640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.907+0000 7ff64d400640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff64e800640 1 -- 172.21.15.7:0/1257977865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 msgr2=0x55c0fade1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff64e800640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff64e800640 1 -- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 msgr2=0x55c0fade1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff64e800640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff64e800640 1 -- 172.21.15.7:0/1257977865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0fae5ca80 con 0x55c0fade7390 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff64e800640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fae5c540 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7ff644050840 tx=0x7ff644032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b3005cc6ef76f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff627400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff627400640 1 -- 172.21.15.7:0/1257977865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644057070 con 0x55c0fade7390 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6440508c0 con 0x55c0fade7390 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.908+0000 7ff627400640 1 -- 172.21.15.7:0/1257977865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 9467+0+0 (secure 0 0 0) 0x7ff644004040 con 0x55c0fade7390 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.909+0000 7ff627400640 1 -- 172.21.15.7:0/1257977865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff644075050 con 0x55c0fade7390 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.909+0000 7ff6535cb740 10 client.19275 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.909+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c0fae5dd00 con 0x55c0fade7390 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.909+0000 7ff627400640 1 -- 172.21.15.7:0/1257977865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6440508c0 con 0x55c0fade7390 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.909+0000 7ff627400640 1 -- 172.21.15.7:0/1257977865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff644044030 con 0x55c0fade7390 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff6535cb740 10 client.19275 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff6535cb740 10 client.19275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff6535cb740 20 client.19275 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff6535cb740 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fae5e330 0x55c0fae60750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff6535cb740 4 client.19275 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:36:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c0facc64b0 con 0x55c0fae5e330 2024-04-23T15:36:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.910+0000 7ff64de00640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fae5e330 0x55c0fae60750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.911+0000 7ff627400640 10 client.19275 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.911+0000 7ff64de00640 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fae5e330 0x55c0fae60750 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daed090614261ec9 server_cookie=c30a846942cf59e7 in_seq=0 out_seq=0 2024-04-23T15:36:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.950+0000 7ff627400640 1 -- 172.21.15.7:0/1257977865 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c0facc64b0 con 0x55c0fae5e330 2024-04-23T15:36:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff627400640 10 client.19275 handle_command_reply: tid=0 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 client.19275 shutdown 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 msgr2=0x55c0fae5c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fae5c540 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7ff644050840 tx=0x7ff644032e60 comp rx=0 tx=0).stop 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 shutdown_connections 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55c0fae5e330 0x55c0fae60750 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0fade7390 0x55c0fae5c540 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c0faddcad0 0x55c0fade1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 --2- 172.21.15.7:0/1257977865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c0faddc1b0 0x55c0fade1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 >> 172.21.15.7:0/1257977865 conn(0x55c0fadd86c0 msgr2=0x55c0fadd6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff627400640 0 client.19275 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 shutdown_connections 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.951+0000 7ff6535cb740 1 -- 172.21.15.7:0/1257977865 wait complete. 2024-04-23T15:36:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.952+0000 7ff6535cb740 20 client.19275 trim_cache size 0 max 16384 2024-04-23T15:36:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:36:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:36:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:36:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:36:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.952+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6340a3dc0 msgr2=0x7ff6340a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6340a3dc0 0x7ff6340a6280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6440096c0 tx=0x7ff64404a000 comp rx=0 tx=0).stop 2024-04-23T15:36:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 msgr2=0x7ff64819ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 0x7ff64819ed50 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7ff64000eab0 tx=0x7ff64000ef70 comp rx=0 tx=0).stop 2024-04-23T15:36:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 shutdown_connections 2024-04-23T15:36:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff6340a3dc0 0x7ff6340a6280 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff648074bf0 0x7ff64819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6481130c0 0x7ff6481a3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 --2- 172.21.15.7:0/1540362022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6480742d0 0x7ff64819ed50 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 >> 172.21.15.7:0/1540362022 conn(0x7ff648079490 msgr2=0x7ff6480feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 shutdown_connections 2024-04-23T15:36:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:01.953+0000 7ff650800640 1 -- 172.21.15.7:0/1540362022 wait complete. 2024-04-23T15:36:03.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:02 smithi007 ceph-mon[27906]: pgmap v1417: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.4 MiB/s wr, 36 op/s 2024-04-23T15:36:03.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:02 smithi186 ceph-mon[31814]: pgmap v1417: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.4 MiB/s wr, 36 op/s 2024-04-23T15:36:03.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:02 smithi137 ceph-mon[31694]: pgmap v1417: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.4 MiB/s wr, 36 op/s 2024-04-23T15:36:04.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:03 smithi007 ceph-mon[27906]: osdmap e169: 12 total, 12 up, 12 in 2024-04-23T15:36:04.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:03 smithi186 ceph-mon[31814]: osdmap e169: 12 total, 12 up, 12 in 2024-04-23T15:36:04.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:03 smithi137 ceph-mon[31694]: osdmap e169: 12 total, 12 up, 12 in 2024-04-23T15:36:05.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:04 smithi007 ceph-mon[27906]: pgmap v1419: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:36:05.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:04 smithi186 ceph-mon[31814]: pgmap v1419: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:36:05.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:04 smithi137 ceph-mon[31694]: pgmap v1419: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:36:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:06 smithi007 ceph-mon[27906]: pgmap v1420: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:36:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:06 smithi186 ceph-mon[31814]: pgmap v1420: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:36:07.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:06 smithi137 ceph-mon[31694]: pgmap v1420: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 32 op/s 2024-04-23T15:36:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:08 smithi007 ceph-mon[27906]: pgmap v1421: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:36:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:08 smithi186 ceph-mon[31814]: pgmap v1421: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:36:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:08 smithi137 ceph-mon[31694]: pgmap v1421: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:36:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:10 smithi007 ceph-mon[27906]: pgmap v1422: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:36:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:10 smithi186 ceph-mon[31814]: pgmap v1422: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:36:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:10 smithi137 ceph-mon[31694]: pgmap v1422: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 36 op/s 2024-04-23T15:36:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:12 smithi007 ceph-mon[27906]: osdmap e170: 12 total, 12 up, 12 in 2024-04-23T15:36:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:12 smithi007 ceph-mon[27906]: pgmap v1424: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:36:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:12 smithi186 ceph-mon[31814]: osdmap e170: 12 total, 12 up, 12 in 2024-04-23T15:36:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:12 smithi186 ceph-mon[31814]: pgmap v1424: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:36:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:12 smithi137 ceph-mon[31694]: osdmap e170: 12 total, 12 up, 12 in 2024-04-23T15:36:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:12 smithi137 ceph-mon[31694]: pgmap v1424: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 18 op/s 2024-04-23T15:36:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:14 smithi007 ceph-mon[27906]: pgmap v1425: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:36:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 -- 172.21.15.7:0/2336019767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103bb0 msgr2=0x7fa2c010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2336019767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103bb0 0x7fa2c010c090 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009900 tx=0x7fa2ac02a510 comp rx=0 tx=0).stop 2024-04-23T15:36:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 -- 172.21.15.7:0/2336019767 shutdown_connections 2024-04-23T15:36:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2336019767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2c010c5d0 0x7fa2c010ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2336019767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103bb0 0x7fa2c010c090 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2336019767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2c0103290 0x7fa2c0103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 -- 172.21.15.7:0/2336019767 >> 172.21.15.7:0/2336019767 conn(0x7fa2c0078080 msgr2=0x7fa2c0078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 -- 172.21.15.7:0/2336019767 shutdown_connections 2024-04-23T15:36:15.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.111+0000 7fa2c6600640 1 -- 172.21.15.7:0/2336019767 wait complete. 2024-04-23T15:36:15.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.112+0000 7fa2c6600640 1 Processor -- start 2024-04-23T15:36:15.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.112+0000 7fa2c6600640 1 -- start start 2024-04-23T15:36:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:14 smithi186 ceph-mon[31814]: pgmap v1425: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:36:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2c6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 0x7fa2c0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2c6600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2c0103bb0 0x7fa2c0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2c6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2c010c5d0 0x7fa2c0101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2c6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01122b0 con 0x7fa2c0103290 2024-04-23T15:36:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2c6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c0112130 con 0x7fa2c010c5d0 2024-04-23T15:36:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2c6600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c0112430 con 0x7fa2c0103bb0 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 0x7fa2c0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 0x7fa2c0100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33016/0 (socket says 172.21.15.7:33016) 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2bf400640 1 -- 172.21.15.7:0/2500464502 learned_addr learned my addr 172.21.15.7:0/2500464502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2c010c5d0 0x7fa2c0101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.113+0000 7fa2bea00640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2c0103bb0 0x7fa2c0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2bf400640 1 -- 172.21.15.7:0/2500464502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2c0103bb0 msgr2=0x7fa2c0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2bf400640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2c0103bb0 0x7fa2c0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2bf400640 1 -- 172.21.15.7:0/2500464502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2c010c5d0 msgr2=0x7fa2c0101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2bf400640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2c010c5d0 0x7fa2c0101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2bf400640 1 -- 172.21.15.7:0/2500464502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c01a6cb0 con 0x7fa2c0103290 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2bf400640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 0x7fa2c0100ee0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000d770 tx=0x7fa2b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2b7e00640 1 -- 172.21.15.7:0/2500464502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0017070 con 0x7fa2c0103290 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2b7e00640 1 -- 172.21.15.7:0/2500464502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2b00054d0 con 0x7fa2c0103290 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c01a6fa0 con 0x7fa2c0103290 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.114+0000 7fa2b7e00640 1 -- 172.21.15.7:0/2500464502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0004cf0 con 0x7fa2c0103290 2024-04-23T15:36:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.115+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c01a7410 con 0x7fa2c0103290 2024-04-23T15:36:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.118+0000 7fa2c93ff740 1 Processor -- start 2024-04-23T15:36:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 -- start start 2024-04-23T15:36:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2b7e00640 1 -- 172.21.15.7:0/2500464502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa2b0004e90 con 0x7fa2c0103290 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 0x556805402590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556805402ad0 0x55680540ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x55680540f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556805368900 con 0x5568054021b0 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55680530ef20 con 0x55680540d390 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5568053648c0 con 0x556805402ad0 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 0x556805402590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 0x556805402590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33018/0 (socket says 172.21.15.7:33018) 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.119+0000 7fa2bfe00640 1 -- 172.21.15.7:0/1442287822 learned_addr learned my addr 172.21.15.7:0/1442287822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bf400640 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556805402ad0 0x55680540ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bea00640 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x55680540f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bfe00640 1 -- 172.21.15.7:0/1442287822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556805402ad0 msgr2=0x55680540ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556805402ad0 0x55680540ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bfe00640 1 -- 172.21.15.7:0/1442287822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 msgr2=0x55680540f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x55680540f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.120+0000 7fa2bfe00640 1 -- 172.21.15.7:0/1442287822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556805333e10 con 0x5568054021b0 2024-04-23T15:36:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.121+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 0x556805402590 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009e60 tx=0x7fa2b8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fff89ce638531 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.121+0000 7fa2b4c00640 1 -- 172.21.15.7:0/1442287822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8016070 con 0x5568054021b0 2024-04-23T15:36:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.121+0000 7fa2b4c00640 1 -- 172.21.15.7:0/1442287822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2b8004d20 con 0x5568054021b0 2024-04-23T15:36:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.121+0000 7fa2b4c00640 1 -- 172.21.15.7:0/1442287822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8012740 con 0x5568054021b0 2024-04-23T15:36:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.121+0000 7fa2b7e00640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2a40a3e70 0x7fa2a40a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2b7e00640 1 -- 172.21.15.7:0/2500464502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7fa2b00d06a0 con 0x7fa2c0103290 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2bf400640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2a40a3e70 0x7fa2a40a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 -- 172.21.15.7:0/1442287822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 msgr2=0x556805402590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 0x556805402590 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009e60 tx=0x7fa2b8010740 comp rx=0 tx=0).stop 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 -- 172.21.15.7:0/1442287822 shutdown_connections 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x55680540f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556805402ad0 0x55680540ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/1442287822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568054021b0 0x556805402590 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.122+0000 7fa2c93ff740 1 -- 172.21.15.7:0/1442287822 >> 172.21.15.7:0/1442287822 conn(0x5568053fe6c0 msgr2=0x5568053feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.123+0000 7fa2c93ff740 1 -- 172.21.15.7:0/1442287822 shutdown_connections 2024-04-23T15:36:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.123+0000 7fa2c93ff740 1 -- 172.21.15.7:0/1442287822 wait complete. 2024-04-23T15:36:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.123+0000 7fa2bf400640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2a40a3e70 0x7fa2a40a6330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x556805403750 tx=0x7fa2b00d6530 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.123+0000 7fa2c93ff740 1 -- start start 2024-04-23T15:36:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.123+0000 7fa2c93ff740 1 Processor -- start 2024-04-23T15:36:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5568054021b0 0x55680540a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x55680540a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55680540d390 0x55680540ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55680540ffc0 con 0x556805402ad0 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5568053222c0 con 0x5568054021b0 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556805410140 con 0x55680540d390 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2c93ff740 10 client.0 _ll_register_callbacks cb 0x55680507aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x55680540a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x55680540a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33026/0 (socket says 172.21.15.7:33026) 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2bea00640 1 -- 172.21.15.7:0/4046352065 learned_addr learned my addr 172.21.15.7:0/4046352065 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.124+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5568054021b0 0x55680540a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55680540d390 0x55680540ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bea00640 1 -- 172.21.15.7:0/4046352065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55680540d390 msgr2=0x55680540ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bea00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55680540d390 0x55680540ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bea00640 1 -- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5568054021b0 msgr2=0x55680540a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bea00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5568054021b0 0x55680540a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bea00640 1 -- 172.21.15.7:0/4046352065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556805332fd0 con 0x556805402ad0 2024-04-23T15:36:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2bea00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x55680540a820 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009230 tx=0x7fa2ac005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed0b89e36d0e7c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.125+0000 7fa2a9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.126+0000 7fa2a9600640 1 -- 172.21.15.7:0/4046352065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac035030 con 0x556805402ad0 2024-04-23T15:36:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.126+0000 7fa2a9600640 1 -- 172.21.15.7:0/4046352065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7fa2ac0048c0 con 0x556805402ad0 2024-04-23T15:36:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.126+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2b8004d20 con 0x556805402ad0 2024-04-23T15:36:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.126+0000 7fa2a9600640 1 -- 172.21.15.7:0/4046352065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa2ac005d50 con 0x556805402ad0 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.126+0000 7fa2c93ff740 10 client.19287 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.126+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55680507b210 con 0x556805402ad0 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2a9600640 1 -- 172.21.15.7:0/4046352065 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2b8004d20 con 0x556805402ad0 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2a9600640 1 -- 172.21.15.7:0/4046352065 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa2ac0314a0 con 0x556805402ad0 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2c93ff740 10 client.19287 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2c93ff740 10 client.19287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2c93ff740 20 client.19287 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55680541d480 0x55680541f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2c93ff740 4 client.19287 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.127+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556805376320 con 0x55680541d480 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.128+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55680541d480 0x55680541f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.129+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55680541d480 0x55680541f870 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b5323ef516e0a8a server_cookie=e2e5ecf4bebb570d in_seq=0 out_seq=0 2024-04-23T15:36:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.129+0000 7fa2a9600640 10 client.19287 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.130+0000 7fa2a9600640 1 -- 172.21.15.7:0/4046352065 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556805376320 con 0x55680541d480 2024-04-23T15:36:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.130+0000 7fa2a9600640 10 client.19287 handle_command_reply: tid=0 2024-04-23T15:36:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.130+0000 7fa2c93ff740 1 client.19287 shutdown 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 msgr2=0x55680540a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x55680540a820 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009230 tx=0x7fa2ac005250 comp rx=0 tx=0).stop 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 shutdown_connections 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55680541d480 0x55680541f870 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55680540d390 0x55680540ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x55680540a820 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4046352065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5568054021b0 0x55680540a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 >> 172.21.15.7:0/4046352065 conn(0x5568053fe6c0 msgr2=0x5568054043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:15.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2a9600640 0 client.19287 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:15.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 shutdown_connections 2024-04-23T15:36:15.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4046352065 wait complete. 2024-04-23T15:36:15.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.131+0000 7fa2c93ff740 20 client.19287 trim_cache size 0 max 16384 2024-04-23T15:36:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 Processor -- start 2024-04-23T15:36:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 -- start start 2024-04-23T15:36:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805418e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805408bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x556805404b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01b1580 con 0x556805402ad0 2024-04-23T15:36:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01b30c0 con 0x55680540d390 2024-04-23T15:36:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.155+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01b1c50 con 0x5568054021b0 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805408bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805408bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33040/0 (socket says 172.21.15.7:33040) 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 -- 172.21.15.7:0/3819170732 learned_addr learned my addr 172.21.15.7:0/3819170732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805418e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x556805404b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 -- 172.21.15.7:0/3819170732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 msgr2=0x556805418e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805418e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 -- 172.21.15.7:0/3819170732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 msgr2=0x556805404b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x556805404b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 -- 172.21.15.7:0/3819170732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556805409290 con 0x556805402ad0 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x556805404b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.156+0000 7fa2bea00640 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805408bb0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009850 tx=0x7fa2ac005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edc5c2c6edf34bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.157+0000 7fa2abe00640 1 -- 172.21.15.7:0/3819170732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac035070 con 0x556805402ad0 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.157+0000 7fa2abe00640 1 -- 172.21.15.7:0/3819170732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2ac03f070 con 0x556805402ad0 2024-04-23T15:36:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.157+0000 7fa2abe00640 1 -- 172.21.15.7:0/3819170732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac005650 con 0x556805402ad0 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 -- 172.21.15.7:0/3819170732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 msgr2=0x556805408bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805408bb0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009850 tx=0x7fa2ac005b50 comp rx=0 tx=0).stop 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 -- 172.21.15.7:0/3819170732 shutdown_connections 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x556805404b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805408bb0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/3819170732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805418e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 -- 172.21.15.7:0/3819170732 >> 172.21.15.7:0/3819170732 conn(0x5568053fe6c0 msgr2=0x55680540ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 -- 172.21.15.7:0/3819170732 shutdown_connections 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 -- 172.21.15.7:0/3819170732 wait complete. 2024-04-23T15:36:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.158+0000 7fa2c93ff740 1 -- start start 2024-04-23T15:36:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 Processor -- start 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805411430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805411970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x5568054829b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01b29f0 con 0x556805402ad0 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01b2320 con 0x55680540d390 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c01af580 con 0x5568054021b0 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.159+0000 7fa2c93ff740 10 client.0 _ll_register_callbacks cb 0x7fa2ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805411970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805411970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33052/0 (socket says 172.21.15.7:33052) 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 -- 172.21.15.7:0/4063525228 learned_addr learned my addr 172.21.15.7:0/4063525228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805411430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x5568054829b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 -- 172.21.15.7:0/4063525228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 msgr2=0x556805411430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805411430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 -- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 msgr2=0x5568054829b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x5568054829b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 -- 172.21.15.7:0/4063525228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556805147620 con 0x556805402ad0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2bea00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805411970 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac02a550 tx=0x7fa2ac004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b890a0935c13826 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.160+0000 7fa2a9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2a9600640 1 -- 172.21.15.7:0/4063525228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac035070 con 0x556805402ad0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2a9600640 1 -- 172.21.15.7:0/4063525228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7fa2ac004ad0 con 0x556805402ad0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2ac03f070 con 0x556805402ad0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2a9600640 1 -- 172.21.15.7:0/4063525228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa2ac005250 con 0x556805402ad0 2024-04-23T15:36:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2c93ff740 10 client.19293 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556805483f00 con 0x556805402ad0 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.161+0000 7fa2a9600640 1 -- 172.21.15.7:0/4063525228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2ac03f070 con 0x556805402ad0 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2a9600640 1 -- 172.21.15.7:0/4063525228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa2ac044470 con 0x556805402ad0 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2c93ff740 10 client.19293 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2c93ff740 10 client.19293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2c93ff740 20 client.19293 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556805484510 0x556805486900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2c93ff740 4 client.19293 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556805370190 con 0x556805484510 2024-04-23T15:36:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.162+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556805484510 0x556805486900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.163+0000 7fa2bfe00640 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556805484510 0x556805486900 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c13c5923bda2a6 server_cookie=2245e0c42a37eb1c in_seq=0 out_seq=0 2024-04-23T15:36:15.165 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.163+0000 7fa2a9600640 10 client.19293 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:14 smithi137 ceph-mon[31694]: pgmap v1425: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:36:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2a9600640 1 -- 172.21.15.7:0/4063525228 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556805370190 con 0x556805484510 2024-04-23T15:36:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2a9600640 10 client.19293 handle_command_reply: tid=0 2024-04-23T15:36:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 client.19293 shutdown 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 msgr2=0x556805411970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805411970 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac02a550 tx=0x7fa2ac004500 comp rx=0 tx=0).stop 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 shutdown_connections 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556805484510 0x556805486900 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55680540d390 0x5568054829b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556805402ad0 0x556805411970 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.207+0000 7fa2c93ff740 1 --2- 172.21.15.7:0/4063525228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568054021b0 0x556805411430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.208+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 >> 172.21.15.7:0/4063525228 conn(0x5568053fe6c0 msgr2=0x5568053fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.208+0000 7fa2a9600640 0 client.19293 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.208+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 shutdown_connections 2024-04-23T15:36:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.208+0000 7fa2c93ff740 1 -- 172.21.15.7:0/4063525228 wait complete. 2024-04-23T15:36:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.208+0000 7fa2c93ff740 20 client.19293 trim_cache size 0 max 16384 2024-04-23T15:36:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:36:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:36:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:36:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2a40a3e70 msgr2=0x7fa2a40a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2a40a3e70 0x7fa2a40a6330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x556805403750 tx=0x7fa2b00d6530 comp rx=0 tx=0).stop 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 msgr2=0x7fa2c0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 0x7fa2c0100ee0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000d770 tx=0x7fa2b000dc30 comp rx=0 tx=0).stop 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 shutdown_connections 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa2a40a3e70 0x7fa2a40a6330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2c010c5d0 0x7fa2c0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2c0103bb0 0x7fa2c0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 --2- 172.21.15.7:0/2500464502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2c0103290 0x7fa2c0100ee0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 >> 172.21.15.7:0/2500464502 conn(0x7fa2c0078080 msgr2=0x7fa2c00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.209+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 shutdown_connections 2024-04-23T15:36:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:15.210+0000 7fa2c6600640 1 -- 172.21.15.7:0/2500464502 wait complete. 2024-04-23T15:36:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:16 smithi007 ceph-mon[27906]: pgmap v1426: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:36:17.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:16 smithi186 ceph-mon[31814]: pgmap v1426: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:36:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:16 smithi137 ceph-mon[31694]: pgmap v1426: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:36:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:18 smithi007 ceph-mon[27906]: pgmap v1427: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:36:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:18 smithi186 ceph-mon[31814]: pgmap v1427: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:36:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:18 smithi137 ceph-mon[31694]: pgmap v1427: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:36:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:20 smithi007 ceph-mon[27906]: pgmap v1428: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:36:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:20 smithi186 ceph-mon[31814]: pgmap v1428: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:36:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:20 smithi137 ceph-mon[31694]: pgmap v1428: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 17 op/s 2024-04-23T15:36:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:22 smithi007 ceph-mon[27906]: pgmap v1429: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.6 MiB/s wr, 22 op/s 2024-04-23T15:36:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:22 smithi186 ceph-mon[31814]: pgmap v1429: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.6 MiB/s wr, 22 op/s 2024-04-23T15:36:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:22 smithi137 ceph-mon[31694]: pgmap v1429: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.6 MiB/s wr, 22 op/s 2024-04-23T15:36:24.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:23 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:36:24.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:23 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:36:24.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:23 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:36:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:24 smithi007 ceph-mon[27906]: pgmap v1430: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:36:25.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:24 smithi186 ceph-mon[31814]: pgmap v1430: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:36:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:24 smithi137 ceph-mon[31694]: pgmap v1430: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:36:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:25 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:36:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:25 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:36:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:25 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:36:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:25 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:36:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:25 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:36:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:25 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:36:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:25 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:36:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:25 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:36:26.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:25 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:36:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:26 smithi007 ceph-mon[27906]: pgmap v1431: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:36:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:26 smithi186 ceph-mon[31814]: pgmap v1431: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:36:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:26 smithi137 ceph-mon[31694]: pgmap v1431: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 -- 172.21.15.7:0/1981826831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074430 msgr2=0x7f9af0074810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 --2- 172.21.15.7:0/1981826831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074430 0x7f9af0074810 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009900 tx=0x7f9ae002a480 comp rx=0 tx=0).stop 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 -- 172.21.15.7:0/1981826831 shutdown_connections 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 --2- 172.21.15.7:0/1981826831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9af0074d50 0x7f9af010e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 --2- 172.21.15.7:0/1981826831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af010e650 0x7f9af0110aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 --2- 172.21.15.7:0/1981826831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074430 0x7f9af0074810 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 -- 172.21.15.7:0/1981826831 >> 172.21.15.7:0/1981826831 conn(0x7f9af00fd940 msgr2=0x7f9af00ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 -- 172.21.15.7:0/1981826831 shutdown_connections 2024-04-23T15:36:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.365+0000 7f9aef200640 1 -- 172.21.15.7:0/1981826831 wait complete. 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 Processor -- start 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 -- start start 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af0074430 0x7f9af01a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 0x7f9af01a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9af010e650 0x7f9af019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01142d0 con 0x7f9af0074d50 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0114150 con 0x7f9af010e650 2024-04-23T15:36:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.367+0000 7f9aef200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0114450 con 0x7f9af0074430 2024-04-23T15:36:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 0x7f9af01a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 0x7f9af01a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47060/0 (socket says 172.21.15.7:47060) 2024-04-23T15:36:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 -- 172.21.15.7:0/2946495246 learned_addr learned my addr 172.21.15.7:0/2946495246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aede00640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af0074430 0x7f9af01a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aee800640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9af010e650 0x7f9af019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 -- 172.21.15.7:0/2946495246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af0074430 msgr2=0x7f9af01a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af0074430 0x7f9af01a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 -- 172.21.15.7:0/2946495246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9af010e650 msgr2=0x7f9af019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9af010e650 0x7f9af019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.368+0000 7f9aed400640 1 -- 172.21.15.7:0/2946495246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af019af10 con 0x7f9af0074d50 2024-04-23T15:36:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.369+0000 7f9aed400640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 0x7f9af01a0ad0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00d950 tx=0x7f9adc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.369+0000 7f9ae6a00640 1 -- 172.21.15.7:0/2946495246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc017070 con 0x7f9af0074d50 2024-04-23T15:36:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.369+0000 7f9ae6a00640 1 -- 172.21.15.7:0/2946495246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9adc009c30 con 0x7f9af0074d50 2024-04-23T15:36:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.369+0000 7f9ae6a00640 1 -- 172.21.15.7:0/2946495246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00f620 con 0x7f9af0074d50 2024-04-23T15:36:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.369+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af019b200 con 0x7f9af0074d50 2024-04-23T15:36:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.369+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af01a7510 con 0x7f9af0074d50 2024-04-23T15:36:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.373+0000 7f9af7da9740 1 Processor -- start 2024-04-23T15:36:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.373+0000 7f9af7da9740 1 -- start start 2024-04-23T15:36:28.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.373+0000 7f9ae6a00640 1 -- 172.21.15.7:0/2946495246 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f9adc0109a0 con 0x7f9af0074d50 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9af7da9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559fab046900 con 0x559fab0e03c0 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9af7da9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559faafecf20 con 0x559fab0e0ce0 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9af7da9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559fab0428c0 con 0x559fab0eb5a0 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9aee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9aee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47076/0 (socket says 172.21.15.7:47076) 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9aee800640 1 -- 172.21.15.7:0/1044764701 learned_addr learned my addr 172.21.15.7:0/1044764701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9aede00640 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.374+0000 7f9aed400640 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aee800640 1 -- 172.21.15.7:0/1044764701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 msgr2=0x559fab0ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aee800640 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aee800640 1 -- 172.21.15.7:0/1044764701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 msgr2=0x559fab0eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aee800640 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aee800640 1 -- 172.21.15.7:0/1044764701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fab011e10 con 0x559fab0e03c0 2024-04-23T15:36:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aede00640 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9aee800640 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e07a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009e60 tx=0x7f9ae8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc8605da53c5560 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9adb400640 1 -- 172.21.15.7:0/1044764701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8016070 con 0x559fab0e03c0 2024-04-23T15:36:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9ae6a00640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9ad40a3d10 0x7f9ad40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9adb400640 1 -- 172.21.15.7:0/1044764701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ae8004d20 con 0x559fab0e03c0 2024-04-23T15:36:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.375+0000 7f9adb400640 1 -- 172.21.15.7:0/1044764701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80126b0 con 0x559fab0e03c0 2024-04-23T15:36:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.376+0000 7f9ae6a00640 1 -- 172.21.15.7:0/2946495246 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7f9adc0d08c0 con 0x7f9af0074d50 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.376+0000 7f9aede00640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9ad40a3d10 0x7f9ad40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.376+0000 7f9af7da9740 1 -- 172.21.15.7:0/1044764701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 msgr2=0x559fab0e07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.376+0000 7f9af7da9740 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e07a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009e60 tx=0x7f9ae8010740 comp rx=0 tx=0).stop 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 -- 172.21.15.7:0/1044764701 shutdown_connections 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 --2- 172.21.15.7:0/1044764701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e07a0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 -- 172.21.15.7:0/1044764701 >> 172.21.15.7:0/1044764701 conn(0x559fab0dc8d0 msgr2=0x559fab0dccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 -- 172.21.15.7:0/1044764701 shutdown_connections 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9aede00640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9ad40a3d10 0x7f9ad40a61d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0000c00 tx=0x7f9ae0005e00 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 -- 172.21.15.7:0/1044764701 wait complete. 2024-04-23T15:36:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.377+0000 7f9af7da9740 1 -- start start 2024-04-23T15:36:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 Processor -- start 2024-04-23T15:36:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e03c0 0x559fab0e8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 0x559fab0e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559fab0ee0e0 con 0x559fab0eb5a0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559fab0002c0 con 0x559fab0e03c0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559fab0ee260 con 0x559fab0e0ce0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9af7da9740 10 client.0 _ll_register_callbacks cb 0x559faad58a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.378+0000 7f9aee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 0x559fab0e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 0x559fab0e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47082/0 (socket says 172.21.15.7:47082) 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 -- 172.21.15.7:0/4163172026 learned_addr learned my addr 172.21.15.7:0/4163172026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aede00640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e03c0 0x559fab0e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aed400640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 -- 172.21.15.7:0/4163172026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 msgr2=0x559fab0e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 -- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e03c0 msgr2=0x559fab0e8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e03c0 0x559fab0e8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 -- 172.21.15.7:0/4163172026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fab010fd0 con 0x559fab0eb5a0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9aee800640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 0x559fab0e90c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f80 tx=0x7f9ae8004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff35bcd44552184 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.379+0000 7f9acfe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9acfe00640 1 -- 172.21.15.7:0/4163172026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8029060 con 0x559fab0eb5a0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9acfe00640 1 -- 172.21.15.7:0/4163172026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7f9ae80051a0 con 0x559fab0eb5a0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ae8004d20 con 0x559fab0eb5a0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9acfe00640 1 -- 172.21.15.7:0/4163172026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9ae8030050 con 0x559fab0eb5a0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9af7da9740 10 client.19305 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559faad59210 con 0x559fab0eb5a0 2024-04-23T15:36:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.380+0000 7f9acfe00640 1 -- 172.21.15.7:0/4163172026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ae8004d20 con 0x559fab0eb5a0 2024-04-23T15:36:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9acfe00640 1 -- 172.21.15.7:0/4163172026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9ae800f040 con 0x559fab0eb5a0 2024-04-23T15:36:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9af7da9740 10 client.19305 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9af7da9740 10 client.19305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9af7da9740 20 client.19305 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab0fb6b0 0x559fab0fdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9af7da9740 4 client.19305 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.381+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fab054320 con 0x559fab0fb6b0 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.382+0000 7f9aede00640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab0fb6b0 0x559fab0fdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.383+0000 7f9aede00640 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab0fb6b0 0x559fab0fdaa0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40339a2ef6d1a564 server_cookie=66f879bcea209980 in_seq=0 out_seq=0 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.383+0000 7f9acfe00640 10 client.19305 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.384+0000 7f9acfe00640 1 -- 172.21.15.7:0/4163172026 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559fab054320 con 0x559fab0fb6b0 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.384+0000 7f9acfe00640 10 client.19305 handle_command_reply: tid=0 2024-04-23T15:36:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.384+0000 7f9af7da9740 1 client.19305 shutdown 2024-04-23T15:36:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 msgr2=0x559fab0e90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 0x559fab0e90c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f80 tx=0x7f9ae8004c70 comp rx=0 tx=0).stop 2024-04-23T15:36:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 shutdown_connections 2024-04-23T15:36:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab0fb6b0 0x559fab0fdaa0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0eb5a0 0x559fab0e90c0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4163172026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e03c0 0x559fab0e8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9acfe00640 0 client.19305 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 >> 172.21.15.7:0/4163172026 conn(0x559fab0dc8d0 msgr2=0x559fab0e2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 shutdown_connections 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 1 -- 172.21.15.7:0/4163172026 wait complete. 2024-04-23T15:36:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.385+0000 7f9af7da9740 20 client.19305 trim_cache size 0 max 16384 2024-04-23T15:36:28.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.409+0000 7f9af7da9740 1 Processor -- start 2024-04-23T15:36:28.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.409+0000 7f9af7da9740 1 -- start start 2024-04-23T15:36:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.410+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0ead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.410+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0dc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.410+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0eb5a0 0x559fab0e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.410+0000 7f9af7da9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01b14b0 con 0x559fab0e03c0 2024-04-23T15:36:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.410+0000 7f9af7da9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01b2ff0 con 0x559fab0eb5a0 2024-04-23T15:36:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.410+0000 7f9af7da9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01b1b80 con 0x559fab0e0ce0 2024-04-23T15:36:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aed400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aed400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0dc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:44352/0 (socket says 172.21.15.7:44352) 2024-04-23T15:36:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0ead70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47098/0 (socket says 172.21.15.7:47098) 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aed400640 1 -- 172.21.15.7:0/3800706748 learned_addr learned my addr 172.21.15.7:0/3800706748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aee800640 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0eb5a0 0x559fab0e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 -- 172.21.15.7:0/3800706748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 msgr2=0x559fab0dc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0dc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 -- 172.21.15.7:0/3800706748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0eb5a0 msgr2=0x559fab0e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0eb5a0 0x559fab0e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 -- 172.21.15.7:0/3800706748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fab0fde10 con 0x559fab0e03c0 2024-04-23T15:36:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.411+0000 7f9aede00640 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0ead70 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f9ae002aa70 tx=0x7f9ae003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cf7cc59cd37689 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.412+0000 7f9adaa00640 1 -- 172.21.15.7:0/3800706748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0056070 con 0x559fab0e03c0 2024-04-23T15:36:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.412+0000 7f9adaa00640 1 -- 172.21.15.7:0/3800706748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ae0050e20 con 0x559fab0e03c0 2024-04-23T15:36:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.412+0000 7f9adaa00640 1 -- 172.21.15.7:0/3800706748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0035050 con 0x559fab0e03c0 2024-04-23T15:36:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 -- 172.21.15.7:0/3800706748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 msgr2=0x559fab0ead70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0ead70 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f9ae002aa70 tx=0x7f9ae003d000 comp rx=0 tx=0).stop 2024-04-23T15:36:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 -- 172.21.15.7:0/3800706748 shutdown_connections 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0eb5a0 0x559fab0e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0e0ce0 0x559fab0dc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 --2- 172.21.15.7:0/3800706748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0ead70 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 -- 172.21.15.7:0/3800706748 >> 172.21.15.7:0/3800706748 conn(0x559fab0dc8d0 msgr2=0x559fab0e2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 -- 172.21.15.7:0/3800706748 shutdown_connections 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 -- 172.21.15.7:0/3800706748 wait complete. 2024-04-23T15:36:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.413+0000 7f9af7da9740 1 -- start start 2024-04-23T15:36:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 Processor -- start 2024-04-23T15:36:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01b2920 con 0x559fab0e03c0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01b2250 con 0x559fab0e0ce0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01af4b0 con 0x559fab0eb5a0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.414+0000 7f9af7da9740 10 client.0 _ll_register_callbacks cb 0x7f9ae8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47102/0 (socket says 172.21.15.7:47102) 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 -- 172.21.15.7:0/4193053673 learned_addr learned my addr 172.21.15.7:0/4193053673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aee800640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aed400640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 -- 172.21.15.7:0/4193053673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 msgr2=0x559fab0e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 -- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 msgr2=0x559fab0e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0e5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 -- 172.21.15.7:0/4193053673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559faae25620 con 0x559fab0e03c0 2024-04-23T15:36:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9aede00640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e52f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0004210 tx=0x7f9ae0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1c7bd6299d5ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.415+0000 7f9acfe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9acfe00640 1 -- 172.21.15.7:0/4193053673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae005f060 con 0x559fab0e03c0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ae0050e20 con 0x559fab0e03c0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9acfe00640 1 -- 172.21.15.7:0/4193053673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7f9ae0004d60 con 0x559fab0e03c0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9acfe00640 1 -- 172.21.15.7:0/4193053673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9ae0056070 con 0x559fab0e03c0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9af7da9740 10 client.19311 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559fab161970 con 0x559fab0e03c0 2024-04-23T15:36:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.416+0000 7f9acfe00640 1 -- 172.21.15.7:0/4193053673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ae0050e20 con 0x559fab0e03c0 2024-04-23T15:36:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9acfe00640 1 -- 172.21.15.7:0/4193053673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9ae00504b0 con 0x559fab0e03c0 2024-04-23T15:36:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9af7da9740 10 client.19311 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9af7da9740 10 client.19311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9af7da9740 20 client.19311 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab162030 0x559fab164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9af7da9740 4 client.19311 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:36:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.417+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559fab04e190 con 0x559fab162030 2024-04-23T15:36:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.418+0000 7f9aed400640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab162030 0x559fab164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.418+0000 7f9aed400640 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab162030 0x559fab164450 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98088cb8527f8b9 server_cookie=201e7aed61b773c0 in_seq=0 out_seq=0 2024-04-23T15:36:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.418+0000 7f9acfe00640 10 client.19311 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.457+0000 7f9acfe00640 1 -- 172.21.15.7:0/4193053673 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559fab04e190 con 0x559fab162030 2024-04-23T15:36:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.457+0000 7f9acfe00640 10 client.19311 handle_command_reply: tid=0 2024-04-23T15:36:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.457+0000 7f9af7da9740 1 client.19311 shutdown 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 msgr2=0x559fab0e52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e52f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0004210 tx=0x7f9ae0005710 comp rx=0 tx=0).stop 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 shutdown_connections 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559fab162030 0x559fab164450 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559fab0e0ce0 0x559fab0e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559fab0eb5a0 0x559fab0e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 --2- 172.21.15.7:0/4193053673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559fab0e03c0 0x559fab0e52f0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 >> 172.21.15.7:0/4193053673 conn(0x559fab0dc8d0 msgr2=0x559fab0e9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9acfe00640 0 client.19311 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 shutdown_connections 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.458+0000 7f9af7da9740 1 -- 172.21.15.7:0/4193053673 wait complete. 2024-04-23T15:36:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.459+0000 7f9af7da9740 20 client.19311 trim_cache size 0 max 16384 2024-04-23T15:36:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:36:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:36:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:36:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.459+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9ad40a3d10 msgr2=0x7f9ad40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.459+0000 7f9aef200640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9ad40a3d10 0x7f9ad40a61d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0000c00 tx=0x7f9ae0005e00 comp rx=0 tx=0).stop 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.459+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 msgr2=0x7f9af01a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.459+0000 7f9aef200640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 0x7f9af01a0ad0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00d950 tx=0x7f9adc00de10 comp rx=0 tx=0).stop 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 shutdown_connections 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9ad40a3d10 0x7f9ad40a61d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9af010e650 0x7f9af019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9af0074d50 0x7f9af01a0ad0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 --2- 172.21.15.7:0/2946495246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af0074430 0x7f9af01a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 >> 172.21.15.7:0/2946495246 conn(0x7f9af00fd940 msgr2=0x7f9af00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 shutdown_connections 2024-04-23T15:36:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:28.460+0000 7f9aef200640 1 -- 172.21.15.7:0/2946495246 wait complete. 2024-04-23T15:36:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:28 smithi007 ceph-mon[27906]: pgmap v1432: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:36:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:28 smithi186 ceph-mon[31814]: pgmap v1432: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:36:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:28 smithi137 ceph-mon[31694]: pgmap v1432: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:36:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:30 smithi007 ceph-mon[27906]: pgmap v1433: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:36:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:30 smithi186 ceph-mon[31814]: pgmap v1433: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:36:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:30 smithi137 ceph-mon[31694]: pgmap v1433: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.0 MiB/s wr, 9 op/s 2024-04-23T15:36:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:32 smithi007 ceph-mon[27906]: pgmap v1434: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:32 smithi186 ceph-mon[31814]: pgmap v1434: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:32 smithi137 ceph-mon[31694]: pgmap v1434: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:34 smithi007 ceph-mon[27906]: pgmap v1435: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:34 smithi186 ceph-mon[31814]: pgmap v1435: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:34 smithi137 ceph-mon[31694]: pgmap v1435: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:37 smithi007 ceph-mon[27906]: pgmap v1436: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:37 smithi186 ceph-mon[31814]: pgmap v1436: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:37 smithi137 ceph-mon[31694]: pgmap v1436: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:39 smithi007 ceph-mon[27906]: pgmap v1437: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:39 smithi186 ceph-mon[31814]: pgmap v1437: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:39 smithi137 ceph-mon[31694]: pgmap v1437: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:41 smithi007 ceph-mon[27906]: pgmap v1438: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:41 smithi186 ceph-mon[31814]: pgmap v1438: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:41 smithi137 ceph-mon[31694]: pgmap v1438: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 -- 172.21.15.7:0/3034053064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 msgr2=0x7f65f0100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 --2- 172.21.15.7:0/3034053064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f0100f80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009900 tx=0x7f65e002a400 comp rx=0 tx=0).stop 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 -- 172.21.15.7:0/3034053064 shutdown_connections 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 --2- 172.21.15.7:0/3034053064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f0101550 0x7f65f010e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 --2- 172.21.15.7:0/3034053064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65f010e750 0x7f65f0110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 --2- 172.21.15.7:0/3034053064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f0100f80 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.624+0000 7f65f4a00640 1 -- 172.21.15.7:0/3034053064 >> 172.21.15.7:0/3034053064 conn(0x7f65f00fc820 msgr2=0x7f65f00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.625+0000 7f65f4a00640 1 -- 172.21.15.7:0/3034053064 shutdown_connections 2024-04-23T15:36:41.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.625+0000 7f65f4a00640 1 -- 172.21.15.7:0/3034053064 wait complete. 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 Processor -- start 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 -- start start 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65f0101550 0x7f65f019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f010e750 0x7f65f019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01142d0 con 0x7f65f0100ba0 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0114150 con 0x7f65f010e750 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.626+0000 7f65f4a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0114450 con 0x7f65f0101550 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52410/0 (socket says 172.21.15.7:52410) 2024-04-23T15:36:41.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 -- 172.21.15.7:0/2009411598 learned_addr learned my addr 172.21.15.7:0/2009411598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ede00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65f0101550 0x7f65f019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ef200640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f010e750 0x7f65f019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 -- 172.21.15.7:0/2009411598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65f0101550 msgr2=0x7f65f019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65f0101550 0x7f65f019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 -- 172.21.15.7:0/2009411598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f010e750 msgr2=0x7f65f019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f010e750 0x7f65f019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.627+0000 7f65ee800640 1 -- 172.21.15.7:0/2009411598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f019f720 con 0x7f65f0100ba0 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.628+0000 7f65ee800640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f019a730 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f65e0005ab0 tx=0x7f65e0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.628+0000 7f65e7400640 1 -- 172.21.15.7:0/2009411598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e003f070 con 0x7f65f0100ba0 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.628+0000 7f65e7400640 1 -- 172.21.15.7:0/2009411598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65e0031d60 con 0x7f65f0100ba0 2024-04-23T15:36:41.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.628+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f019f9b0 con 0x7f65f0100ba0 2024-04-23T15:36:41.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.628+0000 7f65e7400640 1 -- 172.21.15.7:0/2009411598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0035030 con 0x7f65f0100ba0 2024-04-23T15:36:41.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.628+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f01a72a0 con 0x7f65f0100ba0 2024-04-23T15:36:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.632+0000 7f65e7400640 1 -- 172.21.15.7:0/2009411598 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f65e0042070 con 0x7f65f0100ba0 2024-04-23T15:36:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.632+0000 7f65f83c9740 1 Processor -- start 2024-04-23T15:36:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.632+0000 7f65f83c9740 1 -- start start 2024-04-23T15:36:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553d77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553e2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65f83c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563a5533d900 con 0x563a553d7ce0 2024-04-23T15:36:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65f83c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563a552e3f20 con 0x563a553e25a0 2024-04-23T15:36:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65f83c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563a553398c0 con 0x563a553d73c0 2024-04-23T15:36:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553e2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52414/0 (socket says 172.21.15.7:52414) 2024-04-23T15:36:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.633+0000 7f65ee800640 1 -- 172.21.15.7:0/3719873239 learned_addr learned my addr 172.21.15.7:0/3719873239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ef200640 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553d77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ede00640 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ee800640 1 -- 172.21.15.7:0/3719873239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 msgr2=0x563a553d77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ee800640 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553d77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ee800640 1 -- 172.21.15.7:0/3719873239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 msgr2=0x563a553e4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ee800640 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ee800640 1 -- 172.21.15.7:0/3719873239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a55308e10 con 0x563a553d7ce0 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ede00640 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65e7400640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65d40a3d10 0x7f65d40a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ee800640 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553e2060 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ee940 tx=0x7f65e00f7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4b702e0837bf09 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65e7400640 1 -- 172.21.15.7:0/2009411598 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7f65e00f16c0 con 0x7f65f0100ba0 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.634+0000 7f65ef200640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65d40a3d10 0x7f65d40a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.635+0000 7f65db400640 1 -- 172.21.15.7:0/3719873239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00b94f0 con 0x563a553d7ce0 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.635+0000 7f65db400640 1 -- 172.21.15.7:0/3719873239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65e00bd950 con 0x563a553d7ce0 2024-04-23T15:36:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.635+0000 7f65db400640 1 -- 172.21.15.7:0/3719873239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00bcbb0 con 0x563a553d7ce0 2024-04-23T15:36:41.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 -- 172.21.15.7:0/3719873239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 msgr2=0x563a553e2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553e2060 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ee940 tx=0x7f65e00f7cb0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65ef200640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65d40a3d10 0x7f65d40a61d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f65f0102d80 tx=0x7f65e8007380 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 -- 172.21.15.7:0/3719873239 shutdown_connections 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553e2060 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 --2- 172.21.15.7:0/3719873239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553d77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 -- 172.21.15.7:0/3719873239 >> 172.21.15.7:0/3719873239 conn(0x563a553d38d0 msgr2=0x563a553d3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 -- 172.21.15.7:0/3719873239 shutdown_connections 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.636+0000 7f65f83c9740 1 -- 172.21.15.7:0/3719873239 wait complete. 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 -- start start 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 Processor -- start 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563a553e4f90 con 0x563a553d7ce0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563a552f72c0 con 0x563a553e25a0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.637+0000 7f65f83c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563a553e5110 con 0x563a553d73c0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65f83c9740 10 client.0 _ll_register_callbacks cb 0x563a5504fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553dfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52430/0 (socket says 172.21.15.7:52430) 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 -- 172.21.15.7:0/2650927405 learned_addr learned my addr 172.21.15.7:0/2650927405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ee800640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ef200640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 -- 172.21.15.7:0/2650927405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 msgr2=0x563a553df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 -- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 msgr2=0x563a553e0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ede00640 1 -- 172.21.15.7:0/2650927405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a55307fd0 con 0x563a553d7ce0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.638+0000 7f65ee800640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.639+0000 7f65ede00640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553dfae0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00f390 tx=0x7f65dc00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5f459be82b50ad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.639+0000 7f65cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.639+0000 7f65cfe00640 1 -- 172.21.15.7:0/2650927405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc004440 con 0x563a553d7ce0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.639+0000 7f65cfe00640 1 -- 172.21.15.7:0/2650927405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7f65dc0035f0 con 0x563a553d7ce0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.639+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65e00bd950 con 0x563a553d7ce0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.639+0000 7f65cfe00640 1 -- 172.21.15.7:0/2650927405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f65dc005020 con 0x563a553d7ce0 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 10 client.19323 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563a55050210 con 0x563a553d7ce0 2024-04-23T15:36:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65cfe00640 1 -- 172.21.15.7:0/2650927405 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65e00bd950 con 0x563a553d7ce0 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65cfe00640 1 -- 172.21.15.7:0/2650927405 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f65dc0047a0 con 0x563a553d7ce0 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 10 client.19323 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 10 client.19323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 20 client.19323 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a553f2490 0x563a553f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 4 client.19323 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.640+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a5534b320 con 0x563a553f2490 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.641+0000 7f65ee800640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a553f2490 0x563a553f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.642+0000 7f65ee800640 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a553f2490 0x563a553f48c0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91acfed1a2693e07 server_cookie=2cd50ee27c34e642 in_seq=0 out_seq=0 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.642+0000 7f65cfe00640 10 client.19323 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65cfe00640 1 -- 172.21.15.7:0/2650927405 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563a5534b320 con 0x563a553f2490 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65cfe00640 10 client.19323 handle_command_reply: tid=0 2024-04-23T15:36:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 client.19323 shutdown 2024-04-23T15:36:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 msgr2=0x563a553dfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553dfae0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00f390 tx=0x7f65dc00f850 comp rx=0 tx=0).stop 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 shutdown_connections 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a553f2490 0x563a553f48c0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d7ce0 0x563a553dfae0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2650927405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d73c0 0x563a553df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 >> 172.21.15.7:0/2650927405 conn(0x563a553d38d0 msgr2=0x563a553d9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65cfe00640 0 client.19323 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 shutdown_connections 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 1 -- 172.21.15.7:0/2650927405 wait complete. 2024-04-23T15:36:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.644+0000 7f65f83c9740 20 client.19323 trim_cache size 0 max 16384 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 Processor -- start 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 -- start start 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553edd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d7ce0 0x563a553d9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01b1410 con 0x563a553d73c0 2024-04-23T15:36:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01b2f50 con 0x563a553e25a0 2024-04-23T15:36:41.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.662+0000 7f65f83c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01b1ae0 con 0x563a553d7ce0 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553edd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52440/0 (socket says 172.21.15.7:52440) 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 -- 172.21.15.7:0/4087529981 learned_addr learned my addr 172.21.15.7:0/4087529981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ede00640 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d7ce0 0x563a553d9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 -- 172.21.15.7:0/4087529981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d7ce0 msgr2=0x563a553d9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d7ce0 0x563a553d9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ef200640 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 -- 172.21.15.7:0/4087529981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 msgr2=0x563a553fa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553fa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 -- 172.21.15.7:0/4087529981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a553e4d00 con 0x563a553d73c0 2024-04-23T15:36:41.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ef200640 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:36:41.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.663+0000 7f65ee800640 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553edd00 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f65e00bcf50 tx=0x7f65e0005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f01205d69e48b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:41.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.664+0000 7f65daa00640 1 -- 172.21.15.7:0/4087529981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0049040 con 0x563a553d73c0 2024-04-23T15:36:41.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.664+0000 7f65daa00640 1 -- 172.21.15.7:0/4087529981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65e00bd950 con 0x563a553d73c0 2024-04-23T15:36:41.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.664+0000 7f65daa00640 1 -- 172.21.15.7:0/4087529981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00bcd90 con 0x563a553d73c0 2024-04-23T15:36:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 -- 172.21.15.7:0/4087529981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 msgr2=0x563a553edd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553edd00 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f65e00bcf50 tx=0x7f65e0005c90 comp rx=0 tx=0).stop 2024-04-23T15:36:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 -- 172.21.15.7:0/4087529981 shutdown_connections 2024-04-23T15:36:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553e25a0 0x563a553fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553d7ce0 0x563a553d9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 --2- 172.21.15.7:0/4087529981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553edd00 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 -- 172.21.15.7:0/4087529981 >> 172.21.15.7:0/4087529981 conn(0x563a553d38d0 msgr2=0x563a553e0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 -- 172.21.15.7:0/4087529981 shutdown_connections 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 -- 172.21.15.7:0/4087529981 wait complete. 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 -- start start 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.665+0000 7f65f83c9740 1 Processor -- start 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553ea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553d7ce0 0x563a553dc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553e25a0 0x563a553dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01b2880 con 0x563a553d73c0 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01b21b0 con 0x563a553d7ce0 2024-04-23T15:36:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01af410 con 0x563a553e25a0 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65f83c9740 10 client.0 _ll_register_callbacks cb 0x7f65dc00a330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65ee800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553ea780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52454/0 (socket says 172.21.15.7:52454) 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.666+0000 7f65ee800640 1 -- 172.21.15.7:0/2117689014 learned_addr learned my addr 172.21.15.7:0/2117689014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ef200640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553e25a0 0x563a553dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ede00640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553d7ce0 0x563a553dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ee800640 1 -- 172.21.15.7:0/2117689014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553e25a0 msgr2=0x563a553dc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ee800640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553e25a0 0x563a553dc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ee800640 1 -- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553d7ce0 msgr2=0x563a553dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ee800640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553d7ce0 0x563a553dc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ee800640 1 -- 172.21.15.7:0/2117689014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5511c620 con 0x563a553d73c0 2024-04-23T15:36:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ede00640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553d7ce0 0x563a553dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:36:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65ee800640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553ea780 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f65e002a9c0 tx=0x7f65e0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed511a2919d8506a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65cfe00640 1 -- 172.21.15.7:0/2117689014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00bd020 con 0x563a553d73c0 2024-04-23T15:36:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65cfe00640 1 -- 172.21.15.7:0/2117689014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7f65e00bb550 con 0x563a553d73c0 2024-04-23T15:36:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.667+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65e00bd950 con 0x563a553d73c0 2024-04-23T15:36:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65cfe00640 1 -- 172.21.15.7:0/2117689014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f65e00b94f0 con 0x563a553d73c0 2024-04-23T15:36:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 10 client.19329 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563a5511c620 con 0x563a553d73c0 2024-04-23T15:36:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65cfe00640 1 -- 172.21.15.7:0/2117689014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65e00bd950 con 0x563a553d73c0 2024-04-23T15:36:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65cfe00640 1 -- 172.21.15.7:0/2117689014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f65e00eec80 con 0x563a553d73c0 2024-04-23T15:36:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 10 client.19329 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 10 client.19329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 20 client.19329 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a55458bc0 0x563a5545afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 4 client.19329 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.668+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a55345190 con 0x563a55458bc0 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.669+0000 7f65ede00640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a55458bc0 0x563a5545afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.670+0000 7f65ede00640 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a55458bc0 0x563a5545afe0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2216edd9968286f server_cookie=fd1b192087b4baa7 in_seq=0 out_seq=0 2024-04-23T15:36:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.670+0000 7f65cfe00640 10 client.19329 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.710+0000 7f65cfe00640 1 -- 172.21.15.7:0/2117689014 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a55345190 con 0x563a55458bc0 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.710+0000 7f65cfe00640 10 client.19329 handle_command_reply: tid=0 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.710+0000 7f65f83c9740 1 client.19329 shutdown 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.710+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 msgr2=0x563a553ea780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.710+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553ea780 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f65e002a9c0 tx=0x7f65e0009260 comp rx=0 tx=0).stop 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 shutdown_connections 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563a55458bc0 0x563a5545afe0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a553d7ce0 0x563a553dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a553e25a0 0x563a553dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 --2- 172.21.15.7:0/2117689014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563a553d73c0 0x563a553ea780 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65cfe00640 0 client.19329 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 >> 172.21.15.7:0/2117689014 conn(0x563a553d38d0 msgr2=0x563a553e1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 shutdown_connections 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 1 -- 172.21.15.7:0/2117689014 wait complete. 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.711+0000 7f65f83c9740 20 client.19329 trim_cache size 0 max 16384 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:36:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:36:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:36:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65d40a3d10 msgr2=0x7f65d40a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65d40a3d10 0x7f65d40a61d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f65f0102d80 tx=0x7f65e8007380 comp rx=0 tx=0).stop 2024-04-23T15:36:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 msgr2=0x7f65f019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f019a730 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f65e0005ab0 tx=0x7f65e0003d50 comp rx=0 tx=0).stop 2024-04-23T15:36:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 shutdown_connections 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f65d40a3d10 0x7f65d40a61d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65f010e750 0x7f65f019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65f0101550 0x7f65f019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 --2- 172.21.15.7:0/2009411598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f0100ba0 0x7f65f019a730 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 >> 172.21.15.7:0/2009411598 conn(0x7f65f00fc820 msgr2=0x7f65f00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 shutdown_connections 2024-04-23T15:36:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:41.712+0000 7f65f4a00640 1 -- 172.21.15.7:0/2009411598 wait complete. 2024-04-23T15:36:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:43 smithi007 ceph-mon[27906]: pgmap v1439: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:36:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:43 smithi186 ceph-mon[31814]: pgmap v1439: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:36:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:43 smithi137 ceph-mon[31694]: pgmap v1439: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:36:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:45 smithi007 ceph-mon[27906]: pgmap v1440: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:36:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:45 smithi186 ceph-mon[31814]: pgmap v1440: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:36:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:45 smithi137 ceph-mon[31694]: pgmap v1440: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:36:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:47 smithi007 ceph-mon[27906]: pgmap v1441: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:36:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:47 smithi186 ceph-mon[31814]: pgmap v1441: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:36:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:47 smithi137 ceph-mon[31694]: pgmap v1441: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-04-23T15:36:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:49 smithi007 ceph-mon[27906]: pgmap v1442: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:49 smithi186 ceph-mon[31814]: pgmap v1442: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:49 smithi137 ceph-mon[31694]: pgmap v1442: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:51 smithi007 ceph-mon[27906]: pgmap v1443: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:51 smithi186 ceph-mon[31814]: pgmap v1443: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:51 smithi137 ceph-mon[31694]: pgmap v1443: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:36:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:53 smithi007 ceph-mon[27906]: pgmap v1444: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:53 smithi186 ceph-mon[31814]: pgmap v1444: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:53 smithi137 ceph-mon[31694]: pgmap v1444: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.870+0000 7fb157e00640 1 -- 172.21.15.7:0/4028230400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb158100c10 msgr2=0x7fb158100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.870+0000 7fb157e00640 1 --2- 172.21.15.7:0/4028230400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb158100c10 0x7fb158100ff0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fb148009900 tx=0x7fb14802a410 comp rx=0 tx=0).stop 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 -- 172.21.15.7:0/4028230400 shutdown_connections 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 --2- 172.21.15.7:0/4028230400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1581015c0 0x7fb15810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 --2- 172.21.15.7:0/4028230400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15810e7c0 0x7fb158110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 --2- 172.21.15.7:0/4028230400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb158100c10 0x7fb158100ff0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 -- 172.21.15.7:0/4028230400 >> 172.21.15.7:0/4028230400 conn(0x7fb1580fc840 msgr2=0x7fb1580fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 -- 172.21.15.7:0/4028230400 shutdown_connections 2024-04-23T15:36:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.871+0000 7fb157e00640 1 -- 172.21.15.7:0/4028230400 wait complete. 2024-04-23T15:36:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.872+0000 7fb157e00640 1 Processor -- start 2024-04-23T15:36:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.872+0000 7fb157e00640 1 -- start start 2024-04-23T15:36:54.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb157e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb158100c10 0x7fb1581a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb157e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 0x7fb1581a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb157e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15810e7c0 0x7fb15819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb157e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb158114340 con 0x7fb1581015c0 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb157e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581141c0 con 0x7fb158100c10 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb157e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581144c0 con 0x7fb15810e7c0 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 0x7fb1581a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 0x7fb1581a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34314/0 (socket says 172.21.15.7:34314) 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb156000640 1 -- 172.21.15.7:0/2101506722 learned_addr learned my addr 172.21.15.7:0/2101506722 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.873+0000 7fb156a00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb158100c10 0x7fb1581a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb157400640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15810e7c0 0x7fb15819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156000640 1 -- 172.21.15.7:0/2101506722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15810e7c0 msgr2=0x7fb15819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156000640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15810e7c0 0x7fb15819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156000640 1 -- 172.21.15.7:0/2101506722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb158100c10 msgr2=0x7fb1581a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156000640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb158100c10 0x7fb1581a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156000640 1 -- 172.21.15.7:0/2101506722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15819afc0 con 0x7fb1581015c0 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156a00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb158100c10 0x7fb1581a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.874+0000 7fb156000640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 0x7fb1581a0b30 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fb14400d950 tx=0x7fb14400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.875+0000 7fb15ca00640 1 -- 172.21.15.7:0/2101506722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144017030 con 0x7fb1581015c0 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.875+0000 7fb15ca00640 1 -- 172.21.15.7:0/2101506722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb144004020 con 0x7fb1581015c0 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.875+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15819b2b0 con 0x7fb1581015c0 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.875+0000 7fb15ca00640 1 -- 172.21.15.7:0/2101506722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440047a0 con 0x7fb1581015c0 2024-04-23T15:36:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.875+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1581a7570 con 0x7fb1581015c0 2024-04-23T15:36:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.879+0000 7fb160c1e740 1 Processor -- start 2024-04-23T15:36:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 -- start start 2024-04-23T15:36:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 0x55b2069bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b206915900 con 0x55b2069ba5a0 2024-04-23T15:36:54.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b2068bbf20 con 0x55b2069af3c0 2024-04-23T15:36:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb160c1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b2069118c0 con 0x55b2069afce0 2024-04-23T15:36:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.880+0000 7fb15ca00640 1 -- 172.21.15.7:0/2101506722 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb1440041d0 con 0x7fb1581015c0 2024-04-23T15:36:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 0x55b2069bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb157400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 0x55b2069bc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34326/0 (socket says 172.21.15.7:34326) 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb157400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:41238/0 (socket says 172.21.15.7:41238) 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 -- 172.21.15.7:0/3350672246 learned_addr learned my addr 172.21.15.7:0/3350672246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 -- 172.21.15.7:0/3350672246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 msgr2=0x55b2069ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 -- 172.21.15.7:0/3350672246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 msgr2=0x55b2069af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.881+0000 7fb156000640 1 -- 172.21.15.7:0/3350672246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2068e0e10 con 0x55b2069ba5a0 2024-04-23T15:36:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.882+0000 7fb156000640 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 0x55b2069bc990 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fb1440cd970 tx=0x7fb1440d6f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e4d9b523904022 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.882+0000 7fb143e00640 1 -- 172.21.15.7:0/3350672246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440df070 con 0x55b2069ba5a0 2024-04-23T15:36:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.882+0000 7fb15ca00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb13c0a3d90 0x7fb13c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.883+0000 7fb143e00640 1 -- 172.21.15.7:0/3350672246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb14409c950 con 0x55b2069ba5a0 2024-04-23T15:36:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.883+0000 7fb143e00640 1 -- 172.21.15.7:0/3350672246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440ab0c0 con 0x55b2069ba5a0 2024-04-23T15:36:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.883+0000 7fb15ca00640 1 -- 172.21.15.7:0/2101506722 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7fb1440d0660 con 0x7fb1581015c0 2024-04-23T15:36:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.883+0000 7fb157400640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb13c0a3d90 0x7fb13c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.883+0000 7fb160c1e740 1 -- 172.21.15.7:0/3350672246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 msgr2=0x55b2069bc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.883+0000 7fb160c1e740 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 0x55b2069bc990 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fb1440cd970 tx=0x7fb1440d6f10 comp rx=0 tx=0).stop 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 -- 172.21.15.7:0/3350672246 shutdown_connections 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069ba5a0 0x55b2069bc990 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 --2- 172.21.15.7:0/3350672246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 -- 172.21.15.7:0/3350672246 >> 172.21.15.7:0/3350672246 conn(0x55b2069ab8d0 msgr2=0x55b2069abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 -- 172.21.15.7:0/3350672246 shutdown_connections 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb157400640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb13c0a3d90 0x7fb13c0a6250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb158069290 tx=0x7fb1500096b0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 -- 172.21.15.7:0/3350672246 wait complete. 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.884+0000 7fb160c1e740 1 -- start start 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 Processor -- start 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.887 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069ba5a0 0x55b2069b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b2069bd0e0 con 0x55b2069afce0 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b2068cf2c0 con 0x55b2069af3c0 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55b2069bd260 con 0x55b2069ba5a0 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.885+0000 7fb160c1e740 10 client.0 _ll_register_callbacks cb 0x55b206627a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34338/0 (socket says 172.21.15.7:34338) 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 -- 172.21.15.7:0/972235461 learned_addr learned my addr 172.21.15.7:0/972235461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156a00640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb157400640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069ba5a0 0x55b2069b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 -- 172.21.15.7:0/972235461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069ba5a0 msgr2=0x55b2069b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069ba5a0 0x55b2069b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 -- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 msgr2=0x55b2069b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 -- 172.21.15.7:0/972235461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2068dffd0 con 0x55b2069afce0 2024-04-23T15:36:54.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156a00640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb156000640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b7a20 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fb14409c1e0 tx=0x7fb144005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd64a15bddac1bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.886+0000 7fb140c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb140c00640 1 -- 172.21.15.7:0/972235461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440aa2c0 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb140c00640 1 -- 172.21.15.7:0/972235461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7fb1440d0d20 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb14409c950 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb140c00640 1 -- 172.21.15.7:0/972235461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb1440aa510 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb160c1e740 10 client.19341 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b206628210 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.887+0000 7fb140c00640 1 -- 172.21.15.7:0/972235461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb14409c950 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb140c00640 1 -- 172.21.15.7:0/972235461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb1440cdc80 con 0x55b2069afce0 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb160c1e740 10 client.19341 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb160c1e740 10 client.19341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb160c1e740 20 client.19341 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb160c1e740 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b2069ca560 0x55b2069cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb160c1e740 4 client.19341 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:36:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.888+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b206923320 con 0x55b2069ca560 2024-04-23T15:36:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.889+0000 7fb156a00640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b2069ca560 0x55b2069cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.890+0000 7fb156a00640 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b2069ca560 0x55b2069cc950 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c32b1cfcfa4f30d1 server_cookie=fa475e93de0ae5a4 in_seq=0 out_seq=0 2024-04-23T15:36:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.890+0000 7fb140c00640 10 client.19341 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.891+0000 7fb140c00640 1 -- 172.21.15.7:0/972235461 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b206923320 con 0x55b2069ca560 2024-04-23T15:36:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.891+0000 7fb140c00640 10 client.19341 handle_command_reply: tid=0 2024-04-23T15:36:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.891+0000 7fb160c1e740 1 client.19341 shutdown 2024-04-23T15:36:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 msgr2=0x55b2069b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b7a20 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fb14409c1e0 tx=0x7fb144005130 comp rx=0 tx=0).stop 2024-04-23T15:36:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 shutdown_connections 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b2069ca560 0x55b2069cc950 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069ba5a0 0x55b2069b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b7a20 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 --2- 172.21.15.7:0/972235461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069af3c0 0x55b2069b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb140c00640 0 client.19341 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 >> 172.21.15.7:0/972235461 conn(0x55b2069ab8d0 msgr2=0x55b2069aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 shutdown_connections 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 1 -- 172.21.15.7:0/972235461 wait complete. 2024-04-23T15:36:54.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.892+0000 7fb160c1e740 20 client.19341 trim_cache size 0 max 16384 2024-04-23T15:36:54.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.912+0000 7fb160c1e740 1 Processor -- start 2024-04-23T15:36:54.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.912+0000 7fb160c1e740 1 -- start start 2024-04-23T15:36:54.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069af3c0 0x55b2069b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb160c1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581b1550 con 0x55b2069afce0 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb160c1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581b3090 con 0x55b2069ba5a0 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb160c1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581b1c20 con 0x55b2069af3c0 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34352/0 (socket says 172.21.15.7:34352) 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 -- 172.21.15.7:0/959244695 learned_addr learned my addr 172.21.15.7:0/959244695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 -- 172.21.15.7:0/959244695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069af3c0 msgr2=0x55b2069b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069af3c0 0x55b2069b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 -- 172.21.15.7:0/959244695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 msgr2=0x55b2069cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.913+0000 7fb156000640 1 -- 172.21.15.7:0/959244695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2069b2370 con 0x55b2069afce0 2024-04-23T15:36:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.914+0000 7fb156000640 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b6640 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fb14409a500 tx=0x7fb1440050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b8a9bad43d1a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.914+0000 7fb143400640 1 -- 172.21.15.7:0/959244695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440df030 con 0x55b2069afce0 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.914+0000 7fb143400640 1 -- 172.21.15.7:0/959244695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1440d6320 con 0x55b2069afce0 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.914+0000 7fb143400640 1 -- 172.21.15.7:0/959244695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440aa710 con 0x55b2069afce0 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 -- 172.21.15.7:0/959244695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 msgr2=0x55b2069b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b6640 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fb14409a500 tx=0x7fb1440050c0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 -- 172.21.15.7:0/959244695 shutdown_connections 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069afce0 0x55b2069b6640 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 --2- 172.21.15.7:0/959244695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069af3c0 0x55b2069b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 -- 172.21.15.7:0/959244695 >> 172.21.15.7:0/959244695 conn(0x55b2069ab8d0 msgr2=0x55b2069abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 -- 172.21.15.7:0/959244695 shutdown_connections 2024-04-23T15:36:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.915+0000 7fb160c1e740 1 -- 172.21.15.7:0/959244695 wait complete. 2024-04-23T15:36:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.916+0000 7fb160c1e740 1 -- start start 2024-04-23T15:36:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.916+0000 7fb160c1e740 1 Processor -- start 2024-04-23T15:36:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.916+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 0x55b2069cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.916+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb160c1e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb160c1e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581b29c0 con 0x55b2069af3c0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb160c1e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581b22f0 con 0x55b2069ba5a0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb160c1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581af550 con 0x55b2069afce0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb160c1e740 10 client.0 _ll_register_callbacks cb 0x7fb150009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 0x55b2069cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 0x55b2069cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34356/0 (socket says 172.21.15.7:34356) 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 -- 172.21.15.7:0/1059982182 learned_addr learned my addr 172.21.15.7:0/1059982182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156000640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb157400640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 -- 172.21.15.7:0/1059982182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 msgr2=0x55b2069ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 -- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 msgr2=0x55b2069cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb156a00640 1 -- 172.21.15.7:0/1059982182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2066f4620 con 0x55b2069af3c0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.917+0000 7fb157400640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb156a00640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 0x55b2069cfad0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fb148031440 tx=0x7fb148005150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e74c25c8d3833f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb140c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb140c00640 1 -- 172.21.15.7:0/1059982182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148035040 con 0x55b2069af3c0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb140c00640 1 -- 172.21.15.7:0/1059982182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(170..170 src has 1..170) ==== 9467+0+0 (secure 0 0 0) 0x7fb1480054d0 con 0x55b2069af3c0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1440d6320 con 0x55b2069af3c0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb140c00640 1 -- 172.21.15.7:0/1059982182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb148044bc0 con 0x55b2069af3c0 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb160c1e740 10 client.19347 fetch_fsmap learned FSMap version 32 2024-04-23T15:36:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.918+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b206a30310 con 0x55b2069af3c0 2024-04-23T15:36:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb140c00640 1 -- 172.21.15.7:0/1059982182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1440d6320 con 0x55b2069af3c0 2024-04-23T15:36:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb140c00640 1 -- 172.21.15.7:0/1059982182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb148004920 con 0x55b2069af3c0 2024-04-23T15:36:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb160c1e740 10 client.19347 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:36:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb160c1e740 10 client.19347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:36:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb160c1e740 20 client.19347 populate_metadata read hostname 'smithi007' 2024-04-23T15:36:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb160c1e740 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b206a30a30 0x55b206a32e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:36:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb160c1e740 4 client.19347 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:36:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.919+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b20691d190 con 0x55b206a30a30 2024-04-23T15:36:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.920+0000 7fb156000640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b206a30a30 0x55b206a32e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:36:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.920+0000 7fb156000640 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b206a30a30 0x55b206a32e50 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71ac3183791e575b server_cookie=46e57d10ed57293c in_seq=0 out_seq=0 2024-04-23T15:36:54.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.921+0000 7fb140c00640 10 client.19347 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb140c00640 1 -- 172.21.15.7:0/1059982182 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b20691d190 con 0x55b206a30a30 2024-04-23T15:36:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb140c00640 10 client.19347 handle_command_reply: tid=0 2024-04-23T15:36:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 client.19347 shutdown 2024-04-23T15:36:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 msgr2=0x55b2069cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 0x55b2069cfad0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fb148031440 tx=0x7fb148005150 comp rx=0 tx=0).stop 2024-04-23T15:36:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 shutdown_connections 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55b206a30a30 0x55b206a32e50 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2069ba5a0 0x55b2069cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2069afce0 0x55b2069ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 --2- 172.21.15.7:0/1059982182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2069af3c0 0x55b2069cfad0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb140c00640 0 client.19347 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.957+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 >> 172.21.15.7:0/1059982182 conn(0x55b2069ab8d0 msgr2=0x55b2069aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.958+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 shutdown_connections 2024-04-23T15:36:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.958+0000 7fb160c1e740 1 -- 172.21.15.7:0/1059982182 wait complete. 2024-04-23T15:36:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.958+0000 7fb160c1e740 20 client.19347 trim_cache size 0 max 16384 2024-04-23T15:36:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:36:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:36:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:36:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb13c0a3d90 msgr2=0x7fb13c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb13c0a3d90 0x7fb13c0a6250 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb158069290 tx=0x7fb1500096b0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 msgr2=0x7fb1581a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 0x7fb1581a0b30 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fb14400d950 tx=0x7fb14400de10 comp rx=0 tx=0).stop 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 shutdown_connections 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb13c0a3d90 0x7fb13c0a6250 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb15810e7c0 0x7fb15819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1581015c0 0x7fb1581a0b30 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 --2- 172.21.15.7:0/2101506722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb158100c10 0x7fb1581a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 >> 172.21.15.7:0/2101506722 conn(0x7fb1580fc840 msgr2=0x7fb1580fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:36:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 shutdown_connections 2024-04-23T15:36:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:36:54.959+0000 7fb157e00640 1 -- 172.21.15.7:0/2101506722 wait complete. 2024-04-23T15:36:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:55 smithi007 ceph-mon[27906]: pgmap v1445: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:36:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:55 smithi186 ceph-mon[31814]: pgmap v1445: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:36:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:55 smithi137 ceph-mon[31694]: pgmap v1445: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:36:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:57 smithi007 ceph-mon[27906]: pgmap v1446: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:36:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:57 smithi186 ceph-mon[31814]: pgmap v1446: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:36:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:57 smithi137 ceph-mon[31694]: pgmap v1446: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-23T15:36:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:36:59 smithi007 ceph-mon[27906]: pgmap v1447: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2024-04-23T15:36:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:36:59 smithi186 ceph-mon[31814]: pgmap v1447: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2024-04-23T15:36:59.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:36:59 smithi137 ceph-mon[31694]: pgmap v1447: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2024-04-23T15:37:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:01 smithi007 ceph-mon[27906]: pgmap v1448: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:37:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:01 smithi186 ceph-mon[31814]: pgmap v1448: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:37:01.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:01 smithi137 ceph-mon[31694]: pgmap v1448: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.7 MiB/s wr, 14 op/s 2024-04-23T15:37:02.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:02 smithi007 ceph-mon[27906]: pgmap v1449: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 36 op/s 2024-04-23T15:37:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:02 smithi186 ceph-mon[31814]: pgmap v1449: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 36 op/s 2024-04-23T15:37:02.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:02 smithi137 ceph-mon[31694]: pgmap v1449: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 36 op/s 2024-04-23T15:37:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:04 smithi007 ceph-mon[27906]: osdmap e171: 12 total, 12 up, 12 in 2024-04-23T15:37:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:04 smithi007 ceph-mon[27906]: pgmap v1451: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 37 op/s 2024-04-23T15:37:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:04 smithi186 ceph-mon[31814]: osdmap e171: 12 total, 12 up, 12 in 2024-04-23T15:37:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:04 smithi186 ceph-mon[31814]: pgmap v1451: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 37 op/s 2024-04-23T15:37:04.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:04 smithi137 ceph-mon[31694]: osdmap e171: 12 total, 12 up, 12 in 2024-04-23T15:37:04.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:04 smithi137 ceph-mon[31694]: pgmap v1451: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 37 op/s 2024-04-23T15:37:07.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:06 smithi007 ceph-mon[27906]: pgmap v1452: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 37 op/s 2024-04-23T15:37:07.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:06 smithi186 ceph-mon[31814]: pgmap v1452: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 37 op/s 2024-04-23T15:37:07.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:06 smithi137 ceph-mon[31694]: pgmap v1452: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.6 MiB/s wr, 37 op/s 2024-04-23T15:37:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 -- 172.21.15.7:0/490067363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c100bb0 msgr2=0x7f4d3c100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 --2- 172.21.15.7:0/490067363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c100bb0 0x7f4d3c100f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d3002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 -- 172.21.15.7:0/490067363 shutdown_connections 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 --2- 172.21.15.7:0/490067363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c10e760 0x7f4d3c110b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 --2- 172.21.15.7:0/490067363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d3c101560 0x7f4d3c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 --2- 172.21.15.7:0/490067363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c100bb0 0x7f4d3c100f90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 -- 172.21.15.7:0/490067363 >> 172.21.15.7:0/490067363 conn(0x7f4d3c0fc810 msgr2=0x7f4d3c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 -- 172.21.15.7:0/490067363 shutdown_connections 2024-04-23T15:37:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.111+0000 7f4d42800640 1 -- 172.21.15.7:0/490067363 wait complete. 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.112+0000 7f4d42800640 1 Processor -- start 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.112+0000 7f4d42800640 1 -- start start 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d42800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d3c100bb0 0x7f4d3c1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d42800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 0x7f4d3c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d42800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c10e760 0x7f4d3c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d42800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c114300 con 0x7f4d3c101560 2024-04-23T15:37:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d42800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c114180 con 0x7f4d3c10e760 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d42800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c114480 con 0x7f4d3c100bb0 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d40a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 0x7f4d3c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d40a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 0x7f4d3c1a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40878/0 (socket says 172.21.15.7:40878) 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d40a00640 1 -- 172.21.15.7:0/141395142 learned_addr learned my addr 172.21.15.7:0/141395142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d41e00640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c10e760 0x7f4d3c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.113+0000 7f4d41400640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d3c100bb0 0x7f4d3c1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d40a00640 1 -- 172.21.15.7:0/141395142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d3c100bb0 msgr2=0x7f4d3c1a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d40a00640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d3c100bb0 0x7f4d3c1a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d40a00640 1 -- 172.21.15.7:0/141395142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c10e760 msgr2=0x7f4d3c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d40a00640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c10e760 0x7f4d3c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d40a00640 1 -- 172.21.15.7:0/141395142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c19af40 con 0x7f4d3c101560 2024-04-23T15:37:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d40a00640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 0x7f4d3c1a0b00 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e9f0 tx=0x7f4d2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d3a000640 1 -- 172.21.15.7:0/141395142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800cd80 con 0x7f4d3c101560 2024-04-23T15:37:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d3a000640 1 -- 172.21.15.7:0/141395142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d280054d0 con 0x7f4d3c101560 2024-04-23T15:37:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d3a000640 1 -- 172.21.15.7:0/141395142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28010490 con 0x7f4d3c101560 2024-04-23T15:37:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.114+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c19b230 con 0x7f4d3c101560 2024-04-23T15:37:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.115+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3c1a7540 con 0x7f4d3c101560 2024-04-23T15:37:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.118+0000 7f4d3a000640 1 -- 172.21.15.7:0/141395142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4d28005020 con 0x7f4d3c101560 2024-04-23T15:37:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.118+0000 7f4d46de9740 1 Processor -- start 2024-04-23T15:37:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 -- start start 2024-04-23T15:37:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdb95a0 0x55746cdbb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55746cd14900 con 0x55746cdaece0 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55746ccbaf20 con 0x55746cdae3c0 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d46de9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55746cd108c0 con 0x55746cdb95a0 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.119+0000 7f4d41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40892/0 (socket says 172.21.15.7:40892) 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 -- 172.21.15.7:0/690335649 learned_addr learned my addr 172.21.15.7:0/690335649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41e00640 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d40a00640 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdb95a0 0x55746cdbb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 -- 172.21.15.7:0/690335649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdb95a0 msgr2=0x55746cdbb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdb95a0 0x55746cdbb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 -- 172.21.15.7:0/690335649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 msgr2=0x55746cdae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d41400640 1 -- 172.21.15.7:0/690335649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746ccdfe10 con 0x55746cdaece0 2024-04-23T15:37:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.120+0000 7f4d3a000640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4d240a3d90 0x7f4d240a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.121+0000 7f4d3a000640 1 -- 172.21.15.7:0/141395142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 9555+0+0 (secure 0 0 0) 0x7f4d280d1090 con 0x7f4d3c101560 2024-04-23T15:37:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.121+0000 7f4d41400640 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb9060 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d300040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca57114f0b2db4b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.121+0000 7f4d41e00640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4d240a3d90 0x7f4d240a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.121+0000 7f4d2e600640 1 -- 172.21.15.7:0/690335649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30035030 con 0x55746cdaece0 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.121+0000 7f4d2e600640 1 -- 172.21.15.7:0/690335649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d300044b0 con 0x55746cdaece0 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.121+0000 7f4d2e600640 1 -- 172.21.15.7:0/690335649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d300035f0 con 0x55746cdaece0 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 -- 172.21.15.7:0/690335649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 msgr2=0x55746cdb9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d41e00640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4d240a3d90 0x7f4d240a6250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c102d90 tx=0x7f4d34009560 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb9060 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d300040c0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 -- 172.21.15.7:0/690335649 shutdown_connections 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdb95a0 0x55746cdbb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb9060 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 --2- 172.21.15.7:0/690335649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 -- 172.21.15.7:0/690335649 >> 172.21.15.7:0/690335649 conn(0x55746cdaa8d0 msgr2=0x55746cdaacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.122+0000 7f4d46de9740 1 -- 172.21.15.7:0/690335649 shutdown_connections 2024-04-23T15:37:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.123+0000 7f4d46de9740 1 -- 172.21.15.7:0/690335649 wait complete. 2024-04-23T15:37:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.123+0000 7f4d46de9740 1 -- start start 2024-04-23T15:37:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.123+0000 7f4d46de9740 1 Processor -- start 2024-04-23T15:37:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdae3c0 0x55746cdb6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746cdb6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55746cdbc020 con 0x55746cdaece0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55746ccce2c0 con 0x55746cdb95a0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55746cdbc1a0 con 0x55746cdae3c0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d46de9740 10 client.0 _ll_register_callbacks cb 0x55746ca26a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d40a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d40a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40906/0 (socket says 172.21.15.7:40906) 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d40a00640 1 -- 172.21.15.7:0/1995676208 learned_addr learned my addr 172.21.15.7:0/1995676208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d41400640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdae3c0 0x55746cdb6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.124+0000 7f4d41e00640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746cdb6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d40a00640 1 -- 172.21.15.7:0/1995676208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdae3c0 msgr2=0x55746cdb6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d40a00640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdae3c0 0x55746cdb6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d40a00640 1 -- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 msgr2=0x55746cdb6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d40a00640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746cdb6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d40a00640 1 -- 172.21.15.7:0/1995676208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746ccdefd0 con 0x55746cdaece0 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d41400640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdae3c0 0x55746cdb6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d41e00640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746cdb6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d40a00640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb6a40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e9c0 tx=0x7f4d2809ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c302f45661e5fb61 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d22a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d22a00640 1 -- 172.21.15.7:0/1995676208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28005310 con 0x55746cdaece0 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d22a00640 1 -- 172.21.15.7:0/1995676208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 9555+0+0 (secure 0 0 0) 0x7f4d28099230 con 0x55746cdaece0 2024-04-23T15:37:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d300044b0 con 0x55746cdaece0 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d22a00640 1 -- 172.21.15.7:0/1995676208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4d28005680 con 0x55746cdaece0 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.125+0000 7f4d46de9740 10 client.19359 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55746ca27210 con 0x55746cdaece0 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d22a00640 1 -- 172.21.15.7:0/1995676208 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d300044b0 con 0x55746cdaece0 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d22a00640 1 -- 172.21.15.7:0/1995676208 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4d280ce5f0 con 0x55746cdaece0 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 10 client.19359 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 10 client.19359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 20 client.19359 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746cdc9750 0x55746cdcbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 4 client.19359 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.126+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55746cd22320 con 0x55746cdc9750 2024-04-23T15:37:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.127+0000 7f4d41400640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746cdc9750 0x55746cdcbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.128+0000 7f4d41400640 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746cdc9750 0x55746cdcbb40 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af19b0a242d2b5a0 server_cookie=6b6a2be6612cf1b in_seq=0 out_seq=0 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.128+0000 7f4d22a00640 10 client.19359 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d22a00640 1 -- 172.21.15.7:0/1995676208 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55746cd22320 con 0x55746cdc9750 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d22a00640 10 client.19359 handle_command_reply: tid=0 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 client.19359 shutdown 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 msgr2=0x55746cdb6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb6a40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e9c0 tx=0x7f4d2809ca50 comp rx=0 tx=0).stop 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 shutdown_connections 2024-04-23T15:37:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746cdc9750 0x55746cdcbb40 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746cdb6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdaece0 0x55746cdb6a40 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d22a00640 0 client.19359 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1995676208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdae3c0 0x55746cdb6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 >> 172.21.15.7:0/1995676208 conn(0x55746cdaa8d0 msgr2=0x55746cdb0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 shutdown_connections 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.130+0000 7f4d46de9740 1 -- 172.21.15.7:0/1995676208 wait complete. 2024-04-23T15:37:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.131+0000 7f4d46de9740 20 client.19359 trim_cache size 0 max 16384 2024-04-23T15:37:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 Processor -- start 2024-04-23T15:37:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 -- start start 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdc50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 0x55746cdb6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b14a0 con 0x55746cdb95a0 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b2fe0 con 0x55746cdae3c0 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d46de9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b1b70 con 0x55746cdaece0 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d41e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 0x55746cdb6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d41e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 0x55746cdb6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40922/0 (socket says 172.21.15.7:40922) 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.148+0000 7f4d41e00640 1 -- 172.21.15.7:0/2391964020 learned_addr learned my addr 172.21.15.7:0/2391964020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d41400640 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdc50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d40a00640 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d41e00640 1 -- 172.21.15.7:0/2391964020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 msgr2=0x55746cdb0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d41e00640 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d41e00640 1 -- 172.21.15.7:0/2391964020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 msgr2=0x55746cdc50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d41e00640 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdc50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.149+0000 7f4d41e00640 1 -- 172.21.15.7:0/2391964020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746cdbbd00 con 0x55746cdb95a0 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.150+0000 7f4d41e00640 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 0x55746cdb6bd0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4d34012770 tx=0x7f4d34014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2323838bd495102a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.150+0000 7f4d2dc00640 1 -- 172.21.15.7:0/2391964020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004d20 con 0x55746cdb95a0 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.150+0000 7f4d2dc00640 1 -- 172.21.15.7:0/2391964020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d3401eaa0 con 0x55746cdb95a0 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.150+0000 7f4d2dc00640 1 -- 172.21.15.7:0/2391964020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3401fa90 con 0x55746cdb95a0 2024-04-23T15:37:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 -- 172.21.15.7:0/2391964020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 msgr2=0x55746cdb6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 0x55746cdb6bd0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4d34012770 tx=0x7f4d34014000 comp rx=0 tx=0).stop 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 -- 172.21.15.7:0/2391964020 shutdown_connections 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdb95a0 0x55746cdb6bd0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 --2- 172.21.15.7:0/2391964020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdae3c0 0x55746cdc50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 -- 172.21.15.7:0/2391964020 >> 172.21.15.7:0/2391964020 conn(0x55746cdaa8d0 msgr2=0x55746cdb64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 -- 172.21.15.7:0/2391964020 shutdown_connections 2024-04-23T15:37:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 -- 172.21.15.7:0/2391964020 wait complete. 2024-04-23T15:37:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.151+0000 7f4d46de9740 1 -- start start 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 Processor -- start 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 0x55746cdb3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746ce2ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b2910 con 0x55746cdae3c0 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b2240 con 0x55746cdb95a0 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1af4a0 con 0x55746cdaece0 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d46de9740 10 client.0 _ll_register_callbacks cb 0x7f4d28004aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 0x55746cdb3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d41400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 0x55746cdb3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40932/0 (socket says 172.21.15.7:40932) 2024-04-23T15:37:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.152+0000 7f4d41400640 1 -- 172.21.15.7:0/1550031474 learned_addr learned my addr 172.21.15.7:0/1550031474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d40a00640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41400640 1 -- 172.21.15.7:0/1550031474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 msgr2=0x55746cdb3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41e00640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746ce2ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41400640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41400640 1 -- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 msgr2=0x55746ce2ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41400640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746ce2ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41400640 1 -- 172.21.15.7:0/1550031474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746caf3620 con 0x55746cdae3c0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d41400640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 0x55746cdb3630 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f4d30004ab0 tx=0x7f4d3002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aba389444f67bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.153+0000 7f4d22a00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d22a00640 1 -- 172.21.15.7:0/1550031474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30035040 con 0x55746cdae3c0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3401eaa0 con 0x55746cdae3c0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d22a00640 1 -- 172.21.15.7:0/1550031474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 9555+0+0 (secure 0 0 0) 0x7f4d30051560 con 0x55746cdae3c0 2024-04-23T15:37:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d22a00640 1 -- 172.21.15.7:0/1550031474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4d300044e0 con 0x55746cdae3c0 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d46de9740 10 client.19365 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55746ce30200 con 0x55746cdae3c0 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.154+0000 7f4d22a00640 1 -- 172.21.15.7:0/1550031474 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d3401eaa0 con 0x55746cdae3c0 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d22a00640 1 -- 172.21.15.7:0/1550031474 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4d300314a0 con 0x55746cdae3c0 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d46de9740 10 client.19365 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d46de9740 10 client.19365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d46de9740 20 client.19365 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746ce30560 0x55746ce32980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d46de9740 4 client.19365 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:37:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55746cd1c190 con 0x55746ce30560 2024-04-23T15:37:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.155+0000 7f4d40a00640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746ce30560 0x55746ce32980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.156+0000 7f4d40a00640 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746ce30560 0x55746ce32980 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=834f93f62db9f958 server_cookie=e1c3e41c805e3f74 in_seq=0 out_seq=0 2024-04-23T15:37:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.156+0000 7f4d22a00640 10 client.19365 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d22a00640 1 -- 172.21.15.7:0/1550031474 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55746cd1c190 con 0x55746ce30560 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d22a00640 10 client.19365 handle_command_reply: tid=0 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 client.19365 shutdown 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 msgr2=0x55746cdb3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 0x55746cdb3630 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f4d30004ab0 tx=0x7f4d3002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 shutdown_connections 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55746ce30560 0x55746ce32980 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55746cdb95a0 0x55746ce2ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55746cdaece0 0x55746cdb3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d22a00640 0 client.19365 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 --2- 172.21.15.7:0/1550031474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55746cdae3c0 0x55746cdb3630 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.193+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 >> 172.21.15.7:0/1550031474 conn(0x55746cdaa8d0 msgr2=0x55746cdb6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.194+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 shutdown_connections 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.194+0000 7f4d46de9740 1 -- 172.21.15.7:0/1550031474 wait complete. 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.194+0000 7f4d46de9740 20 client.19365 trim_cache size 0 max 16384 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:37:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:37:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4d240a3d90 msgr2=0x7f4d240a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4d240a3d90 0x7f4d240a6250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c102d90 tx=0x7f4d34009560 comp rx=0 tx=0).stop 2024-04-23T15:37:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 msgr2=0x7f4d3c1a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 0x7f4d3c1a0b00 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e9f0 tx=0x7f4d2800edf0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 shutdown_connections 2024-04-23T15:37:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4d240a3d90 0x7f4d240a6250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d3c10e760 0x7f4d3c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d3c101560 0x7f4d3c1a0b00 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 --2- 172.21.15.7:0/141395142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d3c100bb0 0x7f4d3c1a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 >> 172.21.15.7:0/141395142 conn(0x7f4d3c0fc810 msgr2=0x7f4d3c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 shutdown_connections 2024-04-23T15:37:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:08.195+0000 7f4d42800640 1 -- 172.21.15.7:0/141395142 wait complete. 2024-04-23T15:37:09.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:08 smithi007 ceph-mon[27906]: pgmap v1453: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T15:37:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:08 smithi186 ceph-mon[31814]: pgmap v1453: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T15:37:09.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:08 smithi137 ceph-mon[31694]: pgmap v1453: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T15:37:11.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:10 smithi007 ceph-mon[27906]: pgmap v1454: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T15:37:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:10 smithi186 ceph-mon[31814]: pgmap v1454: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T15:37:11.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:10 smithi137 ceph-mon[31694]: pgmap v1454: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 33 op/s 2024-04-23T15:37:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:12 smithi007 ceph-mon[27906]: osdmap e172: 12 total, 12 up, 12 in 2024-04-23T15:37:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:12 smithi007 ceph-mon[27906]: pgmap v1456: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.5 MiB/s wr, 19 op/s 2024-04-23T15:37:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:12 smithi186 ceph-mon[31814]: osdmap e172: 12 total, 12 up, 12 in 2024-04-23T15:37:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:12 smithi186 ceph-mon[31814]: pgmap v1456: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.5 MiB/s wr, 19 op/s 2024-04-23T15:37:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:12 smithi137 ceph-mon[31694]: osdmap e172: 12 total, 12 up, 12 in 2024-04-23T15:37:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:12 smithi137 ceph-mon[31694]: pgmap v1456: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.5 MiB/s wr, 19 op/s 2024-04-23T15:37:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:14 smithi007 ceph-mon[27906]: pgmap v1457: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:37:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:14 smithi186 ceph-mon[31814]: pgmap v1457: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:37:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:14 smithi137 ceph-mon[31694]: pgmap v1457: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:37:17.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:16 smithi007 ceph-mon[27906]: pgmap v1458: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:37:17.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:16 smithi186 ceph-mon[31814]: pgmap v1458: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:37:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:16 smithi137 ceph-mon[31694]: pgmap v1458: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-04-23T15:37:19.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:18 smithi007 ceph-mon[27906]: pgmap v1459: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:37:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:18 smithi186 ceph-mon[31814]: pgmap v1459: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:37:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:18 smithi137 ceph-mon[31694]: pgmap v1459: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:37:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:20 smithi007 ceph-mon[27906]: pgmap v1460: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:37:21.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:20 smithi186 ceph-mon[31814]: pgmap v1460: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:37:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:20 smithi137 ceph-mon[31694]: pgmap v1460: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 16 op/s 2024-04-23T15:37:21.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 -- 172.21.15.7:0/3899693885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c101910 msgr2=0x7fc98c105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 --2- 172.21.15.7:0/3899693885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c101910 0x7fc98c105950 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fc978009900 tx=0x7fc97802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 -- 172.21.15.7:0/3899693885 shutdown_connections 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 --2- 172.21.15.7:0/3899693885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c106030 0x7fc98c10dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 --2- 172.21.15.7:0/3899693885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c101910 0x7fc98c105950 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 --2- 172.21.15.7:0/3899693885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc98c100f60 0x7fc98c101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 -- 172.21.15.7:0/3899693885 >> 172.21.15.7:0/3899693885 conn(0x7fc98c0fc820 msgr2=0x7fc98c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 -- 172.21.15.7:0/3899693885 shutdown_connections 2024-04-23T15:37:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.358+0000 7fc991800640 1 -- 172.21.15.7:0/3899693885 wait complete. 2024-04-23T15:37:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.359+0000 7fc991800640 1 Processor -- start 2024-04-23T15:37:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 -- start start 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc98c100f60 0x7fc98c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c106030 0x7fc98c1a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 0x7fc98c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c110fc0 con 0x7fc98c19a6d0 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c110e40 con 0x7fc98c106030 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.360+0000 7fc991800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c111140 con 0x7fc98c100f60 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 0x7fc98c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 0x7fc98c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37654/0 (socket says 172.21.15.7:37654) 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 -- 172.21.15.7:0/3992067612 learned_addr learned my addr 172.21.15.7:0/3992067612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc98be00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc98c100f60 0x7fc98c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc98b400640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c106030 0x7fc98c1a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 -- 172.21.15.7:0/3992067612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc98c100f60 msgr2=0x7fc98c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc98c100f60 0x7fc98c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 -- 172.21.15.7:0/3992067612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c106030 msgr2=0x7fc98c1a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c106030 0x7fc98c1a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.361+0000 7fc990e00640 1 -- 172.21.15.7:0/3992067612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c19b2d0 con 0x7fc98c19a6d0 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.362+0000 7fc990e00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 0x7fc98c19ab50 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fc98400cce0 tx=0x7fc98400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.362+0000 7fc988c00640 1 -- 172.21.15.7:0/3992067612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98400f450 con 0x7fc98c19a6d0 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.362+0000 7fc988c00640 1 -- 172.21.15.7:0/3992067612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc98400faa0 con 0x7fc98c19a6d0 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.362+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c1a73b0 con 0x7fc98c19a6d0 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.362+0000 7fc988c00640 1 -- 172.21.15.7:0/3992067612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984018b70 con 0x7fc98c19a6d0 2024-04-23T15:37:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.362+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c1a7760 con 0x7fc98c19a6d0 2024-04-23T15:37:21.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.366+0000 7fc995c53740 1 Processor -- start 2024-04-23T15:37:21.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.366+0000 7fc988c00640 1 -- 172.21.15.7:0/3992067612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc984018d10 con 0x7fc98c19a6d0 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 -- start start 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a6ce0 0x55bbd76b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bbd760c900 con 0x55bbd76a63c0 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbd75b2f20 con 0x55bbd76b15a0 2024-04-23T15:37:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc995c53740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55bbd76088c0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc98b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc98b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76a67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37670/0 (socket says 172.21.15.7:37670) 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.367+0000 7fc98b400640 1 -- 172.21.15.7:0/3717594290 learned_addr learned my addr 172.21.15.7:0/3717594290 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98be00640 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a6ce0 0x55bbd76b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98b400640 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98b400640 1 -- 172.21.15.7:0/3717594290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a6ce0 msgr2=0x55bbd76b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98b400640 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a6ce0 0x55bbd76b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc988c00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9700a3d90 0x7fc9700a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98b400640 1 -- 172.21.15.7:0/3717594290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 msgr2=0x55bbd76b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98b400640 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc98b400640 1 -- 172.21.15.7:0/3717594290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd75d7e10 con 0x55bbd76a63c0 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.368+0000 7fc988c00640 1 -- 172.21.15.7:0/3992067612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7fc9840d0f20 con 0x7fc98c19a6d0 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.369+0000 7fc98b400640 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76a67a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fc9780096c0 tx=0x7fc978009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7914cb47240a1d9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.369+0000 7fc990e00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9700a3d90 0x7fc9700a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.369+0000 7fc981600640 1 -- 172.21.15.7:0/3717594290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978043020 con 0x55bbd76a63c0 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.369+0000 7fc981600640 1 -- 172.21.15.7:0/3717594290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9780046c0 con 0x55bbd76a63c0 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.369+0000 7fc981600640 1 -- 172.21.15.7:0/3717594290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978035070 con 0x55bbd76a63c0 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 -- 172.21.15.7:0/3717594290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 msgr2=0x55bbd76a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76a67a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fc9780096c0 tx=0x7fc978009560 comp rx=0 tx=0).stop 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc990e00640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9700a3d90 0x7fc9700a6250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc98409ca40 tx=0x7fc9840184a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 -- 172.21.15.7:0/3717594290 shutdown_connections 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a6ce0 0x55bbd76b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 --2- 172.21.15.7:0/3717594290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76a67a0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 -- 172.21.15.7:0/3717594290 >> 172.21.15.7:0/3717594290 conn(0x55bbd76a28d0 msgr2=0x55bbd76a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 -- 172.21.15.7:0/3717594290 shutdown_connections 2024-04-23T15:37:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.370+0000 7fc995c53740 1 -- 172.21.15.7:0/3717594290 wait complete. 2024-04-23T15:37:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 -- start start 2024-04-23T15:37:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 Processor -- start 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a63c0 0x55bbd76ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bbd76b4080 con 0x55bbd76a6ce0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.371+0000 7fc995c53740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbd75c62c0 con 0x55bbd76a63c0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc995c53740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55bbd76b4200 con 0x55bbd76b15a0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc995c53740 10 client.0 _ll_register_callbacks cb 0x55bbd731ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37678/0 (socket says 172.21.15.7:37678) 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 -- 172.21.15.7:0/2188392846 learned_addr learned my addr 172.21.15.7:0/2188392846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98b400640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a63c0 0x55bbd76ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98b400640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 -- 172.21.15.7:0/2188392846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 msgr2=0x55bbd76af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 -- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a63c0 msgr2=0x55bbd76ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a63c0 0x55bbd76ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.372+0000 7fc98be00640 1 -- 172.21.15.7:0/2188392846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd75d6fd0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc98be00640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aeb30 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00ba40 tx=0x7fc97c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a86c32920d3035c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc976000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc976000640 1 -- 172.21.15.7:0/2188392846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011440 con 0x55bbd76a6ce0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc976000640 1 -- 172.21.15.7:0/2188392846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7fc97c0115e0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9780046c0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc976000640 1 -- 172.21.15.7:0/2188392846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc97c0117e0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc995c53740 10 client.19377 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.373+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bbd731f210 con 0x55bbd76a6ce0 2024-04-23T15:37:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc976000640 1 -- 172.21.15.7:0/2188392846 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9780046c0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc976000640 1 -- 172.21.15.7:0/2188392846 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc97c01b960 con 0x55bbd76a6ce0 2024-04-23T15:37:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc995c53740 10 client.19377 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc995c53740 10 client.19377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc995c53740 20 client.19377 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc995c53740 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd76c1760 0x55bbd76c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc995c53740 4 client.19377 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:37:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.374+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbd761a320 con 0x55bbd76c1760 2024-04-23T15:37:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.375+0000 7fc98b400640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd76c1760 0x55bbd76c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.376+0000 7fc98b400640 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd76c1760 0x55bbd76c3b90 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4899616b79317ca4 server_cookie=bb381ad553f5cf72 in_seq=0 out_seq=0 2024-04-23T15:37:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.376+0000 7fc976000640 10 client.19377 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:21.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc976000640 1 -- 172.21.15.7:0/2188392846 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bbd761a320 con 0x55bbd76c1760 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc976000640 10 client.19377 handle_command_reply: tid=0 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 client.19377 shutdown 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 msgr2=0x55bbd76aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aeb30 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00ba40 tx=0x7fc97c00bf00 comp rx=0 tx=0).stop 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 shutdown_connections 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd76c1760 0x55bbd76c3b90 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aeb30 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 --2- 172.21.15.7:0/2188392846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a63c0 0x55bbd76ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 >> 172.21.15.7:0/2188392846 conn(0x55bbd76a28d0 msgr2=0x55bbd76a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc976000640 0 client.19377 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 shutdown_connections 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.378+0000 7fc995c53740 1 -- 172.21.15.7:0/2188392846 wait complete. 2024-04-23T15:37:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.379+0000 7fc995c53740 20 client.19377 trim_cache size 0 max 16384 2024-04-23T15:37:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 Processor -- start 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 -- start start 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a63c0 0x55bbd76b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1b12d0 con 0x55bbd76a6ce0 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1b2e10 con 0x55bbd76b15a0 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc995c53740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1b19a0 con 0x55bbd76a63c0 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.396+0000 7fc98be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76bd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37686/0 (socket says 172.21.15.7:37686) 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 -- 172.21.15.7:0/162210321 learned_addr learned my addr 172.21.15.7:0/162210321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98b400640 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a63c0 0x55bbd76b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98b400640 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 -- 172.21.15.7:0/162210321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a63c0 msgr2=0x55bbd76b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a63c0 0x55bbd76b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 -- 172.21.15.7:0/162210321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 msgr2=0x55bbd76a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 -- 172.21.15.7:0/162210321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd76b3d00 con 0x55bbd76a6ce0 2024-04-23T15:37:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.397+0000 7fc98be00640 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76bd000 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fc97c006010 tx=0x7fc97c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4523242cfa524d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.398+0000 7fc980c00640 1 -- 172.21.15.7:0/162210321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011440 con 0x55bbd76a6ce0 2024-04-23T15:37:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.398+0000 7fc980c00640 1 -- 172.21.15.7:0/162210321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc97c011e30 con 0x55bbd76a6ce0 2024-04-23T15:37:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.398+0000 7fc980c00640 1 -- 172.21.15.7:0/162210321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c005270 con 0x55bbd76a6ce0 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 -- 172.21.15.7:0/162210321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 msgr2=0x55bbd76bd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76bd000 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fc97c006010 tx=0x7fc97c00b670 comp rx=0 tx=0).stop 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 -- 172.21.15.7:0/162210321 shutdown_connections 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76b15a0 0x55bbd76a8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a6ce0 0x55bbd76bd000 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 --2- 172.21.15.7:0/162210321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76a63c0 0x55bbd76b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 -- 172.21.15.7:0/162210321 >> 172.21.15.7:0/162210321 conn(0x55bbd76a28d0 msgr2=0x55bbd76aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 -- 172.21.15.7:0/162210321 shutdown_connections 2024-04-23T15:37:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 -- 172.21.15.7:0/162210321 wait complete. 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.399+0000 7fc995c53740 1 -- start start 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 Processor -- start 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1b2740 con 0x55bbd76a63c0 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1b2070 con 0x55bbd76a6ce0 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1af2d0 con 0x55bbd76b15a0 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc995c53740 10 client.0 _ll_register_callbacks cb 0x7fc97c0042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.400+0000 7fc98b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76b9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37694/0 (socket says 172.21.15.7:37694) 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 -- 172.21.15.7:0/706377887 learned_addr learned my addr 172.21.15.7:0/706377887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98be00640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 -- 172.21.15.7:0/706377887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 msgr2=0x55bbd76ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 -- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a6ce0 msgr2=0x55bbd76aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.401+0000 7fc98b400640 1 -- 172.21.15.7:0/706377887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd73eb620 con 0x55bbd76a63c0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc98b400640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76b9770 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fc978009900 tx=0x7fc978050ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a741cd1e04fe5d6d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc976000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc976000640 1 -- 172.21.15.7:0/706377887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978043070 con 0x55bbd76a63c0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc97c011e30 con 0x55bbd76a63c0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc976000640 1 -- 172.21.15.7:0/706377887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7fc978050d50 con 0x55bbd76a63c0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc976000640 1 -- 172.21.15.7:0/706377887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc978035040 con 0x55bbd76a63c0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc995c53740 10 client.19383 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.402+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bbd77279b0 con 0x55bbd76a63c0 2024-04-23T15:37:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc976000640 1 -- 172.21.15.7:0/706377887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc97c011e30 con 0x55bbd76a63c0 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc976000640 1 -- 172.21.15.7:0/706377887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc978003950 con 0x55bbd76a63c0 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc995c53740 10 client.19383 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc995c53740 10 client.19383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc995c53740 20 client.19383 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc995c53740 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd7727ca0 0x55bbd772a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc995c53740 4 client.19383 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.403+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bbd7614190 con 0x55bbd7727ca0 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.404+0000 7fc98be00640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd7727ca0 0x55bbd772a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.405+0000 7fc98be00640 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd7727ca0 0x55bbd772a090 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9be09cfd01a235 server_cookie=738a1f8594102bd9 in_seq=0 out_seq=0 2024-04-23T15:37:21.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.405+0000 7fc976000640 10 client.19383 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.444+0000 7fc976000640 1 -- 172.21.15.7:0/706377887 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bbd7614190 con 0x55bbd7727ca0 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.444+0000 7fc976000640 10 client.19383 handle_command_reply: tid=0 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.444+0000 7fc995c53740 1 client.19383 shutdown 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 msgr2=0x55bbd76b9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76b9770 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fc978009900 tx=0x7fc978050ae0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 shutdown_connections 2024-04-23T15:37:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55bbd7727ca0 0x55bbd772a090 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbd76a6ce0 0x55bbd76aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bbd76b15a0 0x55bbd76ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 --2- 172.21.15.7:0/706377887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bbd76a63c0 0x55bbd76b9770 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc976000640 0 client.19383 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 >> 172.21.15.7:0/706377887 conn(0x55bbd76a28d0 msgr2=0x55bbd76aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 shutdown_connections 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 1 -- 172.21.15.7:0/706377887 wait complete. 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.445+0000 7fc995c53740 20 client.19383 trim_cache size 0 max 16384 2024-04-23T15:37:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9700a3d90 msgr2=0x7fc9700a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9700a3d90 0x7fc9700a6250 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc98409ca40 tx=0x7fc9840184a0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 msgr2=0x7fc98c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:21.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 0x7fc98c19ab50 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fc98400cce0 tx=0x7fc98400a620 comp rx=0 tx=0).stop 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 shutdown_connections 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc9700a3d90 0x7fc9700a6250 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c106030 0x7fc98c1a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc98c19a6d0 0x7fc98c19ab50 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 --2- 172.21.15.7:0/3992067612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc98c100f60 0x7fc98c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.446+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 >> 172.21.15.7:0/3992067612 conn(0x7fc98c0fc820 msgr2=0x7fc98c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.447+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 shutdown_connections 2024-04-23T15:37:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:21.447+0000 7fc991800640 1 -- 172.21.15.7:0/3992067612 wait complete. 2024-04-23T15:37:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:22 smithi007 ceph-mon[27906]: pgmap v1461: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.9 MiB/s wr, 25 op/s 2024-04-23T15:37:23.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:22 smithi186 ceph-mon[31814]: pgmap v1461: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.9 MiB/s wr, 25 op/s 2024-04-23T15:37:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:22 smithi137 ceph-mon[31694]: pgmap v1461: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.9 MiB/s wr, 25 op/s 2024-04-23T15:37:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:24 smithi007 ceph-mon[27906]: pgmap v1462: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:25.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:24 smithi186 ceph-mon[31814]: pgmap v1462: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:24 smithi137 ceph-mon[31694]: pgmap v1462: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:26.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:25 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:37:26.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:25 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:37:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:25 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:37:27.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:26 smithi007 ceph-mon[27906]: pgmap v1463: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:27.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:26 smithi186 ceph-mon[31814]: pgmap v1463: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:26 smithi137 ceph-mon[31694]: pgmap v1463: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:27 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:37:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:27 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:37:28.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:27 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:37:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:27 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:37:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:27 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:37:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:27 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:37:28.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:27 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:37:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:27 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:37:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:27 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:37:29.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:28 smithi137 ceph-mon[31694]: pgmap v1464: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:37:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:28 smithi007 ceph-mon[27906]: pgmap v1464: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:37:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:28 smithi186 ceph-mon[31814]: pgmap v1464: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:37:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:30 smithi137 ceph-mon[31694]: pgmap v1465: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:37:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:30 smithi007 ceph-mon[27906]: pgmap v1465: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:37:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:30 smithi186 ceph-mon[31814]: pgmap v1465: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.4 MiB/s wr, 13 op/s 2024-04-23T15:37:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:32 smithi137 ceph-mon[31694]: pgmap v1466: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:37:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:32 smithi007 ceph-mon[27906]: pgmap v1466: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:37:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:32 smithi186 ceph-mon[31814]: pgmap v1466: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 18 op/s 2024-04-23T15:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.609+0000 7f9f9c000640 1 -- 172.21.15.7:0/2294045651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94109530 msgr2=0x7f9f94111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.609+0000 7f9f9c000640 1 --2- 172.21.15.7:0/2294045651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94109530 0x7f9f94111100 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009ca0 tx=0x7f9f8c02a8c0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 -- 172.21.15.7:0/2294045651 shutdown_connections 2024-04-23T15:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 --2- 172.21.15.7:0/2294045651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94109530 0x7f9f94111100 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 --2- 172.21.15.7:0/2294045651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f94104e10 0x7f9f94108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 --2- 172.21.15.7:0/2294045651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f94104460 0x7f9f94104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 -- 172.21.15.7:0/2294045651 >> 172.21.15.7:0/2294045651 conn(0x7f9f940ffd00 msgr2=0x7f9f94102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 -- 172.21.15.7:0/2294045651 shutdown_connections 2024-04-23T15:37:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.610+0000 7f9f9c000640 1 -- 172.21.15.7:0/2294045651 wait complete. 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.611+0000 7f9f9c000640 1 Processor -- start 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.611+0000 7f9f9c000640 1 -- start start 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 0x7f9f941a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9c000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f94109530 0x7f9f941a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9c000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f9419a750 0x7f9f9419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941144f0 con 0x7f9f94104460 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9c000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94114370 con 0x7f9f94109530 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9c000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94114670 con 0x7f9f9419a750 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 0x7f9f941a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 0x7f9f941a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35132/0 (socket says 172.21.15.7:35132) 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 -- 172.21.15.7:0/3646247979 learned_addr learned my addr 172.21.15.7:0/3646247979 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f98c00640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f94109530 0x7f9f941a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9a000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f9419a750 0x7f9f9419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 -- 172.21.15.7:0/3646247979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f9419a750 msgr2=0x7f9f9419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f9419a750 0x7f9f9419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 -- 172.21.15.7:0/3646247979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f94109530 msgr2=0x7f9f941a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f94109530 0x7f9f941a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f99600640 1 -- 172.21.15.7:0/3646247979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9419b350 con 0x7f9f94104460 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.612+0000 7f9f9a000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f9419a750 0x7f9f9419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:37:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.613+0000 7f9f99600640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 0x7f9f941a0690 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800d950 tx=0x7f9f8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.613+0000 7f9f92000640 1 -- 172.21.15.7:0/3646247979 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88017070 con 0x7f9f94104460 2024-04-23T15:37:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.613+0000 7f9f92000640 1 -- 172.21.15.7:0/3646247979 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f88009c30 con 0x7f9f94104460 2024-04-23T15:37:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.613+0000 7f9f92000640 1 -- 172.21.15.7:0/3646247979 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800f620 con 0x7f9f94104460 2024-04-23T15:37:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.613+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f941a7430 con 0x7f9f94104460 2024-04-23T15:37:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.613+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f941a7890 con 0x7f9f94104460 2024-04-23T15:37:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.617+0000 7f9f92000640 1 -- 172.21.15.7:0/3646247979 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f9f880109a0 con 0x7f9f94104460 2024-04-23T15:37:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.617+0000 7f9f9ee7a740 1 Processor -- start 2024-04-23T15:37:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.617+0000 7f9f9ee7a740 1 -- start start 2024-04-23T15:37:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479982590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x56247998ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247998f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5624798e8900 con 0x5624799821b0 2024-04-23T15:37:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56247988ef20 con 0x562479982ad0 2024-04-23T15:37:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5624798e48c0 con 0x56247998d390 2024-04-23T15:37:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479982590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479982590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35140/0 (socket says 172.21.15.7:35140) 2024-04-23T15:37:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f9a000640 1 -- 172.21.15.7:0/1028401782 learned_addr learned my addr 172.21.15.7:0/1028401782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f99600640 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x56247998ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.618+0000 7f9f98c00640 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247998f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f9a000640 1 -- 172.21.15.7:0/1028401782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 msgr2=0x56247998f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247998f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f9a000640 1 -- 172.21.15.7:0/1028401782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 msgr2=0x56247998ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x56247998ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f9a000640 1 -- 172.21.15.7:0/1028401782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624798b3e10 con 0x5624799821b0 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f99600640 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x56247998ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f92000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9f7c0ac650 0x7f9f7c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479982590 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c004af0 tx=0x7f9f8c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687ccfa6125769d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f99600640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9f7c0ac650 0x7f9f7c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.619+0000 7f9f92000640 1 -- 172.21.15.7:0/3646247979 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f9f880d0880 con 0x7f9f94104460 2024-04-23T15:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.620+0000 7f9f86600640 1 -- 172.21.15.7:0/1028401782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c031dc0 con 0x5624799821b0 2024-04-23T15:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.620+0000 7f9f86600640 1 -- 172.21.15.7:0/1028401782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f8c036070 con 0x5624799821b0 2024-04-23T15:37:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.620+0000 7f9f86600640 1 -- 172.21.15.7:0/1028401782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0043c0 con 0x5624799821b0 2024-04-23T15:37:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1028401782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 msgr2=0x562479982590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f99600640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9f7c0ac650 0x7f9f7c0aeb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x562479983750 tx=0x7f9f88098040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479982590 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c004af0 tx=0x7f9f8c009a20 comp rx=0 tx=0).stop 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1028401782 shutdown_connections 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x56247998ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247998f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1028401782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479982590 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1028401782 >> 172.21.15.7:0/1028401782 conn(0x56247997e6c0 msgr2=0x56247997eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1028401782 shutdown_connections 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1028401782 wait complete. 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.621+0000 7f9f9ee7a740 1 -- start start 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 Processor -- start 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x56247998a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562479982ad0 0x56247998a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56247998d390 0x56247998add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56247998ff60 con 0x5624799821b0 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5624798a22c0 con 0x56247998d390 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5624799900e0 con 0x562479982ad0 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.622+0000 7f9f9ee7a740 10 client.0 _ll_register_callbacks cb 0x5624795faa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x56247998a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x56247998a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35142/0 (socket says 172.21.15.7:35142) 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 -- 172.21.15.7:0/120322899 learned_addr learned my addr 172.21.15.7:0/120322899 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f98c00640 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562479982ad0 0x56247998a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 -- 172.21.15.7:0/120322899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562479982ad0 msgr2=0x56247998a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562479982ad0 0x56247998a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 -- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56247998d390 msgr2=0x56247998add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56247998d390 0x56247998add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 -- 172.21.15.7:0/120322899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624798b2fd0 con 0x5624799821b0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.623+0000 7f9f9a000640 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x56247998a350 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c031e60 tx=0x7f9f8c031e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f2830a9d2c0ce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f7aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f7aa00640 1 -- 172.21.15.7:0/120322899 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c031760 con 0x5624799821b0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f8c036070 con 0x5624799821b0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f7aa00640 1 -- 172.21.15.7:0/120322899 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f9f8c003970 con 0x5624799821b0 2024-04-23T15:37:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f7aa00640 1 -- 172.21.15.7:0/120322899 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9f8c05c050 con 0x5624799821b0 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f9ee7a740 10 client.19395 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.624+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5624795fb210 con 0x5624799821b0 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f7aa00640 1 -- 172.21.15.7:0/120322899 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f8c036070 con 0x5624799821b0 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f7aa00640 1 -- 172.21.15.7:0/120322899 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9f8c057030 con 0x5624799821b0 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f9ee7a740 10 client.19395 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f9ee7a740 10 client.19395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f9ee7a740 20 client.19395 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56247999d330 0x56247999f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f9ee7a740 4 client.19395 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.625+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624798f6320 con 0x56247999d330 2024-04-23T15:37:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.626+0000 7f9f98c00640 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56247999d330 0x56247999f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.627+0000 7f9f98c00640 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56247999d330 0x56247999f720 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc5fe5ee268f349 server_cookie=6d1f888cadff164a in_seq=0 out_seq=0 2024-04-23T15:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.627+0000 7f9f7aa00640 10 client.19395 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.628+0000 7f9f7aa00640 1 -- 172.21.15.7:0/120322899 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5624798f6320 con 0x56247999d330 2024-04-23T15:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.628+0000 7f9f7aa00640 10 client.19395 handle_command_reply: tid=0 2024-04-23T15:37:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.628+0000 7f9f9ee7a740 1 client.19395 shutdown 2024-04-23T15:37:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 msgr2=0x56247998a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x56247998a350 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c031e60 tx=0x7f9f8c031e90 comp rx=0 tx=0).stop 2024-04-23T15:37:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 shutdown_connections 2024-04-23T15:37:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x56247999d330 0x56247999f720 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56247998d390 0x56247998add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562479982ad0 0x56247998a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/120322899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x56247998a350 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f7aa00640 0 client.19395 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 >> 172.21.15.7:0/120322899 conn(0x56247997e6c0 msgr2=0x562479984440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 shutdown_connections 2024-04-23T15:37:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/120322899 wait complete. 2024-04-23T15:37:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.629+0000 7f9f9ee7a740 20 client.19395 trim_cache size 0 max 16384 2024-04-23T15:37:34.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 Processor -- start 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 -- start start 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479998e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799894d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247997d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941ad100 con 0x5624799821b0 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941aec40 con 0x562479982ad0 2024-04-23T15:37:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.649+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941ad7d0 con 0x56247998d390 2024-04-23T15:37:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479998e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479998e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35154/0 (socket says 172.21.15.7:35154) 2024-04-23T15:37:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 -- 172.21.15.7:0/2813809655 learned_addr learned my addr 172.21.15.7:0/2813809655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f98c00640 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799894d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 -- 172.21.15.7:0/2813809655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 msgr2=0x56247997d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247997d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 -- 172.21.15.7:0/2813809655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 msgr2=0x5624799894d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799894d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f9a000640 1 -- 172.21.15.7:0/2813809655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624796c7620 con 0x5624799821b0 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.650+0000 7f9f98c00640 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.651+0000 7f9f9a000640 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479998e20 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009430 tx=0x7f9f8c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dc217d24c650bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.651+0000 7f9f85c00640 1 -- 172.21.15.7:0/2813809655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c031a40 con 0x5624799821b0 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.651+0000 7f9f85c00640 1 -- 172.21.15.7:0/2813809655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f8c036070 con 0x5624799821b0 2024-04-23T15:37:34.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.651+0000 7f9f85c00640 1 -- 172.21.15.7:0/2813809655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c030e60 con 0x5624799821b0 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/2813809655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 msgr2=0x562479998e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479998e20 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009430 tx=0x7f9f8c000f40 comp rx=0 tx=0).stop 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/2813809655 shutdown_connections 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56247998d390 0x56247997d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/2813809655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5624799821b0 0x562479998e20 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/2813809655 >> 172.21.15.7:0/2813809655 conn(0x56247997e6c0 msgr2=0x56247997cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/2813809655 shutdown_connections 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.652+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/2813809655 wait complete. 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.653+0000 7f9f9ee7a740 1 -- start start 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.653+0000 7f9f9ee7a740 1 Processor -- start 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.653+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5624799821b0 0x562479995520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.653+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9ee7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 0x562479986f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941ae570 con 0x56247998d390 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941adea0 con 0x562479982ad0 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9ee7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941ab100 con 0x5624799821b0 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9ee7a740 10 client.0 _ll_register_callbacks cb 0x7f9f8c005f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 0x562479986f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 0x562479986f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35160/0 (socket says 172.21.15.7:35160) 2024-04-23T15:37:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9a000640 1 -- 172.21.15.7:0/1872788571 learned_addr learned my addr 172.21.15.7:0/1872788571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5624799821b0 0x562479995520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.654+0000 7f9f98c00640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9a000640 1 -- 172.21.15.7:0/1872788571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5624799821b0 msgr2=0x562479995520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5624799821b0 0x562479995520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9a000640 1 -- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 msgr2=0x5624799869f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799869f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9a000640 1 -- 172.21.15.7:0/1872788571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562479987470 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9a000640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 0x562479986f30 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009600 tx=0x7f9f8c0098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6959906b48f4771 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f7aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f7aa00640 1 -- 172.21.15.7:0/1872788571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c064070 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f7aa00640 1 -- 172.21.15.7:0/1872788571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f9f8c04f440 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.655+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f8c036070 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f7aa00640 1 -- 172.21.15.7:0/1872788571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9f8c030e80 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 10 client.19401 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562479a03260 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f7aa00640 1 -- 172.21.15.7:0/1872788571 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f8c036070 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f7aa00640 1 -- 172.21.15.7:0/1872788571 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9f8c057040 con 0x56247998d390 2024-04-23T15:37:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 10 client.19401 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 10 client.19401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 20 client.19401 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562479a03720 0x562479a05b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 4 client.19401 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.656+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624798f0190 con 0x562479a03720 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.657+0000 7f9f98c00640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562479a03720 0x562479a05b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.658+0000 7f9f98c00640 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562479a03720 0x562479a05b10 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f676edb61a33ff server_cookie=2812130cd5344e in_seq=0 out_seq=0 2024-04-23T15:37:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.658+0000 7f9f7aa00640 10 client.19401 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.694+0000 7f9f7aa00640 1 -- 172.21.15.7:0/1872788571 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624798f0190 con 0x562479a03720 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.694+0000 7f9f7aa00640 10 client.19401 handle_command_reply: tid=0 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.694+0000 7f9f9ee7a740 1 client.19401 shutdown 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 msgr2=0x562479986f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 0x562479986f30 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009600 tx=0x7f9f8c0098c0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 shutdown_connections 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x562479a03720 0x562479a05b10 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562479982ad0 0x5624799869f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56247998d390 0x562479986f30 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 --2- 172.21.15.7:0/1872788571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5624799821b0 0x562479995520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f7aa00640 0 client.19401 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 >> 172.21.15.7:0/1872788571 conn(0x56247997e6c0 msgr2=0x56247997d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 shutdown_connections 2024-04-23T15:37:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 1 -- 172.21.15.7:0/1872788571 wait complete. 2024-04-23T15:37:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.695+0000 7f9f9ee7a740 20 client.19401 trim_cache size 0 max 16384 2024-04-23T15:37:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:37:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:37:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:37:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:37:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9f7c0ac650 msgr2=0x7f9f7c0aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9f7c0ac650 0x7f9f7c0aeb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x562479983750 tx=0x7f9f88098040 comp rx=0 tx=0).stop 2024-04-23T15:37:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 msgr2=0x7f9f941a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 0x7f9f941a0690 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800d950 tx=0x7f9f8800de10 comp rx=0 tx=0).stop 2024-04-23T15:37:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 shutdown_connections 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9f7c0ac650 0x7f9f7c0aeb10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f94109530 0x7f9f941a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f9419a750 0x7f9f9419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 --2- 172.21.15.7:0/3646247979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f94104460 0x7f9f941a0690 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 >> 172.21.15.7:0/3646247979 conn(0x7f9f940ffd00 msgr2=0x7f9f94100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 shutdown_connections 2024-04-23T15:37:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:34.696+0000 7f9f9c000640 1 -- 172.21.15.7:0/3646247979 wait complete. 2024-04-23T15:37:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:34 smithi137 ceph-mon[31694]: pgmap v1467: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:37:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:34 smithi007 ceph-mon[27906]: pgmap v1467: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:37:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:34 smithi186 ceph-mon[31814]: pgmap v1467: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:37:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:36 smithi007 ceph-mon[27906]: pgmap v1468: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:37:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:36 smithi186 ceph-mon[31814]: pgmap v1468: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:37:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:36 smithi137 ceph-mon[31694]: pgmap v1468: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-04-23T15:37:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:38 smithi007 ceph-mon[27906]: pgmap v1469: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:37:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:38 smithi186 ceph-mon[31814]: pgmap v1469: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:37:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:38 smithi137 ceph-mon[31694]: pgmap v1469: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 19 op/s 2024-04-23T15:37:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:40 smithi007 ceph-mon[27906]: pgmap v1470: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:40 smithi186 ceph-mon[31814]: pgmap v1470: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:40 smithi137 ceph-mon[31694]: pgmap v1470: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:42 smithi007 ceph-mon[27906]: pgmap v1471: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:37:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:42 smithi186 ceph-mon[31814]: pgmap v1471: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:37:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:42 smithi137 ceph-mon[31694]: pgmap v1471: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.0 MiB/s wr, 18 op/s 2024-04-23T15:37:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:44 smithi007 ceph-mon[27906]: pgmap v1472: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:44 smithi186 ceph-mon[31814]: pgmap v1472: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:44 smithi137 ceph-mon[31694]: pgmap v1472: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:46 smithi007 ceph-mon[27906]: pgmap v1473: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:46 smithi186 ceph-mon[31814]: pgmap v1473: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:46 smithi137 ceph-mon[31694]: pgmap v1473: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 -- 172.21.15.7:0/4194459118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc104c50 msgr2=0x7f25bc108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 --2- 172.21.15.7:0/4194459118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc104c50 0x7f25bc108c90 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009900 tx=0x7f25a402a410 comp rx=0 tx=0).stop 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 -- 172.21.15.7:0/4194459118 shutdown_connections 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 --2- 172.21.15.7:0/4194459118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc109370 0x7f25bc110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 --2- 172.21.15.7:0/4194459118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc104c50 0x7f25bc108c90 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 --2- 172.21.15.7:0/4194459118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25bc1042a0 0x7f25bc104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 -- 172.21.15.7:0/4194459118 >> 172.21.15.7:0/4194459118 conn(0x7f25bc0ffae0 msgr2=0x7f25bc101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 -- 172.21.15.7:0/4194459118 shutdown_connections 2024-04-23T15:37:47.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.859+0000 7f25bbe00640 1 -- 172.21.15.7:0/4194459118 wait complete. 2024-04-23T15:37:47.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.860+0000 7f25bbe00640 1 Processor -- start 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 -- start start 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25bc1042a0 0x7f25bc1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 0x7f25bc1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc19a780 0x7f25bc19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1142e0 con 0x7f25bc109370 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc114160 con 0x7f25bc19a780 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25bbe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc114460 con 0x7f25bc1042a0 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 0x7f25bc1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 0x7f25bc1a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56500/0 (socket says 172.21.15.7:56500) 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.861+0000 7f25b3e00640 1 -- 172.21.15.7:0/2578268310 learned_addr learned my addr 172.21.15.7:0/2578268310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25baa00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25bc1042a0 0x7f25bc1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25bb400640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc19a780 0x7f25bc19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25b3e00640 1 -- 172.21.15.7:0/2578268310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25bc1042a0 msgr2=0x7f25bc1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25b3e00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25bc1042a0 0x7f25bc1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25b3e00640 1 -- 172.21.15.7:0/2578268310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc19a780 msgr2=0x7f25bc19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25b3e00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc19a780 0x7f25bc19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.862+0000 7f25b3e00640 1 -- 172.21.15.7:0/2578268310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc19b380 con 0x7f25bc109370 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.863+0000 7f25b3e00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 0x7f25bc1a0bb0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f25a4005ab0 tx=0x7f25a4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.863+0000 7f25b3400640 1 -- 172.21.15.7:0/2578268310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a403f070 con 0x7f25bc109370 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.863+0000 7f25b3400640 1 -- 172.21.15.7:0/2578268310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25a4031d60 con 0x7f25bc109370 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.863+0000 7f25b3400640 1 -- 172.21.15.7:0/2578268310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4035030 con 0x7f25bc109370 2024-04-23T15:37:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.863+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25bc19b610 con 0x7f25bc109370 2024-04-23T15:37:47.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.863+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25bc1a76b0 con 0x7f25bc109370 2024-04-23T15:37:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.867+0000 7f25b3400640 1 -- 172.21.15.7:0/2578268310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f25a4042070 con 0x7f25bc109370 2024-04-23T15:37:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.867+0000 7f25c47f2740 1 Processor -- start 2024-04-23T15:37:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.867+0000 7f25c47f2740 1 -- start start 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 0x55df548317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df54831ce0 0x55df5483c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df5483c5a0 0x55df5483e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25c47f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df54797900 con 0x55df548313c0 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25c47f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df5473df20 con 0x55df5483c5a0 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25c47f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55df547938c0 con 0x55df54831ce0 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 0x55df548317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 0x55df548317a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56506/0 (socket says 172.21.15.7:56506) 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.868+0000 7f25bb400640 1 -- 172.21.15.7:0/3388110177 learned_addr learned my addr 172.21.15.7:0/3388110177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25b3e00640 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df5483c5a0 0x55df5483e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25baa00640 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df54831ce0 0x55df5483c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25bb400640 1 -- 172.21.15.7:0/3388110177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df54831ce0 msgr2=0x55df5483c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25bb400640 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df54831ce0 0x55df5483c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25bb400640 1 -- 172.21.15.7:0/3388110177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df5483c5a0 msgr2=0x55df5483e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25bb400640 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df5483c5a0 0x55df5483e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25bb400640 1 -- 172.21.15.7:0/3388110177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df54762e10 con 0x55df548313c0 2024-04-23T15:37:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25bb400640 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 0x55df548317a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009e60 tx=0x7f25b4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae39fa4807e12c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.869+0000 7f25b3400640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25a00a3d10 0x7f25a00a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.870+0000 7f25b3400640 1 -- 172.21.15.7:0/2578268310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f25a40f10a0 con 0x7f25bc109370 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.870+0000 7f25abe00640 1 -- 172.21.15.7:0/3388110177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4016070 con 0x55df548313c0 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.870+0000 7f25abe00640 1 -- 172.21.15.7:0/3388110177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25b4004d20 con 0x55df548313c0 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.870+0000 7f25abe00640 1 -- 172.21.15.7:0/3388110177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4012740 con 0x55df548313c0 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.870+0000 7f25baa00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25a00a3d10 0x7f25a00a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 -- 172.21.15.7:0/3388110177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 msgr2=0x55df548317a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25baa00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25a00a3d10 0x7f25a00a61d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55df54832960 tx=0x7f25ac00b390 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 0x55df548317a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009e60 tx=0x7f25b4010740 comp rx=0 tx=0).stop 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 -- 172.21.15.7:0/3388110177 shutdown_connections 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df5483c5a0 0x55df5483e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df54831ce0 0x55df5483c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3388110177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df548313c0 0x55df548317a0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 -- 172.21.15.7:0/3388110177 >> 172.21.15.7:0/3388110177 conn(0x55df5482d8d0 msgr2=0x55df5482dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 -- 172.21.15.7:0/3388110177 shutdown_connections 2024-04-23T15:37:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 -- 172.21.15.7:0/3388110177 wait complete. 2024-04-23T15:37:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.871+0000 7f25c47f2740 1 -- start start 2024-04-23T15:37:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 Processor -- start 2024-04-23T15:37:47.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df548395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df54839ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df5483a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df5483f0e0 con 0x55df5483c5a0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df547512c0 con 0x55df54831ce0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55df5483f260 con 0x55df548313c0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.872+0000 7f25c47f2740 10 client.0 _ll_register_callbacks cb 0x55df544a9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df5483a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df5483a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56508/0 (socket says 172.21.15.7:56508) 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 -- 172.21.15.7:0/3559540244 learned_addr learned my addr 172.21.15.7:0/3559540244 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25baa00640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df548395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25b3e00640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df54839ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 -- 172.21.15.7:0/3559540244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 msgr2=0x55df548395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df548395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 -- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 msgr2=0x55df54839ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df54839ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25bb400640 1 -- 172.21.15.7:0/3559540244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df54761fd0 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25b3e00640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df54839ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.873+0000 7f25baa00640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df548395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25bb400640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df5483a020 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000f80 tx=0x7f25b4009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8d9a89f7040b4d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25a8c00640 1 -- 172.21.15.7:0/3559540244 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4016040 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25a8c00640 1 -- 172.21.15.7:0/3559540244 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f25b40052e0 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b4004d20 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25a8c00640 1 -- 172.21.15.7:0/3559540244 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f25b4030050 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25c47f2740 10 client.19413 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.874+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55df544aa210 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25a8c00640 1 -- 172.21.15.7:0/3559540244 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25b4004d20 con 0x55df5483c5a0 2024-04-23T15:37:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25a8c00640 1 -- 172.21.15.7:0/3559540244 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f25b402b030 con 0x55df5483c5a0 2024-04-23T15:37:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25c47f2740 10 client.19413 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25c47f2740 10 client.19413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25c47f2740 20 client.19413 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df5484c610 0x55df5484ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25c47f2740 4 client.19413 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:37:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.875+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df547a5320 con 0x55df5484c610 2024-04-23T15:37:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.876+0000 7f25baa00640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df5484c610 0x55df5484ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.877+0000 7f25baa00640 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df5484c610 0x55df5484ea00 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f60f2fb0e5f0c2b server_cookie=4a2b33938be2b5d0 in_seq=0 out_seq=0 2024-04-23T15:37:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.877+0000 7f25a8c00640 10 client.19413 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.878+0000 7f25a8c00640 1 -- 172.21.15.7:0/3559540244 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55df547a5320 con 0x55df5484c610 2024-04-23T15:37:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.878+0000 7f25a8c00640 10 client.19413 handle_command_reply: tid=0 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 client.19413 shutdown 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 msgr2=0x55df5483a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df5483a020 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000f80 tx=0x7f25b4009a60 comp rx=0 tx=0).stop 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 shutdown_connections 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df5484c610 0x55df5484ea00 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df54839ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25a8c00640 0 client.19413 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df5483a020 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 --2- 172.21.15.7:0/3559540244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df548395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 >> 172.21.15.7:0/3559540244 conn(0x55df5482d8d0 msgr2=0x55df54833600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 shutdown_connections 2024-04-23T15:37:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 1 -- 172.21.15.7:0/3559540244 wait complete. 2024-04-23T15:37:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.879+0000 7f25c47f2740 20 client.19413 trim_cache size 0 max 16384 2024-04-23T15:37:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 Processor -- start 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 -- start start 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df54848080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df5482d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df54837d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1b1520 con 0x55df5483c5a0 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1b3060 con 0x55df54831ce0 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.898+0000 7f25c47f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1b1bf0 con 0x55df548313c0 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df54837d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df54837d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56524/0 (socket says 172.21.15.7:56524) 2024-04-23T15:37:47.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 -- 172.21.15.7:0/1909036976 learned_addr learned my addr 172.21.15.7:0/1909036976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25baa00640 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df54848080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25b3e00640 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df5482d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 -- 172.21.15.7:0/1909036976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 msgr2=0x55df54848080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df54848080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 -- 172.21.15.7:0/1909036976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 msgr2=0x55df5482d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df5482d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 -- 172.21.15.7:0/1909036976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df5484ed70 con 0x55df5483c5a0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.899+0000 7f25bb400640 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df54837d40 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f25b4010780 tx=0x7f25b4005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e860b6c929817199 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.900+0000 7f25ab400640 1 -- 172.21.15.7:0/1909036976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4039070 con 0x55df5483c5a0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.900+0000 7f25ab400640 1 -- 172.21.15.7:0/1909036976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25b401a5d0 con 0x55df5483c5a0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.900+0000 7f25ab400640 1 -- 172.21.15.7:0/1909036976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4005780 con 0x55df5483c5a0 2024-04-23T15:37:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 -- 172.21.15.7:0/1909036976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 msgr2=0x55df54837d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df54837d40 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f25b4010780 tx=0x7f25b4005ab0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 -- 172.21.15.7:0/1909036976 shutdown_connections 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df54831ce0 0x55df5482d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df5483c5a0 0x55df54837d40 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1909036976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df548313c0 0x55df54848080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 -- 172.21.15.7:0/1909036976 >> 172.21.15.7:0/1909036976 conn(0x55df5482d8d0 msgr2=0x55df54839df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 -- 172.21.15.7:0/1909036976 shutdown_connections 2024-04-23T15:37:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 -- 172.21.15.7:0/1909036976 wait complete. 2024-04-23T15:37:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 -- start start 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.901+0000 7f25c47f2740 1 Processor -- start 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df548313c0 0x55df5483ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 0x55df54840470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df5483c5a0 0x55df548409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1b2990 con 0x55df54831ce0 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1b22c0 con 0x55df548313c0 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1af520 con 0x55df5483c5a0 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25c47f2740 10 client.0 _ll_register_callbacks cb 0x7f25b4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 0x55df54840470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 0x55df54840470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56540/0 (socket says 172.21.15.7:56540) 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25b3e00640 1 -- 172.21.15.7:0/1059845935 learned_addr learned my addr 172.21.15.7:0/1059845935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:37:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.902+0000 7f25baa00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df548313c0 0x55df5483ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25bb400640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df5483c5a0 0x55df548409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25b3e00640 1 -- 172.21.15.7:0/1059845935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df5483c5a0 msgr2=0x55df548409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25b3e00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df5483c5a0 0x55df548409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25b3e00640 1 -- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df548313c0 msgr2=0x55df5483ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25b3e00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df548313c0 0x55df5483ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25b3e00640 1 -- 172.21.15.7:0/1059845935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df54576620 con 0x55df54831ce0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25baa00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df548313c0 0x55df5483ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25b3e00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 0x55df54840470 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f25a4031440 tx=0x7f25a4031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feeeb5a7d81c741 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25a8c00640 1 -- 172.21.15.7:0/1059845935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4049040 con 0x55df54831ce0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25a8c00640 1 -- 172.21.15.7:0/1059845935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f25a403b560 con 0x55df54831ce0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.903+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b401a5d0 con 0x55df54831ce0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25a8c00640 1 -- 172.21.15.7:0/1059845935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f25a40a7040 con 0x55df54831ce0 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 10 client.19419 fetch_fsmap learned FSMap version 32 2024-04-23T15:37:47.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55df548b28d0 con 0x55df54831ce0 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25a8c00640 1 -- 172.21.15.7:0/1059845935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25b401a5d0 con 0x55df54831ce0 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25a8c00640 1 -- 172.21.15.7:0/1059845935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f25a404c060 con 0x55df54831ce0 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 10 client.19419 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 10 client.19419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 20 client.19419 populate_metadata read hostname 'smithi007' 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df548b3050 0x55df548b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 4 client.19419 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:37:47.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.904+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df5479f190 con 0x55df548b3050 2024-04-23T15:37:47.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.905+0000 7f25baa00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df548b3050 0x55df548b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:37:47.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.906+0000 7f25baa00640 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df548b3050 0x55df548b5470 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb4ec2f212a5c65 server_cookie=8d30805121b0e6c8 in_seq=0 out_seq=0 2024-04-23T15:37:47.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.906+0000 7f25a8c00640 10 client.19419 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25a8c00640 1 -- 172.21.15.7:0/1059845935 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df5479f190 con 0x55df548b3050 2024-04-23T15:37:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25a8c00640 10 client.19419 handle_command_reply: tid=0 2024-04-23T15:37:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 client.19419 shutdown 2024-04-23T15:37:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 msgr2=0x55df54840470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 0x55df54840470 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f25a4031440 tx=0x7f25a4031f10 comp rx=0 tx=0).stop 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 shutdown_connections 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55df548b3050 0x55df548b5470 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df5483c5a0 0x55df548409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df54831ce0 0x55df54840470 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25a8c00640 0 client.19419 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 --2- 172.21.15.7:0/1059845935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df548313c0 0x55df5483ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 >> 172.21.15.7:0/1059845935 conn(0x55df5482d8d0 msgr2=0x55df548394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 shutdown_connections 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 1 -- 172.21.15.7:0/1059845935 wait complete. 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.936+0000 7f25c47f2740 20 client.19419 trim_cache size 0 max 16384 2024-04-23T15:37:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:37:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:37:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:37:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:37:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.937+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25a00a3d10 msgr2=0x7f25a00a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.937+0000 7f25bbe00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25a00a3d10 0x7f25a00a61d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55df54832960 tx=0x7f25ac00b390 comp rx=0 tx=0).stop 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.937+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 msgr2=0x7f25bc1a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.937+0000 7f25bbe00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 0x7f25bc1a0bb0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f25a4005ab0 tx=0x7f25a4003cd0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 shutdown_connections 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f25a00a3d10 0x7f25a00a61d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25bc19a780 0x7f25bc19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25bc109370 0x7f25bc1a0bb0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 --2- 172.21.15.7:0/2578268310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25bc1042a0 0x7f25bc1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 >> 172.21.15.7:0/2578268310 conn(0x7f25bc0ffae0 msgr2=0x7f25bc100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 shutdown_connections 2024-04-23T15:37:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:37:47.938+0000 7f25bbe00640 1 -- 172.21.15.7:0/2578268310 wait complete. 2024-04-23T15:37:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:48 smithi007 ceph-mon[27906]: pgmap v1474: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:37:49.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:48 smithi186 ceph-mon[31814]: pgmap v1474: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:37:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:48 smithi137 ceph-mon[31694]: pgmap v1474: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:37:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:50 smithi007 ceph-mon[27906]: pgmap v1475: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:37:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:50 smithi186 ceph-mon[31814]: pgmap v1475: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:37:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:50 smithi137 ceph-mon[31694]: pgmap v1475: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-04-23T15:37:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:52 smithi007 ceph-mon[27906]: pgmap v1476: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:37:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:52 smithi186 ceph-mon[31814]: pgmap v1476: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:37:53.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:52 smithi137 ceph-mon[31694]: pgmap v1476: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.7 MiB/s wr, 17 op/s 2024-04-23T15:37:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:54 smithi007 ceph-mon[27906]: pgmap v1477: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:37:55.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:54 smithi186 ceph-mon[31814]: pgmap v1477: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:37:55.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:54 smithi137 ceph-mon[31694]: pgmap v1477: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:37:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:56 smithi007 ceph-mon[27906]: pgmap v1478: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:37:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:56 smithi186 ceph-mon[31814]: pgmap v1478: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:37:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:56 smithi137 ceph-mon[31694]: pgmap v1478: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 12 op/s 2024-04-23T15:37:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:37:58 smithi007 ceph-mon[27906]: pgmap v1479: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:37:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:37:58 smithi186 ceph-mon[31814]: pgmap v1479: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:37:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:37:58 smithi137 ceph-mon[31694]: pgmap v1479: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.7 MiB/s wr, 18 op/s 2024-04-23T15:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 -- 172.21.15.7:0/1503236139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 msgr2=0x7f4ae8115300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1503236139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae8115300 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009cd0 tx=0x7f4ae002a8e0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 -- 172.21.15.7:0/1503236139 shutdown_connections 2024-04-23T15:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1503236139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae8115300 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1503236139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae8108540 0x7f4ae8108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1503236139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae810e4d0 0x7f4ae810e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 -- 172.21.15.7:0/1503236139 >> 172.21.15.7:0/1503236139 conn(0x7f4ae8077de0 msgr2=0x7f4ae8106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 -- 172.21.15.7:0/1503236139 shutdown_connections 2024-04-23T15:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.095+0000 7f4aeca00640 1 -- 172.21.15.7:0/1503236139 wait complete. 2024-04-23T15:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.096+0000 7f4aeca00640 1 Processor -- start 2024-04-23T15:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.096+0000 7f4aeca00640 1 -- start start 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4aeca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae8108540 0x7f4ae81a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4aeca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae81a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4aeca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae810e4d0 0x7f4ae819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4aeca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81186e0 con 0x7f4ae8108ec0 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4aeca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8118560 con 0x7f4ae8108540 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4aeca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8118860 con 0x7f4ae810e4d0 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4ae6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae81a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4ae6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae81a4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50502/0 (socket says 172.21.15.7:50502) 2024-04-23T15:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4ae6a00640 1 -- 172.21.15.7:0/1359576436 learned_addr learned my addr 172.21.15.7:0/1359576436 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4ae7400640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae8108540 0x7f4ae81a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.097+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae810e4d0 0x7f4ae819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4ae6a00640 1 -- 172.21.15.7:0/1359576436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae810e4d0 msgr2=0x7f4ae819ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae810e4d0 0x7f4ae819ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4ae6a00640 1 -- 172.21.15.7:0/1359576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae8108540 msgr2=0x7f4ae81a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae8108540 0x7f4ae81a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4ae6a00640 1 -- 172.21.15.7:0/1359576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae819f180 con 0x7f4ae8108ec0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae81a4d90 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400d950 tx=0x7f4ad400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.098+0000 7f4adfe00640 1 -- 172.21.15.7:0/1359576436 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4017070 con 0x7f4ae8108ec0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.099+0000 7f4adfe00640 1 -- 172.21.15.7:0/1359576436 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ad4009c30 con 0x7f4ae8108ec0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.099+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae819f470 con 0x7f4ae8108ec0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.099+0000 7f4adfe00640 1 -- 172.21.15.7:0/1359576436 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400f620 con 0x7f4ae8108ec0 2024-04-23T15:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.099+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae81ab710 con 0x7f4ae8108ec0 2024-04-23T15:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.102+0000 7f4af0e58740 1 Processor -- start 2024-04-23T15:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 -- start start 2024-04-23T15:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd17267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1731060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1733990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ffd168c900 con 0x55ffd17263c0 2024-04-23T15:38:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ffd1632f20 con 0x55ffd1726ce0 2024-04-23T15:38:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4af0e58740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ffd16888c0 con 0x55ffd17315a0 2024-04-23T15:38:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4ae7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd17267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4ae7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd17267a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50514/0 (socket says 172.21.15.7:50514) 2024-04-23T15:38:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.103+0000 7f4ae7e00640 1 -- 172.21.15.7:0/58496150 learned_addr learned my addr 172.21.15.7:0/58496150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7400640 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1731060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4adfe00640 1 -- 172.21.15.7:0/1359576436 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4ad40109a0 con 0x7f4ae8108ec0 2024-04-23T15:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7e00640 1 -- 172.21.15.7:0/58496150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 msgr2=0x55ffd1733990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1733990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7e00640 1 -- 172.21.15.7:0/58496150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 msgr2=0x55ffd1731060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1731060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7e00640 1 -- 172.21.15.7:0/58496150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd1657e10 con 0x55ffd17263c0 2024-04-23T15:38:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.104+0000 7f4ae7400640 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1731060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:38:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.105+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd17267a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0035000 tx=0x7f4ae0031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9c46525b2a567d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.105+0000 7f4ad3e00640 1 -- 172.21.15.7:0/58496150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0031850 con 0x55ffd17263c0 2024-04-23T15:38:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.105+0000 7f4ad3e00640 1 -- 172.21.15.7:0/58496150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ae0036040 con 0x55ffd17263c0 2024-04-23T15:38:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.105+0000 7f4ad3e00640 1 -- 172.21.15.7:0/58496150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00045d0 con 0x55ffd17263c0 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4adfe00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4acc0a3d90 0x7f4acc0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 -- 172.21.15.7:0/58496150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 msgr2=0x55ffd17267a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd17267a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0035000 tx=0x7f4ae0031430 comp rx=0 tx=0).stop 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4adfe00640 1 -- 172.21.15.7:0/1359576436 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f4ad40d0860 con 0x7f4ae8108ec0 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 -- 172.21.15.7:0/58496150 shutdown_connections 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1731060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1733990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 --2- 172.21.15.7:0/58496150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd17267a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 -- 172.21.15.7:0/58496150 >> 172.21.15.7:0/58496150 conn(0x55ffd17228d0 msgr2=0x55ffd1722cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 -- 172.21.15.7:0/58496150 shutdown_connections 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4ae7400640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4acc0a3d90 0x7f4acc0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.106+0000 7f4af0e58740 1 -- 172.21.15.7:0/58496150 wait complete. 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.107+0000 7f4af0e58740 1 -- start start 2024-04-23T15:38:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.107+0000 7f4af0e58740 1 Processor -- start 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4ae7400640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4acc0a3d90 0x7f4acc0a6250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8005e00 tx=0x7f4ad8005d30 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17263c0 0x55ffd172e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd172ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 0x55ffd172f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ffd1733fc0 con 0x55ffd17315a0 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ffd16462c0 con 0x55ffd1726ce0 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ffd1734140 con 0x55ffd17263c0 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4af0e58740 10 client.0 _ll_register_callbacks cb 0x55ffd139ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4ae7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 0x55ffd172f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4ae7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 0x55ffd172f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50520/0 (socket says 172.21.15.7:50520) 2024-04-23T15:38:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4ae7e00640 1 -- 172.21.15.7:0/1576869460 learned_addr learned my addr 172.21.15.7:0/1576869460 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.108+0000 7f4ae7400640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17263c0 0x55ffd172e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd172ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae7e00640 1 -- 172.21.15.7:0/1576869460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17263c0 msgr2=0x55ffd172e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17263c0 0x55ffd172e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae7e00640 1 -- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 msgr2=0x55ffd172ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd172ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae7e00640 1 -- 172.21.15.7:0/1576869460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd1656fd0 con 0x55ffd17315a0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 0x55ffd172f160 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f4ae002aed0 tx=0x7f4ae00098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd3b603eb587171 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.109+0000 7f4ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.110+0000 7f4ad0c00640 1 -- 172.21.15.7:0/1576869460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00315d0 con 0x55ffd17315a0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.110+0000 7f4ad0c00640 1 -- 172.21.15.7:0/1576869460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f4ae0031850 con 0x55ffd17315a0 2024-04-23T15:38:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.110+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae0036040 con 0x55ffd17315a0 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.110+0000 7f4ad0c00640 1 -- 172.21.15.7:0/1576869460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4ae005d050 con 0x55ffd17315a0 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.110+0000 7f4af0e58740 10 client.19431 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.110+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ffd139f210 con 0x55ffd17315a0 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4ad0c00640 1 -- 172.21.15.7:0/1576869460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ae0036040 con 0x55ffd17315a0 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4ad0c00640 1 -- 172.21.15.7:0/1576869460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4ae0058030 con 0x55ffd17315a0 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4af0e58740 10 client.19431 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4af0e58740 10 client.19431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4af0e58740 20 client.19431 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4af0e58740 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17415d0 0x55ffd17439c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4af0e58740 4 client.19431 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:38:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.111+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffd169a320 con 0x55ffd17415d0 2024-04-23T15:38:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.112+0000 7f4ae7400640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17415d0 0x55ffd17439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.113+0000 7f4ad0c00640 10 client.19431 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.113+0000 7f4ae7400640 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17415d0 0x55ffd17439c0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3990e343c86c4af server_cookie=1b6c07dfb5424488 in_seq=0 out_seq=0 2024-04-23T15:38:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4ad0c00640 1 -- 172.21.15.7:0/1576869460 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ffd169a320 con 0x55ffd17415d0 2024-04-23T15:38:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4ad0c00640 10 client.19431 handle_command_reply: tid=0 2024-04-23T15:38:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 client.19431 shutdown 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 msgr2=0x55ffd172f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 0x55ffd172f160 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f4ae002aed0 tx=0x7f4ae00098a0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 shutdown_connections 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17415d0 0x55ffd17439c0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd172ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17315a0 0x55ffd172f160 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 --2- 172.21.15.7:0/1576869460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17263c0 0x55ffd172e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 >> 172.21.15.7:0/1576869460 conn(0x55ffd17228d0 msgr2=0x55ffd1721a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4ad0c00640 0 client.19431 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 shutdown_connections 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.115+0000 7f4af0e58740 1 -- 172.21.15.7:0/1576869460 wait complete. 2024-04-23T15:38:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.116+0000 7f4af0e58740 20 client.19431 trim_cache size 0 max 16384 2024-04-23T15:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 Processor -- start 2024-04-23T15:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 -- start start 2024-04-23T15:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1730e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1721910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1728d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b5930 con 0x55ffd17263c0 2024-04-23T15:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b7470 con 0x55ffd1726ce0 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4af0e58740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b6000 con 0x55ffd17315a0 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.135+0000 7f4ae7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1730e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1730e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50528/0 (socket says 172.21.15.7:50528) 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 -- 172.21.15.7:0/2348425430 learned_addr learned my addr 172.21.15.7:0/2348425430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1721910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1728d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 -- 172.21.15.7:0/2348425430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 msgr2=0x55ffd1728d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1728d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 -- 172.21.15.7:0/2348425430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 msgr2=0x55ffd1721910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1721910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 -- 172.21.15.7:0/2348425430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd146b620 con 0x55ffd17263c0 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1721910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.136+0000 7f4ae7400640 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1730e10 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8011bc0 tx=0x7f4ad8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9cdfeebff286bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.137+0000 7f4ad3400640 1 -- 172.21.15.7:0/2348425430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad802e070 con 0x55ffd17263c0 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.137+0000 7f4ad3400640 1 -- 172.21.15.7:0/2348425430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ad8012cd0 con 0x55ffd17263c0 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.137+0000 7f4ad3400640 1 -- 172.21.15.7:0/2348425430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad801fac0 con 0x55ffd17263c0 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 -- 172.21.15.7:0/2348425430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 msgr2=0x55ffd1730e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1730e10 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8011bc0 tx=0x7f4ad8014000 comp rx=0 tx=0).stop 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 -- 172.21.15.7:0/2348425430 shutdown_connections 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1721910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1728d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2348425430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1730e10 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 -- 172.21.15.7:0/2348425430 >> 172.21.15.7:0/2348425430 conn(0x55ffd17228d0 msgr2=0x55ffd1721200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 -- 172.21.15.7:0/2348425430 shutdown_connections 2024-04-23T15:38:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 -- 172.21.15.7:0/2348425430 wait complete. 2024-04-23T15:38:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.138+0000 7f4af0e58740 1 -- start start 2024-04-23T15:38:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 Processor -- start 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1743fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1744500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1744a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b6da0 con 0x55ffd17263c0 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b66d0 con 0x55ffd1726ce0 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b3930 con 0x55ffd17315a0 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4af0e58740 10 client.0 _ll_register_callbacks cb 0x7f4ae0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.139+0000 7f4ae7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1743fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1743fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50534/0 (socket says 172.21.15.7:50534) 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 -- 172.21.15.7:0/2951718234 learned_addr learned my addr 172.21.15.7:0/2951718234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1744a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1744500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 -- 172.21.15.7:0/2951718234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 msgr2=0x55ffd1744a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1744a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 -- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 msgr2=0x55ffd1744500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1744500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 -- 172.21.15.7:0/2951718234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd17a67b0 con 0x55ffd17263c0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7e00640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1744a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1744500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ae7400640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1743fc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4ad801f4a0 tx=0x7f4ad801f4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fc11d66e01460d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.140+0000 7f4ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4ad0c00640 1 -- 172.21.15.7:0/2951718234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8037060 con 0x55ffd17263c0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4ad0c00640 1 -- 172.21.15.7:0/2951718234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(172..172 src has 1..172) ==== 9467+0+0 (secure 0 0 0) 0x7f4ad8005050 con 0x55ffd17263c0 2024-04-23T15:38:01.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad8012cd0 con 0x55ffd17263c0 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4ad0c00640 1 -- 172.21.15.7:0/2951718234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4ad8024030 con 0x55ffd17263c0 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4af0e58740 10 client.19437 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ffd17a79d0 con 0x55ffd17263c0 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.141+0000 7f4ad0c00640 1 -- 172.21.15.7:0/2951718234 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ad8012cd0 con 0x55ffd17263c0 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4ad0c00640 1 -- 172.21.15.7:0/2951718234 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f4ad8031030 con 0x55ffd17263c0 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4af0e58740 10 client.19437 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4af0e58740 10 client.19437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4af0e58740 20 client.19437 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17a80a0 0x55ffd17aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4af0e58740 4 client.19437 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:38:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffd1694190 con 0x55ffd17a80a0 2024-04-23T15:38:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.142+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17a80a0 0x55ffd17aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.143+0000 7f4ae6a00640 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17a80a0 0x55ffd17aa4c0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80cc8a99e60eec87 server_cookie=fa1162a82e8690da in_seq=0 out_seq=0 2024-04-23T15:38:01.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.143+0000 7f4ad0c00640 10 client.19437 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.176+0000 7f4ad0c00640 1 -- 172.21.15.7:0/2951718234 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffd1694190 con 0x55ffd17a80a0 2024-04-23T15:38:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.176+0000 7f4ad0c00640 10 client.19437 handle_command_reply: tid=0 2024-04-23T15:38:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.176+0000 7f4af0e58740 1 client.19437 shutdown 2024-04-23T15:38:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 msgr2=0x55ffd1743fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1743fc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4ad801f4a0 tx=0x7f4ad801f4d0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 shutdown_connections 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ffd17a80a0 0x55ffd17aa4c0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffd1726ce0 0x55ffd1744500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ffd17315a0 0x55ffd1744a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 --2- 172.21.15.7:0/2951718234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ffd17263c0 0x55ffd1743fc0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4ad0c00640 0 client.19437 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 >> 172.21.15.7:0/2951718234 conn(0x55ffd17228d0 msgr2=0x55ffd1721a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 shutdown_connections 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 1 -- 172.21.15.7:0/2951718234 wait complete. 2024-04-23T15:38:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.177+0000 7f4af0e58740 20 client.19437 trim_cache size 0 max 16384 2024-04-23T15:38:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:38:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:38:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:38:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:38:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4acc0a3d90 msgr2=0x7f4acc0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4acc0a3d90 0x7f4acc0a6250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8005e00 tx=0x7f4ad8005d30 comp rx=0 tx=0).stop 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 msgr2=0x7f4ae81a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae81a4d90 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400d950 tx=0x7f4ad400de10 comp rx=0 tx=0).stop 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 shutdown_connections 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4acc0a3d90 0x7f4acc0a6250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae810e4d0 0x7f4ae819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ae8108ec0 0x7f4ae81a4d90 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 --2- 172.21.15.7:0/1359576436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae8108540 0x7f4ae81a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 >> 172.21.15.7:0/1359576436 conn(0x7f4ae8077de0 msgr2=0x7f4ae8078460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 shutdown_connections 2024-04-23T15:38:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:01.178+0000 7f4aeca00640 1 -- 172.21.15.7:0/1359576436 wait complete. 2024-04-23T15:38:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:01 smithi007 ceph-mon[27906]: pgmap v1480: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:38:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:01 smithi186 ceph-mon[31814]: pgmap v1480: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:38:01.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:01 smithi137 ceph-mon[31694]: pgmap v1480: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 13 op/s 2024-04-23T15:38:03.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:03 smithi007 ceph-mon[27906]: pgmap v1481: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.2 MiB/s wr, 39 op/s 2024-04-23T15:38:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:03 smithi186 ceph-mon[31814]: pgmap v1481: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.2 MiB/s wr, 39 op/s 2024-04-23T15:38:03.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:03 smithi137 ceph-mon[31694]: pgmap v1481: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.2 MiB/s wr, 39 op/s 2024-04-23T15:38:04.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:04 smithi007 ceph-mon[27906]: osdmap e173: 12 total, 12 up, 12 in 2024-04-23T15:38:04.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:04 smithi186 ceph-mon[31814]: osdmap e173: 12 total, 12 up, 12 in 2024-04-23T15:38:04.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:04 smithi137 ceph-mon[31694]: osdmap e173: 12 total, 12 up, 12 in 2024-04-23T15:38:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:05 smithi007 ceph-mon[27906]: pgmap v1483: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.1 MiB/s wr, 37 op/s 2024-04-23T15:38:05.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:05 smithi186 ceph-mon[31814]: pgmap v1483: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.1 MiB/s wr, 37 op/s 2024-04-23T15:38:05.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:05 smithi137 ceph-mon[31694]: pgmap v1483: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.1 MiB/s wr, 37 op/s 2024-04-23T15:38:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:07 smithi007 ceph-mon[27906]: pgmap v1484: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.1 MiB/s wr, 37 op/s 2024-04-23T15:38:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:07 smithi186 ceph-mon[31814]: pgmap v1484: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.1 MiB/s wr, 37 op/s 2024-04-23T15:38:07.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:07 smithi137 ceph-mon[31694]: pgmap v1484: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.1 MiB/s wr, 37 op/s 2024-04-23T15:38:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:09 smithi007 ceph-mon[27906]: pgmap v1485: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:38:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:09 smithi186 ceph-mon[31814]: pgmap v1485: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:38:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:09 smithi137 ceph-mon[31694]: pgmap v1485: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:38:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:11 smithi007 ceph-mon[27906]: pgmap v1486: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:38:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:11 smithi186 ceph-mon[31814]: pgmap v1486: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:38:11.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:11 smithi137 ceph-mon[31694]: pgmap v1486: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.9 MiB/s wr, 37 op/s 2024-04-23T15:38:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:12 smithi007 ceph-mon[27906]: osdmap e174: 12 total, 12 up, 12 in 2024-04-23T15:38:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:12 smithi007 ceph-mon[27906]: pgmap v1488: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-04-23T15:38:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:12 smithi186 ceph-mon[31814]: osdmap e174: 12 total, 12 up, 12 in 2024-04-23T15:38:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:12 smithi186 ceph-mon[31814]: pgmap v1488: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-04-23T15:38:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:12 smithi137 ceph-mon[31694]: osdmap e174: 12 total, 12 up, 12 in 2024-04-23T15:38:12.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:12 smithi137 ceph-mon[31694]: pgmap v1488: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.3 MiB/s wr, 13 op/s 2024-04-23T15:38:13.942 INFO:tasks.workunit.client.0.smithi007.stdout:fs setup took 2664 secs 2024-04-23T15:38:14.283 INFO:tasks.workunit.client.0.smithi007.stdout:Syncing()...0 sec 2024-04-23T15:38:14.286 INFO:tasks.workunit.client.0.smithi007.stdout:Starting Actual Benchmark At: Tue Apr 23 15:38:14 2024 2024-04-23T15:38:14.286 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 -- 172.21.15.7:0/1127611354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c104c50 msgr2=0x7fa42c108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 --2- 172.21.15.7:0/1127611354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c104c50 0x7fa42c108c90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa418009900 tx=0x7fa41802a410 comp rx=0 tx=0).stop 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 -- 172.21.15.7:0/1127611354 shutdown_connections 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 --2- 172.21.15.7:0/1127611354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa42c109370 0x7fa42c110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 --2- 172.21.15.7:0/1127611354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c104c50 0x7fa42c108c90 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 --2- 172.21.15.7:0/1127611354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa42c1042a0 0x7fa42c104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.336+0000 7fa430e00640 1 -- 172.21.15.7:0/1127611354 >> 172.21.15.7:0/1127611354 conn(0x7fa42c0ffae0 msgr2=0x7fa42c101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.337+0000 7fa430e00640 1 -- 172.21.15.7:0/1127611354 shutdown_connections 2024-04-23T15:38:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.337+0000 7fa430e00640 1 -- 172.21.15.7:0/1127611354 wait complete. 2024-04-23T15:38:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 Processor -- start 2024-04-23T15:38:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 -- start start 2024-04-23T15:38:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa42c1042a0 0x7fa42c10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 0x7fa42c110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa42c1a37a0 0x7fa42c1a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c077650 con 0x7fa42c109370 2024-04-23T15:38:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c0774d0 con 0x7fa42c1042a0 2024-04-23T15:38:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.338+0000 7fa430e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c0777d0 con 0x7fa42c1a37a0 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 0x7fa42c110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 0x7fa42c110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55968/0 (socket says 172.21.15.7:55968) 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 -- 172.21.15.7:0/248824293 learned_addr learned my addr 172.21.15.7:0/248824293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42be00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa42c1a37a0 0x7fa42c1a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42b400640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa42c1042a0 0x7fa42c10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 -- 172.21.15.7:0/248824293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa42c1a37a0 msgr2=0x7fa42c1a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa42c1a37a0 0x7fa42c1a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 -- 172.21.15.7:0/248824293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa42c1042a0 msgr2=0x7fa42c10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.339+0000 7fa42aa00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa42c1042a0 0x7fa42c10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.340+0000 7fa42aa00640 1 -- 172.21.15.7:0/248824293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c1a4260 con 0x7fa42c109370 2024-04-23T15:38:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.340+0000 7fa42aa00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 0x7fa42c110250 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa41802aa00 tx=0x7fa418003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.340+0000 7fa423e00640 1 -- 172.21.15.7:0/248824293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41803f070 con 0x7fa42c109370 2024-04-23T15:38:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.340+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42c1a44f0 con 0x7fa42c109370 2024-04-23T15:38:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.341+0000 7fa423e00640 1 -- 172.21.15.7:0/248824293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa418031d60 con 0x7fa42c109370 2024-04-23T15:38:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.341+0000 7fa423e00640 1 -- 172.21.15.7:0/248824293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418035070 con 0x7fa42c109370 2024-04-23T15:38:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.341+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42c1abc60 con 0x7fa42c109370 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 Processor -- start 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 -- start start 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132fa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558313255900 con 0x5583132ef3c0 2024-04-23T15:38:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583131fbf20 con 0x5583132efce0 2024-04-23T15:38:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.346+0000 7fa435385740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5583132518c0 con 0x5583132fa5a0 2024-04-23T15:38:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.347+0000 7fa42be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.347+0000 7fa42be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132ef7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55984/0 (socket says 172.21.15.7:55984) 2024-04-23T15:38:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.347+0000 7fa42be00640 1 -- 172.21.15.7:0/1364653175 learned_addr learned my addr 172.21.15.7:0/1364653175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.347+0000 7fa423e00640 1 -- 172.21.15.7:0/248824293 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa41803b4f0 con 0x7fa42c109370 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.347+0000 7fa42b400640 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42aa00640 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42be00640 1 -- 172.21.15.7:0/1364653175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 msgr2=0x5583132fc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42be00640 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132fc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42be00640 1 -- 172.21.15.7:0/1364653175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 msgr2=0x5583132fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42be00640 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42be00640 1 -- 172.21.15.7:0/1364653175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558313220e10 con 0x5583132ef3c0 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42aa00640 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:38:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.348+0000 7fa42be00640 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132ef7a0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa424009f50 tx=0x7fa4240118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2f4fc6c78147a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.349+0000 7fa420c00640 1 -- 172.21.15.7:0/1364653175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424004d20 con 0x5583132ef3c0 2024-04-23T15:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.349+0000 7fa420c00640 1 -- 172.21.15.7:0/1364653175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa424004050 con 0x5583132ef3c0 2024-04-23T15:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.349+0000 7fa420c00640 1 -- 172.21.15.7:0/1364653175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424005280 con 0x5583132ef3c0 2024-04-23T15:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.349+0000 7fa423e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4100a3d90 0x7fa4100a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.349+0000 7fa423e00640 1 -- 172.21.15.7:0/248824293 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fa4180f10e0 con 0x7fa42c109370 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa42b400640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4100a3d90 0x7fa4100a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 -- 172.21.15.7:0/1364653175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 msgr2=0x5583132ef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132ef7a0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa424009f50 tx=0x7fa4240118d0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 -- 172.21.15.7:0/1364653175 shutdown_connections 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 --2- 172.21.15.7:0/1364653175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132ef7a0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.350+0000 7fa435385740 1 -- 172.21.15.7:0/1364653175 >> 172.21.15.7:0/1364653175 conn(0x5583132eb8d0 msgr2=0x5583132ebcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.351+0000 7fa435385740 1 -- 172.21.15.7:0/1364653175 shutdown_connections 2024-04-23T15:38:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.351+0000 7fa435385740 1 -- 172.21.15.7:0/1364653175 wait complete. 2024-04-23T15:38:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.351+0000 7fa42b400640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4100a3d90 0x7fa4100a6250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5583132f0960 tx=0x7fa41c00d340 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.351+0000 7fa435385740 1 -- start start 2024-04-23T15:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.352+0000 7fa435385740 1 Processor -- start 2024-04-23T15:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.352+0000 7fa435385740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132f7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.352+0000 7fa435385740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132efce0 0x5583132f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.352+0000 7fa435385740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132fa5a0 0x5583132f8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.352+0000 7fa435385740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5583132fd0e0 con 0x5583132ef3c0 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa435385740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55831320f2c0 con 0x5583132fa5a0 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa435385740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5583132fd260 con 0x5583132efce0 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa435385740 10 client.0 _ll_register_callbacks cb 0x558312f67a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa42b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa42aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132efce0 0x5583132f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa42b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55992/0 (socket says 172.21.15.7:55992) 2024-04-23T15:38:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa42b400640 1 -- 172.21.15.7:0/3106803533 learned_addr learned my addr 172.21.15.7:0/3106803533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.353+0000 7fa42aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132efce0 0x5583132f7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:45942/0 (socket says 172.21.15.7:45942) 2024-04-23T15:38:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.354+0000 7fa42be00640 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132fa5a0 0x5583132f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.354+0000 7fa42b400640 1 -- 172.21.15.7:0/3106803533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132efce0 msgr2=0x5583132f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.354+0000 7fa42b400640 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132efce0 0x5583132f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.354+0000 7fa42b400640 1 -- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132fa5a0 msgr2=0x5583132f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.354+0000 7fa42b400640 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132fa5a0 0x5583132f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.354+0000 7fa42b400640 1 -- 172.21.15.7:0/3106803533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55831321ffd0 con 0x5583132ef3c0 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.355+0000 7fa42b400640 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132f7590 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa41c012700 tx=0x7fa41c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1624aa5129fcc6e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.355+0000 7fa415600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.355+0000 7fa415600640 1 -- 172.21.15.7:0/3106803533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c01f9b0 con 0x5583132ef3c0 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.355+0000 7fa415600640 1 -- 172.21.15.7:0/3106803533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fa41c01fb50 con 0x5583132ef3c0 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.355+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa424004050 con 0x5583132ef3c0 2024-04-23T15:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.356+0000 7fa415600640 1 -- 172.21.15.7:0/3106803533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa41c030050 con 0x5583132ef3c0 2024-04-23T15:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.356+0000 7fa435385740 10 client.19449 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.356+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558312f68210 con 0x5583132ef3c0 2024-04-23T15:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.356+0000 7fa415600640 1 -- 172.21.15.7:0/3106803533 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa41c01fd50 con 0x5583132ef3c0 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa415600640 1 -- 172.21.15.7:0/3106803533 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa41c01e440 con 0x5583132ef3c0 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa435385740 10 client.19449 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa435385740 10 client.19449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa435385740 20 client.19449 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa435385740 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55831330a6f0 0x55831330cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa435385740 4 client.19449 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.357+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa424004050 con 0x55831330a6f0 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.358+0000 7fa42aa00640 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55831330a6f0 0x55831330cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.359+0000 7fa42aa00640 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55831330a6f0 0x55831330cb00 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91a58a8bcfc21169 server_cookie=6e5f6e093ce6230f in_seq=0 out_seq=0 2024-04-23T15:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.359+0000 7fa415600640 10 client.19449 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.365+0000 7fa415600640 1 -- 172.21.15.7:0/3106803533 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7fa424004050 con 0x55831330a6f0 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.365+0000 7fa415600640 10 client.19449 handle_command_reply: tid=0 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 client.19449 shutdown 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 msgr2=0x5583132f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132f7590 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa41c012700 tx=0x7fa41c0046c0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 shutdown_connections 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55831330a6f0 0x55831330cb00 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132fa5a0 0x5583132f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132efce0 0x5583132f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 --2- 172.21.15.7:0/3106803533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132ef3c0 0x5583132f7590 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 >> 172.21.15.7:0/3106803533 conn(0x5583132eb8d0 msgr2=0x5583132f1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.366+0000 7fa415600640 0 client.19449 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.367+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 shutdown_connections 2024-04-23T15:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.367+0000 7fa435385740 1 -- 172.21.15.7:0/3106803533 wait complete. 2024-04-23T15:38:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.367+0000 7fa435385740 20 client.19449 trim_cache size 0 max 16384 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.394+0000 7fa435385740 1 Processor -- start 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.394+0000 7fa435385740 1 -- start start 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa435385740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa435385740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa435385740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa435385740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1b5e30 con 0x5583132f1dd0 2024-04-23T15:38:14.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa435385740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1b7970 con 0x5583132efce0 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa435385740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1b6500 con 0x5583132fa5a0 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa42be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa42be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55998/0 (socket says 172.21.15.7:55998) 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa42be00640 1 -- 172.21.15.7:0/1082954470 learned_addr learned my addr 172.21.15.7:0/1082954470 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa42b400640 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.395+0000 7fa42aa00640 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.396+0000 7fa42be00640 1 -- 172.21.15.7:0/1082954470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 msgr2=0x5583132f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.396+0000 7fa42be00640 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.396+0000 7fa42be00640 1 -- 172.21.15.7:0/1082954470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 msgr2=0x5583132f9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.396+0000 7fa42be00640 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.396+0000 7fa42be00640 1 -- 172.21.15.7:0/1082954470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583132fcd00 con 0x5583132f1dd0 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.396+0000 7fa42be00640 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f7e60 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fa424006010 tx=0x7fa424003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6718569341909dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.397+0000 7fa417e00640 1 -- 172.21.15.7:0/1082954470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424003e50 con 0x5583132f1dd0 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.397+0000 7fa417e00640 1 -- 172.21.15.7:0/1082954470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa424004500 con 0x5583132f1dd0 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.397+0000 7fa417e00640 1 -- 172.21.15.7:0/1082954470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424005290 con 0x5583132f1dd0 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 -- 172.21.15.7:0/1082954470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 msgr2=0x5583132f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f7e60 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fa424006010 tx=0x7fa424003ae0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 -- 172.21.15.7:0/1082954470 shutdown_connections 2024-04-23T15:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f7e60 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 --2- 172.21.15.7:0/1082954470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 -- 172.21.15.7:0/1082954470 >> 172.21.15.7:0/1082954470 conn(0x5583132eb8d0 msgr2=0x5583132eaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 -- 172.21.15.7:0/1082954470 shutdown_connections 2024-04-23T15:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.398+0000 7fa435385740 1 -- 172.21.15.7:0/1082954470 wait complete. 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.399+0000 7fa435385740 1 -- start start 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.399+0000 7fa435385740 1 Processor -- start 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1b72a0 con 0x5583132f1dd0 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1b6bd0 con 0x5583132efce0 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1b3e30 con 0x5583132fa5a0 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa435385740 10 client.0 _ll_register_callbacks cb 0x7fa41c00d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.400+0000 7fa42aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56002/0 (socket says 172.21.15.7:56002) 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 -- 172.21.15.7:0/4112952813 learned_addr learned my addr 172.21.15.7:0/4112952813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42be00640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42b400640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 -- 172.21.15.7:0/4112952813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 msgr2=0x5583132f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 -- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 msgr2=0x5583132f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.401+0000 7fa42aa00640 1 -- 172.21.15.7:0/4112952813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558313034620 con 0x5583132f1dd0 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa42aa00640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f4a80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa418031440 tx=0x7fa41803b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3f8e4fb0347ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa415600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa415600640 1 -- 172.21.15.7:0/4112952813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4180c5920 con 0x5583132f1dd0 2024-04-23T15:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa415600640 1 -- 172.21.15.7:0/4112952813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fa4180b9320 con 0x5583132f1dd0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa424004500 con 0x5583132f1dd0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa415600640 1 -- 172.21.15.7:0/4112952813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa4180ee6e0 con 0x5583132f1dd0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa435385740 10 client.19455 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.402+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558313371110 con 0x5583132f1dd0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa415600640 1 -- 172.21.15.7:0/4112952813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa424004500 con 0x5583132f1dd0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa415600640 1 -- 172.21.15.7:0/4112952813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fa4180bcf10 con 0x5583132f1dd0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa435385740 10 client.19455 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa435385740 10 client.19455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa435385740 20 client.19455 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa435385740 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5583133717e0 0x558313373bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa435385740 4 client.19455 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.403+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558313263320 con 0x5583133717e0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.404+0000 7fa42b400640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5583133717e0 0x558313373bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.405+0000 7fa42b400640 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5583133717e0 0x558313373bd0 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986ace753688365a server_cookie=3a7275c1f7590f54 in_seq=0 out_seq=0 2024-04-23T15:38:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.405+0000 7fa415600640 10 client.19455 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa415600640 1 -- 172.21.15.7:0/4112952813 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558313263320 con 0x5583133717e0 2024-04-23T15:38:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa415600640 10 client.19455 handle_command_reply: tid=0 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 client.19455 shutdown 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 msgr2=0x5583132f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f4a80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa418031440 tx=0x7fa41803b460 comp rx=0 tx=0).stop 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 shutdown_connections 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5583133717e0 0x558313373bd0 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5583132fa5a0 0x5583132f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583132f1dd0 0x5583132f4a80 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 --2- 172.21.15.7:0/4112952813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583132efce0 0x5583132f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 >> 172.21.15.7:0/4112952813 conn(0x5583132eb8d0 msgr2=0x5583132f0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.440+0000 7fa415600640 0 client.19455 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.441+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 shutdown_connections 2024-04-23T15:38:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.441+0000 7fa435385740 1 -- 172.21.15.7:0/4112952813 wait complete. 2024-04-23T15:38:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.441+0000 7fa435385740 20 client.19455 trim_cache size 0 max 16384 2024-04-23T15:38:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:38:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:38:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:38:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4100a3d90 msgr2=0x7fa4100a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4100a3d90 0x7fa4100a6250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5583132f0960 tx=0x7fa41c00d340 comp rx=0 tx=0).stop 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 msgr2=0x7fa42c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 0x7fa42c110250 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa41802aa00 tx=0x7fa418003c80 comp rx=0 tx=0).stop 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 shutdown_connections 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4100a3d90 0x7fa4100a6250 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa42c1a37a0 0x7fa42c1a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa42c109370 0x7fa42c110250 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 --2- 172.21.15.7:0/248824293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa42c1042a0 0x7fa42c10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.442+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 >> 172.21.15.7:0/248824293 conn(0x7fa42c0ffae0 msgr2=0x7fa42c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.443+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 shutdown_connections 2024-04-23T15:38:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:14.443+0000 7fa430e00640 1 -- 172.21.15.7:0/248824293 wait complete. 2024-04-23T15:38:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:14 smithi007 ceph-mon[27906]: pgmap v1489: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:38:15.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:14 smithi186 ceph-mon[31814]: pgmap v1489: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:38:15.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:14 smithi137 ceph-mon[31694]: pgmap v1489: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:38:17.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:16 smithi007 ceph-mon[27906]: pgmap v1490: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:38:17.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:16 smithi186 ceph-mon[31814]: pgmap v1490: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:38:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:16 smithi137 ceph-mon[31694]: pgmap v1490: 129 pgs: 129 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.6 MiB/s wr, 11 op/s 2024-04-23T15:38:19.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:18 smithi007 ceph-mon[27906]: pgmap v1491: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 534 op/s 2024-04-23T15:38:19.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:18 smithi186 ceph-mon[31814]: pgmap v1491: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 534 op/s 2024-04-23T15:38:19.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:18 smithi137 ceph-mon[31694]: pgmap v1491: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 534 op/s 2024-04-23T15:38:21.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:20 smithi007 ceph-mon[27906]: pgmap v1492: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 534 op/s 2024-04-23T15:38:21.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:20 smithi186 ceph-mon[31814]: pgmap v1492: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 534 op/s 2024-04-23T15:38:21.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:20 smithi137 ceph-mon[31694]: pgmap v1492: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 534 op/s 2024-04-23T15:38:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:22 smithi007 ceph-mon[27906]: pgmap v1493: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 2.12k op/s 2024-04-23T15:38:23.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:22 smithi186 ceph-mon[31814]: pgmap v1493: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 2.12k op/s 2024-04-23T15:38:23.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:22 smithi137 ceph-mon[31694]: pgmap v1493: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 2.12k op/s 2024-04-23T15:38:25.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:24 smithi007 ceph-mon[27906]: pgmap v1494: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 1.83k op/s 2024-04-23T15:38:25.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:24 smithi186 ceph-mon[31814]: pgmap v1494: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 1.83k op/s 2024-04-23T15:38:25.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:24 smithi137 ceph-mon[31694]: pgmap v1494: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 1.83k op/s 2024-04-23T15:38:27.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:26 smithi186 ceph-mon[31814]: pgmap v1495: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 1.83k op/s 2024-04-23T15:38:27.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:26 smithi137 ceph-mon[31694]: pgmap v1495: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 1.83k op/s 2024-04-23T15:38:27.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:26 smithi007 ceph-mon[27906]: pgmap v1495: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 1.83k op/s 2024-04-23T15:38:28.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:27 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:38:28.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:27 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:38:28.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:27 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:38:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.740+0000 7fe0fdc00640 1 -- 172.21.15.7:0/2430875939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109000 msgr2=0x7fe0f81093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.740+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/2430875939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109000 0x7fe0f81093e0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009ca0 tx=0x7fe0e802a970 comp rx=0 tx=0).stop 2024-04-23T15:38:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.741+0000 7fe0fdc00640 1 -- 172.21.15.7:0/2430875939 shutdown_connections 2024-04-23T15:38:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.743+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/2430875939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8109920 0x7fe0f8114c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.743+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/2430875939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f8115150 0x7fe0f8117540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.743+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/2430875939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109000 0x7fe0f81093e0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.743+0000 7fe0fdc00640 1 -- 172.21.15.7:0/2430875939 >> 172.21.15.7:0/2430875939 conn(0x7fe0f806d0d0 msgr2=0x7fe0f806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.743+0000 7fe0fdc00640 1 -- 172.21.15.7:0/2430875939 shutdown_connections 2024-04-23T15:38:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.744+0000 7fe0fdc00640 1 -- 172.21.15.7:0/2430875939 wait complete. 2024-04-23T15:38:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.746+0000 7fe0fdc00640 1 Processor -- start 2024-04-23T15:38:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.746+0000 7fe0fdc00640 1 -- start start 2024-04-23T15:38:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.747+0000 7fe0fdc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f8109000 0x7fe0f8114550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.747+0000 7fe0fdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109920 0x7fe0f8114a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.747+0000 7fe0fdc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 0x7fe0f810be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.748+0000 7fe0fdc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f811aad0 con 0x7fe0f8109920 2024-04-23T15:38:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.749+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 0x7fe0f810be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.749+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 0x7fe0f810be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:60354/0 (socket says 172.21.15.7:60354) 2024-04-23T15:38:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.749+0000 7fe0f7400640 1 -- 172.21.15.7:0/3421023686 learned_addr learned my addr 172.21.15.7:0/3421023686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.749+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f8109000 0x7fe0f8114550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.749+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f811a950 con 0x7fe0f8115150 2024-04-23T15:38:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.750+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f811ac50 con 0x7fe0f8109000 2024-04-23T15:38:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.750+0000 7fe0f6000640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109920 0x7fe0f8114a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.751+0000 7fe0f7400640 1 -- 172.21.15.7:0/3421023686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f8109000 msgr2=0x7fe0f8114550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.751+0000 7fe0f7400640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f8109000 0x7fe0f8114550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.751+0000 7fe0f7400640 1 -- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109920 msgr2=0x7fe0f8114a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.751+0000 7fe0f7400640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109920 0x7fe0f8114a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.751+0000 7fe0f7400640 1 -- 172.21.15.7:0/3421023686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f810c720 con 0x7fe0f8115150 2024-04-23T15:38:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.752+0000 7fe0f6000640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109920 0x7fe0f8114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:38:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.752+0000 7fe0f7400640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 0x7fe0f810be60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e970 tx=0x7fe0f000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.754+0000 7fe0ef400640 1 -- 172.21.15.7:0/3421023686 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000ccc0 con 0x7fe0f8115150 2024-04-23T15:38:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.754+0000 7fe0ef400640 1 -- 172.21.15.7:0/3421023686 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0f000ce60 con 0x7fe0f8115150 2024-04-23T15:38:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.754+0000 7fe0ef400640 1 -- 172.21.15.7:0/3421023686 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0010430 con 0x7fe0f8115150 2024-04-23T15:38:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.754+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f810ca10 con 0x7fe0f8115150 2024-04-23T15:38:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.755+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f8110260 con 0x7fe0f8115150 2024-04-23T15:38:28.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.764+0000 7fe1009d1740 1 Processor -- start 2024-04-23T15:38:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.771+0000 7fe0ef400640 1 -- 172.21.15.7:0/3421023686 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe0f0004f50 con 0x7fe0f8115150 2024-04-23T15:38:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.773+0000 7fe0ef400640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe0dc0a3ff0 0x7fe0dc0a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.774+0000 7fe0ef400640 1 -- 172.21.15.7:0/3421023686 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fe0f00d0f70 con 0x7fe0f8115150 2024-04-23T15:38:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.775+0000 7fe1009d1740 1 -- start start 2024-04-23T15:38:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.775+0000 7fe0f6000640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe0dc0a3ff0 0x7fe0dc0a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.778+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab3c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.780+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab46e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.781+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 0x55eebab49780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.780+0000 7fe0f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab3c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.781+0000 7fe0f6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab3c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44414/0 (socket says 172.21.15.7:44414) 2024-04-23T15:38:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.782+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 0x55eebab49780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.782+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 0x55eebab49780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:58298/0 (socket says 172.21.15.7:58298) 2024-04-23T15:38:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.782+0000 7fe0f7400640 1 -- 172.21.15.7:0/2083306972 learned_addr learned my addr 172.21.15.7:0/2083306972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.783+0000 7fe0f6000640 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab46e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.784+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eebaaa2900 con 0x55eebab3c1b0 2024-04-23T15:38:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.784+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eebaa48f20 con 0x55eebab3cad0 2024-04-23T15:38:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.784+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55eebaa9e8c0 con 0x55eebab47390 2024-04-23T15:38:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.785+0000 7fe0f6000640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe0dc0a3ff0 0x7fe0dc0a64b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe0f81a7ff0 tx=0x7fe0e4005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.785+0000 7fe0f7400640 1 -- 172.21.15.7:0/2083306972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 msgr2=0x55eebab46e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.785+0000 7fe0f7400640 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab46e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.785+0000 7fe0f7400640 1 -- 172.21.15.7:0/2083306972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 msgr2=0x55eebab3c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.785+0000 7fe0f7400640 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab3c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.785+0000 7fe0f7400640 1 -- 172.21.15.7:0/2083306972 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eebaa6de10 con 0x55eebab47390 2024-04-23T15:38:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.786+0000 7fe0f7400640 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 0x55eebab49780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00994d0 tx=0x7fe0f009c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fecf0fc91cf28441 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.788+0000 7fe0e3e00640 1 -- 172.21.15.7:0/2083306972 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00a0eb0 con 0x55eebab47390 2024-04-23T15:38:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.788+0000 7fe0e3e00640 1 -- 172.21.15.7:0/2083306972 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0f00a5770 con 0x55eebab47390 2024-04-23T15:38:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.788+0000 7fe0e3e00640 1 -- 172.21.15.7:0/2083306972 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f009cd60 con 0x55eebab47390 2024-04-23T15:38:28.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.789+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 msgr2=0x55eebab49780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:28.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.789+0000 7fe1009d1740 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 0x55eebab49780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00994d0 tx=0x7fe0f009c700 comp rx=0 tx=0).stop 2024-04-23T15:38:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.790+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 shutdown_connections 2024-04-23T15:38:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.790+0000 7fe1009d1740 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab46e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.790+0000 7fe1009d1740 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab47390 0x55eebab49780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.790+0000 7fe1009d1740 1 --2- 172.21.15.7:0/2083306972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab3c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.790+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 >> 172.21.15.7:0/2083306972 conn(0x55eebab386c0 msgr2=0x55eebab38aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.791+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 shutdown_connections 2024-04-23T15:38:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.791+0000 7fe1009d1740 1 -- 172.21.15.7:0/2083306972 wait complete. 2024-04-23T15:38:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.792+0000 7fe1009d1740 1 -- start start 2024-04-23T15:38:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.792+0000 7fe1009d1740 1 Processor -- start 2024-04-23T15:38:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.796+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab44370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.796+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.797+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 0x55eebab44df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.797+0000 7fe0f6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.797+0000 7fe0f6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:58304/0 (socket says 172.21.15.7:58304) 2024-04-23T15:38:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.798+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 0x55eebab44df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.798+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 0x55eebab44df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:60370/0 (socket says 172.21.15.7:60370) 2024-04-23T15:38:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.798+0000 7fe0f6000640 1 -- 172.21.15.7:0/1068503086 learned_addr learned my addr 172.21.15.7:0/1068503086 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.798+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab44370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.799+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eebab49fc0 con 0x55eebab3c1b0 2024-04-23T15:38:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.799+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eebaa5c2c0 con 0x55eebab47390 2024-04-23T15:38:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.799+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55eebab4a140 con 0x55eebab3cad0 2024-04-23T15:38:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.800+0000 7fe0f7400640 1 -- 172.21.15.7:0/1068503086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 msgr2=0x55eebab448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.800+0000 7fe0f7400640 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.800+0000 7fe0f7400640 1 -- 172.21.15.7:0/1068503086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 msgr2=0x55eebab44370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.800+0000 7fe0f7400640 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab44370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.800+0000 7fe0f7400640 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eebaa6cfd0 con 0x55eebab47390 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.801+0000 7fe0f7400640 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 0x55eebab44df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0f009adb0 tx=0x7fe0f0009720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7426075588c09e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.802+0000 7fe0e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.802+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1068503086 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00a0eb0 con 0x55eebab47390 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.802+0000 7fe1009d1740 10 client.0 _ll_register_callbacks cb 0x55eeba7b4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.802+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1068503086 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fe0f009cd60 con 0x55eebab47390 2024-04-23T15:38:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.802+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0f00a5770 con 0x55eebab47390 2024-04-23T15:38:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.804+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1068503086 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe0f009cf60 con 0x55eebab47390 2024-04-23T15:38:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.804+0000 7fe1009d1740 10 client.38192 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.804+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55eeba7b5210 con 0x55eebab47390 2024-04-23T15:38:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.805+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1068503086 <== mon.2 v2:172.21.15.137:3300/0 4 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe0f00a52e0 con 0x55eebab47390 2024-04-23T15:38:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe1009d1740 10 client.38192 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe1009d1740 10 client.38192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe1009d1740 20 client.38192 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebab56e50 0x55eebab59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe1009d1740 4 client.38192 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:38:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eebaab0320 con 0x55eebab56e50 2024-04-23T15:38:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.806+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebab56e50 0x55eebab59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.811+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebab56e50 0x55eebab59240 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60638758cb3de7d server_cookie=acb38d29cd25c8d5 in_seq=0 out_seq=0 2024-04-23T15:38:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.811+0000 7fe0e0c00640 10 client.38192 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.817+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1068503086 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eebaab0320 con 0x55eebab56e50 2024-04-23T15:38:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.817+0000 7fe0e0c00640 10 client.38192 handle_command_reply: tid=0 2024-04-23T15:38:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.817+0000 7fe1009d1740 1 client.38192 shutdown 2024-04-23T15:38:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.818+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 msgr2=0x55eebab44df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.818+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 0x55eebab44df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0f009adb0 tx=0x7fe0f0009720 comp rx=0 tx=0).stop 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 shutdown_connections 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebab56e50 0x55eebab59240 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab47390 0x55eebab44df0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1068503086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab3c1b0 0x55eebab44370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 >> 172.21.15.7:0/1068503086 conn(0x55eebab386c0 msgr2=0x55eebab3e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe0e0c00640 0 client.38192 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 shutdown_connections 2024-04-23T15:38:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.819+0000 7fe1009d1740 1 -- 172.21.15.7:0/1068503086 wait complete. 2024-04-23T15:38:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.820+0000 7fe1009d1740 20 client.38192 trim_cache size 0 max 16384 2024-04-23T15:38:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.860+0000 7fe1009d1740 1 Processor -- start 2024-04-23T15:38:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.860+0000 7fe1009d1740 1 -- start start 2024-04-23T15:38:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3c1b0 0x55eebab3ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab44c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab5e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe1009d1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f81c6a40 con 0x55eebab47390 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe1009d1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f81c8580 con 0x55eebab3c1b0 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe1009d1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f81c7110 con 0x55eebab3cad0 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab5e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab5e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44432/0 (socket says 172.21.15.7:44432) 2024-04-23T15:38:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.861+0000 7fe0f7400640 1 -- 172.21.15.7:0/112112942 learned_addr learned my addr 172.21.15.7:0/112112942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.862+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3c1b0 0x55eebab3ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.862+0000 7fe0f6000640 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab44c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f7400640 1 -- 172.21.15.7:0/112112942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 msgr2=0x55eebab44c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f7400640 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab44c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f7400640 1 -- 172.21.15.7:0/112112942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3c1b0 msgr2=0x55eebab3ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f7400640 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3c1b0 0x55eebab3ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f7400640 1 -- 172.21.15.7:0/112112942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeba881620 con 0x55eebab47390 2024-04-23T15:38:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3c1b0 0x55eebab3ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:38:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.863+0000 7fe0f7400640 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab5e8f0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c6a0 tx=0x7fe0f0098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57536a38edad0cb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.870+0000 7fe0e3400640 1 -- 172.21.15.7:0/112112942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00a0eb0 con 0x55eebab47390 2024-04-23T15:38:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.870+0000 7fe0e3400640 1 -- 172.21.15.7:0/112112942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0f00a5770 con 0x55eebab47390 2024-04-23T15:38:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.870+0000 7fe0e3400640 1 -- 172.21.15.7:0/112112942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0098ab0 con 0x55eebab47390 2024-04-23T15:38:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 -- 172.21.15.7:0/112112942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 msgr2=0x55eebab5e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab5e8f0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c6a0 tx=0x7fe0f0098000 comp rx=0 tx=0).stop 2024-04-23T15:38:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 -- 172.21.15.7:0/112112942 shutdown_connections 2024-04-23T15:38:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab5e8f0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3cad0 0x55eebab44c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 --2- 172.21.15.7:0/112112942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3c1b0 0x55eebab3ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.872+0000 7fe1009d1740 1 -- 172.21.15.7:0/112112942 >> 172.21.15.7:0/112112942 conn(0x55eebab386c0 msgr2=0x55eebab37840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:28.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.874+0000 7fe1009d1740 1 -- 172.21.15.7:0/112112942 shutdown_connections 2024-04-23T15:38:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.874+0000 7fe1009d1740 1 -- 172.21.15.7:0/112112942 wait complete. 2024-04-23T15:38:28.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.874+0000 7fe1009d1740 1 -- start start 2024-04-23T15:38:28.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.875+0000 7fe1009d1740 1 Processor -- start 2024-04-23T15:38:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3c1b0 0x55eebab41360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f81c7eb0 con 0x55eebab47390 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f81c77e0 con 0x55eebab3cad0 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f81c4a40 con 0x55eebab3c1b0 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe1009d1740 10 client.0 _ll_register_callbacks cb 0x7fe0f009c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe0f7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab41e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44442/0 (socket says 172.21.15.7:44442) 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.879+0000 7fe0f7400640 1 -- 172.21.15.7:0/1850476298 learned_addr learned my addr 172.21.15.7:0/1850476298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.880+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3c1b0 0x55eebab41360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.880+0000 7fe0f7400640 1 -- 172.21.15.7:0/1850476298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3c1b0 msgr2=0x55eebab41360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.880+0000 7fe0f7400640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3c1b0 0x55eebab41360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.880+0000 7fe0f6000640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.880+0000 7fe0f7400640 1 -- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 msgr2=0x55eebab418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.881+0000 7fe0f7400640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.881+0000 7fe0f7400640 1 -- 172.21.15.7:0/1850476298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eebabbc450 con 0x55eebab47390 2024-04-23T15:38:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.883+0000 7fe0f6000640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:38:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.884+0000 7fe0f7400640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab41e20 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00994d0 tx=0x7fe0f0098a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54d67908462af06 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.884+0000 7fe0e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:38:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.884+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1850476298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00a0eb0 con 0x55eebab47390 2024-04-23T15:38:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.884+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1850476298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fe0f009cd60 con 0x55eebab47390 2024-04-23T15:38:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.884+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0f00a5770 con 0x55eebab47390 2024-04-23T15:38:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.885+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1850476298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe0f009bbd0 con 0x55eebab47390 2024-04-23T15:38:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.885+0000 7fe1009d1740 10 client.19473 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.885+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55eebabbc450 con 0x55eebab47390 2024-04-23T15:38:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.887+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1850476298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0f0082020 con 0x55eebab47390 2024-04-23T15:38:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.888+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1850476298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe0f00872d0 con 0x55eebab47390 2024-04-23T15:38:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.889+0000 7fe1009d1740 10 client.19473 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.889+0000 7fe1009d1740 10 client.19473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.889+0000 7fe1009d1740 20 client.19473 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.889+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebabbda50 0x55eebabbfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.889+0000 7fe1009d1740 4 client.19473 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:38:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.889+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eebaaaa190 con 0x55eebabbda50 2024-04-23T15:38:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.891+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebabbda50 0x55eebabbfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:28.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.895+0000 7fe0f6a00640 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebabbda50 0x55eebabbfe40 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a81761748dc4143 server_cookie=c4d12ee96f7c665f in_seq=0 out_seq=0 2024-04-23T15:38:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:28.895+0000 7fe0e0c00640 10 client.19473 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:29.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:28 smithi137 ceph-mon[31694]: pgmap v1496: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 3.10k op/s 2024-04-23T15:38:29.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:28 smithi007 ceph-mon[27906]: pgmap v1496: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 3.10k op/s 2024-04-23T15:38:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:28 smithi186 ceph-mon[31814]: pgmap v1496: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 3.10k op/s 2024-04-23T15:38:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.569+0000 7fe0e0c00640 1 -- 172.21.15.7:0/1850476298 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eebaaaa190 con 0x55eebabbda50 2024-04-23T15:38:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.569+0000 7fe0e0c00640 10 client.19473 handle_command_reply: tid=0 2024-04-23T15:38:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.569+0000 7fe1009d1740 1 client.19473 shutdown 2024-04-23T15:38:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.569+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 msgr2=0x55eebab41e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab41e20 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00994d0 tx=0x7fe0f0098a80 comp rx=0 tx=0).stop 2024-04-23T15:38:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 shutdown_connections 2024-04-23T15:38:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55eebabbda50 0x55eebabbfe40 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe0e0c00640 0 client.19473 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eebab3cad0 0x55eebab418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eebab47390 0x55eebab41e20 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 --2- 172.21.15.7:0/1850476298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eebab3c1b0 0x55eebab41360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.570+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 >> 172.21.15.7:0/1850476298 conn(0x55eebab386c0 msgr2=0x55eebab45ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.571+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 shutdown_connections 2024-04-23T15:38:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.571+0000 7fe1009d1740 1 -- 172.21.15.7:0/1850476298 wait complete. 2024-04-23T15:38:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.571+0000 7fe1009d1740 20 client.19473 trim_cache size 0 max 16384 2024-04-23T15:38:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:38:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:38:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:38:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.572+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe0dc0a3ff0 msgr2=0x7fe0dc0a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe0dc0a3ff0 0x7fe0dc0a64b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe0f81a7ff0 tx=0x7fe0e4005f90 comp rx=0 tx=0).stop 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 msgr2=0x7fe0f810be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 0x7fe0f810be60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e970 tx=0x7fe0f000ed70 comp rx=0 tx=0).stop 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 shutdown_connections 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe0dc0a3ff0 0x7fe0dc0a64b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f8115150 0x7fe0f810be60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0f8109920 0x7fe0f8114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 --2- 172.21.15.7:0/3421023686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f8109000 0x7fe0f8114550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.573+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 >> 172.21.15.7:0/3421023686 conn(0x7fe0f806d0d0 msgr2=0x7fe0f810a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.574+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 shutdown_connections 2024-04-23T15:38:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:29.574+0000 7fe0fdc00640 1 -- 172.21.15.7:0/3421023686 wait complete. 2024-04-23T15:38:31.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:30 smithi137 ceph-mon[31694]: pgmap v1497: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:38:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:38:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:38:31.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:30 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:38:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:30 smithi007 ceph-mon[27906]: pgmap v1497: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:38:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:38:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:38:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:30 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:38:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:30 smithi186 ceph-mon[31814]: pgmap v1497: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:38:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:38:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:38:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:30 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:38:33.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:32 smithi137 ceph-mon[31694]: pgmap v1498: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 3.41k op/s 2024-04-23T15:38:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:32 smithi007 ceph-mon[27906]: pgmap v1498: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 3.41k op/s 2024-04-23T15:38:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:32 smithi186 ceph-mon[31814]: pgmap v1498: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 3.41k op/s 2024-04-23T15:38:35.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:34 smithi137 ceph-mon[31694]: pgmap v1499: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-04-23T15:38:35.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:34 smithi007 ceph-mon[27906]: pgmap v1499: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-04-23T15:38:35.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:34 smithi186 ceph-mon[31814]: pgmap v1499: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-04-23T15:38:37.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:36 smithi137 ceph-mon[31694]: pgmap v1500: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-04-23T15:38:37.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:36 smithi007 ceph-mon[27906]: pgmap v1500: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-04-23T15:38:37.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:36 smithi186 ceph-mon[31814]: pgmap v1500: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-04-23T15:38:39.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:38 smithi137 ceph-mon[31694]: pgmap v1501: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:38:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:38 smithi007 ceph-mon[27906]: pgmap v1501: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:38:39.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:38 smithi186 ceph-mon[31814]: pgmap v1501: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:38:41.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:40 smithi007 ceph-mon[27906]: pgmap v1502: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 1.40k op/s 2024-04-23T15:38:41.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:40 smithi137 ceph-mon[31694]: pgmap v1502: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 1.40k op/s 2024-04-23T15:38:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:40 smithi186 ceph-mon[31814]: pgmap v1502: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 1.40k op/s 2024-04-23T15:38:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.870+0000 7fb04a600640 1 -- 172.21.15.7:0/3751724956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c098b00 msgr2=0x7fb03c09cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.870+0000 7fb04a600640 1 --2- 172.21.15.7:0/3751724956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c098b00 0x7fb03c09cb40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb030009900 tx=0x7fb03002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.874+0000 7fb04a600640 1 -- 172.21.15.7:0/3751724956 shutdown_connections 2024-04-23T15:38:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.874+0000 7fb04a600640 1 --2- 172.21.15.7:0/3751724956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c09d220 0x7fb03c0a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.874+0000 7fb04a600640 1 --2- 172.21.15.7:0/3751724956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c098b00 0x7fb03c09cb40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.874+0000 7fb04a600640 1 --2- 172.21.15.7:0/3751724956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb03c098150 0x7fb03c098530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.874+0000 7fb04a600640 1 -- 172.21.15.7:0/3751724956 >> 172.21.15.7:0/3751724956 conn(0x7fb03c0939f0 msgr2=0x7fb03c095e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.875+0000 7fb04a600640 1 -- 172.21.15.7:0/3751724956 shutdown_connections 2024-04-23T15:38:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.875+0000 7fb04a600640 1 -- 172.21.15.7:0/3751724956 wait complete. 2024-04-23T15:38:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.876+0000 7fb04a600640 1 Processor -- start 2024-04-23T15:38:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.879+0000 7fb04a600640 1 -- start start 2024-04-23T15:38:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.881+0000 7fb04a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 0x7fb03c12e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.881+0000 7fb04a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c09d220 0x7fb03c12ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.881+0000 7fb04a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb03c132f50 0x7fb03c133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.881+0000 7fb04a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c0a8190 con 0x7fb03c132f50 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.881+0000 7fb04a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c0a8010 con 0x7fb03c098150 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.881+0000 7fb04a600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c0a8310 con 0x7fb03c09d220 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.882+0000 7fb049200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 0x7fb03c12e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.882+0000 7fb049200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 0x7fb03c12e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:50394/0 (socket says 172.21.15.7:50394) 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.882+0000 7fb049200640 1 -- 172.21.15.7:0/1833668246 learned_addr learned my addr 172.21.15.7:0/1833668246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.882+0000 7fb043e00640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c09d220 0x7fb03c12ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.882+0000 7fb04bc00640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb03c132f50 0x7fb03c133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.883+0000 7fb043e00640 1 -- 172.21.15.7:0/1833668246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 msgr2=0x7fb03c12e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.883+0000 7fb043e00640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 0x7fb03c12e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.883+0000 7fb043e00640 1 -- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb03c132f50 msgr2=0x7fb03c133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.883+0000 7fb043e00640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb03c132f50 0x7fb03c133400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.884+0000 7fb043e00640 1 -- 172.21.15.7:0/1833668246 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c133a40 con 0x7fb03c09d220 2024-04-23T15:38:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.884+0000 7fb049200640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 0x7fb03c12e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:38:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.884+0000 7fb043e00640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c09d220 0x7fb03c12ebd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb030009850 tx=0x7fb030003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:42.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.885+0000 7fb041600640 1 -- 172.21.15.7:0/1833668246 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03003f070 con 0x7fb03c09d220 2024-04-23T15:38:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.886+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c133cd0 con 0x7fb03c09d220 2024-04-23T15:38:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.887+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c13b490 con 0x7fb03c09d220 2024-04-23T15:38:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.886+0000 7fb041600640 1 -- 172.21.15.7:0/1833668246 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb030031d60 con 0x7fb03c09d220 2024-04-23T15:38:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.889+0000 7fb041600640 1 -- 172.21.15.7:0/1833668246 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030035030 con 0x7fb03c09d220 2024-04-23T15:38:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.901+0000 7fb041600640 1 -- 172.21.15.7:0/1833668246 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb030042070 con 0x7fb03c09d220 2024-04-23T15:38:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.903+0000 7fb041600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb02c0a3de0 0x7fb02c0a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.905+0000 7fb04ebb5740 1 Processor -- start 2024-04-23T15:38:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.905+0000 7fb04ebb5740 1 -- start start 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb049200640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb02c0a3de0 0x7fb02c0a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 0x55d7d0ce1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7d0c34900 con 0x55d7d0cce300 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d7d0bdaf20 con 0x55d7d0ce1db0 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.906+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d7d0c308c0 con 0x55d7d0ccec20 2024-04-23T15:38:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.907+0000 7fb043e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 0x55d7d0ce1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.907+0000 7fb043e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 0x55d7d0ce1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:34144/0 (socket says 172.21.15.7:34144) 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.907+0000 7fb043e00640 1 -- 172.21.15.7:0/513126134 learned_addr learned my addr 172.21.15.7:0/513126134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.908+0000 7fb04bc00640 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.908+0000 7fb043e00640 1 -- 172.21.15.7:0/513126134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 msgr2=0x55d7d0ce41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.908+0000 7fb043e00640 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.908+0000 7fb043e00640 1 -- 172.21.15.7:0/513126134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 msgr2=0x55d7d0cce6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:38:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.908+0000 7fb043e00640 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cce6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.908+0000 7fb043e00640 1 -- 172.21.15.7:0/513126134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d0bffe10 con 0x55d7d0ccec20 2024-04-23T15:38:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.910+0000 7fb043e00640 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 0x55d7d0ce1870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0300bcdb0 tx=0x7fb0300c22f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b8551902d83683 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.910+0000 7fb041600640 1 -- 172.21.15.7:0/1833668246 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fb0300baec0 con 0x7fb03c09d220 2024-04-23T15:38:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.912+0000 7fb036000640 1 -- 172.21.15.7:0/513126134 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300b9850 con 0x55d7d0ccec20 2024-04-23T15:38:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.912+0000 7fb036000640 1 -- 172.21.15.7:0/513126134 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb03003de80 con 0x55d7d0ccec20 2024-04-23T15:38:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.912+0000 7fb036000640 1 -- 172.21.15.7:0/513126134 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300b99f0 con 0x55d7d0ccec20 2024-04-23T15:38:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.913+0000 7fb04ebb5740 1 -- 172.21.15.7:0/513126134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 msgr2=0x55d7d0ce1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.913+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 0x55d7d0ce1870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0300bcdb0 tx=0x7fb0300c22f0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.913+0000 7fb049200640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb02c0a3de0 0x7fb02c0a62a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb044050b40 tx=0x7fb044050d00 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.915+0000 7fb04ebb5740 1 -- 172.21.15.7:0/513126134 shutdown_connections 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.915+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.915+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ccec20 0x55d7d0ce1870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.915+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/513126134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.915+0000 7fb04ebb5740 1 -- 172.21.15.7:0/513126134 >> 172.21.15.7:0/513126134 conn(0x55d7d0cca8d0 msgr2=0x55d7d0ccacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.916+0000 7fb04ebb5740 1 -- 172.21.15.7:0/513126134 shutdown_connections 2024-04-23T15:38:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.916+0000 7fb04ebb5740 1 -- 172.21.15.7:0/513126134 wait complete. 2024-04-23T15:38:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.917+0000 7fb04ebb5740 1 -- start start 2024-04-23T15:38:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.917+0000 7fb04ebb5740 1 Processor -- start 2024-04-23T15:38:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.918+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cdb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.918+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cdbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.918+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.918+0000 7fb043e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cdbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.918+0000 7fb043e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cdbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:50416/0 (socket says 172.21.15.7:50416) 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb049200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cdb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb049200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cdb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52096/0 (socket says 172.21.15.7:52096) 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7d0c308c0 con 0x55d7d0cce300 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d7d0bee2c0 con 0x55d7d0ccec20 2024-04-23T15:38:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d7d0cd1060 con 0x55d7d0ce1db0 2024-04-23T15:38:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04bc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04bc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:34156/0 (socket says 172.21.15.7:34156) 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04bc00640 1 -- 172.21.15.7:0/588689396 learned_addr learned my addr 172.21.15.7:0/588689396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.919+0000 7fb04ebb5740 10 client.0 _ll_register_callbacks cb 0x55d7d0946a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.920+0000 7fb04bc00640 1 -- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 msgr2=0x55d7d0cdbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.920+0000 7fb04bc00640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cdbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.920+0000 7fb04bc00640 1 -- 172.21.15.7:0/588689396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 msgr2=0x55d7d0cdb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.920+0000 7fb04bc00640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cdb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.920+0000 7fb04bc00640 1 -- 172.21.15.7:0/588689396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d0bfefd0 con 0x55d7d0ce1db0 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.921+0000 7fb043e00640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cdbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.921+0000 7fb049200640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cdb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.921+0000 7fb02aa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.921+0000 7fb04bc00640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce12b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0380106d0 tx=0x7fb038010ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb2df804815ba90 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.921+0000 7fb02aa00640 1 -- 172.21.15.7:0/588689396 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03800ca40 con 0x55d7d0ce1db0 2024-04-23T15:38:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.921+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb03003de80 con 0x55d7d0ce1db0 2024-04-23T15:38:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.922+0000 7fb02aa00640 1 -- 172.21.15.7:0/588689396 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fb03800c840 con 0x55d7d0ce1db0 2024-04-23T15:38:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.924+0000 7fb02aa00640 1 -- 172.21.15.7:0/588689396 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb03800ca40 con 0x55d7d0ce1db0 2024-04-23T15:38:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.924+0000 7fb04ebb5740 10 client.28327 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.924+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d7d0947210 con 0x55d7d0ce1db0 2024-04-23T15:38:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.925+0000 7fb02aa00640 1 -- 172.21.15.7:0/588689396 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb03003de80 con 0x55d7d0ce1db0 2024-04-23T15:38:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.925+0000 7fb02aa00640 1 -- 172.21.15.7:0/588689396 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb0380038e0 con 0x55d7d0ce1db0 2024-04-23T15:38:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.926+0000 7fb04ebb5740 10 client.28327 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.926+0000 7fb04ebb5740 10 client.28327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.926+0000 7fb04ebb5740 20 client.28327 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.926+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0cfa560 0x55d7d0cfc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.926+0000 7fb04ebb5740 4 client.28327 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:38:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.926+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7d0c42320 con 0x55d7d0cfa560 2024-04-23T15:38:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.927+0000 7fb049200640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0cfa560 0x55d7d0cfc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.928+0000 7fb049200640 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0cfa560 0x55d7d0cfc9c0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a543c2ed72727e6 server_cookie=f20dd62f0c9dc102 in_seq=0 out_seq=0 2024-04-23T15:38:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.929+0000 7fb02aa00640 10 client.28327 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.930+0000 7fb02aa00640 1 -- 172.21.15.7:0/588689396 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d7d0c42320 con 0x55d7d0cfa560 2024-04-23T15:38:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.930+0000 7fb02aa00640 10 client.28327 handle_command_reply: tid=0 2024-04-23T15:38:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.930+0000 7fb04ebb5740 1 client.28327 shutdown 2024-04-23T15:38:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.939+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 msgr2=0x55d7d0ce12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.939+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce12b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0380106d0 tx=0x7fb038010ad0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.939+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 shutdown_connections 2024-04-23T15:38:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.939+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0cfa560 0x55d7d0cfc9c0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.939+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cdbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.940+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0ce1db0 0x55d7d0ce12b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.940+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/588689396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0cce300 0x55d7d0cdb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.940+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 >> 172.21.15.7:0/588689396 conn(0x55d7d0cca8d0 msgr2=0x55d7d0cd0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.940+0000 7fb02aa00640 0 client.28327 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.941+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 shutdown_connections 2024-04-23T15:38:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.941+0000 7fb04ebb5740 1 -- 172.21.15.7:0/588689396 wait complete. 2024-04-23T15:38:42.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:42.941+0000 7fb04ebb5740 20 client.28327 trim_cache size 0 max 16384 2024-04-23T15:38:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.014+0000 7fb04ebb5740 1 Processor -- start 2024-04-23T15:38:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.015+0000 7fb04ebb5740 1 -- start start 2024-04-23T15:38:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.016+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.016+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ccec20 0x55d7d0cc9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.017+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d02290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.017+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb024010020 con 0x55d7d0ccec20 2024-04-23T15:38:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.017+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb024011b60 con 0x55d7d0ce1db0 2024-04-23T15:38:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.017+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240106f0 con 0x55d7d0cce300 2024-04-23T15:38:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.018+0000 7fb04bc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d02290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.018+0000 7fb04bc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d02290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:50418/0 (socket says 172.21.15.7:50418) 2024-04-23T15:38:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.018+0000 7fb049200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.019+0000 7fb043e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ccec20 0x55d7d0cc9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.019+0000 7fb049200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:34158/0 (socket says 172.21.15.7:34158) 2024-04-23T15:38:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.019+0000 7fb049200640 1 -- 172.21.15.7:0/3158011166 learned_addr learned my addr 172.21.15.7:0/3158011166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.020+0000 7fb043e00640 1 -- 172.21.15.7:0/3158011166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 msgr2=0x55d7d0cd5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.020+0000 7fb043e00640 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.020+0000 7fb043e00640 1 -- 172.21.15.7:0/3158011166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 msgr2=0x55d7d0d02290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.020+0000 7fb043e00640 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d02290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.021+0000 7fb043e00640 1 -- 172.21.15.7:0/3158011166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d0a13620 con 0x55d7d0ccec20 2024-04-23T15:38:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.021+0000 7fb04bc00640 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d02290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:38:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.022+0000 7fb043e00640 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ccec20 0x55d7d0cc9910 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb0300b9280 tx=0x7fb030031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb1b7371c2276c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.023+0000 7fb035600640 1 -- 172.21.15.7:0/3158011166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300d5030 con 0x55d7d0ccec20 2024-04-23T15:38:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.024+0000 7fb035600640 1 -- 172.21.15.7:0/3158011166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0300d6040 con 0x55d7d0ccec20 2024-04-23T15:38:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.024+0000 7fb035600640 1 -- 172.21.15.7:0/3158011166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300d5030 con 0x55d7d0ccec20 2024-04-23T15:38:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.025+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3158011166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ccec20 msgr2=0x55d7d0cc9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.025+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ccec20 0x55d7d0cc9910 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb0300b9280 tx=0x7fb030031f10 comp rx=0 tx=0).stop 2024-04-23T15:38:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.026+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3158011166 shutdown_connections 2024-04-23T15:38:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.026+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d02290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.026+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ccec20 0x55d7d0cc9910 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.027+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3158011166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.027+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3158011166 >> 172.21.15.7:0/3158011166 conn(0x55d7d0cca8d0 msgr2=0x55d7d0cc9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.027+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3158011166 shutdown_connections 2024-04-23T15:38:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.028+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3158011166 wait complete. 2024-04-23T15:38:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.031+0000 7fb04ebb5740 1 -- start start 2024-04-23T15:38:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.032+0000 7fb04ebb5740 1 Processor -- start 2024-04-23T15:38:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.033+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.033+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cd3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb049200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb043e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cd3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb04ebb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d5f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb024011490 con 0x55d7d0ce1db0 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb024010dc0 con 0x55d7d0ccec20 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb04ebb5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb02400dfc0 con 0x55d7d0cce300 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb04ebb5740 10 client.0 _ll_register_callbacks cb 0x7fb038005f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.034+0000 7fb049200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:34162/0 (socket says 172.21.15.7:34162) 2024-04-23T15:38:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.035+0000 7fb049200640 1 -- 172.21.15.7:0/3202450909 learned_addr learned my addr 172.21.15.7:0/3202450909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.036+0000 7fb04bc00640 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d5f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.037+0000 7fb049200640 1 -- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 msgr2=0x55d7d0cd3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.037+0000 7fb049200640 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cd3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.037+0000 7fb049200640 1 -- 172.21.15.7:0/3202450909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ce1db0 msgr2=0x55d7d0d5f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.037+0000 7fb049200640 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d5f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.037+0000 7fb049200640 1 -- 172.21.15.7:0/3202450909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d0d5fb20 con 0x55d7d0cce300 2024-04-23T15:38:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.038+0000 7fb049200640 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd3a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb044051740 tx=0x7fb04406b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344925aa8b6bdbb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.039+0000 7fb02aa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:38:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.040+0000 7fb02aa00640 1 -- 172.21.15.7:0/3202450909 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440942e0 con 0x55d7d0cce300 2024-04-23T15:38:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.041+0000 7fb02aa00640 1 -- 172.21.15.7:0/3202450909 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fb044094480 con 0x55d7d0cce300 2024-04-23T15:38:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.042+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0300d6040 con 0x55d7d0cce300 2024-04-23T15:38:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.043+0000 7fb02aa00640 1 -- 172.21.15.7:0/3202450909 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb044083eb0 con 0x55d7d0cce300 2024-04-23T15:38:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.043+0000 7fb04ebb5740 10 client.28333 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.043+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d7d0d60d50 con 0x55d7d0cce300 2024-04-23T15:38:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.044+0000 7fb02aa00640 1 -- 172.21.15.7:0/3202450909 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0300d6040 con 0x55d7d0cce300 2024-04-23T15:38:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.044+0000 7fb02aa00640 1 -- 172.21.15.7:0/3202450909 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb044076420 con 0x55d7d0cce300 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.045+0000 7fb04ebb5740 10 client.28333 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.045+0000 7fb04ebb5740 10 client.28333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.045+0000 7fb04ebb5740 20 client.28333 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.045+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0d61420 0x55d7d0d638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.045+0000 7fb04ebb5740 4 client.28333 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.045+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7d0c3c190 con 0x55d7d0d61420 2024-04-23T15:38:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.046+0000 7fb043e00640 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0d61420 0x55d7d0d638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.049+0000 7fb043e00640 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0d61420 0x55d7d0d638e0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910c5f93427e7b77 server_cookie=82282c432e45656b in_seq=0 out_seq=0 2024-04-23T15:38:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:43.049+0000 7fb02aa00640 10 client.28333 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:43.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:42 smithi137 ceph-mon[31694]: pgmap v1503: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:38:43.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:42 smithi007 ceph-mon[27906]: pgmap v1503: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:38:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:42 smithi186 ceph-mon[31814]: pgmap v1503: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:38:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.360+0000 7fb02aa00640 1 -- 172.21.15.7:0/3202450909 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7d0c3c190 con 0x55d7d0d61420 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.360+0000 7fb02aa00640 10 client.28333 handle_command_reply: tid=0 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.360+0000 7fb04ebb5740 1 client.28333 shutdown 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.361+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 msgr2=0x55d7d0cd3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.361+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd3a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb044051740 tx=0x7fb04406b9b0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.361+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 shutdown_connections 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.362+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d7d0d61420 0x55d7d0d638e0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.362+0000 7fb02aa00640 0 client.28333 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.362+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7d0ccec20 0x55d7d0cd3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.362+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7d0ce1db0 0x55d7d0d5f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.362+0000 7fb04ebb5740 1 --2- 172.21.15.7:0/3202450909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d7d0cce300 0x55d7d0cd3a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.362+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 >> 172.21.15.7:0/3202450909 conn(0x55d7d0cca8d0 msgr2=0x55d7d0cc9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:44.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.364+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 shutdown_connections 2024-04-23T15:38:44.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.364+0000 7fb04ebb5740 1 -- 172.21.15.7:0/3202450909 wait complete. 2024-04-23T15:38:44.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.364+0000 7fb04ebb5740 20 client.28333 trim_cache size 0 max 16384 2024-04-23T15:38:44.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:38:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:38:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:38:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:38:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.366+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb02c0a3de0 msgr2=0x7fb02c0a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.366+0000 7fb04a600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb02c0a3de0 0x7fb02c0a62a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb044050b40 tx=0x7fb044050d00 comp rx=0 tx=0).stop 2024-04-23T15:38:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c09d220 msgr2=0x7fb03c12ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c09d220 0x7fb03c12ebd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb030009850 tx=0x7fb030003d60 comp rx=0 tx=0).stop 2024-04-23T15:38:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 shutdown_connections 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb02c0a3de0 0x7fb02c0a62a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb03c132f50 0x7fb03c133400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb03c09d220 0x7fb03c12ebd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 --2- 172.21.15.7:0/1833668246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb03c098150 0x7fb03c12e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.367+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 >> 172.21.15.7:0/1833668246 conn(0x7fb03c0939f0 msgr2=0x7fb03c095d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.368+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 shutdown_connections 2024-04-23T15:38:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:44.368+0000 7fb04a600640 1 -- 172.21.15.7:0/1833668246 wait complete. 2024-04-23T15:38:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:44 smithi007 ceph-mon[27906]: pgmap v1504: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 1.99k op/s 2024-04-23T15:38:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:44 smithi186 ceph-mon[31814]: pgmap v1504: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 1.99k op/s 2024-04-23T15:38:45.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:44 smithi137 ceph-mon[31694]: pgmap v1504: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.8 MiB/s wr, 1.99k op/s 2024-04-23T15:38:47.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:46 smithi007 ceph-mon[27906]: pgmap v1505: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.4 MiB/s wr, 1.88k op/s 2024-04-23T15:38:47.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:46 smithi186 ceph-mon[31814]: pgmap v1505: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.4 MiB/s wr, 1.88k op/s 2024-04-23T15:38:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:46 smithi137 ceph-mon[31694]: pgmap v1505: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.4 MiB/s wr, 1.88k op/s 2024-04-23T15:38:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:48 smithi007 ceph-mon[27906]: pgmap v1506: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 3.32k op/s 2024-04-23T15:38:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:48 smithi186 ceph-mon[31814]: pgmap v1506: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 3.32k op/s 2024-04-23T15:38:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:48 smithi137 ceph-mon[31694]: pgmap v1506: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 3.32k op/s 2024-04-23T15:38:51.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:50 smithi007 ceph-mon[27906]: pgmap v1507: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:38:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:50 smithi186 ceph-mon[31814]: pgmap v1507: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:38:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:50 smithi137 ceph-mon[31694]: pgmap v1507: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:38:53.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:52 smithi007 ceph-mon[27906]: pgmap v1508: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 3.81k op/s 2024-04-23T15:38:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:52 smithi186 ceph-mon[31814]: pgmap v1508: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 3.81k op/s 2024-04-23T15:38:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:52 smithi137 ceph-mon[31694]: pgmap v1508: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 3.81k op/s 2024-04-23T15:38:55.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:54 smithi007 ceph-mon[27906]: pgmap v1509: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-04-23T15:38:55.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:54 smithi186 ceph-mon[31814]: pgmap v1509: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-04-23T15:38:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:54 smithi137 ceph-mon[31694]: pgmap v1509: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-04-23T15:38:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:56 smithi007 ceph-mon[27906]: pgmap v1510: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-04-23T15:38:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:56 smithi186 ceph-mon[31814]: pgmap v1510: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-04-23T15:38:57.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:56 smithi137 ceph-mon[31694]: pgmap v1510: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-04-23T15:38:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.330+0000 7fee85400640 1 -- 172.21.15.7:0/1387778506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee780959d0 msgr2=0x7fee780a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.330+0000 7fee85400640 1 --2- 172.21.15.7:0/1387778506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee780959d0 0x7fee780a1a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fee80067770 tx=0x7fee80096810 comp rx=0 tx=0).stop 2024-04-23T15:38:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.332+0000 7fee85400640 1 -- 172.21.15.7:0/1387778506 shutdown_connections 2024-04-23T15:38:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.333+0000 7fee85400640 1 --2- 172.21.15.7:0/1387778506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee780959d0 0x7fee780a1a80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.333+0000 7fee85400640 1 --2- 172.21.15.7:0/1387778506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee78095030 0x7fee78095490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.333+0000 7fee85400640 1 --2- 172.21.15.7:0/1387778506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7809ac70 0x7fee7809b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.333+0000 7fee85400640 1 -- 172.21.15.7:0/1387778506 >> 172.21.15.7:0/1387778506 conn(0x7fee7800a740 msgr2=0x7fee7800ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.334+0000 7fee85400640 1 -- 172.21.15.7:0/1387778506 shutdown_connections 2024-04-23T15:38:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.334+0000 7fee85400640 1 -- 172.21.15.7:0/1387778506 wait complete. 2024-04-23T15:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.336+0000 7fee85400640 1 Processor -- start 2024-04-23T15:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.336+0000 7fee85400640 1 -- start start 2024-04-23T15:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.336+0000 7fee85400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee78095030 0x7fee7812c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.337+0000 7fee85400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee780959d0 0x7fee7812c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.337+0000 7fee7fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee78095030 0x7fee7812c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.337+0000 7fee7fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee78095030 0x7fee7812c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:37766/0 (socket says 172.21.15.7:37766) 2024-04-23T15:38:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.337+0000 7fee7fe00640 1 -- 172.21.15.7:0/693349864 learned_addr learned my addr 172.21.15.7:0/693349864 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.338+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7809ac70 0x7fee78130c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.338+0000 7fee7f400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee780959d0 0x7fee7812c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.339+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee780a5e70 con 0x7fee780959d0 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.339+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee780a5cf0 con 0x7fee78095030 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.339+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee780a5ff0 con 0x7fee7809ac70 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.339+0000 7fee86a00640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7809ac70 0x7fee78130c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.340+0000 7fee7f400640 1 -- 172.21.15.7:0/693349864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7809ac70 msgr2=0x7fee78130c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.340+0000 7fee7f400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7809ac70 0x7fee78130c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.340+0000 7fee7f400640 1 -- 172.21.15.7:0/693349864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee78095030 msgr2=0x7fee7812c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.340+0000 7fee7f400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee78095030 0x7fee7812c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.340+0000 7fee7f400640 1 -- 172.21.15.7:0/693349864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee781313a0 con 0x7fee780959d0 2024-04-23T15:38:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.342+0000 7fee7f400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee780959d0 0x7fee7812c8f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fee7400e9f0 tx=0x7fee7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.342+0000 7fee7cc00640 1 -- 172.21.15.7:0/693349864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7400ccc0 con 0x7fee780959d0 2024-04-23T15:38:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.342+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee78131690 con 0x7fee780959d0 2024-04-23T15:38:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.342+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee78138f20 con 0x7fee780959d0 2024-04-23T15:38:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.343+0000 7fee7cc00640 1 -- 172.21.15.7:0/693349864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee740108e0 con 0x7fee780959d0 2024-04-23T15:38:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.343+0000 7fee7cc00640 1 -- 172.21.15.7:0/693349864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74026060 con 0x7fee780959d0 2024-04-23T15:38:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.347+0000 7fee7cc00640 1 -- 172.21.15.7:0/693349864 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fee740187a0 con 0x7fee780959d0 2024-04-23T15:38:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.349+0000 7fee7cc00640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee680a3de0 0x7fee680a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.349+0000 7fee7cc00640 1 -- 172.21.15.7:0/693349864 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fee740d1ef0 con 0x7fee780959d0 2024-04-23T15:38:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.353+0000 7fee7fe00640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee680a3de0 0x7fee680a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.353+0000 7fee89831740 1 Processor -- start 2024-04-23T15:38:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.354+0000 7fee89831740 1 -- start start 2024-04-23T15:38:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.356+0000 7fee89831740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.356+0000 7fee89831740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd9d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.356+0000 7fee89831740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd9f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.356+0000 7fee89831740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ccf8900 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.356+0000 7fee89831740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed9cc9ef20 con 0x55ed9cd923c0 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.356+0000 7fee89831740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ccf48c0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.357+0000 7fee86a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd9f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.357+0000 7fee86a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd9f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33900/0 (socket says 172.21.15.7:33900) 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.357+0000 7fee86a00640 1 -- 172.21.15.7:0/4077453979 learned_addr learned my addr 172.21.15.7:0/4077453979 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:58.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.357+0000 7fee7f400640 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd9d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.359+0000 7fee7f400640 1 -- 172.21.15.7:0/4077453979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 msgr2=0x55ed9cd927a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:38:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.359+0000 7fee7f400640 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd927a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.359+0000 7fee7f400640 1 -- 172.21.15.7:0/4077453979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 msgr2=0x55ed9cd9f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.359+0000 7fee7f400640 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd9f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.359+0000 7fee7f400640 1 -- 172.21.15.7:0/4077453979 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9ccc3e10 con 0x55ed9cd92ce0 2024-04-23T15:38:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.361+0000 7fee7f400640 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd9d060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fee740cf230 tx=0x7fee7409db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fc6d957f11783 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.361+0000 7fee6d200640 1 -- 172.21.15.7:0/4077453979 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740be0c0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.361+0000 7fee6d200640 1 -- 172.21.15.7:0/4077453979 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee740cf4b0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee6d200640 1 -- 172.21.15.7:0/4077453979 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740be0c0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 -- 172.21.15.7:0/4077453979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 msgr2=0x55ed9cd9d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd9d060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fee740cf230 tx=0x7fee7409db40 comp rx=0 tx=0).stop 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee7fe00640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee680a3de0 0x7fee680a62a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee70009ba0 tx=0x7fee70005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 -- 172.21.15.7:0/4077453979 shutdown_connections 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd9f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd9d060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 --2- 172.21.15.7:0/4077453979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 -- 172.21.15.7:0/4077453979 >> 172.21.15.7:0/4077453979 conn(0x55ed9cd8e8d0 msgr2=0x55ed9cd8ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 -- 172.21.15.7:0/4077453979 shutdown_connections 2024-04-23T15:38:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.362+0000 7fee89831740 1 -- 172.21.15.7:0/4077453979 wait complete. 2024-04-23T15:38:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.363+0000 7fee89831740 1 -- start start 2024-04-23T15:38:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.363+0000 7fee89831740 1 Processor -- start 2024-04-23T15:38:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd923c0 0x55ed9cd9cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd95fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd96520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ed9cda4570 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ccb22c0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ed9cda46f0 con 0x55ed9cd923c0 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.364+0000 7fee89831740 10 client.0 _ll_register_callbacks cb 0x55ed9ca0aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.365+0000 7fee7f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd95fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.365+0000 7fee7f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd95fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:37772/0 (socket says 172.21.15.7:37772) 2024-04-23T15:38:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.365+0000 7fee7f400640 1 -- 172.21.15.7:0/3254069005 learned_addr learned my addr 172.21.15.7:0/3254069005 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee7f400640 1 -- 172.21.15.7:0/3254069005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd923c0 msgr2=0x55ed9cd9cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee7f400640 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd923c0 0x55ed9cd9cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee7f400640 1 -- 172.21.15.7:0/3254069005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 msgr2=0x55ed9cd96520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:38:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee7f400640 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd96520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee7f400640 1 -- 172.21.15.7:0/3254069005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9ccc2fd0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee7f400640 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd95fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee7409da10 tx=0x7fee74000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5cb36c229ececc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.366+0000 7fee61600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:38:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.367+0000 7fee61600640 1 -- 172.21.15.7:0/3254069005 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740b6070 con 0x55ed9cd92ce0 2024-04-23T15:38:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.367+0000 7fee61600640 1 -- 172.21.15.7:0/3254069005 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fee74010430 con 0x55ed9cd92ce0 2024-04-23T15:38:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.367+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee740cf4b0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.369+0000 7fee61600640 1 -- 172.21.15.7:0/3254069005 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fee74010630 con 0x55ed9cd92ce0 2024-04-23T15:38:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.369+0000 7fee89831740 10 client.38216 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.369+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ed9ca0b210 con 0x55ed9cd92ce0 2024-04-23T15:38:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.370+0000 7fee61600640 1 -- 172.21.15.7:0/3254069005 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee740cf4b0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.371+0000 7fee61600640 1 -- 172.21.15.7:0/3254069005 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fee74088190 con 0x55ed9cd92ce0 2024-04-23T15:38:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.371+0000 7fee89831740 10 client.38216 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.372+0000 7fee89831740 10 client.38216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.372+0000 7fee89831740 20 client.38216 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:58.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.372+0000 7fee89831740 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9cdb8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.372+0000 7fee89831740 4 client.38216 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:38:58.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.372+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed9cd06320 con 0x55ed9cdb5d10 2024-04-23T15:38:58.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.373+0000 7fee7fe00640 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9cdb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.374+0000 7fee7fe00640 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9cdb8100 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7eb355126809e1 server_cookie=8a8b4c25d43d8cfe in_seq=0 out_seq=0 2024-04-23T15:38:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.374+0000 7fee61600640 10 client.38216 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.375+0000 7fee61600640 1 -- 172.21.15.7:0/3254069005 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ed9cd06320 con 0x55ed9cdb5d10 2024-04-23T15:38:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.375+0000 7fee61600640 10 client.38216 handle_command_reply: tid=0 2024-04-23T15:38:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.375+0000 7fee89831740 1 client.38216 shutdown 2024-04-23T15:38:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.376+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 msgr2=0x55ed9cd95fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.376+0000 7fee89831740 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd95fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee7409da10 tx=0x7fee74000bc0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 shutdown_connections 2024-04-23T15:38:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee89831740 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9cdb8100 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee89831740 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cd95fe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee61600640 0 client.38216 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee89831740 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cd96520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee89831740 1 --2- 172.21.15.7:0/3254069005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd923c0 0x55ed9cd9cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.377+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 >> 172.21.15.7:0/3254069005 conn(0x55ed9cd8e8d0 msgr2=0x55ed9cd94600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.378+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 shutdown_connections 2024-04-23T15:38:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.378+0000 7fee89831740 1 -- 172.21.15.7:0/3254069005 wait complete. 2024-04-23T15:38:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.378+0000 7fee89831740 20 client.38216 trim_cache size 0 max 16384 2024-04-23T15:38:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.436+0000 7fee89831740 1 Processor -- start 2024-04-23T15:38:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.448+0000 7fee89831740 1 -- start start 2024-04-23T15:38:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.449+0000 7fee89831740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd8d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.449+0000 7fee89831740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cdbd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.449+0000 7fee89831740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cdbdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.450+0000 7fee89831740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee64010030 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.450+0000 7fee89831740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee64011b70 con 0x55ed9cd923c0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.450+0000 7fee89831740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee64010700 con 0x55ed9cd92ce0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.451+0000 7fee7fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd8d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.451+0000 7fee7fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd8d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:37774/0 (socket says 172.21.15.7:37774) 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.451+0000 7fee7fe00640 1 -- 172.21.15.7:0/3556743274 learned_addr learned my addr 172.21.15.7:0/3556743274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.452+0000 7fee7f400640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cdbd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.452+0000 7fee86a00640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cdbdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.453+0000 7fee86a00640 1 -- 172.21.15.7:0/3556743274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 msgr2=0x55ed9cdbd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.454+0000 7fee86a00640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cdbd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.454+0000 7fee86a00640 1 -- 172.21.15.7:0/3556743274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 msgr2=0x55ed9cd8d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.454+0000 7fee86a00640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd8d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.454+0000 7fee86a00640 1 -- 172.21.15.7:0/3556743274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9cd937c0 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.458 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.454+0000 7fee7f400640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cdbd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:38:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.454+0000 7fee7fe00640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd8d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:38:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.455+0000 7fee86a00640 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cdbdc10 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fee80065850 tx=0x7fee80068510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35a0b2c8bc2593c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.455+0000 7fee63e00640 1 -- 172.21.15.7:0/3556743274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80068de0 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.456+0000 7fee63e00640 1 -- 172.21.15.7:0/3556743274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee8009b040 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.456+0000 7fee63e00640 1 -- 172.21.15.7:0/3556743274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80068de0 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.456+0000 7fee89831740 1 -- 172.21.15.7:0/3556743274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 msgr2=0x55ed9cdbdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.456+0000 7fee89831740 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cdbdc10 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fee80065850 tx=0x7fee80068510 comp rx=0 tx=0).stop 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 -- 172.21.15.7:0/3556743274 shutdown_connections 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cdbdc10 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd92ce0 0x55ed9cdbd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 --2- 172.21.15.7:0/3556743274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd923c0 0x55ed9cd8d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 -- 172.21.15.7:0/3556743274 >> 172.21.15.7:0/3556743274 conn(0x55ed9cd8e8d0 msgr2=0x55ed9cd8d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:38:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 -- 172.21.15.7:0/3556743274 shutdown_connections 2024-04-23T15:38:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.457+0000 7fee89831740 1 -- 172.21.15.7:0/3556743274 wait complete. 2024-04-23T15:38:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.458+0000 7fee89831740 1 -- start start 2024-04-23T15:38:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.458+0000 7fee89831740 1 Processor -- start 2024-04-23T15:38:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.459+0000 7fee89831740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 0x55ed9cda22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.459+0000 7fee7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 0x55ed9cda22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.460+0000 7fee7fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 0x55ed9cda22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33912/0 (socket says 172.21.15.7:33912) 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.460+0000 7fee7fe00640 1 -- 172.21.15.7:0/605129721 learned_addr learned my addr 172.21.15.7:0/605129721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.460+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cda2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.460+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cda7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.460+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee640114a0 con 0x55ed9cd923c0 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.461+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee64010dd0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.461+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee6400e030 con 0x55ed9cd9d5a0 2024-04-23T15:38:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.461+0000 7fee89831740 10 client.0 _ll_register_callbacks cb 0x7fee74005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:38:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.460+0000 7fee7f400640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cda2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.461+0000 7fee86a00640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cda7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.461+0000 7fee7f400640 1 -- 172.21.15.7:0/605129721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd9d5a0 msgr2=0x55ed9cda7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.462+0000 7fee7f400640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cda7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.462+0000 7fee7f400640 1 -- 172.21.15.7:0/605129721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 msgr2=0x55ed9cda22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:38:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.462+0000 7fee7f400640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 0x55ed9cda22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:38:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.462+0000 7fee7f400640 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9cdb8470 con 0x55ed9cd92ce0 2024-04-23T15:38:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.462+0000 7fee86a00640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cda7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:38:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.462+0000 7fee7fe00640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 0x55ed9cda22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:38:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.463+0000 7fee7f400640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cda2800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee7409a450 tx=0x7fee74009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=792c21841bea4257 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:38:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.463+0000 7fee61600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:38:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.464+0000 7fee61600640 1 -- 172.21.15.7:0/605129721 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740b6070 con 0x55ed9cd92ce0 2024-04-23T15:38:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.464+0000 7fee61600640 1 -- 172.21.15.7:0/605129721 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 9467+0+0 (secure 0 0 0) 0x7fee740999e0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.464+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee8009b040 con 0x55ed9cd92ce0 2024-04-23T15:38:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.465+0000 7fee61600640 1 -- 172.21.15.7:0/605129721 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fee74099d20 con 0x55ed9cd92ce0 2024-04-23T15:38:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.467+0000 7fee89831740 10 client.38222 fetch_fsmap learned FSMap version 32 2024-04-23T15:38:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.467+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ed9cad7620 con 0x55ed9cd92ce0 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.468+0000 7fee61600640 1 -- 172.21.15.7:0/605129721 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee8009b040 con 0x55ed9cd92ce0 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee61600640 1 -- 172.21.15.7:0/605129721 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fee740a2fc0 con 0x55ed9cd92ce0 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee89831740 10 client.38222 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee89831740 10 client.38222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee89831740 20 client.38222 populate_metadata read hostname 'smithi007' 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9ce15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee89831740 4 client.38222 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:38:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ed9cdb3060 con 0x55ed9cdb5d10 2024-04-23T15:38:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.469+0000 7fee7fe00640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9ce15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:38:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.477+0000 7fee61600640 10 client.38222 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:38:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:38:58.477+0000 7fee7fe00640 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9ce15f10 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67163caa2d7a3920 server_cookie=13d621d44f3764e in_seq=0 out_seq=0 2024-04-23T15:38:59.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:38:59 smithi007 ceph-mon[27906]: pgmap v1511: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 4.09k op/s 2024-04-23T15:38:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:38:59 smithi186 ceph-mon[31814]: pgmap v1511: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 4.09k op/s 2024-04-23T15:38:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:38:59 smithi137 ceph-mon[31694]: pgmap v1511: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 4.09k op/s 2024-04-23T15:39:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.165+0000 7fee61600640 1 -- 172.21.15.7:0/605129721 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ed9cdb3060 con 0x55ed9cdb5d10 2024-04-23T15:39:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.165+0000 7fee61600640 10 client.38222 handle_command_reply: tid=0 2024-04-23T15:39:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.165+0000 7fee89831740 1 client.38222 shutdown 2024-04-23T15:39:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.167+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 msgr2=0x55ed9cda2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.167+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cda2800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee7409a450 tx=0x7fee74009700 comp rx=0 tx=0).stop 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 shutdown_connections 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55ed9cdb5d10 0x55ed9ce15f10 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed9cd92ce0 0x55ed9cda2800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ed9cd9d5a0 0x55ed9cda7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 --2- 172.21.15.7:0/605129721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ed9cd923c0 0x55ed9cda22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 >> 172.21.15.7:0/605129721 conn(0x55ed9cd8e8d0 msgr2=0x55ed9cd9a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee61600640 0 client.38222 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.168+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 shutdown_connections 2024-04-23T15:39:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.169+0000 7fee89831740 1 -- 172.21.15.7:0/605129721 wait complete. 2024-04-23T15:39:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.169+0000 7fee89831740 20 client.38222 trim_cache size 0 max 16384 2024-04-23T15:39:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:39:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:39:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:39:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:39:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.170+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee680a3de0 msgr2=0x7fee680a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.170+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee680a3de0 0x7fee680a62a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee70009ba0 tx=0x7fee70005f90 comp rx=0 tx=0).stop 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.170+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee780959d0 msgr2=0x7fee7812c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.170+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee780959d0 0x7fee7812c8f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fee7400e9f0 tx=0x7fee7400eeb0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 shutdown_connections 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fee680a3de0 0x7fee680a62a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7809ac70 0x7fee78130c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee780959d0 0x7fee7812c8f0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 --2- 172.21.15.7:0/693349864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee78095030 0x7fee7812c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 >> 172.21.15.7:0/693349864 conn(0x7fee7800a740 msgr2=0x7fee78093e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 shutdown_connections 2024-04-23T15:39:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:00.171+0000 7fee85400640 1 -- 172.21.15.7:0/693349864 wait complete. 2024-04-23T15:39:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:01 smithi007 ceph-mon[27906]: pgmap v1512: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 2.64k op/s 2024-04-23T15:39:01.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:01 smithi186 ceph-mon[31814]: pgmap v1512: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 2.64k op/s 2024-04-23T15:39:01.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:01 smithi137 ceph-mon[31694]: pgmap v1512: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 2.64k op/s 2024-04-23T15:39:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:03 smithi007 ceph-mon[27906]: pgmap v1513: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 3.44k op/s 2024-04-23T15:39:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:03 smithi186 ceph-mon[31814]: pgmap v1513: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 3.44k op/s 2024-04-23T15:39:03.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:03 smithi137 ceph-mon[31694]: pgmap v1513: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 3.44k op/s 2024-04-23T15:39:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:05 smithi007 ceph-mon[27906]: pgmap v1514: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-04-23T15:39:05.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:05 smithi186 ceph-mon[31814]: pgmap v1514: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-04-23T15:39:05.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:05 smithi137 ceph-mon[31694]: pgmap v1514: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-04-23T15:39:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:07 smithi007 ceph-mon[27906]: pgmap v1515: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.6 MiB/s wr, 2.45k op/s 2024-04-23T15:39:07.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:07 smithi186 ceph-mon[31814]: pgmap v1515: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.6 MiB/s wr, 2.45k op/s 2024-04-23T15:39:07.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:07 smithi137 ceph-mon[31694]: pgmap v1515: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.6 MiB/s wr, 2.45k op/s 2024-04-23T15:39:09.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:09 smithi007 ceph-mon[27906]: pgmap v1516: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 3.23k op/s 2024-04-23T15:39:09.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:09 smithi007 ceph-mon[27906]: osdmap e175: 12 total, 12 up, 12 in 2024-04-23T15:39:09.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:09 smithi186 ceph-mon[31814]: pgmap v1516: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 3.23k op/s 2024-04-23T15:39:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:09 smithi186 ceph-mon[31814]: osdmap e175: 12 total, 12 up, 12 in 2024-04-23T15:39:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:09 smithi137 ceph-mon[31694]: pgmap v1516: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 3.23k op/s 2024-04-23T15:39:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:09 smithi137 ceph-mon[31694]: osdmap e175: 12 total, 12 up, 12 in 2024-04-23T15:39:11.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:11 smithi007 ceph-mon[27906]: pgmap v1518: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-04-23T15:39:11.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:11 smithi186 ceph-mon[31814]: pgmap v1518: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-04-23T15:39:11.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:11 smithi137 ceph-mon[31694]: pgmap v1518: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-04-23T15:39:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:13 smithi007 ceph-mon[27906]: pgmap v1519: 129 pgs: 11 active+clean+snaptrim, 87 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 2.90k op/s 2024-04-23T15:39:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:13 smithi186 ceph-mon[31814]: pgmap v1519: 129 pgs: 11 active+clean+snaptrim, 87 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 2.90k op/s 2024-04-23T15:39:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:13 smithi137 ceph-mon[31694]: pgmap v1519: 129 pgs: 11 active+clean+snaptrim, 87 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 2.90k op/s 2024-04-23T15:39:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:15 smithi186 ceph-mon[31814]: pgmap v1520: 129 pgs: 17 active+clean+snaptrim, 63 active+clean, 49 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:15.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:15 smithi137 ceph-mon[31694]: pgmap v1520: 129 pgs: 17 active+clean+snaptrim, 63 active+clean, 49 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:15.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:15 smithi007 ceph-mon[27906]: pgmap v1520: 129 pgs: 17 active+clean+snaptrim, 63 active+clean, 49 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:17 smithi186 ceph-mon[31814]: pgmap v1521: 129 pgs: 17 active+clean+snaptrim, 63 active+clean, 49 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:17.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:17 smithi137 ceph-mon[31694]: pgmap v1521: 129 pgs: 17 active+clean+snaptrim, 63 active+clean, 49 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:17.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:17 smithi007 ceph-mon[27906]: pgmap v1521: 129 pgs: 17 active+clean+snaptrim, 63 active+clean, 49 active+clean+snaptrim_wait; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.843+0000 7f3b1b200640 1 -- 172.21.15.7:0/1902480071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14104c60 msgr2=0x7f3b14108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.843+0000 7f3b1b200640 1 --2- 172.21.15.7:0/1902480071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14104c60 0x7f3b14108ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009900 tx=0x7f3b0402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.845+0000 7f3b1b200640 1 -- 172.21.15.7:0/1902480071 shutdown_connections 2024-04-23T15:39:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.845+0000 7f3b1b200640 1 --2- 172.21.15.7:0/1902480071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14104c60 0x7f3b14108ca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.845+0000 7f3b1b200640 1 --2- 172.21.15.7:0/1902480071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b14109380 0x7f3b14110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.845+0000 7f3b1b200640 1 --2- 172.21.15.7:0/1902480071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 0x7f3b14104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.845+0000 7f3b1b200640 1 -- 172.21.15.7:0/1902480071 >> 172.21.15.7:0/1902480071 conn(0x7f3b140ffb10 msgr2=0x7f3b14101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.846+0000 7f3b1b200640 1 -- 172.21.15.7:0/1902480071 shutdown_connections 2024-04-23T15:39:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.846+0000 7f3b1b200640 1 -- 172.21.15.7:0/1902480071 wait complete. 2024-04-23T15:39:18.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.847+0000 7f3b1b200640 1 Processor -- start 2024-04-23T15:39:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.848+0000 7f3b1b200640 1 -- start start 2024-04-23T15:39:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.848+0000 7f3b1b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 0x7f3b1410f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.848+0000 7f3b1b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14109380 0x7f3b1411b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.848+0000 7f3b1b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 0x7f3b1410fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.849+0000 7f3b19400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14109380 0x7f3b1411b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.849+0000 7f3b19e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 0x7f3b1410f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.849+0000 7f3b19400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14109380 0x7f3b1411b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:59036/0 (socket says 172.21.15.7:59036) 2024-04-23T15:39:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.849+0000 7f3b19e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 0x7f3b1410f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39838/0 (socket says 172.21.15.7:39838) 2024-04-23T15:39:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.850+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 0x7f3b1410fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.850+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 0x7f3b1410fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35122/0 (socket says 172.21.15.7:35122) 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.851+0000 7f3b19400640 1 -- 172.21.15.7:0/3615299164 learned_addr learned my addr 172.21.15.7:0/3615299164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.851+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140770f0 con 0x7f3b1410f960 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.851+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b14076f70 con 0x7f3b14109380 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.851+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3b14077270 con 0x7f3b141042b0 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.852+0000 7f3b1a800640 1 -- 172.21.15.7:0/3615299164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 msgr2=0x7f3b1410f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.852+0000 7f3b1a800640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 0x7f3b1410f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.852+0000 7f3b1a800640 1 -- 172.21.15.7:0/3615299164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14109380 msgr2=0x7f3b1411b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.852+0000 7f3b1a800640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14109380 0x7f3b1411b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.852+0000 7f3b1a800640 1 -- 172.21.15.7:0/3615299164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b141b3c30 con 0x7f3b1410f960 2024-04-23T15:39:18.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.854+0000 7f3b1a800640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 0x7f3b1410fde0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000ea80 tx=0x7f3b1000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.856+0000 7f3b0ea00640 1 -- 172.21.15.7:0/3615299164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000cea0 con 0x7f3b1410f960 2024-04-23T15:39:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.856+0000 7f3b0ea00640 1 -- 172.21.15.7:0/3615299164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b10005020 con 0x7f3b1410f960 2024-04-23T15:39:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.856+0000 7f3b0ea00640 1 -- 172.21.15.7:0/3615299164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000cea0 con 0x7f3b1410f960 2024-04-23T15:39:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.856+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b141b3ec0 con 0x7f3b1410f960 2024-04-23T15:39:18.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.856+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b141b4330 con 0x7f3b1410f960 2024-04-23T15:39:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.865+0000 7f3b1f7d7740 1 Processor -- start 2024-04-23T15:39:18.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.869+0000 7f3b0ea00640 1 -- 172.21.15.7:0/3615299164 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3b10004a40 con 0x7f3b1410f960 2024-04-23T15:39:18.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 -- start start 2024-04-23T15:39:18.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49d837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d8e5a0 0x557f49d90990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557f49ce9900 con 0x557f49d8e5a0 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557f49c8ff20 con 0x557f49d833c0 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.871+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557f49ce58c0 con 0x557f49d83ce0 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.874+0000 7f3b19e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.877+0000 7f3b19e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39840/0 (socket says 172.21.15.7:39840) 2024-04-23T15:39:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.877+0000 7f3b19e00640 1 -- 172.21.15.7:0/459621083 learned_addr learned my addr 172.21.15.7:0/459621083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19400640 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49d837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19400640 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d8e5a0 0x557f49d90990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19e00640 1 -- 172.21.15.7:0/459621083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 msgr2=0x557f49d837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19e00640 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49d837a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19e00640 1 -- 172.21.15.7:0/459621083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d8e5a0 msgr2=0x557f49d90990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19e00640 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d8e5a0 0x557f49d90990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19e00640 1 -- 172.21.15.7:0/459621083 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f49cb4e10 con 0x557f49d83ce0 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.879+0000 7f3b19400640 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d8e5a0 0x557f49d90990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:39:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.880+0000 7f3b19e00640 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8e060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800b820 tx=0x7f3b0800bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ead3723814b892 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.880+0000 7f3b03000640 1 -- 172.21.15.7:0/459621083 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800d950 con 0x557f49d83ce0 2024-04-23T15:39:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.881+0000 7f3b0ea00640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3afc0a4110 0x7f3afc0a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.881+0000 7f3b03000640 1 -- 172.21.15.7:0/459621083 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b08019070 con 0x557f49d83ce0 2024-04-23T15:39:18.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.881+0000 7f3b0ea00640 1 -- 172.21.15.7:0/3615299164 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7f3b1000cca0 con 0x7f3b1410f960 2024-04-23T15:39:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.882+0000 7f3b03000640 1 -- 172.21.15.7:0/459621083 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b080123e0 con 0x557f49d83ce0 2024-04-23T15:39:18.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.882+0000 7f3b19400640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3afc0a4110 0x7f3afc0a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.883+0000 7f3b19400640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3afc0a4110 0x7f3afc0a65d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x557f49d80a60 tx=0x7f3b04005b50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.884+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/459621083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 msgr2=0x557f49d8e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.884+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8e060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800b820 tx=0x7f3b0800bce0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.885+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/459621083 shutdown_connections 2024-04-23T15:39:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.885+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d8e5a0 0x557f49d90990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.885+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8e060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.885+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/459621083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49d837a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.885+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/459621083 >> 172.21.15.7:0/459621083 conn(0x557f49d7f8d0 msgr2=0x557f49d7fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.886+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/459621083 shutdown_connections 2024-04-23T15:39:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.887+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/459621083 wait complete. 2024-04-23T15:39:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.887+0000 7f3b1f7d7740 1 -- start start 2024-04-23T15:39:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.888+0000 7f3b1f7d7740 1 Processor -- start 2024-04-23T15:39:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.889+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 0x557f49d8b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.889+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.889+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49d8bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.890+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557f49da2230 con 0x557f49d833c0 2024-04-23T15:39:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.890+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49d8bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.890+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49d8bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:59054/0 (socket says 172.21.15.7:59054) 2024-04-23T15:39:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.890+0000 7f3b1a800640 1 -- 172.21.15.7:0/1470974589 learned_addr learned my addr 172.21.15.7:0/1470974589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.890+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557f49ca32c0 con 0x557f49d8e5a0 2024-04-23T15:39:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.890+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557f49da23b0 con 0x557f49d83ce0 2024-04-23T15:39:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.891+0000 7f3b1f7d7740 10 client.0 _ll_register_callbacks cb 0x557f499fba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:39:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3b1a800640 1 -- 172.21.15.7:0/1470974589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 msgr2=0x557f49d8b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:39:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3b1a800640 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3b1a800640 1 -- 172.21.15.7:0/1470974589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 msgr2=0x557f49d8b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3b1a800640 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 0x557f49d8b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3b1a800640 1 -- 172.21.15.7:0/1470974589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f49cb3fd0 con 0x557f49d8e5a0 2024-04-23T15:39:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3b1a800640 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49d8bed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b10099270 tx=0x7f3b1000cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8a66bd92985fa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3af7400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:39:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3af7400640 1 -- 172.21.15.7:0/1470974589 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b100a5510 con 0x557f49d8e5a0 2024-04-23T15:39:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.892+0000 7f3af7400640 1 -- 172.21.15.7:0/1470974589 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7f3b1009dbd0 con 0x557f49d8e5a0 2024-04-23T15:39:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.893+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b08019070 con 0x557f49d8e5a0 2024-04-23T15:39:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.893+0000 7f3af7400640 1 -- 172.21.15.7:0/1470974589 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3b1009de50 con 0x557f49d8e5a0 2024-04-23T15:39:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.893+0000 7f3b1f7d7740 10 client.38234 fetch_fsmap learned FSMap version 32 2024-04-23T15:39:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.893+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557f499fc210 con 0x557f49d8e5a0 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3af7400640 1 -- 172.21.15.7:0/1470974589 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b08019070 con 0x557f49d8e5a0 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3af7400640 1 -- 172.21.15.7:0/1470974589 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3b100985f0 con 0x557f49d8e5a0 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3b1f7d7740 10 client.38234 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3b1f7d7740 10 client.38234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3b1f7d7740 20 client.38234 populate_metadata read hostname 'smithi007' 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49daf6d0 0x557f49db1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3b1f7d7740 4 client.38234 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.895+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f49cf7320 con 0x557f49daf6d0 2024-04-23T15:39:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.897+0000 7f3b19e00640 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49daf6d0 0x557f49db1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.898+0000 7f3b19e00640 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49daf6d0 0x557f49db1ae0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe6a88ed8ee135e7 server_cookie=fefa4dfeca47e064 in_seq=0 out_seq=0 2024-04-23T15:39:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.898+0000 7f3af7400640 10 client.38234 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.900+0000 7f3af7400640 1 -- 172.21.15.7:0/1470974589 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f49cf7320 con 0x557f49daf6d0 2024-04-23T15:39:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.900+0000 7f3af7400640 10 client.38234 handle_command_reply: tid=0 2024-04-23T15:39:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.903+0000 7f3b1f7d7740 1 client.38234 shutdown 2024-04-23T15:39:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.904+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 msgr2=0x557f49d8bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.904+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49d8bed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b10099270 tx=0x7f3b1000cfa0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 shutdown_connections 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49daf6d0 0x557f49db1ae0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49d8bed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49d8b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1470974589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 0x557f49d8b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 >> 172.21.15.7:0/1470974589 conn(0x557f49d7f8d0 msgr2=0x557f49d7ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.905+0000 7f3af7400640 0 client.38234 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.906+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 shutdown_connections 2024-04-23T15:39:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.907+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1470974589 wait complete. 2024-04-23T15:39:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.907+0000 7f3b1f7d7740 20 client.38234 trim_cache size 0 max 16384 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.953+0000 7f3b1f7d7740 1 Processor -- start 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.953+0000 7f3b1f7d7740 1 -- start start 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.954+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49dab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.954+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d83ce0 0x557f49db73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.954+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d8e5a0 0x557f49db7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.954+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141b59a0 con 0x557f49d83ce0 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.954+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141b74e0 con 0x557f49d833c0 2024-04-23T15:39:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.954+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141b6070 con 0x557f49d8e5a0 2024-04-23T15:39:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.955+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d8e5a0 0x557f49db7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.955+0000 7f3b19e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49dab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.955+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d8e5a0 0x557f49db7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39846/0 (socket says 172.21.15.7:39846) 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.955+0000 7f3b1a800640 1 -- 172.21.15.7:0/1185977502 learned_addr learned my addr 172.21.15.7:0/1185977502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.956+0000 7f3b19e00640 1 -- 172.21.15.7:0/1185977502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d8e5a0 msgr2=0x557f49db7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.956+0000 7f3b19e00640 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d8e5a0 0x557f49db7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.956+0000 7f3b19e00640 1 -- 172.21.15.7:0/1185977502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d83ce0 msgr2=0x557f49db73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.956+0000 7f3b19e00640 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d83ce0 0x557f49db73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.956+0000 7f3b19e00640 1 -- 172.21.15.7:0/1185977502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f49d83b10 con 0x557f49d833c0 2024-04-23T15:39:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.958+0000 7f3b19e00640 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49dab120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x557f49db2360 tx=0x7f3b080047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80cc38c1bc4eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.960+0000 7f3b02600640 1 -- 172.21.15.7:0/1185977502 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08014890 con 0x557f49d833c0 2024-04-23T15:39:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.960+0000 7f3b02600640 1 -- 172.21.15.7:0/1185977502 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b08019040 con 0x557f49d833c0 2024-04-23T15:39:18.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.960+0000 7f3b02600640 1 -- 172.21.15.7:0/1185977502 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08024740 con 0x557f49d833c0 2024-04-23T15:39:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.961+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1185977502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 msgr2=0x557f49dab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:18.964 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.961+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49dab120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x557f49db2360 tx=0x7f3b080047d0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.965+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1185977502 shutdown_connections 2024-04-23T15:39:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.965+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d8e5a0 0x557f49db7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.965+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d83ce0 0x557f49db73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.965+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/1185977502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d833c0 0x557f49dab120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.966+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1185977502 >> 172.21.15.7:0/1185977502 conn(0x557f49d7f8d0 msgr2=0x557f49d7fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.966+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1185977502 shutdown_connections 2024-04-23T15:39:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.966+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/1185977502 wait complete. 2024-04-23T15:39:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.967+0000 7f3b1f7d7740 1 -- start start 2024-04-23T15:39:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.967+0000 7f3b1f7d7740 1 Processor -- start 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 0x557f49da7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49da7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49da2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141b6e10 con 0x557f49d833c0 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141b6740 con 0x557f49d8e5a0 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3b14050620 con 0x557f49d83ce0 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.970+0000 7f3b1f7d7740 10 client.0 _ll_register_callbacks cb 0x7f3b10098b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49da2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49da2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:59080/0 (socket says 172.21.15.7:59080) 2024-04-23T15:39:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 -- 172.21.15.7:0/2583663613 learned_addr learned my addr 172.21.15.7:0/2583663613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 -- 172.21.15.7:0/2583663613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 msgr2=0x557f49da7b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49da7b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 -- 172.21.15.7:0/2583663613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 msgr2=0x557f49da7640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 0x557f49da7640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.971+0000 7f3b1a800640 1 -- 172.21.15.7:0/2583663613 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f49ac8620 con 0x557f49d8e5a0 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.972+0000 7f3b1a800640 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49da2be0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b100a56d0 tx=0x7f3b100d0e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ffaf3bfe97b4e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.972+0000 7f3af7400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:39:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.972+0000 7f3af7400640 1 -- 172.21.15.7:0/2583663613 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1009c3e0 con 0x557f49d8e5a0 2024-04-23T15:39:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.972+0000 7f3af7400640 1 -- 172.21.15.7:0/2583663613 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7f3b1009a680 con 0x557f49d8e5a0 2024-04-23T15:39:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.974+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b08019040 con 0x557f49d8e5a0 2024-04-23T15:39:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.974+0000 7f3af7400640 1 -- 172.21.15.7:0/2583663613 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3b1009c670 con 0x557f49d8e5a0 2024-04-23T15:39:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.974+0000 7f3b1f7d7740 10 client.38240 fetch_fsmap learned FSMap version 32 2024-04-23T15:39:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.974+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557f49ac8620 con 0x557f49d8e5a0 2024-04-23T15:39:18.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3af7400640 1 -- 172.21.15.7:0/2583663613 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b08019040 con 0x557f49d8e5a0 2024-04-23T15:39:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3af7400640 1 -- 172.21.15.7:0/2583663613 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3b100cece0 con 0x557f49d8e5a0 2024-04-23T15:39:18.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3b1f7d7740 10 client.38240 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:39:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3b1f7d7740 10 client.38240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:39:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3b1f7d7740 20 client.38240 populate_metadata read hostname 'smithi007' 2024-04-23T15:39:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49e15a80 0x557f49e17eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3b1f7d7740 4 client.38240 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:39:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.976+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f49cf1190 con 0x557f49e15a80 2024-04-23T15:39:18.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.977+0000 7f3b19e00640 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49e15a80 0x557f49e17eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.979+0000 7f3b19e00640 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49e15a80 0x557f49e17eb0 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1290969d5ade76b9 server_cookie=8478447d55d2168e in_seq=0 out_seq=0 2024-04-23T15:39:18.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:18.979+0000 7f3af7400640 10 client.38240 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:19 smithi186 ceph-mon[31814]: pgmap v1522: 129 pgs: 15 active+clean+snaptrim, 73 active+clean, 41 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 3.16k op/s 2024-04-23T15:39:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:19 smithi137 ceph-mon[31694]: pgmap v1522: 129 pgs: 15 active+clean+snaptrim, 73 active+clean, 41 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 3.16k op/s 2024-04-23T15:39:19.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:19 smithi007 ceph-mon[27906]: pgmap v1522: 129 pgs: 15 active+clean+snaptrim, 73 active+clean, 41 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 3.16k op/s 2024-04-23T15:39:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.671+0000 7f3af7400640 1 -- 172.21.15.7:0/2583663613 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f49cf1190 con 0x557f49e15a80 2024-04-23T15:39:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.671+0000 7f3af7400640 10 client.38240 handle_command_reply: tid=0 2024-04-23T15:39:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.672+0000 7f3b1f7d7740 1 client.38240 shutdown 2024-04-23T15:39:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.673+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 msgr2=0x557f49da2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.673+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49da2be0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b100a56d0 tx=0x7f3b100d0e10 comp rx=0 tx=0).stop 2024-04-23T15:39:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.673+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 shutdown_connections 2024-04-23T15:39:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.673+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f49e15a80 0x557f49e17eb0 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.674+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f49d8e5a0 0x557f49da2be0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.674+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f49d83ce0 0x557f49da7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.674+0000 7f3b1f7d7740 1 --2- 172.21.15.7:0/2583663613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f49d833c0 0x557f49da7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.674+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 >> 172.21.15.7:0/2583663613 conn(0x557f49d7f8d0 msgr2=0x557f49d89d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.674+0000 7f3af7400640 0 client.38240 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.674+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 shutdown_connections 2024-04-23T15:39:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.676+0000 7f3b1f7d7740 1 -- 172.21.15.7:0/2583663613 wait complete. 2024-04-23T15:39:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.676+0000 7f3b1f7d7740 20 client.38240 trim_cache size 0 max 16384 2024-04-23T15:39:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:39:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:39:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:39:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:39:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.681+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3afc0a4110 msgr2=0x7f3afc0a65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.681+0000 7f3b1b200640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3afc0a4110 0x7f3afc0a65d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x557f49d80a60 tx=0x7f3b04005b50 comp rx=0 tx=0).stop 2024-04-23T15:39:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.682+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 msgr2=0x7f3b1410fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.682+0000 7f3b1b200640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 0x7f3b1410fde0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000ea80 tx=0x7f3b1000ef40 comp rx=0 tx=0).stop 2024-04-23T15:39:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.683+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 shutdown_connections 2024-04-23T15:39:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.683+0000 7f3b1b200640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3afc0a4110 0x7f3afc0a65d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.683+0000 7f3b1b200640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b14109380 0x7f3b1411b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.683+0000 7f3b1b200640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1410f960 0x7f3b1410fde0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.684+0000 7f3b1b200640 1 --2- 172.21.15.7:0/3615299164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b141042b0 0x7f3b1410f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.684+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 >> 172.21.15.7:0/3615299164 conn(0x7f3b140ffb10 msgr2=0x7f3b14100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.685+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 shutdown_connections 2024-04-23T15:39:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:20.687+0000 7f3b1b200640 1 -- 172.21.15.7:0/3615299164 wait complete. 2024-04-23T15:39:21.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:21 smithi186 ceph-mon[31814]: pgmap v1523: 129 pgs: 15 active+clean+snaptrim, 73 active+clean, 41 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-04-23T15:39:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:21 smithi137 ceph-mon[31694]: pgmap v1523: 129 pgs: 15 active+clean+snaptrim, 73 active+clean, 41 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-04-23T15:39:21.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:21 smithi007 ceph-mon[27906]: pgmap v1523: 129 pgs: 15 active+clean+snaptrim, 73 active+clean, 41 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-04-23T15:39:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:23 smithi137 ceph-mon[31694]: pgmap v1524: 129 pgs: 14 active+clean+snaptrim, 80 active+clean, 35 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:23 smithi007 ceph-mon[27906]: pgmap v1524: 129 pgs: 14 active+clean+snaptrim, 80 active+clean, 35 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:23.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:23 smithi186 ceph-mon[31814]: pgmap v1524: 129 pgs: 14 active+clean+snaptrim, 80 active+clean, 35 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 2.94k op/s 2024-04-23T15:39:25.415 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:25 smithi186 ceph-mon[31814]: pgmap v1525: 129 pgs: 14 active+clean+snaptrim, 83 active+clean, 32 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 2.90k op/s 2024-04-23T15:39:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:25 smithi137 ceph-mon[31694]: pgmap v1525: 129 pgs: 14 active+clean+snaptrim, 83 active+clean, 32 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 2.90k op/s 2024-04-23T15:39:25.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:25 smithi007 ceph-mon[27906]: pgmap v1525: 129 pgs: 14 active+clean+snaptrim, 83 active+clean, 32 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 2.90k op/s 2024-04-23T15:39:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:27 smithi137 ceph-mon[31694]: pgmap v1526: 129 pgs: 14 active+clean+snaptrim, 83 active+clean, 32 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.7 MiB/s wr, 2.48k op/s 2024-04-23T15:39:27.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:27 smithi007 ceph-mon[27906]: pgmap v1526: 129 pgs: 14 active+clean+snaptrim, 83 active+clean, 32 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.7 MiB/s wr, 2.48k op/s 2024-04-23T15:39:27.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:27 smithi186 ceph-mon[31814]: pgmap v1526: 129 pgs: 14 active+clean+snaptrim, 83 active+clean, 32 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.7 MiB/s wr, 2.48k op/s 2024-04-23T15:39:29.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:29 smithi137 ceph-mon[31694]: pgmap v1527: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 3.54k op/s 2024-04-23T15:39:29.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:29 smithi007 ceph-mon[27906]: pgmap v1527: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 3.54k op/s 2024-04-23T15:39:29.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:29 smithi186 ceph-mon[31814]: pgmap v1527: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 3.54k op/s 2024-04-23T15:39:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:31 smithi137 ceph-mon[31694]: pgmap v1528: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-04-23T15:39:31.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:31 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:39:31.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:31 smithi007 ceph-mon[27906]: pgmap v1528: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-04-23T15:39:31.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:31 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:39:31.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:31 smithi186 ceph-mon[31814]: pgmap v1528: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-04-23T15:39:31.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:31 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:39:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:33 smithi137 ceph-mon[31694]: pgmap v1529: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 3.15k op/s 2024-04-23T15:39:33.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:33 smithi007 ceph-mon[27906]: pgmap v1529: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 3.15k op/s 2024-04-23T15:39:33.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:33 smithi186 ceph-mon[31814]: pgmap v1529: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 3.15k op/s 2024-04-23T15:39:35.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:35 smithi007 ceph-mon[27906]: pgmap v1530: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-04-23T15:39:35.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:35 smithi186 ceph-mon[31814]: pgmap v1530: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-04-23T15:39:35.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:35 smithi137 ceph-mon[31694]: pgmap v1530: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 3.42k op/s 2024-04-23T15:39:36.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.730+0000 7fb4aee00640 1 -- 172.21.15.7:0/4192377045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 msgr2=0x7fb4a81093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.730+0000 7fb4aee00640 1 --2- 172.21.15.7:0/4192377045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 0x7fb4a81093e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb498009930 tx=0x7fb49802a4f0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.730+0000 7fb4aee00640 1 -- 172.21.15.7:0/4192377045 shutdown_connections 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.731+0000 7fb4aee00640 1 --2- 172.21.15.7:0/4192377045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8117540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.731+0000 7fb4aee00640 1 --2- 172.21.15.7:0/4192377045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4a8109920 0x7fb4a8114c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.731+0000 7fb4aee00640 1 --2- 172.21.15.7:0/4192377045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 0x7fb4a81093e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.731+0000 7fb4aee00640 1 -- 172.21.15.7:0/4192377045 >> 172.21.15.7:0/4192377045 conn(0x7fb4a806d0d0 msgr2=0x7fb4a806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.732+0000 7fb4aee00640 1 -- 172.21.15.7:0/4192377045 shutdown_connections 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.732+0000 7fb4aee00640 1 -- 172.21.15.7:0/4192377045 wait complete. 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 Processor -- start 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 -- start start 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 0x7fb4a8111d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4a8109920 0x7fb4a8112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a810c550 con 0x7fb4a8109920 2024-04-23T15:39:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a810c3d0 con 0x7fb4a8115150 2024-04-23T15:39:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.734+0000 7fb4aee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a810c6d0 con 0x7fb4a8109000 2024-04-23T15:39:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.735+0000 7fb4ace00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.735+0000 7fb4ace00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:40432/0 (socket says 172.21.15.7:40432) 2024-04-23T15:39:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.735+0000 7fb4ace00640 1 -- 172.21.15.7:0/3304177978 learned_addr learned my addr 172.21.15.7:0/3304177978 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.736+0000 7fb4ace00640 1 -- 172.21.15.7:0/3304177978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 msgr2=0x7fb4a8111d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.736+0000 7fb4ace00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 0x7fb4a8111d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.736+0000 7fb4ace00640 1 -- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4a8109920 msgr2=0x7fb4a8112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.736+0000 7fb4ace00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4a8109920 0x7fb4a8112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.736+0000 7fb4ace00640 1 -- 172.21.15.7:0/3304177978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a81243c0 con 0x7fb4a8115150 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.737+0000 7fb4ace00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8112780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000b970 tx=0x7fb4a000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:36.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.739+0000 7fb4a4c00640 1 -- 172.21.15.7:0/3304177978 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0019070 con 0x7fb4a8115150 2024-04-23T15:39:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.739+0000 7fb4a4c00640 1 -- 172.21.15.7:0/3304177978 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb4a0014440 con 0x7fb4a8115150 2024-04-23T15:39:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.739+0000 7fb4a4c00640 1 -- 172.21.15.7:0/3304177978 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00075f0 con 0x7fb4a8115150 2024-04-23T15:39:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.739+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a81246b0 con 0x7fb4a8115150 2024-04-23T15:39:36.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.740+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a8124bb0 con 0x7fb4a8115150 2024-04-23T15:39:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.751+0000 7fb4b1c56740 1 Processor -- start 2024-04-23T15:39:36.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.756+0000 7fb4a4c00640 1 -- 172.21.15.7:0/3304177978 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb4a00145f0 con 0x7fb4a8115150 2024-04-23T15:39:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.758+0000 7fb4a4c00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb48c0a3f70 0x7fb48c0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.759+0000 7fb4a4c00640 1 -- 172.21.15.7:0/3304177978 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7fb4a00cffb0 con 0x7fb4a8115150 2024-04-23T15:39:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.759+0000 7fb4a7400640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb48c0a3f70 0x7fb48c0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.761+0000 7fb4b1c56740 1 -- start start 2024-04-23T15:39:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.761+0000 7fb4a7400640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb48c0a3f70 0x7fb48c0a6430 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4a81134c0 tx=0x7fb490005bf0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.763+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce6c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.764+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 0x55990ce76e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.764+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 0x55990ce76e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.764+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 0x55990ce76e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:38404/0 (socket says 172.21.15.7:38404) 2024-04-23T15:39:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.766+0000 7fb4a7400640 1 -- 172.21.15.7:0/1640034422 learned_addr learned my addr 172.21.15.7:0/1640034422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.766+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce77390 0x55990ce79780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.766+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce6c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.766+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55990cdd2900 con 0x55990ce6c1b0 2024-04-23T15:39:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.768+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55990cd78f20 con 0x55990ce77390 2024-04-23T15:39:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.768+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55990cdce8c0 con 0x55990ce6cad0 2024-04-23T15:39:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.768+0000 7fb4ace00640 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce77390 0x55990ce79780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7400640 1 -- 172.21.15.7:0/1640034422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce77390 msgr2=0x55990ce79780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7400640 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce77390 0x55990ce79780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7400640 1 -- 172.21.15.7:0/1640034422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 msgr2=0x55990ce6c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7400640 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce6c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7400640 1 -- 172.21.15.7:0/1640034422 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990cd9de10 con 0x55990ce6cad0 2024-04-23T15:39:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce6c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:39:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.769+0000 7fb4a7400640 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 0x55990ce76e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb49000afd0 tx=0x7fb49000f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17febe7a4b1c192d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.770+0000 7fb49d600640 1 -- 172.21.15.7:0/1640034422 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490020070 con 0x55990ce6cad0 2024-04-23T15:39:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.770+0000 7fb49d600640 1 -- 172.21.15.7:0/1640034422 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb490016070 con 0x55990ce6cad0 2024-04-23T15:39:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.770+0000 7fb49d600640 1 -- 172.21.15.7:0/1640034422 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490020070 con 0x55990ce6cad0 2024-04-23T15:39:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.775+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 msgr2=0x55990ce76e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:36.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.775+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 0x55990ce76e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb49000afd0 tx=0x7fb49000f000 comp rx=0 tx=0).stop 2024-04-23T15:39:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.776+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 shutdown_connections 2024-04-23T15:39:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.776+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce77390 0x55990ce79780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.776+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6cad0 0x55990ce76e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.776+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1640034422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce6c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.777+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 >> 172.21.15.7:0/1640034422 conn(0x55990ce686c0 msgr2=0x55990ce68aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:36.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.778+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 shutdown_connections 2024-04-23T15:39:36.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.778+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1640034422 wait complete. 2024-04-23T15:39:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.780+0000 7fb4b1c56740 1 -- start start 2024-04-23T15:39:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.780+0000 7fb4b1c56740 1 Processor -- start 2024-04-23T15:39:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.781+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce74280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.781+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.781+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.782+0000 7fb4b1c56740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55990ce79fc0 con 0x55990ce6c1b0 2024-04-23T15:39:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.782+0000 7fb4b1c56740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55990cd8c2c0 con 0x55990ce6cad0 2024-04-23T15:39:36.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.782+0000 7fb4b1c56740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55990ce7a140 con 0x55990ce77390 2024-04-23T15:39:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.782+0000 7fb4b1c56740 10 client.0 _ll_register_callbacks cb 0x55990cae4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:39:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.783+0000 7fb4ace00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.783+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.783+0000 7fb4ace00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce74d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:38418/0 (socket says 172.21.15.7:38418) 2024-04-23T15:39:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.783+0000 7fb4ace00640 1 -- 172.21.15.7:0/1244336053 learned_addr learned my addr 172.21.15.7:0/1244336053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.784+0000 7fb4a7400640 1 -- 172.21.15.7:0/1244336053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 msgr2=0x55990ce74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.784+0000 7fb4a7400640 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.784+0000 7fb4a7400640 1 -- 172.21.15.7:0/1244336053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 msgr2=0x55990ce74280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.784+0000 7fb4a7400640 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce74280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.784+0000 7fb4a7400640 1 -- 172.21.15.7:0/1244336053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990cd9cfd0 con 0x55990ce6cad0 2024-04-23T15:39:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.785+0000 7fb4a7400640 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce747c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb49000afd0 tx=0x7fb49001cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f244b71f3195969a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.785+0000 7fb496000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:39:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.787+0000 7fb496000640 1 -- 172.21.15.7:0/1244336053 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49002b070 con 0x55990ce6cad0 2024-04-23T15:39:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.787+0000 7fb496000640 1 -- 172.21.15.7:0/1244336053 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7fb49000eca0 con 0x55990ce6cad0 2024-04-23T15:39:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.788+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb490016070 con 0x55990ce6cad0 2024-04-23T15:39:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.790+0000 7fb496000640 1 -- 172.21.15.7:0/1244336053 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb490020040 con 0x55990ce6cad0 2024-04-23T15:39:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.790+0000 7fb4b1c56740 10 client.38249 fetch_fsmap learned FSMap version 32 2024-04-23T15:39:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.791+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55990cae5210 con 0x55990ce6cad0 2024-04-23T15:39:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.792+0000 7fb496000640 1 -- 172.21.15.7:0/1244336053 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb490016070 con 0x55990ce6cad0 2024-04-23T15:39:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.792+0000 7fb496000640 1 -- 172.21.15.7:0/1244336053 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb49001b070 con 0x55990ce6cad0 2024-04-23T15:39:36.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.793+0000 7fb4b1c56740 10 client.38249 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:39:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.793+0000 7fb4b1c56740 10 client.38249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:39:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.794+0000 7fb4b1c56740 20 client.38249 populate_metadata read hostname 'smithi007' 2024-04-23T15:39:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.794+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ce873e0 0x55990ce897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.794+0000 7fb4b1c56740 4 client.38249 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:39:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.794+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990cde0320 con 0x55990ce873e0 2024-04-23T15:39:36.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.794+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ce873e0 0x55990ce897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.795+0000 7fb496000640 10 client.38249 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.795+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ce873e0 0x55990ce897d0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f79ceb02e2fa89 server_cookie=63ec311ebf6a7d0e in_seq=0 out_seq=0 2024-04-23T15:39:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.799+0000 7fb496000640 1 -- 172.21.15.7:0/1244336053 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55990cde0320 con 0x55990ce873e0 2024-04-23T15:39:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.799+0000 7fb496000640 10 client.38249 handle_command_reply: tid=0 2024-04-23T15:39:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.800+0000 7fb4b1c56740 1 client.38249 shutdown 2024-04-23T15:39:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.801+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 msgr2=0x55990ce747c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.801+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce747c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb49000afd0 tx=0x7fb49001cb60 comp rx=0 tx=0).stop 2024-04-23T15:39:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 shutdown_connections 2024-04-23T15:39:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ce873e0 0x55990ce897d0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce747c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/1244336053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce74280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb496000640 0 client.38249 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.805+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 >> 172.21.15.7:0/1244336053 conn(0x55990ce686c0 msgr2=0x55990ce6e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.807+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 shutdown_connections 2024-04-23T15:39:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.808+0000 7fb4b1c56740 1 -- 172.21.15.7:0/1244336053 wait complete. 2024-04-23T15:39:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.809+0000 7fb4b1c56740 20 client.38249 trim_cache size 0 max 16384 2024-04-23T15:39:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.904+0000 7fb4b1c56740 1 Processor -- start 2024-04-23T15:39:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.904+0000 7fb4b1c56740 1 -- start start 2024-04-23T15:39:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce82e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce6eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4b1c56740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81c6cf0 con 0x55990ce6c1b0 2024-04-23T15:39:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4b1c56740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81c8830 con 0x55990ce6cad0 2024-04-23T15:39:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4b1c56740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81c73c0 con 0x55990ce77390 2024-04-23T15:39:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.905+0000 7fb4ace00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce6eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce6eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:40444/0 (socket says 172.21.15.7:40444) 2024-04-23T15:39:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 -- 172.21.15.7:0/2006399135 learned_addr learned my addr 172.21.15.7:0/2006399135 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 -- 172.21.15.7:0/2006399135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 msgr2=0x55990ce676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 -- 172.21.15.7:0/2006399135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 msgr2=0x55990ce82e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce82e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.906+0000 7fb4a7400640 1 -- 172.21.15.7:0/2006399135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990ce6c900 con 0x55990ce6cad0 2024-04-23T15:39:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.907+0000 7fb4a7400640 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce6eb70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb490004ea0 tx=0x7fb49000cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c78b2adde52d5b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.908+0000 7fb49cc00640 1 -- 172.21.15.7:0/2006399135 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49003c030 con 0x55990ce6cad0 2024-04-23T15:39:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.908+0000 7fb49cc00640 1 -- 172.21.15.7:0/2006399135 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb490016070 con 0x55990ce6cad0 2024-04-23T15:39:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.908+0000 7fb49cc00640 1 -- 172.21.15.7:0/2006399135 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49003c030 con 0x55990ce6cad0 2024-04-23T15:39:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.910+0000 7fb4b1c56740 1 -- 172.21.15.7:0/2006399135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 msgr2=0x55990ce6eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.910+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce6eb70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb490004ea0 tx=0x7fb49000cb60 comp rx=0 tx=0).stop 2024-04-23T15:39:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.911+0000 7fb4b1c56740 1 -- 172.21.15.7:0/2006399135 shutdown_connections 2024-04-23T15:39:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.911+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce6eb70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.911+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce77390 0x55990ce676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.911+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/2006399135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce6c1b0 0x55990ce82e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.911+0000 7fb4b1c56740 1 -- 172.21.15.7:0/2006399135 >> 172.21.15.7:0/2006399135 conn(0x55990ce686c0 msgr2=0x55990ce66fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.912+0000 7fb4b1c56740 1 -- 172.21.15.7:0/2006399135 shutdown_connections 2024-04-23T15:39:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.912+0000 7fb4b1c56740 1 -- 172.21.15.7:0/2006399135 wait complete. 2024-04-23T15:39:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.913+0000 7fb4b1c56740 1 -- start start 2024-04-23T15:39:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.913+0000 7fb4b1c56740 1 Processor -- start 2024-04-23T15:39:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.914+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 0x55990ce7acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.914+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce7b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.914+0000 7fb4b1c56740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce77390 0x55990ce7b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.916+0000 7fb4a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 0x55990ce7acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.916+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce7b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.916+0000 7fb4a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce7b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:40450/0 (socket says 172.21.15.7:40450) 2024-04-23T15:39:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.916+0000 7fb4a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 0x55990ce7acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:38448/0 (socket says 172.21.15.7:38448) 2024-04-23T15:39:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.917+0000 7fb4a7e00640 1 -- 172.21.15.7:0/590636298 learned_addr learned my addr 172.21.15.7:0/590636298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.917+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81c8160 con 0x55990ce77390 2024-04-23T15:39:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.917+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81c7a90 con 0x55990ce6cad0 2024-04-23T15:39:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.917+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81c4cf0 con 0x55990ce6c1b0 2024-04-23T15:39:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.917+0000 7fb4b1c56740 10 client.0 _ll_register_callbacks cb 0x7fb498009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:39:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.918+0000 7fb4a7e00640 1 -- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 msgr2=0x55990ce7b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.918+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce7b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.918+0000 7fb4a7e00640 1 -- 172.21.15.7:0/590636298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce77390 msgr2=0x55990ce7b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.919+0000 7fb4ace00640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce77390 0x55990ce7b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.922+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce77390 0x55990ce7b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.922+0000 7fb4a7e00640 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990cbb1620 con 0x55990ce6c1b0 2024-04-23T15:39:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.922+0000 7fb4a7400640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce7b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:39:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.922+0000 7fb4a7e00640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 0x55990ce7acf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb498033040 tx=0x7fb4980049d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7fdb38de243c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.923+0000 7fb496000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:39:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.923+0000 7fb4ace00640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce77390 0x55990ce7b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:39:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.923+0000 7fb496000640 1 -- 172.21.15.7:0/590636298 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498044d60 con 0x55990ce6c1b0 2024-04-23T15:39:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.923+0000 7fb496000640 1 -- 172.21.15.7:0/590636298 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7fb498037040 con 0x55990ce6c1b0 2024-04-23T15:39:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.929+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb490016070 con 0x55990ce6c1b0 2024-04-23T15:39:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.930+0000 7fb496000640 1 -- 172.21.15.7:0/590636298 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb498004040 con 0x55990ce6c1b0 2024-04-23T15:39:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.930+0000 7fb4b1c56740 10 client.28372 fetch_fsmap learned FSMap version 32 2024-04-23T15:39:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.931+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55990ceed760 con 0x55990ce6c1b0 2024-04-23T15:39:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.932+0000 7fb496000640 1 -- 172.21.15.7:0/590636298 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb490016070 con 0x55990ce6c1b0 2024-04-23T15:39:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.935+0000 7fb496000640 1 -- 172.21.15.7:0/590636298 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fb4980035f0 con 0x55990ce6c1b0 2024-04-23T15:39:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.937+0000 7fb4b1c56740 10 client.28372 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.937+0000 7fb4b1c56740 10 client.28372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.937+0000 7fb4b1c56740 20 client.28372 populate_metadata read hostname 'smithi007' 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.937+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ceedf30 0x55990cef0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.937+0000 7fb4b1c56740 4 client.28372 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.937+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55990cdda190 con 0x55990ceedf30 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.938+0000 7fb4a7400640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ceedf30 0x55990cef0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.939+0000 7fb4a7400640 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ceedf30 0x55990cef0350 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d39502aa69a0d3 server_cookie=2e4f586dfd308c99 in_seq=0 out_seq=0 2024-04-23T15:39:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:36.939+0000 7fb496000640 10 client.28372 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:37.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:37 smithi007 ceph-mon[27906]: pgmap v1531: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:39:37.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:37 smithi186 ceph-mon[31814]: pgmap v1531: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:39:37.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:37 smithi137 ceph-mon[31694]: pgmap v1531: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:39:39.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:39 smithi007 ceph-mon[27906]: pgmap v1532: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 3.75k op/s 2024-04-23T15:39:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:39 smithi186 ceph-mon[31814]: pgmap v1532: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 3.75k op/s 2024-04-23T15:39:39.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:39 smithi137 ceph-mon[31694]: pgmap v1532: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 15 MiB/s wr, 3.75k op/s 2024-04-23T15:39:41.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:41 smithi007 ceph-mon[27906]: pgmap v1533: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-04-23T15:39:41.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:41 smithi186 ceph-mon[31814]: pgmap v1533: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-04-23T15:39:41.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:41 smithi137 ceph-mon[31694]: pgmap v1533: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-04-23T15:39:42.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:42 smithi007 ceph-mon[27906]: pgmap v1534: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-04-23T15:39:42.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:42 smithi186 ceph-mon[31814]: pgmap v1534: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-04-23T15:39:42.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:42 smithi137 ceph-mon[31694]: pgmap v1534: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-04-23T15:39:43.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:39:43.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:39:43.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:43 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:39:43.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:39:43.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:39:43.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:43 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:39:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:39:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:39:43.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:43 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:39:44.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:44 smithi137 ceph-mon[31694]: pgmap v1535: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-04-23T15:39:44.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:44 smithi007 ceph-mon[27906]: pgmap v1535: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-04-23T15:39:44.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:44 smithi186 ceph-mon[31814]: pgmap v1535: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-04-23T15:39:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.346+0000 7fb496000640 1 -- 172.21.15.7:0/590636298 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55990cdda190 con 0x55990ceedf30 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.346+0000 7fb496000640 10 client.28372 handle_command_reply: tid=0 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 client.28372 shutdown 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 msgr2=0x55990ce7acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 0x55990ce7acf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb498033040 tx=0x7fb4980049d0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 shutdown_connections 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55990ceedf30 0x55990cef0350 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55990ce6cad0 0x55990ce7b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55990ce77390 0x55990ce7b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 --2- 172.21.15.7:0/590636298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55990ce6c1b0 0x55990ce7acf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb496000640 0 client.28372 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.347+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 >> 172.21.15.7:0/590636298 conn(0x55990ce686c0 msgr2=0x55990ce72710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.348+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 shutdown_connections 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.348+0000 7fb4b1c56740 1 -- 172.21.15.7:0/590636298 wait complete. 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.348+0000 7fb4b1c56740 20 client.28372 trim_cache size 0 max 16384 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:39:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:39:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb48c0a3f70 msgr2=0x7fb48c0a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb48c0a3f70 0x7fb48c0a6430 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4a81134c0 tx=0x7fb490005bf0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 msgr2=0x7fb4a8112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8112780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000b970 tx=0x7fb4a000be30 comp rx=0 tx=0).stop 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 shutdown_connections 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb48c0a3f70 0x7fb48c0a6430 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8115150 0x7fb4a8112780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4a8109920 0x7fb4a8112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 --2- 172.21.15.7:0/3304177978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a8109000 0x7fb4a8111d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 >> 172.21.15.7:0/3304177978 conn(0x7fb4a806d0d0 msgr2=0x7fb4a8070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 shutdown_connections 2024-04-23T15:39:45.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:45.349+0000 7fb4aee00640 1 -- 172.21.15.7:0/3304177978 wait complete. 2024-04-23T15:39:47.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:46 smithi186 ceph-mon[31814]: pgmap v1536: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 2.65k op/s 2024-04-23T15:39:47.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:46 smithi137 ceph-mon[31694]: pgmap v1536: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 2.65k op/s 2024-04-23T15:39:47.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:46 smithi007 ceph-mon[27906]: pgmap v1536: 129 pgs: 12 active+clean+snaptrim, 86 active+clean, 31 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 2.65k op/s 2024-04-23T15:39:49.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:48 smithi186 ceph-mon[31814]: pgmap v1537: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-04-23T15:39:49.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:48 smithi137 ceph-mon[31694]: pgmap v1537: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-04-23T15:39:49.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:48 smithi007 ceph-mon[27906]: pgmap v1537: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-04-23T15:39:51.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:50 smithi137 ceph-mon[31694]: pgmap v1538: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-04-23T15:39:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:50 smithi007 ceph-mon[27906]: pgmap v1538: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-04-23T15:39:51.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:50 smithi186 ceph-mon[31814]: pgmap v1538: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-04-23T15:39:53.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:52 smithi137 ceph-mon[31694]: pgmap v1539: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-04-23T15:39:53.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:52 smithi007 ceph-mon[27906]: pgmap v1539: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-04-23T15:39:53.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:52 smithi186 ceph-mon[31814]: pgmap v1539: 129 pgs: 11 active+clean+snaptrim, 93 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-04-23T15:39:55.164 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:54 smithi186 ceph-mon[31814]: pgmap v1540: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 3.09k op/s 2024-04-23T15:39:55.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:54 smithi137 ceph-mon[31694]: pgmap v1540: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 3.09k op/s 2024-04-23T15:39:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:54 smithi007 ceph-mon[27906]: pgmap v1540: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 3.09k op/s 2024-04-23T15:39:57.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:56 smithi137 ceph-mon[31694]: pgmap v1541: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:39:57.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:56 smithi007 ceph-mon[27906]: pgmap v1541: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:39:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:56 smithi186 ceph-mon[31814]: pgmap v1541: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:39:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.578+0000 7f2e67200640 1 -- 172.21.15.7:0/2000833804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c0a1640 msgr2=0x7f2e5c0a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.578+0000 7f2e67200640 1 --2- 172.21.15.7:0/2000833804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c0a1640 0x7f2e5c0a9210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e60067770 tx=0x7f2e600967b0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.579+0000 7f2e67200640 1 -- 172.21.15.7:0/2000833804 shutdown_connections 2024-04-23T15:39:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.579+0000 7f2e67200640 1 --2- 172.21.15.7:0/2000833804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c09cf20 0x7f2e5c0a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.579+0000 7f2e67200640 1 --2- 172.21.15.7:0/2000833804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c0a1640 0x7f2e5c0a9210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.579+0000 7f2e67200640 1 --2- 172.21.15.7:0/2000833804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c09c570 0x7f2e5c09c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.579+0000 7f2e67200640 1 -- 172.21.15.7:0/2000833804 >> 172.21.15.7:0/2000833804 conn(0x7f2e5c00c820 msgr2=0x7f2e5c09a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.580+0000 7f2e67200640 1 -- 172.21.15.7:0/2000833804 shutdown_connections 2024-04-23T15:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.580+0000 7f2e67200640 1 -- 172.21.15.7:0/2000833804 wait complete. 2024-04-23T15:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.581+0000 7f2e67200640 1 Processor -- start 2024-04-23T15:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.582+0000 7f2e67200640 1 -- start start 2024-04-23T15:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.583+0000 7f2e67200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c09c570 0x7f2e5c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.583+0000 7f2e67200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c0a1640 0x7f2e5c149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.583+0000 7f2e67200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c143900 0x7f2e5c143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.583+0000 7f2e67200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0ac530 con 0x7f2e5c143900 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.583+0000 7f2e67200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0ac3b0 con 0x7f2e5c0a1640 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.583+0000 7f2e67200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0ac6b0 con 0x7f2e5c09c570 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c09c570 0x7f2e5c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c09c570 0x7f2e5c149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50642/0 (socket says 172.21.15.7:50642) 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e65e00640 1 -- 172.21.15.7:0/3476611357 learned_addr learned my addr 172.21.15.7:0/3476611357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e66800640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c143900 0x7f2e5c143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e65400640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c0a1640 0x7f2e5c149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e66800640 1 -- 172.21.15.7:0/3476611357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c09c570 msgr2=0x7f2e5c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e66800640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c09c570 0x7f2e5c149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e66800640 1 -- 172.21.15.7:0/3476611357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c0a1640 msgr2=0x7f2e5c149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e66800640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c0a1640 0x7f2e5c149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.584+0000 7f2e66800640 1 -- 172.21.15.7:0/3476611357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c144420 con 0x7f2e5c143900 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.585+0000 7f2e66800640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c143900 0x7f2e5c143db0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f2e60067cb0 tx=0x7f2e6006b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.585+0000 7f2e5aa00640 1 -- 172.21.15.7:0/3476611357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6009c5f0 con 0x7f2e5c143900 2024-04-23T15:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.585+0000 7f2e5aa00640 1 -- 172.21.15.7:0/3476611357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e6009ce10 con 0x7f2e5c143900 2024-04-23T15:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.586+0000 7f2e5aa00640 1 -- 172.21.15.7:0/3476611357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e600626a0 con 0x7f2e5c143900 2024-04-23T15:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.587+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c1446b0 con 0x7f2e5c143900 2024-04-23T15:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.587+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c150850 con 0x7f2e5c143900 2024-04-23T15:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.592+0000 7f2e6b5f2740 1 Processor -- start 2024-04-23T15:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.593+0000 7f2e6b5f2740 1 -- start start 2024-04-23T15:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 0x557f299887a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e5aa00640 1 -- 172.21.15.7:0/3476611357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2e6006b5d0 con 0x7f2e5c143900 2024-04-23T15:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f29988ce0 0x557f29993060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f29995990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557f298ee900 con 0x557f299935a0 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557f29894f20 con 0x557f299883c0 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.594+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557f298ea8c0 con 0x557f29988ce0 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.595+0000 7f2e65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 0x557f299887a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.595+0000 7f2e65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 0x557f299887a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:60688/0 (socket says 172.21.15.7:60688) 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.595+0000 7f2e65400640 1 -- 172.21.15.7:0/1378787158 learned_addr learned my addr 172.21.15.7:0/1378787158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.595+0000 7f2e65400640 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f29995990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.596+0000 7f2e65e00640 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f29988ce0 0x557f29993060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.596+0000 7f2e65400640 1 -- 172.21.15.7:0/1378787158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f29988ce0 msgr2=0x557f29993060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.596+0000 7f2e65400640 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f29988ce0 0x557f29993060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.596+0000 7f2e65400640 1 -- 172.21.15.7:0/1378787158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 msgr2=0x557f29995990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.596+0000 7f2e65400640 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f29995990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.596+0000 7f2e65400640 1 -- 172.21.15.7:0/1378787158 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f298b9e10 con 0x557f299883c0 2024-04-23T15:39:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.597+0000 7f2e65400640 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 0x557f299887a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009fd0 tx=0x7f2e540094d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e062f17b80e49f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.597+0000 7f2e5aa00640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2e480a3e20 0x7f2e480a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.598+0000 7f2e4f000640 1 -- 172.21.15.7:0/1378787158 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e540135f0 con 0x557f299883c0 2024-04-23T15:39:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.598+0000 7f2e4f000640 1 -- 172.21.15.7:0/1378787158 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e5401d070 con 0x557f299883c0 2024-04-23T15:39:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.598+0000 7f2e4f000640 1 -- 172.21.15.7:0/1378787158 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e540188f0 con 0x557f299883c0 2024-04-23T15:39:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.598+0000 7f2e5aa00640 1 -- 172.21.15.7:0/3476611357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7f2e60152bc0 con 0x7f2e5c143900 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.599+0000 7f2e65e00640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2e480a3e20 0x7f2e480a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.600+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1378787158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 msgr2=0x557f299887a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.600+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 0x557f299887a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009fd0 tx=0x7f2e540094d0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.600+0000 7f2e65e00640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2e480a3e20 0x7f2e480a62e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x557f29989960 tx=0x7f2e5000b4a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.602+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1378787158 shutdown_connections 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.602+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f29995990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.602+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f29988ce0 0x557f29993060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.602+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1378787158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299883c0 0x557f299887a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.602+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1378787158 >> 172.21.15.7:0/1378787158 conn(0x557f299848d0 msgr2=0x557f29984cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.603+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1378787158 shutdown_connections 2024-04-23T15:39:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.603+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1378787158 wait complete. 2024-04-23T15:39:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.605+0000 7f2e6b5f2740 1 -- start start 2024-04-23T15:39:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.607+0000 7f2e6b5f2740 1 Processor -- start 2024-04-23T15:39:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.610+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299883c0 0x557f29990520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.611+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f29990a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.611+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 0x557f29990fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.611+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557f299a7180 con 0x557f299883c0 2024-04-23T15:39:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.611+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557f298a82c0 con 0x557f29988ce0 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.611+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x557f299a7300 con 0x557f299935a0 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.611+0000 7f2e6b5f2740 10 client.0 _ll_register_callbacks cb 0x557f29600a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.612+0000 7f2e66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 0x557f29990fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.612+0000 7f2e66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 0x557f29990fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50650/0 (socket says 172.21.15.7:50650) 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.612+0000 7f2e66800640 1 -- 172.21.15.7:0/483897331 learned_addr learned my addr 172.21.15.7:0/483897331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.612+0000 7f2e65400640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f29990a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.612+0000 7f2e65e00640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299883c0 0x557f29990520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.613+0000 7f2e66800640 1 -- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 msgr2=0x557f29990a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.613+0000 7f2e66800640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f29990a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.613+0000 7f2e66800640 1 -- 172.21.15.7:0/483897331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299883c0 msgr2=0x557f29990520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.613+0000 7f2e66800640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299883c0 0x557f29990520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.613+0000 7f2e66800640 1 -- 172.21.15.7:0/483897331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f298b8fd0 con 0x557f299935a0 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.613+0000 7f2e65400640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f29990a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:39:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.614+0000 7f2e66800640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 0x557f29990fa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e60050b40 tx=0x7f2e6011e230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216d177bfc8de36e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.614+0000 7f2e43400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:39:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.615+0000 7f2e43400640 1 -- 172.21.15.7:0/483897331 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e600a1070 con 0x557f299935a0 2024-04-23T15:39:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.616+0000 7f2e43400640 1 -- 172.21.15.7:0/483897331 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7f2e60126ed0 con 0x557f299935a0 2024-04-23T15:39:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.616+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e5401d070 con 0x557f299935a0 2024-04-23T15:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.617+0000 7f2e43400640 1 -- 172.21.15.7:0/483897331 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2e60150320 con 0x557f299935a0 2024-04-23T15:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.617+0000 7f2e6b5f2740 10 client.28384 fetch_fsmap learned FSMap version 32 2024-04-23T15:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.617+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557f29601210 con 0x557f299935a0 2024-04-23T15:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.620+0000 7f2e43400640 1 -- 172.21.15.7:0/483897331 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e5401d070 con 0x557f299935a0 2024-04-23T15:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.620+0000 7f2e43400640 1 -- 172.21.15.7:0/483897331 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2e6011db40 con 0x557f299935a0 2024-04-23T15:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.621+0000 7f2e6b5f2740 10 client.28384 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.621+0000 7f2e6b5f2740 10 client.28384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.621+0000 7f2e6b5f2740 20 client.28384 populate_metadata read hostname 'smithi007' 2024-04-23T15:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.621+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f299b4740 0x557f299b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.621+0000 7f2e6b5f2740 4 client.28384 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.621+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f298fc320 con 0x557f299b4740 2024-04-23T15:39:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.623+0000 7f2e65e00640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f299b4740 0x557f299b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.624+0000 7f2e65e00640 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f299b4740 0x557f299b6b50 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20962becc3e35c96 server_cookie=7e6d6519865d5172 in_seq=0 out_seq=0 2024-04-23T15:39:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.624+0000 7f2e43400640 10 client.28384 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.627+0000 7f2e43400640 1 -- 172.21.15.7:0/483897331 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f298fc320 con 0x557f299b4740 2024-04-23T15:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.627+0000 7f2e43400640 10 client.28384 handle_command_reply: tid=0 2024-04-23T15:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.627+0000 7f2e6b5f2740 1 client.28384 shutdown 2024-04-23T15:39:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 msgr2=0x557f29990fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 0x557f29990fa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e60050b40 tx=0x7f2e6011e230 comp rx=0 tx=0).stop 2024-04-23T15:39:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 shutdown_connections 2024-04-23T15:39:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f299b4740 0x557f299b6b50 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f29990a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299935a0 0x557f29990fa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/483897331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299883c0 0x557f29990520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 >> 172.21.15.7:0/483897331 conn(0x557f299848d0 msgr2=0x557f2998a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.630+0000 7f2e43400640 0 client.28384 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.631+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 shutdown_connections 2024-04-23T15:39:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.631+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/483897331 wait complete. 2024-04-23T15:39:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.631+0000 7f2e6b5f2740 20 client.28384 trim_cache size 0 max 16384 2024-04-23T15:39:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 Processor -- start 2024-04-23T15:39:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 -- start start 2024-04-23T15:39:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f299b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f299b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f299bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c151f20 con 0x557f299935a0 2024-04-23T15:39:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c153a60 con 0x557f29988ce0 2024-04-23T15:39:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.683+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c1525f0 con 0x557f299883c0 2024-04-23T15:39:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f299b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f299b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50660/0 (socket says 172.21.15.7:50660) 2024-04-23T15:39:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 -- 172.21.15.7:0/4126486542 learned_addr learned my addr 172.21.15.7:0/4126486542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65400640 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f299b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e66800640 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f299bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 -- 172.21.15.7:0/4126486542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 msgr2=0x557f299b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f299b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 -- 172.21.15.7:0/4126486542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 msgr2=0x557f299bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f299bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.685+0000 7f2e65e00640 1 -- 172.21.15.7:0/4126486542 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f296cd620 con 0x557f299883c0 2024-04-23T15:39:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.686+0000 7f2e65e00640 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f299b6b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x557f299b7400 tx=0x7f2e50016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef64ac05b7581ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.688+0000 7f2e4e600640 1 -- 172.21.15.7:0/4126486542 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50020e60 con 0x557f299883c0 2024-04-23T15:39:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.690+0000 7f2e4e600640 1 -- 172.21.15.7:0/4126486542 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e5002a920 con 0x557f299883c0 2024-04-23T15:39:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.691+0000 7f2e4e600640 1 -- 172.21.15.7:0/4126486542 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50020e60 con 0x557f299883c0 2024-04-23T15:39:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.692+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/4126486542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 msgr2=0x557f299b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:39:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.692+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f299b6b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x557f299b7400 tx=0x7f2e50016000 comp rx=0 tx=0).stop 2024-04-23T15:39:58.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/4126486542 shutdown_connections 2024-04-23T15:39:58.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f29988ce0 0x557f299b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f299935a0 0x557f299bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/4126486542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f299b6b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/4126486542 >> 172.21.15.7:0/4126486542 conn(0x557f299848d0 msgr2=0x557f29983a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:39:58.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/4126486542 shutdown_connections 2024-04-23T15:39:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.693+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/4126486542 wait complete. 2024-04-23T15:39:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.694+0000 7f2e6b5f2740 1 -- start start 2024-04-23T15:39:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.694+0000 7f2e6b5f2740 1 Processor -- start 2024-04-23T15:39:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.695+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f2998d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.695+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f29988ce0 0x557f2998d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.695+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f2998d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f2998d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50666/0 (socket says 172.21.15.7:50666) 2024-04-23T15:39:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e6b5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299935a0 0x557f2998df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c153390 con 0x557f29988ce0 2024-04-23T15:39:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c152cc0 con 0x557f299935a0 2024-04-23T15:39:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e6b5f2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0055c0 con 0x557f299883c0 2024-04-23T15:39:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e6b5f2740 10 client.0 _ll_register_callbacks cb 0x7f2e600679d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:39:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e65e00640 1 -- 172.21.15.7:0/1647761367 learned_addr learned my addr 172.21.15.7:0/1647761367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:39:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.696+0000 7f2e66800640 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299935a0 0x557f2998df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e65e00640 1 -- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299935a0 msgr2=0x557f2998df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e65e00640 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299935a0 0x557f2998df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e65e00640 1 -- 172.21.15.7:0/1647761367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f29988ce0 msgr2=0x557f2998d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:39:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e65e00640 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f29988ce0 0x557f2998d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:39:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e65e00640 1 -- 172.21.15.7:0/1647761367 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f29a19f70 con 0x557f299883c0 2024-04-23T15:39:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e65e00640 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f2998d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e500041a0 tx=0x7f2e50003de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4088eec6b9f1bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:39:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.697+0000 7f2e43400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:39:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.698+0000 7f2e43400640 1 -- 172.21.15.7:0/1647761367 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50038070 con 0x557f299883c0 2024-04-23T15:39:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.698+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f298f6190 con 0x557f299883c0 2024-04-23T15:39:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.698+0000 7f2e43400640 1 -- 172.21.15.7:0/1647761367 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9555+0+0 (secure 0 0 0) 0x7f2e5002a470 con 0x557f299883c0 2024-04-23T15:39:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.699+0000 7f2e43400640 1 -- 172.21.15.7:0/1647761367 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2e50042050 con 0x557f299883c0 2024-04-23T15:39:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.700+0000 7f2e6b5f2740 10 client.28390 fetch_fsmap learned FSMap version 32 2024-04-23T15:39:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.701+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557f29a1b260 con 0x557f299883c0 2024-04-23T15:39:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.701+0000 7f2e43400640 1 -- 172.21.15.7:0/1647761367 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x557f298f6190 con 0x557f299883c0 2024-04-23T15:39:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.701+0000 7f2e43400640 1 -- 172.21.15.7:0/1647761367 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f2e50004ae0 con 0x557f299883c0 2024-04-23T15:39:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.702+0000 7f2e6b5f2740 10 client.28390 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:39:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.702+0000 7f2e6b5f2740 10 client.28390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:39:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.702+0000 7f2e6b5f2740 20 client.28390 populate_metadata read hostname 'smithi007' 2024-04-23T15:39:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.702+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f29a1b9a0 0x557f29a1ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:39:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.702+0000 7f2e6b5f2740 4 client.28390 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:39:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.702+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f298724b0 con 0x557f29a1b9a0 2024-04-23T15:39:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.704+0000 7f2e65400640 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f29a1b9a0 0x557f29a1ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:39:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.706+0000 7f2e43400640 10 client.28390 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:39:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:39:58.711+0000 7f2e65400640 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f29a1b9a0 0x557f29a1ddc0 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5401f9c14b8adca server_cookie=c190d2180f6259fa in_seq=0 out_seq=0 2024-04-23T15:39:59.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:39:58 smithi137 ceph-mon[31694]: pgmap v1542: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 3.00k op/s 2024-04-23T15:39:59.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:39:58 smithi007 ceph-mon[27906]: pgmap v1542: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 3.00k op/s 2024-04-23T15:39:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:39:58 smithi186 ceph-mon[31814]: pgmap v1542: 129 pgs: 10 active+clean+snaptrim, 101 active+clean, 18 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 3.00k op/s 2024-04-23T15:40:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:00 smithi137 ceph-mon[31694]: pgmap v1543: 129 pgs: 9 active+clean+snaptrim, 108 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 2.97k op/s 2024-04-23T15:40:01.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:00 smithi137 ceph-mon[31694]: overall HEALTH_OK 2024-04-23T15:40:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:00 smithi007 ceph-mon[27906]: pgmap v1543: 129 pgs: 9 active+clean+snaptrim, 108 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 2.97k op/s 2024-04-23T15:40:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:00 smithi007 ceph-mon[27906]: overall HEALTH_OK 2024-04-23T15:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:00 smithi186 ceph-mon[31814]: pgmap v1543: 129 pgs: 9 active+clean+snaptrim, 108 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 2.97k op/s 2024-04-23T15:40:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:00 smithi186 ceph-mon[31814]: overall HEALTH_OK 2024-04-23T15:40:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:02 smithi007 ceph-mon[27906]: pgmap v1544: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-04-23T15:40:03.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:02 smithi186 ceph-mon[31814]: pgmap v1544: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-04-23T15:40:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:02 smithi137 ceph-mon[31694]: pgmap v1544: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 12 MiB/s wr, 2.99k op/s 2024-04-23T15:40:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.093+0000 7f2e43400640 1 -- 172.21.15.7:0/1647761367 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f298724b0 con 0x557f29a1b9a0 2024-04-23T15:40:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.093+0000 7f2e43400640 10 client.28390 handle_command_reply: tid=0 2024-04-23T15:40:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.093+0000 7f2e6b5f2740 1 client.28390 shutdown 2024-04-23T15:40:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.093+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 msgr2=0x557f2998d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.093+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f2998d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e500041a0 tx=0x7f2e50003de0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 shutdown_connections 2024-04-23T15:40:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x557f29a1b9a0 0x557f29a1ddc0 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f299935a0 0x557f2998df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e43400640 0 client.28390 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557f29988ce0 0x557f2998d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e6b5f2740 1 --2- 172.21.15.7:0/1647761367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557f299883c0 0x557f2998d490 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.094+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 >> 172.21.15.7:0/1647761367 conn(0x557f299848d0 msgr2=0x557f29989d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.095+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 shutdown_connections 2024-04-23T15:40:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.096+0000 7f2e6b5f2740 1 -- 172.21.15.7:0/1647761367 wait complete. 2024-04-23T15:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.096+0000 7f2e6b5f2740 20 client.28390 trim_cache size 0 max 16384 2024-04-23T15:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:40:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:40:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.097+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2e480a3e20 msgr2=0x7f2e480a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.097+0000 7f2e67200640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2e480a3e20 0x7f2e480a62e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x557f29989960 tx=0x7f2e5000b4a0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.097+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c143900 msgr2=0x7f2e5c143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.097+0000 7f2e67200640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c143900 0x7f2e5c143db0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f2e60067cb0 tx=0x7f2e6006b4e0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.097+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 shutdown_connections 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f2e480a3e20 0x7f2e480a62e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c0a1640 0x7f2e5c149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e5c143900 0x7f2e5c143db0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 --2- 172.21.15.7:0/3476611357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e5c09c570 0x7f2e5c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 >> 172.21.15.7:0/3476611357 conn(0x7f2e5c00c820 msgr2=0x7f2e5c00a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 shutdown_connections 2024-04-23T15:40:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:05.098+0000 7f2e67200640 1 -- 172.21.15.7:0/3476611357 wait complete. 2024-04-23T15:40:05.221 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:04 smithi137 ceph-mon[31694]: pgmap v1545: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:40:05.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:04 smithi007 ceph-mon[27906]: pgmap v1545: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:40:05.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:04 smithi186 ceph-mon[31814]: pgmap v1545: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 10 MiB/s wr, 2.66k op/s 2024-04-23T15:40:07.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:06 smithi007 ceph-mon[27906]: pgmap v1546: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 2.48k op/s 2024-04-23T15:40:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:06 smithi186 ceph-mon[31814]: pgmap v1546: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 2.48k op/s 2024-04-23T15:40:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:06 smithi137 ceph-mon[31694]: pgmap v1546: 129 pgs: 8 active+clean+snaptrim, 109 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 2.48k op/s 2024-04-23T15:40:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:08 smithi007 ceph-mon[27906]: pgmap v1547: 129 pgs: 7 active+clean+snaptrim, 110 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 12 MiB/s wr, 3.14k op/s 2024-04-23T15:40:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:08 smithi007 ceph-mon[27906]: osdmap e176: 12 total, 12 up, 12 in 2024-04-23T15:40:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:08 smithi186 ceph-mon[31814]: pgmap v1547: 129 pgs: 7 active+clean+snaptrim, 110 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 12 MiB/s wr, 3.14k op/s 2024-04-23T15:40:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:08 smithi186 ceph-mon[31814]: osdmap e176: 12 total, 12 up, 12 in 2024-04-23T15:40:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:08 smithi137 ceph-mon[31694]: pgmap v1547: 129 pgs: 7 active+clean+snaptrim, 110 active+clean, 12 active+clean+snaptrim_wait; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 12 MiB/s wr, 3.14k op/s 2024-04-23T15:40:09.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:08 smithi137 ceph-mon[31694]: osdmap e176: 12 total, 12 up, 12 in 2024-04-23T15:40:11.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:10 smithi007 ceph-mon[27906]: pgmap v1549: 129 pgs: 12 active+clean+snaptrim, 90 active+clean, 27 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 10 MiB/s wr, 2.64k op/s 2024-04-23T15:40:11.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:10 smithi186 ceph-mon[31814]: pgmap v1549: 129 pgs: 12 active+clean+snaptrim, 90 active+clean, 27 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 10 MiB/s wr, 2.64k op/s 2024-04-23T15:40:11.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:10 smithi137 ceph-mon[31694]: pgmap v1549: 129 pgs: 12 active+clean+snaptrim, 90 active+clean, 27 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 10 MiB/s wr, 2.64k op/s 2024-04-23T15:40:13.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:12 smithi007 ceph-mon[27906]: pgmap v1550: 129 pgs: 16 active+clean+snaptrim, 66 active+clean, 47 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-04-23T15:40:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:12 smithi186 ceph-mon[31814]: pgmap v1550: 129 pgs: 16 active+clean+snaptrim, 66 active+clean, 47 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-04-23T15:40:13.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:12 smithi137 ceph-mon[31694]: pgmap v1550: 129 pgs: 16 active+clean+snaptrim, 66 active+clean, 47 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 12 MiB/s wr, 2.95k op/s 2024-04-23T15:40:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:14 smithi007 ceph-mon[27906]: pgmap v1551: 129 pgs: 15 active+clean+snaptrim, 67 active+clean, 47 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-04-23T15:40:15.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:14 smithi186 ceph-mon[31814]: pgmap v1551: 129 pgs: 15 active+clean+snaptrim, 67 active+clean, 47 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-04-23T15:40:15.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:14 smithi137 ceph-mon[31694]: pgmap v1551: 129 pgs: 15 active+clean+snaptrim, 67 active+clean, 47 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-04-23T15:40:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:17 smithi007 ceph-mon[27906]: pgmap v1552: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-04-23T15:40:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:17 smithi186 ceph-mon[31814]: pgmap v1552: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-04-23T15:40:17.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:17 smithi137 ceph-mon[31694]: pgmap v1552: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-04-23T15:40:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.315+0000 7f614ec00640 1 -- 172.21.15.7:0/2565867639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148076e50 msgr2=0x7f6148112950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.315+0000 7f614ec00640 1 --2- 172.21.15.7:0/2565867639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148076e50 0x7f6148112950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6134009930 tx=0x7f613402a440 comp rx=0 tx=0).stop 2024-04-23T15:40:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.317+0000 7f614ec00640 1 -- 172.21.15.7:0/2565867639 shutdown_connections 2024-04-23T15:40:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.317+0000 7f614ec00640 1 --2- 172.21.15.7:0/2565867639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6148112e90 0x7f6148115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.317+0000 7f614ec00640 1 --2- 172.21.15.7:0/2565867639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148076e50 0x7f6148112950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.317+0000 7f614ec00640 1 --2- 172.21.15.7:0/2565867639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076530 0x7f6148076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.317+0000 7f614ec00640 1 -- 172.21.15.7:0/2565867639 >> 172.21.15.7:0/2565867639 conn(0x7f61480ffd00 msgr2=0x7f6148102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:18.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.321+0000 7f614ec00640 1 -- 172.21.15.7:0/2565867639 shutdown_connections 2024-04-23T15:40:18.322 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.321+0000 7f614ec00640 1 -- 172.21.15.7:0/2565867639 wait complete. 2024-04-23T15:40:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.322+0000 7f614ec00640 1 Processor -- start 2024-04-23T15:40:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 -- start start 2024-04-23T15:40:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6148076530 0x7f614819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076e50 0x7f614819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 0x7f61481a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61481188f0 con 0x7f6148076530 2024-04-23T15:40:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6148118770 con 0x7f6148076e50 2024-04-23T15:40:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.325+0000 7f614ec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6148118a70 con 0x7f6148112e90 2024-04-23T15:40:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.326+0000 7f614cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 0x7f61481a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.326+0000 7f614cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 0x7f61481a36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:60494/0 (socket says 172.21.15.7:60494) 2024-04-23T15:40:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.326+0000 7f614cc00640 1 -- 172.21.15.7:0/3361227578 learned_addr learned my addr 172.21.15.7:0/3361227578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.326+0000 7f6147400640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076e50 0x7f614819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f614cc00640 1 -- 172.21.15.7:0/3361227578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076e50 msgr2=0x7f614819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f614cc00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076e50 0x7f614819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f614cc00640 1 -- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6148076530 msgr2=0x7f614819edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f614cc00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6148076530 0x7f614819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f614cc00640 1 -- 172.21.15.7:0/3361227578 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61481a3de0 con 0x7f6148112e90 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f6147400640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076e50 0x7f614819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:40:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f614cc00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 0x7f61481a36b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6140009c90 tx=0x7f614000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.327+0000 7f6144c00640 1 -- 172.21.15.7:0/3361227578 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140003b70 con 0x7f6148112e90 2024-04-23T15:40:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.328+0000 7f6144c00640 1 -- 172.21.15.7:0/3361227578 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6140003d10 con 0x7f6148112e90 2024-04-23T15:40:18.329 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.328+0000 7f6144c00640 1 -- 172.21.15.7:0/3361227578 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400108c0 con 0x7f6148112e90 2024-04-23T15:40:18.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.328+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61481a40d0 con 0x7f6148112e90 2024-04-23T15:40:18.330 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.328+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61481ab960 con 0x7f6148112e90 2024-04-23T15:40:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.336+0000 7f6144c00640 1 -- 172.21.15.7:0/3361227578 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f6140004020 con 0x7f6148112e90 2024-04-23T15:40:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.340+0000 7f6151a20740 1 Processor -- start 2024-04-23T15:40:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.340+0000 7f6151a20740 1 -- start start 2024-04-23T15:40:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.340+0000 7f6151a20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 0x556742ca1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.340+0000 7f6151a20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742cabe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.341+0000 7f6151a20740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742cac390 0x556742cae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.341+0000 7f6151a20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556742c07900 con 0x556742ca1ad0 2024-04-23T15:40:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.341+0000 7f6151a20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556742badf20 con 0x556742ca11b0 2024-04-23T15:40:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.341+0000 7f6151a20740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556742c038c0 con 0x556742cac390 2024-04-23T15:40:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.341+0000 7f6147e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742cabe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.342+0000 7f6147400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 0x556742ca1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.342+0000 7f6147400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 0x556742ca1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:40414/0 (socket says 172.21.15.7:40414) 2024-04-23T15:40:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.342+0000 7f6147400640 1 -- 172.21.15.7:0/1558562491 learned_addr learned my addr 172.21.15.7:0/1558562491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.342+0000 7f6147400640 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742cac390 0x556742cae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.343+0000 7f6144c00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f612c0a3f10 0x7f612c0a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.344+0000 7f6144c00640 1 -- 172.21.15.7:0/3361227578 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7f61400d13c0 con 0x7f6148112e90 2024-04-23T15:40:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.344+0000 7f6147400640 1 -- 172.21.15.7:0/1558562491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742cac390 msgr2=0x556742cae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.344+0000 7f6147400640 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742cac390 0x556742cae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.344+0000 7f6147400640 1 -- 172.21.15.7:0/1558562491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 msgr2=0x556742cabe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.344+0000 7f6147400640 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742cabe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.344+0000 7f6147400640 1 -- 172.21.15.7:0/1558562491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556742bd2e10 con 0x556742ca11b0 2024-04-23T15:40:18.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.345+0000 7f6147400640 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 0x556742ca1590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6134005ab0 tx=0x7f6134000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834beef64f3d4754 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:18.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.345+0000 7f614cc00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f612c0a3f10 0x7f612c0a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.345+0000 7f613d200640 1 -- 172.21.15.7:0/1558562491 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134035040 con 0x556742ca11b0 2024-04-23T15:40:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.346+0000 7f613d200640 1 -- 172.21.15.7:0/1558562491 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61340046c0 con 0x556742ca11b0 2024-04-23T15:40:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.346+0000 7f613d200640 1 -- 172.21.15.7:0/1558562491 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134003950 con 0x556742ca11b0 2024-04-23T15:40:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.348+0000 7f6151a20740 1 -- 172.21.15.7:0/1558562491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 msgr2=0x556742ca1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.348+0000 7f614cc00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f612c0a3f10 0x7f612c0a63d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f61400a55f0 tx=0x7f6140009f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.348+0000 7f6151a20740 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 0x556742ca1590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6134005ab0 tx=0x7f6134000bc0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 -- 172.21.15.7:0/1558562491 shutdown_connections 2024-04-23T15:40:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742cac390 0x556742cae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742cabe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 --2- 172.21.15.7:0/1558562491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742ca11b0 0x556742ca1590 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 -- 172.21.15.7:0/1558562491 >> 172.21.15.7:0/1558562491 conn(0x556742c9d6c0 msgr2=0x556742c9daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 -- 172.21.15.7:0/1558562491 shutdown_connections 2024-04-23T15:40:18.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.349+0000 7f6151a20740 1 -- 172.21.15.7:0/1558562491 wait complete. 2024-04-23T15:40:18.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.350+0000 7f6151a20740 1 -- start start 2024-04-23T15:40:18.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.350+0000 7f6151a20740 1 Processor -- start 2024-04-23T15:40:18.352 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742ca9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556742cbff70 con 0x556742ca1ad0 2024-04-23T15:40:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556742bc12c0 con 0x556742cac390 2024-04-23T15:40:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x556742cc00f0 con 0x556742ca11b0 2024-04-23T15:40:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.351+0000 7f6151a20740 10 client.0 _ll_register_callbacks cb 0x556742919a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:40:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.352+0000 7f6147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.352+0000 7f6147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:60500/0 (socket says 172.21.15.7:60500) 2024-04-23T15:40:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.352+0000 7f6147400640 1 -- 172.21.15.7:0/2289211441 learned_addr learned my addr 172.21.15.7:0/2289211441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.352+0000 7f6147400640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742ca9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.352+0000 7f6147e00640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.353+0000 7f6147400640 1 -- 172.21.15.7:0/2289211441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 msgr2=0x556742ca9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.353+0000 7f6147400640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.353+0000 7f6147400640 1 -- 172.21.15.7:0/2289211441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 msgr2=0x556742ca98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.353+0000 7f6147400640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.353+0000 7f6147400640 1 -- 172.21.15.7:0/2289211441 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556742bd1fd0 con 0x556742cac390 2024-04-23T15:40:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.355+0000 7f6147e00640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:40:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.355+0000 7f6147400640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742ca9df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6134009850 tx=0x7f6134031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00f55af9d4b4b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.356+0000 7f6131600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:40:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.356+0000 7f6131600640 1 -- 172.21.15.7:0/2289211441 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134035040 con 0x556742cac390 2024-04-23T15:40:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.356+0000 7f6131600640 1 -- 172.21.15.7:0/2289211441 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7f61340054e0 con 0x556742cac390 2024-04-23T15:40:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.357+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61340046c0 con 0x556742cac390 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.357+0000 7f6131600640 1 -- 172.21.15.7:0/2289211441 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f61340036f0 con 0x556742cac390 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.357+0000 7f6151a20740 10 client.38279 fetch_fsmap learned FSMap version 32 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.357+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55674291a210 con 0x556742cac390 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.358+0000 7f6131600640 1 -- 172.21.15.7:0/2289211441 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61340046c0 con 0x556742cac390 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6131600640 1 -- 172.21.15.7:0/2289211441 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6134054070 con 0x556742cac390 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6151a20740 10 client.38279 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:40:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6151a20740 10 client.38279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:40:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6151a20740 20 client.38279 populate_metadata read hostname 'smithi007' 2024-04-23T15:40:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6151a20740 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742ccd3a0 0x556742ccf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6151a20740 4 client.38279 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:40:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.361+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556742c15320 con 0x556742ccd3a0 2024-04-23T15:40:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.362+0000 7f6147e00640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742ccd3a0 0x556742ccf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.363+0000 7f6147e00640 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742ccd3a0 0x556742ccf790 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c15658e31287a9 server_cookie=45eaf698721c9fe6 in_seq=0 out_seq=0 2024-04-23T15:40:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.363+0000 7f6131600640 10 client.38279 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.364+0000 7f6131600640 1 -- 172.21.15.7:0/2289211441 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556742c15320 con 0x556742ccd3a0 2024-04-23T15:40:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6131600640 10 client.38279 handle_command_reply: tid=0 2024-04-23T15:40:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6151a20740 1 client.38279 shutdown 2024-04-23T15:40:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 msgr2=0x556742ca9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6151a20740 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742ca9df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6134009850 tx=0x7f6134031400 comp rx=0 tx=0).stop 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 shutdown_connections 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6151a20740 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742ccd3a0 0x556742ccf790 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.365+0000 7f6151a20740 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742ca9df0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.366+0000 7f6151a20740 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.366+0000 7f6151a20740 1 --2- 172.21.15.7:0/2289211441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.366+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 >> 172.21.15.7:0/2289211441 conn(0x556742c9d6c0 msgr2=0x556742ca3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.366+0000 7f6131600640 0 client.38279 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.366+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 shutdown_connections 2024-04-23T15:40:18.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.366+0000 7f6151a20740 1 -- 172.21.15.7:0/2289211441 wait complete. 2024-04-23T15:40:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.369+0000 7f6151a20740 20 client.38279 trim_cache size 0 max 16384 2024-04-23T15:40:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.407+0000 7f6151a20740 1 Processor -- start 2024-04-23T15:40:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.407+0000 7f6151a20740 1 -- start start 2024-04-23T15:40:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.408+0000 7f6151a20740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.408+0000 7f6151a20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.408+0000 7f6151a20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742cd27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.408+0000 7f6151a20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61481ad460 con 0x556742ca1ad0 2024-04-23T15:40:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.408+0000 7f6151a20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61481aefa0 con 0x556742cac390 2024-04-23T15:40:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.408+0000 7f6151a20740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f61481adb30 con 0x556742ca11b0 2024-04-23T15:40:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.409+0000 7f6147e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.409+0000 7f6147e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40250/0 (socket says 172.21.15.7:40250) 2024-04-23T15:40:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.409+0000 7f6147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.409+0000 7f6147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:60512/0 (socket says 172.21.15.7:60512) 2024-04-23T15:40:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.410+0000 7f6147400640 1 -- 172.21.15.7:0/887901599 learned_addr learned my addr 172.21.15.7:0/887901599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.410+0000 7f6147400640 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742cd27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.411+0000 7f6147400640 1 -- 172.21.15.7:0/887901599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 msgr2=0x556742cd27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.411+0000 7f6147400640 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742cd27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.411+0000 7f6147400640 1 -- 172.21.15.7:0/887901599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 msgr2=0x556742ca9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.411+0000 7f6147400640 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.412+0000 7f6147400640 1 -- 172.21.15.7:0/887901599 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567429e6620 con 0x556742ca11b0 2024-04-23T15:40:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.412+0000 7f6147e00640 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:40:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.415+0000 7f6147400640 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca3b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6134054870 tx=0x7f613402a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6deaee1afdfb0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.416+0000 7f6133e00640 1 -- 172.21.15.7:0/887901599 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613405b080 con 0x556742ca11b0 2024-04-23T15:40:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.416+0000 7f6133e00640 1 -- 172.21.15.7:0/887901599 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f613404e070 con 0x556742ca11b0 2024-04-23T15:40:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.416+0000 7f6133e00640 1 -- 172.21.15.7:0/887901599 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61340036f0 con 0x556742ca11b0 2024-04-23T15:40:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.417+0000 7f6151a20740 1 -- 172.21.15.7:0/887901599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 msgr2=0x556742ca3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.417+0000 7f6151a20740 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca3b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6134054870 tx=0x7f613402a440 comp rx=0 tx=0).stop 2024-04-23T15:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.418+0000 7f6151a20740 1 -- 172.21.15.7:0/887901599 shutdown_connections 2024-04-23T15:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.418+0000 7f6151a20740 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742cd27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.418+0000 7f6151a20740 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742ca9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.418+0000 7f6151a20740 1 --2- 172.21.15.7:0/887901599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742ca3b70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.418+0000 7f6151a20740 1 -- 172.21.15.7:0/887901599 >> 172.21.15.7:0/887901599 conn(0x556742c9d6c0 msgr2=0x556742c9c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.420+0000 7f6151a20740 1 -- 172.21.15.7:0/887901599 shutdown_connections 2024-04-23T15:40:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.420+0000 7f6151a20740 1 -- 172.21.15.7:0/887901599 wait complete. 2024-04-23T15:40:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.421+0000 7f6151a20740 1 -- start start 2024-04-23T15:40:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.421+0000 7f6151a20740 1 Processor -- start 2024-04-23T15:40:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.422+0000 7f6151a20740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742d2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6151a20740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742d2be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6151a20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742d2c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6151a20740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f61481ae8d0 con 0x556742ca1ad0 2024-04-23T15:40:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6151a20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61481ae200 con 0x556742cac390 2024-04-23T15:40:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6151a20740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6148073b10 con 0x556742ca11b0 2024-04-23T15:40:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6151a20740 10 client.0 _ll_register_callbacks cb 0x7f6134009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:40:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742d2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742d2b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:60526/0 (socket says 172.21.15.7:60526) 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.423+0000 7f6147400640 1 -- 172.21.15.7:0/2745921954 learned_addr learned my addr 172.21.15.7:0/2745921954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147e00640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742d2be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147400640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742d2c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147400640 1 -- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 msgr2=0x556742d2c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147400640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742d2c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147400640 1 -- 172.21.15.7:0/2745921954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 msgr2=0x556742d2be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147400640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742d2be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147400640 1 -- 172.21.15.7:0/2745921954 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556742cd1a30 con 0x556742ca11b0 2024-04-23T15:40:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.424+0000 7f6147e00640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742d2be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:40:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.425+0000 7f6147400640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742d2b940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6134004360 tx=0x7f6134005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d075621a5325517a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.425+0000 7f6131600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.425+0000 7f6131600640 1 -- 172.21.15.7:0/2745921954 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613405b070 con 0x556742ca11b0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.425+0000 7f6131600640 1 -- 172.21.15.7:0/2745921954 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7f613403b750 con 0x556742ca11b0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.425+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f613404e070 con 0x556742ca11b0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.426+0000 7f6131600640 1 -- 172.21.15.7:0/2745921954 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6134072050 con 0x556742ca11b0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.426+0000 7f6151a20740 10 client.28408 fetch_fsmap learned FSMap version 32 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.426+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556742cd2d40 con 0x556742ca11b0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6131600640 1 -- 172.21.15.7:0/2745921954 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f613404e070 con 0x556742ca11b0 2024-04-23T15:40:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6131600640 1 -- 172.21.15.7:0/2745921954 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f6134054070 con 0x556742ca11b0 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6151a20740 10 client.28408 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6151a20740 10 client.28408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6151a20740 20 client.28408 populate_metadata read hostname 'smithi007' 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6151a20740 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742d44580 0x556742d46970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6151a20740 4 client.28408 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.427+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556742c0f190 con 0x556742d44580 2024-04-23T15:40:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.428+0000 7f6147e00640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742d44580 0x556742d46970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.429+0000 7f6147e00640 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742d44580 0x556742d46970 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e23e70435998c60 server_cookie=8f20e43d344f8efd in_seq=0 out_seq=0 2024-04-23T15:40:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:18.429+0000 7f6131600640 10 client.28408 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:19.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:19 smithi007 ceph-mon[27906]: pgmap v1553: 129 pgs: 10 active+clean+snaptrim, 85 active+clean, 34 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 2.84k op/s 2024-04-23T15:40:19.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:19 smithi186 ceph-mon[31814]: pgmap v1553: 129 pgs: 10 active+clean+snaptrim, 85 active+clean, 34 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 2.84k op/s 2024-04-23T15:40:19.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:19 smithi137 ceph-mon[31694]: pgmap v1553: 129 pgs: 10 active+clean+snaptrim, 85 active+clean, 34 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 2.84k op/s 2024-04-23T15:40:20.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.409+0000 7f6131600640 1 -- 172.21.15.7:0/2745921954 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556742c0f190 con 0x556742d44580 2024-04-23T15:40:20.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.409+0000 7f6131600640 10 client.28408 handle_command_reply: tid=0 2024-04-23T15:40:20.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.409+0000 7f6151a20740 1 client.28408 shutdown 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 msgr2=0x556742d2b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742d2b940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6134004360 tx=0x7f6134005d50 comp rx=0 tx=0).stop 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 shutdown_connections 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x556742d44580 0x556742d46970 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556742cac390 0x556742d2c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556742ca1ad0 0x556742d2be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 --2- 172.21.15.7:0/2745921954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556742ca11b0 0x556742d2b940 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 >> 172.21.15.7:0/2745921954 conn(0x556742c9d6c0 msgr2=0x556742cc8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:20.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.410+0000 7f6131600640 0 client.28408 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.411+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 shutdown_connections 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.411+0000 7f6151a20740 1 -- 172.21.15.7:0/2745921954 wait complete. 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.411+0000 7f6151a20740 20 client.28408 trim_cache size 0 max 16384 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:40:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:40:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.412+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f612c0a3f10 msgr2=0x7f612c0a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.412+0000 7f614ec00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f612c0a3f10 0x7f612c0a63d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f61400a55f0 tx=0x7f6140009f90 comp rx=0 tx=0).stop 2024-04-23T15:40:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 msgr2=0x7f61481a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 0x7f61481a36b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6140009c90 tx=0x7f614000c6a0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 shutdown_connections 2024-04-23T15:40:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f612c0a3f10 0x7f612c0a63d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6148076e50 0x7f614819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6148112e90 0x7f61481a36b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 --2- 172.21.15.7:0/3361227578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6148076530 0x7f614819edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 >> 172.21.15.7:0/3361227578 conn(0x7f61480ffd00 msgr2=0x7f6148114510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 shutdown_connections 2024-04-23T15:40:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:20.413+0000 7f614ec00640 1 -- 172.21.15.7:0/3361227578 wait complete. 2024-04-23T15:40:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:21 smithi007 ceph-mon[27906]: pgmap v1554: 129 pgs: 6 active+clean+snaptrim, 104 active+clean, 19 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:40:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:21 smithi186 ceph-mon[31814]: pgmap v1554: 129 pgs: 6 active+clean+snaptrim, 104 active+clean, 19 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:40:21.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:21 smithi137 ceph-mon[31694]: pgmap v1554: 129 pgs: 6 active+clean+snaptrim, 104 active+clean, 19 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:40:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:23 smithi007 ceph-mon[27906]: pgmap v1555: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 13 MiB/s wr, 3.19k op/s 2024-04-23T15:40:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:23 smithi186 ceph-mon[31814]: pgmap v1555: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 13 MiB/s wr, 3.19k op/s 2024-04-23T15:40:23.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:23 smithi137 ceph-mon[31694]: pgmap v1555: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 13 MiB/s wr, 3.19k op/s 2024-04-23T15:40:25.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:25 smithi007 ceph-mon[27906]: pgmap v1556: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:40:25.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:25 smithi186 ceph-mon[31814]: pgmap v1556: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:40:25.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:25 smithi137 ceph-mon[31694]: pgmap v1556: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:40:27.040 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:27 smithi186 ceph-mon[31814]: pgmap v1557: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-04-23T15:40:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:27 smithi007 ceph-mon[27906]: pgmap v1557: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-04-23T15:40:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:27 smithi137 ceph-mon[31694]: pgmap v1557: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-04-23T15:40:29.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:29 smithi007 ceph-mon[27906]: pgmap v1558: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-04-23T15:40:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:29 smithi186 ceph-mon[31814]: pgmap v1558: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-04-23T15:40:29.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:29 smithi137 ceph-mon[31694]: pgmap v1558: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-04-23T15:40:31.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:31 smithi007 ceph-mon[27906]: pgmap v1559: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:40:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:31 smithi186 ceph-mon[31814]: pgmap v1559: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:40:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:31 smithi137 ceph-mon[31694]: pgmap v1559: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:40:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:33 smithi007 ceph-mon[27906]: pgmap v1560: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 3.01k op/s 2024-04-23T15:40:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:33 smithi186 ceph-mon[31814]: pgmap v1560: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 3.01k op/s 2024-04-23T15:40:33.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:33 smithi137 ceph-mon[31694]: pgmap v1560: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 3.01k op/s 2024-04-23T15:40:33.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 -- 172.21.15.7:0/3540978896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68100a90 msgr2=0x7f3a6810ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 --2- 172.21.15.7:0/3540978896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68100a90 0x7f3a6810ed90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009cd0 tx=0x7f3a6002a8f0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 -- 172.21.15.7:0/3540978896 shutdown_connections 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 --2- 172.21.15.7:0/3540978896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68100a90 0x7f3a6810ed90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 --2- 172.21.15.7:0/3540978896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 --2- 172.21.15.7:0/3540978896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a68107120 0x7f3a68107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.710+0000 7f3a6d000640 1 -- 172.21.15.7:0/3540978896 >> 172.21.15.7:0/3540978896 conn(0x7f3a68077000 msgr2=0x7f3a680fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.711+0000 7f3a6d000640 1 -- 172.21.15.7:0/3540978896 shutdown_connections 2024-04-23T15:40:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.711+0000 7f3a6d000640 1 -- 172.21.15.7:0/3540978896 wait complete. 2024-04-23T15:40:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 Processor -- start 2024-04-23T15:40:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 -- start start 2024-04-23T15:40:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a68100a90 0x7f3a68109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68107120 0x7f3a681ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6806d0f0 con 0x7f3a681000d0 2024-04-23T15:40:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6806cf70 con 0x7f3a68100a90 2024-04-23T15:40:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.712+0000 7f3a6d000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6806d270 con 0x7f3a68107120 2024-04-23T15:40:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.713+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.713+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52108/0 (socket says 172.21.15.7:52108) 2024-04-23T15:40:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.713+0000 7f3a65e00640 1 -- 172.21.15.7:0/710982635 learned_addr learned my addr 172.21.15.7:0/710982635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.713+0000 7f3a66800640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68107120 0x7f3a681ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.714+0000 7f3a65400640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a68100a90 0x7f3a68109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.714+0000 7f3a65e00640 1 -- 172.21.15.7:0/710982635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68107120 msgr2=0x7f3a681ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.714+0000 7f3a65e00640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68107120 0x7f3a681ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.714+0000 7f3a65e00640 1 -- 172.21.15.7:0/710982635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a68100a90 msgr2=0x7f3a68109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.714+0000 7f3a65e00640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a68100a90 0x7f3a68109b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.714+0000 7f3a65e00640 1 -- 172.21.15.7:0/710982635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a681aced0 con 0x7f3a681000d0 2024-04-23T15:40:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.715+0000 7f3a65e00640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68109640 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800d770 tx=0x7f3a5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.716+0000 7f3a5ea00640 1 -- 172.21.15.7:0/710982635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58017070 con 0x7f3a681000d0 2024-04-23T15:40:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.716+0000 7f3a5ea00640 1 -- 172.21.15.7:0/710982635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a58009c30 con 0x7f3a681000d0 2024-04-23T15:40:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.716+0000 7f3a5ea00640 1 -- 172.21.15.7:0/710982635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58003d00 con 0x7f3a681000d0 2024-04-23T15:40:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.716+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a68101ad0 con 0x7f3a681000d0 2024-04-23T15:40:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.716+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a68101fd0 con 0x7f3a681000d0 2024-04-23T15:40:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.721+0000 7f3a6fe4a740 1 Processor -- start 2024-04-23T15:40:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 -- start start 2024-04-23T15:40:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4909279c0 0x55d490927da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909282e0 0x55d490932660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490934f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d490885900 con 0x55d490932ba0 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d49082bf20 con 0x55d4909282e0 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.722+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d4908818c0 con 0x55d4909279c0 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.723+0000 7f3a66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4909279c0 0x55d490927da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.723+0000 7f3a66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4909279c0 0x55d490927da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:58740/0 (socket says 172.21.15.7:58740) 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.723+0000 7f3a66800640 1 -- 172.21.15.7:0/621933206 learned_addr learned my addr 172.21.15.7:0/621933206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.723+0000 7f3a5ea00640 1 -- 172.21.15.7:0/710982635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3a58003ea0 con 0x7f3a681000d0 2024-04-23T15:40:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.724+0000 7f3a65400640 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490934f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.725+0000 7f3a65e00640 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909282e0 0x55d490932660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.726+0000 7f3a65400640 1 -- 172.21.15.7:0/621933206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4909279c0 msgr2=0x55d490927da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.726+0000 7f3a65400640 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4909279c0 0x55d490927da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.726+0000 7f3a65400640 1 -- 172.21.15.7:0/621933206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909282e0 msgr2=0x55d490932660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.726+0000 7f3a65400640 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909282e0 0x55d490932660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.726+0000 7f3a65400640 1 -- 172.21.15.7:0/621933206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d490850e10 con 0x55d490932ba0 2024-04-23T15:40:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.727+0000 7f3a65400640 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490934f90 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3a6810acb0 tx=0x7f3a540107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bed5e9c4a09361a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.729+0000 7f3a5ea00640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a4c0a3e40 0x7f3a4c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.729+0000 7f3a5ea00640 1 -- 172.21.15.7:0/710982635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7f3a580d03b0 con 0x7f3a681000d0 2024-04-23T15:40:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.730+0000 7f3a66800640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a4c0a3e40 0x7f3a4c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.731+0000 7f3a66800640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a4c0a3e40 0x7f3a4c0a6300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a60005fa0 tx=0x7f3a6003f040 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.732+0000 7f3a53400640 1 -- 172.21.15.7:0/621933206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5400be60 con 0x55d490932ba0 2024-04-23T15:40:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.732+0000 7f3a53400640 1 -- 172.21.15.7:0/621933206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a540035f0 con 0x55d490932ba0 2024-04-23T15:40:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.732+0000 7f3a53400640 1 -- 172.21.15.7:0/621933206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540116a0 con 0x55d490932ba0 2024-04-23T15:40:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.733+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/621933206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 msgr2=0x55d490934f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.733+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490934f90 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3a6810acb0 tx=0x7f3a540107a0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.737+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/621933206 shutdown_connections 2024-04-23T15:40:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.738+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909282e0 0x55d490932660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.738+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490934f90 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.738+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/621933206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4909279c0 0x55d490927da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.738+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/621933206 >> 172.21.15.7:0/621933206 conn(0x55d490923ed0 msgr2=0x55d4909242b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.745+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/621933206 shutdown_connections 2024-04-23T15:40:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.746+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/621933206 wait complete. 2024-04-23T15:40:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.746+0000 7f3a6fe4a740 1 -- start start 2024-04-23T15:40:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.747+0000 7f3a6fe4a740 1 Processor -- start 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49092fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909282e0 0x55d49092ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d490932ba0 0x55d490930500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d490935820 con 0x55d4909282e0 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d49083f2c0 con 0x55d4909279c0 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d4909359a0 con 0x55d490932ba0 2024-04-23T15:40:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a6fe4a740 10 client.0 _ll_register_callbacks cb 0x55d490597a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.750+0000 7f3a66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d490932ba0 0x55d490930500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.751+0000 7f3a66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d490932ba0 0x55d490930500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:58742/0 (socket says 172.21.15.7:58742) 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.751+0000 7f3a66800640 1 -- 172.21.15.7:0/2034454614 learned_addr learned my addr 172.21.15.7:0/2034454614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.751+0000 7f3a65400640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909282e0 0x55d49092ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.751+0000 7f3a65e00640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49092fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.752+0000 7f3a65400640 1 -- 172.21.15.7:0/2034454614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d490932ba0 msgr2=0x55d490930500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.752+0000 7f3a65400640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d490932ba0 0x55d490930500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.752+0000 7f3a65400640 1 -- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 msgr2=0x55d49092fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.752+0000 7f3a65400640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49092fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.752+0000 7f3a65400640 1 -- 172.21.15.7:0/2034454614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d49084ffd0 con 0x55d4909282e0 2024-04-23T15:40:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.753+0000 7f3a65400640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909282e0 0x55d49092ffc0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3a54011010 tx=0x7f3a5400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7033b4a9e466f27a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.753+0000 7f3a47e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:40:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.754+0000 7f3a47e00640 1 -- 172.21.15.7:0/2034454614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5402a060 con 0x55d4909282e0 2024-04-23T15:40:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.755+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a540035f0 con 0x55d4909282e0 2024-04-23T15:40:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.756+0000 7f3a47e00640 1 -- 172.21.15.7:0/2034454614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7f3a54004210 con 0x55d4909282e0 2024-04-23T15:40:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.756+0000 7f3a47e00640 1 -- 172.21.15.7:0/2034454614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a5402a060 con 0x55d4909282e0 2024-04-23T15:40:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.757+0000 7f3a6fe4a740 10 client.19548 fetch_fsmap learned FSMap version 32 2024-04-23T15:40:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.758+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d490598210 con 0x55d4909282e0 2024-04-23T15:40:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.762+0000 7f3a47e00640 1 -- 172.21.15.7:0/2034454614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a540035f0 con 0x55d4909282e0 2024-04-23T15:40:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.763+0000 7f3a47e00640 1 -- 172.21.15.7:0/2034454614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3a540046c0 con 0x55d4909282e0 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.763+0000 7f3a6fe4a740 10 client.19548 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.763+0000 7f3a6fe4a740 10 client.19548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.763+0000 7f3a6fe4a740 20 client.19548 populate_metadata read hostname 'smithi007' 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.764+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d490942c30 0x55d490945020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.764+0000 7f3a6fe4a740 4 client.19548 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.764+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d490893320 con 0x55d490942c30 2024-04-23T15:40:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.764+0000 7f3a65e00640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d490942c30 0x55d490945020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.766+0000 7f3a65e00640 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d490942c30 0x55d490945020 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5fee730ac00011a server_cookie=b27e5e2542b72b9f in_seq=0 out_seq=0 2024-04-23T15:40:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.766+0000 7f3a47e00640 10 client.19548 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.767+0000 7f3a47e00640 1 -- 172.21.15.7:0/2034454614 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d490893320 con 0x55d490942c30 2024-04-23T15:40:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.768+0000 7f3a47e00640 10 client.19548 handle_command_reply: tid=0 2024-04-23T15:40:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.768+0000 7f3a6fe4a740 1 client.19548 shutdown 2024-04-23T15:40:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909282e0 msgr2=0x55d49092ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909282e0 0x55d49092ffc0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3a54011010 tx=0x7f3a5400be90 comp rx=0 tx=0).stop 2024-04-23T15:40:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 shutdown_connections 2024-04-23T15:40:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d490942c30 0x55d490945020 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d490932ba0 0x55d490930500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909282e0 0x55d49092ffc0 secure :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3a54011010 tx=0x7f3a5400be90 comp rx=0 tx=0).stop 2024-04-23T15:40:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/2034454614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49092fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 >> 172.21.15.7:0/2034454614 conn(0x55d490923ed0 msgr2=0x55d49091a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.772+0000 7f3a47e00640 0 client.19548 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:33.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.774+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 shutdown_connections 2024-04-23T15:40:33.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.777+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/2034454614 wait complete. 2024-04-23T15:40:33.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.779+0000 7f3a6fe4a740 20 client.19548 trim_cache size 0 max 16384 2024-04-23T15:40:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.809+0000 7f3a6fe4a740 1 Processor -- start 2024-04-23T15:40:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.811+0000 7f3a6fe4a740 1 -- start start 2024-04-23T15:40:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.811+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49093e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.812+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490948040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.812+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d490948580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b58b0 con 0x55d490932ba0 2024-04-23T15:40:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b73f0 con 0x55d4909279c0 2024-04-23T15:40:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b5f80 con 0x55d49093e890 2024-04-23T15:40:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49093e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49093e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:51276/0 (socket says 172.21.15.7:51276) 2024-04-23T15:40:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a65e00640 1 -- 172.21.15.7:0/3321274028 learned_addr learned my addr 172.21.15.7:0/3321274028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.813+0000 7f3a65400640 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490948040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.814+0000 7f3a66800640 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d490948580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.815+0000 7f3a65e00640 1 -- 172.21.15.7:0/3321274028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 msgr2=0x55d490948580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.815+0000 7f3a65e00640 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d490948580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.815+0000 7f3a65e00640 1 -- 172.21.15.7:0/3321274028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 msgr2=0x55d490948040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.815+0000 7f3a65e00640 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490948040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.815+0000 7f3a65e00640 1 -- 172.21.15.7:0/3321274028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d490664620 con 0x55d4909279c0 2024-04-23T15:40:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.818+0000 7f3a65e00640 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49093e350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3a58098360 tx=0x7f3a580d2040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0a38db8c0cf64db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.820+0000 7f3a52a00640 1 -- 172.21.15.7:0/3321274028 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58009de0 con 0x55d4909279c0 2024-04-23T15:40:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.820+0000 7f3a52a00640 1 -- 172.21.15.7:0/3321274028 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a5809bf00 con 0x55d4909279c0 2024-04-23T15:40:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.820+0000 7f3a52a00640 1 -- 172.21.15.7:0/3321274028 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580d3d50 con 0x55d4909279c0 2024-04-23T15:40:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.821+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/3321274028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 msgr2=0x55d49093e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.821+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49093e350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3a58098360 tx=0x7f3a580d2040 comp rx=0 tx=0).stop 2024-04-23T15:40:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.823+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/3321274028 shutdown_connections 2024-04-23T15:40:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.824+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d490948580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.824+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d490932ba0 0x55d490948040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.824+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/3321274028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4909279c0 0x55d49093e350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.824+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/3321274028 >> 172.21.15.7:0/3321274028 conn(0x55d490923ed0 msgr2=0x55d49093dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.826+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/3321274028 shutdown_connections 2024-04-23T15:40:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.826+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/3321274028 wait complete. 2024-04-23T15:40:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.827+0000 7f3a6fe4a740 1 -- start start 2024-04-23T15:40:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.832+0000 7f3a6fe4a740 1 Processor -- start 2024-04-23T15:40:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909279c0 0x55d490945c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 0x55d490946170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d4909466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b6d20 con 0x55d4909279c0 2024-04-23T15:40:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b6650 con 0x55d490932ba0 2024-04-23T15:40:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b3940 con 0x55d49093e890 2024-04-23T15:40:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.835+0000 7f3a6fe4a740 10 client.0 _ll_register_callbacks cb 0x7f3a60005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:40:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.839+0000 7f3a65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 0x55d490946170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.841+0000 7f3a66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d4909466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.841+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909279c0 0x55d490945c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.841+0000 7f3a65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 0x55d490946170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:51290/0 (socket says 172.21.15.7:51290) 2024-04-23T15:40:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.842+0000 7f3a65400640 1 -- 172.21.15.7:0/1531751271 learned_addr learned my addr 172.21.15.7:0/1531751271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.842+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909279c0 0x55d490945c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52132/0 (socket says 172.21.15.7:52132) 2024-04-23T15:40:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.842+0000 7f3a66800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d4909466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:58756/0 (socket says 172.21.15.7:58756) 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.843+0000 7f3a66800640 1 -- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 msgr2=0x55d490946170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.843+0000 7f3a66800640 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 0x55d490946170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.843+0000 7f3a66800640 1 -- 172.21.15.7:0/1531751271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909279c0 msgr2=0x55d490945c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.843+0000 7f3a66800640 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909279c0 0x55d490945c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.843+0000 7f3a66800640 1 -- 172.21.15.7:0/1531751271 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4909a7fe0 con 0x55d49093e890 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.843+0000 7f3a65400640 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 0x55d490946170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:40:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.844+0000 7f3a66800640 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d4909466b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009780 tx=0x7f3a60005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dce81cb0a1e709e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.845+0000 7f3a47e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:40:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.845+0000 7f3a47e00640 1 -- 172.21.15.7:0/1531751271 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60057060 con 0x55d49093e890 2024-04-23T15:40:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.845+0000 7f3a47e00640 1 -- 172.21.15.7:0/1531751271 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7f3a60004040 con 0x55d49093e890 2024-04-23T15:40:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.846+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a5809bf00 con 0x55d49093e890 2024-04-23T15:40:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.846+0000 7f3a47e00640 1 -- 172.21.15.7:0/1531751271 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a60031640 con 0x55d49093e890 2024-04-23T15:40:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.850+0000 7f3a6fe4a740 10 client.28426 fetch_fsmap learned FSMap version 32 2024-04-23T15:40:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.850+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d4909a92b0 con 0x55d49093e890 2024-04-23T15:40:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.851+0000 7f3a47e00640 1 -- 172.21.15.7:0/1531751271 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a5809bf00 con 0x55d49093e890 2024-04-23T15:40:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a47e00640 1 -- 172.21.15.7:0/1531751271 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f3a60047830 con 0x55d49093e890 2024-04-23T15:40:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a6fe4a740 10 client.28426 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:40:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a6fe4a740 10 client.28426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:40:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a6fe4a740 20 client.28426 populate_metadata read hostname 'smithi007' 2024-04-23T15:40:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d4909a9980 0x55d4909abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a6fe4a740 4 client.28426 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:40:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.852+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d49088d190 con 0x55d4909a9980 2024-04-23T15:40:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.856+0000 7f3a65e00640 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d4909a9980 0x55d4909abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.857+0000 7f3a65e00640 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d4909a9980 0x55d4909abda0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c96fb1b462469e6 server_cookie=5aeb1b7d9708d048 in_seq=0 out_seq=0 2024-04-23T15:40:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:33.857+0000 7f3a47e00640 10 client.28426 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:35 smithi186 ceph-mon[31814]: pgmap v1561: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.9 MiB/s wr, 2.45k op/s 2024-04-23T15:40:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:35 smithi137 ceph-mon[31694]: pgmap v1561: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.9 MiB/s wr, 2.45k op/s 2024-04-23T15:40:35.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:35 smithi007 ceph-mon[27906]: pgmap v1561: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.9 MiB/s wr, 2.45k op/s 2024-04-23T15:40:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.022+0000 7f3a47e00640 1 -- 172.21.15.7:0/1531751271 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d49088d190 con 0x55d4909a9980 2024-04-23T15:40:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.022+0000 7f3a47e00640 10 client.28426 handle_command_reply: tid=0 2024-04-23T15:40:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.022+0000 7f3a6fe4a740 1 client.28426 shutdown 2024-04-23T15:40:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 msgr2=0x55d4909466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d4909466b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009780 tx=0x7f3a60005fd0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 shutdown_connections 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55d4909a9980 0x55d4909abda0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d490932ba0 0x55d490946170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d49093e890 0x55d4909466b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 --2- 172.21.15.7:0/1531751271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4909279c0 0x55d490945c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 >> 172.21.15.7:0/1531751271 conn(0x55d490923ed0 msgr2=0x55d490931b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a47e00640 0 client.28426 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 shutdown_connections 2024-04-23T15:40:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.023+0000 7f3a6fe4a740 1 -- 172.21.15.7:0/1531751271 wait complete. 2024-04-23T15:40:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.024+0000 7f3a6fe4a740 20 client.28426 trim_cache size 0 max 16384 2024-04-23T15:40:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:40:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:40:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:40:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:40:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a4c0a3e40 msgr2=0x7f3a4c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a4c0a3e40 0x7f3a4c0a6300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a60005fa0 tx=0x7f3a6003f040 comp rx=0 tx=0).stop 2024-04-23T15:40:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 msgr2=0x7f3a68109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68109640 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800d770 tx=0x7f3a5800dc30 comp rx=0 tx=0).stop 2024-04-23T15:40:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 shutdown_connections 2024-04-23T15:40:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f3a4c0a3e40 0x7f3a4c0a6300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a68100a90 0x7f3a68109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a68107120 0x7f3a681ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 --2- 172.21.15.7:0/710982635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a681000d0 0x7f3a68109640 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 >> 172.21.15.7:0/710982635 conn(0x7f3a68077000 msgr2=0x7f3a68105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 shutdown_connections 2024-04-23T15:40:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:36.025+0000 7f3a6d000640 1 -- 172.21.15.7:0/710982635 wait complete. 2024-04-23T15:40:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:37 smithi186 ceph-mon[31814]: pgmap v1562: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:40:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:37 smithi137 ceph-mon[31694]: pgmap v1562: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:40:37.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:37 smithi007 ceph-mon[27906]: pgmap v1562: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:40:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:39 smithi137 ceph-mon[31694]: pgmap v1563: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-04-23T15:40:39.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:39 smithi007 ceph-mon[27906]: pgmap v1563: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-04-23T15:40:39.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:39 smithi186 ceph-mon[31814]: pgmap v1563: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-04-23T15:40:41.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:41 smithi137 ceph-mon[31694]: pgmap v1564: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 12 MiB/s wr, 2.86k op/s 2024-04-23T15:40:41.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:41 smithi007 ceph-mon[27906]: pgmap v1564: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 12 MiB/s wr, 2.86k op/s 2024-04-23T15:40:41.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:41 smithi186 ceph-mon[31814]: pgmap v1564: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 12 MiB/s wr, 2.86k op/s 2024-04-23T15:40:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:43 smithi137 ceph-mon[31694]: pgmap v1565: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-04-23T15:40:43.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:43 smithi007 ceph-mon[27906]: pgmap v1565: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-04-23T15:40:43.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:43 smithi186 ceph-mon[31814]: pgmap v1565: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.71k op/s 2024-04-23T15:40:44.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:44 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:40:44.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:44 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:40:44.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:44 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:40:45.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:45 smithi007 ceph-mon[27906]: pgmap v1566: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:40:45.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:45 smithi186 ceph-mon[31814]: pgmap v1566: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:40:45.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:45 smithi137 ceph-mon[31694]: pgmap v1566: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:40:47.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:47 smithi007 ceph-mon[27906]: pgmap v1567: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-04-23T15:40:47.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:47 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:40:47.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:47 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:40:47.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:47 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:40:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:47 smithi186 ceph-mon[31814]: pgmap v1567: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-04-23T15:40:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:47 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:40:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:47 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:40:47.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:47 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:40:47.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:47 smithi137 ceph-mon[31694]: pgmap v1567: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-04-23T15:40:47.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:47 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:40:47.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:47 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:40:47.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:47 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:40:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.307+0000 7fd7eee00640 1 -- 172.21.15.7:0/269313692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0099bf0 msgr2=0x7fd7e0099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.307+0000 7fd7eee00640 1 --2- 172.21.15.7:0/269313692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0099bf0 0x7fd7e0099fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009930 tx=0x7fd7dc02a420 comp rx=0 tx=0).stop 2024-04-23T15:40:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.310+0000 7fd7eee00640 1 -- 172.21.15.7:0/269313692 shutdown_connections 2024-04-23T15:40:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.310+0000 7fd7eee00640 1 --2- 172.21.15.7:0/269313692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7e0095820 0x7fd7e00a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.310+0000 7fd7eee00640 1 --2- 172.21.15.7:0/269313692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 0x7fd7e00952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.310+0000 7fd7eee00640 1 --2- 172.21.15.7:0/269313692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0099bf0 0x7fd7e0099fd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.310+0000 7fd7eee00640 1 -- 172.21.15.7:0/269313692 >> 172.21.15.7:0/269313692 conn(0x7fd7e000a770 msgr2=0x7fd7e000ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.310+0000 7fd7eee00640 1 -- 172.21.15.7:0/269313692 shutdown_connections 2024-04-23T15:40:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.311+0000 7fd7eee00640 1 -- 172.21.15.7:0/269313692 wait complete. 2024-04-23T15:40:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.316+0000 7fd7eee00640 1 Processor -- start 2024-04-23T15:40:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.316+0000 7fd7eee00640 1 -- start start 2024-04-23T15:40:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.317+0000 7fd7eee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 0x7fd7e013c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.318+0000 7fd7eee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0095820 0x7fd7e013c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.318+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 0x7fd7e013c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.318+0000 7fd7eee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7e0099bf0 0x7fd7e0140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7eee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e00a4f30 con 0x7fd7e0094e80 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 0x7fd7e013c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33174/0 (socket says 172.21.15.7:33174) 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7e7e00640 1 -- 172.21.15.7:0/557462319 learned_addr learned my addr 172.21.15.7:0/557462319 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7e7400640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0095820 0x7fd7e013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e00a4db0 con 0x7fd7e0095820 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e00a50b0 con 0x7fd7e0099bf0 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.319+0000 7fd7ece00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7e0099bf0 0x7fd7e0140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.320+0000 7fd7e7400640 1 -- 172.21.15.7:0/557462319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7e0099bf0 msgr2=0x7fd7e0140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.320+0000 7fd7e7400640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7e0099bf0 0x7fd7e0140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.320+0000 7fd7e7400640 1 -- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 msgr2=0x7fd7e013c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.320+0000 7fd7e7400640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 0x7fd7e013c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.320+0000 7fd7e7400640 1 -- 172.21.15.7:0/557462319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e0141430 con 0x7fd7e0095820 2024-04-23T15:40:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.321+0000 7fd7e7400640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0095820 0x7fd7e013c980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400c970 tx=0x7fd7d400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.321+0000 7fd7e4c00640 1 -- 172.21.15.7:0/557462319 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4007bb0 con 0x7fd7e0095820 2024-04-23T15:40:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.321+0000 7fd7e4c00640 1 -- 172.21.15.7:0/557462319 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7d4007d50 con 0x7fd7e0095820 2024-04-23T15:40:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.321+0000 7fd7e4c00640 1 -- 172.21.15.7:0/557462319 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4004de0 con 0x7fd7e0095820 2024-04-23T15:40:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.321+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e0141720 con 0x7fd7e0095820 2024-04-23T15:40:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.322+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e0004cb0 con 0x7fd7e0095820 2024-04-23T15:40:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.331+0000 7fd7e4c00640 1 -- 172.21.15.7:0/557462319 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd7d4004fa0 con 0x7fd7e0095820 2024-04-23T15:40:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.333+0000 7fd7f1b7a740 1 Processor -- start 2024-04-23T15:40:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.333+0000 7fd7f1b7a740 1 -- start start 2024-04-23T15:40:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb97396300 0x55cb973966e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb973a9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb973a9db0 0x55cb973ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cb972fc900 con 0x55cb97396c20 2024-04-23T15:40:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cb972a2f20 con 0x55cb973a9db0 2024-04-23T15:40:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cb972f88c0 con 0x55cb97396300 2024-04-23T15:40:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.335+0000 7fd7e4c00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd7d00a3d20 0x7fd7d00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.336+0000 7fd7e4c00640 1 -- 172.21.15.7:0/557462319 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7fd7d40d07f0 con 0x7fd7e0095820 2024-04-23T15:40:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.336+0000 7fd7e7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb973a9db0 0x55cb973ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.336+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb97396300 0x55cb973966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.336+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb97396300 0x55cb973966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:49014/0 (socket says 172.21.15.7:49014) 2024-04-23T15:40:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.336+0000 7fd7ece00640 1 -- 172.21.15.7:0/3786185100 learned_addr learned my addr 172.21.15.7:0/3786185100 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.337+0000 7fd7ece00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd7d00a3d20 0x7fd7d00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.337+0000 7fd7e7400640 1 -- 172.21.15.7:0/3786185100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb97396300 msgr2=0x55cb973966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.337+0000 7fd7e7400640 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb97396300 0x55cb973966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.337+0000 7fd7e7400640 1 -- 172.21.15.7:0/3786185100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 msgr2=0x55cb973a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.337+0000 7fd7e7400640 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb973a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.337+0000 7fd7e7400640 1 -- 172.21.15.7:0/3786185100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb972c7e10 con 0x55cb973a9db0 2024-04-23T15:40:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.338+0000 7fd7e7400640 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb973a9db0 0x55cb973ac1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40cda90 tx=0x7fd7d409c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35a4e7b0e4665b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.338+0000 7fd7d9600640 1 -- 172.21.15.7:0/3786185100 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d401d070 con 0x55cb973a9db0 2024-04-23T15:40:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.338+0000 7fd7d9600640 1 -- 172.21.15.7:0/3786185100 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7d4096e50 con 0x55cb973a9db0 2024-04-23T15:40:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.338+0000 7fd7d9600640 1 -- 172.21.15.7:0/3786185100 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4098af0 con 0x55cb973a9db0 2024-04-23T15:40:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.338+0000 7fd7ece00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd7d00a3d20 0x7fd7d00a61e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8067770 tx=0x7fd7e8068150 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3786185100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb973a9db0 msgr2=0x55cb973ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb973a9db0 0x55cb973ac1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40cda90 tx=0x7fd7d409c9e0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3786185100 shutdown_connections 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb973a9db0 0x55cb973ac1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb973a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3786185100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb97396300 0x55cb973966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3786185100 >> 172.21.15.7:0/3786185100 conn(0x55cb973928d0 msgr2=0x55cb97392cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.341+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3786185100 shutdown_connections 2024-04-23T15:40:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.342+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3786185100 wait complete. 2024-04-23T15:40:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.342+0000 7fd7f1b7a740 1 -- start start 2024-04-23T15:40:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.343+0000 7fd7f1b7a740 1 Processor -- start 2024-04-23T15:40:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.343+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396300 0x55cb973a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.343+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396c20 0x55cb973a7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.343+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.344+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cb973ac980 con 0x55cb97396300 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.344+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cb972b62c0 con 0x55cb97396c20 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.344+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55cb973acb00 con 0x55cb973a9db0 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.344+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.344+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:49030/0 (socket says 172.21.15.7:49030) 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.344+0000 7fd7ece00640 1 -- 172.21.15.7:0/618220066 learned_addr learned my addr 172.21.15.7:0/618220066 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7f1b7a740 10 client.0 _ll_register_callbacks cb 0x55cb9700ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:40:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7e7400640 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396c20 0x55cb973a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7ece00640 1 -- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396c20 msgr2=0x55cb973a7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7ece00640 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396c20 0x55cb973a7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7ece00640 1 -- 172.21.15.7:0/618220066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396300 msgr2=0x55cb973a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7ece00640 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396300 0x55cb973a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.345+0000 7fd7ece00640 1 -- 172.21.15.7:0/618220066 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb972c6fd0 con 0x55cb973a9db0 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.346+0000 7fd7ece00640 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973a7760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80504d0 tx=0x7fd7e806d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4de9ef593b5505d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.346+0000 7fd7ce000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:40:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.346+0000 7fd7ce000640 1 -- 172.21.15.7:0/618220066 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8078790 con 0x55cb973a9db0 2024-04-23T15:40:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.347+0000 7fd7ce000640 1 -- 172.21.15.7:0/618220066 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7fd7e8078930 con 0x55cb973a9db0 2024-04-23T15:40:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.347+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7d4096e50 con 0x55cb973a9db0 2024-04-23T15:40:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.347+0000 7fd7ce000640 1 -- 172.21.15.7:0/618220066 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd7e8078b30 con 0x55cb973a9db0 2024-04-23T15:40:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.347+0000 7fd7f1b7a740 10 client.28435 fetch_fsmap learned FSMap version 32 2024-04-23T15:40:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.347+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cb9700f210 con 0x55cb973a9db0 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.348+0000 7fd7ce000640 1 -- 172.21.15.7:0/618220066 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7d4096e50 con 0x55cb973a9db0 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.349+0000 7fd7ce000640 1 -- 172.21.15.7:0/618220066 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd7e8086410 con 0x55cb973a9db0 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7f1b7a740 10 client.28435 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7f1b7a740 10 client.28435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7f1b7a740 20 client.28435 populate_metadata read hostname 'smithi007' 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb973bc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7f1b7a740 4 client.28435 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:40:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb9730a320 con 0x55cb973b9f20 2024-04-23T15:40:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.350+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb973bc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.351+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb973bc3c0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c82b9042276cd6e4 server_cookie=b4f71b024242dd0a in_seq=0 out_seq=0 2024-04-23T15:40:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.353+0000 7fd7ce000640 10 client.28435 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.353+0000 7fd7ce000640 1 -- 172.21.15.7:0/618220066 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cb9730a320 con 0x55cb973b9f20 2024-04-23T15:40:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.353+0000 7fd7ce000640 10 client.28435 handle_command_reply: tid=0 2024-04-23T15:40:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.354+0000 7fd7f1b7a740 1 client.28435 shutdown 2024-04-23T15:40:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.354+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 msgr2=0x55cb973a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.354+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973a7760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80504d0 tx=0x7fd7e806d040 comp rx=0 tx=0).stop 2024-04-23T15:40:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.355+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 shutdown_connections 2024-04-23T15:40:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.355+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb973bc3c0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.355+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396c20 0x55cb973a7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.355+0000 7fd7ce000640 0 client.28435 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.355+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973a7760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.355+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/618220066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396300 0x55cb973a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.356+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 >> 172.21.15.7:0/618220066 conn(0x55cb973928d0 msgr2=0x55cb97398650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.357+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 shutdown_connections 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.357+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/618220066 wait complete. 2024-04-23T15:40:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.357+0000 7fd7f1b7a740 20 client.28435 trim_cache size 0 max 16384 2024-04-23T15:40:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.399+0000 7fd7f1b7a740 1 Processor -- start 2024-04-23T15:40:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.399+0000 7fd7f1b7a740 1 -- start start 2024-04-23T15:40:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.400+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb973b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.400+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97391910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.400+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.400+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8010140 con 0x55cb97396c20 2024-04-23T15:40:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.400+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8011c80 con 0x55cb97396300 2024-04-23T15:40:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.400+0000 7fd7f1b7a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8010810 con 0x55cb973a9db0 2024-04-23T15:40:49.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.401+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb973b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.401+0000 7fd7e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97391910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.401+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb973b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:38140/0 (socket says 172.21.15.7:38140) 2024-04-23T15:40:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.401+0000 7fd7e7e00640 1 -- 172.21.15.7:0/3438790231 learned_addr learned my addr 172.21.15.7:0/3438790231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.401+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.403+0000 7fd7e7e00640 1 -- 172.21.15.7:0/3438790231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 msgr2=0x55cb973c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.403+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.403+0000 7fd7e7e00640 1 -- 172.21.15.7:0/3438790231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 msgr2=0x55cb97391910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.403+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97391910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.403+0000 7fd7e7e00640 1 -- 172.21.15.7:0/3438790231 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb970db620 con 0x55cb97396300 2024-04-23T15:40:49.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.403+0000 7fd7ece00640 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:40:49.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.406+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb973b58b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005ec0 tx=0x7fd7dc005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b217f09dbc5a7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.407+0000 7fd7d8c00640 1 -- 172.21.15.7:0/3438790231 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc035040 con 0x55cb97396300 2024-04-23T15:40:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.408+0000 7fd7d8c00640 1 -- 172.21.15.7:0/3438790231 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7dc048070 con 0x55cb97396300 2024-04-23T15:40:49.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.408+0000 7fd7d8c00640 1 -- 172.21.15.7:0/3438790231 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc042570 con 0x55cb97396300 2024-04-23T15:40:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.409+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3438790231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 msgr2=0x55cb973b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.409+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb973b58b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005ec0 tx=0x7fd7dc005a20 comp rx=0 tx=0).stop 2024-04-23T15:40:49.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.410+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3438790231 shutdown_connections 2024-04-23T15:40:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.410+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.410+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97391910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.410+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/3438790231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb973b58b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.410+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3438790231 >> 172.21.15.7:0/3438790231 conn(0x55cb973928d0 msgr2=0x55cb97391200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.410+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3438790231 shutdown_connections 2024-04-23T15:40:49.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.411+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/3438790231 wait complete. 2024-04-23T15:40:49.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.411+0000 7fd7f1b7a740 1 -- start start 2024-04-23T15:40:49.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.412+0000 7fd7f1b7a740 1 Processor -- start 2024-04-23T15:40:49.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.414+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb97419850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.414+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97419d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.414+0000 7fd7f1b7a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.415+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.415+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:49044/0 (socket says 172.21.15.7:49044) 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.415+0000 7fd7ece00640 1 -- 172.21.15.7:0/930862126 learned_addr learned my addr 172.21.15.7:0/930862126 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.416+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80115b0 con 0x55cb97396c20 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.416+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8010ee0 con 0x55cb97396300 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.416+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c800e140 con 0x55cb973a9db0 2024-04-23T15:40:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.416+0000 7fd7f1b7a740 10 client.0 _ll_register_callbacks cb 0x7fd7e807c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:40:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.416+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb97419850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.416+0000 7fd7e7400640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97419d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.417+0000 7fd7ece00640 1 -- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 msgr2=0x55cb97419850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.417 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.417+0000 7fd7ece00640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb97419850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.417+0000 7fd7ece00640 1 -- 172.21.15.7:0/930862126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 msgr2=0x55cb97419d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:40:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.417+0000 7fd7ece00640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97419d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.417+0000 7fd7ece00640 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb973ae5f0 con 0x55cb973a9db0 2024-04-23T15:40:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.418+0000 7fd7ce000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:40:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.418+0000 7fd7ece00640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973adf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8050b40 tx=0x7fd7e8078f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b2d16a56d9f99de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:40:49.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.419+0000 7fd7ce000640 1 -- 172.21.15.7:0/930862126 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8086b90 con 0x55cb973a9db0 2024-04-23T15:40:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.419+0000 7fd7ce000640 1 -- 172.21.15.7:0/930862126 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7fd7e8096070 con 0x55cb973a9db0 2024-04-23T15:40:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.420+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7dc048070 con 0x55cb973a9db0 2024-04-23T15:40:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.420+0000 7fd7ce000640 1 -- 172.21.15.7:0/930862126 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd7e80a6050 con 0x55cb973a9db0 2024-04-23T15:40:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.421+0000 7fd7f1b7a740 10 client.28441 fetch_fsmap learned FSMap version 32 2024-04-23T15:40:49.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.421+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cb97420f90 con 0x55cb973a9db0 2024-04-23T15:40:49.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.421+0000 7fd7ce000640 1 -- 172.21.15.7:0/930862126 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7dc048070 con 0x55cb973a9db0 2024-04-23T15:40:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.423+0000 7fd7ce000640 1 -- 172.21.15.7:0/930862126 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd7e80a1030 con 0x55cb973a9db0 2024-04-23T15:40:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.425+0000 7fd7f1b7a740 10 client.28441 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:40:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.425+0000 7fd7f1b7a740 10 client.28441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:40:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.425+0000 7fd7f1b7a740 20 client.28441 populate_metadata read hostname 'smithi007' 2024-04-23T15:40:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.425+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb97423730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:40:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.425+0000 7fd7f1b7a740 4 client.28441 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:40:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.425+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb97304190 con 0x55cb973b9f20 2024-04-23T15:40:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.426+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb97423730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:40:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.427+0000 7fd7e7e00640 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb97423730 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4165d57f83b13f09 server_cookie=f600c86882cb362e in_seq=0 out_seq=0 2024-04-23T15:40:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:49.427+0000 7fd7ce000640 10 client.28441 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:49.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:49 smithi007 ceph-mon[27906]: pgmap v1568: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.84k op/s 2024-04-23T15:40:49.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:49 smithi186 ceph-mon[31814]: pgmap v1568: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.84k op/s 2024-04-23T15:40:49.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:49 smithi137 ceph-mon[31694]: pgmap v1568: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.84k op/s 2024-04-23T15:40:51.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:51 smithi007 ceph-mon[27906]: pgmap v1569: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 2.76k op/s 2024-04-23T15:40:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:51 smithi186 ceph-mon[31814]: pgmap v1569: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 2.76k op/s 2024-04-23T15:40:51.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:51 smithi137 ceph-mon[31694]: pgmap v1569: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 2.76k op/s 2024-04-23T15:40:53.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:53 smithi007 ceph-mon[27906]: pgmap v1570: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:40:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:53 smithi186 ceph-mon[31814]: pgmap v1570: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:40:53.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:53 smithi137 ceph-mon[31694]: pgmap v1570: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:40:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.552+0000 7fd7ce000640 1 -- 172.21.15.7:0/930862126 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb97304190 con 0x55cb973b9f20 2024-04-23T15:40:55.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.552+0000 7fd7ce000640 10 client.28441 handle_command_reply: tid=0 2024-04-23T15:40:55.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.553+0000 7fd7f1b7a740 1 client.28441 shutdown 2024-04-23T15:40:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.556+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 msgr2=0x55cb973adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.556+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973adf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8050b40 tx=0x7fd7e8078f00 comp rx=0 tx=0).stop 2024-04-23T15:40:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 shutdown_connections 2024-04-23T15:40:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55cb973b9f20 0x55cb97423730 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb973a9db0 0x55cb973adf30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cb97396c20 0x55cb97419d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7f1b7a740 1 --2- 172.21.15.7:0/930862126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cb97396300 0x55cb97419850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 >> 172.21.15.7:0/930862126 conn(0x55cb973928d0 msgr2=0x55cb973a7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.560+0000 7fd7ce000640 0 client.28441 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:40:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.561+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 shutdown_connections 2024-04-23T15:40:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.561+0000 7fd7f1b7a740 1 -- 172.21.15.7:0/930862126 wait complete. 2024-04-23T15:40:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.563+0000 7fd7f1b7a740 20 client.28441 trim_cache size 0 max 16384 2024-04-23T15:40:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:40:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:40:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:40:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:40:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.566+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd7d00a3d20 msgr2=0x7fd7d00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.566+0000 7fd7eee00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd7d00a3d20 0x7fd7d00a61e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8067770 tx=0x7fd7e8068150 comp rx=0 tx=0).stop 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0095820 msgr2=0x7fd7e013c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0095820 0x7fd7e013c980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400c970 tx=0x7fd7d400ce30 comp rx=0 tx=0).stop 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 shutdown_connections 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd7d00a3d20 0x7fd7d00a61e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e0095820 0x7fd7e013c980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7e0099bf0 0x7fd7e0140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 --2- 172.21.15.7:0/557462319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7e0094e80 0x7fd7e013c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:40:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.567+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 >> 172.21.15.7:0/557462319 conn(0x7fd7e000a770 msgr2=0x7fd7e0092f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:40:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.568+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 shutdown_connections 2024-04-23T15:40:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:40:55.568+0000 7fd7eee00640 1 -- 172.21.15.7:0/557462319 wait complete. 2024-04-23T15:40:55.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:55 smithi007 ceph-mon[27906]: pgmap v1571: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:40:55.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:55 smithi186 ceph-mon[31814]: pgmap v1571: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:40:55.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:55 smithi137 ceph-mon[31694]: pgmap v1571: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:40:57.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:57 smithi007 ceph-mon[27906]: pgmap v1572: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 10 MiB/s wr, 2.65k op/s 2024-04-23T15:40:57.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:57 smithi186 ceph-mon[31814]: pgmap v1572: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 10 MiB/s wr, 2.65k op/s 2024-04-23T15:40:57.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:57 smithi137 ceph-mon[31694]: pgmap v1572: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 10 MiB/s wr, 2.65k op/s 2024-04-23T15:40:59.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:40:59 smithi007 ceph-mon[27906]: pgmap v1573: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:40:59.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:40:59 smithi186 ceph-mon[31814]: pgmap v1573: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:40:59.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:40:59 smithi137 ceph-mon[31694]: pgmap v1573: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:41:01.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:01 smithi007 ceph-mon[27906]: pgmap v1574: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-04-23T15:41:01.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:01 smithi186 ceph-mon[31814]: pgmap v1574: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-04-23T15:41:01.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:01 smithi137 ceph-mon[31694]: pgmap v1574: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-04-23T15:41:03.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:03 smithi007 ceph-mon[27906]: pgmap v1575: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.8 MiB/s wr, 2.49k op/s 2024-04-23T15:41:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:03 smithi186 ceph-mon[31814]: pgmap v1575: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.8 MiB/s wr, 2.49k op/s 2024-04-23T15:41:03.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:03 smithi137 ceph-mon[31694]: pgmap v1575: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.8 MiB/s wr, 2.49k op/s 2024-04-23T15:41:05.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:05 smithi007 ceph-mon[27906]: pgmap v1576: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.1 MiB/s wr, 2.31k op/s 2024-04-23T15:41:05.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:05 smithi186 ceph-mon[31814]: pgmap v1576: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.1 MiB/s wr, 2.31k op/s 2024-04-23T15:41:05.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:05 smithi137 ceph-mon[31694]: pgmap v1576: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.1 MiB/s wr, 2.31k op/s 2024-04-23T15:41:07.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:07 smithi007 ceph-mon[27906]: pgmap v1577: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-04-23T15:41:07.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:07 smithi186 ceph-mon[31814]: pgmap v1577: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-04-23T15:41:07.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:07 smithi137 ceph-mon[31694]: pgmap v1577: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-04-23T15:41:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 -- 172.21.15.7:0/1468577042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 msgr2=0x7fc618110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 --2- 172.21.15.7:0/1468577042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 0x7fc618110ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc610009be0 tx=0x7fc61002a750 comp rx=0 tx=0).stop 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 -- 172.21.15.7:0/1468577042 shutdown_connections 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 --2- 172.21.15.7:0/1468577042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 0x7fc618110ce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 --2- 172.21.15.7:0/1468577042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074c20 0x7fc61810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 --2- 172.21.15.7:0/1468577042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074300 0x7fc6180746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 -- 172.21.15.7:0/1468577042 >> 172.21.15.7:0/1468577042 conn(0x7fc618079490 msgr2=0x7fc6180798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 -- 172.21.15.7:0/1468577042 shutdown_connections 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.822+0000 7fc61cc00640 1 -- 172.21.15.7:0/1468577042 wait complete. 2024-04-23T15:41:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 Processor -- start 2024-04-23T15:41:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 -- start start 2024-04-23T15:41:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074300 0x7fc61810dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074c20 0x7fc61810e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 0x7fc618102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc61806e260 con 0x7fc618074c20 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc61806e0e0 con 0x7fc61810e8f0 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.824+0000 7fc61cc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc61806e3e0 con 0x7fc618074300 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.825+0000 7fc615e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074300 0x7fc61810dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.825+0000 7fc615400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074c20 0x7fc61810e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.825+0000 7fc615e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074300 0x7fc61810dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:52160/0 (socket says 172.21.15.7:52160) 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.825+0000 7fc615e00640 1 -- 172.21.15.7:0/3028304860 learned_addr learned my addr 172.21.15.7:0/3028304860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.825+0000 7fc616800640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 0x7fc618102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.826+0000 7fc615400640 1 -- 172.21.15.7:0/3028304860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074300 msgr2=0x7fc61810dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.826+0000 7fc615400640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074300 0x7fc61810dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.826+0000 7fc615400640 1 -- 172.21.15.7:0/3028304860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 msgr2=0x7fc618102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.826+0000 7fc615400640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 0x7fc618102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.826+0000 7fc615400640 1 -- 172.21.15.7:0/3028304860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6181025d0 con 0x7fc618074c20 2024-04-23T15:41:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.828+0000 7fc615400640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074c20 0x7fc61810e260 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e7c0 tx=0x7fc60400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.828+0000 7fc60ea00640 1 -- 172.21.15.7:0/3028304860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60400ccc0 con 0x7fc618074c20 2024-04-23T15:41:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.828+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6181028c0 con 0x7fc618074c20 2024-04-23T15:41:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.829+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6181a31d0 con 0x7fc618074c20 2024-04-23T15:41:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.831+0000 7fc60ea00640 1 -- 172.21.15.7:0/3028304860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc60400ce60 con 0x7fc618074c20 2024-04-23T15:41:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.831+0000 7fc60ea00640 1 -- 172.21.15.7:0/3028304860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604026060 con 0x7fc618074c20 2024-04-23T15:41:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.833+0000 7fc61fa35740 1 Processor -- start 2024-04-23T15:41:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.835+0000 7fc61fa35740 1 -- start start 2024-04-23T15:41:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.835+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42ef590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.836+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.836+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b42fc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.836+0000 7fc61fa35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5627b4255900 con 0x5627b42ef1b0 2024-04-23T15:41:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.836+0000 7fc61fa35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627b41fbf20 con 0x5627b42fa390 2024-04-23T15:41:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.836+0000 7fc61fa35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5627b42518c0 con 0x5627b42efad0 2024-04-23T15:41:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.837+0000 7fc615e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.837+0000 7fc615e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:52168/0 (socket says 172.21.15.7:52168) 2024-04-23T15:41:08.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.837+0000 7fc615e00640 1 -- 172.21.15.7:0/1044476515 learned_addr learned my addr 172.21.15.7:0/1044476515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.839+0000 7fc616800640 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.840+0000 7fc616800640 1 -- 172.21.15.7:0/1044476515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 msgr2=0x5627b42f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.840+0000 7fc616800640 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.840+0000 7fc616800640 1 -- 172.21.15.7:0/1044476515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 msgr2=0x5627b42fc780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:41:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.840+0000 7fc616800640 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b42fc780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.840+0000 7fc616800640 1 -- 172.21.15.7:0/1044476515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4220e10 con 0x5627b42ef1b0 2024-04-23T15:41:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.841+0000 7fc616800640 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42ef590 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fc610009b30 tx=0x7fc6100304a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7edd0131c77d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.841+0000 7fc603000640 1 -- 172.21.15.7:0/1044476515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610041030 con 0x5627b42ef1b0 2024-04-23T15:41:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.842+0000 7fc60ea00640 1 -- 172.21.15.7:0/3028304860 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc604010430 con 0x7fc618074c20 2024-04-23T15:41:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.843+0000 7fc603000640 1 -- 172.21.15.7:0/1044476515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc610037040 con 0x5627b42ef1b0 2024-04-23T15:41:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.844+0000 7fc60ea00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc5fc0a3e70 0x7fc5fc0a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.844+0000 7fc61fa35740 1 -- 172.21.15.7:0/1044476515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 msgr2=0x5627b42ef590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.844+0000 7fc61fa35740 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42ef590 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fc610009b30 tx=0x7fc6100304a0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.844+0000 7fc60ea00640 1 -- 172.21.15.7:0/3028304860 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7fc6040d0d10 con 0x7fc618074c20 2024-04-23T15:41:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.846+0000 7fc615e00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc5fc0a3e70 0x7fc5fc0a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.846+0000 7fc61fa35740 1 -- 172.21.15.7:0/1044476515 shutdown_connections 2024-04-23T15:41:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.847+0000 7fc61fa35740 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b42fc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.847+0000 7fc61fa35740 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.847+0000 7fc61fa35740 1 --2- 172.21.15.7:0/1044476515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42ef590 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.847+0000 7fc61fa35740 1 -- 172.21.15.7:0/1044476515 >> 172.21.15.7:0/1044476515 conn(0x5627b42eb6c0 msgr2=0x5627b42ebaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.847+0000 7fc61fa35740 1 -- 172.21.15.7:0/1044476515 shutdown_connections 2024-04-23T15:41:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.848+0000 7fc61fa35740 1 -- 172.21.15.7:0/1044476515 wait complete. 2024-04-23T15:41:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.849+0000 7fc615e00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc5fc0a3e70 0x7fc5fc0a6330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5627b42f0750 tx=0x7fc608005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.849+0000 7fc61fa35740 1 -- start start 2024-04-23T15:41:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.849+0000 7fc61fa35740 1 Processor -- start 2024-04-23T15:41:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42ef1b0 0x5627b42f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 0x5627b42f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5627b42fcfb0 con 0x5627b42fa390 2024-04-23T15:41:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627b420f2c0 con 0x5627b42ef1b0 2024-04-23T15:41:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5627b42fd130 con 0x5627b42efad0 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.850+0000 7fc61fa35740 10 client.0 _ll_register_callbacks cb 0x5627b3f67a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.851+0000 7fc616800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 0x5627b42f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.851+0000 7fc616800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 0x5627b42f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47078/0 (socket says 172.21.15.7:47078) 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.851+0000 7fc616800640 1 -- 172.21.15.7:0/3905953359 learned_addr learned my addr 172.21.15.7:0/3905953359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc615400640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc615e00640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42ef1b0 0x5627b42f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc616800640 1 -- 172.21.15.7:0/3905953359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 msgr2=0x5627b42f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc616800640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc616800640 1 -- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42ef1b0 msgr2=0x5627b42f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc616800640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42ef1b0 0x5627b42f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.852+0000 7fc616800640 1 -- 172.21.15.7:0/3905953359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b421ffd0 con 0x5627b42fa390 2024-04-23T15:41:08.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.854+0000 7fc616800640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 0x5627b42f7c70 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fc610009560 tx=0x7fc610003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fe6134114670bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:08.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.854+0000 7fc5f7400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:41:08.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.855+0000 7fc5f7400640 1 -- 172.21.15.7:0/3905953359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610041040 con 0x5627b42fa390 2024-04-23T15:41:08.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.855+0000 7fc5f7400640 1 -- 172.21.15.7:0/3905953359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7fc610031640 con 0x5627b42fa390 2024-04-23T15:41:08.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.856+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc610037040 con 0x5627b42fa390 2024-04-23T15:41:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.858+0000 7fc5f7400640 1 -- 172.21.15.7:0/3905953359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc610009800 con 0x5627b42fa390 2024-04-23T15:41:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.858+0000 7fc61fa35740 10 client.19572 fetch_fsmap learned FSMap version 32 2024-04-23T15:41:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.858+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5627b3f68210 con 0x5627b42fa390 2024-04-23T15:41:08.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.859+0000 7fc5f7400640 1 -- 172.21.15.7:0/3905953359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc610037040 con 0x5627b42fa390 2024-04-23T15:41:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc5f7400640 1 -- 172.21.15.7:0/3905953359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc61003c040 con 0x5627b42fa390 2024-04-23T15:41:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc61fa35740 10 client.19572 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:41:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc61fa35740 10 client.19572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:41:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc61fa35740 20 client.19572 populate_metadata read hostname 'smithi007' 2024-04-23T15:41:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc61fa35740 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b430a2f0 0x5627b430c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc61fa35740 4 client.19572 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:41:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.862+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627b4263320 con 0x5627b430a2f0 2024-04-23T15:41:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.863+0000 7fc615e00640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b430a2f0 0x5627b430c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.864+0000 7fc615e00640 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b430a2f0 0x5627b430c6e0 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b91fafeaba46f3d server_cookie=4dd764e038e31f31 in_seq=0 out_seq=0 2024-04-23T15:41:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.864+0000 7fc5f7400640 10 client.19572 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.867+0000 7fc5f7400640 1 -- 172.21.15.7:0/3905953359 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5627b4263320 con 0x5627b430a2f0 2024-04-23T15:41:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.867+0000 7fc5f7400640 10 client.19572 handle_command_reply: tid=0 2024-04-23T15:41:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.867+0000 7fc61fa35740 1 client.19572 shutdown 2024-04-23T15:41:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.870+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 msgr2=0x5627b42f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.870+0000 7fc61fa35740 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 0x5627b42f7c70 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fc610009560 tx=0x7fc610003c20 comp rx=0 tx=0).stop 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 shutdown_connections 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b430a2f0 0x5627b430c6e0 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42fa390 0x5627b42f7c70 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 --2- 172.21.15.7:0/3905953359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42ef1b0 0x5627b42f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc5f7400640 0 client.19572 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 >> 172.21.15.7:0/3905953359 conn(0x5627b42eb6c0 msgr2=0x5627b42f13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.871+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 shutdown_connections 2024-04-23T15:41:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.872+0000 7fc61fa35740 1 -- 172.21.15.7:0/3905953359 wait complete. 2024-04-23T15:41:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.874+0000 7fc61fa35740 20 client.19572 trim_cache size 0 max 16384 2024-04-23T15:41:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 Processor -- start 2024-04-23T15:41:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 -- start start 2024-04-23T15:41:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b4305ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80100b0 con 0x5627b42ef1b0 2024-04-23T15:41:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f8011bf0 con 0x5627b42fa390 2024-04-23T15:41:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.915+0000 7fc61fa35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f8010780 con 0x5627b42efad0 2024-04-23T15:41:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.916+0000 7fc616800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b4305ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.916+0000 7fc616800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b4305ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:44556/0 (socket says 172.21.15.7:44556) 2024-04-23T15:41:08.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.916+0000 7fc616800640 1 -- 172.21.15.7:0/35927471 learned_addr learned my addr 172.21.15.7:0/35927471 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.916+0000 7fc615e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.916+0000 7fc615400640 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.917+0000 7fc616800640 1 -- 172.21.15.7:0/35927471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 msgr2=0x5627b42f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.917+0000 7fc616800640 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.917+0000 7fc616800640 1 -- 172.21.15.7:0/35927471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 msgr2=0x5627b42f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.917+0000 7fc616800640 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.917+0000 7fc616800640 1 -- 172.21.15.7:0/35927471 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4034620 con 0x5627b42fa390 2024-04-23T15:41:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.917+0000 7fc616800640 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b4305ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc610002230 tx=0x7fc610030920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74cbaa93fb2acad4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.919+0000 7fc602600640 1 -- 172.21.15.7:0/35927471 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610041070 con 0x5627b42fa390 2024-04-23T15:41:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.919+0000 7fc602600640 1 -- 172.21.15.7:0/35927471 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc610009a60 con 0x5627b42fa390 2024-04-23T15:41:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.919+0000 7fc602600640 1 -- 172.21.15.7:0/35927471 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610058980 con 0x5627b42fa390 2024-04-23T15:41:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.920+0000 7fc61fa35740 1 -- 172.21.15.7:0/35927471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 msgr2=0x5627b4305ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.920+0000 7fc61fa35740 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b4305ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc610002230 tx=0x7fc610030920 comp rx=0 tx=0).stop 2024-04-23T15:41:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 -- 172.21.15.7:0/35927471 shutdown_connections 2024-04-23T15:41:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b4305ae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b42f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 --2- 172.21.15.7:0/35927471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b42f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 -- 172.21.15.7:0/35927471 >> 172.21.15.7:0/35927471 conn(0x5627b42eb6c0 msgr2=0x5627b43053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 -- 172.21.15.7:0/35927471 shutdown_connections 2024-04-23T15:41:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.922+0000 7fc61fa35740 1 -- 172.21.15.7:0/35927471 wait complete. 2024-04-23T15:41:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.923+0000 7fc61fa35740 1 -- start start 2024-04-23T15:41:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.923+0000 7fc61fa35740 1 Processor -- start 2024-04-23T15:41:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.925+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b430f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.925+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b430cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc61fa35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b430d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc61fa35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f8011520 con 0x5627b42ef1b0 2024-04-23T15:41:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc61fa35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f8010e50 con 0x5627b42fa390 2024-04-23T15:41:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc61fa35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f800e0b0 con 0x5627b42efad0 2024-04-23T15:41:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc615400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b430cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc615400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b430cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:52192/0 (socket says 172.21.15.7:52192) 2024-04-23T15:41:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc615400640 1 -- 172.21.15.7:0/872611406 learned_addr learned my addr 172.21.15.7:0/872611406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc61fa35740 10 client.0 _ll_register_callbacks cb 0x7fc608005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:41:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.926+0000 7fc616800640 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b430d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.927+0000 7fc615400640 1 -- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 msgr2=0x5627b430d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.927+0000 7fc615400640 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b430d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.927+0000 7fc615400640 1 -- 172.21.15.7:0/872611406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 msgr2=0x5627b430f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.927+0000 7fc615400640 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b430f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.927+0000 7fc615400640 1 -- 172.21.15.7:0/872611406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b430d690 con 0x5627b42efad0 2024-04-23T15:41:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.929+0000 7fc615400640 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b430cbe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc60400d010 tx=0x7fc60409c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f1d6da26d9d3039 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.932+0000 7fc5f7400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:41:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.932+0000 7fc5f7400640 1 -- 172.21.15.7:0/872611406 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60409c860 con 0x5627b42efad0 2024-04-23T15:41:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.932+0000 7fc5f7400640 1 -- 172.21.15.7:0/872611406 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 9619+0+0 (secure 0 0 0) 0x7fc60409db90 con 0x5627b42efad0 2024-04-23T15:41:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.932+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc610009a60 con 0x5627b42efad0 2024-04-23T15:41:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.933+0000 7fc5f7400640 1 -- 172.21.15.7:0/872611406 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc6040a0c10 con 0x5627b42efad0 2024-04-23T15:41:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.933+0000 7fc61fa35740 10 client.28459 fetch_fsmap learned FSMap version 32 2024-04-23T15:41:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.933+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5627b4370290 con 0x5627b42efad0 2024-04-23T15:41:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc5f7400640 1 -- 172.21.15.7:0/872611406 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc610009a60 con 0x5627b42efad0 2024-04-23T15:41:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc5f7400640 1 -- 172.21.15.7:0/872611406 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc6040985b0 con 0x5627b42efad0 2024-04-23T15:41:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc61fa35740 10 client.28459 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:41:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc61fa35740 10 client.28459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:41:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc61fa35740 20 client.28459 populate_metadata read hostname 'smithi007' 2024-04-23T15:41:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc61fa35740 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b43709c0 0x5627b4372de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc61fa35740 4 client.28459 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:41:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.934+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5627b425d190 con 0x5627b43709c0 2024-04-23T15:41:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.936+0000 7fc615e00640 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b43709c0 0x5627b4372de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.938+0000 7fc615e00640 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b43709c0 0x5627b4372de0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edba2878fa8963f6 server_cookie=4bbb9a48e42f4862 in_seq=0 out_seq=0 2024-04-23T15:41:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:08.938+0000 7fc5f7400640 10 client.28459 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.434+0000 7fc5f7400640 1 -- 172.21.15.7:0/872611406 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5627b425d190 con 0x5627b43709c0 2024-04-23T15:41:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.434+0000 7fc5f7400640 10 client.28459 handle_command_reply: tid=0 2024-04-23T15:41:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.434+0000 7fc61fa35740 1 client.28459 shutdown 2024-04-23T15:41:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.434+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 msgr2=0x5627b430cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.434+0000 7fc61fa35740 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b430cbe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc60400d010 tx=0x7fc60409c720 comp rx=0 tx=0).stop 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 shutdown_connections 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5627b43709c0 0x5627b4372de0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627b42fa390 0x5627b430d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627b42efad0 0x5627b430cbe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 --2- 172.21.15.7:0/872611406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627b42ef1b0 0x5627b430f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 >> 172.21.15.7:0/872611406 conn(0x5627b42eb6c0 msgr2=0x5627b43053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc5f7400640 0 client.28459 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 shutdown_connections 2024-04-23T15:41:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 1 -- 172.21.15.7:0/872611406 wait complete. 2024-04-23T15:41:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.435+0000 7fc61fa35740 20 client.28459 trim_cache size 0 max 16384 2024-04-23T15:41:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:41:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:41:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:41:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:41:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.440+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc5fc0a3e70 msgr2=0x7fc5fc0a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc5fc0a3e70 0x7fc5fc0a6330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5627b42f0750 tx=0x7fc608005f90 comp rx=0 tx=0).stop 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074c20 msgr2=0x7fc61810e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074c20 0x7fc61810e260 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e7c0 tx=0x7fc60400ec80 comp rx=0 tx=0).stop 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 shutdown_connections 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc5fc0a3e70 0x7fc5fc0a6330 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5627b42f0750 tx=0x7fc608005f90 comp rx=0 tx=0).stop 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc61810e8f0 0x7fc618102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618074c20 0x7fc61810e260 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 --2- 172.21.15.7:0/3028304860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc618074300 0x7fc61810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.441+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 >> 172.21.15.7:0/3028304860 conn(0x7fc618079490 msgr2=0x7fc6180fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.443+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 shutdown_connections 2024-04-23T15:41:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:09.443+0000 7fc61cc00640 1 -- 172.21.15.7:0/3028304860 wait complete. 2024-04-23T15:41:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:09 smithi007 ceph-mon[27906]: pgmap v1578: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 2.59k op/s 2024-04-23T15:41:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:09 smithi186 ceph-mon[31814]: pgmap v1578: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 2.59k op/s 2024-04-23T15:41:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:09 smithi137 ceph-mon[31694]: pgmap v1578: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 2.59k op/s 2024-04-23T15:41:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:11 smithi007 ceph-mon[27906]: pgmap v1579: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.8 MiB/s wr, 2.46k op/s 2024-04-23T15:41:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:11 smithi186 ceph-mon[31814]: pgmap v1579: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.8 MiB/s wr, 2.46k op/s 2024-04-23T15:41:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:11 smithi137 ceph-mon[31694]: pgmap v1579: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.8 MiB/s wr, 2.46k op/s 2024-04-23T15:41:12.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:12 smithi007 ceph-mon[27906]: pgmap v1580: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.9 MiB/s wr, 2.49k op/s 2024-04-23T15:41:12.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:12 smithi186 ceph-mon[31814]: pgmap v1580: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.9 MiB/s wr, 2.49k op/s 2024-04-23T15:41:12.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:12 smithi137 ceph-mon[31694]: pgmap v1580: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.9 MiB/s wr, 2.49k op/s 2024-04-23T15:41:15.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:14 smithi137 ceph-mon[31694]: pgmap v1581: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.6 MiB/s wr, 2.42k op/s 2024-04-23T15:41:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:14 smithi007 ceph-mon[27906]: pgmap v1581: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.6 MiB/s wr, 2.42k op/s 2024-04-23T15:41:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:14 smithi186 ceph-mon[31814]: pgmap v1581: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.6 MiB/s wr, 2.42k op/s 2024-04-23T15:41:17.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:16 smithi137 ceph-mon[31694]: pgmap v1582: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 12 MiB/s wr, 3.01k op/s 2024-04-23T15:41:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:16 smithi007 ceph-mon[27906]: pgmap v1582: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 12 MiB/s wr, 3.01k op/s 2024-04-23T15:41:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:16 smithi186 ceph-mon[31814]: pgmap v1582: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 12 MiB/s wr, 3.01k op/s 2024-04-23T15:41:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:18 smithi007 ceph-mon[27906]: pgmap v1583: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:41:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:18 smithi007 ceph-mon[27906]: osdmap e177: 12 total, 12 up, 12 in 2024-04-23T15:41:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:18 smithi186 ceph-mon[31814]: pgmap v1583: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:41:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:18 smithi186 ceph-mon[31814]: osdmap e177: 12 total, 12 up, 12 in 2024-04-23T15:41:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:18 smithi137 ceph-mon[31694]: pgmap v1583: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-04-23T15:41:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:18 smithi137 ceph-mon[31694]: osdmap e177: 12 total, 12 up, 12 in 2024-04-23T15:41:21.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:20 smithi007 ceph-mon[27906]: pgmap v1585: 129 pgs: 10 active+clean+snaptrim, 93 active+clean, 26 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 2.70k op/s 2024-04-23T15:41:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:20 smithi186 ceph-mon[31814]: pgmap v1585: 129 pgs: 10 active+clean+snaptrim, 93 active+clean, 26 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 2.70k op/s 2024-04-23T15:41:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:20 smithi137 ceph-mon[31694]: pgmap v1585: 129 pgs: 10 active+clean+snaptrim, 93 active+clean, 26 active+clean+snaptrim_wait; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 2.70k op/s 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.704+0000 7fe4f7200640 1 -- 172.21.15.7:0/1774391212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f0004cb0 msgr2=0x7fe4f0005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.704+0000 7fe4f7200640 1 --2- 172.21.15.7:0/1774391212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f0004cb0 0x7fe4f0005090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009900 tx=0x7fe4e802a420 comp rx=0 tx=0).stop 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.704+0000 7fe4f7200640 1 -- 172.21.15.7:0/1774391212 shutdown_connections 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.704+0000 7fe4f7200640 1 --2- 172.21.15.7:0/1774391212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00a2a00 0x7fe4f00a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.704+0000 7fe4f7200640 1 --2- 172.21.15.7:0/1774391212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f00055d0 0x7fe4f00a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.704+0000 7fe4f7200640 1 --2- 172.21.15.7:0/1774391212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f0004cb0 0x7fe4f0005090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.705+0000 7fe4f7200640 1 -- 172.21.15.7:0/1774391212 >> 172.21.15.7:0/1774391212 conn(0x7fe4f000a740 msgr2=0x7fe4f000ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:22.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.705+0000 7fe4f7200640 1 -- 172.21.15.7:0/1774391212 shutdown_connections 2024-04-23T15:41:22.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.705+0000 7fe4f7200640 1 -- 172.21.15.7:0/1774391212 wait complete. 2024-04-23T15:41:22.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.706+0000 7fe4f7200640 1 Processor -- start 2024-04-23T15:41:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.707+0000 7fe4f7200640 1 -- start start 2024-04-23T15:41:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.708+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f0004cb0 0x7fe4f009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.708+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 0x7fe4f009bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.709+0000 7fe4f7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f00a2a00 0x7fe4f0097020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.709+0000 7fe4f7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00a8280 con 0x7fe4f00055d0 2024-04-23T15:41:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.709+0000 7fe4f7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00a8100 con 0x7fe4f00a2a00 2024-04-23T15:41:22.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.709+0000 7fe4f7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00a8400 con 0x7fe4f0004cb0 2024-04-23T15:41:22.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.710+0000 7fe4f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 0x7fe4f009bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.710+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f00a2a00 0x7fe4f0097020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.710+0000 7fe4f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 0x7fe4f009bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38584/0 (socket says 172.21.15.7:38584) 2024-04-23T15:41:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.710+0000 7fe4f5400640 1 -- 172.21.15.7:0/4100971303 learned_addr learned my addr 172.21.15.7:0/4100971303 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.710+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f0004cb0 0x7fe4f009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.711+0000 7fe4f5400640 1 -- 172.21.15.7:0/4100971303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f0004cb0 msgr2=0x7fe4f009ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.711+0000 7fe4f5400640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f0004cb0 0x7fe4f009ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.711+0000 7fe4f5400640 1 -- 172.21.15.7:0/4100971303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f00a2a00 msgr2=0x7fe4f0097020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.711+0000 7fe4f5400640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f00a2a00 0x7fe4f0097020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.711+0000 7fe4f5400640 1 -- 172.21.15.7:0/4100971303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00977a0 con 0x7fe4f00055d0 2024-04-23T15:41:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.713+0000 7fe4f5400640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 0x7fe4f009bf40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400b450 tx=0x7fe4e400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:22.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.714+0000 7fe4eea00640 1 -- 172.21.15.7:0/4100971303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4015020 con 0x7fe4f00055d0 2024-04-23T15:41:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.714+0000 7fe4eea00640 1 -- 172.21.15.7:0/4100971303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4e4011d40 con 0x7fe4f00055d0 2024-04-23T15:41:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.714+0000 7fe4eea00640 1 -- 172.21.15.7:0/4100971303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400f340 con 0x7fe4f00055d0 2024-04-23T15:41:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.714+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f0097a90 con 0x7fe4f00055d0 2024-04-23T15:41:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.716+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f00a1910 con 0x7fe4f00055d0 2024-04-23T15:41:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.728+0000 7fe4eea00640 1 -- 172.21.15.7:0/4100971303 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fe4e4018020 con 0x7fe4f00055d0 2024-04-23T15:41:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.729+0000 7fe4ffc08740 1 Processor -- start 2024-04-23T15:41:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.731+0000 7fe4ffc08740 1 -- start start 2024-04-23T15:41:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.733+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d6a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.734+0000 7fe4eea00640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.734+0000 7fe4eea00640 1 -- 172.21.15.7:0/4100971303 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7fe4e40d04e0 con 0x7fe4f00055d0 2024-04-23T15:41:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.734+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d6a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.734+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d6a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50294/0 (socket says 172.21.15.7:50294) 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.734+0000 7fe4f6800640 1 -- 172.21.15.7:0/983233986 learned_addr learned my addr 172.21.15.7:0/983233986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.735+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.735+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d75060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.736+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d77990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.736+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558409cd0900 con 0x558409d6ace0 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.736+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558409c76f20 con 0x558409d755a0 2024-04-23T15:41:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.736+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558409ccc8c0 con 0x558409d6a3c0 2024-04-23T15:41:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.737+0000 7fe4f5400640 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d75060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.738+0000 7fe4f5400640 1 -- 172.21.15.7:0/983233986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 msgr2=0x558409d6a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.738+0000 7fe4f5400640 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d6a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.738+0000 7fe4f5400640 1 -- 172.21.15.7:0/983233986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 msgr2=0x558409d77990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:41:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.738+0000 7fe4f5400640 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d77990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.738+0000 7fe4f5400640 1 -- 172.21.15.7:0/983233986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558409c9be10 con 0x558409d6ace0 2024-04-23T15:41:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.739+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8000c00 tx=0x7fe4e8005a00 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.739+0000 7fe4f5400640 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d75060 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40cd8b0 tx=0x7fe4e409bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a56411fa073bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.739+0000 7fe4f6800640 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d6a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:41:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.749+0000 7fe4e3400640 1 -- 172.21.15.7:0/983233986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40b5070 con 0x558409d6ace0 2024-04-23T15:41:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.751+0000 7fe4e3400640 1 -- 172.21.15.7:0/983233986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4e40a04b0 con 0x558409d6ace0 2024-04-23T15:41:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.751+0000 7fe4e3400640 1 -- 172.21.15.7:0/983233986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40d0170 con 0x558409d6ace0 2024-04-23T15:41:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.752+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 msgr2=0x558409d75060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.752+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d75060 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40cd8b0 tx=0x7fe4e409bb20 comp rx=0 tx=0).stop 2024-04-23T15:41:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.758+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 shutdown_connections 2024-04-23T15:41:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.758+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d77990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.758+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d75060 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.758+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/983233986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d6a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.758+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 >> 172.21.15.7:0/983233986 conn(0x558409d668d0 msgr2=0x558409d66cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.760+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 shutdown_connections 2024-04-23T15:41:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.760+0000 7fe4ffc08740 1 -- 172.21.15.7:0/983233986 wait complete. 2024-04-23T15:41:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.761+0000 7fe4ffc08740 1 -- start start 2024-04-23T15:41:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.761+0000 7fe4ffc08740 1 Processor -- start 2024-04-23T15:41:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.762+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6a3c0 0x558409d724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.762+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d72a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.763+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d72f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.763+0000 7fe4ffc08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558409d780e0 con 0x558409d6a3c0 2024-04-23T15:41:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.763+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6a3c0 0x558409d724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.764+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6a3c0 0x558409d724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38604/0 (socket says 172.21.15.7:38604) 2024-04-23T15:41:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.764+0000 7fe4f5e00640 1 -- 172.21.15.7:0/2130806609 learned_addr learned my addr 172.21.15.7:0/2130806609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.765+0000 7fe4f5400640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d72a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.763+0000 7fe4ffc08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558409c8a2c0 con 0x558409d755a0 2024-04-23T15:41:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x558409d78260 con 0x558409d6ace0 2024-04-23T15:41:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4ffc08740 10 client.0 _ll_register_callbacks cb 0x5584099e2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:41:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4f6800640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d72f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4f5400640 1 -- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 msgr2=0x558409d72f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4f5400640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d72f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4f5400640 1 -- 172.21.15.7:0/2130806609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6a3c0 msgr2=0x558409d724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4f5400640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6a3c0 0x558409d724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.766+0000 7fe4f5400640 1 -- 172.21.15.7:0/2130806609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558409c9afd0 con 0x558409d6ace0 2024-04-23T15:41:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.767+0000 7fe4f5400640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d72a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009fd0 tx=0x7fe4e4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72070fe0936730c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.767+0000 7fe4d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:41:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.770+0000 7fe4d7e00640 1 -- 172.21.15.7:0/2130806609 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40b5040 con 0x558409d6ace0 2024-04-23T15:41:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.770+0000 7fe4d7e00640 1 -- 172.21.15.7:0/2130806609 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7fe4e40d0170 con 0x558409d6ace0 2024-04-23T15:41:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.770+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4e40a04b0 con 0x558409d6ace0 2024-04-23T15:41:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.770+0000 7fe4d7e00640 1 -- 172.21.15.7:0/2130806609 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe4e40a4d70 con 0x558409d6ace0 2024-04-23T15:41:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.771+0000 7fe4ffc08740 10 client.28468 fetch_fsmap learned FSMap version 32 2024-04-23T15:41:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.771+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5584099e3210 con 0x558409d6ace0 2024-04-23T15:41:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4d7e00640 1 -- 172.21.15.7:0/2130806609 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4e40a04b0 con 0x558409d6ace0 2024-04-23T15:41:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4d7e00640 1 -- 172.21.15.7:0/2130806609 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe4e409b550 con 0x558409d6ace0 2024-04-23T15:41:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4ffc08740 10 client.28468 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:41:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4ffc08740 10 client.28468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:41:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4ffc08740 20 client.28468 populate_metadata read hostname 'smithi007' 2024-04-23T15:41:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409d85540 0x558409d87930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4ffc08740 4 client.28468 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:41:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.772+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558409cde320 con 0x558409d85540 2024-04-23T15:41:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.773+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409d85540 0x558409d87930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.775+0000 7fe4d7e00640 10 client.28468 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.776+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409d85540 0x558409d87930 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f4775111b9133e4 server_cookie=22868dc5d571b24d in_seq=0 out_seq=0 2024-04-23T15:41:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.777+0000 7fe4d7e00640 1 -- 172.21.15.7:0/2130806609 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558409cde320 con 0x558409d85540 2024-04-23T15:41:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.777+0000 7fe4d7e00640 10 client.28468 handle_command_reply: tid=0 2024-04-23T15:41:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.777+0000 7fe4ffc08740 1 client.28468 shutdown 2024-04-23T15:41:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.778+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 msgr2=0x558409d72a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.778+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d72a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009fd0 tx=0x7fe4e4004770 comp rx=0 tx=0).stop 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.782+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 shutdown_connections 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.782+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409d85540 0x558409d87930 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.782+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d72f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.782+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d72a20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.782+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/2130806609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6a3c0 0x558409d724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.782+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 >> 172.21.15.7:0/2130806609 conn(0x558409d668d0 msgr2=0x558409d6c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.783+0000 7fe4d7e00640 0 client.28468 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.783+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 shutdown_connections 2024-04-23T15:41:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.783+0000 7fe4ffc08740 1 -- 172.21.15.7:0/2130806609 wait complete. 2024-04-23T15:41:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.784+0000 7fe4ffc08740 20 client.28468 trim_cache size 0 max 16384 2024-04-23T15:41:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.842+0000 7fe4ffc08740 1 Processor -- start 2024-04-23T15:41:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.843+0000 7fe4ffc08740 1 -- start start 2024-04-23T15:41:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.845+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d74c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.846+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d71640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.846+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d80d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.846+0000 7fe4ffc08740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0152080 con 0x558409d6ace0 2024-04-23T15:41:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.846+0000 7fe4ffc08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0153bc0 con 0x558409d755a0 2024-04-23T15:41:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.846+0000 7fe4ffc08740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0152750 con 0x558409d6a3c0 2024-04-23T15:41:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.846+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d74c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.847+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d80d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.847+0000 7fe4f6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d80d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:39050/0 (socket says 172.21.15.7:39050) 2024-04-23T15:41:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.847+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d74c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:50312/0 (socket says 172.21.15.7:50312) 2024-04-23T15:41:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.847+0000 7fe4f5e00640 1 -- 172.21.15.7:0/36706173 learned_addr learned my addr 172.21.15.7:0/36706173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.848+0000 7fe4f5e00640 1 -- 172.21.15.7:0/36706173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 msgr2=0x558409d80d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.848+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d80d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.848+0000 7fe4f5e00640 1 -- 172.21.15.7:0/36706173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 msgr2=0x558409d71640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.848+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d71640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.848+0000 7fe4f5e00640 1 -- 172.21.15.7:0/36706173 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558409aaf620 con 0x558409d6a3c0 2024-04-23T15:41:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.851+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d74c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe4e802a940 tx=0x7fe4e8040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed7ce0a98d1f3f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.851+0000 7fe4e2a00640 1 -- 172.21.15.7:0/36706173 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8057070 con 0x558409d6a3c0 2024-04-23T15:41:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.852+0000 7fe4e2a00640 1 -- 172.21.15.7:0/36706173 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4e8003da0 con 0x558409d6a3c0 2024-04-23T15:41:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.852+0000 7fe4e2a00640 1 -- 172.21.15.7:0/36706173 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e803c440 con 0x558409d6a3c0 2024-04-23T15:41:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.853+0000 7fe4ffc08740 1 -- 172.21.15.7:0/36706173 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 msgr2=0x558409d74c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.853+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d74c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe4e802a940 tx=0x7fe4e8040000 comp rx=0 tx=0).stop 2024-04-23T15:41:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.853+0000 7fe4ffc08740 1 -- 172.21.15.7:0/36706173 shutdown_connections 2024-04-23T15:41:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.853+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d755a0 0x558409d80d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.853+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d6ace0 0x558409d71640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.853+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/36706173 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6a3c0 0x558409d74c10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.855+0000 7fe4ffc08740 1 -- 172.21.15.7:0/36706173 >> 172.21.15.7:0/36706173 conn(0x558409d668d0 msgr2=0x558409d805f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.855+0000 7fe4ffc08740 1 -- 172.21.15.7:0/36706173 shutdown_connections 2024-04-23T15:41:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.855+0000 7fe4ffc08740 1 -- 172.21.15.7:0/36706173 wait complete. 2024-04-23T15:41:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.856+0000 7fe4ffc08740 1 -- start start 2024-04-23T15:41:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.856+0000 7fe4ffc08740 1 Processor -- start 2024-04-23T15:41:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.859+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 0x558409d8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.859+0000 7fe4ffc08740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d88280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.859+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 0x558409d8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.859+0000 7fe4f5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 0x558409d8aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:39058/0 (socket says 172.21.15.7:39058) 2024-04-23T15:41:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.860+0000 7fe4f5e00640 1 -- 172.21.15.7:0/4124470648 learned_addr learned my addr 172.21.15.7:0/4124470648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.860+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d755a0 0x558409d889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.860+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01534f0 con 0x558409d755a0 2024-04-23T15:41:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.860+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0152e20 con 0x558409d6a3c0 2024-04-23T15:41:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.860+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0150080 con 0x558409d6ace0 2024-04-23T15:41:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.861+0000 7fe4ffc08740 10 client.0 _ll_register_callbacks cb 0x7fe4e409bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:41:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.861+0000 7fe4f5400640 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d88280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.862+0000 7fe4f5e00640 1 -- 172.21.15.7:0/4124470648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 msgr2=0x558409d88280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.862+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d88280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.862+0000 7fe4f5e00640 1 -- 172.21.15.7:0/4124470648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d755a0 msgr2=0x558409d889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.862+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d755a0 0x558409d889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.862+0000 7fe4f5e00640 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558409dea720 con 0x558409d6a3c0 2024-04-23T15:41:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.863+0000 7fe4f5e00640 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 0x558409d8aef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8003700 tx=0x7fe4e8051ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d019c3f356bba4d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.863+0000 7fe4d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:41:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.864+0000 7fe4d7e00640 1 -- 172.21.15.7:0/4124470648 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8057030 con 0x558409d6a3c0 2024-04-23T15:41:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.864+0000 7fe4d7e00640 1 -- 172.21.15.7:0/4124470648 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7fe4e8050070 con 0x558409d6a3c0 2024-04-23T15:41:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.865+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4e8003da0 con 0x558409d6a3c0 2024-04-23T15:41:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.866+0000 7fe4d7e00640 1 -- 172.21.15.7:0/4124470648 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe4e8062050 con 0x558409d6a3c0 2024-04-23T15:41:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.866+0000 7fe4ffc08740 10 client.38348 fetch_fsmap learned FSMap version 32 2024-04-23T15:41:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.866+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558409deb8d0 con 0x558409d6a3c0 2024-04-23T15:41:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.867+0000 7fe4d7e00640 1 -- 172.21.15.7:0/4124470648 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4e8003da0 con 0x558409d6a3c0 2024-04-23T15:41:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.867+0000 7fe4d7e00640 1 -- 172.21.15.7:0/4124470648 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fe4e803c820 con 0x558409d6a3c0 2024-04-23T15:41:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.867+0000 7fe4ffc08740 10 client.38348 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:41:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.867+0000 7fe4ffc08740 10 client.38348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:41:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.867+0000 7fe4ffc08740 20 client.38348 populate_metadata read hostname 'smithi007' 2024-04-23T15:41:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.867+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409debfc0 0x558409dee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.868+0000 7fe4ffc08740 4 client.38348 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:41:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.868+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558409cd8190 con 0x558409debfc0 2024-04-23T15:41:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.869+0000 7fe4f5400640 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409debfc0 0x558409dee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.871+0000 7fe4f5400640 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409debfc0 0x558409dee3e0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa998d0fe3a8302 server_cookie=ce4b808f449fba6e in_seq=0 out_seq=0 2024-04-23T15:41:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:22.872+0000 7fe4d7e00640 10 client.38348 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:22 smithi007 ceph-mon[27906]: pgmap v1586: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-04-23T15:41:23.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:22 smithi186 ceph-mon[31814]: pgmap v1586: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-04-23T15:41:23.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:22 smithi137 ceph-mon[31694]: pgmap v1586: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-04-23T15:41:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:24 smithi007 ceph-mon[27906]: pgmap v1587: 129 pgs: 18 active+clean+snaptrim, 59 active+clean, 52 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 2.53k op/s 2024-04-23T15:41:25.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:24 smithi186 ceph-mon[31814]: pgmap v1587: 129 pgs: 18 active+clean+snaptrim, 59 active+clean, 52 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 2.53k op/s 2024-04-23T15:41:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:24 smithi137 ceph-mon[31694]: pgmap v1587: 129 pgs: 18 active+clean+snaptrim, 59 active+clean, 52 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 2.53k op/s 2024-04-23T15:41:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:26 smithi007 ceph-mon[27906]: pgmap v1588: 129 pgs: 17 active+clean+snaptrim, 60 active+clean, 52 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.9 MiB/s wr, 2.17k op/s 2024-04-23T15:41:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:26 smithi186 ceph-mon[31814]: pgmap v1588: 129 pgs: 17 active+clean+snaptrim, 60 active+clean, 52 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.9 MiB/s wr, 2.17k op/s 2024-04-23T15:41:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:26 smithi137 ceph-mon[31694]: pgmap v1588: 129 pgs: 17 active+clean+snaptrim, 60 active+clean, 52 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.9 MiB/s wr, 2.17k op/s 2024-04-23T15:41:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:28 smithi007 ceph-mon[27906]: pgmap v1589: 129 pgs: 16 active+clean+snaptrim, 67 active+clean, 46 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 2.60k op/s 2024-04-23T15:41:29.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:28 smithi186 ceph-mon[31814]: pgmap v1589: 129 pgs: 16 active+clean+snaptrim, 67 active+clean, 46 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 2.60k op/s 2024-04-23T15:41:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:28 smithi137 ceph-mon[31694]: pgmap v1589: 129 pgs: 16 active+clean+snaptrim, 67 active+clean, 46 active+clean+snaptrim_wait; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 2.60k op/s 2024-04-23T15:41:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:30 smithi007 ceph-mon[27906]: pgmap v1590: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:41:31.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:30 smithi186 ceph-mon[31814]: pgmap v1590: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:41:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:30 smithi137 ceph-mon[31694]: pgmap v1590: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:41:33.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:32 smithi007 ceph-mon[27906]: pgmap v1591: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.8 MiB/s wr, 2.41k op/s 2024-04-23T15:41:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:32 smithi186 ceph-mon[31814]: pgmap v1591: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.8 MiB/s wr, 2.41k op/s 2024-04-23T15:41:33.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:32 smithi137 ceph-mon[31694]: pgmap v1591: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.8 MiB/s wr, 2.41k op/s 2024-04-23T15:41:35.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:34 smithi007 ceph-mon[27906]: pgmap v1592: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.6 MiB/s wr, 2.37k op/s 2024-04-23T15:41:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:34 smithi186 ceph-mon[31814]: pgmap v1592: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.6 MiB/s wr, 2.37k op/s 2024-04-23T15:41:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:34 smithi137 ceph-mon[31694]: pgmap v1592: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.6 MiB/s wr, 2.37k op/s 2024-04-23T15:41:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:36 smithi007 ceph-mon[27906]: pgmap v1593: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.75k op/s 2024-04-23T15:41:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:37 smithi186 ceph-mon[31814]: pgmap v1593: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.75k op/s 2024-04-23T15:41:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:37 smithi137 ceph-mon[31694]: pgmap v1593: 129 pgs: 15 active+clean+snaptrim, 68 active+clean, 46 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.75k op/s 2024-04-23T15:41:39.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.205+0000 7fe4d7e00640 1 -- 172.21.15.7:0/4124470648 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558409cd8190 con 0x558409debfc0 2024-04-23T15:41:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.205+0000 7fe4d7e00640 10 client.38348 handle_command_reply: tid=0 2024-04-23T15:41:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.205+0000 7fe4ffc08740 1 client.38348 shutdown 2024-04-23T15:41:39.206 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.206+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 msgr2=0x558409d8aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.206+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 0x558409d8aef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8003700 tx=0x7fe4e8051ad0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 shutdown_connections 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x558409debfc0 0x558409dee3e0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558409d755a0 0x558409d889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558409d6ace0 0x558409d88280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4ffc08740 1 --2- 172.21.15.7:0/4124470648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558409d6a3c0 0x558409d8aef0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4d7e00640 0 client.38348 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.208+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 >> 172.21.15.7:0/4124470648 conn(0x558409d668d0 msgr2=0x558409d80e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:39.217 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.217+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 shutdown_connections 2024-04-23T15:41:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:41:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:41:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:41:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:41:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.221+0000 7fe4ffc08740 1 -- 172.21.15.7:0/4124470648 wait complete. 2024-04-23T15:41:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.221+0000 7fe4ffc08740 20 client.38348 trim_cache size 0 max 16384 2024-04-23T15:41:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.227+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4dc0a3da0 msgr2=0x7fe4dc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.227+0000 7fe4f7200640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8000c00 tx=0x7fe4e8005a00 comp rx=0 tx=0).stop 2024-04-23T15:41:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.227+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 msgr2=0x7fe4f009bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.227+0000 7fe4f7200640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 0x7fe4f009bf40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400b450 tx=0x7fe4e400b910 comp rx=0 tx=0).stop 2024-04-23T15:41:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.230+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 shutdown_connections 2024-04-23T15:41:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.230+0000 7fe4f7200640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.230+0000 7fe4f7200640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4f00a2a00 0x7fe4f0097020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.230+0000 7fe4f7200640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4f00055d0 0x7fe4f009bf40 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.230+0000 7fe4f7200640 1 --2- 172.21.15.7:0/4100971303 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f0004cb0 0x7fe4f009ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.230+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 >> 172.21.15.7:0/4100971303 conn(0x7fe4f000a740 msgr2=0x7fe4f00a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.234+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 shutdown_connections 2024-04-23T15:41:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:39.236+0000 7fe4f7200640 1 -- 172.21.15.7:0/4100971303 wait complete. 2024-04-23T15:41:39.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:39 smithi007 ceph-mon[27906]: pgmap v1594: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 2.88k op/s 2024-04-23T15:41:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:39 smithi186 ceph-mon[31814]: pgmap v1594: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 2.88k op/s 2024-04-23T15:41:39.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:39 smithi137 ceph-mon[31694]: pgmap v1594: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 12 MiB/s wr, 2.88k op/s 2024-04-23T15:41:41.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:41 smithi007 ceph-mon[27906]: pgmap v1595: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.77k op/s 2024-04-23T15:41:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:41 smithi186 ceph-mon[31814]: pgmap v1595: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.77k op/s 2024-04-23T15:41:41.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:41 smithi137 ceph-mon[31694]: pgmap v1595: 129 pgs: 14 active+clean+snaptrim, 75 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.77k op/s 2024-04-23T15:41:43.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:43 smithi007 ceph-mon[27906]: pgmap v1596: 129 pgs: 13 active+clean+snaptrim, 84 active+clean, 32 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:41:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:43 smithi186 ceph-mon[31814]: pgmap v1596: 129 pgs: 13 active+clean+snaptrim, 84 active+clean, 32 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:41:43.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:43 smithi137 ceph-mon[31694]: pgmap v1596: 129 pgs: 13 active+clean+snaptrim, 84 active+clean, 32 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:41:45.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:45 smithi007 ceph-mon[27906]: pgmap v1597: 129 pgs: 13 active+clean+snaptrim, 84 active+clean, 32 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 11 MiB/s wr, 2.66k op/s 2024-04-23T15:41:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:45 smithi186 ceph-mon[31814]: pgmap v1597: 129 pgs: 13 active+clean+snaptrim, 84 active+clean, 32 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 11 MiB/s wr, 2.66k op/s 2024-04-23T15:41:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:45 smithi137 ceph-mon[31694]: pgmap v1597: 129 pgs: 13 active+clean+snaptrim, 84 active+clean, 32 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 11 MiB/s wr, 2.66k op/s 2024-04-23T15:41:47.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:47 smithi007 ceph-mon[27906]: pgmap v1598: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-04-23T15:41:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:47 smithi186 ceph-mon[31814]: pgmap v1598: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-04-23T15:41:47.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:47 smithi137 ceph-mon[31694]: pgmap v1598: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-04-23T15:41:48.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:48 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:41:48.367 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:48 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:41:48.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:48 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:41:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:49 smithi007 ceph-mon[27906]: pgmap v1599: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:41:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:49 smithi186 ceph-mon[31814]: pgmap v1599: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:41:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:49 smithi137 ceph-mon[31694]: pgmap v1599: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 2.79k op/s 2024-04-23T15:41:50.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:50 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:50.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:50 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:50.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:50 smithi007 ceph-mon[27906]: pgmap v1600: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 2.82k op/s 2024-04-23T15:41:50.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:50 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:50.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:50 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:50.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:50 smithi186 ceph-mon[31814]: pgmap v1600: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 2.82k op/s 2024-04-23T15:41:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:50 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:50 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:50.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:50 smithi137 ceph-mon[31694]: pgmap v1600: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 2.82k op/s 2024-04-23T15:41:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.562+0000 7f815e200640 1 -- 172.21.15.7:0/3835586010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8158109530 msgr2=0x7f8158111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.562+0000 7f815e200640 1 --2- 172.21.15.7:0/3835586010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8158109530 0x7f8158111100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8150009ca0 tx=0x7f815002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.563+0000 7f815e200640 1 -- 172.21.15.7:0/3835586010 shutdown_connections 2024-04-23T15:41:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.563+0000 7f815e200640 1 --2- 172.21.15.7:0/3835586010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8158109530 0x7f8158111100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.563+0000 7f815e200640 1 --2- 172.21.15.7:0/3835586010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158104e10 0x7f8158108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.563+0000 7f815e200640 1 --2- 172.21.15.7:0/3835586010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 0x7f8158104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.563+0000 7f815e200640 1 -- 172.21.15.7:0/3835586010 >> 172.21.15.7:0/3835586010 conn(0x7f81580ffd00 msgr2=0x7f8158102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.565+0000 7f815e200640 1 -- 172.21.15.7:0/3835586010 shutdown_connections 2024-04-23T15:41:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.565+0000 7f815e200640 1 -- 172.21.15.7:0/3835586010 wait complete. 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.582+0000 7f815e200640 1 Processor -- start 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.582+0000 7f815e200640 1 -- start start 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.582+0000 7f815e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 0x7f815810fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.582+0000 7f815e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 0x7f8158110380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f815e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81581108c0 0x7f8158114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f815e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81580779e0 con 0x7f8158104460 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f815e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8158077860 con 0x7f81581108c0 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f815e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8158077b60 con 0x7f8158109530 2024-04-23T15:41:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f814fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 0x7f8158110380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f814fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 0x7f8158110380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:45728/0 (socket says 172.21.15.7:45728) 2024-04-23T15:41:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.583+0000 7f814fe00640 1 -- 172.21.15.7:0/2822518146 learned_addr learned my addr 172.21.15.7:0/2822518146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.584+0000 7f814fe00640 1 -- 172.21.15.7:0/2822518146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81581108c0 msgr2=0x7f8158114f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T15:41:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.584+0000 7f814fe00640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81581108c0 0x7f8158114f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.584+0000 7f814fe00640 1 -- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 msgr2=0x7f815810fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.584+0000 7f8157400640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 0x7f815810fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.585+0000 7f814fe00640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 0x7f815810fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.585+0000 7f814fe00640 1 -- 172.21.15.7:0/2822518146 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8158115700 con 0x7f8158109530 2024-04-23T15:41:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.585+0000 7f8157400640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 0x7f815810fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:41:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.586+0000 7f814fe00640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 0x7f8158110380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f814800d770 tx=0x7f814800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.587+0000 7f8154c00640 1 -- 172.21.15.7:0/2822518146 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148017070 con 0x7f8158109530 2024-04-23T15:41:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.587+0000 7f8154c00640 1 -- 172.21.15.7:0/2822518146 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8148009c30 con 0x7f8158109530 2024-04-23T15:41:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.587+0000 7f8154c00640 1 -- 172.21.15.7:0/2822518146 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814800f620 con 0x7f8158109530 2024-04-23T15:41:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.587+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81581159f0 con 0x7f8158109530 2024-04-23T15:41:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.587+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8158115f40 con 0x7f8158109530 2024-04-23T15:41:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.600+0000 7f8154c00640 1 -- 172.21.15.7:0/2822518146 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f814801a070 con 0x7f8158109530 2024-04-23T15:41:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.602+0000 7f8161184740 1 Processor -- start 2024-04-23T15:41:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.602+0000 7f8161184740 1 -- start start 2024-04-23T15:41:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.605+0000 7f8161184740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f75f2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.605+0000 7f8161184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.605+0000 7f8161184740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75fd390 0x5589f75ff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.605+0000 7f8161184740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589f7558900 con 0x5589f75f21b0 2024-04-23T15:41:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.605+0000 7f8161184740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5589f74fef20 con 0x5589f75fd390 2024-04-23T15:41:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.605+0000 7f8161184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5589f75548c0 con 0x5589f75f2ad0 2024-04-23T15:41:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.606+0000 7f8157400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f75f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.607+0000 7f8157400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f75f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45214/0 (socket says 172.21.15.7:45214) 2024-04-23T15:41:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.607+0000 7f8157400640 1 -- 172.21.15.7:0/978981374 learned_addr learned my addr 172.21.15.7:0/978981374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.607+0000 7f814fe00640 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.609+0000 7f8157e00640 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75fd390 0x5589f75ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.609+0000 7f8154c00640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f813c0a3f20 0x7f813c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.609+0000 7f8154c00640 1 -- 172.21.15.7:0/2822518146 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7f81480d05a0 con 0x7f8158109530 2024-04-23T15:41:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.612+0000 7f8157400640 1 -- 172.21.15.7:0/978981374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 msgr2=0x5589f75fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.612+0000 7f8157400640 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.612+0000 7f8157400640 1 -- 172.21.15.7:0/978981374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75fd390 msgr2=0x5589f75ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.612+0000 7f8157400640 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75fd390 0x5589f75ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.612+0000 7f8157400640 1 -- 172.21.15.7:0/978981374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f7523e10 con 0x5589f75f21b0 2024-04-23T15:41:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.613+0000 7f8157e00640 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75fd390 0x5589f75ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:41:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.614+0000 7f8157e00640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f813c0a3f20 0x7f813c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.615+0000 7f8157400640 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f75f2590 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f814000aa10 tx=0x7f814000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999ac64f1a3a6a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.620+0000 7f8147e00640 1 -- 172.21.15.7:0/978981374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140015070 con 0x5589f75f21b0 2024-04-23T15:41:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.621+0000 7f8147e00640 1 -- 172.21.15.7:0/978981374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f814000cc60 con 0x5589f75f21b0 2024-04-23T15:41:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.621+0000 7f8147e00640 1 -- 172.21.15.7:0/978981374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140018580 con 0x5589f75f21b0 2024-04-23T15:41:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.624+0000 7f8161184740 1 -- 172.21.15.7:0/978981374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 msgr2=0x5589f75f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.624+0000 7f8161184740 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f75f2590 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f814000aa10 tx=0x7f814000aed0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.624+0000 7f8157e00640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f813c0a3f20 0x7f813c0a63e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8150009a60 tx=0x7f81500095c0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.625+0000 7f8161184740 1 -- 172.21.15.7:0/978981374 shutdown_connections 2024-04-23T15:41:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.625+0000 7f8161184740 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75fd390 0x5589f75ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.625+0000 7f8161184740 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.625+0000 7f8161184740 1 --2- 172.21.15.7:0/978981374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f75f2590 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.625+0000 7f8161184740 1 -- 172.21.15.7:0/978981374 >> 172.21.15.7:0/978981374 conn(0x5589f75ee6c0 msgr2=0x5589f75eeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.626+0000 7f8161184740 1 -- 172.21.15.7:0/978981374 shutdown_connections 2024-04-23T15:41:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.627+0000 7f8161184740 1 -- 172.21.15.7:0/978981374 wait complete. 2024-04-23T15:41:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.627+0000 7f8161184740 1 -- start start 2024-04-23T15:41:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.631+0000 7f8161184740 1 Processor -- start 2024-04-23T15:41:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.632+0000 7f8161184740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f21b0 0x5589f75fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.632+0000 7f8161184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.633+0000 7f8161184740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75fd390 0x5589f75fad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.633+0000 7f8161184740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589f75fffc0 con 0x5589f75fd390 2024-04-23T15:41:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.633+0000 7f8161184740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5589f75122c0 con 0x5589f75f21b0 2024-04-23T15:41:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.633+0000 7f8161184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5589f7600140 con 0x5589f75f2ad0 2024-04-23T15:41:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.633+0000 7f8161184740 10 client.0 _ll_register_callbacks cb 0x5589f726aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:41:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.634+0000 7f8157e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75fd390 0x5589f75fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.634+0000 7f814fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.635+0000 7f814fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:45752/0 (socket says 172.21.15.7:45752) 2024-04-23T15:41:52.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.635+0000 7f814fe00640 1 -- 172.21.15.7:0/2555777189 learned_addr learned my addr 172.21.15.7:0/2555777189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.636+0000 7f8157400640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f21b0 0x5589f75fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157400640 1 -- 172.21.15.7:0/2555777189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 msgr2=0x5589f75fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157400640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157400640 1 -- 172.21.15.7:0/2555777189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75fd390 msgr2=0x5589f75fad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157400640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75fd390 0x5589f75fad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157400640 1 -- 172.21.15.7:0/2555777189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f7522fd0 con 0x5589f75f21b0 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157e00640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75fd390 0x5589f75fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8144c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.637+0000 7f8157400640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f21b0 0x5589f75fa2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8140004700 tx=0x7f8140011ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b0f897ca5d9c714 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.638+0000 7f8144c00640 1 -- 172.21.15.7:0/2555777189 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140020070 con 0x5589f75f21b0 2024-04-23T15:41:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.638+0000 7f8144c00640 1 -- 172.21.15.7:0/2555777189 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7f814001a450 con 0x5589f75f21b0 2024-04-23T15:41:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.638+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f814000cc60 con 0x5589f75f21b0 2024-04-23T15:41:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.640+0000 7f8144c00640 1 -- 172.21.15.7:0/2555777189 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8140015040 con 0x5589f75f21b0 2024-04-23T15:41:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.640+0000 7f8161184740 10 client.38354 fetch_fsmap learned FSMap version 32 2024-04-23T15:41:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.640+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5589f726b210 con 0x5589f75f21b0 2024-04-23T15:41:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.643+0000 7f8144c00640 1 -- 172.21.15.7:0/2555777189 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f814000cc60 con 0x5589f75f21b0 2024-04-23T15:41:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8144c00640 1 -- 172.21.15.7:0/2555777189 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f814002e480 con 0x5589f75f21b0 2024-04-23T15:41:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8161184740 10 client.38354 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:41:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8161184740 10 client.38354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:41:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8161184740 20 client.38354 populate_metadata read hostname 'smithi007' 2024-04-23T15:41:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8161184740 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f760d270 0x5589f760f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8161184740 4 client.38354 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:41:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.644+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589f7566320 con 0x5589f760d270 2024-04-23T15:41:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.646+0000 7f814fe00640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f760d270 0x5589f760f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.647+0000 7f814fe00640 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f760d270 0x5589f760f660 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c01f6c881da24cdf server_cookie=de1014626b17c03e in_seq=0 out_seq=0 2024-04-23T15:41:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.647+0000 7f8144c00640 10 client.38354 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.648+0000 7f8144c00640 1 -- 172.21.15.7:0/2555777189 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5589f7566320 con 0x5589f760d270 2024-04-23T15:41:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.648+0000 7f8144c00640 10 client.38354 handle_command_reply: tid=0 2024-04-23T15:41:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.649+0000 7f8161184740 1 client.38354 shutdown 2024-04-23T15:41:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.649+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f21b0 msgr2=0x5589f75fa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.649+0000 7f8161184740 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f21b0 0x5589f75fa2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8140004700 tx=0x7f8140011ae0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.649+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 shutdown_connections 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.649+0000 7f8161184740 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f760d270 0x5589f760f660 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.650+0000 7f8161184740 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75fd390 0x5589f75fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.650+0000 7f8161184740 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75f2ad0 0x5589f75fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.650+0000 7f8161184740 1 --2- 172.21.15.7:0/2555777189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f21b0 0x5589f75fa2b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.650+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 >> 172.21.15.7:0/2555777189 conn(0x5589f75ee6c0 msgr2=0x5589f75f43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.650+0000 7f8144c00640 0 client.38354 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.652+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 shutdown_connections 2024-04-23T15:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.652+0000 7f8161184740 1 -- 172.21.15.7:0/2555777189 wait complete. 2024-04-23T15:41:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.652+0000 7f8161184740 20 client.38354 trim_cache size 0 max 16384 2024-04-23T15:41:52.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.694+0000 7f8161184740 1 Processor -- start 2024-04-23T15:41:52.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 -- start start 2024-04-23T15:41:52.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f7608390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f7612690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.695 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81581c6cc0 con 0x5589f75f21b0 2024-04-23T15:41:52.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81581c8800 con 0x5589f75f2ad0 2024-04-23T15:41:52.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.695+0000 7f8161184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f81581c7390 con 0x5589f75fd390 2024-04-23T15:41:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.696+0000 7f8157e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.696+0000 7f8157e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:45754/0 (socket says 172.21.15.7:45754) 2024-04-23T15:41:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.696+0000 7f8157e00640 1 -- 172.21.15.7:0/3859045540 learned_addr learned my addr 172.21.15.7:0/3859045540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.696+0000 7f814fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f7612690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.697+0000 7f8157400640 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f7608390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.698+0000 7f8157e00640 1 -- 172.21.15.7:0/3859045540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 msgr2=0x5589f7612690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.698+0000 7f8157e00640 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f7612690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.698+0000 7f8157e00640 1 -- 172.21.15.7:0/3859045540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 msgr2=0x5589f7608390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.698+0000 7f8157e00640 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f7608390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.698+0000 7f8157e00640 1 -- 172.21.15.7:0/3859045540 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f7337620 con 0x5589f75fd390 2024-04-23T15:41:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.699+0000 7f8157e00640 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f815002ade0 tx=0x7f815003e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe0b066113779368 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.705+0000 7f8147400640 1 -- 172.21.15.7:0/3859045540 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150004240 con 0x5589f75fd390 2024-04-23T15:41:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.705+0000 7f8147400640 1 -- 172.21.15.7:0/3859045540 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f815004b030 con 0x5589f75fd390 2024-04-23T15:41:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.705+0000 7f8147400640 1 -- 172.21.15.7:0/3859045540 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150030dd0 con 0x5589f75fd390 2024-04-23T15:41:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.706+0000 7f8161184740 1 -- 172.21.15.7:0/3859045540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 msgr2=0x5589f7612bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.706+0000 7f8161184740 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f815002ade0 tx=0x7f815003e000 comp rx=0 tx=0).stop 2024-04-23T15:41:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 -- 172.21.15.7:0/3859045540 shutdown_connections 2024-04-23T15:41:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f7612690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612bd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 --2- 172.21.15.7:0/3859045540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f7608390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 -- 172.21.15.7:0/3859045540 >> 172.21.15.7:0/3859045540 conn(0x5589f75ee6c0 msgr2=0x5589f75ed840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 -- 172.21.15.7:0/3859045540 shutdown_connections 2024-04-23T15:41:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.707+0000 7f8161184740 1 -- 172.21.15.7:0/3859045540 wait complete. 2024-04-23T15:41:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.708+0000 7f8161184740 1 -- start start 2024-04-23T15:41:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.708+0000 7f8161184740 1 Processor -- start 2024-04-23T15:41:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.713+0000 7f8161184740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f766be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.713+0000 7f8161184740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f766c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.714+0000 7f8161184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.714+0000 7f8161184740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81581c8130 con 0x5589f75f21b0 2024-04-23T15:41:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.714+0000 7f8161184740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81581c7a60 con 0x5589f75f2ad0 2024-04-23T15:41:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.714+0000 7f8161184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f81581c4d00 con 0x5589f75fd390 2024-04-23T15:41:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.715+0000 7f814fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f766c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.715+0000 7f8161184740 10 client.0 _ll_register_callbacks cb 0x7f81480d6060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:41:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.715+0000 7f8157e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.715+0000 7f8157e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:45756/0 (socket says 172.21.15.7:45756) 2024-04-23T15:41:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.715+0000 7f8157e00640 1 -- 172.21.15.7:0/742867 learned_addr learned my addr 172.21.15.7:0/742867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:41:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.715+0000 7f8157400640 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f766be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.716+0000 7f814fe00640 1 -- 172.21.15.7:0/742867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 msgr2=0x5589f7612070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.716+0000 7f814fe00640 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.717+0000 7f814fe00640 1 -- 172.21.15.7:0/742867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 msgr2=0x5589f766be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:41:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.717+0000 7f814fe00640 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f766be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.717+0000 7f814fe00640 1 -- 172.21.15.7:0/742867 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f7612760 con 0x5589f75f2ad0 2024-04-23T15:41:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.718+0000 7f8144c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:41:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.718+0000 7f814fe00640 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f766c3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f814809c060 tx=0x7f81480d2040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e81db41c4d10bf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:41:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.719+0000 7f8144c00640 1 -- 172.21.15.7:0/742867 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81480b4070 con 0x5589f75f2ad0 2024-04-23T15:41:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.719+0000 7f8144c00640 1 -- 172.21.15.7:0/742867 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7f8148098740 con 0x5589f75f2ad0 2024-04-23T15:41:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.719+0000 7f8161184740 1 -- 172.21.15.7:0/742867 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f815004b030 con 0x5589f75f2ad0 2024-04-23T15:41:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.720+0000 7f8144c00640 1 -- 172.21.15.7:0/742867 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8148009de0 con 0x5589f75f2ad0 2024-04-23T15:41:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.720+0000 7f8161184740 10 client.38360 fetch_fsmap learned FSMap version 32 2024-04-23T15:41:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.720+0000 7f8161184740 1 -- 172.21.15.7:0/742867 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5589f7673700 con 0x5589f75f2ad0 2024-04-23T15:41:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.720+0000 7f8144c00640 1 -- 172.21.15.7:0/742867 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f815004b030 con 0x5589f75f2ad0 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8144c00640 1 -- 172.21.15.7:0/742867 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f81480cda80 con 0x5589f75f2ad0 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8161184740 10 client.38360 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8161184740 10 client.38360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8161184740 20 client.38360 populate_metadata read hostname 'smithi007' 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8161184740 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f7673de0 0x5589f7676200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8161184740 4 client.38360 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:41:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.722+0000 7f8161184740 1 -- 172.21.15.7:0/742867 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589f7560190 con 0x5589f7673de0 2024-04-23T15:41:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.723+0000 7f8157400640 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f7673de0 0x5589f7676200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:41:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.724+0000 7f8157400640 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f7673de0 0x5589f7676200 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9f8eec40431966 server_cookie=571e0be30ec5f893 in_seq=0 out_seq=0 2024-04-23T15:41:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:52.724+0000 7f8144c00640 10 client.38360 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:52.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:52.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:52 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:52.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:52 smithi007 ceph-mon[27906]: pgmap v1601: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 2.61k op/s 2024-04-23T15:41:52.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:52.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:52 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:52.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:52 smithi186 ceph-mon[31814]: pgmap v1601: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 2.61k op/s 2024-04-23T15:41:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:52 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:52.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:52 smithi137 ceph-mon[31694]: pgmap v1601: 129 pgs: 12 active+clean+snaptrim, 93 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 2.61k op/s 2024-04-23T15:41:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:41:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:41:53.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:53 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:53.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:41:53.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:41:53.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:53 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:41:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:41:53.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:53 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:41:54.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:54 smithi186 ceph-mon[31814]: pgmap v1602: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 10 MiB/s wr, 2.52k op/s 2024-04-23T15:41:54.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:54 smithi137 ceph-mon[31694]: pgmap v1602: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 10 MiB/s wr, 2.52k op/s 2024-04-23T15:41:55.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:54 smithi007 ceph-mon[27906]: pgmap v1602: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 10 MiB/s wr, 2.52k op/s 2024-04-23T15:41:57.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:56 smithi007 ceph-mon[27906]: pgmap v1603: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 2.62k op/s 2024-04-23T15:41:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:56 smithi186 ceph-mon[31814]: pgmap v1603: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 2.62k op/s 2024-04-23T15:41:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:56 smithi137 ceph-mon[31694]: pgmap v1603: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 2.62k op/s 2024-04-23T15:41:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.445+0000 7f8144c00640 1 -- 172.21.15.7:0/742867 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5589f7560190 con 0x5589f7673de0 2024-04-23T15:41:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.445+0000 7f8144c00640 10 client.38360 handle_command_reply: tid=0 2024-04-23T15:41:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.445+0000 7f8161184740 1 client.38360 shutdown 2024-04-23T15:41:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.445+0000 7f8161184740 1 -- 172.21.15.7:0/742867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 msgr2=0x5589f766c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.445+0000 7f8161184740 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f766c3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f814809c060 tx=0x7f81480d2040 comp rx=0 tx=0).stop 2024-04-23T15:41:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 -- 172.21.15.7:0/742867 shutdown_connections 2024-04-23T15:41:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x5589f7673de0 0x5589f7676200 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5589f75f2ad0 0x5589f766c3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589f75fd390 0x5589f7612070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 --2- 172.21.15.7:0/742867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5589f75f21b0 0x5589f766be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 -- 172.21.15.7:0/742867 >> 172.21.15.7:0/742867 conn(0x5589f75ee6c0 msgr2=0x5589f75fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8144c00640 0 client.38360 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 -- 172.21.15.7:0/742867 shutdown_connections 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 1 -- 172.21.15.7:0/742867 wait complete. 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.446+0000 7f8161184740 20 client.38360 trim_cache size 0 max 16384 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:41:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:41:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.449+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f813c0a3f20 msgr2=0x7f813c0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.450+0000 7f815e200640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f813c0a3f20 0x7f813c0a63e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8150009a60 tx=0x7f81500095c0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.450+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 msgr2=0x7f8158110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:41:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.450+0000 7f815e200640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 0x7f8158110380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f814800d770 tx=0x7f814800dc30 comp rx=0 tx=0).stop 2024-04-23T15:41:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.450+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 shutdown_connections 2024-04-23T15:41:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.450+0000 7f815e200640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f813c0a3f20 0x7f813c0a63e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.451+0000 7f815e200640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81581108c0 0x7f8158114f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.451+0000 7f815e200640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8158109530 0x7f8158110380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.451+0000 7f815e200640 1 --2- 172.21.15.7:0/2822518146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8158104460 0x7f815810fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:41:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.451+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 >> 172.21.15.7:0/2822518146 conn(0x7f81580ffd00 msgr2=0x7f815807a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:41:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.451+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 shutdown_connections 2024-04-23T15:41:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:41:57.452+0000 7f815e200640 1 -- 172.21.15.7:0/2822518146 wait complete. 2024-04-23T15:41:59.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:41:58 smithi007 ceph-mon[27906]: pgmap v1604: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 11 MiB/s wr, 2.64k op/s 2024-04-23T15:41:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:41:58 smithi186 ceph-mon[31814]: pgmap v1604: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 11 MiB/s wr, 2.64k op/s 2024-04-23T15:41:59.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:41:58 smithi137 ceph-mon[31694]: pgmap v1604: 129 pgs: 11 active+clean+snaptrim, 94 active+clean, 24 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 11 MiB/s wr, 2.64k op/s 2024-04-23T15:42:01.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:00 smithi007 ceph-mon[27906]: pgmap v1605: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 10 MiB/s wr, 2.47k op/s 2024-04-23T15:42:01.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:00 smithi186 ceph-mon[31814]: pgmap v1605: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 10 MiB/s wr, 2.47k op/s 2024-04-23T15:42:01.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:00 smithi137 ceph-mon[31694]: pgmap v1605: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 10 MiB/s wr, 2.47k op/s 2024-04-23T15:42:03.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:02 smithi007 ceph-mon[27906]: pgmap v1606: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 8.8 MiB/s wr, 2.18k op/s 2024-04-23T15:42:03.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:02 smithi186 ceph-mon[31814]: pgmap v1606: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 8.8 MiB/s wr, 2.18k op/s 2024-04-23T15:42:03.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:02 smithi137 ceph-mon[31694]: pgmap v1606: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 8.8 MiB/s wr, 2.18k op/s 2024-04-23T15:42:05.220 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:04 smithi137 ceph-mon[31694]: pgmap v1607: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.7 MiB/s wr, 2.18k op/s 2024-04-23T15:42:05.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:04 smithi007 ceph-mon[27906]: pgmap v1607: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.7 MiB/s wr, 2.18k op/s 2024-04-23T15:42:05.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:04 smithi186 ceph-mon[31814]: pgmap v1607: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.7 MiB/s wr, 2.18k op/s 2024-04-23T15:42:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:06 smithi007 ceph-mon[27906]: pgmap v1608: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.9 MiB/s wr, 2.49k op/s 2024-04-23T15:42:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:06 smithi186 ceph-mon[31814]: pgmap v1608: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.9 MiB/s wr, 2.49k op/s 2024-04-23T15:42:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:06 smithi137 ceph-mon[31694]: pgmap v1608: 129 pgs: 10 active+clean+snaptrim, 102 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.9 MiB/s wr, 2.49k op/s 2024-04-23T15:42:09.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:09 smithi007 ceph-mon[27906]: pgmap v1609: 129 pgs: 9 active+clean+snaptrim, 103 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.75k op/s 2024-04-23T15:42:09.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:09 smithi186 ceph-mon[31814]: pgmap v1609: 129 pgs: 9 active+clean+snaptrim, 103 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.75k op/s 2024-04-23T15:42:09.434 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:09 smithi137 ceph-mon[31694]: pgmap v1609: 129 pgs: 9 active+clean+snaptrim, 103 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 2.75k op/s 2024-04-23T15:42:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 -- 172.21.15.7:0/1802154594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc107350 msgr2=0x7fc3dc10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/1802154594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc107350 0x7fc3dc10ef20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009be0 tx=0x7fc3d402a6f0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 -- 172.21.15.7:0/1802154594 shutdown_connections 2024-04-23T15:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/1802154594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc102c30 0x7fc3dc106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/1802154594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc107350 0x7fc3dc10ef20 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/1802154594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc102280 0x7fc3dc102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.720+0000 7fc3e0a00640 1 -- 172.21.15.7:0/1802154594 >> 172.21.15.7:0/1802154594 conn(0x7fc3dc079490 msgr2=0x7fc3dc0798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.721+0000 7fc3e0a00640 1 -- 172.21.15.7:0/1802154594 shutdown_connections 2024-04-23T15:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.721+0000 7fc3e0a00640 1 -- 172.21.15.7:0/1802154594 wait complete. 2024-04-23T15:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.722+0000 7fc3e0a00640 1 Processor -- start 2024-04-23T15:42:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 -- start start 2024-04-23T15:42:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc102280 0x7fc3dc19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc107350 0x7fc3dc19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc1a3610 0x7fc3dc1a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc110100 con 0x7fc3dc102280 2024-04-23T15:42:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc10ff80 con 0x7fc3dc1a3610 2024-04-23T15:42:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.723+0000 7fc3e0a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc110280 con 0x7fc3dc107350 2024-04-23T15:42:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.724+0000 7fc3d9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc107350 0x7fc3dc19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.724+0000 7fc3d9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc107350 0x7fc3dc19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:41120/0 (socket says 172.21.15.7:41120) 2024-04-23T15:42:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.724+0000 7fc3d9400640 1 -- 172.21.15.7:0/811347949 learned_addr learned my addr 172.21.15.7:0/811347949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3da800640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc1a3610 0x7fc3dc1a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc102280 0x7fc3dc19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3da800640 1 -- 172.21.15.7:0/811347949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc107350 msgr2=0x7fc3dc19f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3da800640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc107350 0x7fc3dc19f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3da800640 1 -- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc102280 msgr2=0x7fc3dc19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3da800640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc102280 0x7fc3dc19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3da800640 1 -- 172.21.15.7:0/811347949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc1a4100 con 0x7fc3dc1a3610 2024-04-23T15:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.725+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc102280 0x7fc3dc19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.726+0000 7fc3da800640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc1a3610 0x7fc3dc1a3ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009b30 tx=0x7fc3d4003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.729+0000 7fc3d2a00640 1 -- 172.21.15.7:0/811347949 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4041020 con 0x7fc3dc1a3610 2024-04-23T15:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.729+0000 7fc3d2a00640 1 -- 172.21.15.7:0/811347949 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3d4003e50 con 0x7fc3dc1a3610 2024-04-23T15:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.729+0000 7fc3d2a00640 1 -- 172.21.15.7:0/811347949 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4036040 con 0x7fc3dc1a3610 2024-04-23T15:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.729+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc1a4390 con 0x7fc3dc1a3610 2024-04-23T15:42:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.729+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc196470 con 0x7fc3dc1a3610 2024-04-23T15:42:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.734+0000 7fc3e37c6740 1 Processor -- start 2024-04-23T15:42:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3d2a00640 1 -- 172.21.15.7:0/811347949 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc3d4044020 con 0x7fc3dc1a3610 2024-04-23T15:42:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 -- start start 2024-04-23T15:42:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596662151b0 0x559666215590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559666215ad0 0x55966621fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666220390 0x559666222780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55966617b900 con 0x5596662151b0 2024-04-23T15:42:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559666121f20 con 0x559666220390 2024-04-23T15:42:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.736+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x5596661778c0 con 0x559666215ad0 2024-04-23T15:42:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.737+0000 7fc3d9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559666215ad0 0x55966621fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.737+0000 7fc3d9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559666215ad0 0x55966621fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:41126/0 (socket says 172.21.15.7:41126) 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.737+0000 7fc3d9e00640 1 -- 172.21.15.7:0/4141069620 learned_addr learned my addr 172.21.15.7:0/4141069620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.738+0000 7fc3d2a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc3c00a3f20 0x7fc3c00a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d2a00640 1 -- 172.21.15.7:0/811347949 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7fc3d40f1300 con 0x7fc3dc1a3610 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666220390 0x559666222780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596662151b0 0x559666215590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 -- 172.21.15.7:0/4141069620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559666215ad0 msgr2=0x55966621fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559666215ad0 0x55966621fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 -- 172.21.15.7:0/4141069620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596662151b0 msgr2=0x559666215590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596662151b0 0x559666215590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.739+0000 7fc3d9400640 1 -- 172.21.15.7:0/4141069620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559666146e10 con 0x559666220390 2024-04-23T15:42:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.740+0000 7fc3da800640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc3c00a3f20 0x7fc3c00a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.740+0000 7fc3d9400640 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666220390 0x559666222780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0ff5d0 tx=0x7fc3c8006a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5ea103abc10add server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.741+0000 7fc3da800640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc3c00a3f20 0x7fc3c00a63e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40ee5c0 tx=0x7fc3d4009520 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.741+0000 7fc3c7000640 1 -- 172.21.15.7:0/4141069620 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8028680 con 0x559666220390 2024-04-23T15:42:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.741+0000 7fc3c7000640 1 -- 172.21.15.7:0/4141069620 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3c802d070 con 0x559666220390 2024-04-23T15:42:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.741+0000 7fc3c7000640 1 -- 172.21.15.7:0/4141069620 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8015ab0 con 0x559666220390 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.742+0000 7fc3e37c6740 1 -- 172.21.15.7:0/4141069620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666220390 msgr2=0x559666222780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.742+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666220390 0x559666222780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0ff5d0 tx=0x7fc3c8006a30 comp rx=0 tx=0).stop 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 -- 172.21.15.7:0/4141069620 shutdown_connections 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666220390 0x559666222780 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0ff5d0 tx=0x7fc3c8006a30 comp rx=0 tx=0).stop 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559666215ad0 0x55966621fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/4141069620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596662151b0 0x559666215590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 -- 172.21.15.7:0/4141069620 >> 172.21.15.7:0/4141069620 conn(0x5596662116c0 msgr2=0x559666211aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:10.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 -- 172.21.15.7:0/4141069620 shutdown_connections 2024-04-23T15:42:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.743+0000 7fc3e37c6740 1 -- 172.21.15.7:0/4141069620 wait complete. 2024-04-23T15:42:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.744+0000 7fc3e37c6740 1 -- start start 2024-04-23T15:42:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.744+0000 7fc3e37c6740 1 Processor -- start 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596662151b0 0x55966621d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55966621e090 0x55966622c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559666222fc0 con 0x559666215ad0 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5596661352c0 con 0x5596662151b0 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559666223140 con 0x55966621e090 2024-04-23T15:42:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.745+0000 7fc3e37c6740 10 client.0 _ll_register_callbacks cb 0x559665e8da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:42:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.746+0000 7fc3d9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.746+0000 7fc3d9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34308/0 (socket says 172.21.15.7:34308) 2024-04-23T15:42:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.746+0000 7fc3d9e00640 1 -- 172.21.15.7:0/349882122 learned_addr learned my addr 172.21.15.7:0/349882122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9400640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55966621e090 0x55966622c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9400640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596662151b0 0x55966621d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9e00640 1 -- 172.21.15.7:0/349882122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55966621e090 msgr2=0x55966622c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55966621e090 0x55966622c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9e00640 1 -- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596662151b0 msgr2=0x55966621d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596662151b0 0x55966621d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9e00640 1 -- 172.21.15.7:0/349882122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559666145fd0 con 0x559666215ad0 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.747+0000 7fc3d9400640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596662151b0 0x55966621d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.748+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621db00 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc011430 tx=0x7fc3cc0118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c682a3ed3ba9059e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.748+0000 7fc3bb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:42:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.749+0000 7fc3bb400640 1 -- 172.21.15.7:0/349882122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc012980 con 0x559666215ad0 2024-04-23T15:42:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.749+0000 7fc3bb400640 1 -- 172.21.15.7:0/349882122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7fc3cc012b20 con 0x559666215ad0 2024-04-23T15:42:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.749+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c802d070 con 0x559666215ad0 2024-04-23T15:42:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.750+0000 7fc3bb400640 1 -- 172.21.15.7:0/349882122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc3cc012d20 con 0x559666215ad0 2024-04-23T15:42:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.750+0000 7fc3e37c6740 10 client.19599 fetch_fsmap learned FSMap version 32 2024-04-23T15:42:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.750+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559665e8e210 con 0x559666215ad0 2024-04-23T15:42:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.750+0000 7fc3bb400640 1 -- 172.21.15.7:0/349882122 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3c802d070 con 0x559666215ad0 2024-04-23T15:42:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3bb400640 1 -- 172.21.15.7:0/349882122 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc3cc00f040 con 0x559666215ad0 2024-04-23T15:42:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3e37c6740 10 client.19599 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:42:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3e37c6740 10 client.19599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:42:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3e37c6740 20 client.19599 populate_metadata read hostname 'smithi007' 2024-04-23T15:42:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666230bc0 0x559666232fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3e37c6740 4 client.19599 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:42:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.752+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559666189320 con 0x559666230bc0 2024-04-23T15:42:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.753+0000 7fc3d9400640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666230bc0 0x559666232fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.754+0000 7fc3d9400640 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666230bc0 0x559666232fb0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa1021c369f388a5 server_cookie=aafc7c9d20c318f6 in_seq=0 out_seq=0 2024-04-23T15:42:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.754+0000 7fc3bb400640 10 client.19599 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.757+0000 7fc3bb400640 1 -- 172.21.15.7:0/349882122 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559666189320 con 0x559666230bc0 2024-04-23T15:42:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.757+0000 7fc3bb400640 10 client.19599 handle_command_reply: tid=0 2024-04-23T15:42:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.757+0000 7fc3e37c6740 1 client.19599 shutdown 2024-04-23T15:42:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.758+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 msgr2=0x55966621db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.758+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621db00 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc011430 tx=0x7fc3cc0118f0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 shutdown_connections 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666230bc0 0x559666232fb0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55966621e090 0x55966622c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621db00 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3bb400640 0 client.19599 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/349882122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596662151b0 0x55966621d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.759+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 >> 172.21.15.7:0/349882122 conn(0x5596662116c0 msgr2=0x5596662174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.762+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 shutdown_connections 2024-04-23T15:42:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.762+0000 7fc3e37c6740 1 -- 172.21.15.7:0/349882122 wait complete. 2024-04-23T15:42:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.762+0000 7fc3e37c6740 20 client.19599 trim_cache size 0 max 16384 2024-04-23T15:42:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.794+0000 7fc3e37c6740 1 Processor -- start 2024-04-23T15:42:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.794+0000 7fc3e37c6740 1 -- start start 2024-04-23T15:42:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.795+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666210fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.795+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666215ad0 0x55966621f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.795+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55966621e090 0x559666238850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.796+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc06d4a0 con 0x55966621e090 2024-04-23T15:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.796+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc06efe0 con 0x559666215ad0 2024-04-23T15:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.796+0000 7fc3e37c6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc06db70 con 0x5596662151b0 2024-04-23T15:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.796+0000 7fc3d9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666210fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.797+0000 7fc3d9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666210fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:41142/0 (socket says 172.21.15.7:41142) 2024-04-23T15:42:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.797+0000 7fc3d9400640 1 -- 172.21.15.7:0/2126996638 learned_addr learned my addr 172.21.15.7:0/2126996638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.797+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666215ad0 0x55966621f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.798+0000 7fc3d9400640 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55966621e090 0x559666238850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.798+0000 7fc3d9e00640 1 -- 172.21.15.7:0/2126996638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 msgr2=0x559666210fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.798+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666210fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.798+0000 7fc3d9e00640 1 -- 172.21.15.7:0/2126996638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55966621e090 msgr2=0x559666238850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.799+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55966621e090 0x559666238850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.799+0000 7fc3d9e00640 1 -- 172.21.15.7:0/2126996638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559665f5a620 con 0x559666215ad0 2024-04-23T15:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.799+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666215ad0 0x55966621f500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55966621eb90 tx=0x7fc3cc005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10cf5e58f939239f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.799+0000 7fc3d9400640 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55966621e090 0x559666238850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:42:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.800+0000 7fc3c6600640 1 -- 172.21.15.7:0/2126996638 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc032070 con 0x559666215ad0 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.800+0000 7fc3c6600640 1 -- 172.21.15.7:0/2126996638 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3cc005040 con 0x559666215ad0 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.800+0000 7fc3c6600640 1 -- 172.21.15.7:0/2126996638 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc023a00 con 0x559666215ad0 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.801+0000 7fc3e37c6740 1 -- 172.21.15.7:0/2126996638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666215ad0 msgr2=0x55966621f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.801+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666215ad0 0x55966621f500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55966621eb90 tx=0x7fc3cc005c70 comp rx=0 tx=0).stop 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.801+0000 7fc3e37c6740 1 -- 172.21.15.7:0/2126996638 shutdown_connections 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.802+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559666215ad0 0x55966621f500 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.802+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55966621e090 0x559666238850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.802+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/2126996638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666210fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.802+0000 7fc3e37c6740 1 -- 172.21.15.7:0/2126996638 >> 172.21.15.7:0/2126996638 conn(0x5596662116c0 msgr2=0x55966621edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.803+0000 7fc3e37c6740 1 -- 172.21.15.7:0/2126996638 shutdown_connections 2024-04-23T15:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.803+0000 7fc3e37c6740 1 -- 172.21.15.7:0/2126996638 wait complete. 2024-04-23T15:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.803+0000 7fc3e37c6740 1 -- start start 2024-04-23T15:42:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.804+0000 7fc3e37c6740 1 Processor -- start 2024-04-23T15:42:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.805+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666228780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.805+0000 7fc3e37c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3d9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666228780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3d9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666228780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:41146/0 (socket says 172.21.15.7:41146) 2024-04-23T15:42:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3d9400640 1 -- 172.21.15.7:0/923655317 learned_addr learned my addr 172.21.15.7:0/923655317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966621e090 0x55966621a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc06e910 con 0x559666215ad0 2024-04-23T15:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc06e240 con 0x55966621e090 2024-04-23T15:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc19e510 con 0x5596662151b0 2024-04-23T15:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.806+0000 7fc3e37c6740 10 client.0 _ll_register_callbacks cb 0x7fc3cc0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.807+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.808+0000 7fc3d9400640 1 -- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966621e090 msgr2=0x55966621a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.808+0000 7fc3d9400640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966621e090 0x55966621a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.808+0000 7fc3d9400640 1 -- 172.21.15.7:0/923655317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 msgr2=0x55966621a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.808+0000 7fc3d9400640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.809+0000 7fc3d9400640 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55966621ad80 con 0x5596662151b0 2024-04-23T15:42:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.809+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:42:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.810+0000 7fc3d9400640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666228780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009270 tx=0x7fc3c80047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57fb4deb07be15c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.810+0000 7fc3bb400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:42:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.812+0000 7fc3bb400640 1 -- 172.21.15.7:0/923655317 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c803dbd0 con 0x5596662151b0 2024-04-23T15:42:10.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.812+0000 7fc3bb400640 1 -- 172.21.15.7:0/923655317 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9683+0+0 (secure 0 0 0) 0x7fc3c803dd70 con 0x5596662151b0 2024-04-23T15:42:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.812+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3cc005040 con 0x5596662151b0 2024-04-23T15:42:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.813+0000 7fc3bb400640 1 -- 172.21.15.7:0/923655317 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc3c8009420 con 0x5596662151b0 2024-04-23T15:42:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.813+0000 7fc3e37c6740 10 client.28507 fetch_fsmap learned FSMap version 32 2024-04-23T15:42:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.813+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5596662970d0 con 0x5596662151b0 2024-04-23T15:42:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.814+0000 7fc3bb400640 1 -- 172.21.15.7:0/923655317 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3cc005040 con 0x5596662151b0 2024-04-23T15:42:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.814+0000 7fc3bb400640 1 -- 172.21.15.7:0/923655317 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc3c8015820 con 0x5596662151b0 2024-04-23T15:42:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.815+0000 7fc3e37c6740 10 client.28507 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:42:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.815+0000 7fc3e37c6740 10 client.28507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:42:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.815+0000 7fc3e37c6740 20 client.28507 populate_metadata read hostname 'smithi007' 2024-04-23T15:42:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.815+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666297480 0x559666299870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.815+0000 7fc3e37c6740 4 client.28507 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:42:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.815+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559666183190 con 0x559666297480 2024-04-23T15:42:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.816+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666297480 0x559666299870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.821+0000 7fc3d9e00640 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666297480 0x559666299870 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc212ffddd29a796 server_cookie=c0b89d162dc5911 in_seq=0 out_seq=0 2024-04-23T15:42:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:10.821+0000 7fc3bb400640 10 client.28507 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:11.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:11 smithi007 ceph-mon[27906]: pgmap v1610: 129 pgs: 9 active+clean+snaptrim, 103 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 2.46k op/s 2024-04-23T15:42:11.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:11 smithi186 ceph-mon[31814]: pgmap v1610: 129 pgs: 9 active+clean+snaptrim, 103 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 2.46k op/s 2024-04-23T15:42:11.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:11 smithi137 ceph-mon[31694]: pgmap v1610: 129 pgs: 9 active+clean+snaptrim, 103 active+clean, 17 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 2.46k op/s 2024-04-23T15:42:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.584+0000 7fc3bb400640 1 -- 172.21.15.7:0/923655317 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559666183190 con 0x559666297480 2024-04-23T15:42:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.584+0000 7fc3bb400640 10 client.28507 handle_command_reply: tid=0 2024-04-23T15:42:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.584+0000 7fc3e37c6740 1 client.28507 shutdown 2024-04-23T15:42:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.584+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 msgr2=0x559666228780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.584+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666228780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009270 tx=0x7fc3c80047d0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 shutdown_connections 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x559666297480 0x559666299870 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966621e090 0x55966621a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559666215ad0 0x55966621a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 --2- 172.21.15.7:0/923655317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5596662151b0 0x559666228780 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 >> 172.21.15.7:0/923655317 conn(0x5596662116c0 msgr2=0x55966621f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3bb400640 0 client.28507 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 shutdown_connections 2024-04-23T15:42:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.586+0000 7fc3e37c6740 1 -- 172.21.15.7:0/923655317 wait complete. 2024-04-23T15:42:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.587+0000 7fc3e37c6740 20 client.28507 trim_cache size 0 max 16384 2024-04-23T15:42:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:42:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:42:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:42:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:42:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.588+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc3c00a3f20 msgr2=0x7fc3c00a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.588+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc3c00a3f20 0x7fc3c00a63e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40ee5c0 tx=0x7fc3d4009520 comp rx=0 tx=0).stop 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.588+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc1a3610 msgr2=0x7fc3dc1a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.588+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc1a3610 0x7fc3dc1a3ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009b30 tx=0x7fc3d4003ce0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 shutdown_connections 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc3c00a3f20 0x7fc3c00a63e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3dc1a3610 0x7fc3dc1a3ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3dc107350 0x7fc3dc19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 --2- 172.21.15.7:0/811347949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3dc102280 0x7fc3dc19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 >> 172.21.15.7:0/811347949 conn(0x7fc3dc079490 msgr2=0x7fc3dc0ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 shutdown_connections 2024-04-23T15:42:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:12.589+0000 7fc3e0a00640 1 -- 172.21.15.7:0/811347949 wait complete. 2024-04-23T15:42:13.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:13 smithi007 ceph-mon[27906]: pgmap v1611: 129 pgs: 4 active+clean+snaptrim, 114 active+clean, 11 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.3 MiB/s wr, 2.35k op/s 2024-04-23T15:42:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:13 smithi186 ceph-mon[31814]: pgmap v1611: 129 pgs: 4 active+clean+snaptrim, 114 active+clean, 11 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.3 MiB/s wr, 2.35k op/s 2024-04-23T15:42:13.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:13 smithi137 ceph-mon[31694]: pgmap v1611: 129 pgs: 4 active+clean+snaptrim, 114 active+clean, 11 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.3 MiB/s wr, 2.35k op/s 2024-04-23T15:42:14.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:14 smithi007 ceph-mon[27906]: pgmap v1612: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.2 MiB/s wr, 2.31k op/s 2024-04-23T15:42:14.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:14 smithi186 ceph-mon[31814]: pgmap v1612: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.2 MiB/s wr, 2.31k op/s 2024-04-23T15:42:14.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:14 smithi137 ceph-mon[31694]: pgmap v1612: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.2 MiB/s wr, 2.31k op/s 2024-04-23T15:42:15.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:15 smithi007 ceph-mon[27906]: osdmap e178: 12 total, 12 up, 12 in 2024-04-23T15:42:15.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:15 smithi186 ceph-mon[31814]: osdmap e178: 12 total, 12 up, 12 in 2024-04-23T15:42:15.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:15 smithi137 ceph-mon[31694]: osdmap e178: 12 total, 12 up, 12 in 2024-04-23T15:42:16.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:16 smithi007 ceph-mon[27906]: pgmap v1614: 129 pgs: 10 active+clean+snaptrim, 99 active+clean, 20 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 10 MiB/s wr, 2.50k op/s 2024-04-23T15:42:16.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:16 smithi186 ceph-mon[31814]: pgmap v1614: 129 pgs: 10 active+clean+snaptrim, 99 active+clean, 20 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 10 MiB/s wr, 2.50k op/s 2024-04-23T15:42:16.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:16 smithi137 ceph-mon[31694]: pgmap v1614: 129 pgs: 10 active+clean+snaptrim, 99 active+clean, 20 active+clean+snaptrim_wait; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 10 MiB/s wr, 2.50k op/s 2024-04-23T15:42:19.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:18 smithi007 ceph-mon[27906]: pgmap v1615: 129 pgs: 16 active+clean+snaptrim, 73 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.8 MiB/s wr, 2.17k op/s 2024-04-23T15:42:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:18 smithi186 ceph-mon[31814]: pgmap v1615: 129 pgs: 16 active+clean+snaptrim, 73 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.8 MiB/s wr, 2.17k op/s 2024-04-23T15:42:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:18 smithi137 ceph-mon[31694]: pgmap v1615: 129 pgs: 16 active+clean+snaptrim, 73 active+clean, 40 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.8 MiB/s wr, 2.17k op/s 2024-04-23T15:42:21.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:20 smithi007 ceph-mon[27906]: pgmap v1616: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 2.29k op/s 2024-04-23T15:42:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:20 smithi186 ceph-mon[31814]: pgmap v1616: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 2.29k op/s 2024-04-23T15:42:21.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:20 smithi137 ceph-mon[31694]: pgmap v1616: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 2.29k op/s 2024-04-23T15:42:23.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:22 smithi007 ceph-mon[27906]: pgmap v1617: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 2.58k op/s 2024-04-23T15:42:23.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:22 smithi186 ceph-mon[31814]: pgmap v1617: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 2.58k op/s 2024-04-23T15:42:23.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:22 smithi137 ceph-mon[31694]: pgmap v1617: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 2.58k op/s 2024-04-23T15:42:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:24 smithi007 ceph-mon[27906]: pgmap v1618: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-04-23T15:42:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:24 smithi186 ceph-mon[31814]: pgmap v1618: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-04-23T15:42:25.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:24 smithi137 ceph-mon[31694]: pgmap v1618: 129 pgs: 18 active+clean+snaptrim, 64 active+clean, 47 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-04-23T15:42:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.849+0000 7f4038e00640 1 -- 172.21.15.7:0/3159484305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034104e20 msgr2=0x7f4034108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.849+0000 7f4038e00640 1 --2- 172.21.15.7:0/3159484305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034104e20 0x7f4034108e60 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f402c009ca0 tx=0x7f402c02a8b0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.850+0000 7f4038e00640 1 -- 172.21.15.7:0/3159484305 shutdown_connections 2024-04-23T15:42:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.850+0000 7f4038e00640 1 --2- 172.21.15.7:0/3159484305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4034109540 0x7f4034111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.850+0000 7f4038e00640 1 --2- 172.21.15.7:0/3159484305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034104e20 0x7f4034108e60 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.851+0000 7f4038e00640 1 --2- 172.21.15.7:0/3159484305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f4034104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.851+0000 7f4038e00640 1 -- 172.21.15.7:0/3159484305 >> 172.21.15.7:0/3159484305 conn(0x7f40340ffcd0 msgr2=0x7f40341020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.856+0000 7f4038e00640 1 -- 172.21.15.7:0/3159484305 shutdown_connections 2024-04-23T15:42:25.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.856+0000 7f4038e00640 1 -- 172.21.15.7:0/3159484305 wait complete. 2024-04-23T15:42:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.857+0000 7f4038e00640 1 Processor -- start 2024-04-23T15:42:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.857+0000 7f4038e00640 1 -- start start 2024-04-23T15:42:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.858+0000 7f4038e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f40341a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.858+0000 7f4038e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034109540 0x7f40341a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.858+0000 7f4038e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f403419a770 0x7f403419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.858+0000 7f4038e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40341144b0 con 0x7f4034109540 2024-04-23T15:42:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.858+0000 7f4038e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4034114330 con 0x7f403419a770 2024-04-23T15:42:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.858+0000 7f4038e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4034114630 con 0x7f4034104470 2024-04-23T15:42:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.859+0000 7f4031e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f40341a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.859+0000 7f4031e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f40341a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46216/0 (socket says 172.21.15.7:46216) 2024-04-23T15:42:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.859+0000 7f4031e00640 1 -- 172.21.15.7:0/2014376355 learned_addr learned my addr 172.21.15.7:0/2014376355 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.860+0000 7f4031400640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034109540 0x7f40341a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.861+0000 7f4032800640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f403419a770 0x7f403419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.861+0000 7f4031e00640 1 -- 172.21.15.7:0/2014376355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f403419a770 msgr2=0x7f403419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.861+0000 7f4031e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f403419a770 0x7f403419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.861+0000 7f4031e00640 1 -- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034109540 msgr2=0x7f40341a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.861+0000 7f4031e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034109540 0x7f40341a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.861+0000 7f4031e00640 1 -- 172.21.15.7:0/2014376355 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403419b370 con 0x7f4034104470 2024-04-23T15:42:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.863+0000 7f4031e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f40341a06b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f402000e9f0 tx=0x7f402000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.865+0000 7f402aa00640 1 -- 172.21.15.7:0/2014376355 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402000cd80 con 0x7f4034104470 2024-04-23T15:42:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.865+0000 7f402aa00640 1 -- 172.21.15.7:0/2014376355 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40200108e0 con 0x7f4034104470 2024-04-23T15:42:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.865+0000 7f402aa00640 1 -- 172.21.15.7:0/2014376355 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020018920 con 0x7f4034104470 2024-04-23T15:42:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.866+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40341a7450 con 0x7f4034104470 2024-04-23T15:42:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.866+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40341a7800 con 0x7f4034104470 2024-04-23T15:42:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.881+0000 7f403bbfe740 1 Processor -- start 2024-04-23T15:42:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.881+0000 7f403bbfe740 1 -- start start 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.882+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 0x555c241ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.882+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 0x555c24212660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.882+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c24214f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.882+0000 7f403bbfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555c24165900 con 0x555c241ffa10 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.882+0000 7f403bbfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555c2410bf20 con 0x555c24212ba0 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.882+0000 7f403bbfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555c241618c0 con 0x555c241ff0f0 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.883+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 0x555c241ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.883+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 0x555c241ff4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46226/0 (socket says 172.21.15.7:46226) 2024-04-23T15:42:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.883+0000 7f4032800640 1 -- 172.21.15.7:0/1716548822 learned_addr learned my addr 172.21.15.7:0/1716548822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.883+0000 7f4031400640 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c24214f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.886+0000 7f4032800640 1 -- 172.21.15.7:0/1716548822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 msgr2=0x555c24214f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.888+0000 7f4032800640 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c24214f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.888+0000 7f4032800640 1 -- 172.21.15.7:0/1716548822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 msgr2=0x555c24212660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T15:42:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.888+0000 7f4032800640 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 0x555c24212660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.888+0000 7f4032800640 1 -- 172.21.15.7:0/1716548822 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c24130e10 con 0x555c241ff0f0 2024-04-23T15:42:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.888+0000 7f4031400640 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c24214f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:42:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.891+0000 7f402aa00640 1 -- 172.21.15.7:0/2014376355 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4020010a90 con 0x7f4034104470 2024-04-23T15:42:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.891+0000 7f4032800640 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 0x555c241ff4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f402400bba0 tx=0x7f402400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d50943cf527d96b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.893+0000 7f401f400640 1 -- 172.21.15.7:0/1716548822 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024015070 con 0x555c241ff0f0 2024-04-23T15:42:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.893+0000 7f401f400640 1 -- 172.21.15.7:0/1716548822 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40240054d0 con 0x555c241ff0f0 2024-04-23T15:42:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.893+0000 7f401f400640 1 -- 172.21.15.7:0/1716548822 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024011440 con 0x555c241ff0f0 2024-04-23T15:42:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.896+0000 7f403bbfe740 1 -- 172.21.15.7:0/1716548822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 msgr2=0x555c241ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.896+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 0x555c241ff4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f402400bba0 tx=0x7f402400f730 comp rx=0 tx=0).stop 2024-04-23T15:42:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.896+0000 7f403bbfe740 1 -- 172.21.15.7:0/1716548822 shutdown_connections 2024-04-23T15:42:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.897+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c24214f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.897+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 0x555c24212660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.897+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1716548822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241ff0f0 0x555c241ff4d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.897+0000 7f403bbfe740 1 -- 172.21.15.7:0/1716548822 >> 172.21.15.7:0/1716548822 conn(0x555c241fb6c0 msgr2=0x555c241fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.899+0000 7f402aa00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40180a3fa0 0x7f40180a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.900+0000 7f402aa00640 1 -- 172.21.15.7:0/2014376355 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7f40200d0f90 con 0x7f4034104470 2024-04-23T15:42:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.902+0000 7f4031400640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40180a3fa0 0x7f40180a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.902+0000 7f403bbfe740 1 -- 172.21.15.7:0/1716548822 shutdown_connections 2024-04-23T15:42:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.902+0000 7f403bbfe740 1 -- 172.21.15.7:0/1716548822 wait complete. 2024-04-23T15:42:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.903+0000 7f403bbfe740 1 -- start start 2024-04-23T15:42:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.904+0000 7f403bbfe740 1 Processor -- start 2024-04-23T15:42:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 0x555c2420c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2420cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c24212460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555c24202090 con 0x555c241ff0f0 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555c2411f2c0 con 0x555c241ffa10 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x555c24202210 con 0x555c24212ba0 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.905+0000 7f403bbfe740 10 client.0 _ll_register_callbacks cb 0x555c23e77a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.906+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c24212460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.906+0000 7f4031e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 0x555c2420c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.906+0000 7f4031e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 0x555c2420c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60598/0 (socket says 172.21.15.7:60598) 2024-04-23T15:42:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.906+0000 7f4031e00640 1 -- 172.21.15.7:0/1534417727 learned_addr learned my addr 172.21.15.7:0/1534417727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.907+0000 7f4031e00640 1 -- 172.21.15.7:0/1534417727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 msgr2=0x555c24212460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.907+0000 7f4031e00640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c24212460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.907+0000 7f4031e00640 1 -- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 msgr2=0x555c2420cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.907+0000 7f4031400640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2420cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.908+0000 7f4031400640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40180a3fa0 0x7f40180a6460 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f402c004af0 tx=0x7f402c009820 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.908+0000 7f4031e00640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2420cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.908+0000 7f4031e00640 1 -- 172.21.15.7:0/1534417727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c2412ffd0 con 0x555c241ff0f0 2024-04-23T15:42:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.909+0000 7f4031400640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2420cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:42:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.909+0000 7f4031e00640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 0x555c2420c740 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4020009380 tx=0x7f4020010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e54eb4779069eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.909+0000 7f4013e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:42:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.910+0000 7f4013e00640 1 -- 172.21.15.7:0/1534417727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40200ce640 con 0x555c241ff0f0 2024-04-23T15:42:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.911+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40240054d0 con 0x555c241ff0f0 2024-04-23T15:42:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.911+0000 7f4013e00640 1 -- 172.21.15.7:0/1534417727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7f40200bb920 con 0x555c241ff0f0 2024-04-23T15:42:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.912+0000 7f4013e00640 1 -- 172.21.15.7:0/1534417727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f40200a0db0 con 0x555c241ff0f0 2024-04-23T15:42:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.912+0000 7f403bbfe740 10 client.19614 fetch_fsmap learned FSMap version 32 2024-04-23T15:42:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.913+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555c23e78210 con 0x555c241ff0f0 2024-04-23T15:42:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.914+0000 7f4013e00640 1 -- 172.21.15.7:0/1534417727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40240054d0 con 0x555c241ff0f0 2024-04-23T15:42:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.914+0000 7f4013e00640 1 -- 172.21.15.7:0/1534417727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f40200ba030 con 0x555c241ff0f0 2024-04-23T15:42:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.915+0000 7f403bbfe740 10 client.19614 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:42:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.915+0000 7f403bbfe740 10 client.19614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:42:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.915+0000 7f403bbfe740 20 client.19614 populate_metadata read hostname 'smithi007' 2024-04-23T15:42:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.915+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c2422b4b0 0x555c2422d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.915+0000 7f403bbfe740 4 client.19614 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:42:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.915+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c24173320 con 0x555c2422b4b0 2024-04-23T15:42:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.916+0000 7f4031400640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c2422b4b0 0x555c2422d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.919+0000 7f4031400640 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c2422b4b0 0x555c2422d8a0 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e7a97c88b1c1c05 server_cookie=498db220c520432 in_seq=0 out_seq=0 2024-04-23T15:42:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.920+0000 7f4013e00640 10 client.19614 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.920+0000 7f4013e00640 1 -- 172.21.15.7:0/1534417727 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555c24173320 con 0x555c2422b4b0 2024-04-23T15:42:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.920+0000 7f4013e00640 10 client.19614 handle_command_reply: tid=0 2024-04-23T15:42:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.922+0000 7f403bbfe740 1 client.19614 shutdown 2024-04-23T15:42:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.923+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 msgr2=0x555c2420c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.923+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 0x555c2420c740 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4020009380 tx=0x7f4020010ea0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 shutdown_connections 2024-04-23T15:42:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c2422b4b0 0x555c2422d8a0 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2420cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c24212460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1534417727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ff0f0 0x555c2420c740 secure :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4020009380 tx=0x7f4020010ea0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 >> 172.21.15.7:0/1534417727 conn(0x555c241fb6c0 msgr2=0x555c24201440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.924+0000 7f4013e00640 0 client.19614 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.925+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 shutdown_connections 2024-04-23T15:42:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.925+0000 7f403bbfe740 1 -- 172.21.15.7:0/1534417727 wait complete. 2024-04-23T15:42:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.925+0000 7f403bbfe740 20 client.19614 trim_cache size 0 max 16384 2024-04-23T15:42:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.993+0000 7f403bbfe740 1 Processor -- start 2024-04-23T15:42:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.993+0000 7f403bbfe740 1 -- start start 2024-04-23T15:42:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.994+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 0x555c241fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.994+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c242330e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.994+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241fac00 0x555c24233620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.994+0000 7f403bbfe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40341ad3c0 con 0x555c241ffa10 2024-04-23T15:42:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.994+0000 7f403bbfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40341aef00 con 0x555c24212ba0 2024-04-23T15:42:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.994+0000 7f403bbfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f40341ada90 con 0x555c241fac00 2024-04-23T15:42:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.995+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241fac00 0x555c24233620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.995+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241fac00 0x555c24233620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46236/0 (socket says 172.21.15.7:46236) 2024-04-23T15:42:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.995+0000 7f4031400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c242330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.995+0000 7f4031400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c242330e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:36522/0 (socket says 172.21.15.7:36522) 2024-04-23T15:42:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.995+0000 7f4031400640 1 -- 172.21.15.7:0/3607658702 learned_addr learned my addr 172.21.15.7:0/3607658702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.996+0000 7f4031400640 1 -- 172.21.15.7:0/3607658702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241fac00 msgr2=0x555c24233620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.996+0000 7f4031400640 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241fac00 0x555c24233620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.996+0000 7f4031400640 1 -- 172.21.15.7:0/3607658702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 msgr2=0x555c241fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.996+0000 7f4031400640 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 0x555c241fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.996+0000 7f4031400640 1 -- 172.21.15.7:0/3607658702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c241ff840 con 0x555c24212ba0 2024-04-23T15:42:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.997+0000 7f4031400640 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c242330e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f402c006010 tx=0x7f402c041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e917164434a004 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.997+0000 7f401ea00640 1 -- 172.21.15.7:0/3607658702 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c030ca0 con 0x555c24212ba0 2024-04-23T15:42:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.998+0000 7f401ea00640 1 -- 172.21.15.7:0/3607658702 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f402c036050 con 0x555c24212ba0 2024-04-23T15:42:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:25.998+0000 7f401ea00640 1 -- 172.21.15.7:0/3607658702 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c054030 con 0x555c24212ba0 2024-04-23T15:42:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 -- 172.21.15.7:0/3607658702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 msgr2=0x555c242330e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c242330e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f402c006010 tx=0x7f402c041000 comp rx=0 tx=0).stop 2024-04-23T15:42:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 -- 172.21.15.7:0/3607658702 shutdown_connections 2024-04-23T15:42:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c24212ba0 0x555c242330e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c241fac00 0x555c24233620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 --2- 172.21.15.7:0/3607658702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241ffa10 0x555c241fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.000+0000 7f403bbfe740 1 -- 172.21.15.7:0/3607658702 >> 172.21.15.7:0/3607658702 conn(0x555c241fb6c0 msgr2=0x555c241f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.001+0000 7f403bbfe740 1 -- 172.21.15.7:0/3607658702 shutdown_connections 2024-04-23T15:42:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.001+0000 7f403bbfe740 1 -- 172.21.15.7:0/3607658702 wait complete. 2024-04-23T15:42:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.001+0000 7f403bbfe740 1 -- start start 2024-04-23T15:42:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.002+0000 7f403bbfe740 1 Processor -- start 2024-04-23T15:42:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.003+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 0x555c2423ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.003+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2423b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.003+0000 7f403bbfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c2423bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4031400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2423b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4031400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2423b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:36528/0 (socket says 172.21.15.7:36528) 2024-04-23T15:42:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4031e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 0x555c2423ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c2423bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4032800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c2423bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:46240/0 (socket says 172.21.15.7:46240) 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4031e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 0x555c2423ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60628/0 (socket says 172.21.15.7:60628) 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f4031400640 1 -- 172.21.15.7:0/1183156968 learned_addr learned my addr 172.21.15.7:0/1183156968 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40341ae830 con 0x555c241fac00 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40341ae160 con 0x555c241ffa10 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f40341ab3e0 con 0x555c24212ba0 2024-04-23T15:42:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.005+0000 7f403bbfe740 10 client.0 _ll_register_callbacks cb 0x7f4020009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.006+0000 7f4032800640 1 -- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 msgr2=0x555c2423b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.006+0000 7f4032800640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2423b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.006+0000 7f4032800640 1 -- 172.21.15.7:0/1183156968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 msgr2=0x555c2423ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.006+0000 7f4032800640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 0x555c2423ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.006+0000 7f4032800640 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c23f44620 con 0x555c24212ba0 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.007+0000 7f4031e00640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 0x555c2423ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:42:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.007+0000 7f4032800640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c2423bd90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f402400bb70 tx=0x7f4024004870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d144a7249f67c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.007+0000 7f4031400640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2423b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:42:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.008+0000 7f4013e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:42:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.008+0000 7f4013e00640 1 -- 172.21.15.7:0/1183156968 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024015040 con 0x555c24212ba0 2024-04-23T15:42:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.008+0000 7f4013e00640 1 -- 172.21.15.7:0/1183156968 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7f4024011850 con 0x555c24212ba0 2024-04-23T15:42:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.008+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f402c036050 con 0x555c24212ba0 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.013+0000 7f4013e00640 1 -- 172.21.15.7:0/1183156968 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f402400b7b0 con 0x555c24212ba0 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.013+0000 7f403bbfe740 10 client.28525 fetch_fsmap learned FSMap version 32 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.013+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555c242923d0 con 0x555c24212ba0 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f4013e00640 1 -- 172.21.15.7:0/1183156968 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f402c036050 con 0x555c24212ba0 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f4013e00640 1 -- 172.21.15.7:0/1183156968 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f40240269e0 con 0x555c24212ba0 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f403bbfe740 10 client.28525 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f403bbfe740 10 client.28525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:42:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f403bbfe740 20 client.28525 populate_metadata read hostname 'smithi007' 2024-04-23T15:42:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c242927e0 0x555c24294c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f403bbfe740 4 client.28525 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:42:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.016+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c2416d190 con 0x555c242927e0 2024-04-23T15:42:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.017+0000 7f4031e00640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c242927e0 0x555c24294c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.021+0000 7f4013e00640 10 client.28525 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.021+0000 7f4031e00640 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c242927e0 0x555c24294c00 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d51b394e884e073 server_cookie=71efab5393f4fdc0 in_seq=0 out_seq=0 2024-04-23T15:42:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.887+0000 7f4013e00640 1 -- 172.21.15.7:0/1183156968 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c2416d190 con 0x555c242927e0 2024-04-23T15:42:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.887+0000 7f4013e00640 10 client.28525 handle_command_reply: tid=0 2024-04-23T15:42:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.887+0000 7f403bbfe740 1 client.28525 shutdown 2024-04-23T15:42:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.889+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 msgr2=0x555c2423bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.889+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c2423bd90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f402400bb70 tx=0x7f4024004870 comp rx=0 tx=0).stop 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.890+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 shutdown_connections 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.891+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x555c242927e0 0x555c24294c00 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.891+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555c241ffa10 0x555c2423b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.891+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c24212ba0 0x555c2423bd90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.891+0000 7f403bbfe740 1 --2- 172.21.15.7:0/1183156968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c241fac00 0x555c2423ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.891+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 >> 172.21.15.7:0/1183156968 conn(0x555c241fb6c0 msgr2=0x555c24200b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.891+0000 7f4013e00640 0 client.28525 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.892+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 shutdown_connections 2024-04-23T15:42:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.893+0000 7f403bbfe740 1 -- 172.21.15.7:0/1183156968 wait complete. 2024-04-23T15:42:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.894+0000 7f403bbfe740 20 client.28525 trim_cache size 0 max 16384 2024-04-23T15:42:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:42:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:42:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:42:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.898+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40180a3fa0 msgr2=0x7f40180a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.898+0000 7f4038e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40180a3fa0 0x7f40180a6460 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f402c004af0 tx=0x7f402c009820 comp rx=0 tx=0).stop 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.898+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 msgr2=0x7f40341a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.898+0000 7f4038e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f40341a06b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f402000e9f0 tx=0x7f402000eeb0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.899+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 shutdown_connections 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.899+0000 7f4038e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40180a3fa0 0x7f40180a6460 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.899+0000 7f4038e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f403419a770 0x7f403419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.899+0000 7f4038e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4034109540 0x7f40341a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.899+0000 7f4038e00640 1 --2- 172.21.15.7:0/2014376355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4034104470 0x7f40341a06b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.899+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 >> 172.21.15.7:0/2014376355 conn(0x7f40340ffcd0 msgr2=0x7f4034101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.900+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 shutdown_connections 2024-04-23T15:42:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:26.900+0000 7f4038e00640 1 -- 172.21.15.7:0/2014376355 wait complete. 2024-04-23T15:42:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:26 smithi007 ceph-mon[27906]: pgmap v1619: 129 pgs: 14 active+clean+snaptrim, 76 active+clean, 39 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-04-23T15:42:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:26 smithi186 ceph-mon[31814]: pgmap v1619: 129 pgs: 14 active+clean+snaptrim, 76 active+clean, 39 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-04-23T15:42:27.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:26 smithi137 ceph-mon[31694]: pgmap v1619: 129 pgs: 14 active+clean+snaptrim, 76 active+clean, 39 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-04-23T15:42:29.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:28 smithi007 ceph-mon[27906]: pgmap v1620: 129 pgs: 14 active+clean+snaptrim, 76 active+clean, 39 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.5 MiB/s wr, 2.33k op/s 2024-04-23T15:42:29.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:28 smithi186 ceph-mon[31814]: pgmap v1620: 129 pgs: 14 active+clean+snaptrim, 76 active+clean, 39 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.5 MiB/s wr, 2.33k op/s 2024-04-23T15:42:29.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:28 smithi137 ceph-mon[31694]: pgmap v1620: 129 pgs: 14 active+clean+snaptrim, 76 active+clean, 39 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.5 MiB/s wr, 2.33k op/s 2024-04-23T15:42:31.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:30 smithi007 ceph-mon[27906]: pgmap v1621: 129 pgs: 14 active+clean+snaptrim, 78 active+clean, 37 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.2 MiB/s wr, 2.25k op/s 2024-04-23T15:42:31.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:30 smithi186 ceph-mon[31814]: pgmap v1621: 129 pgs: 14 active+clean+snaptrim, 78 active+clean, 37 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.2 MiB/s wr, 2.25k op/s 2024-04-23T15:42:31.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:30 smithi137 ceph-mon[31694]: pgmap v1621: 129 pgs: 14 active+clean+snaptrim, 78 active+clean, 37 active+clean+snaptrim_wait; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.2 MiB/s wr, 2.25k op/s 2024-04-23T15:42:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:33 smithi007 ceph-mon[27906]: pgmap v1622: 129 pgs: 9 active+clean+snaptrim, 97 active+clean, 23 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-04-23T15:42:33.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:33 smithi186 ceph-mon[31814]: pgmap v1622: 129 pgs: 9 active+clean+snaptrim, 97 active+clean, 23 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-04-23T15:42:33.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:33 smithi137 ceph-mon[31694]: pgmap v1622: 129 pgs: 9 active+clean+snaptrim, 97 active+clean, 23 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 2.78k op/s 2024-04-23T15:42:35.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:35 smithi007 ceph-mon[27906]: pgmap v1623: 129 pgs: 5 active+clean+snaptrim, 112 active+clean, 12 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 9.5 MiB/s wr, 2.32k op/s 2024-04-23T15:42:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:35 smithi186 ceph-mon[31814]: pgmap v1623: 129 pgs: 5 active+clean+snaptrim, 112 active+clean, 12 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 9.5 MiB/s wr, 2.32k op/s 2024-04-23T15:42:35.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:35 smithi137 ceph-mon[31694]: pgmap v1623: 129 pgs: 5 active+clean+snaptrim, 112 active+clean, 12 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 9.5 MiB/s wr, 2.32k op/s 2024-04-23T15:42:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:37 smithi007 ceph-mon[27906]: pgmap v1624: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:42:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:37 smithi186 ceph-mon[31814]: pgmap v1624: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:42:37.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:37 smithi137 ceph-mon[31694]: pgmap v1624: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 2.55k op/s 2024-04-23T15:42:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:39 smithi007 ceph-mon[27906]: pgmap v1625: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.0 MiB/s wr, 2.20k op/s 2024-04-23T15:42:39.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:39 smithi186 ceph-mon[31814]: pgmap v1625: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.0 MiB/s wr, 2.20k op/s 2024-04-23T15:42:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:39 smithi137 ceph-mon[31694]: pgmap v1625: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.0 MiB/s wr, 2.20k op/s 2024-04-23T15:42:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 -- 172.21.15.7:0/1768426331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc007860 msgr2=0x7f9bcc0a2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/1768426331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc007860 0x7f9bcc0a2090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009900 tx=0x7f9bc002a4a0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 -- 172.21.15.7:0/1768426331 shutdown_connections 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/1768426331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc007860 0x7f9bcc0a2090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/1768426331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc0a25d0 0x7f9bcc0a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/1768426331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc006f40 0x7f9bcc007320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.195+0000 7f9bd3e00640 1 -- 172.21.15.7:0/1768426331 >> 172.21.15.7:0/1768426331 conn(0x7f9bcc00ce50 msgr2=0x7f9bcc00d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.196+0000 7f9bd3e00640 1 -- 172.21.15.7:0/1768426331 shutdown_connections 2024-04-23T15:42:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.196+0000 7f9bd3e00640 1 -- 172.21.15.7:0/1768426331 wait complete. 2024-04-23T15:42:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.198+0000 7f9bd3e00640 1 Processor -- start 2024-04-23T15:42:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.198+0000 7f9bd3e00640 1 -- start start 2024-04-23T15:42:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 0x7f9bcc09c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc007860 0x7f9bcc09cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc0a25d0 0x7f9bcc097990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc096520 con 0x7f9bcc007860 2024-04-23T15:42:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0963a0 con 0x7f9bcc0a25d0 2024-04-23T15:42:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd3e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0966a0 con 0x7f9bcc006f40 2024-04-23T15:42:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.199+0000 7f9bd2a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 0x7f9bcc09c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 0x7f9bcc09c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59138/0 (socket says 172.21.15.7:59138) 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 -- 172.21.15.7:0/2222561759 learned_addr learned my addr 172.21.15.7:0/2222561759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd3400640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc0a25d0 0x7f9bcc097990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 -- 172.21.15.7:0/2222561759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc0a25d0 msgr2=0x7f9bcc097990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc0a25d0 0x7f9bcc097990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 -- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc007860 msgr2=0x7f9bcc09cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc007860 0x7f9bcc09cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd2a00640 1 -- 172.21.15.7:0/2222561759 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc0981c0 con 0x7f9bcc006f40 2024-04-23T15:42:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.200+0000 7f9bd3400640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc0a25d0 0x7f9bcc097990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:42:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.201+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 0x7f9bcc09c830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d950 tx=0x7f9bc400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.201+0000 7f9bcb400640 1 -- 172.21.15.7:0/2222561759 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4017070 con 0x7f9bcc006f40 2024-04-23T15:42:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.201+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc0984b0 con 0x7f9bcc006f40 2024-04-23T15:42:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.201+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc147fe0 con 0x7f9bcc006f40 2024-04-23T15:42:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.202+0000 7f9bcb400640 1 -- 172.21.15.7:0/2222561759 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bc4009c30 con 0x7f9bcc006f40 2024-04-23T15:42:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.202+0000 7f9bcb400640 1 -- 172.21.15.7:0/2222561759 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4017070 con 0x7f9bcc006f40 2024-04-23T15:42:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.207+0000 7f9bcb400640 1 -- 172.21.15.7:0/2222561759 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f9bc4010460 con 0x7f9bcc006f40 2024-04-23T15:42:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.210+0000 7f9bcb400640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9bb80a3fd0 0x7f9bb80a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.210+0000 7f9bcb400640 1 -- 172.21.15.7:0/2222561759 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7f9bc40d0520 con 0x7f9bcc006f40 2024-04-23T15:42:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.210+0000 7f9bdc575740 1 Processor -- start 2024-04-23T15:42:40.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.211+0000 7f9bd2000640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9bb80a3fd0 0x7f9bb80a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.212+0000 7f9bd2000640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9bb80a3fd0 0x7f9bb80a6490 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00096c0 tx=0x7f9bc0000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.212+0000 7f9bdc575740 1 -- start start 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.212+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af516087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.212+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51613060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.212+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 0x55af51615990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bdc575740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55af5156e900 con 0x55af516135a0 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bdc575740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55af51514f20 con 0x55af516083c0 2024-04-23T15:42:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bdc575740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55af5156a8c0 con 0x55af51608ce0 2024-04-23T15:42:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 0x55af51615990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 0x55af51615990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47454/0 (socket says 172.21.15.7:47454) 2024-04-23T15:42:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bd3400640 1 -- 172.21.15.7:0/2277196085 learned_addr learned my addr 172.21.15.7:0/2277196085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.213+0000 7f9bd2000640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51613060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.214+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af516087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.214+0000 7f9bd2000640 1 -- 172.21.15.7:0/2277196085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 msgr2=0x55af516087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.214+0000 7f9bd2000640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af516087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.214+0000 7f9bd2000640 1 -- 172.21.15.7:0/2277196085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 msgr2=0x55af51615990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.214+0000 7f9bd2000640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 0x55af51615990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.214+0000 7f9bd2000640 1 -- 172.21.15.7:0/2277196085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af51539e10 con 0x55af51608ce0 2024-04-23T15:42:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.215+0000 7f9bd3400640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 0x55af51615990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.215+0000 7f9bd2000640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51613060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009230 tx=0x7f9bc003a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a902908e2ab92d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.215+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af516087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.215+0000 7f9bbfe00640 1 -- 172.21.15.7:0/2277196085 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0040070 con 0x55af51608ce0 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.215+0000 7f9bbfe00640 1 -- 172.21.15.7:0/2277196085 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bc004c070 con 0x55af51608ce0 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.215+0000 7f9bbfe00640 1 -- 172.21.15.7:0/2277196085 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0035040 con 0x55af51608ce0 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.216+0000 7f9bdc575740 1 -- 172.21.15.7:0/2277196085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 msgr2=0x55af51613060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.216+0000 7f9bdc575740 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51613060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009230 tx=0x7f9bc003a000 comp rx=0 tx=0).stop 2024-04-23T15:42:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 -- 172.21.15.7:0/2277196085 shutdown_connections 2024-04-23T15:42:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516135a0 0x55af51615990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51613060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 --2- 172.21.15.7:0/2277196085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af516087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 -- 172.21.15.7:0/2277196085 >> 172.21.15.7:0/2277196085 conn(0x55af516048d0 msgr2=0x55af51604cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 -- 172.21.15.7:0/2277196085 shutdown_connections 2024-04-23T15:42:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.221+0000 7f9bdc575740 1 -- 172.21.15.7:0/2277196085 wait complete. 2024-04-23T15:42:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.222+0000 7f9bdc575740 1 -- start start 2024-04-23T15:42:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.222+0000 7f9bdc575740 1 Processor -- start 2024-04-23T15:42:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.223+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af51610550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.223+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51610a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.223+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 0x55af51610fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd2000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51610a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 0x55af51610fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 0x55af51610fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:53080/0 (socket says 172.21.15.7:53080) 2024-04-23T15:42:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd2000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51610a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59156/0 (socket says 172.21.15.7:59156) 2024-04-23T15:42:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af51610550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af51610550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47466/0 (socket says 172.21.15.7:47466) 2024-04-23T15:42:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.225+0000 7f9bd3400640 1 -- 172.21.15.7:0/1995482103 learned_addr learned my addr 172.21.15.7:0/1995482103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.226+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55af516160e0 con 0x55af516083c0 2024-04-23T15:42:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.226+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55af515282c0 con 0x55af516135a0 2024-04-23T15:42:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.226+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55af51616260 con 0x55af51608ce0 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.227+0000 7f9bd3400640 1 -- 172.21.15.7:0/1995482103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 msgr2=0x55af51610a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.227+0000 7f9bd3400640 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51610a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.227+0000 7f9bd3400640 1 -- 172.21.15.7:0/1995482103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 msgr2=0x55af51610550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.227+0000 7f9bd3400640 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af51610550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.227+0000 7f9bd3400640 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af51538fd0 con 0x55af516135a0 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.228+0000 7f9bdc575740 10 client.0 _ll_register_callbacks cb 0x55af51280a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.228+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bc004c070 con 0x55af516135a0 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.228+0000 7f9bbcc00640 10 client.38390 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:42:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.228+0000 7f9bd3400640 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 0x55af51610fd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4067cb0 tx=0x7f9bd40767f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b329282859751a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.229+0000 7f9bbcc00640 1 -- 172.21.15.7:0/1995482103 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4084660 con 0x55af516135a0 2024-04-23T15:42:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.229+0000 7f9bbcc00640 1 -- 172.21.15.7:0/1995482103 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7f9bd4084460 con 0x55af516135a0 2024-04-23T15:42:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.229+0000 7f9bbcc00640 1 -- 172.21.15.7:0/1995482103 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9bd4084660 con 0x55af516135a0 2024-04-23T15:42:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.229+0000 7f9bdc575740 10 client.38390 fetch_fsmap learned FSMap version 32 2024-04-23T15:42:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.229+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55af51281210 con 0x55af516135a0 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bbcc00640 1 -- 172.21.15.7:0/1995482103 <== mon.2 v2:172.21.15.137:3300/0 4 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9bd4084800 con 0x55af516135a0 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bdc575740 10 client.38390 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bdc575740 10 client.38390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bdc575740 20 client.38390 populate_metadata read hostname 'smithi007' 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af51623310 0x55af51625770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bdc575740 4 client.38390 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:42:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af5157c320 con 0x55af51623310 2024-04-23T15:42:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.233+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af51623310 0x55af51625770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.234+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af51623310 0x55af51625770 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c411e201d79c7b server_cookie=f590fc982d2fe24 in_seq=0 out_seq=0 2024-04-23T15:42:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.234+0000 7f9bbcc00640 10 client.38390 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.235+0000 7f9bbcc00640 1 -- 172.21.15.7:0/1995482103 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55af5157c320 con 0x55af51623310 2024-04-23T15:42:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.235+0000 7f9bbcc00640 10 client.38390 handle_command_reply: tid=0 2024-04-23T15:42:40.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.235+0000 7f9bdc575740 1 client.38390 shutdown 2024-04-23T15:42:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 msgr2=0x55af51610fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 0x55af51610fd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4067cb0 tx=0x7f9bd40767f0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 shutdown_connections 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af51623310 0x55af51625770 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516135a0 0x55af51610fd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af51608ce0 0x55af51610a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1995482103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af51610550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 >> 172.21.15.7:0/1995482103 conn(0x55af516048d0 msgr2=0x55af5160a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bbcc00640 0 client.38390 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.236+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 shutdown_connections 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.237+0000 7f9bdc575740 1 -- 172.21.15.7:0/1995482103 wait complete. 2024-04-23T15:42:40.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.237+0000 7f9bdc575740 20 client.38390 trim_cache size 0 max 16384 2024-04-23T15:42:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.279+0000 7f9bdc575740 1 Processor -- start 2024-04-23T15:42:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.279+0000 7f9bdc575740 1 -- start start 2024-04-23T15:42:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.280+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af5161f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.280+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af51608ce0 0x55af51610df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.280+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af51603a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.280+0000 7f9bdc575740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb4010110 con 0x55af51608ce0 2024-04-23T15:42:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.280+0000 7f9bdc575740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb4011c50 con 0x55af516083c0 2024-04-23T15:42:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.280+0000 7f9bdc575740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb40107e0 con 0x55af516135a0 2024-04-23T15:42:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.281+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af51603a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.281+0000 7f9bd2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af5161f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.281+0000 7f9bd2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af51608ce0 0x55af51610df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.281+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af51603a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59160/0 (socket says 172.21.15.7:59160) 2024-04-23T15:42:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.281+0000 7f9bd3400640 1 -- 172.21.15.7:0/1751668609 learned_addr learned my addr 172.21.15.7:0/1751668609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.282+0000 7f9bd2000640 1 -- 172.21.15.7:0/1751668609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 msgr2=0x55af51603a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.282+0000 7f9bd2000640 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af51603a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.282+0000 7f9bd2000640 1 -- 172.21.15.7:0/1751668609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 msgr2=0x55af5161f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.282+0000 7f9bd2000640 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af5161f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.282+0000 7f9bd2000640 1 -- 172.21.15.7:0/1751668609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af5160f500 con 0x55af51608ce0 2024-04-23T15:42:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.283+0000 7f9bd2000640 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af51608ce0 0x55af51610df0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009850 tx=0x7f9bc0047cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2b17fcd1bf2a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.284+0000 7f9bbf400640 1 -- 172.21.15.7:0/1751668609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0054070 con 0x55af51608ce0 2024-04-23T15:42:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.284+0000 7f9bbf400640 1 -- 172.21.15.7:0/1751668609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bc0047920 con 0x55af51608ce0 2024-04-23T15:42:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.284+0000 7f9bbf400640 1 -- 172.21.15.7:0/1751668609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0040050 con 0x55af51608ce0 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 -- 172.21.15.7:0/1751668609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af51608ce0 msgr2=0x55af51610df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af51608ce0 0x55af51610df0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009850 tx=0x7f9bc0047cf0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 -- 172.21.15.7:0/1751668609 shutdown_connections 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af51603a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af51608ce0 0x55af51610df0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 --2- 172.21.15.7:0/1751668609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516083c0 0x55af5161f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.285+0000 7f9bdc575740 1 -- 172.21.15.7:0/1751668609 >> 172.21.15.7:0/1751668609 conn(0x55af516048d0 msgr2=0x55af51604cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.286+0000 7f9bdc575740 1 -- 172.21.15.7:0/1751668609 shutdown_connections 2024-04-23T15:42:40.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.288+0000 7f9bdc575740 1 -- 172.21.15.7:0/1751668609 wait complete. 2024-04-23T15:42:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.289+0000 7f9bdc575740 1 -- start start 2024-04-23T15:42:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.289+0000 7f9bdc575740 1 Processor -- start 2024-04-23T15:42:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.292+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af5161b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.292+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af5161bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.292+0000 7f9bdc575740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 0x55af51618a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bdc575740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb4011580 con 0x55af516083c0 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bdc575740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb4010eb0 con 0x55af516185f0 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bdc575740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb400e110 con 0x55af516135a0 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bdc575740 10 client.0 _ll_register_callbacks cb 0x7f9bd40688a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 0x55af51618a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bd3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 0x55af51618a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:53110/0 (socket says 172.21.15.7:53110) 2024-04-23T15:42:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.293+0000 7f9bd3400640 1 -- 172.21.15.7:0/3039880600 learned_addr learned my addr 172.21.15.7:0/3039880600 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.294+0000 7f9bd3400640 1 -- 172.21.15.7:0/3039880600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 msgr2=0x55af5161bb60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.294+0000 7f9bd3400640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af5161bb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.294+0000 7f9bd3400640 1 -- 172.21.15.7:0/3039880600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 msgr2=0x55af5161b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.294+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af5161b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.295+0000 7f9bd3400640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af5161b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.295+0000 7f9bd3400640 1 -- 172.21.15.7:0/3039880600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af51609790 con 0x55af516185f0 2024-04-23T15:42:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.295+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af5161b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:42:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.296+0000 7f9bd3400640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 0x55af51618a70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4051000 tx=0x7f9bd4083000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4117386b3296594b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:42:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.296+0000 7f9bbcc00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:42:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.297+0000 7f9bbcc00640 1 -- 172.21.15.7:0/3039880600 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd408e990 con 0x55af516185f0 2024-04-23T15:42:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.297+0000 7f9bbcc00640 1 -- 172.21.15.7:0/3039880600 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7f9bd408eb30 con 0x55af516185f0 2024-04-23T15:42:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.297+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bc0047920 con 0x55af516185f0 2024-04-23T15:42:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.298+0000 7f9bbcc00640 1 -- 172.21.15.7:0/3039880600 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9bd40a5050 con 0x55af516185f0 2024-04-23T15:42:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.298+0000 7f9bdc575740 10 client.38396 fetch_fsmap learned FSMap version 32 2024-04-23T15:42:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.298+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55af5134d620 con 0x55af516185f0 2024-04-23T15:42:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.301+0000 7f9bbcc00640 1 -- 172.21.15.7:0/3039880600 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bc0047920 con 0x55af516185f0 2024-04-23T15:42:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bbcc00640 1 -- 172.21.15.7:0/3039880600 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f9bd40988c0 con 0x55af516185f0 2024-04-23T15:42:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bdc575740 10 client.38396 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:42:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bdc575740 10 client.38396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:42:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bdc575740 20 client.38396 populate_metadata read hostname 'smithi007' 2024-04-23T15:42:40.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bdc575740 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af5168aac0 0x55af5168cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:42:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bdc575740 4 client.38396 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:42:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.303+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af51576190 con 0x55af5168aac0 2024-04-23T15:42:40.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.304+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af5168aac0 0x55af5168cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:42:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.306+0000 7f9bd2a00640 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af5168aac0 0x55af5168cee0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=930203e486956fe3 server_cookie=ab5ab10af0d28b23 in_seq=0 out_seq=0 2024-04-23T15:42:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:40.306+0000 7f9bbcc00640 10 client.38396 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:41 smithi007 ceph-mon[27906]: pgmap v1626: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.2 MiB/s wr, 2.25k op/s 2024-04-23T15:42:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:41 smithi186 ceph-mon[31814]: pgmap v1626: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.2 MiB/s wr, 2.25k op/s 2024-04-23T15:42:41.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:41 smithi137 ceph-mon[31694]: pgmap v1626: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.2 MiB/s wr, 2.25k op/s 2024-04-23T15:42:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:43 smithi007 ceph-mon[27906]: pgmap v1627: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 2.87k op/s 2024-04-23T15:42:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:43 smithi186 ceph-mon[31814]: pgmap v1627: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 2.87k op/s 2024-04-23T15:42:43.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:43 smithi137 ceph-mon[31694]: pgmap v1627: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 2.87k op/s 2024-04-23T15:42:45.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:45 smithi186 ceph-mon[31814]: pgmap v1628: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.2 MiB/s wr, 2.26k op/s 2024-04-23T15:42:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:45 smithi137 ceph-mon[31694]: pgmap v1628: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.2 MiB/s wr, 2.26k op/s 2024-04-23T15:42:45.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:45 smithi007 ceph-mon[27906]: pgmap v1628: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.2 MiB/s wr, 2.26k op/s 2024-04-23T15:42:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:47 smithi186 ceph-mon[31814]: pgmap v1629: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 2.73k op/s 2024-04-23T15:42:47.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:47 smithi137 ceph-mon[31694]: pgmap v1629: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 2.73k op/s 2024-04-23T15:42:47.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:47 smithi007 ceph-mon[27906]: pgmap v1629: 129 pgs: 3 active+clean+snaptrim, 121 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 2.73k op/s 2024-04-23T15:42:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.954+0000 7f9bbcc00640 1 -- 172.21.15.7:0/3039880600 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af51576190 con 0x55af5168aac0 2024-04-23T15:42:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.954+0000 7f9bbcc00640 10 client.38396 handle_command_reply: tid=0 2024-04-23T15:42:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.954+0000 7f9bdc575740 1 client.38396 shutdown 2024-04-23T15:42:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.959+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 msgr2=0x55af51618a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.959+0000 7f9bdc575740 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 0x55af51618a70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4051000 tx=0x7f9bd4083000 comp rx=0 tx=0).stop 2024-04-23T15:42:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 shutdown_connections 2024-04-23T15:42:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bdc575740 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x55af5168aac0 0x55af5168cee0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bdc575740 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55af516185f0 0x55af51618a70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bdc575740 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55af516135a0 0x55af5161bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bdc575740 1 --2- 172.21.15.7:0/3039880600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55af516083c0 0x55af5161b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 >> 172.21.15.7:0/3039880600 conn(0x55af516048d0 msgr2=0x55af5160a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.961+0000 7f9bbcc00640 0 client.38396 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:42:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.962+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 shutdown_connections 2024-04-23T15:42:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.962+0000 7f9bdc575740 1 -- 172.21.15.7:0/3039880600 wait complete. 2024-04-23T15:42:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.963+0000 7f9bdc575740 20 client.38396 trim_cache size 0 max 16384 2024-04-23T15:42:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:42:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:42:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:42:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:42:48.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.966+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9bb80a3fd0 msgr2=0x7f9bb80a6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:48.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.966+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9bb80a3fd0 0x7f9bb80a6490 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00096c0 tx=0x7f9bc0000bc0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.966+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 msgr2=0x7f9bcc09c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.966+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 0x7f9bcc09c830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d950 tx=0x7f9bc400de10 comp rx=0 tx=0).stop 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.968+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 shutdown_connections 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.968+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f9bb80a3fd0 0x7f9bb80a6490 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.968+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bcc0a25d0 0x7f9bcc097990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.968+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc007860 0x7f9bcc09cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.968+0000 7f9bd3e00640 1 --2- 172.21.15.7:0/2222561759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bcc006f40 0x7f9bcc09c830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.968+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 >> 172.21.15.7:0/2222561759 conn(0x7f9bcc00ce50 msgr2=0x7f9bcc092e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:42:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.969+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 shutdown_connections 2024-04-23T15:42:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:42:48.970+0000 7f9bd3e00640 1 -- 172.21.15.7:0/2222561759 wait complete. 2024-04-23T15:42:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:49 smithi186 ceph-mon[31814]: pgmap v1630: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 2.61k op/s 2024-04-23T15:42:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:49 smithi137 ceph-mon[31694]: pgmap v1630: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 2.61k op/s 2024-04-23T15:42:49.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:49 smithi007 ceph-mon[27906]: pgmap v1630: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 2.61k op/s 2024-04-23T15:42:51.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:51 smithi137 ceph-mon[31694]: pgmap v1631: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-04-23T15:42:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:51 smithi007 ceph-mon[27906]: pgmap v1631: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-04-23T15:42:51.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:51 smithi186 ceph-mon[31814]: pgmap v1631: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-04-23T15:42:53.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:53 smithi137 ceph-mon[31694]: pgmap v1632: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-04-23T15:42:53.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:53 smithi007 ceph-mon[27906]: pgmap v1632: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-04-23T15:42:53.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:53 smithi186 ceph-mon[31814]: pgmap v1632: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-04-23T15:42:54.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:54 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:42:54.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:54 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:42:54.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:54 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:42:55.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:55 smithi137 ceph-mon[31694]: pgmap v1633: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-04-23T15:42:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:55 smithi007 ceph-mon[27906]: pgmap v1633: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-04-23T15:42:55.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:55 smithi186 ceph-mon[31814]: pgmap v1633: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.6 MiB/s wr, 2.38k op/s 2024-04-23T15:42:57.416 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:57 smithi186 ceph-mon[31814]: pgmap v1634: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:42:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:57 smithi137 ceph-mon[31694]: pgmap v1634: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:42:57.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:57 smithi007 ceph-mon[27906]: pgmap v1634: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-04-23T15:42:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:42:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:42:58.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:58 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:42:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:42:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:42:58.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:58 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:42:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:42:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:42:58.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:58 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:42:59.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:42:59 smithi007 ceph-mon[27906]: pgmap v1635: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.7 MiB/s wr, 2.44k op/s 2024-04-23T15:42:59.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:42:59 smithi186 ceph-mon[31814]: pgmap v1635: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.7 MiB/s wr, 2.44k op/s 2024-04-23T15:42:59.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:42:59 smithi137 ceph-mon[31694]: pgmap v1635: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.7 MiB/s wr, 2.44k op/s 2024-04-23T15:43:01.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:01 smithi007 ceph-mon[27906]: pgmap v1636: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.3 MiB/s wr, 2.34k op/s 2024-04-23T15:43:01.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:01 smithi186 ceph-mon[31814]: pgmap v1636: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.3 MiB/s wr, 2.34k op/s 2024-04-23T15:43:01.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:01 smithi137 ceph-mon[31694]: pgmap v1636: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.3 MiB/s wr, 2.34k op/s 2024-04-23T15:43:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.368+0000 7fc14ec00640 1 -- 172.21.15.7:0/341482670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc148109520 msgr2=0x7fc1481110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.368+0000 7fc14ec00640 1 --2- 172.21.15.7:0/341482670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc148109520 0x7fc1481110f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc134009900 tx=0x7fc13402a420 comp rx=0 tx=0).stop 2024-04-23T15:43:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 -- 172.21.15.7:0/341482670 shutdown_connections 2024-04-23T15:43:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 --2- 172.21.15.7:0/341482670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc148109520 0x7fc1481110f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 --2- 172.21.15.7:0/341482670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148104e00 0x7fc148108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 --2- 172.21.15.7:0/341482670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc148104450 0x7fc148104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 -- 172.21.15.7:0/341482670 >> 172.21.15.7:0/341482670 conn(0x7fc1480ffcf0 msgr2=0x7fc148102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 -- 172.21.15.7:0/341482670 shutdown_connections 2024-04-23T15:43:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.369+0000 7fc14ec00640 1 -- 172.21.15.7:0/341482670 wait complete. 2024-04-23T15:43:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 Processor -- start 2024-04-23T15:43:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 -- start start 2024-04-23T15:43:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148104450 0x7fc1481a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc148109520 0x7fc1481a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 0x7fc14819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc148114500 con 0x7fc148104450 2024-04-23T15:43:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc148114380 con 0x7fc14819a7c0 2024-04-23T15:43:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.371+0000 7fc14ec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc148114680 con 0x7fc148109520 2024-04-23T15:43:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.372+0000 7fc14cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 0x7fc14819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.372+0000 7fc14cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 0x7fc14819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45056/0 (socket says 172.21.15.7:45056) 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.372+0000 7fc14cc00640 1 -- 172.21.15.7:0/2863276437 learned_addr learned my addr 172.21.15.7:0/2863276437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc14cc00640 1 -- 172.21.15.7:0/2863276437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc148109520 msgr2=0x7fc1481a0b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc14cc00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc148109520 0x7fc1481a0b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc14cc00640 1 -- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148104450 msgr2=0x7fc1481a0650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc14cc00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148104450 0x7fc1481a0650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc14cc00640 1 -- 172.21.15.7:0/2863276437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14819b350 con 0x7fc14819a7c0 2024-04-23T15:43:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc14cc00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 0x7fc14819ac70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc13402a990 tx=0x7fc134003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.373+0000 7fc144c00640 1 -- 172.21.15.7:0/2863276437 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13403f070 con 0x7fc14819a7c0 2024-04-23T15:43:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.374+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14819b5e0 con 0x7fc14819a7c0 2024-04-23T15:43:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.374+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1481a77c0 con 0x7fc14819a7c0 2024-04-23T15:43:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.374+0000 7fc144c00640 1 -- 172.21.15.7:0/2863276437 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc134031b50 con 0x7fc14819a7c0 2024-04-23T15:43:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.374+0000 7fc144c00640 1 -- 172.21.15.7:0/2863276437 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134035030 con 0x7fc14819a7c0 2024-04-23T15:43:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.385+0000 7fc1519b0740 1 Processor -- start 2024-04-23T15:43:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.385+0000 7fc144c00640 1 -- 172.21.15.7:0/2863276437 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc134042070 con 0x7fc14819a7c0 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.391+0000 7fc1519b0740 1 -- start start 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.391+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f882da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.391+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.391+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f88ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.391+0000 7fc1519b0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564a8f7e0900 con 0x564a8f8829c0 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.391+0000 7fc1519b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a8f786f20 con 0x564a8f8832e0 2024-04-23T15:43:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.392+0000 7fc1519b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564a8f7dc8c0 con 0x564a8f88dba0 2024-04-23T15:43:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.393+0000 7fc144c00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc12c0a3e90 0x7fc12c0a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.393+0000 7fc147e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.393+0000 7fc147e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45058/0 (socket says 172.21.15.7:45058) 2024-04-23T15:43:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.393+0000 7fc147e00640 1 -- 172.21.15.7:0/440134448 learned_addr learned my addr 172.21.15.7:0/440134448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.393+0000 7fc14cc00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc12c0a3e90 0x7fc12c0a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.394+0000 7fc147400640 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f88ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.395+0000 7fc147400640 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f882da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.395+0000 7fc14cc00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc12c0a3e90 0x7fc12c0a6350 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc1340b9340 tx=0x7fc1340b8a60 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.394+0000 7fc144c00640 1 -- 172.21.15.7:0/2863276437 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7fc1340f1410 con 0x7fc14819a7c0 2024-04-23T15:43:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.396+0000 7fc147e00640 1 -- 172.21.15.7:0/440134448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 msgr2=0x564a8f88ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.396+0000 7fc147e00640 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f88ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.396+0000 7fc147e00640 1 -- 172.21.15.7:0/440134448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 msgr2=0x564a8f882da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.397+0000 7fc147e00640 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f882da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.397+0000 7fc147e00640 1 -- 172.21.15.7:0/440134448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8f7abe10 con 0x564a8f8832e0 2024-04-23T15:43:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.397+0000 7fc147400640 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f882da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:43:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.398+0000 7fc147e00640 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88d660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc140009d80 tx=0x7fc14000b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d1919158129313 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.399+0000 7fc13d200640 1 -- 172.21.15.7:0/440134448 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14000bd40 con 0x564a8f8832e0 2024-04-23T15:43:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.399+0000 7fc13d200640 1 -- 172.21.15.7:0/440134448 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc140017070 con 0x564a8f8832e0 2024-04-23T15:43:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.399+0000 7fc13d200640 1 -- 172.21.15.7:0/440134448 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140011700 con 0x564a8f8832e0 2024-04-23T15:43:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.404+0000 7fc1519b0740 1 -- 172.21.15.7:0/440134448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 msgr2=0x564a8f88d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.404+0000 7fc1519b0740 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88d660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc140009d80 tx=0x7fc14000b420 comp rx=0 tx=0).stop 2024-04-23T15:43:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.404+0000 7fc1519b0740 1 -- 172.21.15.7:0/440134448 shutdown_connections 2024-04-23T15:43:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.404+0000 7fc1519b0740 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88d660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.405+0000 7fc1519b0740 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f88ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.405+0000 7fc1519b0740 1 --2- 172.21.15.7:0/440134448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f882da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.405+0000 7fc1519b0740 1 -- 172.21.15.7:0/440134448 >> 172.21.15.7:0/440134448 conn(0x564a8f87eed0 msgr2=0x564a8f87f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.405+0000 7fc1519b0740 1 -- 172.21.15.7:0/440134448 shutdown_connections 2024-04-23T15:43:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.405+0000 7fc1519b0740 1 -- 172.21.15.7:0/440134448 wait complete. 2024-04-23T15:43:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.406+0000 7fc1519b0740 1 -- start start 2024-04-23T15:43:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.407+0000 7fc1519b0740 1 Processor -- start 2024-04-23T15:43:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.408+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f88ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.408+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f88b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc1519b0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564a8f8a17e0 con 0x564a8f88dba0 2024-04-23T15:43:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc1519b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a8f79a2c0 con 0x564a8f8832e0 2024-04-23T15:43:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc1519b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564a8f8a1960 con 0x564a8f8829c0 2024-04-23T15:43:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc1519b0740 10 client.0 _ll_register_callbacks cb 0x564a8f4f2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:43:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f88ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f88ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:33060/0 (socket says 172.21.15.7:33060) 2024-04-23T15:43:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.409+0000 7fc147400640 1 -- 172.21.15.7:0/1887557505 learned_addr learned my addr 172.21.15.7:0/1887557505 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.410+0000 7fc147e00640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.410+0000 7fc147400640 1 -- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 msgr2=0x564a8f88b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.410+0000 7fc147400640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.410+0000 7fc147400640 1 -- 172.21.15.7:0/1887557505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 msgr2=0x564a8f88b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.411+0000 7fc147400640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f88b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.411+0000 7fc147400640 1 -- 172.21.15.7:0/1887557505 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8f7aafd0 con 0x564a8f8829c0 2024-04-23T15:43:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.411+0000 7fc147e00640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:43:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.414+0000 7fc147400640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f88ab00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc138004650 tx=0x7fc138013cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb76db1fe288f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.414+0000 7fc131600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:43:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.414+0000 7fc131600640 1 -- 172.21.15.7:0/1887557505 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138010a90 con 0x564a8f8829c0 2024-04-23T15:43:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.415+0000 7fc131600640 1 -- 172.21.15.7:0/1887557505 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7fc138010c30 con 0x564a8f8829c0 2024-04-23T15:43:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.415+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc140017070 con 0x564a8f8829c0 2024-04-23T15:43:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.416+0000 7fc131600640 1 -- 172.21.15.7:0/1887557505 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc138010e70 con 0x564a8f8829c0 2024-04-23T15:43:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.416+0000 7fc1519b0740 10 client.28546 fetch_fsmap learned FSMap version 32 2024-04-23T15:43:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.416+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564a8f4f3210 con 0x564a8f8829c0 2024-04-23T15:43:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.416+0000 7fc131600640 1 -- 172.21.15.7:0/1887557505 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1380054d0 con 0x564a8f8829c0 2024-04-23T15:43:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc131600640 1 -- 172.21.15.7:0/1887557505 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc138004ca0 con 0x564a8f8829c0 2024-04-23T15:43:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc1519b0740 10 client.28546 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:43:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc1519b0740 10 client.28546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:43:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc1519b0740 20 client.28546 populate_metadata read hostname 'smithi007' 2024-04-23T15:43:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc1519b0740 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f8b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc1519b0740 4 client.28546 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:43:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.419+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc140017070 con 0x564a8f8aede0 2024-04-23T15:43:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.420+0000 7fc147e00640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f8b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.421+0000 7fc147e00640 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f8b1210 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc0ae6e48f60b1f server_cookie=a209118b7a9c2839 in_seq=0 out_seq=0 2024-04-23T15:43:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.421+0000 7fc131600640 10 client.28546 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.423+0000 7fc131600640 1 -- 172.21.15.7:0/1887557505 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7fc140017070 con 0x564a8f8aede0 2024-04-23T15:43:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.423+0000 7fc131600640 10 client.28546 handle_command_reply: tid=0 2024-04-23T15:43:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.424+0000 7fc1519b0740 1 client.28546 shutdown 2024-04-23T15:43:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.424+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 msgr2=0x564a8f88ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.424+0000 7fc1519b0740 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f88ab00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc138004650 tx=0x7fc138013cb0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 shutdown_connections 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc1519b0740 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f8b1210 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc1519b0740 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc131600640 0 client.28546 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc1519b0740 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f88b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc1519b0740 1 --2- 172.21.15.7:0/1887557505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f88ab00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.425+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 >> 172.21.15.7:0/1887557505 conn(0x564a8f87eed0 msgr2=0x564a8f875840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.426+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 shutdown_connections 2024-04-23T15:43:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.426+0000 7fc1519b0740 1 -- 172.21.15.7:0/1887557505 wait complete. 2024-04-23T15:43:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.426+0000 7fc1519b0740 20 client.28546 trim_cache size 0 max 16384 2024-04-23T15:43:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.488+0000 7fc1519b0740 1 Processor -- start 2024-04-23T15:43:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.488+0000 7fc1519b0740 1 -- start start 2024-04-23T15:43:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.489+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f8aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.489+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.489+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f8b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.489+0000 7fc1519b0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc12800ffa0 con 0x564a8f88dba0 2024-04-23T15:43:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.489+0000 7fc1519b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc128011ae0 con 0x564a8f8832e0 2024-04-23T15:43:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.489+0000 7fc1519b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc128010670 con 0x564a8f8829c0 2024-04-23T15:43:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.491+0000 7fc147e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.491+0000 7fc147400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f8aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.492+0000 7fc147e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45080/0 (socket says 172.21.15.7:45080) 2024-04-23T15:43:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.492+0000 7fc147e00640 1 -- 172.21.15.7:0/351025657 learned_addr learned my addr 172.21.15.7:0/351025657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.493+0000 7fc147400640 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f8b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.494+0000 7fc147e00640 1 -- 172.21.15.7:0/351025657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 msgr2=0x564a8f8aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.494+0000 7fc147e00640 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f8aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.494+0000 7fc147e00640 1 -- 172.21.15.7:0/351025657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 msgr2=0x564a8f8b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.494+0000 7fc147e00640 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f8b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.494+0000 7fc147e00640 1 -- 172.21.15.7:0/351025657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8f5bf620 con 0x564a8f8832e0 2024-04-23T15:43:02.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.495+0000 7fc147400640 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f8b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:43:02.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.497+0000 7fc147e00640 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x564a8f883f60 tx=0x7fc14000b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3281e9df943bb036 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.497+0000 7fc133e00640 1 -- 172.21.15.7:0/351025657 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140026020 con 0x564a8f8832e0 2024-04-23T15:43:02.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.497+0000 7fc133e00640 1 -- 172.21.15.7:0/351025657 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc140017040 con 0x564a8f8832e0 2024-04-23T15:43:02.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.498+0000 7fc133e00640 1 -- 172.21.15.7:0/351025657 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140026020 con 0x564a8f8832e0 2024-04-23T15:43:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.499+0000 7fc1519b0740 1 -- 172.21.15.7:0/351025657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 msgr2=0x564a8f88b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.499+0000 7fc1519b0740 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x564a8f883f60 tx=0x7fc14000b420 comp rx=0 tx=0).stop 2024-04-23T15:43:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.500+0000 7fc1519b0740 1 -- 172.21.15.7:0/351025657 shutdown_connections 2024-04-23T15:43:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.500+0000 7fc1519b0740 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f88b3a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.500+0000 7fc1519b0740 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f88dba0 0x564a8f8b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.500+0000 7fc1519b0740 1 --2- 172.21.15.7:0/351025657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f8829c0 0x564a8f8aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.500+0000 7fc1519b0740 1 -- 172.21.15.7:0/351025657 >> 172.21.15.7:0/351025657 conn(0x564a8f87eed0 msgr2=0x564a8f884c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.501+0000 7fc1519b0740 1 -- 172.21.15.7:0/351025657 shutdown_connections 2024-04-23T15:43:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.502+0000 7fc1519b0740 1 -- 172.21.15.7:0/351025657 wait complete. 2024-04-23T15:43:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.502+0000 7fc1519b0740 1 -- start start 2024-04-23T15:43:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.503+0000 7fc1519b0740 1 Processor -- start 2024-04-23T15:43:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.505+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f887a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.506+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f887fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.506+0000 7fc1519b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f888510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.506+0000 7fc1519b0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc128011410 con 0x564a8f8829c0 2024-04-23T15:43:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.506+0000 7fc1519b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc128010d40 con 0x564a8f8832e0 2024-04-23T15:43:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.506+0000 7fc1519b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc12800e030 con 0x564a8f88dba0 2024-04-23T15:43:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.507+0000 7fc1519b0740 10 client.0 _ll_register_callbacks cb 0x7fc138009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:43:02.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.507+0000 7fc147e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f887fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.507+0000 7fc147e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f887fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:45096/0 (socket says 172.21.15.7:45096) 2024-04-23T15:43:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.507+0000 7fc147e00640 1 -- 172.21.15.7:0/263230575 learned_addr learned my addr 172.21.15.7:0/263230575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.508+0000 7fc147400640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f888510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.508+0000 7fc147400640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f887a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.509+0000 7fc147e00640 1 -- 172.21.15.7:0/263230575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 msgr2=0x564a8f888510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.509+0000 7fc147e00640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f888510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.509+0000 7fc147e00640 1 -- 172.21.15.7:0/263230575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 msgr2=0x564a8f887a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.509+0000 7fc147e00640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f887a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.510+0000 7fc147e00640 1 -- 172.21.15.7:0/263230575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8f914630 con 0x564a8f8832e0 2024-04-23T15:43:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.510+0000 7fc147400640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f887a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:43:02.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.510+0000 7fc147e00640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f887fd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc140009610 tx=0x7fc140012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2afa03f6dc4d39c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.510+0000 7fc131600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:43:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.511+0000 7fc131600640 1 -- 172.21.15.7:0/263230575 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140031070 con 0x564a8f8832e0 2024-04-23T15:43:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.512+0000 7fc131600640 1 -- 172.21.15.7:0/263230575 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 9747+0+0 (secure 0 0 0) 0x7fc140022050 con 0x564a8f8832e0 2024-04-23T15:43:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.512+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc140017040 con 0x564a8f8832e0 2024-04-23T15:43:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.513+0000 7fc131600640 1 -- 172.21.15.7:0/263230575 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc140012640 con 0x564a8f8832e0 2024-04-23T15:43:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.513+0000 7fc1519b0740 10 client.38414 fetch_fsmap learned FSMap version 32 2024-04-23T15:43:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.513+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564a8f9158b0 con 0x564a8f8832e0 2024-04-23T15:43:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc131600640 1 -- 172.21.15.7:0/263230575 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc140017040 con 0x564a8f8832e0 2024-04-23T15:43:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc131600640 1 -- 172.21.15.7:0/263230575 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fc140011070 con 0x564a8f8832e0 2024-04-23T15:43:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc1519b0740 10 client.38414 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:43:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc1519b0740 10 client.38414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:43:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc1519b0740 20 client.38414 populate_metadata read hostname 'smithi007' 2024-04-23T15:43:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc1519b0740 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f917df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc1519b0740 4 client.38414 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:43:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.514+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a8f7ee320 con 0x564a8f8aede0 2024-04-23T15:43:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.515+0000 7fc147400640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f917df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.520+0000 7fc147400640 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f917df0 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2188d1f034fb2512 server_cookie=49801d93ce2c5920 in_seq=0 out_seq=0 2024-04-23T15:43:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:02.520+0000 7fc131600640 10 client.38414 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:03.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:03 smithi007 ceph-mon[27906]: pgmap v1637: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-04-23T15:43:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:03 smithi186 ceph-mon[31814]: pgmap v1637: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-04-23T15:43:03.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:03 smithi137 ceph-mon[31694]: pgmap v1637: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-04-23T15:43:05.470 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:05 smithi137 ceph-mon[31694]: pgmap v1638: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.4 MiB/s wr, 2.37k op/s 2024-04-23T15:43:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:05 smithi007 ceph-mon[27906]: pgmap v1638: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.4 MiB/s wr, 2.37k op/s 2024-04-23T15:43:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:05 smithi186 ceph-mon[31814]: pgmap v1638: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.4 MiB/s wr, 2.37k op/s 2024-04-23T15:43:07.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:07 smithi007 ceph-mon[27906]: pgmap v1639: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:43:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:07 smithi186 ceph-mon[31814]: pgmap v1639: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:43:07.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:07 smithi137 ceph-mon[31694]: pgmap v1639: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-04-23T15:43:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:09 smithi007 ceph-mon[27906]: pgmap v1640: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-04-23T15:43:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:09 smithi186 ceph-mon[31814]: pgmap v1640: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-04-23T15:43:09.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:09 smithi137 ceph-mon[31694]: pgmap v1640: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-04-23T15:43:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:11 smithi007 ceph-mon[27906]: pgmap v1641: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.4 MiB/s wr, 2.37k op/s 2024-04-23T15:43:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:11 smithi186 ceph-mon[31814]: pgmap v1641: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.4 MiB/s wr, 2.37k op/s 2024-04-23T15:43:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:11 smithi137 ceph-mon[31694]: pgmap v1641: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.4 MiB/s wr, 2.37k op/s 2024-04-23T15:43:13.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:13 smithi007 ceph-mon[27906]: pgmap v1642: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-04-23T15:43:13.612 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:13 smithi186 ceph-mon[31814]: pgmap v1642: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-04-23T15:43:13.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:13 smithi137 ceph-mon[31694]: pgmap v1642: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 2.83k op/s 2024-04-23T15:43:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:15 smithi007 ceph-mon[27906]: pgmap v1643: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.1 MiB/s wr, 2.03k op/s 2024-04-23T15:43:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:15 smithi186 ceph-mon[31814]: pgmap v1643: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.1 MiB/s wr, 2.03k op/s 2024-04-23T15:43:15.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:15 smithi137 ceph-mon[31694]: pgmap v1643: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.1 MiB/s wr, 2.03k op/s 2024-04-23T15:43:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:17 smithi007 ceph-mon[27906]: pgmap v1644: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 2.63k op/s 2024-04-23T15:43:17.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:17 smithi186 ceph-mon[31814]: pgmap v1644: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 2.63k op/s 2024-04-23T15:43:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.635+0000 7fc131600640 1 -- 172.21.15.7:0/263230575 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a8f7ee320 con 0x564a8f8aede0 2024-04-23T15:43:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.635+0000 7fc131600640 10 client.38414 handle_command_reply: tid=0 2024-04-23T15:43:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.635+0000 7fc1519b0740 1 client.38414 shutdown 2024-04-23T15:43:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.636+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 msgr2=0x564a8f887fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.636+0000 7fc1519b0740 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f887fd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc140009610 tx=0x7fc140012bc0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.636+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 shutdown_connections 2024-04-23T15:43:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.636+0000 7fc1519b0740 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564a8f8aede0 0x564a8f917df0 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.636+0000 7fc131600640 0 client.38414 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.636+0000 7fc1519b0740 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a8f8832e0 0x564a8f887fd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.637+0000 7fc1519b0740 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a8f88dba0 0x564a8f888510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.637+0000 7fc1519b0740 1 --2- 172.21.15.7:0/263230575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8f8829c0 0x564a8f887a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.637+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 >> 172.21.15.7:0/263230575 conn(0x564a8f87eed0 msgr2=0x564a8f874fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.637+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 shutdown_connections 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.637+0000 7fc1519b0740 1 -- 172.21.15.7:0/263230575 wait complete. 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.638+0000 7fc1519b0740 20 client.38414 trim_cache size 0 max 16384 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:43:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:43:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:43:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:43:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc12c0a3e90 msgr2=0x7fc12c0a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc12c0a3e90 0x7fc12c0a6350 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc1340b9340 tx=0x7fc1340b8a60 comp rx=0 tx=0).stop 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 msgr2=0x7fc14819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 0x7fc14819ac70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc13402a990 tx=0x7fc134003c00 comp rx=0 tx=0).stop 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 shutdown_connections 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc12c0a3e90 0x7fc12c0a6350 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14819a7c0 0x7fc14819ac70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc148109520 0x7fc1481a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 --2- 172.21.15.7:0/2863276437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc148104450 0x7fc1481a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.639+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 >> 172.21.15.7:0/2863276437 conn(0x7fc1480ffcf0 msgr2=0x7fc148101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.640+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 shutdown_connections 2024-04-23T15:43:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:17.640+0000 7fc14ec00640 1 -- 172.21.15.7:0/2863276437 wait complete. 2024-04-23T15:43:17.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:17 smithi137 ceph-mon[31694]: pgmap v1644: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 2.63k op/s 2024-04-23T15:43:19.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:19 smithi007 ceph-mon[27906]: pgmap v1645: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.5 MiB/s wr, 2.37k op/s 2024-04-23T15:43:19.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:19 smithi007 ceph-mon[27906]: osdmap e179: 12 total, 12 up, 12 in 2024-04-23T15:43:19.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:19 smithi186 ceph-mon[31814]: pgmap v1645: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.5 MiB/s wr, 2.37k op/s 2024-04-23T15:43:19.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:19 smithi186 ceph-mon[31814]: osdmap e179: 12 total, 12 up, 12 in 2024-04-23T15:43:19.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:19 smithi137 ceph-mon[31694]: pgmap v1645: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 9.5 MiB/s wr, 2.37k op/s 2024-04-23T15:43:19.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:19 smithi137 ceph-mon[31694]: osdmap e179: 12 total, 12 up, 12 in 2024-04-23T15:43:21.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:21 smithi007 ceph-mon[27906]: pgmap v1647: 129 pgs: 4 active+clean+snaptrim, 114 active+clean, 11 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.6 MiB/s wr, 2.13k op/s 2024-04-23T15:43:21.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:21 smithi186 ceph-mon[31814]: pgmap v1647: 129 pgs: 4 active+clean+snaptrim, 114 active+clean, 11 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.6 MiB/s wr, 2.13k op/s 2024-04-23T15:43:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:21 smithi137 ceph-mon[31694]: pgmap v1647: 129 pgs: 4 active+clean+snaptrim, 114 active+clean, 11 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.6 MiB/s wr, 2.13k op/s 2024-04-23T15:43:23.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:23 smithi007 ceph-mon[27906]: pgmap v1648: 129 pgs: 14 active+clean+snaptrim, 78 active+clean, 37 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 8.7 MiB/s wr, 2.13k op/s 2024-04-23T15:43:23.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:23 smithi186 ceph-mon[31814]: pgmap v1648: 129 pgs: 14 active+clean+snaptrim, 78 active+clean, 37 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 8.7 MiB/s wr, 2.13k op/s 2024-04-23T15:43:23.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:23 smithi137 ceph-mon[31694]: pgmap v1648: 129 pgs: 14 active+clean+snaptrim, 78 active+clean, 37 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 8.7 MiB/s wr, 2.13k op/s 2024-04-23T15:43:25.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:25 smithi007 ceph-mon[27906]: pgmap v1649: 129 pgs: 18 active+clean+snaptrim, 60 active+clean, 51 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.3 MiB/s wr, 2.29k op/s 2024-04-23T15:43:25.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:25 smithi186 ceph-mon[31814]: pgmap v1649: 129 pgs: 18 active+clean+snaptrim, 60 active+clean, 51 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.3 MiB/s wr, 2.29k op/s 2024-04-23T15:43:25.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:25 smithi137 ceph-mon[31694]: pgmap v1649: 129 pgs: 18 active+clean+snaptrim, 60 active+clean, 51 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.3 MiB/s wr, 2.29k op/s 2024-04-23T15:43:27.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:27 smithi007 ceph-mon[27906]: pgmap v1650: 129 pgs: 16 active+clean+snaptrim, 62 active+clean, 51 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 1.83k op/s 2024-04-23T15:43:27.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:27 smithi186 ceph-mon[31814]: pgmap v1650: 129 pgs: 16 active+clean+snaptrim, 62 active+clean, 51 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 1.83k op/s 2024-04-23T15:43:27.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:27 smithi137 ceph-mon[31694]: pgmap v1650: 129 pgs: 16 active+clean+snaptrim, 62 active+clean, 51 active+clean+snaptrim_wait; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 1.83k op/s 2024-04-23T15:43:29.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:29 smithi007 ceph-mon[27906]: pgmap v1651: 129 pgs: 10 active+clean+snaptrim, 88 active+clean, 31 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.9 MiB/s wr, 1.69k op/s 2024-04-23T15:43:29.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:29 smithi186 ceph-mon[31814]: pgmap v1651: 129 pgs: 10 active+clean+snaptrim, 88 active+clean, 31 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.9 MiB/s wr, 1.69k op/s 2024-04-23T15:43:29.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:29 smithi137 ceph-mon[31694]: pgmap v1651: 129 pgs: 10 active+clean+snaptrim, 88 active+clean, 31 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.9 MiB/s wr, 1.69k op/s 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 -- 172.21.15.7:0/1599921189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 msgr2=0x7fd9d0104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 --2- 172.21.15.7:0/1599921189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 0x7fd9d0104680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009900 tx=0x7fd9bc02a400 comp rx=0 tx=0).stop 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 -- 172.21.15.7:0/1599921189 shutdown_connections 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 --2- 172.21.15.7:0/1599921189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d0109370 0x7fd9d0110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 --2- 172.21.15.7:0/1599921189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d0104c50 0x7fd9d0108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 --2- 172.21.15.7:0/1599921189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 0x7fd9d0104680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 -- 172.21.15.7:0/1599921189 >> 172.21.15.7:0/1599921189 conn(0x7fd9d00ffae0 msgr2=0x7fd9d0101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.953+0000 7fd9d5400640 1 -- 172.21.15.7:0/1599921189 shutdown_connections 2024-04-23T15:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.954+0000 7fd9d5400640 1 -- 172.21.15.7:0/1599921189 wait complete. 2024-04-23T15:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.955+0000 7fd9d5400640 1 Processor -- start 2024-04-23T15:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.955+0000 7fd9d5400640 1 -- start start 2024-04-23T15:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 0x7fd9d01a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d0109370 0x7fd9d01a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 0x7fd9d019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d5400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0114300 con 0x7fd9d019a6a0 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d5400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0114180 con 0x7fd9d0109370 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d5400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0114480 con 0x7fd9d01042a0 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 0x7fd9d019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 0x7fd9d019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56850/0 (socket says 172.21.15.7:56850) 2024-04-23T15:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.956+0000 7fd9d4a00640 1 -- 172.21.15.7:0/2554103469 learned_addr learned my addr 172.21.15.7:0/2554103469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.957+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 0x7fd9d01a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.957+0000 7fd9cf400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d0109370 0x7fd9d01a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.958+0000 7fd9d4a00640 1 -- 172.21.15.7:0/2554103469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 msgr2=0x7fd9d01a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.958+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 0x7fd9d01a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.958+0000 7fd9d4a00640 1 -- 172.21.15.7:0/2554103469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d0109370 msgr2=0x7fd9d01a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.958+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d0109370 0x7fd9d01a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.958+0000 7fd9d4a00640 1 -- 172.21.15.7:0/2554103469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d019b270 con 0x7fd9d019a6a0 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.959+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 0x7fd9d019ab20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800eb10 tx=0x7fd9c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.960+0000 7fd9ccc00640 1 -- 172.21.15.7:0/2554103469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8004b20 con 0x7fd9d019a6a0 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.960+0000 7fd9ccc00640 1 -- 172.21.15.7:0/2554103469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9c8004cc0 con 0x7fd9d019a6a0 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.960+0000 7fd9ccc00640 1 -- 172.21.15.7:0/2554103469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8010690 con 0x7fd9d019a6a0 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.961+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d006ba20 con 0x7fd9d019a6a0 2024-04-23T15:43:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.961+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d006bf20 con 0x7fd9d019a6a0 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.967+0000 7fd9d99d3740 1 Processor -- start 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.967+0000 7fd9ccc00640 1 -- 172.21.15.7:0/2554103469 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd9c8005000 con 0x7fd9d019a6a0 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.967+0000 7fd9d99d3740 1 -- start start 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.968+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.968+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b1f6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.968+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.968+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564b2b149900 con 0x564b2b1e32e0 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.968+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b2b0eff20 con 0x564b2b1e3c00 2024-04-23T15:43:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.968+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564b2b1458c0 con 0x564b2b1f6db0 2024-04-23T15:43:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59126/0 (socket says 172.21.15.7:59126) 2024-04-23T15:43:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 -- 172.21.15.7:0/3215218923 learned_addr learned my addr 172.21.15.7:0/3215218923 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b1f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 -- 172.21.15.7:0/3215218923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 msgr2=0x564b2b1f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b1f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 -- 172.21.15.7:0/3215218923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 msgr2=0x564b2b1e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1e36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.969+0000 7fd9cf400640 1 -- 172.21.15.7:0/3215218923 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b2b114e10 con 0x564b2b1f6db0 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.970+0000 7fd9cf400640 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f91a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0011470 tx=0x7fd9c00097a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8519152e5317ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.970+0000 7fd9c5200640 1 -- 172.21.15.7:0/3215218923 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0005020 con 0x564b2b1f6db0 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.970+0000 7fd9c5200640 1 -- 172.21.15.7:0/3215218923 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9c00047a0 con 0x564b2b1f6db0 2024-04-23T15:43:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.970+0000 7fd9c5200640 1 -- 172.21.15.7:0/3215218923 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000e620 con 0x564b2b1f6db0 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9ccc00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9b40a3e60 0x7fd9b40a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 -- 172.21.15.7:0/3215218923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 msgr2=0x564b2b1f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f91a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0011470 tx=0x7fd9c00097a0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9ccc00640 1 -- 172.21.15.7:0/2554103469 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 9811+0+0 (secure 0 0 0) 0x7fd9c80d1170 con 0x7fd9d019a6a0 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 -- 172.21.15.7:0/3215218923 shutdown_connections 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b1f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f91a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/3215218923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.971+0000 7fd9d99d3740 1 -- 172.21.15.7:0/3215218923 >> 172.21.15.7:0/3215218923 conn(0x564b2b1df8d0 msgr2=0x564b2b1dfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.973+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9b40a3e60 0x7fd9b40a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.973+0000 7fd9d99d3740 1 -- 172.21.15.7:0/3215218923 shutdown_connections 2024-04-23T15:43:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.973+0000 7fd9d99d3740 1 -- 172.21.15.7:0/3215218923 wait complete. 2024-04-23T15:43:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.973+0000 7fd9d99d3740 1 -- start start 2024-04-23T15:43:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.974+0000 7fd9d99d3740 1 Processor -- start 2024-04-23T15:43:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.974+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9b40a3e60 0x7fd9b40a6320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc005ab0 tx=0x7fd9bc005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1f0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e3c00 0x564b2b1f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564b2b1e62a0 con 0x564b2b1e3c00 2024-04-23T15:43:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b2b1032c0 con 0x564b2b1e32e0 2024-04-23T15:43:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x564b2b1e6420 con 0x564b2b1f6db0 2024-04-23T15:43:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.976+0000 7fd9d99d3740 10 client.0 _ll_register_callbacks cb 0x564b2ae5ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:43:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.977+0000 7fd9cfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.977+0000 7fd9cfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:39646/0 (socket says 172.21.15.7:39646) 2024-04-23T15:43:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.977+0000 7fd9cfe00640 1 -- 172.21.15.7:0/1947559145 learned_addr learned my addr 172.21.15.7:0/1947559145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.977+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.977+0000 7fd9cf400640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e3c00 0x564b2b1f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.978+0000 7fd9d4a00640 1 -- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 msgr2=0x564b2b1f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.978+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.978+0000 7fd9d4a00640 1 -- 172.21.15.7:0/1947559145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e3c00 msgr2=0x564b2b1f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.978+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e3c00 0x564b2b1f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.978+0000 7fd9d4a00640 1 -- 172.21.15.7:0/1947559145 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b2b113fd0 con 0x564b2b1f6db0 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.978+0000 7fd9b9600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.979+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f6640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80ce3b0 tx=0x7fd9c809c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d084646805cc016 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.979+0000 7fd9b9600640 1 -- 172.21.15.7:0/1947559145 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80a0fb0 con 0x564b2b1f6db0 2024-04-23T15:43:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.979+0000 7fd9b9600640 1 -- 172.21.15.7:0/1947559145 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 9811+0+0 (secure 0 0 0) 0x7fd9c80052f0 con 0x564b2b1f6db0 2024-04-23T15:43:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.979+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c00047a0 con 0x564b2b1f6db0 2024-04-23T15:43:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.980+0000 7fd9b9600640 1 -- 172.21.15.7:0/1947559145 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd9c80a5870 con 0x564b2b1f6db0 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.980+0000 7fd9d99d3740 10 client.28564 fetch_fsmap learned FSMap version 32 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.980+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564b2ae5c210 con 0x564b2b1f6db0 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.980+0000 7fd9b9600640 1 -- 172.21.15.7:0/1947559145 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9c00047a0 con 0x564b2b1f6db0 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.980+0000 7fd9b9600640 1 -- 172.21.15.7:0/1947559145 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd9c80ceb00 con 0x564b2b1f6db0 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9d99d3740 10 client.28564 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9d99d3740 10 client.28564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:43:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9d99d3740 20 client.28564 populate_metadata read hostname 'smithi007' 2024-04-23T15:43:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b20f750 0x564b2b211b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9d99d3740 4 client.28564 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:43:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b2b157320 con 0x564b2b20f750 2024-04-23T15:43:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.981+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b20f750 0x564b2b211b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.983+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b20f750 0x564b2b211b40 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac8c152d0f56e430 server_cookie=4ee19452bc1c6edb in_seq=0 out_seq=0 2024-04-23T15:43:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.984+0000 7fd9b9600640 10 client.28564 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.986+0000 7fd9b9600640 1 -- 172.21.15.7:0/1947559145 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564b2b157320 con 0x564b2b20f750 2024-04-23T15:43:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.986+0000 7fd9b9600640 10 client.28564 handle_command_reply: tid=0 2024-04-23T15:43:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.986+0000 7fd9d99d3740 1 client.28564 shutdown 2024-04-23T15:43:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 msgr2=0x564b2b1f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f6640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80ce3b0 tx=0x7fd9c809c800 comp rx=0 tx=0).stop 2024-04-23T15:43:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 shutdown_connections 2024-04-23T15:43:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b20f750 0x564b2b211b40 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9b9600640 0 client.28564 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b1f6640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e3c00 0x564b2b1f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/1947559145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:30.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.987+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 >> 172.21.15.7:0/1947559145 conn(0x564b2b1df8d0 msgr2=0x564b2b1dea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.988+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 shutdown_connections 2024-04-23T15:43:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.988+0000 7fd9d99d3740 1 -- 172.21.15.7:0/1947559145 wait complete. 2024-04-23T15:43:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:30.989+0000 7fd9d99d3740 20 client.28564 trim_cache size 0 max 16384 2024-04-23T15:43:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.016+0000 7fd9d99d3740 1 Processor -- start 2024-04-23T15:43:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 -- start start 2024-04-23T15:43:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b2173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b2178e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0071b20 con 0x564b2b1e32e0 2024-04-23T15:43:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0073660 con 0x564b2b1e3c00 2024-04-23T15:43:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.020+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00721f0 con 0x564b2b1f6db0 2024-04-23T15:43:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.021+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b2178e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.021+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b2178e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59136/0 (socket says 172.21.15.7:59136) 2024-04-23T15:43:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.021+0000 7fd9d4a00640 1 -- 172.21.15.7:0/4214160021 learned_addr learned my addr 172.21.15.7:0/4214160021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9cf400640 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b2173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9d4a00640 1 -- 172.21.15.7:0/4214160021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 msgr2=0x564b2b2173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b2173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9d4a00640 1 -- 172.21.15.7:0/4214160021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 msgr2=0x564b2b1de910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1de910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9d4a00640 1 -- 172.21.15.7:0/4214160021 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b2af28620 con 0x564b2b1f6db0 2024-04-23T15:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.022+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1de910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.024+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b2178e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9c809cb90 tx=0x7fd9c8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ef4a9b945c9068 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.025+0000 7fd9bbe00640 1 -- 172.21.15.7:0/4214160021 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80a0fb0 con 0x564b2b1f6db0 2024-04-23T15:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.025+0000 7fd9bbe00640 1 -- 172.21.15.7:0/4214160021 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9c8098b60 con 0x564b2b1f6db0 2024-04-23T15:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.025+0000 7fd9bbe00640 1 -- 172.21.15.7:0/4214160021 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8099270 con 0x564b2b1f6db0 2024-04-23T15:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.026+0000 7fd9d99d3740 1 -- 172.21.15.7:0/4214160021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 msgr2=0x564b2b2178e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.026+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b2178e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9c809cb90 tx=0x7fd9c8004ab0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.026+0000 7fd9d99d3740 1 -- 172.21.15.7:0/4214160021 shutdown_connections 2024-04-23T15:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.026+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e3c00 0x564b2b2173a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.027+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1f6db0 0x564b2b2178e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.027+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/4214160021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1e32e0 0x564b2b1de910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.027+0000 7fd9d99d3740 1 -- 172.21.15.7:0/4214160021 >> 172.21.15.7:0/4214160021 conn(0x564b2b1df8d0 msgr2=0x564b2b1de200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.028+0000 7fd9d99d3740 1 -- 172.21.15.7:0/4214160021 shutdown_connections 2024-04-23T15:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.028+0000 7fd9d99d3740 1 -- 172.21.15.7:0/4214160021 wait complete. 2024-04-23T15:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.029+0000 7fd9d99d3740 1 -- start start 2024-04-23T15:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.029+0000 7fd9d99d3740 1 Processor -- start 2024-04-23T15:43:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.030+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 0x564b2b1e9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d99d3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1f6db0 0x564b2b2746f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0072f90 con 0x564b2b1f6db0 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00728c0 con 0x564b2b1e32e0 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d99d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d006fb40 con 0x564b2b1e3c00 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d99d3740 10 client.0 _ll_register_callbacks cb 0x7fd9c809c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1f6db0 0x564b2b2746f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9cf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 0x564b2b1e9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.031+0000 7fd9cf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 0x564b2b1e9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:59144/0 (socket says 172.21.15.7:59144) 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9cf400640 1 -- 172.21.15.7:0/391522841 learned_addr learned my addr 172.21.15.7:0/391522841 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9d4a00640 1 -- 172.21.15.7:0/391522841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 msgr2=0x564b2b1e9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 0x564b2b1e9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9d4a00640 1 -- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 msgr2=0x564b2b1e8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1e8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.032+0000 7fd9d4a00640 1 -- 172.21.15.7:0/391522841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b2b1e9b40 con 0x564b2b1f6db0 2024-04-23T15:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.033+0000 7fd9cf400640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 0x564b2b1e9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.033+0000 7fd9b9600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-23T15:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.034+0000 7fd9d4a00640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1f6db0 0x564b2b2746f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd9c809c900 tx=0x7fd9c8009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d51d54af9cec10f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.034+0000 7fd9b9600640 1 -- 172.21.15.7:0/391522841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80a0fb0 con 0x564b2b1f6db0 2024-04-23T15:43:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.035+0000 7fd9b9600640 1 -- 172.21.15.7:0/391522841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 9811+0+0 (secure 0 0 0) 0x7fd9c80052f0 con 0x564b2b1f6db0 2024-04-23T15:43:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.035+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c8098b60 con 0x564b2b1f6db0 2024-04-23T15:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.035+0000 7fd9b9600640 1 -- 172.21.15.7:0/391522841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd9c80b1120 con 0x564b2b1f6db0 2024-04-23T15:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.036+0000 7fd9d99d3740 10 client.19653 fetch_fsmap learned FSMap version 32 2024-04-23T15:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.036+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564b2b275d40 con 0x564b2b1f6db0 2024-04-23T15:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.037+0000 7fd9b9600640 1 -- 172.21.15.7:0/391522841 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9c8098b60 con 0x564b2b1f6db0 2024-04-23T15:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.037+0000 7fd9b9600640 1 -- 172.21.15.7:0/391522841 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7fd9c80b12c0 con 0x564b2b1f6db0 2024-04-23T15:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.037+0000 7fd9d99d3740 10 client.19653 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.037+0000 7fd9d99d3740 10 client.19653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:43:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.037+0000 7fd9d99d3740 20 client.19653 populate_metadata read hostname 'smithi007' 2024-04-23T15:43:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.037+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b2761c0 0x564b2b2785b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.038+0000 7fd9d99d3740 4 client.19653 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:43:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.038+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b2b151190 con 0x564b2b2761c0 2024-04-23T15:43:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.038+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b2761c0 0x564b2b2785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.040+0000 7fd9cfe00640 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b2761c0 0x564b2b2785b0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29628bb463fa6d6d server_cookie=e0e161e0563fa38e in_seq=0 out_seq=0 2024-04-23T15:43:31.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:31.041+0000 7fd9b9600640 10 client.19653 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:31.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:31 smithi007 ceph-mon[27906]: pgmap v1652: 129 pgs: 8 active+clean+snaptrim, 96 active+clean, 25 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 1.45k op/s 2024-04-23T15:43:31.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:31 smithi186 ceph-mon[31814]: pgmap v1652: 129 pgs: 8 active+clean+snaptrim, 96 active+clean, 25 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 1.45k op/s 2024-04-23T15:43:31.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:31 smithi137 ceph-mon[31694]: pgmap v1652: 129 pgs: 8 active+clean+snaptrim, 96 active+clean, 25 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 1.45k op/s 2024-04-23T15:43:33.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:33 smithi186 ceph-mon[31814]: pgmap v1653: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.0 MiB/s wr, 1.98k op/s 2024-04-23T15:43:33.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:33 smithi137 ceph-mon[31694]: pgmap v1653: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.0 MiB/s wr, 1.98k op/s 2024-04-23T15:43:33.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:33 smithi007 ceph-mon[27906]: pgmap v1653: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.0 MiB/s wr, 1.98k op/s 2024-04-23T15:43:35.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:35 smithi186 ceph-mon[31814]: pgmap v1654: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.1 MiB/s wr, 1.26k op/s 2024-04-23T15:43:35.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:35 smithi137 ceph-mon[31694]: pgmap v1654: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.1 MiB/s wr, 1.26k op/s 2024-04-23T15:43:35.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:35 smithi007 ceph-mon[27906]: pgmap v1654: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.1 MiB/s wr, 1.26k op/s 2024-04-23T15:43:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.925+0000 7fd9b9600640 1 -- 172.21.15.7:0/391522841 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b2b151190 con 0x564b2b2761c0 2024-04-23T15:43:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.926+0000 7fd9b9600640 10 client.19653 handle_command_reply: tid=0 2024-04-23T15:43:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.926+0000 7fd9d99d3740 1 client.19653 shutdown 2024-04-23T15:43:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.926+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1f6db0 msgr2=0x564b2b2746f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.926+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1f6db0 0x564b2b2746f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd9c809c900 tx=0x7fd9c8009200 comp rx=0 tx=0).stop 2024-04-23T15:43:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 shutdown_connections 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x564b2b2761c0 0x564b2b2785b0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b2b1f6db0 0x564b2b2746f0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b2b1e3c00 0x564b2b1e9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9d99d3740 1 --2- 172.21.15.7:0/391522841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b2b1e32e0 0x564b2b1e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 >> 172.21.15.7:0/391522841 conn(0x564b2b1df8d0 msgr2=0x564b2b1dea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.927+0000 7fd9b9600640 0 client.19653 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.928+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 shutdown_connections 2024-04-23T15:43:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.928+0000 7fd9d99d3740 1 -- 172.21.15.7:0/391522841 wait complete. 2024-04-23T15:43:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.929+0000 7fd9d99d3740 20 client.19653 trim_cache size 0 max 16384 2024-04-23T15:43:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:43:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:43:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:43:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:43:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.930+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9b40a3e60 msgr2=0x7fd9b40a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.930+0000 7fd9d5400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9b40a3e60 0x7fd9b40a6320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc005ab0 tx=0x7fd9bc005a20 comp rx=0 tx=0).stop 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.930+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 msgr2=0x7fd9d019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.930+0000 7fd9d5400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 0x7fd9d019ab20 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800eb10 tx=0x7fd9c800c2d0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.931+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 shutdown_connections 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.931+0000 7fd9d5400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9b40a3e60 0x7fd9b40a6320 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc005ab0 tx=0x7fd9bc005a20 comp rx=0 tx=0).stop 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.931+0000 7fd9d5400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d0109370 0x7fd9d01a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.931+0000 7fd9d5400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d019a6a0 0x7fd9d019ab20 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.931+0000 7fd9d5400640 1 --2- 172.21.15.7:0/2554103469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9d01042a0 0x7fd9d01a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.931+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 >> 172.21.15.7:0/2554103469 conn(0x7fd9d00ffae0 msgr2=0x7fd9d0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.932+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 shutdown_connections 2024-04-23T15:43:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:35.932+0000 7fd9d5400640 1 -- 172.21.15.7:0/2554103469 wait complete. 2024-04-23T15:43:36.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:36 smithi137 ceph-mon[31694]: pgmap v1655: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.1 MiB/s wr, 1.76k op/s 2024-04-23T15:43:36.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:36 smithi007 ceph-mon[27906]: pgmap v1655: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.1 MiB/s wr, 1.76k op/s 2024-04-23T15:43:36.862 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:36 smithi186 ceph-mon[31814]: pgmap v1655: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.1 MiB/s wr, 1.76k op/s 2024-04-23T15:43:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:38 smithi007 ceph-mon[27906]: pgmap v1656: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.6 MiB/s wr, 1.89k op/s 2024-04-23T15:43:39.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:38 smithi186 ceph-mon[31814]: pgmap v1656: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.6 MiB/s wr, 1.89k op/s 2024-04-23T15:43:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:38 smithi137 ceph-mon[31694]: pgmap v1656: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.6 MiB/s wr, 1.89k op/s 2024-04-23T15:43:41.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:40 smithi007 ceph-mon[27906]: pgmap v1657: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.1 MiB/s wr, 1.78k op/s 2024-04-23T15:43:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:40 smithi186 ceph-mon[31814]: pgmap v1657: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.1 MiB/s wr, 1.78k op/s 2024-04-23T15:43:41.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:40 smithi137 ceph-mon[31694]: pgmap v1657: 129 pgs: 2 active+clean+snaptrim, 122 active+clean, 5 active+clean+snaptrim_wait; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.1 MiB/s wr, 1.78k op/s 2024-04-23T15:43:42.510 INFO:tasks.workunit.client.0.smithi007.stdout:Syncing()...7 sec 2024-04-23T15:43:42.510 INFO:tasks.workunit.client.0.smithi007.stdout:FFSB benchmark finished at: Tue Apr 23 15:43:42 2024 2024-04-23T15:43:42.510 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:Results: 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:Benchmark took 328.23 sec 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:Total Results 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:=============== 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout: ======= ============ ========= ======= =========== ========== 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout: write : 876800 2671.33 100.000% 100.000% 10.4MB/sec 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:- 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:2671.33 Transactions per Second 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:Throughput Results 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:=================== 2024-04-23T15:43:42.511 INFO:tasks.workunit.client.0.smithi007.stdout:Write Throughput: 10.4MB/sec 2024-04-23T15:43:42.537 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.537 INFO:tasks.workunit.client.0.smithi007.stdout:System Call Latency statistics in millisecs 2024-04-23T15:43:42.537 INFO:tasks.workunit.client.0.smithi007.stdout:===== 2024-04-23T15:43:42.537 INFO:tasks.workunit.client.0.smithi007.stdout: Min Avg Max Total Calls 2024-04-23T15:43:42.537 INFO:tasks.workunit.client.0.smithi007.stdout: ======== ======== ======== ============ 2024-04-23T15:43:42.537 INFO:tasks.workunit.client.0.smithi007.stdout:[ open] 0.869000 311.834015 25864.134766 685 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 2 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 1 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 6 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 30 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 187 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 199 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 204 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 41 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 2 2024-04-23T15:43:42.538 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout:[ write] 0.177000 11.179538 43470.628906 876800 2024-04-23T15:43:42.539 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 72 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 19 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 8 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 8 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 347 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 471 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 4090 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 48569 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 106722 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 137359 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 147959 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 107399 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 170322 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 153101 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 205 2024-04-23T15:43:42.540 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout:[ lseek] 0.000000 0.002071 6.604000 876800 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-04-23T15:43:42.541 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 21 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 30 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 71 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 225 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 176 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 195 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 1100 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 1112 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 873869 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout:[ close] 0.044000 2.781952 283.928009 685 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-23T15:43:42.542 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 11 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 23 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 60 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 96 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 54 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 49 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 113 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 99 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 172 2024-04-23T15:43:42.543 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 6 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout:0.5% User Time 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout:25.5% System Time 2024-04-23T15:43:42.544 INFO:tasks.workunit.client.0.smithi007.stdout:26.1% CPU Utilization 2024-04-23T15:43:42.552 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd .. 2024-04-23T15:43:42.572 INFO:tasks.workunit.client.0.smithi007.stderr:+ rm -r tmp ffsb 2024-04-23T15:43:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:42 smithi007 ceph-mon[27906]: pgmap v1658: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 2.15k op/s 2024-04-23T15:43:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:42 smithi186 ceph-mon[31814]: pgmap v1658: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 2.15k op/s 2024-04-23T15:43:43.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:42 smithi137 ceph-mon[31694]: pgmap v1658: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 2.15k op/s 2024-04-23T15:43:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:45 smithi007 ceph-mon[27906]: pgmap v1659: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-04-23T15:43:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:45 smithi186 ceph-mon[31814]: pgmap v1659: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-04-23T15:43:45.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:45 smithi137 ceph-mon[31694]: pgmap v1659: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-04-23T15:43:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:47 smithi007 ceph-mon[27906]: pgmap v1660: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 6.0 MiB/s wr, 1.47k op/s 2024-04-23T15:43:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:47 smithi007 ceph-mon[27906]: osdmap e180: 12 total, 12 up, 12 in 2024-04-23T15:43:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:47 smithi186 ceph-mon[31814]: pgmap v1660: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 6.0 MiB/s wr, 1.47k op/s 2024-04-23T15:43:47.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:47 smithi186 ceph-mon[31814]: osdmap e180: 12 total, 12 up, 12 in 2024-04-23T15:43:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:47 smithi137 ceph-mon[31694]: pgmap v1660: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 6.0 MiB/s wr, 1.47k op/s 2024-04-23T15:43:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:47 smithi137 ceph-mon[31694]: osdmap e180: 12 total, 12 up, 12 in 2024-04-23T15:43:49.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 -- 172.21.15.7:0/2509209634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c102fc0 msgr2=0x7ff49c1033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 --2- 172.21.15.7:0/2509209634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c102fc0 0x7ff49c1033a0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009860 tx=0x7ff48c02a3d0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 -- 172.21.15.7:0/2509209634 shutdown_connections 2024-04-23T15:43:49.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 --2- 172.21.15.7:0/2509209634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 0x7ff49c10e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 --2- 172.21.15.7:0/2509209634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c1038e0 0x7ff49c10bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 --2- 172.21.15.7:0/2509209634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c102fc0 0x7ff49c1033a0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.143+0000 7ff4a1000640 1 -- 172.21.15.7:0/2509209634 >> 172.21.15.7:0/2509209634 conn(0x7ff49c0fc820 msgr2=0x7ff49c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:49.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.146+0000 7ff4a1000640 1 -- 172.21.15.7:0/2509209634 shutdown_connections 2024-04-23T15:43:49.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.146+0000 7ff4a1000640 1 -- 172.21.15.7:0/2509209634 wait complete. 2024-04-23T15:43:49.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 Processor -- start 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 -- start start 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c102fc0 0x7ff49c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c1038e0 0x7ff49c19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 0x7ff49c1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c10ff10 con 0x7ff49c1038e0 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c10fd90 con 0x7ff49c10c3e0 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.148+0000 7ff4a1000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c110090 con 0x7ff49c102fc0 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c1038e0 0x7ff49c19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c1038e0 0x7ff49c19d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47750/0 (socket says 172.21.15.7:47750) 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49aa00640 1 -- 172.21.15.7:0/805256749 learned_addr learned my addr 172.21.15.7:0/805256749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c102fc0 0x7ff49c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49be00640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 0x7ff49c1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49b400640 1 -- 172.21.15.7:0/805256749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 msgr2=0x7ff49c1961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49b400640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 0x7ff49c1961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49b400640 1 -- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c1038e0 msgr2=0x7ff49c19d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49b400640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c1038e0 0x7ff49c19d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.149+0000 7ff49b400640 1 -- 172.21.15.7:0/805256749 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c196ab0 con 0x7ff49c102fc0 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.150+0000 7ff49be00640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 0x7ff49c1961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:43:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.150+0000 7ff49b400640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c102fc0 0x7ff49c19d050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff48c02a9c0 tx=0x7ff48c0052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.153+0000 7ff493e00640 1 -- 172.21.15.7:0/805256749 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004250 con 0x7ff49c102fc0 2024-04-23T15:43:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.153+0000 7ff493e00640 1 -- 172.21.15.7:0/805256749 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff48c030e40 con 0x7ff49c102fc0 2024-04-23T15:43:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.153+0000 7ff493e00640 1 -- 172.21.15.7:0/805256749 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004aa0 con 0x7ff49c102fc0 2024-04-23T15:43:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.153+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c196ce0 con 0x7ff49c102fc0 2024-04-23T15:43:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.153+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c19ad50 con 0x7ff49c102fc0 2024-04-23T15:43:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 Processor -- start 2024-04-23T15:43:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 -- start start 2024-04-23T15:43:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026f2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563b0264d900 con 0x563b026e73c0 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563b025f3f20 con 0x563b026f25a0 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff4a5476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563b026498c0 con 0x563b026e7ce0 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.161+0000 7ff493e00640 1 -- 172.21.15.7:0/805256749 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7ff48c039040 con 0x7ff49c102fc0 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.162+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.163+0000 7ff49be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.163+0000 7ff49be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026e77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47766/0 (socket says 172.21.15.7:47766) 2024-04-23T15:43:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.163+0000 7ff49be00640 1 -- 172.21.15.7:0/1955971011 learned_addr learned my addr 172.21.15.7:0/1955971011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.163+0000 7ff49b400640 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49be00640 1 -- 172.21.15.7:0/1955971011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 msgr2=0x563b026f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49be00640 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49be00640 1 -- 172.21.15.7:0/1955971011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 msgr2=0x563b026f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49be00640 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49be00640 1 -- 172.21.15.7:0/1955971011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b02618e10 con 0x563b026e73c0 2024-04-23T15:43:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:43:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49b400640 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:43:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.165+0000 7ff49be00640 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026e77a0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff48400bbf0 tx=0x7ff48400b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0782331dcec966 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.166+0000 7ff493e00640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff4800a3e60 0x7ff4800a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.166+0000 7ff493e00640 1 -- 172.21.15.7:0/805256749 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7ff48c0f2090 con 0x7ff49c102fc0 2024-04-23T15:43:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.167+0000 7ff490c00640 1 -- 172.21.15.7:0/1955971011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484005020 con 0x563b026e73c0 2024-04-23T15:43:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.167+0000 7ff490c00640 1 -- 172.21.15.7:0/1955971011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4840047a0 con 0x563b026e73c0 2024-04-23T15:43:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.167+0000 7ff490c00640 1 -- 172.21.15.7:0/1955971011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484015680 con 0x563b026e73c0 2024-04-23T15:43:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.169+0000 7ff4a5476740 1 -- 172.21.15.7:0/1955971011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 msgr2=0x563b026e77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.169+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026e77a0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff48400bbf0 tx=0x7ff48400b500 comp rx=0 tx=0).stop 2024-04-23T15:43:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.169+0000 7ff49b400640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff4800a3e60 0x7ff4800a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.170+0000 7ff49b400640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff4800a3e60 0x7ff4800a6320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0ef3e0 tx=0x7ff48c0045f0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.171+0000 7ff4a5476740 1 -- 172.21.15.7:0/1955971011 shutdown_connections 2024-04-23T15:43:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.171+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.171+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.171+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1955971011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026e77a0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.171+0000 7ff4a5476740 1 -- 172.21.15.7:0/1955971011 >> 172.21.15.7:0/1955971011 conn(0x563b026e38d0 msgr2=0x563b026e3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.173+0000 7ff4a5476740 1 -- 172.21.15.7:0/1955971011 shutdown_connections 2024-04-23T15:43:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.175+0000 7ff4a5476740 1 -- 172.21.15.7:0/1955971011 wait complete. 2024-04-23T15:43:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.175+0000 7ff4a5476740 1 -- start start 2024-04-23T15:43:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.176+0000 7ff4a5476740 1 Processor -- start 2024-04-23T15:43:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.177+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026ef620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.181+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.181+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.181+0000 7ff4a5476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563b026f50e0 con 0x563b026e73c0 2024-04-23T15:43:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.181+0000 7ff4a5476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563b026072c0 con 0x563b026f25a0 2024-04-23T15:43:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.181+0000 7ff4a5476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x563b026f5260 con 0x563b026e7ce0 2024-04-23T15:43:49.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.181+0000 7ff4a5476740 10 client.0 _ll_register_callbacks cb 0x563b0235fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:43:49.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.182+0000 7ff49be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.182+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.182+0000 7ff49be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026ef620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47782/0 (socket says 172.21.15.7:47782) 2024-04-23T15:43:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.182+0000 7ff49be00640 1 -- 172.21.15.7:0/557029325 learned_addr learned my addr 172.21.15.7:0/557029325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.182+0000 7ff49be00640 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.184+0000 7ff49aa00640 1 -- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 msgr2=0x563b026f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.184+0000 7ff49aa00640 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.184+0000 7ff49aa00640 1 -- 172.21.15.7:0/557029325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 msgr2=0x563b026ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.184+0000 7ff49aa00640 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026ef620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.184+0000 7ff49aa00640 1 -- 172.21.15.7:0/557029325 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b02617fd0 con 0x563b026e7ce0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.185+0000 7ff49aa00640 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026efb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff49c197890 tx=0x7ff494007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a869480d8e507657 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.185+0000 7ff489600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.186+0000 7ff489600640 1 -- 172.21.15.7:0/557029325 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49400fcf0 con 0x563b026e7ce0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.186+0000 7ff489600640 1 -- 172.21.15.7:0/557029325 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7ff494016420 con 0x563b026e7ce0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.186+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4840047a0 con 0x563b026e7ce0 2024-04-23T15:43:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.187+0000 7ff489600640 1 -- 172.21.15.7:0/557029325 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff494024050 con 0x563b026e7ce0 2024-04-23T15:43:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.187+0000 7ff4a5476740 10 client.28576 fetch_fsmap learned FSMap version 32 2024-04-23T15:43:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.187+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563b02360210 con 0x563b026e7ce0 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff489600640 1 -- 172.21.15.7:0/557029325 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4840047a0 con 0x563b026e7ce0 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff489600640 1 -- 172.21.15.7:0/557029325 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff494014690 con 0x563b026e7ce0 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff4a5476740 10 client.28576 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff4a5476740 10 client.28576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff4a5476740 20 client.28576 populate_metadata read hostname 'smithi007' 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff4a5476740 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b027026f0 0x563b02704ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff4a5476740 4 client.28576 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.188+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b0265b320 con 0x563b027026f0 2024-04-23T15:43:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.189+0000 7ff49be00640 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b027026f0 0x563b02704ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.190+0000 7ff49be00640 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b027026f0 0x563b02704ae0 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2702199959b55c89 server_cookie=41cc68da9ebf68c0 in_seq=0 out_seq=0 2024-04-23T15:43:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.190+0000 7ff489600640 10 client.28576 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.191+0000 7ff489600640 1 -- 172.21.15.7:0/557029325 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563b0265b320 con 0x563b027026f0 2024-04-23T15:43:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.191+0000 7ff489600640 10 client.28576 handle_command_reply: tid=0 2024-04-23T15:43:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.191+0000 7ff4a5476740 1 client.28576 shutdown 2024-04-23T15:43:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.193+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 msgr2=0x563b026efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.193+0000 7ff4a5476740 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026efb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff49c197890 tx=0x7ff494007f90 comp rx=0 tx=0).stop 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 shutdown_connections 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b027026f0 0x563b02704ae0 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026f25a0 0x563b026f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff489600640 0 client.28576 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026efb60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 --2- 172.21.15.7:0/557029325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026e73c0 0x563b026ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 >> 172.21.15.7:0/557029325 conn(0x563b026e38d0 msgr2=0x563b026e9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 shutdown_connections 2024-04-23T15:43:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.196+0000 7ff4a5476740 1 -- 172.21.15.7:0/557029325 wait complete. 2024-04-23T15:43:49.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.197+0000 7ff4a5476740 20 client.28576 trim_cache size 0 max 16384 2024-04-23T15:43:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.228+0000 7ff4a5476740 1 Processor -- start 2024-04-23T15:43:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.228+0000 7ff4a5476740 1 -- start start 2024-04-23T15:43:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.229+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e73c0 0x563b026fe080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.229+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.229+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b0270a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.229+0000 7ff4a5476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1be120 con 0x563b026f25a0 2024-04-23T15:43:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.229+0000 7ff4a5476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1bfc60 con 0x563b026e73c0 2024-04-23T15:43:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.229+0000 7ff4a5476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1be7f0 con 0x563b026e7ce0 2024-04-23T15:43:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.230+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.230+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:55484/0 (socket says 172.21.15.7:55484) 2024-04-23T15:43:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.230+0000 7ff49aa00640 1 -- 172.21.15.7:0/1789071972 learned_addr learned my addr 172.21.15.7:0/1789071972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.230+0000 7ff49be00640 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e73c0 0x563b026fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.230+0000 7ff49be00640 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b0270a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.231+0000 7ff49aa00640 1 -- 172.21.15.7:0/1789071972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e73c0 msgr2=0x563b026fe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.231+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e73c0 0x563b026fe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.231+0000 7ff49aa00640 1 -- 172.21.15.7:0/1789071972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 msgr2=0x563b0270a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.231+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b0270a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.231+0000 7ff49aa00640 1 -- 172.21.15.7:0/1789071972 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b02704e50 con 0x563b026e7ce0 2024-04-23T15:43:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.231+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026e9d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff494002230 tx=0x7ff494009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e841364c838185 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.232+0000 7ff48be00640 1 -- 172.21.15.7:0/1789071972 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494014cd0 con 0x563b026e7ce0 2024-04-23T15:43:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.232+0000 7ff48be00640 1 -- 172.21.15.7:0/1789071972 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff49401b070 con 0x563b026e7ce0 2024-04-23T15:43:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.232+0000 7ff48be00640 1 -- 172.21.15.7:0/1789071972 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494020450 con 0x563b026e7ce0 2024-04-23T15:43:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.233+0000 7ff4a5476740 1 -- 172.21.15.7:0/1789071972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 msgr2=0x563b026e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.233+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026e9d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff494002230 tx=0x7ff494009240 comp rx=0 tx=0).stop 2024-04-23T15:43:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 -- 172.21.15.7:0/1789071972 shutdown_connections 2024-04-23T15:43:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b0270a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e7ce0 0x563b026e9d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1789071972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e73c0 0x563b026fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 -- 172.21.15.7:0/1789071972 >> 172.21.15.7:0/1789071972 conn(0x563b026e38d0 msgr2=0x563b026e2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 -- 172.21.15.7:0/1789071972 shutdown_connections 2024-04-23T15:43:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.234+0000 7ff4a5476740 1 -- 172.21.15.7:0/1789071972 wait complete. 2024-04-23T15:43:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.235+0000 7ff4a5476740 1 -- start start 2024-04-23T15:43:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.235+0000 7ff4a5476740 1 Processor -- start 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e73c0 0x563b026fa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 0x563b026faad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b026f7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1bf590 con 0x563b026f25a0 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1beec0 con 0x563b026e7ce0 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1bc120 con 0x563b026e73c0 2024-04-23T15:43:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff4a5476740 10 client.0 _ll_register_callbacks cb 0x7ff49c06a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T15:43:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 0x563b026faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff49aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 0x563b026faad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:50406/0 (socket says 172.21.15.7:50406) 2024-04-23T15:43:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff49aa00640 1 -- 172.21.15.7:0/1168072641 learned_addr learned my addr 172.21.15.7:0/1168072641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.236+0000 7ff49be00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e73c0 0x563b026fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.237+0000 7ff49be00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b026f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.237+0000 7ff49aa00640 1 -- 172.21.15.7:0/1168072641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e73c0 msgr2=0x563b026fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.237+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e73c0 0x563b026fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.237+0000 7ff49aa00640 1 -- 172.21.15.7:0/1168072641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 msgr2=0x563b026f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.237+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b026f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.237+0000 7ff49aa00640 1 -- 172.21.15.7:0/1168072641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b0242c620 con 0x563b026e7ce0 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.238+0000 7ff49aa00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 0x563b026faad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4940099e0 tx=0x7ff494007710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5accc65588b078f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.238+0000 7ff489600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T15:43:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.239+0000 7ff489600640 1 -- 172.21.15.7:0/1168072641 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494036060 con 0x563b026e7ce0 2024-04-23T15:43:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.239+0000 7ff489600640 1 -- 172.21.15.7:0/1168072641 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7ff494014e50 con 0x563b026e7ce0 2024-04-23T15:43:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.239+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff49401b070 con 0x563b026e7ce0 2024-04-23T15:43:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.240+0000 7ff489600640 1 -- 172.21.15.7:0/1168072641 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff49403d050 con 0x563b026e7ce0 2024-04-23T15:43:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.240+0000 7ff4a5476740 10 client.38444 fetch_fsmap learned FSMap version 32 2024-04-23T15:43:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.240+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563b0277a610 con 0x563b026e7ce0 2024-04-23T15:43:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.240+0000 7ff489600640 1 -- 172.21.15.7:0/1168072641 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff49401b070 con 0x563b026e7ce0 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff489600640 1 -- 172.21.15.7:0/1168072641 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7ff4940319e0 con 0x563b026e7ce0 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff4a5476740 10 client.38444 fetch_fsmap finished waiting for FSMap version 32 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff4a5476740 10 client.38444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff4a5476740 20 client.38444 populate_metadata read hostname 'smithi007' 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b0277ac40 0x563b0277d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff4a5476740 4 client.38444 mds_command: new command op to 34526 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T15:43:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 --> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563b02655190 con 0x563b0277ac40 2024-04-23T15:43:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.241+0000 7ff49be00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b0277ac40 0x563b0277d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.246+0000 7ff489600640 10 client.38444 ms_handle_connect on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:49.246 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.246+0000 7ff49be00640 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b0277ac40 0x563b0277d060 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21295817be44660 server_cookie=500585c0f50bc578 in_seq=0 out_seq=0 2024-04-23T15:43:49.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:49 smithi007 ceph-mon[27906]: pgmap v1662: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 2.3 MiB/s wr, 523 op/s 2024-04-23T15:43:49.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:49 smithi186 ceph-mon[31814]: pgmap v1662: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 2.3 MiB/s wr, 523 op/s 2024-04-23T15:43:49.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:49 smithi137 ceph-mon[31694]: pgmap v1662: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 2.3 MiB/s wr, 523 op/s 2024-04-23T15:43:49.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.422+0000 7ff489600640 1 -- 172.21.15.7:0/1168072641 <== mds.0 v2:172.21.15.137:6838/174749197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563b02655190 con 0x563b0277ac40 2024-04-23T15:43:49.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.422+0000 7ff489600640 10 client.38444 handle_command_reply: tid=0 2024-04-23T15:43:49.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.422+0000 7ff4a5476740 1 client.38444 shutdown 2024-04-23T15:43:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.424+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 msgr2=0x563b026faad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.424+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 0x563b026faad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4940099e0 tx=0x7ff494007710 comp rx=0 tx=0).stop 2024-04-23T15:43:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.424+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 shutdown_connections 2024-04-23T15:43:49.424 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.424+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:6838/174749197,v1:172.21.15.137:6839/174749197] conn(0x563b0277ac40 0x563b0277d060 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.424+0000 7ff489600640 0 client.38444 ms_handle_reset on v2:172.21.15.137:6838/174749197 2024-04-23T15:43:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.424+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b026e7ce0 0x563b026faad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.425+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b026f25a0 0x563b026f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.425+0000 7ff4a5476740 1 --2- 172.21.15.7:0/1168072641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b026e73c0 0x563b026fa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.425+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 >> 172.21.15.7:0/1168072641 conn(0x563b026e38d0 msgr2=0x563b026ef5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.425+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 shutdown_connections 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.425+0000 7ff4a5476740 1 -- 172.21.15.7:0/1168072641 wait complete. 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.425+0000 7ff4a5476740 20 client.38444 trim_cache size 0 max 16384 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-04-23T15:43:49.426 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-04-23T15:43:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-04-23T15:43:49.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.426+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff4800a3e60 msgr2=0x7ff4800a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.426+0000 7ff4a1000640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff4800a3e60 0x7ff4800a6320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0ef3e0 tx=0x7ff48c0045f0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.426+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c102fc0 msgr2=0x7ff49c19d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.426+0000 7ff4a1000640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c102fc0 0x7ff49c19d050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff48c02a9c0 tx=0x7ff48c0052f0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.427+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 shutdown_connections 2024-04-23T15:43:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.427+0000 7ff4a1000640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7ff4800a3e60 0x7ff4800a6320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.427+0000 7ff4a1000640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49c10c3e0 0x7ff49c1961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.427+0000 7ff4a1000640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff49c1038e0 0x7ff49c19d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.427+0000 7ff4a1000640 1 --2- 172.21.15.7:0/805256749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff49c102fc0 0x7ff49c19d050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:49.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.427+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 >> 172.21.15.7:0/805256749 conn(0x7ff49c0fc820 msgr2=0x7ff49c10dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.428+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 shutdown_connections 2024-04-23T15:43:49.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-04-23T15:43:49.428+0000 7ff4a1000640 1 -- 172.21.15.7:0/805256749 wait complete. 2024-04-23T15:43:51.013 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T15:43:51.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T15:43:51.266 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-04-23T15:43:51.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T15:43:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:51 smithi007 ceph-mon[27906]: pgmap v1663: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 2.0 MiB/s wr, 461 op/s 2024-04-23T15:43:51.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:51 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:51 smithi186 ceph-mon[31814]: pgmap v1663: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 2.0 MiB/s wr, 461 op/s 2024-04-23T15:43:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:51 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:51 smithi137 ceph-mon[31694]: pgmap v1663: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 2.0 MiB/s wr, 461 op/s 2024-04-23T15:43:51.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:51 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:52.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:52 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:52.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:52 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:52.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:52 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:52.897 DEBUG:teuthology.parallel:result is None 2024-04-23T15:43:52.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T15:43:53.037 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T15:43:53.038 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-23T15:43:53.051 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T15:43:53.074 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-23T15:43:53.093 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-23T15:43:53.093 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T15:43:53.093 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T15:43:53.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-23T15:43:53.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:53 smithi007 ceph-mon[27906]: pgmap v1664: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 271 KiB/s wr, 116 op/s 2024-04-23T15:43:53.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:53 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:53.228 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-23T15:43:53.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-23T15:43:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:53 smithi186 ceph-mon[31814]: pgmap v1664: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 271 KiB/s wr, 116 op/s 2024-04-23T15:43:53.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:53 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:53.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:53 smithi137 ceph-mon[31694]: pgmap v1664: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 271 KiB/s wr, 116 op/s 2024-04-23T15:43:53.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:53 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 -- 172.21.15.7:0/3252959890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 msgr2=0x7fca3410ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 --2- 172.21.15.7:0/3252959890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca3410ef20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca3001acb0 tx=0x7fca3003b8e0 comp rx=0 tx=0).stop 2024-04-23T15:43:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 -- 172.21.15.7:0/3252959890 shutdown_connections 2024-04-23T15:43:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 --2- 172.21.15.7:0/3252959890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca34102c30 0x7fca34106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 --2- 172.21.15.7:0/3252959890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca3410ef20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 --2- 172.21.15.7:0/3252959890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca34102280 0x7fca34102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:53.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.633+0000 7fca3c800640 1 -- 172.21.15.7:0/3252959890 >> 172.21.15.7:0/3252959890 conn(0x7fca34079490 msgr2=0x7fca340798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:53.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.634+0000 7fca3c800640 1 -- 172.21.15.7:0/3252959890 shutdown_connections 2024-04-23T15:43:53.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.634+0000 7fca3c800640 1 -- 172.21.15.7:0/3252959890 wait complete. 2024-04-23T15:43:53.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.635+0000 7fca3c800640 1 Processor -- start 2024-04-23T15:43:53.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.635+0000 7fca3c800640 1 -- start start 2024-04-23T15:43:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca34102280 0x7fca34075aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3c800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca34074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3c800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca34074770 0x7fca34074bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3c800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fca3406e260 con 0x7fca34074770 2024-04-23T15:43:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca3406e0e0 con 0x7fca34102280 2024-04-23T15:43:53.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3c800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fca3406e3e0 con 0x7fca34107350 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca3a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca34074770 0x7fca34074bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca39400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca34074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca39e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca34102280 0x7fca34075aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca39400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca34074230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39476/0 (socket says 172.21.15.7:39476) 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.636+0000 7fca39400640 1 -- 172.21.15.7:0/938214170 learned_addr learned my addr 172.21.15.7:0/938214170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.637+0000 7fca39400640 1 -- 172.21.15.7:0/938214170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca34102280 msgr2=0x7fca34075aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.637+0000 7fca39400640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca34102280 0x7fca34075aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:53.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.637+0000 7fca39400640 1 -- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca34074770 msgr2=0x7fca34074bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.637+0000 7fca39400640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca34074770 0x7fca34074bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.637+0000 7fca39400640 1 -- 172.21.15.7:0/938214170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3419e7f0 con 0x7fca34107350 2024-04-23T15:43:53.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.638+0000 7fca39400640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca34074230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca2400c970 tx=0x7fca2400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.639+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24014070 con 0x7fca34107350 2024-04-23T15:43:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.639+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca24004440 con 0x7fca34107350 2024-04-23T15:43:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.639+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3419e9c0 con 0x7fca34107350 2024-04-23T15:43:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.639+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24003e20 con 0x7fca34107350 2024-04-23T15:43:53.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.640+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3419ef10 con 0x7fca34107350 2024-04-23T15:43:53.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.645+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3404fd90 con 0x7fca34107350 2024-04-23T15:43:53.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.647+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fca24017070 con 0x7fca34107350 2024-04-23T15:43:53.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.650+0000 7fca2ea00640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fca1c0a3f70 0x7fca1c0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:53.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.651+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7fca240d05b0 con 0x7fca34107350 2024-04-23T15:43:53.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.651+0000 7fca39e00640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fca1c0a3f70 0x7fca1c0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:53.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.654+0000 7fca39e00640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fca1c0a3f70 0x7fca1c0a6430 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fca28009bd0 tx=0x7fca28005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:53.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:53.656+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fca2401e030 con 0x7fca34107350 2024-04-23T15:43:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.085+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fca34102c90 con 0x7fca1c0a3f70 2024-04-23T15:43:54.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.148+0000 7fca2ea00640 1 -- 172.21.15.7:0/938214170 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fca34102c90 con 0x7fca1c0a3f70 2024-04-23T15:43:54.151 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-23T00:00:00", "created": "2024-04-23T14:51:21", "first": "2024-04-23T14:52:00", "last": "2024-04-23T15:43:06", "last_pruned": "2024-04-23T15:43:10", "created_count": 52, "pruned_count": 45, "active": true} 2024-04-23T15:43:54.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.153+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fca1c0a3f70 msgr2=0x7fca1c0a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.153+0000 7fca3c800640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fca1c0a3f70 0x7fca1c0a6430 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fca28009bd0 tx=0x7fca28005f90 comp rx=0 tx=0).stop 2024-04-23T15:43:54.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.153+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 msgr2=0x7fca34074230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.153+0000 7fca3c800640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca34074230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca2400c970 tx=0x7fca2400ce30 comp rx=0 tx=0).stop 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 shutdown_connections 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fca1c0a3f70 0x7fca1c0a6430 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca34074770 0x7fca34074bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca34107350 0x7fca34074230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 --2- 172.21.15.7:0/938214170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca34102280 0x7fca34075aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 >> 172.21.15.7:0/938214170 conn(0x7fca34079490 msgr2=0x7fca340ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 shutdown_connections 2024-04-23T15:43:54.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.156+0000 7fca3c800640 1 -- 172.21.15.7:0/938214170 wait complete. 2024-04-23T15:43:54.184 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-23T15:43:54.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.458+0000 7fb130200640 1 -- 172.21.15.7:0/3117459455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb128110bd0 msgr2=0x7fb128109540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.458+0000 7fb130200640 1 --2- 172.21.15.7:0/3117459455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb128110bd0 0x7fb128109540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb114009900 tx=0x7fb11402a480 comp rx=0 tx=0).stop 2024-04-23T15:43:54.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.459+0000 7fb130200640 1 -- 172.21.15.7:0/3117459455 shutdown_connections 2024-04-23T15:43:54.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.459+0000 7fb130200640 1 --2- 172.21.15.7:0/3117459455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb12811b7e0 0x7fb12811dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.459+0000 7fb130200640 1 --2- 172.21.15.7:0/3117459455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb128110bd0 0x7fb128109540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.459+0000 7fb130200640 1 --2- 172.21.15.7:0/3117459455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1281107f0 0x7fb128109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.459+0000 7fb130200640 1 -- 172.21.15.7:0/3117459455 >> 172.21.15.7:0/3117459455 conn(0x7fb12806d0d0 msgr2=0x7fb12806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:54.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.459+0000 7fb130200640 1 -- 172.21.15.7:0/3117459455 shutdown_connections 2024-04-23T15:43:54.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.460+0000 7fb130200640 1 -- 172.21.15.7:0/3117459455 wait complete. 2024-04-23T15:43:54.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.461+0000 7fb130200640 1 Processor -- start 2024-04-23T15:43:54.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.461+0000 7fb130200640 1 -- start start 2024-04-23T15:43:54.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.462+0000 7fb130200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 0x7fb1281a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:54.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.462+0000 7fb130200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb12811b7e0 0x7fb1281a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.462+0000 7fb130200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1281abee0 0x7fb1281ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.462+0000 7fb130200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb128121160 con 0x7fb12811b7e0 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.462+0000 7fb130200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb128120fe0 con 0x7fb1281abee0 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.462+0000 7fb130200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb1281212e0 con 0x7fb1281107f0 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 0x7fb1281a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 0x7fb1281a7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39500/0 (socket says 172.21.15.7:39500) 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12d800640 1 -- 172.21.15.7:0/1269480366 learned_addr learned my addr 172.21.15.7:0/1269480366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12e200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1281abee0 0x7fb1281ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12d800640 1 -- 172.21.15.7:0/1269480366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1281abee0 msgr2=0x7fb1281ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12d800640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1281abee0 0x7fb1281ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.463+0000 7fb12d800640 1 -- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb12811b7e0 msgr2=0x7fb1281a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.464+0000 7fb12ce00640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb12811b7e0 0x7fb1281a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.464+0000 7fb12d800640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb12811b7e0 0x7fb1281a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.464+0000 7fb12d800640 1 -- 172.21.15.7:0/1269480366 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1281ac9d0 con 0x7fb1281107f0 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.464+0000 7fb12ce00640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb12811b7e0 0x7fb1281a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.464+0000 7fb12d800640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 0x7fb1281a7620 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb12000ebc0 tx=0x7fb12000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.465+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120010630 con 0x7fb1281107f0 2024-04-23T15:43:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.465+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb120010c80 con 0x7fb1281107f0 2024-04-23T15:43:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.465+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120018b30 con 0x7fb1281107f0 2024-04-23T15:43:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.465+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1281accc0 con 0x7fb1281107f0 2024-04-23T15:43:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.465+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1281b4460 con 0x7fb1281107f0 2024-04-23T15:43:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.467+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12804fd90 con 0x7fb1281107f0 2024-04-23T15:43:54.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.470+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb120018cd0 con 0x7fb1281107f0 2024-04-23T15:43:54.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.471+0000 7fb126000640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1100a3e40 0x7fb1100a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:54.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.472+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7fb1200d12b0 con 0x7fb1281107f0 2024-04-23T15:43:54.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.475+0000 7fb12ce00640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1100a3e40 0x7fb1100a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:54.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.476+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb12009ce50 con 0x7fb1281107f0 2024-04-23T15:43:54.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.479+0000 7fb12ce00640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1100a3e40 0x7fb1100a6300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb114005ab0 tx=0x7fb114000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.900+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 --> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb128110d90 con 0x7fb1100a3e40 2024-04-23T15:43:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.947+0000 7fb126000640 1 -- 172.21.15.7:0/1269480366 <== mgr.15528 v2:172.21.15.7:6800/4082524202 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb128110d90 con 0x7fb1100a3e40 2024-04-23T15:43:54.948 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-04-23T15:43:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.949+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1100a3e40 msgr2=0x7fb1100a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.949+0000 7fb130200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1100a3e40 0x7fb1100a6300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb114005ab0 tx=0x7fb114000bc0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.949+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 msgr2=0x7fb1281a7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:54.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.949+0000 7fb130200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 0x7fb1281a7620 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb12000ebc0 tx=0x7fb12000c6a0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 shutdown_connections 2024-04-23T15:43:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb1100a3e40 0x7fb1100a6300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1281abee0 0x7fb1281ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb12811b7e0 0x7fb1281a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 --2- 172.21.15.7:0/1269480366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1281107f0 0x7fb1281a7620 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 >> 172.21.15.7:0/1269480366 conn(0x7fb12806d0d0 msgr2=0x7fb12810e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 shutdown_connections 2024-04-23T15:43:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:54.953+0000 7fb130200640 1 -- 172.21.15.7:0/1269480366 wait complete. 2024-04-23T15:43:54.982 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-23T15:43:54.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:43:55.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 -- 172.21.15.7:0/3954143225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4109230 msgr2=0x7fd9c4109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3954143225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4109230 0x7fd9c4109610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009930 tx=0x7fd9b402a420 comp rx=0 tx=0).stop 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 -- 172.21.15.7:0/3954143225 shutdown_connections 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3954143225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109b50 0x7fd9c4114c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3954143225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9c4115150 0x7fd9c4117540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3954143225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4109230 0x7fd9c4109610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 -- 172.21.15.7:0/3954143225 >> 172.21.15.7:0/3954143225 conn(0x7fd9c406d120 msgr2=0x7fd9c406d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 -- 172.21.15.7:0/3954143225 shutdown_connections 2024-04-23T15:43:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.267+0000 7fd9cae00640 1 -- 172.21.15.7:0/3954143225 wait complete. 2024-04-23T15:43:55.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.268+0000 7fd9cae00640 1 Processor -- start 2024-04-23T15:43:55.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 -- start start 2024-04-23T15:43:55.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109230 0x7fd9c41a3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9c4109b50 0x7fd9c41a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 0x7fd9c41a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c411aaa0 con 0x7fd9c4109b50 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c411a920 con 0x7fd9c4109230 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.269+0000 7fd9cae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c411ac20 con 0x7fd9c4115150 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 0x7fd9c41a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109230 0x7fd9c41a3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 0x7fd9c41a7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39530/0 (socket says 172.21.15.7:39530) 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 -- 172.21.15.7:0/3192428130 learned_addr learned my addr 172.21.15.7:0/3192428130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c3e00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109230 0x7fd9c41a3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:49616/0 (socket says 172.21.15.7:49616) 2024-04-23T15:43:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 -- 172.21.15.7:0/3192428130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109230 msgr2=0x7fd9c41a3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109230 0x7fd9c41a3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 -- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9c4109b50 msgr2=0x7fd9c41a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9c4109b50 0x7fd9c41a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.270+0000 7fd9c8e00640 1 -- 172.21.15.7:0/3192428130 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c41a8250 con 0x7fd9c4115150 2024-04-23T15:43:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.271+0000 7fd9c8e00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 0x7fd9c41a7b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00eb40 tx=0x7fd9bc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.271+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc004b20 con 0x7fd9c4115150 2024-04-23T15:43:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.271+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9bc004cc0 con 0x7fd9c4115150 2024-04-23T15:43:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.271+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0107b0 con 0x7fd9c4115150 2024-04-23T15:43:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.271+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c41a8540 con 0x7fd9c4115150 2024-04-23T15:43:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.272+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c41afdd0 con 0x7fd9c4115150 2024-04-23T15:43:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.276+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c4068e20 con 0x7fd9c4115150 2024-04-23T15:43:55.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.283+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd9bc005020 con 0x7fd9c4115150 2024-04-23T15:43:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.286+0000 7fd9c0c00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9a80a3e70 0x7fd9a80a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.286+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7fd9bc0d1860 con 0x7fd9c4115150 2024-04-23T15:43:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.286+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd9bc100070 con 0x7fd9c4115150 2024-04-23T15:43:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.286+0000 7fd9c3e00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9a80a3e70 0x7fd9a80a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.290+0000 7fd9c3e00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9a80a3e70 0x7fd9a80a6330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4031440 tx=0x7fd9b4005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:55.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:55 smithi007 ceph-mon[27906]: pgmap v1665: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 388 KiB/s wr, 161 op/s 2024-04-23T15:43:55.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:55 smithi007 ceph-mon[27906]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:55.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:55 smithi007 ceph-mon[27906]: from='client.28588 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:43:55.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:55 smithi186 ceph-mon[31814]: pgmap v1665: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 388 KiB/s wr, 161 op/s 2024-04-23T15:43:55.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:55 smithi186 ceph-mon[31814]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:55.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:55 smithi186 ceph-mon[31814]: from='client.28588 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:43:55.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:55 smithi137 ceph-mon[31694]: pgmap v1665: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 388 KiB/s wr, 161 op/s 2024-04-23T15:43:55.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:55 smithi137 ceph-mon[31694]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T15:43:55.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:55 smithi137 ceph-mon[31694]: from='client.28588 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:43:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.628+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9c41b0130 con 0x7fd9c4115150 2024-04-23T15:43:55.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.631+0000 7fd9c0c00640 1 -- 172.21.15.7:0/3192428130 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) ==== 74+0+25572 (secure 0 0 0) 0x7fd9bc09dad0 con 0x7fd9c4115150 2024-04-23T15:43:55.635 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:43:55.635 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":180,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T15:43:46.425673+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":98,"snap_epoch":179,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":98,"snap_epoch":179,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/53488990":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3733281875":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3240450123":"2024-04-24T14:51:20.179514+0000","172.21.15.7:6801/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3573875988":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":90,"length":1},{"begin":92,"length":1},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1}]},{"pool":4,"snaps":[{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":90,"length":1},{"begin":92,"length":1},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:43:55.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9a80a3e70 msgr2=0x7fd9a80a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9a80a3e70 0x7fd9a80a6330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4031440 tx=0x7fd9b4005a20 comp rx=0 tx=0).stop 2024-04-23T15:43:55.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 msgr2=0x7fd9c41a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 0x7fd9c41a7b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00eb40 tx=0x7fd9bc00c2d0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 shutdown_connections 2024-04-23T15:43:55.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd9a80a3e70 0x7fd9a80a6330 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9c4115150 0x7fd9c41a7b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9c4109b50 0x7fd9c41a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 --2- 172.21.15.7:0/3192428130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c4109230 0x7fd9c41a3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 >> 172.21.15.7:0/3192428130 conn(0x7fd9c406d120 msgr2=0x7fd9c410aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 shutdown_connections 2024-04-23T15:43:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.635+0000 7fd9cae00640 1 -- 172.21.15.7:0/3192428130 wait complete. 2024-04-23T15:43:55.660 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 98, 'snap_epoch': 179, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 98, 'snap_epoch': 179, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T15:43:55.660 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T15:43:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.959+0000 7f4cc0a00640 1 -- 172.21.15.7:0/2812803672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc101770 msgr2=0x7f4cbc105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.959+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/2812803672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc101770 0x7f4cbc105c30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009900 tx=0x7f4cac02a4a0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.960+0000 7f4cc0a00640 1 -- 172.21.15.7:0/2812803672 shutdown_connections 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.960+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/2812803672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc101770 0x7f4cbc105c30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.960+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/2812803672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cbc106250 0x7f4cbc1066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.960+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/2812803672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc100e50 0x7f4cbc101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.960+0000 7f4cc0a00640 1 -- 172.21.15.7:0/2812803672 >> 172.21.15.7:0/2812803672 conn(0x7f4cbc0fc880 msgr2=0x7f4cbc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.961+0000 7f4cc0a00640 1 -- 172.21.15.7:0/2812803672 shutdown_connections 2024-04-23T15:43:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.961+0000 7f4cc0a00640 1 -- 172.21.15.7:0/2812803672 wait complete. 2024-04-23T15:43:55.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.962+0000 7f4cc0a00640 1 Processor -- start 2024-04-23T15:43:55.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.962+0000 7f4cc0a00640 1 -- start start 2024-04-23T15:43:55.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.963+0000 7f4cc0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cbc100e50 0x7f4cbc19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.963+0000 7f4cc0a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 0x7f4cbc19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.963+0000 7f4cc0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc106250 0x7f4cbc1a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.963+0000 7f4cc0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc118790 con 0x7f4cbc100e50 2024-04-23T15:43:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.963+0000 7f4cc0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc118610 con 0x7f4cbc106250 2024-04-23T15:43:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.963+0000 7f4cc0a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc118910 con 0x7f4cbc101770 2024-04-23T15:43:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbaa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 0x7f4cbc19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbaa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 0x7f4cbc19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.7:39540/0 (socket says 172.21.15.7:39540) 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbaa00640 1 -- 172.21.15.7:0/4094446026 learned_addr learned my addr 172.21.15.7:0/4094446026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc106250 0x7f4cbc1a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbbe00640 1 -- 172.21.15.7:0/4094446026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 msgr2=0x7f4cbc19f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 0x7f4cbc19f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbbe00640 1 -- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cbc100e50 msgr2=0x7f4cbc19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cbc100e50 0x7f4cbc19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbbe00640 1 -- 172.21.15.7:0/4094446026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc1a3d40 con 0x7f4cbc106250 2024-04-23T15:43:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.964+0000 7f4cbaa00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 0x7f4cbc19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:43:55.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.967+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc106250 0x7f4cbc1a3610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009fd0 tx=0x7f4cb400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:55.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.967+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400ce20 con 0x7f4cbc106250 2024-04-23T15:43:55.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.967+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4cb4005020 con 0x7f4cbc106250 2024-04-23T15:43:55.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.967+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4010690 con 0x7f4cbc106250 2024-04-23T15:43:55.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.967+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc1a4030 con 0x7f4cbc106250 2024-04-23T15:43:55.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.967+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc1ab8c0 con 0x7f4cbc106250 2024-04-23T15:43:55.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.969+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc068d40 con 0x7f4cbc106250 2024-04-23T15:43:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.972+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f4cb40051d0 con 0x7f4cbc106250 2024-04-23T15:43:55.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.975+0000 7f4cb3e00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4ca00a3e70 0x7f4ca00a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:55.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.975+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7f4cb40d1910 con 0x7f4cbc106250 2024-04-23T15:43:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.976+0000 7f4cbb400640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4ca00a3e70 0x7f4ca00a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:55.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.980+0000 7f4cbb400640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4ca00a3e70 0x7f4ca00a6330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80096f0 tx=0x7f4ca8006c40 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:55.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:55.987+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4cb409db80 con 0x7f4cbc106250 2024-04-23T15:43:56.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.360+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cbc1abb50 con 0x7f4cbc106250 2024-04-23T15:43:56.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:56 smithi186 ceph-mon[31814]: from='client.28594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:43:56.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:56 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3192428130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:43:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.364+0000 7f4cb3e00640 1 -- 172.21.15.7:0/4094446026 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) ==== 93+0+10 (secure 0 0 0) 0x7f4cb409d480 con 0x7f4cbc106250 2024-04-23T15:43:56.364 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.367+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4ca00a3e70 msgr2=0x7f4ca00a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.367+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4ca00a3e70 0x7f4ca00a6330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80096f0 tx=0x7f4ca8006c40 comp rx=0 tx=0).stop 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.367+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc106250 msgr2=0x7f4cbc1a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.367+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc106250 0x7f4cbc1a3610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009fd0 tx=0x7f4cb400ef10 comp rx=0 tx=0).stop 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 shutdown_connections 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f4ca00a3e70 0x7f4ca00a6330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc106250 0x7f4cbc1a3610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cbc101770 0x7f4cbc19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 --2- 172.21.15.7:0/4094446026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cbc100e50 0x7f4cbc19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 >> 172.21.15.7:0/4094446026 conn(0x7f4cbc0fc880 msgr2=0x7f4cbc0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:56.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 shutdown_connections 2024-04-23T15:43:56.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.368+0000 7f4cc0a00640 1 -- 172.21.15.7:0/4094446026 wait complete. 2024-04-23T15:43:56.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:56 smithi007 ceph-mon[27906]: from='client.28594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:43:56.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:56 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3192428130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:43:56.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T15:43:56.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:56 smithi137 ceph-mon[31694]: from='client.28594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:43:56.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:56 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3192428130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:43:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.691+0000 7f40b4600640 1 -- 172.21.15.7:0/1149190702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 msgr2=0x7f40ac11dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:56.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.691+0000 7f40b4600640 1 --2- 172.21.15.7:0/1149190702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 0x7f40ac11dbd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009be0 tx=0x7f40a402a710 comp rx=0 tx=0).stop 2024-04-23T15:43:56.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.692+0000 7f40b4600640 1 -- 172.21.15.7:0/1149190702 shutdown_connections 2024-04-23T15:43:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.692+0000 7f40b4600640 1 --2- 172.21.15.7:0/1149190702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac10ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.692+0000 7f40b4600640 1 --2- 172.21.15.7:0/1149190702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 0x7f40ac11dbd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.692+0000 7f40b4600640 1 --2- 172.21.15.7:0/1149190702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ac110850 0x7f40ac10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.692+0000 7f40b4600640 1 -- 172.21.15.7:0/1149190702 >> 172.21.15.7:0/1149190702 conn(0x7f40ac06d110 msgr2=0x7f40ac06d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:56.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.694+0000 7f40b4600640 1 -- 172.21.15.7:0/1149190702 shutdown_connections 2024-04-23T15:43:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.694+0000 7f40b4600640 1 -- 172.21.15.7:0/1149190702 wait complete. 2024-04-23T15:43:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.696+0000 7f40b4600640 1 Processor -- start 2024-04-23T15:43:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.696+0000 7f40b4600640 1 -- start start 2024-04-23T15:43:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.696+0000 7f40b4600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac11ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.696+0000 7f40b4600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ac110850 0x7f40ac11b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.696+0000 7f40b4600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 0x7f40ac117020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b4600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac113800 con 0x7f40ac110850 2024-04-23T15:43:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b4600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac113680 con 0x7f40ac10e880 2024-04-23T15:43:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b4600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac113980 con 0x7f40ac11b7e0 2024-04-23T15:43:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac11ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac11ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:49640/0 (socket says 172.21.15.7:49640) 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 -- 172.21.15.7:0/819115664 learned_addr learned my addr 172.21.15.7:0/819115664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1200640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ac110850 0x7f40ac11b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b2600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 0x7f40ac117020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 -- 172.21.15.7:0/819115664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 msgr2=0x7f40ac117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 0x7f40ac117020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 -- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ac110850 msgr2=0x7f40ac11b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ac110850 0x7f40ac11b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.697+0000 7f40b1c00640 1 -- 172.21.15.7:0/819115664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac1178e0 con 0x7f40ac10e880 2024-04-23T15:43:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.698+0000 7f40b1c00640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac11ad60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a000d950 tx=0x7f40a000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.698+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0017070 con 0x7f40ac10e880 2024-04-23T15:43:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.698+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40a0009c30 con 0x7f40ac10e880 2024-04-23T15:43:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.698+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac117bd0 con 0x7f40ac10e880 2024-04-23T15:43:56.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.698+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a000f620 con 0x7f40ac10e880 2024-04-23T15:43:56.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.699+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac1ab860 con 0x7f40ac10e880 2024-04-23T15:43:56.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.700+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ac06e3b0 con 0x7f40ac10e880 2024-04-23T15:43:56.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.705+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f40a00109a0 con 0x7f40ac10e880 2024-04-23T15:43:56.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.709+0000 7f40aa000640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40940a3de0 0x7f40940a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:56.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.710+0000 7f40b1200640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40940a3de0 0x7f40940a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.711+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7f40a00d07a0 con 0x7f40ac10e880 2024-04-23T15:43:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.712+0000 7f40b1200640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40940a3de0 0x7f40940a62a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f40ac1185b0 tx=0x7f409801c3a0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:56.713+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f40a0009de0 con 0x7f40ac10e880 2024-04-23T15:43:57.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.088+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f40ac02d620 con 0x7f40ac10e880 2024-04-23T15:43:57.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.088+0000 7f40aa000640 1 -- 172.21.15.7:0/819115664 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) ==== 104+0+11 (secure 0 0 0) 0x7f40a009c340 con 0x7f40ac10e880 2024-04-23T15:43:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40940a3de0 msgr2=0x7f40940a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40940a3de0 0x7f40940a62a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f40ac1185b0 tx=0x7f409801c3a0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 msgr2=0x7f40ac11ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac11ad60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a000d950 tx=0x7f40a000de10 comp rx=0 tx=0).stop 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 shutdown_connections 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f40940a3de0 0x7f40940a62a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40ac11b7e0 0x7f40ac117020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ac110850 0x7f40ac11b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 --2- 172.21.15.7:0/819115664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac10e880 0x7f40ac11ad60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 >> 172.21.15.7:0/819115664 conn(0x7f40ac06d110 msgr2=0x7f40ac11d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:57.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 shutdown_connections 2024-04-23T15:43:57.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.092+0000 7f40b4600640 1 -- 172.21.15.7:0/819115664 wait complete. 2024-04-23T15:43:57.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T15:43:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:57 smithi186 ceph-mon[31814]: pgmap v1666: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 393 KiB/s wr, 233 op/s 2024-04-23T15:43:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:57 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4094446026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:43:57.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:57 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/819115664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:43:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.412+0000 7fc315600640 1 -- 172.21.15.7:0/169209465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310106fe0 msgr2=0x7fc3101073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.412+0000 7fc315600640 1 --2- 172.21.15.7:0/169209465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310106fe0 0x7fc3101073c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc300009900 tx=0x7fc30002a3f0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 -- 172.21.15.7:0/169209465 shutdown_connections 2024-04-23T15:43:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 --2- 172.21.15.7:0/169209465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100ed0 0x7fc310104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 --2- 172.21.15.7:0/169209465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc310100510 0x7fc310100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 --2- 172.21.15.7:0/169209465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310106fe0 0x7fc3101073c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 -- 172.21.15.7:0/169209465 >> 172.21.15.7:0/169209465 conn(0x7fc3100774a0 msgr2=0x7fc3100fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 -- 172.21.15.7:0/169209465 shutdown_connections 2024-04-23T15:43:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.413+0000 7fc315600640 1 -- 172.21.15.7:0/169209465 wait complete. 2024-04-23T15:43:57.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.415+0000 7fc315600640 1 Processor -- start 2024-04-23T15:43:57.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.415+0000 7fc315600640 1 -- start start 2024-04-23T15:43:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.416+0000 7fc315600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100510 0x7fc3100737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.416+0000 7fc315600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 0x7fc310073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.416+0000 7fc315600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc310106fe0 0x7fc31006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.416+0000 7fc315600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc310118900 con 0x7fc310106fe0 2024-04-23T15:43:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.416+0000 7fc315600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc310118780 con 0x7fc310100ed0 2024-04-23T15:43:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.416+0000 7fc315600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc310118a80 con 0x7fc310100510 2024-04-23T15:43:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 0x7fc310073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 0x7fc310073cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:49668/0 (socket says 172.21.15.7:49668) 2024-04-23T15:43:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 -- 172.21.15.7:0/3310877746 learned_addr learned my addr 172.21.15.7:0/3310877746 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100510 0x7fc3100737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:57.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:57 smithi137 ceph-mon[31694]: pgmap v1666: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 393 KiB/s wr, 233 op/s 2024-04-23T15:43:57.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:57 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4094446026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:43:57.419 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:57 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/819115664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:43:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 -- 172.21.15.7:0/3310877746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100510 msgr2=0x7fc3100737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100510 0x7fc3100737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 -- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc310106fe0 msgr2=0x7fc31006c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.417+0000 7fc30e000640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc310106fe0 0x7fc31006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.418+0000 7fc30e000640 1 -- 172.21.15.7:0/3310877746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31006d2b0 con 0x7fc310100ed0 2024-04-23T15:43:57.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.418+0000 7fc30ea00640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100510 0x7fc3100737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:43:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.420+0000 7fc30e000640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 0x7fc310073cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00d950 tx=0x7fc2fc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:57.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.420+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc017070 con 0x7fc310100ed0 2024-04-23T15:43:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.420+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2fc009c30 con 0x7fc310100ed0 2024-04-23T15:43:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.420+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc017070 con 0x7fc310100ed0 2024-04-23T15:43:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.422+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31006d5a0 con 0x7fc310100ed0 2024-04-23T15:43:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.422+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc310071570 con 0x7fc310100ed0 2024-04-23T15:43:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.426+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc310101520 con 0x7fc310100ed0 2024-04-23T15:43:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.432+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc2fc010460 con 0x7fc310100ed0 2024-04-23T15:43:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.434+0000 7fc307400640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2f40a4020 0x7fc2f40a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.434+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7fc2fc0d0590 con 0x7fc310100ed0 2024-04-23T15:43:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.435+0000 7fc30ea00640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2f40a4020 0x7fc2f40a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:57.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.437+0000 7fc30ea00640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2f40a4020 0x7fc2f40a64e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc300009230 tx=0x7fc300005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.442+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc2fc09c720 con 0x7fc310100ed0 2024-04-23T15:43:57.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:57 smithi007 ceph-mon[27906]: pgmap v1666: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 393 KiB/s wr, 233 op/s 2024-04-23T15:43:57.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:57 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4094446026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:43:57.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:57 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/819115664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:43:57.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.814+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc3100718a0 con 0x7fc310100ed0 2024-04-23T15:43:57.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.815+0000 7fc307400640 1 -- 172.21.15.7:0/3310877746 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) ==== 100+0+11 (secure 0 0 0) 0x7fc2fc09c020 con 0x7fc310100ed0 2024-04-23T15:43:57.816 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T15:43:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2f40a4020 msgr2=0x7fc2f40a64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2f40a4020 0x7fc2f40a64e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc300009230 tx=0x7fc300005a20 comp rx=0 tx=0).stop 2024-04-23T15:43:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 msgr2=0x7fc310073cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 0x7fc310073cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00d950 tx=0x7fc2fc00de10 comp rx=0 tx=0).stop 2024-04-23T15:43:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 shutdown_connections 2024-04-23T15:43:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc2f40a4020 0x7fc2f40a64e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc310100ed0 0x7fc310073cf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc310106fe0 0x7fc31006c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.819+0000 7fc315600640 1 --2- 172.21.15.7:0/3310877746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc310100510 0x7fc3100737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.820+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 >> 172.21.15.7:0/3310877746 conn(0x7fc3100774a0 msgr2=0x7fc310102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.820+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 shutdown_connections 2024-04-23T15:43:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:57.820+0000 7fc315600640 1 -- 172.21.15.7:0/3310877746 wait complete. 2024-04-23T15:43:57.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T15:43:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.132+0000 7fd38a800640 1 -- 172.21.15.7:0/1662192483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384101140 msgr2=0x7fd384101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.132+0000 7fd38a800640 1 --2- 172.21.15.7:0/1662192483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384101140 0x7fd384101520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd374009900 tx=0x7fd37402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 -- 172.21.15.7:0/1662192483 shutdown_connections 2024-04-23T15:43:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 --2- 172.21.15.7:0/1662192483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101af0 0x7fd384105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 --2- 172.21.15.7:0/1662192483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd384106210 0x7fd38410dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 --2- 172.21.15.7:0/1662192483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384101140 0x7fd384101520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 -- 172.21.15.7:0/1662192483 >> 172.21.15.7:0/1662192483 conn(0x7fd384078000 msgr2=0x7fd384078410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 -- 172.21.15.7:0/1662192483 shutdown_connections 2024-04-23T15:43:58.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.133+0000 7fd38a800640 1 -- 172.21.15.7:0/1662192483 wait complete. 2024-04-23T15:43:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.134+0000 7fd38a800640 1 Processor -- start 2024-04-23T15:43:58.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.135+0000 7fd38a800640 1 -- start start 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd38a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101140 0x7fd384196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd38a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384106210 0x7fd384196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd38a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd38419aef0 0x7fd38419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd38a800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3841100b0 con 0x7fd38419aef0 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd38a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd38410ff30 con 0x7fd384101140 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd38a800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd384110230 con 0x7fd384106210 2024-04-23T15:43:58.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.136+0000 7fd383400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101140 0x7fd384196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.137+0000 7fd383400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101140 0x7fd384196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:49694/0 (socket says 172.21.15.7:49694) 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.137+0000 7fd383400640 1 -- 172.21.15.7:0/1861716699 learned_addr learned my addr 172.21.15.7:0/1861716699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.137+0000 7fd382a00640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384106210 0x7fd384196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.137+0000 7fd383e00640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd38419aef0 0x7fd38419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.138+0000 7fd382a00640 1 -- 172.21.15.7:0/1861716699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101140 msgr2=0x7fd384196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.138+0000 7fd382a00640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101140 0x7fd384196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.138+0000 7fd382a00640 1 -- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd38419aef0 msgr2=0x7fd38419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.138+0000 7fd382a00640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd38419aef0 0x7fd38419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.138+0000 7fd382a00640 1 -- 172.21.15.7:0/1861716699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38419b9e0 con 0x7fd384106210 2024-04-23T15:43:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.139+0000 7fd382a00640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384106210 0x7fd384196b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd37000e9c0 tx=0x7fd37000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.139+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37000ccc0 con 0x7fd384106210 2024-04-23T15:43:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.139+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd370005020 con 0x7fd384106210 2024-04-23T15:43:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.139+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38419bcd0 con 0x7fd384106210 2024-04-23T15:43:58.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.139+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370004a00 con 0x7fd384106210 2024-04-23T15:43:58.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.139+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3841a34c0 con 0x7fd384106210 2024-04-23T15:43:58.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.141+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd364005290 con 0x7fd384106210 2024-04-23T15:43:58.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.145+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fd370004ba0 con 0x7fd384106210 2024-04-23T15:43:58.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.147+0000 7fd37be00640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd3680a3d80 0x7fd3680a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.148+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7fd3700d0b00 con 0x7fd384106210 2024-04-23T15:43:58.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.149+0000 7fd383400640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd3680a3d80 0x7fd3680a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.150+0000 7fd383400640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd3680a3d80 0x7fd3680a6240 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd3740096c0 tx=0x7fd374005a20 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.151+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd37009ccf0 con 0x7fd384106210 2024-04-23T15:43:58.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:58 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3310877746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:43:58.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:58 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3310877746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:43:58.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.539+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd364005850 con 0x7fd384106210 2024-04-23T15:43:58.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.539+0000 7fd37be00640 1 -- 172.21.15.7:0/1861716699 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v180) ==== 103+0+11 (secure 0 0 0) 0x7fd37009c5f0 con 0x7fd384106210 2024-04-23T15:43:58.540 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T15:43:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.542+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd3680a3d80 msgr2=0x7fd3680a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.542+0000 7fd38a800640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd3680a3d80 0x7fd3680a6240 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd3740096c0 tx=0x7fd374005a20 comp rx=0 tx=0).stop 2024-04-23T15:43:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.542+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384106210 msgr2=0x7fd384196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.542+0000 7fd38a800640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384106210 0x7fd384196b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd37000e9c0 tx=0x7fd37000ee80 comp rx=0 tx=0).stop 2024-04-23T15:43:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 shutdown_connections 2024-04-23T15:43:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fd3680a3d80 0x7fd3680a6240 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd38419aef0 0x7fd38419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd384106210 0x7fd384196b70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 --2- 172.21.15.7:0/1861716699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384101140 0x7fd384196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 >> 172.21.15.7:0/1861716699 conn(0x7fd384078000 msgr2=0x7fd3840ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:58.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 shutdown_connections 2024-04-23T15:43:58.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.543+0000 7fd38a800640 1 -- 172.21.15.7:0/1861716699 wait complete. 2024-04-23T15:43:58.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:58 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3310877746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:43:58.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 -- 172.21.15.7:0/805110604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c109510 msgr2=0x7fc74c1110e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 --2- 172.21.15.7:0/805110604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c109510 0x7fc74c1110e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc744009ca0 tx=0x7fc74402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 -- 172.21.15.7:0/805110604 shutdown_connections 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 --2- 172.21.15.7:0/805110604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104df0 0x7fc74c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 --2- 172.21.15.7:0/805110604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c109510 0x7fc74c1110e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 --2- 172.21.15.7:0/805110604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c104440 0x7fc74c104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 -- 172.21.15.7:0/805110604 >> 172.21.15.7:0/805110604 conn(0x7fc74c0ffcc0 msgr2=0x7fc74c1020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.857+0000 7fc752600640 1 -- 172.21.15.7:0/805110604 shutdown_connections 2024-04-23T15:43:58.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.858+0000 7fc752600640 1 -- 172.21.15.7:0/805110604 wait complete. 2024-04-23T15:43:58.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.859+0000 7fc752600640 1 Processor -- start 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.859+0000 7fc752600640 1 -- start start 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.860+0000 7fc752600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104440 0x7fc74c0738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.860+0000 7fc752600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c109510 0x7fc74c071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.860+0000 7fc752600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c071970 0x7fc74c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.860+0000 7fc752600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c114460 con 0x7fc74c109510 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.860+0000 7fc752600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c1142e0 con 0x7fc74c104440 2024-04-23T15:43:58.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.860+0000 7fc752600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c1145e0 con 0x7fc74c071970 2024-04-23T15:43:58.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc743e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c109510 0x7fc74c071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc743e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c109510 0x7fc74c071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51304/0 (socket says 172.21.15.7:51304) 2024-04-23T15:43:58.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc743e00640 1 -- 172.21.15.7:0/3350141491 learned_addr learned my addr 172.21.15.7:0/3350141491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:43:58.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc74b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104440 0x7fc74c0738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc74be00640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c071970 0x7fc74c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc74b400640 1 -- 172.21.15.7:0/3350141491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c071970 msgr2=0x7fc74c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc74b400640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c071970 0x7fc74c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.861+0000 7fc74b400640 1 -- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c109510 msgr2=0x7fc74c071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:43:58.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.862+0000 7fc74b400640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c109510 0x7fc74c071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:43:58.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.862+0000 7fc74b400640 1 -- 172.21.15.7:0/3350141491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74c06caa0 con 0x7fc74c104440 2024-04-23T15:43:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.862+0000 7fc74b400640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104440 0x7fc74c0738e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00d6d0 tx=0x7fc73c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.863+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c017070 con 0x7fc74c104440 2024-04-23T15:43:58.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.863+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc73c009820 con 0x7fc74c104440 2024-04-23T15:43:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.863+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74c06cd90 con 0x7fc74c104440 2024-04-23T15:43:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.863+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c004c40 con 0x7fc74c104440 2024-04-23T15:43:58.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.864+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74c06d270 con 0x7fc74c104440 2024-04-23T15:43:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.866+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74c069270 con 0x7fc74c104440 2024-04-23T15:43:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.868+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fc73c005220 con 0x7fc74c104440 2024-04-23T15:43:58.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.870+0000 7fc748c00640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc7300a3de0 0x7fc7300a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:43:58.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.870+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9723+0+0 (secure 0 0 0) 0x7fc73c0d0780 con 0x7fc74c104440 2024-04-23T15:43:58.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.872+0000 7fc743e00640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc7300a3de0 0x7fc7300a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:43:58.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.873+0000 7fc743e00640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc7300a3de0 0x7fc7300a62a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc74c1000e0 tx=0x7fc73400b480 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:43:58.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:58.878+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc73c09c970 con 0x7fc74c104440 2024-04-23T15:43:59.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.362+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc74c10c740 con 0x7fc74c104440 2024-04-23T15:43:59.362 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:59 smithi186 ceph-mon[31814]: pgmap v1667: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 361 KiB/s wr, 260 op/s 2024-04-23T15:43:59.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:43:59 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1861716699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:43:59.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.386+0000 7fc748c00640 1 -- 172.21.15.7:0/3350141491 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+746052 (secure 0 0 0) 0x7fc73c09c270 con 0x7fc74c104440 2024-04-23T15:43:59.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:43:59.398 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T15:43:59.398 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 26, 2024-04-23T15:43:59.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "active_gid": 15528, 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "active_name": "x", 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addrs": { 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4082524202 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4082524202 2024-04-23T15:43:59.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addr": "172.21.15.7:6801/4082524202", 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "active_change": "2024-04-23T14:51:20.180045+0000", 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "active_mgr_features": 4540701547738038271, 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "available": true, 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "standbys": [ 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 25156, 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540701547738038271, 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.402 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-04-23T15:43:59.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-04-23T15:43:59.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-04-23T15:43:59.414 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T15:43:59.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-04-23T15:43:59.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.425 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-04-23T15:43:59.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.433 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-04-23T15:43:59.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-04-23T15:43:59.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-04-23T15:43:59.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-04-23T15:43:59.437 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-04-23T15:43:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.440 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-04-23T15:43:59.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-04-23T15:43:59.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-23T15:43:59.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-04-23T15:43:59.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-04-23T15:43:59.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-04-23T15:43:59.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-04-23T15:43:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.459 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-04-23T15:43:59.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.465 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-04-23T15:43:59.466 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.469 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.472 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-04-23T15:43:59.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.482 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-23T15:43:59.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.484 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-04-23T15:43:59.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-04-23T15:43:59.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-04-23T15:43:59.490 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.493 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.494 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.495 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.496 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-04-23T15:43:59.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.500 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.501 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.502 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-04-23T15:43:59.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.508 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.511 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-23T15:43:59.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-23T15:43:59.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-23T15:43:59.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:43:59.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.517 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.520 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.523 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-23T15:43:59.524 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.531 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-23T15:43:59.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-23T15:43:59.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-23T15:43:59.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.536 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-04-23T15:43:59.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-04-23T15:43:59.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:43:59.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.563 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.564 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.565 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.566 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-23T15:43:59.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-23T15:43:59.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.572 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.573 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.574 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.581 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.583 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.585 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.588 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-04-23T15:43:59.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-04-23T15:43:59.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-04-23T15:43:59.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-04-23T15:43:59.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.594 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-04-23T15:43:59.595 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.596 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.601 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.604 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-23T15:43:59.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.608 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.609 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.611 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-04-23T15:43:59.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.614 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-04-23T15:43:59.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-04-23T15:43:59.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.624 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.625 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.626 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.627 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.630 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.631 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.635 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.638 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.640 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.641 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.642 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.644 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.645 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.650 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.652 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.658 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.660 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.668 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-04-23T15:43:59.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.675 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.678 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.682 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:43:59.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-04-23T15:43:59.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-04-23T15:43:59.687 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.688 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.689 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.695 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.698 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.700 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.701 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.706 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.707 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.712 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.717 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.718 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.724 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-04-23T15:43:59.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-04-23T15:43:59.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.734 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.741 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-23T15:43:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-23T15:43:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-04-23T15:43:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 35129, 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "y", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540701547738038271, 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-04-23T15:43:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-04-23T15:43:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-04-23T15:43:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-04-23T15:43:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T15:43:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-04-23T15:43:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-04-23T15:43:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-04-23T15:43:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-04-23T15:43:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-04-23T15:43:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-23T15:43:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-04-23T15:43:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-04-23T15:43:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-04-23T15:43:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-04-23T15:43:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-23T15:43:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-23T15:43:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-23T15:43:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-04-23T15:43:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-23T15:43:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-23T15:43:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-23T15:43:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-23T15:43:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-23T15:43:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-23T15:43:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-04-23T15:43:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-04-23T15:43:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-04-23T15:43:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-23T15:43:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-23T15:43:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-04-23T15:43:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-04-23T15:43:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:43:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-23T15:43:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-04-23T15:43:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:43:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-04-23T15:43:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-04-23T15:43:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-04-23T15:44:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-04-23T15:44:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-23T15:44:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-04-23T15:44:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-04-23T15:44:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-23T15:44:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.067 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.068 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.072 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.076 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.079 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-04-23T15:44:00.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-04-23T15:44:00.082 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.086 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.087 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.088 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.090 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.095 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.101 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.104 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.105 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.108 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.110 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.111 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.115 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.121 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.123 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.126 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.127 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.129 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.130 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-04-23T15:44:00.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-04-23T15:44:00.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-04-23T15:44:00.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-04-23T15:44:00.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-04-23T15:44:00.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-04-23T15:44:00.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-04-23T15:44:00.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-04-23T15:44:00.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.146 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.148 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.150 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.151 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.153 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.156 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.162 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.163 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.169 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.174 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.178 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.181 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-04-23T15:44:00.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.187 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-04-23T15:44:00.188 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.189 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.192 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.194 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.200 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-04-23T15:44:00.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.206 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.211 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-04-23T15:44:00.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.213 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "modules": [ 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard", 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "iostat", 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "nfs", 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "restful", 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_schedule" 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.214 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.216 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.222 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-04-23T15:44:00.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.226 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-04-23T15:44:00.226 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-04-23T15:44:00.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.226 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.226 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.226 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-04-23T15:44:00.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-04-23T15:44:00.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-04-23T15:44:00.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-04-23T15:44:00.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-04-23T15:44:00.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-04-23T15:44:00.232 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.233 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.237 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.238 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-04-23T15:44:00.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.243 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:44:00.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.246 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-04-23T15:44:00.247 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.248 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-04-23T15:44:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-04-23T15:44:00.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.255 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.257 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.258 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-23T15:44:00.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-23T15:44:00.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.267 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-04-23T15:44:00.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-04-23T15:44:00.269 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-04-23T15:44:00.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-04-23T15:44:00.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-04-23T15:44:00.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-04-23T15:44:00.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-04-23T15:44:00.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-04-23T15:44:00.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-04-23T15:44:00.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.282 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.284 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.286 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.289 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.290 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.292 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.293 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.297 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-04-23T15:44:00.298 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.302 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.304 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.305 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-04-23T15:44:00.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-04-23T15:44:00.307 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.308 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.311 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.312 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.314 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.315 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.316 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.318 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-04-23T15:44:00.320 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.321 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.322 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.324 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-04-23T15:44:00.325 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-23T15:44:00.326 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.327 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.329 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.330 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.333 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-04-23T15:44:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.346 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.347 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.348 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.349 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.350 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.351 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.359 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.360 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-23T15:44:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-23T15:44:00.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-23T15:44:00.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.370 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.376 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.383 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.389 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.393 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.394 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-04-23T15:44:00.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-23T15:44:00.396 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.397 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.400 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.410 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.412 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-23T15:44:00.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.421 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.423 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.425 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.428 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.429 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.430 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-04-23T15:44:00.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.435 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.437 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.439 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.440 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.441 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-04-23T15:44:00.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.448 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.449 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-04-23T15:44:00.453 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.454 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.457 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.459 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.461 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.466 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.468 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-04-23T15:44:00.470 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.472 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.474 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.477 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.478 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.483 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-23T15:44:00.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.490 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.492 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.494 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-04-23T15:44:00.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.502 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.511 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.514 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.516 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.520 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.524 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.526 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.530 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.531 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.533 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-04-23T15:44:00.535 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.536 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.540 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-04-23T15:44:00.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-04-23T15:44:00.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-04-23T15:44:00.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-04-23T15:44:00.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.560 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.563 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.565 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.568 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.570 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.571 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.572 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.573 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.578 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.579 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.594 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.596 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.597 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.599 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.602 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.603 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.604 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.605 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.611 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.612 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.622 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-04-23T15:44:00.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-04-23T15:44:00.628 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "services": { 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard": "https://172.21.15.7:8443/" 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "always_on_modules": { 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "octopus": [ 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-04-23T15:44:00.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "pacific": [ 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-04-23T15:44:00.630 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "quincy": [ 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.631 INFO:teuthology.orchestra.run.smithi007.stdout: "reef": [ 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "squid": [ 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-04-23T15:44:00.632 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "last_failure_osd_epoch": 94, 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "active_clients": [ 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:44:00.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1021113354 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "libcephsqlite", 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 756801507 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.634 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3280743012 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:44:00.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3400006937 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3276405836 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1938465720 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-23T15:44:00.637 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T15:44:00.639 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:00 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3350141491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-23T15:44:00.639 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:00 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:44:00.639 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:59 smithi137 ceph-mon[31694]: pgmap v1667: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 361 KiB/s wr, 260 op/s 2024-04-23T15:44:00.639 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:43:59 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1861716699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:44:00.639 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:00 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3350141491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-23T15:44:00.639 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:00 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:44:00.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.400+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc7300a3de0 msgr2=0x7fc7300a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:44:00.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.400+0000 7fc752600640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc7300a3de0 0x7fc7300a62a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc74c1000e0 tx=0x7fc73400b480 comp rx=0 tx=0).stop 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104440 msgr2=0x7fc74c0738e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104440 0x7fc74c0738e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00d6d0 tx=0x7fc73c00db90 comp rx=0 tx=0).stop 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 shutdown_connections 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fc7300a3de0 0x7fc7300a62a0 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc74c1000e0 tx=0x7fc73400b480 comp rx=0 tx=0).stop 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc74c071970 0x7fc74c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc74c109510 0x7fc74c071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 --2- 172.21.15.7:0/3350141491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc74c104440 0x7fc74c0738e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 >> 172.21.15.7:0/3350141491 conn(0x7fc74c0ffcc0 msgr2=0x7fc74c102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 shutdown_connections 2024-04-23T15:44:00.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:43:59.401+0000 7fc752600640 1 -- 172.21.15.7:0/3350141491 wait complete. 2024-04-23T15:44:00.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:59 smithi007 ceph-mon[27906]: pgmap v1667: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 361 KiB/s wr, 260 op/s 2024-04-23T15:44:00.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:43:59 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1861716699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:44:00.647 DEBUG:tasks.check_counter:Getting stats from a 2024-04-23T15:44:00.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-23T15:44:00.648 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:00 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3350141491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-23T15:44:00.648 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:00 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:44:01.229 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T15:44:01.402 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:01 smithi007 ceph-mon[27906]: pgmap v1668: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 181 KiB/s wr, 256 op/s 2024-04-23T15:44:01.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:01 smithi137 ceph-mon[31694]: pgmap v1668: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 181 KiB/s wr, 256 op/s 2024-04-23T15:44:01.616 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:01 smithi186 ceph-mon[31814]: pgmap v1668: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 181 KiB/s wr, 256 op/s 2024-04-23T15:44:02.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:02 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:02.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:02 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:02 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:02.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:02 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:02.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:02 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:02.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:02 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:03.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:03 smithi007 ceph-mon[27906]: pgmap v1669: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 180 KiB/s wr, 322 op/s 2024-04-23T15:44:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:03 smithi186 ceph-mon[31814]: pgmap v1669: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 180 KiB/s wr, 322 op/s 2024-04-23T15:44:03.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:03 smithi137 ceph-mon[31694]: pgmap v1669: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 180 KiB/s wr, 322 op/s 2024-04-23T15:44:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:05 smithi007 ceph-mon[27906]: pgmap v1670: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 135 KiB/s wr, 261 op/s 2024-04-23T15:44:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:05 smithi186 ceph-mon[31814]: pgmap v1670: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 135 KiB/s wr, 261 op/s 2024-04-23T15:44:05.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:05 smithi137 ceph-mon[31694]: pgmap v1670: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 135 KiB/s wr, 261 op/s 2024-04-23T15:44:07.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:07 smithi007 ceph-mon[27906]: pgmap v1671: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 68 KiB/s wr, 256 op/s 2024-04-23T15:44:07.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:07 smithi186 ceph-mon[31814]: pgmap v1671: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 68 KiB/s wr, 256 op/s 2024-04-23T15:44:07.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:07 smithi137 ceph-mon[31694]: pgmap v1671: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 68 KiB/s wr, 256 op/s 2024-04-23T15:44:08.917 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:08 smithi137 ceph-mon[31694]: pgmap v1672: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 67 KiB/s wr, 216 op/s 2024-04-23T15:44:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:08 smithi137 ceph-mon[31694]: osdmap e181: 12 total, 12 up, 12 in 2024-04-23T15:44:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:08.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:08 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:08 smithi007 ceph-mon[27906]: pgmap v1672: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 67 KiB/s wr, 216 op/s 2024-04-23T15:44:09.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:08 smithi007 ceph-mon[27906]: osdmap e181: 12 total, 12 up, 12 in 2024-04-23T15:44:09.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:08 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:08 smithi186 ceph-mon[31814]: pgmap v1672: 129 pgs: 129 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 67 KiB/s wr, 216 op/s 2024-04-23T15:44:09.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:08 smithi186 ceph-mon[31814]: osdmap e181: 12 total, 12 up, 12 in 2024-04-23T15:44:09.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:08 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:09.971 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:09.971 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:09.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:09.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:09 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:09.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:09 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:44:09.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:09 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:44:10.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:09 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:09 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:44:10.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:09 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:44:10.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:09 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:09 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-23T15:44:10.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:09 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: pgmap v1674: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 178 op/s 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:44:10.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:10 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:44:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: pgmap v1674: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 178 op/s 2024-04-23T15:44:11.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:44:11.114 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:10 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: pgmap v1674: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 58 KiB/s wr, 178 op/s 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi186 to 176.4M 2024-04-23T15:44:11.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:10 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi186 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-04-23T15:44:13.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:13 smithi007 ceph-mon[27906]: pgmap v1675: 129 pgs: 14 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 76 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 96 op/s 2024-04-23T15:44:13.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:13 smithi186 ceph-mon[31814]: pgmap v1675: 129 pgs: 14 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 76 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 96 op/s 2024-04-23T15:44:13.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:13 smithi137 ceph-mon[31694]: pgmap v1675: 129 pgs: 14 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 76 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 96 op/s 2024-04-23T15:44:15.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:15 smithi007 ceph-mon[27906]: pgmap v1676: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 72 op/s 2024-04-23T15:44:15.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:15 smithi186 ceph-mon[31814]: pgmap v1676: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 72 op/s 2024-04-23T15:44:15.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:15 smithi137 ceph-mon[31694]: pgmap v1676: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 72 op/s 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 6568, 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 6570, 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 2037997, 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 2088625, 2024-04-23T15:44:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 1.484257788, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.553115294, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.366526239, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.411475755, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 6568, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.637920913, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000097125 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 3140, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 3814, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 772834, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 2450754, 2024-04-23T15:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 10, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 5, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.910502456, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.376236658, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.186234454, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.255499559, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3811, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.412771327, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000108310 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 1453120 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1005, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 983, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1947548, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 567406, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.385189304, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.177563953, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.157662804, 2024-04-23T15:44:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.048763765, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 983, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.111255165, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000113179 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1947280, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 567088 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 15592, 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.948000586, 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000060800 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 4, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 4, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 4, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-04-23T15:44:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 1, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-04-23T15:44:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-04-23T15:44:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-04-23T15:44:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-04-23T15:44:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 34, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 2, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 2, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-04-23T15:44:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 4194304, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 4269070, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 4266465, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 34 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 4, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 25, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 21, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 2, 2024-04-23T15:44:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 18, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 16, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 4, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 30, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 26, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 50432, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 215416 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-04-23T15:44:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-04-23T15:44:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-04-23T15:44:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 1, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 0, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 1, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-04-23T15:44:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 4903, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 190901, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 54, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 9656, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 186, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 16544, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 48, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 9706, 2024-04-23T15:44:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 21, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 3, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 9706, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 9706, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 48.449252242, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.004991680 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 9706, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 9707 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 9706, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 9706, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 6412, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 3292, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-04-23T15:44:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 1, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-04-23T15:44:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 181, 2024-04-23T15:44:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 90, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 5, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 10, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 5, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-04-23T15:44:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-04-23T15:44:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 10709, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 3740224, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 10709, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 10709, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 3740224, 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 9706, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 74771, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 9706, 2024-04-23T15:44:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 74771, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 9706, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 9706, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 9706, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 9706, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:15.883 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x561f16570780": { 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-04-23T15:44:15.884 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:15.885 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:17.174 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-04-23T15:44:17.175 DEBUG:tasks.check_counter:Getting stats from d 2024-04-23T15:44:17.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-23T15:44:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:17 smithi007 ceph-mon[27906]: pgmap v1677: 129 pgs: 13 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 75 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.2 KiB/s wr, 32 op/s 2024-04-23T15:44:17.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:17 smithi186 ceph-mon[31814]: pgmap v1677: 129 pgs: 13 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 75 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.2 KiB/s wr, 32 op/s 2024-04-23T15:44:17.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:17 smithi137 ceph-mon[31694]: pgmap v1677: 129 pgs: 13 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 75 active+clean; 15 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.2 KiB/s wr, 32 op/s 2024-04-23T15:44:17.705 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T15:44:19.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:19 smithi007 ceph-mon[27906]: pgmap v1678: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T15:44:19.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:19 smithi186 ceph-mon[31814]: pgmap v1678: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T15:44:19.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:19 smithi137 ceph-mon[31694]: pgmap v1678: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T15:44:21.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:21.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:20 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:21.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:20 smithi007 ceph-mon[27906]: pgmap v1679: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-04-23T15:44:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:20 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:21.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:20 smithi137 ceph-mon[31694]: pgmap v1679: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-04-23T15:44:21.308 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3040, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.004877362, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000085123, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001509967, 2024-04-23T15:44:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.001726276, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000575425 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 905, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 894, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1786336, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 555728, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.361242033, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.165054102, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.149651995, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.047823732, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 893, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.103194053, 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000115558 2024-04-23T15:44:21.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1786336, 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 555728 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:21.312 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 686, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 640, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 433872, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 7, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.147873348, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.118116013, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.011926609, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 683, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.115564559, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000169201 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.313 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 640, 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 433872 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-04-23T15:44:21.314 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:21.316 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:21.317 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148794, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 32, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:21.318 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 909, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1658313, 2024-04-23T15:44:21.319 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 909, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 909, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1658313, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:21.320 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T15:44:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:21.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:20 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:21.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:20 smithi186 ceph-mon[31814]: pgmap v1679: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-04-23T15:44:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:22.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:21 smithi007 ceph-mon[27906]: osdmap e182: 12 total, 12 up, 12 in 2024-04-23T15:44:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:44:22.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:44:22.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:44:22.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:44:22.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:22.169 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:21 smithi137 ceph-mon[31694]: osdmap e182: 12 total, 12 up, 12 in 2024-04-23T15:44:22.187 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-23T15:44:22.187 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-23T15:44:22.187 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-23T15:44:22.187 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-23T15:44:22.187 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-23T15:44:22.187 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-23T15:44:22.188 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-23T15:44:22.188 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-04-23T15:44:22.188 DEBUG:tasks.check_counter:Getting stats from g 2024-04-23T15:44:22.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: Unable to set osd_memory_target on smithi007 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' 2024-04-23T15:44:22.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:21 smithi186 ceph-mon[31814]: osdmap e182: 12 total, 12 up, 12 in 2024-04-23T15:44:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T15:44:23.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:22 smithi007 ceph-mon[27906]: pgmap v1681: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T15:44:23.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:22 smithi137 ceph-mon[31694]: pgmap v1681: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T15:44:23.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:22 smithi186 ceph-mon[31814]: pgmap v1681: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 3097, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 3096, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1044241, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 983652, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 9, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.893862256, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.400597118, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.197279000, 2024-04-23T15:44:25.105 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.212576179, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3094, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.330068095, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000106680 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T15:44:25.106 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 7067, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 7047, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3911241, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 2496827, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 1.542772908, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.594691811, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.453275334, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.413959761, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 7046, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.727507291, 2024-04-23T15:44:25.107 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000103251 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1945568, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 568736 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 10, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 685, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 4868, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 1458293, 2024-04-23T15:44:25.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 13, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 5, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.153125152, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.121039616, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.013153630, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000119277, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 683, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.100119568, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000146587 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3520, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 1457328 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 15292, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.870153617, 2024-04-23T15:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000056902 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-04-23T15:44:25.111 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 37, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 37, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-04-23T15:44:25.112 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 37, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 1, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-04-23T15:44:25.113 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 0, 2024-04-23T15:44:25.114 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-04-23T15:44:25.115 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-04-23T15:44:25.116 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.117 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 323, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 2, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 2, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-04-23T15:44:25.118 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 4194304, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 4618943, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 4616855, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 323 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 4, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 68, 2024-04-23T15:44:25.119 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 64, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 2, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 13, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 11, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 37, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 101, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 64, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 50412, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 215416 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-04-23T15:44:25.120 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.122 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.123 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.124 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-04-23T15:44:25.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.125 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.125 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.127 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.128 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:25.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.130 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-04-23T15:44:25.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:25.132 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-04-23T15:44:25.133 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 2, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 1, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 2, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 6645, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.134 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:25.135 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:25.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 199025, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 58, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:25.137 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 180, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 41272, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 183, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-04-23T15:44:25.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 9159, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 21, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 3, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 9159, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 9159, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 241.680272539, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.026387189 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 9159, 2024-04-23T15:44:25.139 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 9160 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 9159, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 9159, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 6040, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 3117, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-04-23T15:44:25.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 1, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-04-23T15:44:25.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-04-23T15:44:25.142 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 182, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 91, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 6, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 14, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 8, 2024-04-23T15:44:25.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-04-23T15:44:25.144 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 10170, 2024-04-23T15:44:25.145 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 3990503, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 10170, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 10170, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 3990503, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.146 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 9159, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 424644, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 9159, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 424644, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.147 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 9159, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 9159, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 9159, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 9159, 2024-04-23T15:44:25.148 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-04-23T15:44:25.149 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x55aebfcc2780": { 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:25.150 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:25.151 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T15:44:25.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:25 smithi007 ceph-mon[27906]: pgmap v1682: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-04-23T15:44:25.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:25 smithi186 ceph-mon[31814]: pgmap v1682: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-04-23T15:44:25.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:25 smithi137 ceph-mon[31694]: pgmap v1682: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:25.994 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-04-23T15:44:25.994 DEBUG:tasks.check_counter:Getting stats from j 2024-04-23T15:44:25.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-23T15:44:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T15:44:27.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:27 smithi007 ceph-mon[27906]: pgmap v1683: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-04-23T15:44:27.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:27 smithi186 ceph-mon[31814]: pgmap v1683: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-04-23T15:44:27.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:27 smithi137 ceph-mon[31694]: pgmap v1683: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-04-23T15:44:28.633 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-23T15:44:28.633 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3040, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.004476836, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000095030, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001294026, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.001550592, 2024-04-23T15:44:28.634 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000516864 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 687, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 640, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 434048, 2024-04-23T15:44:28.635 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 7, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.144132190, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.119196709, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.006995668, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 684, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.123697001, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000180843 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:28.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 640, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 434048 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 908, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 897, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1787152, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 557648, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.351695153, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.162562393, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.134006880, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.049094925, 2024-04-23T15:44:28.637 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 896, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.089105053, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000099447 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1787152, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 557648 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-04-23T15:44:28.638 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:28.639 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:28.640 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148714, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:28.641 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-23T15:44:28.642 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 912, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1658703, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 912, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 912, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1658703, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-04-23T15:44:28.643 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-04-23T15:44:28.644 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:28.644 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-23T15:44:28.644 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-23T15:44:29.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:29 smithi007 ceph-mon[27906]: pgmap v1684: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-23T15:44:29.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:29 smithi186 ceph-mon[31814]: pgmap v1684: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-23T15:44:29.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:29 smithi137 ceph-mon[31694]: pgmap v1684: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-23T15:44:29.475 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-04-23T15:44:29.475 DEBUG:tasks.check_counter:Getting stats from b 2024-04-23T15:44:29.476 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-23T15:44:30.476 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T15:44:31.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:31 smithi007 ceph-mon[27906]: pgmap v1685: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-23T15:44:31.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:31 smithi186 ceph-mon[31814]: pgmap v1685: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-23T15:44:31.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:31 smithi137 ceph-mon[31694]: pgmap v1685: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-23T15:44:32.845 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 13286, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 17781, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 5645530, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 36741825, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 210, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 4.015046365, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 1.751074633, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 1.532521421, 2024-04-23T15:44:32.846 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.628770480, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 17781, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 3.794439355, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000213398 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 19168, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.010553052, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000550 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1999872, 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 1303040 2024-04-23T15:44:32.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 18933, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 19950, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 6405603, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 45065171, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 278, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 4.447535176, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 1.640405885, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 2.212415190, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.662104730, 2024-04-23T15:44:32.848 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 19947, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 3.672530234, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000184114 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 26204, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.012603700, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000480 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 138832, 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 741456 2024-04-23T15:44:32.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 18428, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 19658, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 6028544, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 41686784, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 17, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 7, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 5.177512643, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 2.497878610, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 1.761681355, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.905296027, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 19656, 2024-04-23T15:44:32.850 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 3.895539878, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000198185 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 23803, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.014853416, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000624 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1751872, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 623872 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-23T15:44:32.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 10621, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 13.193003578, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001242162 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 5758, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.517334236, 2024-04-23T15:44:32.852 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000089846 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 4970, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 4918, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4918, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 225.173712304, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.045785626 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 52, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:32.853 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 2420, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 3, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 1520, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 760, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 749, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 11, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 434, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 50, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 3, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 3, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 3, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 7066, 2024-04-23T15:44:32.854 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 6692, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 39, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 0, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 42, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-04-23T15:44:32.855 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 8, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 44, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 8, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 114, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 7, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:32.856 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 1883, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 3228, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 6, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 5839, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 2847, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 44, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 2720 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 408, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 0, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 0, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 0, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 801, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 84, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:32.858 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 878, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 734, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 61, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 8, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-04-23T15:44:32.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 3, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 8724, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 8450, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 8450, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 274, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 683, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 250, 2024-04-23T15:44:32.860 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 249, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 249, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 1, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 1, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 2, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 86593245, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 87576065, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-04-23T15:44:32.861 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3524, 2024-04-23T15:44:32.862 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 81.596838000, 2024-04-23T15:44:32.862 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.023154607 2024-04-23T15:44:32.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.862 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 970, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 1745, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 775, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 120, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 141, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 21, 2024-04-23T15:44:32.863 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 1520, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 2507, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 987, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 3, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 871, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 868, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 73196, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 231800 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 6539, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 83, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 4970, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 98, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 238, 2024-04-23T15:44:32.864 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 747, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2.677908356, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.003584884 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1809, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.156517365, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000639313 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-04-23T15:44:32.865 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 61, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.514977560, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.008442255 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 194, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.217194123, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.006274196 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.866 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:32.867 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.868 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.868 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.868 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 53, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.029669993, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000559811 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 105, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.336671248, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.003206392 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 53, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.446392034, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.027290415 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 661, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 202.306587713, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.306061403 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 200, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2.083782911, 2024-04-23T15:44:32.870 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.010418914 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 95, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 6.091840912, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.064124641 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.871 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 99, 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2.873244102, 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.029022667 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.872 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 46, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.882610161, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.019187177 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 5, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.011612490, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002322498 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.873 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.003713543, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000928385 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 9, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.055737709, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.006193078 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 13, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.034044198, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002618784 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 764, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 3.451207886, 2024-04-23T15:44:32.875 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.004517287 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 2, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 7, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 5, 2024-04-23T15:44:32.876 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 2, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 882, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 441, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 3173, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 360, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 360, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:32.877 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:32.878 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:32.879 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 1013339, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 306, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 180, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:32.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 3501444, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 37610, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 15266, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 93899660, 2024-04-23T15:44:32.881 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 37, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 15266, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 15266, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 535.540312310, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.035080591 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 15266, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 22358 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 15266, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 79, 2024-04-23T15:44:32.882 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 15187, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 2302, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 917, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 79, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 3603, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 828, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 1, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 1, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 6387, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:32.883 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 1476, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 6, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-04-23T15:44:32.884 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 182, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-04-23T15:44:32.885 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 98, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 12, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 12, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 6335, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 0, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 423 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-04-23T15:44:32.886 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "osd-slow-ops": { 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 12 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 60, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 7, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 5836, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 734, 2024-04-23T15:44:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 50643, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 13263439, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 50643, 2024-04-23T15:44:32.888 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 50643, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 13263439, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:32.889 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 15266, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 93994386, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 15266, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 93994386, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:32.890 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 15266, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 15266, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 15266, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 15266, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.891 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 734, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 94726, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:32.892 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 734, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 79, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 94726, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x5569b0584500": { 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:32.893 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 8724, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 83381761, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 8724, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 3524, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 83381761, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:32.894 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-23T15:44:33.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:33 smithi137 ceph-mon[31694]: pgmap v1686: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-23T15:44:33.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:33 smithi007 ceph-mon[27906]: pgmap v1686: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-23T15:44:33.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:33 smithi186 ceph-mon[31814]: pgmap v1686: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds.exported=8 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds.imported=8 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=408 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=53 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=46 2024-04-23T15:44:33.836 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=3 2024-04-23T15:44:33.836 DEBUG:tasks.check_counter:Getting stats from e 2024-04-23T15:44:33.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-23T15:44:34.297 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T15:44:35.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:35 smithi007 ceph-mon[27906]: pgmap v1687: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-23T15:44:35.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:35 smithi186 ceph-mon[31814]: pgmap v1687: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-23T15:44:35.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:35 smithi137 ceph-mon[31694]: pgmap v1687: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-23T15:44:37.300 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:37 smithi137 ceph-mon[31694]: pgmap v1688: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-23T15:44:37.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:37 smithi007 ceph-mon[27906]: pgmap v1688: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-23T15:44:37.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:37 smithi186 ceph-mon[31814]: pgmap v1688: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-23T15:44:37.694 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 7266, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 5118, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 4244931, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 1951449, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 15, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 1.968479720, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 1.033170860, 2024-04-23T15:44:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 1.075182580, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.077960233, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 5121, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.763319931, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000149056 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 9909, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.005263260, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000531 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1972128, 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 579472 2024-04-23T15:44:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 67, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 749, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 54975, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 1531248, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 22, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 7, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.112574218, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.065958432, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.027259381, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.001167680, 2024-04-23T15:44:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 746, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.161013220, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000215835 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 49, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000041868, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000854 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 1478400 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 171, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 413, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 74955, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 275212, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 21, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 7, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.085920198, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.030274828, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.048067689, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.001775395, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 408, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.120556378, 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000295481 2024-04-23T15:44:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 419, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000566655, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000001352 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 448 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-04-23T15:44:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 97, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.038879456, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000400819 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 46, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.004393324, 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000095507 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 49, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 37, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 37, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.066846916, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001806673 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 12, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 11, 2024-04-23T15:44:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 13, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 1, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 1, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 11, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 11, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 224, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 1, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 1, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 3, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 293, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 166, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 12, 2024-04-23T15:44:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 84, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 2, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 45, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 2, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 16, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-04-23T15:44:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 7, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 2, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 15, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 16, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 14, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 2, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 30 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 9, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 308, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 195, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 211, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 10, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 15, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 15, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 2, 2024-04-23T15:44:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 64, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 64, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 2, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-04-23T15:44:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 2, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 2, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 4327869, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 20, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.167347741, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.008367387 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 17, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 154, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 137, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 16, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 141, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 125, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 13, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 255, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 242, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 1, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 18, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 17, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 54344, 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 223608 2024-04-23T15:44:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 69, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 9, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 49, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 38, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 35, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000380949, 2024-04-23T15:44:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000380949 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 19, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.015108722, 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000795195 2024-04-23T15:44:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.002666848, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001333424 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 15, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.048690397, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.003246026 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 1, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 2, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 1, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 1, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 27, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 27, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 3196, 2024-04-23T15:44:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 324044, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 124, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-23T15:44:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 180, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 72184, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 270, 2024-04-23T15:44:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 112, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 149946, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 33, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 112, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 112, 2024-04-23T15:44:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.715968907, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.015321150 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 112, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 145 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 112, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 3, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 109, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 0, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 10, 2024-04-23T15:44:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 3, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 23, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 12, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 42, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 20, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-04-23T15:44:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 182, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 91, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 12, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 32, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 20, 2024-04-23T15:44:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 29, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 0, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 6 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "osd-slow-ops": { 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-04-23T15:44:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 10, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 5, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 30, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 15, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 7500, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 3642934, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 7500, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 7500, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 3642934, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 112, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 152421, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 112, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 152421, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 112, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 112, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 112, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 112, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 15, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 2475, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 15, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 3, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 2475, 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x56286bc92500": { 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 64, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 133565, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 64, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 20, 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 133565, 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:37.739 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-23T15:44:38.642 INFO:tasks.check_counter:Daemon mds.e mds.exported=2 2024-04-23T15:44:38.642 INFO:tasks.check_counter:Daemon mds.e mds.imported=2 2024-04-23T15:44:38.642 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=9 2024-04-23T15:44:38.642 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=308 2024-04-23T15:44:38.643 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=7 2024-04-23T15:44:38.643 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:38.643 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:38.643 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-04-23T15:44:38.643 DEBUG:tasks.check_counter:Getting stats from h 2024-04-23T15:44:38.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-23T15:44:39.091 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T15:44:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:39 smithi007 ceph-mon[27906]: pgmap v1689: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-23T15:44:39.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:39 smithi186 ceph-mon[31814]: pgmap v1689: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-23T15:44:39.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:39 smithi137 ceph-mon[31694]: pgmap v1689: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-23T15:44:41.310 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:41 smithi137 ceph-mon[31694]: pgmap v1690: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 1131, 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 1750, 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 2015402, 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 2066770, 2024-04-23T15:44:41.312 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 24, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 7, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.463634111, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.216578330, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.178442854, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.049773477, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1744, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.270703057, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000155219 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 63, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000024447, 2024-04-23T15:44:41.313 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000388 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1978832, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 1927776 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 6272, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 4377, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 2270747, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 1503042, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 17, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 1.650104672, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.897612204, 2024-04-23T15:44:41.314 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.906482509, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.031614654, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4379, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.737517277, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000168421 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 10238, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.004684642, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000457 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 2672, 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 111504 2024-04-23T15:44:41.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 62, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 64, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 37601, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 47932, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 19, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 7, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.034456616, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.006396883, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.023807446, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.001828022, 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:41.316 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 63, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.064205782, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001019139 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 43, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000017052, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000396 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 5184, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 3472 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-23T15:44:41.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 111, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.014973719, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000134898 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 23, 2024-04-23T15:44:41.318 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.001014734, 2024-04-23T15:44:41.319 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000044118 2024-04-23T15:44:41.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.319 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 32, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 15, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 15, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.036200172, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002413344 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 17, 2024-04-23T15:44:41.320 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 11, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 17, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 0, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 7, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 10, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 13, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 183, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 2, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 2, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 3, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 254, 2024-04-23T15:44:41.321 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 145, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 15, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 86, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 2, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 6, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 2, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 4, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:41.322 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 7, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 2, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 2, 2024-04-23T15:44:41.323 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 6, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 2, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 4 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 9, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 308, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 195, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 214, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 9, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-04-23T15:44:41.324 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 2, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 2, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:41.325 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 2, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 31, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 31, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 2, 2024-04-23T15:44:41.326 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 2, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 2, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 4246504, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 26, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.155840533, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.005993866 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-04-23T15:44:41.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 21, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 115, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 94, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 20, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 143, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 123, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 17, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 202, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 185, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 2, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 13, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 11, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 54448, 2024-04-23T15:44:41.328 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 223608 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 44, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 9, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 32, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 50, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 23, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 5, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.006557063, 2024-04-23T15:44:41.329 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001311412 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 6, 2024-04-23T15:44:41.330 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.004869545, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000811590 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.333 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-04-23T15:44:41.333 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.333 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.333 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.334 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.001093409, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000546704 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.335 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.336 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.337 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-04-23T15:44:41.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.023680155, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.011840077 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.339 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 1, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 5, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 4, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 1, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 1, 2024-04-23T15:44:41.340 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 1, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 3203, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:41.341 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:41.342 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 344952, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 119, 2024-04-23T15:44:41.343 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 180, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-23T15:44:41.344 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 90277, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 373, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 91, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 65058, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 33, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 91, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 91, 2024-04-23T15:44:41.345 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.124979592, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.012362413 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 91, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 123 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 91, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 2, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 89, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-04-23T15:44:41.346 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 10, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 2, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 28, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 13, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 16, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 0, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 20, 2024-04-23T15:44:41.347 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-04-23T15:44:41.348 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 182, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 91, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 10, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 31, 2024-04-23T15:44:41.349 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 21, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 30, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 0, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 4 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "osd-slow-ops": { 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-04-23T15:44:41.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.353 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-04-23T15:44:41.353 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:41.353 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 2, 2024-04-23T15:44:41.353 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 1, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 4, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 2, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 7461, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 3594330, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 7461, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:41.354 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 7461, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 3594330, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:41.355 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 91, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 65388, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 91, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 65388, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:41.356 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 91, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 91, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 91, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 91, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:41.357 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 2, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 330, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 2, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 2, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 330, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.358 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x55a04dcf6500": { 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 31, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 52200, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 31, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 26, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 52200, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:41.359 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:41.360 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:41.360 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.360 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:41.360 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-23T15:44:41.360 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:41 smithi007 ceph-mon[27906]: pgmap v1690: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-23T15:44:41.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:41 smithi186 ceph-mon[31814]: pgmap v1690: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-23T15:44:42.476 INFO:tasks.check_counter:Daemon mds.h mds.exported=2 2024-04-23T15:44:42.476 INFO:tasks.check_counter:Daemon mds.h mds.imported=2 2024-04-23T15:44:42.476 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=9 2024-04-23T15:44:42.477 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=308 2024-04-23T15:44:42.477 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=7 2024-04-23T15:44:42.477 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:42.477 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:42.477 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-04-23T15:44:42.477 DEBUG:tasks.check_counter:Getting stats from k 2024-04-23T15:44:42.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-23T15:44:42.955 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T15:44:43.320 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:43 smithi137 ceph-mon[31694]: pgmap v1691: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-23T15:44:43.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:43 smithi007 ceph-mon[27906]: pgmap v1691: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-23T15:44:43.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:43 smithi186 ceph-mon[31814]: pgmap v1691: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-23T15:44:45.124 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 7257, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 5101, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 4232978, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 1915092, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 13, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 4, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 1.886701197, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.959645208, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 1.053619818, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.078576780, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 5104, 2024-04-23T15:44:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.729652221, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000142956 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 9900, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.006375700, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000644 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1968208, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 582048 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 68, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 754, 2024-04-23T15:44:45.126 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 38650, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 1498887, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 21, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.109314922, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.067195668, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.023103829, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.001490922, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 752, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.138334852, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000183955 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 38, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000017861, 2024-04-23T15:44:45.127 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000470 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3680, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 1424400 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 113, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 314, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 38786, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 144519, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 21, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 8, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.064895671, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.022323437, 2024-04-23T15:44:45.128 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.037834131, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000823857, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 308, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.097561666, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000316758 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 335, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000217990, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000650 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.129 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 104, 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.013286611, 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000127755 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:45.130 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 22, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.001095599, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000049799 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 24, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 8, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 8, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.032352858, 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.004044107 2024-04-23T15:44:45.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 16, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 11, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 16, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 2, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 4, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 10, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 13, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 185, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 0, 2024-04-23T15:44:45.132 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 3, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 240, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 130, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 16, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 85, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 3, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 9, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 3, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 6, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:45.133 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 7, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:45.134 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 3, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 3, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 11, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 2, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 6 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 15, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 304, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 193, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 208, 2024-04-23T15:44:45.135 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 15, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 3, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 3, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:45.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 3, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 34, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 34, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 2, 2024-04-23T15:44:45.137 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 2, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 2, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 4269070, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 25, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.136538435, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.005461537 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-04-23T15:44:45.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 20, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 117, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 97, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 19, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 140, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 121, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 16, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 204, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 188, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 0, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 6, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 6, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 53744, 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 223608 2024-04-23T15:44:45.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 34, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 9, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 24, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 35, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 24, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.140 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.003362642, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001681321 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.144 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.003211536, 2024-04-23T15:44:45.145 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001070512 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.146 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.148 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-04-23T15:44:45.149 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.025778680, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.008592893 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 1, 2024-04-23T15:44:45.150 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 1, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 1, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 2, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 2, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 3204, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:45.151 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:45.152 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 338185, 2024-04-23T15:44:45.153 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 119, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 180, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:45.154 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 89717, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 350, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 88, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 87583, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 27, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 88, 2024-04-23T15:44:45.155 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 88, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.875984115, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.009954364 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 88, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 119 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 88, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 2, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 86, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 0, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 10, 2024-04-23T15:44:45.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 2, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 27, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 11, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 18, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 20, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:45.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-04-23T15:44:45.158 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 182, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 91, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 10, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 30, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 20, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-04-23T15:44:45.159 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 26, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 0, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 5 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd-slow-ops": { 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:45.160 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 4, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 2, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 6, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 3, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 7434, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 3584715, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 7434, 2024-04-23T15:44:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 7434, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 3584715, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:45.162 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 88, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 88078, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 88, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 88078, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:45.163 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 88, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 88, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 88, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 88, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:45.164 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 3, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 495, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 3, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 2, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 495, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x55c36e64a500": { 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 34, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 74766, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 34, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 25, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 74766, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-23T15:44:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-23T15:44:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-23T15:44:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-23T15:44:45.167 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-23T15:44:45.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:45 smithi137 ceph-mon[31694]: pgmap v1692: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-23T15:44:45.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:45 smithi007 ceph-mon[27906]: pgmap v1692: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-23T15:44:45.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:45 smithi186 ceph-mon[31814]: pgmap v1692: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds.exported=3 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds.imported=3 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=15 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=304 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=7 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:46.040 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-04-23T15:44:46.040 DEBUG:tasks.check_counter:Getting stats from c 2024-04-23T15:44:46.041 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-23T15:44:46.746 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T15:44:47.231 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:47 smithi186 ceph-mon[31814]: pgmap v1693: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T15:44:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:47 smithi007 ceph-mon[27906]: pgmap v1693: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T15:44:47.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:47 smithi137 ceph-mon[31694]: pgmap v1693: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T15:44:49.172 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:49 smithi186 ceph-mon[31814]: pgmap v1694: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-23T15:44:49.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:49 smithi137 ceph-mon[31694]: pgmap v1694: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-23T15:44:49.552 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-23T15:44:49.552 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:49.552 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 6890, 2024-04-23T15:44:49.552 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 6892, 2024-04-23T15:44:49.552 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 35582290, 2024-04-23T15:44:49.552 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 2191030, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 7, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 3, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 1.522444690, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.498596648, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.491262810, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.390262827, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 6890, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.650380938, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000094394 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.553 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 3719, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 3697, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 27297637, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1434410, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 8, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 4, 2024-04-23T15:44:49.554 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.997121794, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.368795054, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.386703000, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.200421696, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3697, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.374356422, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000101259 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 1951488, 2024-04-23T15:44:49.555 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 575744 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1953, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 2637, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 25669964, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1987909, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 11, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.574633562, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.225197750, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.174534756, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.119517578, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2634, 2024-04-23T15:44:49.556 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.309510092, 2024-04-23T15:44:49.557 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000117505 2024-04-23T15:44:49.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.557 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:49.557 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.557 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 1367808 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:44:49.558 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 19310, 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1.097977548, 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000056860 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-04-23T15:44:49.560 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 2353, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 1303, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 1050, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 492, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 2, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-04-23T15:44:49.561 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 4, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 234, 2024-04-23T15:44:49.562 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 7, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:49.563 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-04-23T15:44:49.564 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:49.565 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 8724, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 2, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 232, 2024-04-23T15:44:49.566 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 86593245, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 87576065, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 87562096, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 8724 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 970, 2024-04-23T15:44:49.567 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 1741, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 771, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 118, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 137, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 19, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 2353, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 2445, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 92, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 58976, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 215416 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-04-23T15:44:49.568 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.569 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.571 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.573 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-04-23T15:44:49.573 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.573 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.573 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.574 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.575 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.576 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:49.577 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.578 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.579 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 2, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 7, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 5, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 5, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-04-23T15:44:49.580 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 7241, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:49.581 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:49.582 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 226419, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 79, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:49.583 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 180, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 4034627, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 34267, 2024-04-23T15:44:49.584 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 11540, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 26, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 4, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 11540, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 11540, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 35.093335480, 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003041016 2024-04-23T15:44:49.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 11540, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 11541 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 11540, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 11540, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 6640, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 4897, 2024-04-23T15:44:49.586 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 2, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:49.587 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-04-23T15:44:49.588 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 182, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 91, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 9, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 14, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 5, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-04-23T15:44:49.589 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-04-23T15:44:49.590 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 12558, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 87364558, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:49.591 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 12558, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 12558, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 87364558, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:49.592 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 11540, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 83404273, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 11540, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 83404273, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:49.593 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 11540, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 11540, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 11540, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 11540, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.594 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-04-23T15:44:49.595 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x55913621a780": { 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:49.596 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:49.597 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-23T15:44:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:49 smithi007 ceph-mon[27906]: pgmap v1694: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-23T15:44:50.888 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-23T15:44:50.888 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-23T15:44:50.888 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-04-23T15:44:50.888 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-04-23T15:44:50.888 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=7 2024-04-23T15:44:50.889 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:50.889 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:50.889 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-04-23T15:44:50.889 DEBUG:tasks.check_counter:Getting stats from f 2024-04-23T15:44:50.889 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-23T15:44:51.327 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T15:44:51.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:51 smithi186 ceph-mon[31814]: pgmap v1695: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T15:44:51.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:51 smithi137 ceph-mon[31694]: pgmap v1695: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T15:44:51.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:51 smithi007 ceph-mon[27906]: pgmap v1695: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T15:44:53.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:53 smithi186 ceph-mon[31814]: pgmap v1696: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-23T15:44:53.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:53 smithi007 ceph-mon[27906]: pgmap v1696: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-23T15:44:53.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:53 smithi137 ceph-mon[31694]: pgmap v1696: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 9973, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 9975, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 2860751, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 3171421, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 6, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 1, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 1.965306508, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.671575893, 2024-04-23T15:44:53.659 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.576338062, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.568567317, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9973, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.857014693, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000085933 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T15:44:53.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 5, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 692, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1036, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1372682, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 10, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 4, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.089251542, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.063457499, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.008734816, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.000077025, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 688, 2024-04-23T15:44:53.661 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.101562808, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000147620 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 1371984 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:53.662 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1024, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 1002, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 2093212, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 577518, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 8, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 3, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.360054583, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.149340586, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.176262372, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.044339638, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1001, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.117961691, 2024-04-23T15:44:53.663 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000117843 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 2092944, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 577200 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-04-23T15:44:53.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 16597, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.806962694, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000048620 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.665 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:53.666 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 3, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 3, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 3, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-04-23T15:44:53.667 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 1, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-04-23T15:44:53.668 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:53.669 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-04-23T15:44:53.670 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:53.671 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 31, 2024-04-23T15:44:53.672 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 2, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 4246504, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 4243899, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.673 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 31 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 4, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 21, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 17, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 2, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 16, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 14, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 3, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 23, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 20, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-04-23T15:44:53.674 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 50176, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 215416 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-04-23T15:44:53.679 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.682 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.684 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 5, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 4, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 4, 2024-04-23T15:44:53.686 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 9669, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:53.687 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:53.688 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:53.689 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 182849, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 49, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:53.690 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 180, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 15840, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 44, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 9976, 2024-04-23T15:44:53.691 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 21, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 3, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 9976, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9976, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 18.849642780, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001889499 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9976, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 9977 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 9976, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 9976, 2024-04-23T15:44:53.692 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 6611, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 3363, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:53.693 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 1, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-04-23T15:44:53.694 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 182, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-04-23T15:44:53.695 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 91, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 4, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 9, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 5, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.696 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:44:53.697 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 10998, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 3909872, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 10998, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 10998, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 3909872, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:53.698 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 9976, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 52205, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 9976, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 52205, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.699 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 9976, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 9976, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 9976, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 9976, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.700 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-04-23T15:44:53.701 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x559b5c514780": { 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:53.702 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:53.703 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:54.602 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-04-23T15:44:54.603 DEBUG:tasks.check_counter:Getting stats from i 2024-04-23T15:44:54.603 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-23T15:44:55.057 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T15:44:55.356 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:55 smithi186 ceph-mon[31814]: pgmap v1697: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-23T15:44:55.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:55 smithi137 ceph-mon[31694]: pgmap v1697: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-23T15:44:55.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:55 smithi007 ceph-mon[27906]: pgmap v1697: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-23T15:44:57.324 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:57 smithi186 ceph-mon[31814]: pgmap v1698: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 185, 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 832, 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 69153, 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1847336, 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 26, 2024-04-23T15:44:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.143305323, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.073266279, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.036588183, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.008397506, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 825, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.165580322, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000200703 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 45, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000015621, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000347 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.329 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 1320896 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 6482, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 4800, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 2334370, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1733148, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 18, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 1.139561507, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.487784488, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.778415785, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.028056170, 2024-04-23T15:44:57.330 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4802, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.519833238, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000108253 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 10724, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.004841736, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000451 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 138016 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1122, 2024-04-23T15:44:57.331 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 1097, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 2000825, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 626120, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 16, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.384931675, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.158378156, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.185007472, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.048594893, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1097, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.152505719, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000139020 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:44:57.332 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 46, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000015357, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000333 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 1964992, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 582176 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 195, 2024-04-23T15:44:57.333 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.184339467, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000945330 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 148, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.022081545, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000149199 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 146, 2024-04-23T15:44:57.334 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 142, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 142, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.483820962, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003407189 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 4, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 11, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 16, 2024-04-23T15:44:57.335 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 2, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 4, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 10, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 13, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 231, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 3, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 646, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 411, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 4, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 89, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-04-23T15:44:57.336 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 1, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 54, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 1, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 18, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 4, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 234, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 7, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-04-23T15:44:57.337 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 19, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 72, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 91, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 18, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 10, 2024-04-23T15:44:57.338 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 126 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 12, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 320, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 204, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 218, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 16, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 36, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 36, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-04-23T15:44:57.339 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 1, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-04-23T15:44:57.340 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 323, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 323, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 2, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 2, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 4618943, 2024-04-23T15:44:57.341 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 0, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 71, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.361118245, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.005086172 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 0 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 20, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 170, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 150, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 19, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 145, 2024-04-23T15:44:57.342 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 126, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 16, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 283, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 267, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 37, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 37, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 55760, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 223608 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 275, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 9, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 146, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 39, 2024-04-23T15:44:57.343 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 73, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 18, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.128402997, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.007133499 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 86, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.069642932, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000809801 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.345 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.346 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.347 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.348 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2, 2024-04-23T15:44:57.349 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.004387243, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.002193621 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 18, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.190069869, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.010559437 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.350 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-04-23T15:44:57.351 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-04-23T15:44:57.352 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-04-23T15:44:57.353 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 18, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.091317921, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.005073217 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:44:57.354 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 1, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 1, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 35, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 35, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 3217, 2024-04-23T15:44:57.355 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:44:57.356 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:44:57.357 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 324657, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 126, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-04-23T15:44:57.358 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 9416, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 180, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 86765, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 345, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-04-23T15:44:57.359 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 243, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 442940, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 33, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 243, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 243, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2.130959670, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.008769381 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-04-23T15:44:57.360 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 243, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 274 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 243, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 17, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 226, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 0, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 10, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 17, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 88, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 23, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-04-23T15:44:57.361 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 84, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 20, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-04-23T15:44:57.362 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-04-23T15:44:57.363 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 182, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 91, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 12, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 36, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 24, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 27, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 0, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 5 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.364 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 1, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 10, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 5, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 72, 2024-04-23T15:44:57.365 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 36, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 7785, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 3646892, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 7785, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 7785, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 3646892, 2024-04-23T15:44:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 243, 2024-04-23T15:44:57.367 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 447872, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 243, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 447872, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:44:57.368 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 243, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 243, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 243, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 243, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:57.369 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 36, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 4932, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 36, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 17, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 4932, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:44:57.370 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x564251d06500": { 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 323, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 424639, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 323, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 71, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 424639, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:44:57.371 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.372 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:44:57.372 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-23T15:44:57.417 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:57 smithi137 ceph-mon[31694]: pgmap v1698: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T15:44:57.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:57 smithi007 ceph-mon[27906]: pgmap v1698: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T15:44:58.304 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=12 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=320 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:44:58.305 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-04-23T15:44:58.305 DEBUG:tasks.check_counter:Getting stats from l 2024-04-23T15:44:58.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 shell --fsid 7b70c844-017e-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-23T15:44:58.772 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T15:44:59.240 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:44:59 smithi186 ceph-mon[31814]: pgmap v1699: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-23T15:44:59.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:44:59 smithi137 ceph-mon[31694]: pgmap v1699: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-23T15:44:59.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:44:59 smithi007 ceph-mon[27906]: pgmap v1699: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-04-23T15:45:00.996 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 3347, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 3347, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1012918, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1063586, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 9, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.681939956, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.243870332, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.175635633, 2024-04-23T15:45:00.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.181324838, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3346, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.331746626, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000099147 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 448 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T15:45:00.998 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 3189, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 3880, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 784258, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 2385425, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 10, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 5, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.764880178, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.282861766, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.166900873, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.228932320, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3877, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.386410222, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000099667 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:00.999 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 1372272 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 4352, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 4332, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 3069840, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1639536, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 3, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-04-23T15:45:01.000 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 1.053578514, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.396652909, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.335507726, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.249725246, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4331, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.469459987, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000108395 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 1951632, 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 581232 2024-04-23T15:45:01.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 15607, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.878229779, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000056271 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-04-23T15:45:01.002 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.003 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 16, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 16, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 16, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-04-23T15:45:01.004 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 1, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-04-23T15:45:01.005 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T15:45:01.006 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-04-23T15:45:01.007 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_path": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_quiesce_inode": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-04-23T15:45:01.008 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 64, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 2, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-04-23T15:45:01.009 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 4327869, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 4325035, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 64 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 4, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 62, 2024-04-23T15:45:01.010 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 58, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 2, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 17, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 15, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 16, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 76, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 60, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 51140, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 215416 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-04-23T15:45:01.011 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.012 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.013 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.014 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.015 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.018 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.020 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-04-23T15:45:01.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.022 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 1, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 2, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 6445, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-04-23T15:45:01.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-04-23T15:45:01.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-04-23T15:45:01.025 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 191729, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 56, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 9416, 2024-04-23T15:45:01.026 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 180, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 24992, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 96, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 9857, 2024-04-23T15:45:01.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 21, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 3, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 9857, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9857, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 43.289180742, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.004391719 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9857, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 9858 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 9857, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 9857, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-04-23T15:45:01.028 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 6512, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 3343, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 1, 2024-04-23T15:45:01.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-04-23T15:45:01.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 182, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 91, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 5, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 10, 2024-04-23T15:45:01.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 5, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 10884, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 3831882, 2024-04-23T15:45:01.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 10884, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 10884, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 3831882, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-04-23T15:45:01.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 9857, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 133570, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 9857, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 133570, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.035 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 9857, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 9857, 2024-04-23T15:45:01.036 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 9857, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 9857, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:45:01.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x562c73a14780": { 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-04-23T15:45:01.038 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.039 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-23T15:45:01.040 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-23T15:45:01.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:01 smithi186 ceph-mon[31814]: pgmap v1700: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T15:45:01.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:01 smithi137 ceph-mon[31694]: pgmap v1700: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T15:45:01.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:01 smithi007 ceph-mon[27906]: pgmap v1700: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T15:45:02.192 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-04-23T15:45:02.193 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-23T15:45:02.204 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-23T15:45:02.204 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T15:45:02.204 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:45:02.280 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T15:45:02.281 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:45:02.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 -- 172.21.15.7:0/2559089593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe0104c20 msgr2=0x7f1fe0108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 --2- 172.21.15.7:0/2559089593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe0104c20 0x7f1fe0108c60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009900 tx=0x7f1fcc02a410 comp rx=0 tx=0).stop 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 -- 172.21.15.7:0/2559089593 shutdown_connections 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 --2- 172.21.15.7:0/2559089593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fe0109340 0x7f1fe0110f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 --2- 172.21.15.7:0/2559089593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe0104c20 0x7f1fe0108c60 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 --2- 172.21.15.7:0/2559089593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe0104270 0x7f1fe0104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 -- 172.21.15.7:0/2559089593 >> 172.21.15.7:0/2559089593 conn(0x7f1fe00ffad0 msgr2=0x7f1fe0101ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:02.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 -- 172.21.15.7:0/2559089593 shutdown_connections 2024-04-23T15:45:02.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.557+0000 7f1fe6800640 1 -- 172.21.15.7:0/2559089593 wait complete. 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.558+0000 7f1fe6800640 1 Processor -- start 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 -- start start 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe0104270 0x7f1fe01a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fe0109340 0x7f1fe01a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 0x7f1fe019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0114280 con 0x7f1fe019a6d0 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0114100 con 0x7f1fe0109340 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe6800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0114400 con 0x7f1fe0104270 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 0x7f1fe019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 0x7f1fe019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54004/0 (socket says 172.21.15.7:54004) 2024-04-23T15:45:02.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.559+0000 7f1fe5e00640 1 -- 172.21.15.7:0/3341997985 learned_addr learned my addr 172.21.15.7:0/3341997985 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe4a00640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fe0109340 0x7f1fe01a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5400640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe0104270 0x7f1fe01a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5e00640 1 -- 172.21.15.7:0/3341997985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe0104270 msgr2=0x7f1fe01a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5e00640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe0104270 0x7f1fe01a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5e00640 1 -- 172.21.15.7:0/3341997985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fe0109340 msgr2=0x7f1fe01a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5e00640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fe0109340 0x7f1fe01a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5e00640 1 -- 172.21.15.7:0/3341997985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe019b2d0 con 0x7f1fe019a6d0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe5e00640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 0x7f1fe019ab50 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800eaa0 tx=0x7f1fd800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800cdb0 con 0x7f1fe019a6d0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1fd8005020 con 0x7f1fe019a6d0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80116d0 con 0x7f1fe019a6d0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.560+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe01a7360 con 0x7f1fe019a6d0 2024-04-23T15:45:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.561+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe01a7710 con 0x7f1fe019a6d0 2024-04-23T15:45:02.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.562+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe0105740 con 0x7f1fe019a6d0 2024-04-23T15:45:02.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.564+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f1fd80051d0 con 0x7f1fe019a6d0 2024-04-23T15:45:02.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.566+0000 7f1fde000640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1fc80a3d20 0x7f1fc80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:02.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.566+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f1fd80d0e60 con 0x7f1fe019a6d0 2024-04-23T15:45:02.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.566+0000 7f1fe5400640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1fc80a3d20 0x7f1fc80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:02.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.567+0000 7f1fe5400640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1fc80a3d20 0x7f1fc80a61e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4005fd0 tx=0x7f1fd4005850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:02.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.572+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fd8016030 con 0x7f1fe019a6d0 2024-04-23T15:45:02.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.780+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fe0069190 con 0x7f1fe019a6d0 2024-04-23T15:45:02.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.784+0000 7f1fde000640 1 -- 172.21.15.7:0/3341997985 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+25192 (secure 0 0 0) 0x7f1fd809d0f0 con 0x7f1fe019a6d0 2024-04-23T15:45:02.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:45:02.786 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":182,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T15:44:21.443171+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":100,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":100,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/53488990":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3733281875":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3240450123":"2024-04-24T14:51:20.179514+0000","172.21.15.7:6801/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3573875988":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":87,"length":1},{"begin":100,"length":1}]},{"pool":4,"snaps":[{"begin":87,"length":1},{"begin":100,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:45:02.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.787+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1fc80a3d20 msgr2=0x7f1fc80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.787+0000 7f1fe6800640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1fc80a3d20 0x7f1fc80a61e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4005fd0 tx=0x7f1fd4005850 comp rx=0 tx=0).stop 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.787+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 msgr2=0x7f1fe019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.787+0000 7f1fe6800640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 0x7f1fe019ab50 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800eaa0 tx=0x7f1fd800ef60 comp rx=0 tx=0).stop 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 shutdown_connections 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f1fc80a3d20 0x7f1fc80a61e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fe0109340 0x7f1fe01a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fe019a6d0 0x7f1fe019ab50 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 --2- 172.21.15.7:0/3341997985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe0104270 0x7f1fe01a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:02.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 >> 172.21.15.7:0/3341997985 conn(0x7f1fe00ffad0 msgr2=0x7f1fe0100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:02.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 shutdown_connections 2024-04-23T15:45:02.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:02.788+0000 7f1fe6800640 1 -- 172.21.15.7:0/3341997985 wait complete. 2024-04-23T15:45:02.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 100, 'snap_epoch': 181, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 100, 'snap_epoch': 181, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T15:45:02.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 -- 172.21.15.7:0/135859849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd88109520 msgr2=0x7fdd881110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 --2- 172.21.15.7:0/135859849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd88109520 0x7fdd881110f0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009ca0 tx=0x7fdd8002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 -- 172.21.15.7:0/135859849 shutdown_connections 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 --2- 172.21.15.7:0/135859849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd88109520 0x7fdd881110f0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 --2- 172.21.15.7:0/135859849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104e00 0x7fdd88108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 --2- 172.21.15.7:0/135859849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd88104450 0x7fdd88104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 -- 172.21.15.7:0/135859849 >> 172.21.15.7:0/135859849 conn(0x7fdd880ffc70 msgr2=0x7fdd88102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 -- 172.21.15.7:0/135859849 shutdown_connections 2024-04-23T15:45:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.016+0000 7fdd8f600640 1 -- 172.21.15.7:0/135859849 wait complete. 2024-04-23T15:45:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.017+0000 7fdd8f600640 1 Processor -- start 2024-04-23T15:45:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.017+0000 7fdd8f600640 1 -- start start 2024-04-23T15:45:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8f600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104450 0x7fdd881a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd88109520 0x7fdd881a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 0x7fdd8819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8f600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd88114470 con 0x7fdd8819a7f0 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd881142f0 con 0x7fdd88109520 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8f600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdd881145f0 con 0x7fdd88104450 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 0x7fdd8819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 0x7fdd8819aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44408/0 (socket says 172.21.15.7:44408) 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd8d600640 1 -- 172.21.15.7:0/3099638461 learned_addr learned my addr 172.21.15.7:0/3099638461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.018+0000 7fdd87e00640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd88109520 0x7fdd881a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8cc00640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104450 0x7fdd881a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8d600640 1 -- 172.21.15.7:0/3099638461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104450 msgr2=0x7fdd881a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8d600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104450 0x7fdd881a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8d600640 1 -- 172.21.15.7:0/3099638461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd88109520 msgr2=0x7fdd881a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8d600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd88109520 0x7fdd881a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8d600640 1 -- 172.21.15.7:0/3099638461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8819b380 con 0x7fdd8819a7f0 2024-04-23T15:45:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8cc00640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104450 0x7fdd881a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:45:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.019+0000 7fdd8d600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 0x7fdd8819aca0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009dc0 tx=0x7fdd80032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.020+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80003bf0 con 0x7fdd8819a7f0 2024-04-23T15:45:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.020+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd80003d90 con 0x7fdd8819a7f0 2024-04-23T15:45:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.020+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8819b610 con 0x7fdd8819a7f0 2024-04-23T15:45:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.020+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80030b80 con 0x7fdd8819a7f0 2024-04-23T15:45:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.020+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd881a77f0 con 0x7fdd8819a7f0 2024-04-23T15:45:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.021+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd88105920 con 0x7fdd8819a7f0 2024-04-23T15:45:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.023+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fdd80004040 con 0x7fdd8819a7f0 2024-04-23T15:45:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.024+0000 7fdd85600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd700a3d20 0x7fdd700a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.025+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7fdd800f2190 con 0x7fdd8819a7f0 2024-04-23T15:45:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.025+0000 7fdd8cc00640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd700a3d20 0x7fdd700a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.025+0000 7fdd8cc00640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd700a3d20 0x7fdd700a61e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009c20 tx=0x7fdd7c005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.029+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdd800be530 con 0x7fdd8819a7f0 2024-04-23T15:45:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.239+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd88104e00 con 0x7fdd8819a7f0 2024-04-23T15:45:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.240+0000 7fdd85600640 1 -- 172.21.15.7:0/3099638461 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) ==== 93+0+10 (secure 0 0 0) 0x7fdd800bde30 con 0x7fdd8819a7f0 2024-04-23T15:45:03.241 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T15:45:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd700a3d20 msgr2=0x7fdd700a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd700a3d20 0x7fdd700a61e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009c20 tx=0x7fdd7c005f90 comp rx=0 tx=0).stop 2024-04-23T15:45:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 msgr2=0x7fdd8819aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 0x7fdd8819aca0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009dc0 tx=0x7fdd80032ff0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 shutdown_connections 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fdd700a3d20 0x7fdd700a61e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd88109520 0x7fdd881a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd8819a7f0 0x7fdd8819aca0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 --2- 172.21.15.7:0/3099638461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd88104450 0x7fdd881a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 >> 172.21.15.7:0/3099638461 conn(0x7fdd880ffc70 msgr2=0x7fdd88101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 shutdown_connections 2024-04-23T15:45:03.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.243+0000 7fdd8f600640 1 -- 172.21.15.7:0/3099638461 wait complete. 2024-04-23T15:45:03.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T15:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:03 smithi137 ceph-mon[31694]: pgmap v1701: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 24 op/s 2024-04-23T15:45:03.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:03 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3341997985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 -- 172.21.15.7:0/786400979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f801071f0 msgr2=0x7f7f8010edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 --2- 172.21.15.7:0/786400979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f801071f0 0x7f7f8010edc0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009900 tx=0x7f7f7802a410 comp rx=0 tx=0).stop 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 -- 172.21.15.7:0/786400979 shutdown_connections 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 --2- 172.21.15.7:0/786400979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80102ad0 0x7f7f80106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 --2- 172.21.15.7:0/786400979 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f801071f0 0x7f7f8010edc0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 --2- 172.21.15.7:0/786400979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f80102120 0x7f7f80102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 -- 172.21.15.7:0/786400979 >> 172.21.15.7:0/786400979 conn(0x7f7f800fd9a0 msgr2=0x7f7f800ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 -- 172.21.15.7:0/786400979 shutdown_connections 2024-04-23T15:45:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.482+0000 7f7f7f200640 1 -- 172.21.15.7:0/786400979 wait complete. 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.483+0000 7f7f7f200640 1 Processor -- start 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.483+0000 7f7f7f200640 1 -- start start 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 0x7f7f80074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f801071f0 0x7f7f80074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80074d80 0x7f7f801a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80112140 con 0x7f7f80102120 2024-04-23T15:45:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80111fc0 con 0x7f7f80074d80 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801122c0 con 0x7f7f801071f0 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 0x7f7f80074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 0x7f7f80074300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44432/0 (socket says 172.21.15.7:44432) 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.484+0000 7f7f7de00640 1 -- 172.21.15.7:0/3913890534 learned_addr learned my addr 172.21.15.7:0/3913890534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7d400640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f801071f0 0x7f7f80074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7e800640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80074d80 0x7f7f801a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7de00640 1 -- 172.21.15.7:0/3913890534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f801071f0 msgr2=0x7f7f80074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7de00640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f801071f0 0x7f7f80074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7de00640 1 -- 172.21.15.7:0/3913890534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80074d80 msgr2=0x7f7f801a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7de00640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80074d80 0x7f7f801a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7de00640 1 -- 172.21.15.7:0/3913890534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f801a6f70 con 0x7f7f80102120 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7e800640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80074d80 0x7f7f801a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7de00640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 0x7f7f80074300 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000eab0 tx=0x7f7f7000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ce40 con 0x7f7f80102120 2024-04-23T15:45:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f801a7260 con 0x7f7f80102120 2024-04-23T15:45:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f70011920 con 0x7f7f80102120 2024-04-23T15:45:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.485+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70010a00 con 0x7f7f80102120 2024-04-23T15:45:03.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.486+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801a77b0 con 0x7f7f80102120 2024-04-23T15:45:03.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.487+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f80069190 con 0x7f7f80102120 2024-04-23T15:45:03.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.489+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7f70011ad0 con 0x7f7f80102120 2024-04-23T15:45:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.490+0000 7f7f76a00640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7f640a3d50 0x7f7f640a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.491+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f7f700d12f0 con 0x7f7f80102120 2024-04-23T15:45:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.491+0000 7f7f7d400640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7f640a3d50 0x7f7f640a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.491+0000 7f7f7d400640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7f640a3d50 0x7f7f640a6210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005fd0 tx=0x7f7f68005850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.495+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7f70016030 con 0x7f7f80102120 2024-04-23T15:45:03.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:03 smithi007 ceph-mon[27906]: pgmap v1701: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 24 op/s 2024-04-23T15:45:03.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:03 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3341997985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:03 smithi186 ceph-mon[31814]: pgmap v1701: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 24 op/s 2024-04-23T15:45:03.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:03 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3341997985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.702+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f8010a4d0 con 0x7f7f80102120 2024-04-23T15:45:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.703+0000 7f7f76a00640 1 -- 172.21.15.7:0/3913890534 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v182) ==== 104+0+11 (secure 0 0 0) 0x7f7f8010a4d0 con 0x7f7f80102120 2024-04-23T15:45:03.703 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.705+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7f640a3d50 msgr2=0x7f7f640a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.705+0000 7f7f7f200640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7f640a3d50 0x7f7f640a6210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005fd0 tx=0x7f7f68005850 comp rx=0 tx=0).stop 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.705+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 msgr2=0x7f7f80074300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.705+0000 7f7f7f200640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 0x7f7f80074300 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000eab0 tx=0x7f7f7000ef70 comp rx=0 tx=0).stop 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 shutdown_connections 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7f640a3d50 0x7f7f640a6210 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f80074d80 0x7f7f801a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f801071f0 0x7f7f80074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 --2- 172.21.15.7:0/3913890534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f80102120 0x7f7f80074300 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 >> 172.21.15.7:0/3913890534 conn(0x7f7f800fd9a0 msgr2=0x7f7f800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 shutdown_connections 2024-04-23T15:45:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.706+0000 7f7f7f200640 1 -- 172.21.15.7:0/3913890534 wait complete. 2024-04-23T15:45:03.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 -- 172.21.15.7:0/3180433994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481019c0 msgr2=0x7fb748105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 --2- 172.21.15.7:0/3180433994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481019c0 0x7fb748105a00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fb734009900 tx=0x7fb73402a410 comp rx=0 tx=0).stop 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 -- 172.21.15.7:0/3180433994 shutdown_connections 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 --2- 172.21.15.7:0/3180433994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7481060e0 0x7fb74810dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 --2- 172.21.15.7:0/3180433994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481019c0 0x7fb748105a00 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 --2- 172.21.15.7:0/3180433994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb748101010 0x7fb7481013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 -- 172.21.15.7:0/3180433994 >> 172.21.15.7:0/3180433994 conn(0x7fb7480fc850 msgr2=0x7fb7480fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 -- 172.21.15.7:0/3180433994 shutdown_connections 2024-04-23T15:45:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.936+0000 7fb74d400640 1 -- 172.21.15.7:0/3180433994 wait complete. 2024-04-23T15:45:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.937+0000 7fb74d400640 1 Processor -- start 2024-04-23T15:45:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 -- start start 2024-04-23T15:45:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb748101010 0x7fb7481a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 0x7fb7481a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb74819a710 0x7fb74819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb748111000 con 0x7fb7481060e0 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb748110e80 con 0x7fb748101010 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb74d400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb748111180 con 0x7fb74819a710 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb747400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 0x7fb7481a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb747400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 0x7fb7481a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44454/0 (socket says 172.21.15.7:44454) 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb747400640 1 -- 172.21.15.7:0/1003238053 learned_addr learned my addr 172.21.15.7:0/1003238053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.938+0000 7fb747e00640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb748101010 0x7fb7481a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb74ca00640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb74819a710 0x7fb74819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb747400640 1 -- 172.21.15.7:0/1003238053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb74819a710 msgr2=0x7fb74819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb747400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb74819a710 0x7fb74819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb747400640 1 -- 172.21.15.7:0/1003238053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb748101010 msgr2=0x7fb7481a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb747400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb748101010 0x7fb7481a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb747400640 1 -- 172.21.15.7:0/1003238053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74819b310 con 0x7fb7481060e0 2024-04-23T15:45:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb747400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 0x7fb7481a0b90 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb734004270 tx=0x7fb7340042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73403f030 con 0x7fb7481060e0 2024-04-23T15:45:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7340044c0 con 0x7fb7481060e0 2024-04-23T15:45:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.939+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734035070 con 0x7fb7481060e0 2024-04-23T15:45:03.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.940+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74819b5a0 con 0x7fb7481060e0 2024-04-23T15:45:03.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.940+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7481a7690 con 0x7fb7481060e0 2024-04-23T15:45:03.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.941+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7481024e0 con 0x7fb7481060e0 2024-04-23T15:45:03.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.943+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb734042030 con 0x7fb7481060e0 2024-04-23T15:45:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.944+0000 7fb744c00640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb72c0a3da0 0x7fb72c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.944+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7fb7340f14b0 con 0x7fb7481060e0 2024-04-23T15:45:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.945+0000 7fb747e00640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb72c0a3da0 0x7fb72c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.945+0000 7fb747e00640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb72c0a3da0 0x7fb72c0a6260 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb738005fd0 tx=0x7fb73800b590 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:03.947+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb7340bd740 con 0x7fb7481060e0 2024-04-23T15:45:04.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.147+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb7481040e0 con 0x7fb7481060e0 2024-04-23T15:45:04.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.148+0000 7fb744c00640 1 -- 172.21.15.7:0/1003238053 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v182) ==== 100+0+11 (secure 0 0 0) 0x7fb7340bd040 con 0x7fb7481060e0 2024-04-23T15:45:04.148 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T15:45:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb72c0a3da0 msgr2=0x7fb72c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb72c0a3da0 0x7fb72c0a6260 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb738005fd0 tx=0x7fb73800b590 comp rx=0 tx=0).stop 2024-04-23T15:45:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 msgr2=0x7fb7481a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 0x7fb7481a0b90 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb734004270 tx=0x7fb7340042a0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 shutdown_connections 2024-04-23T15:45:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb72c0a3da0 0x7fb72c0a6260 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb74819a710 0x7fb74819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7481060e0 0x7fb7481a0b90 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 --2- 172.21.15.7:0/1003238053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb748101010 0x7fb7481a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 >> 172.21.15.7:0/1003238053 conn(0x7fb7480fc850 msgr2=0x7fb7480fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 shutdown_connections 2024-04-23T15:45:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.151+0000 7fb74d400640 1 -- 172.21.15.7:0/1003238053 wait complete. 2024-04-23T15:45:04.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 -- 172.21.15.7:0/2530361678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc107310 msgr2=0x7fa4bc10eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/2530361678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc107310 0x7fa4bc10eee0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009ca0 tx=0x7fa4b402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 -- 172.21.15.7:0/2530361678 shutdown_connections 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/2530361678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4bc102bf0 0x7fa4bc106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/2530361678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc107310 0x7fa4bc10eee0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/2530361678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4bc102240 0x7fa4bc102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 -- 172.21.15.7:0/2530361678 >> 172.21.15.7:0/2530361678 conn(0x7fa4bc079450 msgr2=0x7fa4bc079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 -- 172.21.15.7:0/2530361678 shutdown_connections 2024-04-23T15:45:04.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.374+0000 7fa4c0e00640 1 -- 172.21.15.7:0/2530361678 wait complete. 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.375+0000 7fa4c0e00640 1 Processor -- start 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.375+0000 7fa4c0e00640 1 -- start start 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4c0e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4bc102240 0x7fa4bc074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4c0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4bc107310 0x7fa4bc074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4c0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 0x7fa4bc1a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4c0e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1122b0 con 0x7fa4bc074d80 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4c0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc112130 con 0x7fa4bc107310 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4c0e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc112430 con 0x7fa4bc102240 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4ba800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 0x7fa4bc1a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4ba800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 0x7fa4bc1a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44486/0 (socket says 172.21.15.7:44486) 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4ba800640 1 -- 172.21.15.7:0/3143796407 learned_addr learned my addr 172.21.15.7:0/3143796407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:04.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4b3e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4bc107310 0x7fa4bc074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.376+0000 7fa4b9e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4bc102240 0x7fa4bc074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4ba800640 1 -- 172.21.15.7:0/3143796407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4bc102240 msgr2=0x7fa4bc074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4ba800640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4bc102240 0x7fa4bc074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4ba800640 1 -- 172.21.15.7:0/3143796407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4bc107310 msgr2=0x7fa4bc074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4ba800640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4bc107310 0x7fa4bc074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4ba800640 1 -- 172.21.15.7:0/3143796407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc1a7000 con 0x7fa4bc074d80 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4ba800640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 0x7fa4bc1a6900 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4031040 tx=0x7fa4b4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4003ce0 con 0x7fa4bc074d80 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4b40044f0 con 0x7fa4bc074d80 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4030c90 con 0x7fa4bc074d80 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc1a7290 con 0x7fa4bc074d80 2024-04-23T15:45:04.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.377+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc1a7790 con 0x7fa4bc074d80 2024-04-23T15:45:04.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.378+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc069270 con 0x7fa4bc074d80 2024-04-23T15:45:04.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.380+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fa4b40046a0 con 0x7fa4bc074d80 2024-04-23T15:45:04.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.383+0000 7fa4b2a00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4a00a3dd0 0x7fa4a00a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.383+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7fa4b40f2130 con 0x7fa4bc074d80 2024-04-23T15:45:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.383+0000 7fa4b9e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4a00a3dd0 0x7fa4a00a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.384+0000 7fa4b9e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4a00a3dd0 0x7fa4a00a6290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac005e10 tx=0x7fa4ac005da0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.387+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa4b40be4d0 con 0x7fa4bc074d80 2024-04-23T15:45:04.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:04 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3099638461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:45:04.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:04 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3913890534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:45:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:04 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3099638461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:45:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:04 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3913890534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:45:04.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.594+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa4bc102bf0 con 0x7fa4bc074d80 2024-04-23T15:45:04.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.595+0000 7fa4b2a00640 1 -- 172.21.15.7:0/3143796407 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v182) ==== 103+0+11 (secure 0 0 0) 0x7fa4b40098b0 con 0x7fa4bc074d80 2024-04-23T15:45:04.595 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T15:45:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.597+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4a00a3dd0 msgr2=0x7fa4a00a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.597+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4a00a3dd0 0x7fa4a00a6290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac005e10 tx=0x7fa4ac005da0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.597+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 msgr2=0x7fa4bc1a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.597+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 0x7fa4bc1a6900 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4031040 tx=0x7fa4b4003970 comp rx=0 tx=0).stop 2024-04-23T15:45:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 shutdown_connections 2024-04-23T15:45:04.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fa4a00a3dd0 0x7fa4a00a6290 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4bc107310 0x7fa4bc074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc074d80 0x7fa4bc1a6900 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 --2- 172.21.15.7:0/3143796407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4bc102240 0x7fa4bc074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 >> 172.21.15.7:0/3143796407 conn(0x7fa4bc079450 msgr2=0x7fa4bc0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 shutdown_connections 2024-04-23T15:45:04.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.598+0000 7fa4c0e00640 1 -- 172.21.15.7:0/3143796407 wait complete. 2024-04-23T15:45:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:04 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3099638461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:45:04.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:04 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3913890534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:45:04.618 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T15:45:04.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 -- 172.21.15.7:0/702152351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 msgr2=0x7f02ac10e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 --2- 172.21.15.7:0/702152351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac10e920 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009900 tx=0x7f02a402a480 comp rx=0 tx=0).stop 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 -- 172.21.15.7:0/702152351 shutdown_connections 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 --2- 172.21.15.7:0/702152351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac10e920 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 --2- 172.21.15.7:0/702152351 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02ac103980 0x7f02ac10be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 --2- 172.21.15.7:0/702152351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 0x7f02ac103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 -- 172.21.15.7:0/702152351 >> 172.21.15.7:0/702152351 conn(0x7f02ac0fc880 msgr2=0x7f02ac0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 -- 172.21.15.7:0/702152351 shutdown_connections 2024-04-23T15:45:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.832+0000 7f02abe00640 1 -- 172.21.15.7:0/702152351 wait complete. 2024-04-23T15:45:04.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.833+0000 7f02abe00640 1 Processor -- start 2024-04-23T15:45:04.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.833+0000 7f02abe00640 1 -- start start 2024-04-23T15:45:04.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02abe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 0x7f02ac1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02abe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02ac103980 0x7f02ac1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02abe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02abe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac112140 con 0x7f02ac10c480 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02abe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac111fc0 con 0x7f02ac103060 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02abe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac1122c0 con 0x7f02ac103980 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02ab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02ab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44502/0 (socket says 172.21.15.7:44502) 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02ab400640 1 -- 172.21.15.7:0/1773796692 learned_addr learned my addr 172.21.15.7:0/1773796692 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.834+0000 7f02aaa00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 0x7f02ac1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02aa000640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02ac103980 0x7f02ac1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02ab400640 1 -- 172.21.15.7:0/1773796692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02ac103980 msgr2=0x7f02ac1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02ab400640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02ac103980 0x7f02ac1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02ab400640 1 -- 172.21.15.7:0/1773796692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 msgr2=0x7f02ac1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02ab400640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 0x7f02ac1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02ab400640 1 -- 172.21.15.7:0/1773796692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac19ad90 con 0x7f02ac10c480 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02aaa00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 0x7f02ac1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:45:04.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02ab400640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac19a610 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f02a402a9a0 tx=0x7f02a4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.835+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a403f070 con 0x7f02ac10c480 2024-04-23T15:45:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.836+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02a4031d60 con 0x7f02ac10c480 2024-04-23T15:45:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.836+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4035030 con 0x7f02ac10c480 2024-04-23T15:45:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.836+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ac19b020 con 0x7f02ac10c480 2024-04-23T15:45:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.836+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ac1a7320 con 0x7f02ac10c480 2024-04-23T15:45:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.837+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ac068d40 con 0x7f02ac10c480 2024-04-23T15:45:04.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.839+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f02a4042070 con 0x7f02ac10c480 2024-04-23T15:45:04.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.840+0000 7f02b0a00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f028c0a3da0 0x7f028c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:04.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.841+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f02a40f1480 con 0x7f02ac10c480 2024-04-23T15:45:04.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.841+0000 7f02aaa00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f028c0a3da0 0x7f028c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:04.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.842+0000 7f02aaa00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f028c0a3da0 0x7f028c0a6260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f029c0058c0 tx=0x7f029c005850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:04.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:04.845+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f02a40bd770 con 0x7f02ac10c480 2024-04-23T15:45:05.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.070+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02ac1a7520 con 0x7f02ac10c480 2024-04-23T15:45:05.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.071+0000 7f02b0a00640 1 -- 172.21.15.7:0/1773796692 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v182) ==== 81+0+926 (secure 0 0 0) 0x7f02a40bd070 con 0x7f02ac10c480 2024-04-23T15:45:05.071 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/53488990 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3733281875 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3240450123 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3440122157 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3573875988 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/890429947 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2805710934 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/147420039 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3440122157 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4250737482 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3290686917 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1124398484 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:05.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:05.073 INFO:teuthology.orchestra.run.smithi007.stderr:listed 16 entries 2024-04-23T15:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.073+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f028c0a3da0 msgr2=0x7f028c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.073+0000 7f02abe00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f028c0a3da0 0x7f028c0a6260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f029c0058c0 tx=0x7f029c005850 comp rx=0 tx=0).stop 2024-04-23T15:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.073+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 msgr2=0x7f02ac19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.073+0000 7f02abe00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac19a610 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f02a402a9a0 tx=0x7f02a4003cd0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 shutdown_connections 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f028c0a3da0 0x7f028c0a6260 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02ac10c480 0x7f02ac19a610 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02ac103980 0x7f02ac1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 --2- 172.21.15.7:0/1773796692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac103060 0x7f02ac1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 >> 172.21.15.7:0/1773796692 conn(0x7f02ac0fc880 msgr2=0x7f02ac100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 shutdown_connections 2024-04-23T15:45:05.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.074+0000 7f02abe00640 1 -- 172.21.15.7:0/1773796692 wait complete. 2024-04-23T15:45:05.095 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-23T15:45:05.095 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:45:05.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:45:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.367+0000 7f54fd000640 1 -- 172.21.15.7:0/3961005066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 msgr2=0x7f54f8115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.367+0000 7f54fd000640 1 --2- 172.21.15.7:0/3961005066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f8115090 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009ca0 tx=0x7f54f002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 -- 172.21.15.7:0/3961005066 shutdown_connections 2024-04-23T15:45:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 --2- 172.21.15.7:0/3961005066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076e50 0x7f54f8112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 --2- 172.21.15.7:0/3961005066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f8115090 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 --2- 172.21.15.7:0/3961005066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076530 0x7f54f8076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 -- 172.21.15.7:0/3961005066 >> 172.21.15.7:0/3961005066 conn(0x7f54f80ffad0 msgr2=0x7f54f8101ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 -- 172.21.15.7:0/3961005066 shutdown_connections 2024-04-23T15:45:05.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.368+0000 7f54fd000640 1 -- 172.21.15.7:0/3961005066 wait complete. 2024-04-23T15:45:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 Processor -- start 2024-04-23T15:45:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 -- start start 2024-04-23T15:45:05.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076530 0x7f54f81a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076e50 0x7f54f81a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81186c0 con 0x7f54f8112ca0 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8118540 con 0x7f54f8076530 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.369+0000 7f54fd000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8118840 con 0x7f54f8076e50 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44534/0 (socket says 172.21.15.7:44534) 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 -- 172.21.15.7:0/3435712294 learned_addr learned my addr 172.21.15.7:0/3435712294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7400640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076530 0x7f54f81a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f6a00640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076e50 0x7f54f81a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 -- 172.21.15.7:0/3435712294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076e50 msgr2=0x7f54f81a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076e50 0x7f54f81a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 -- 172.21.15.7:0/3435712294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076530 msgr2=0x7f54f81a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076530 0x7f54f81a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7e00640 1 -- 172.21.15.7:0/3435712294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f819f220 con 0x7f54f8112ca0 2024-04-23T15:45:05.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f7400640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076530 0x7f54f81a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:45:05.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.370+0000 7f54f6a00640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076e50 0x7f54f81a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:45:05.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.371+0000 7f54f7e00640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f819eaa0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f54f0031040 tx=0x7f54f0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.371+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0003ce0 con 0x7f54f8112ca0 2024-04-23T15:45:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.371+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54f00044f0 con 0x7f54f8112ca0 2024-04-23T15:45:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.371+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f819f4b0 con 0x7f54f8112ca0 2024-04-23T15:45:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.371+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0030c60 con 0x7f54f8112ca0 2024-04-23T15:45:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.371+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f81ab760 con 0x7f54f8112ca0 2024-04-23T15:45:05.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.372+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f8069190 con 0x7f54f8112ca0 2024-04-23T15:45:05.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.374+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f54f00046a0 con 0x7f54f8112ca0 2024-04-23T15:45:05.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.376+0000 7f54efe00640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f54dc0a3d20 0x7f54dc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.376+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f54f00f1ff0 con 0x7f54f8112ca0 2024-04-23T15:45:05.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.376+0000 7f54f7400640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f54dc0a3d20 0x7f54dc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.377+0000 7f54f7400640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f54dc0a3d20 0x7f54dc0a61e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f54e8005fd0 tx=0x7f54e8005850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:05.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.380+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f54f00be3f0 con 0x7f54f8112ca0 2024-04-23T15:45:05.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:05 smithi137 ceph-mon[31694]: pgmap v1702: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T15:45:05.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1003238053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:45:05.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3143796407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:45:05.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:05 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1773796692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:45:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:05 smithi007 ceph-mon[27906]: pgmap v1702: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T15:45:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1003238053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:45:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3143796407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:45:05.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:05 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1773796692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:45:05.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.588+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54f810d8a0 con 0x7f54f8112ca0 2024-04-23T15:45:05.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.591+0000 7f54efe00640 1 -- 172.21.15.7:0/3435712294 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+25192 (secure 0 0 0) 0x7f54f00098b0 con 0x7f54f8112ca0 2024-04-23T15:45:05.592 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:45:05.592 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":182,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T15:44:21.443171+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":100,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":100,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/53488990":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3733281875":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3240450123":"2024-04-24T14:51:20.179514+0000","172.21.15.7:6801/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3573875988":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":87,"length":1},{"begin":100,"length":1}]},{"pool":4,"snaps":[{"begin":87,"length":1},{"begin":100,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f54dc0a3d20 msgr2=0x7f54dc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f54dc0a3d20 0x7f54dc0a61e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f54e8005fd0 tx=0x7f54e8005850 comp rx=0 tx=0).stop 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 msgr2=0x7f54f819eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f819eaa0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f54f0031040 tx=0x7f54f0003970 comp rx=0 tx=0).stop 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 shutdown_connections 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f54dc0a3d20 0x7f54dc0a61e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54f8112ca0 0x7f54f819eaa0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54f8076e50 0x7f54f81a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 --2- 172.21.15.7:0/3435712294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f8076530 0x7f54f81a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 >> 172.21.15.7:0/3435712294 conn(0x7f54f80ffad0 msgr2=0x7f54f8114390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 shutdown_connections 2024-04-23T15:45:05.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.594+0000 7f54fd000640 1 -- 172.21.15.7:0/3435712294 wait complete. 2024-04-23T15:45:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:05 smithi186 ceph-mon[31814]: pgmap v1702: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T15:45:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1003238053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:45:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3143796407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:45:05.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:05 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1773796692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:45:05.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:41:56.325786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T14:48:21.290632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T14:48:22.601707+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 100, 'snap_epoch': 181, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T14:48:26.649609+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 100, 'snap_epoch': 181, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T15:45:05.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T15:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 -- 172.21.15.7:0/1255580873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 msgr2=0x7fcf74101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1255580873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf74101240 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009900 tx=0x7fcf6402a3f0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 -- 172.21.15.7:0/1255580873 shutdown_connections 2024-04-23T15:45:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1255580873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 0x7fcf74110e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1255580873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 0x7fcf7410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1255580873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf74101240 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 -- 172.21.15.7:0/1255580873 >> 172.21.15.7:0/1255580873 conn(0x7fcf74078060 msgr2=0x7fcf74078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 -- 172.21.15.7:0/1255580873 shutdown_connections 2024-04-23T15:45:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.825+0000 7fcf7b200640 1 -- 172.21.15.7:0/1255580873 wait complete. 2024-04-23T15:45:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.826+0000 7fcf7b200640 1 Processor -- start 2024-04-23T15:45:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.826+0000 7fcf7b200640 1 -- start start 2024-04-23T15:45:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.826+0000 7fcf7b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf741a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.826+0000 7fcf7b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 0x7fcf741a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.826+0000 7fcf7b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 0x7fcf7419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf7b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741144b0 con 0x7fcf74100e60 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf7b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74114330 con 0x7fcf7410ea10 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf7b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74114630 con 0x7fcf74101780 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf741a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf741a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44558/0 (socket says 172.21.15.7:44558) 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 -- 172.21.15.7:0/1232388160 learned_addr learned my addr 172.21.15.7:0/1232388160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73400640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 0x7fcf741a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf79200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 0x7fcf7419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 -- 172.21.15.7:0/1232388160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 msgr2=0x7fcf741a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 0x7fcf741a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 -- 172.21.15.7:0/1232388160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 msgr2=0x7fcf7419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 0x7fcf7419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73e00640 1 -- 172.21.15.7:0/1232388160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7419afc0 con 0x7fcf74100e60 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf73400640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 0x7fcf741a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.827+0000 7fcf79200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 0x7fcf7419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.828+0000 7fcf73e00640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf741a0680 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fcf64005940 tx=0x7fcf640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.828+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6403f030 con 0x7fcf74100e60 2024-04-23T15:45:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.828+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf64003cb0 con 0x7fcf74100e60 2024-04-23T15:45:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.828+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7419b250 con 0x7fcf74100e60 2024-04-23T15:45:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.828+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64035070 con 0x7fcf74100e60 2024-04-23T15:45:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.828+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf741a74d0 con 0x7fcf74100e60 2024-04-23T15:45:05.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.829+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf7406aa80 con 0x7fcf74100e60 2024-04-23T15:45:05.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.831+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fcf64042030 con 0x7fcf74100e60 2024-04-23T15:45:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.833+0000 7fcf70c00640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf540a3d20 0x7fcf540a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.833+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7fcf640f1470 con 0x7fcf74100e60 2024-04-23T15:45:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.833+0000 7fcf73400640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf540a3d20 0x7fcf540a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.834+0000 7fcf73400640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf540a3d20 0x7fcf540a61e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf741028b0 tx=0x7fcf5c005d90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:05.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:05.837+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcf640bd800 con 0x7fcf74100e60 2024-04-23T15:45:06.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.048+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf74109ba0 con 0x7fcf74100e60 2024-04-23T15:45:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.049+0000 7fcf70c00640 1 -- 172.21.15.7:0/1232388160 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) ==== 93+0+10 (secure 0 0 0) 0x7fcf640bd100 con 0x7fcf74100e60 2024-04-23T15:45:06.049 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-23T15:45:06.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.051+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf540a3d20 msgr2=0x7fcf540a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.051+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf540a3d20 0x7fcf540a61e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf741028b0 tx=0x7fcf5c005d90 comp rx=0 tx=0).stop 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.051+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 msgr2=0x7fcf741a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.051+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf741a0680 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fcf64005940 tx=0x7fcf640042f0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 shutdown_connections 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fcf540a3d20 0x7fcf540a61e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf7410ea10 0x7fcf7419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf74101780 0x7fcf741a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 --2- 172.21.15.7:0/1232388160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf74100e60 0x7fcf741a0680 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 >> 172.21.15.7:0/1232388160 conn(0x7fcf74078060 msgr2=0x7fcf7410ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 shutdown_connections 2024-04-23T15:45:06.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.052+0000 7fcf7b200640 1 -- 172.21.15.7:0/1232388160 wait complete. 2024-04-23T15:45:06.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T15:45:06.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 -- 172.21.15.7:0/3752598968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec107470 msgr2=0x7f78ec10ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 --2- 172.21.15.7:0/3752598968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec107470 0x7f78ec10ef60 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009ca0 tx=0x7f78e402a8c0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 -- 172.21.15.7:0/3752598968 shutdown_connections 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 --2- 172.21.15.7:0/3752598968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec107470 0x7f78ec10ef60 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 --2- 172.21.15.7:0/3752598968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec100d60 0x7f78ec106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 --2- 172.21.15.7:0/3752598968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78ec1003b0 0x7f78ec100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 -- 172.21.15.7:0/3752598968 >> 172.21.15.7:0/3752598968 conn(0x7f78ec077060 msgr2=0x7f78ec0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 -- 172.21.15.7:0/3752598968 shutdown_connections 2024-04-23T15:45:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.293+0000 7f78f2600640 1 -- 172.21.15.7:0/3752598968 wait complete. 2024-04-23T15:45:06.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.294+0000 7f78f2600640 1 Processor -- start 2024-04-23T15:45:06.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 -- start start 2024-04-23T15:45:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 0x7f78ec1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec107470 0x7f78ec1a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78ec19a970 0x7f78ec19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec112350 con 0x7f78ec1003b0 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1121d0 con 0x7f78ec19a970 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78f2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1124d0 con 0x7f78ec107470 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.295+0000 7f78eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 0x7f78ec1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 0x7f78ec1a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44582/0 (socket says 172.21.15.7:44582) 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 -- 172.21.15.7:0/37738197 learned_addr learned my addr 172.21.15.7:0/37738197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eaa00640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec107470 0x7f78ec1a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78ebe00640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78ec19a970 0x7f78ec19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 -- 172.21.15.7:0/37738197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec107470 msgr2=0x7f78ec1a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec107470 0x7f78ec1a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 -- 172.21.15.7:0/37738197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78ec19a970 msgr2=0x7f78ec19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78ec19a970 0x7f78ec19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 -- 172.21.15.7:0/37738197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec19b490 con 0x7f78ec1003b0 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eaa00640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec107470 0x7f78ec1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.296+0000 7f78eb400640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 0x7f78ec1a07c0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00d950 tx=0x7f78dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.297+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc017070 con 0x7f78ec1003b0 2024-04-23T15:45:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.297+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78dc009c30 con 0x7f78ec1003b0 2024-04-23T15:45:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.297+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00f620 con 0x7f78ec1003b0 2024-04-23T15:45:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.297+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec19b780 con 0x7f78ec1003b0 2024-04-23T15:45:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.297+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec1a7980 con 0x7f78ec1003b0 2024-04-23T15:45:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.298+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ec069270 con 0x7f78ec1003b0 2024-04-23T15:45:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.300+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f78dc0109a0 con 0x7f78ec1003b0 2024-04-23T15:45:06.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.302+0000 7f78e3e00640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78d00a3da0 0x7f78d00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.303+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f78dc0d0880 con 0x7f78ec1003b0 2024-04-23T15:45:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.303+0000 7f78eaa00640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78d00a3da0 0x7f78d00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.303+0000 7f78eaa00640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78d00a3da0 0x7f78d00a6260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f78d8005fd0 tx=0x7f78d80094d0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:06.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.307+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f78dc009de0 con 0x7f78ec1003b0 2024-04-23T15:45:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:06 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3435712294' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:06.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:06 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1232388160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:45:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:06 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3435712294' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:06.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:06 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1232388160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:45:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.515+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f78ec100d60 con 0x7f78ec1003b0 2024-04-23T15:45:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.516+0000 7f78e3e00640 1 -- 172.21.15.7:0/37738197 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v182) ==== 104+0+11 (secure 0 0 0) 0x7f78dc09cb10 con 0x7f78ec1003b0 2024-04-23T15:45:06.516 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T15:45:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78d00a3da0 msgr2=0x7f78d00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78d00a3da0 0x7f78d00a6260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f78d8005fd0 tx=0x7f78d80094d0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 msgr2=0x7f78ec1a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 0x7f78ec1a07c0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00d950 tx=0x7f78dc00de10 comp rx=0 tx=0).stop 2024-04-23T15:45:06.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 shutdown_connections 2024-04-23T15:45:06.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f78d00a3da0 0x7f78d00a6260 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78ec19a970 0x7f78ec19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78ec107470 0x7f78ec1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.518+0000 7f78f2600640 1 --2- 172.21.15.7:0/37738197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78ec1003b0 0x7f78ec1a07c0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.519+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 >> 172.21.15.7:0/37738197 conn(0x7f78ec077060 msgr2=0x7f78ec105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.519+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 shutdown_connections 2024-04-23T15:45:06.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.519+0000 7f78f2600640 1 -- 172.21.15.7:0/37738197 wait complete. 2024-04-23T15:45:06.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T15:45:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:06 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3435712294' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:06.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:06 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1232388160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 -- 172.21.15.7:0/2484871188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c104e60 msgr2=0x7fbd3c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2484871188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c104e60 0x7fbd3c108ea0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009ca0 tx=0x7fbd2402a8b0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 -- 172.21.15.7:0/2484871188 shutdown_connections 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2484871188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3c109580 0x7fbd3c111150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2484871188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c104e60 0x7fbd3c108ea0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2484871188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 0x7fbd3c104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 -- 172.21.15.7:0/2484871188 >> 172.21.15.7:0/2484871188 conn(0x7fbd3c0ffd90 msgr2=0x7fbd3c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 -- 172.21.15.7:0/2484871188 shutdown_connections 2024-04-23T15:45:06.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.755+0000 7fbd42c00640 1 -- 172.21.15.7:0/2484871188 wait complete. 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.756+0000 7fbd42c00640 1 Processor -- start 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 -- start start 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 0x7fbd3c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 0x7fbd3c1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3c19a940 0x7fbd3c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1144f0 con 0x7fbd3c109580 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c114370 con 0x7fbd3c19a940 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd42c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c114670 con 0x7fbd3c1044b0 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd3b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 0x7fbd3c1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd3b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 0x7fbd3c1a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44610/0 (socket says 172.21.15.7:44610) 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd3b400640 1 -- 172.21.15.7:0/2240728403 learned_addr learned my addr 172.21.15.7:0/2240728403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.757+0000 7fbd40c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3c19a940 0x7fbd3c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3be00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 0x7fbd3c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3b400640 1 -- 172.21.15.7:0/2240728403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 msgr2=0x7fbd3c1a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3b400640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 0x7fbd3c1a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3b400640 1 -- 172.21.15.7:0/2240728403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3c19a940 msgr2=0x7fbd3c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3b400640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3c19a940 0x7fbd3c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3b400640 1 -- 172.21.15.7:0/2240728403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c19b460 con 0x7fbd3c109580 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3be00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 0x7fbd3c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd3b400640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 0x7fbd3c1a0c80 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000f80 tx=0x7fbd24003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24004240 con 0x7fbd3c109580 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd24040070 con 0x7fbd3c109580 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24045d90 con 0x7fbd3c109580 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.758+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c19b6f0 con 0x7fbd3c109580 2024-04-23T15:45:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.759+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c1a78f0 con 0x7fbd3c109580 2024-04-23T15:45:06.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.760+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c069270 con 0x7fbd3c109580 2024-04-23T15:45:06.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.762+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fbd240043e0 con 0x7fbd3c109580 2024-04-23T15:45:06.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.764+0000 7fbd38c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd1c0a3d20 0x7fbd1c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:06.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.764+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7fbd240f1d30 con 0x7fbd3c109580 2024-04-23T15:45:06.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.764+0000 7fbd3be00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd1c0a3d20 0x7fbd1c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:06.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.765+0000 7fbd3be00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd1c0a3d20 0x7fbd1c0a61e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c103480 tx=0x7fbd2c005e70 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:06.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.769+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd240be130 con 0x7fbd3c109580 2024-04-23T15:45:06.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.977+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd3c104e60 con 0x7fbd3c109580 2024-04-23T15:45:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.978+0000 7fbd38c00640 1 -- 172.21.15.7:0/2240728403 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v182) ==== 100+0+11 (secure 0 0 0) 0x7fbd240bda30 con 0x7fbd3c109580 2024-04-23T15:45:06.979 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-23T15:45:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd1c0a3d20 msgr2=0x7fbd1c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd1c0a3d20 0x7fbd1c0a61e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c103480 tx=0x7fbd2c005e70 comp rx=0 tx=0).stop 2024-04-23T15:45:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 msgr2=0x7fbd3c1a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 0x7fbd3c1a0c80 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000f80 tx=0x7fbd24003ba0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 shutdown_connections 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fbd1c0a3d20 0x7fbd1c0a61e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3c19a940 0x7fbd3c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd3c109580 0x7fbd3c1a0c80 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 --2- 172.21.15.7:0/2240728403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd3c1044b0 0x7fbd3c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 >> 172.21.15.7:0/2240728403 conn(0x7fbd3c0ffd90 msgr2=0x7fbd3c1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.981+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 shutdown_connections 2024-04-23T15:45:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:06.982+0000 7fbd42c00640 1 -- 172.21.15.7:0/2240728403 wait complete. 2024-04-23T15:45:07.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T15:45:07.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 -- 172.21.15.7:0/1945972224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 msgr2=0x7f332010d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 --2- 172.21.15.7:0/1945972224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332010d8e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f3314009930 tx=0x7f331402a420 comp rx=0 tx=0).stop 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 -- 172.21.15.7:0/1945972224 shutdown_connections 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 --2- 172.21.15.7:0/1945972224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3320108580 0x7f3320108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 --2- 172.21.15.7:0/1945972224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3320108f40 0x7f33201153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 --2- 172.21.15.7:0/1945972224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332010d8e0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 -- 172.21.15.7:0/1945972224 >> 172.21.15.7:0/1945972224 conn(0x7f3320077e20 msgr2=0x7f3320106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 -- 172.21.15.7:0/1945972224 shutdown_connections 2024-04-23T15:45:07.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.224+0000 7f3326200640 1 -- 172.21.15.7:0/1945972224 wait complete. 2024-04-23T15:45:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.225+0000 7f3326200640 1 Processor -- start 2024-04-23T15:45:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.225+0000 7f3326200640 1 -- start start 2024-04-23T15:45:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3326200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3320108580 0x7f33201a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3326200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3320108f40 0x7f33201a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3326200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3326200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33201187c0 con 0x7f332010d500 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3326200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3320118640 con 0x7f3320108f40 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3326200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3320118940 con 0x7f3320108580 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3325800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3325800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332019eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44624/0 (socket says 172.21.15.7:44624) 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.226+0000 7f3325800640 1 -- 172.21.15.7:0/1545395519 learned_addr learned my addr 172.21.15.7:0/1545395519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3324e00640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3320108580 0x7f33201a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f331fe00640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3320108f40 0x7f33201a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3325800640 1 -- 172.21.15.7:0/1545395519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3320108580 msgr2=0x7f33201a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3325800640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3320108580 0x7f33201a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3325800640 1 -- 172.21.15.7:0/1545395519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3320108f40 msgr2=0x7f33201a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3325800640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3320108f40 0x7f33201a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3325800640 1 -- 172.21.15.7:0/1545395519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332019f260 con 0x7f332010d500 2024-04-23T15:45:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f3325800640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332019eae0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f331800e960 tx=0x7f331800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:07.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.227+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3318004d20 con 0x7f332010d500 2024-04-23T15:45:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.228+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3318005020 con 0x7f332010d500 2024-04-23T15:45:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.228+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33180116d0 con 0x7f332010d500 2024-04-23T15:45:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.228+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332019f550 con 0x7f332010d500 2024-04-23T15:45:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.228+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33201ab7a0 con 0x7f332010d500 2024-04-23T15:45:07.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.229+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3320069190 con 0x7f332010d500 2024-04-23T15:45:07.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.231+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f33180051d0 con 0x7f332010d500 2024-04-23T15:45:07.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.232+0000 7f331d600640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33080a3da0 0x7f33080a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.233+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f33180d1090 con 0x7f332010d500 2024-04-23T15:45:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.233+0000 7f3324e00640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33080a3da0 0x7f33080a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.234+0000 7f3324e00640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33080a3da0 0x7f33080a6260 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3314009900 tx=0x7f3314000bc0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:07.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.237+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3318016030 con 0x7f332010d500 2024-04-23T15:45:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:07 smithi007 ceph-mon[27906]: pgmap v1703: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T15:45:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/37738197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:45:07.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:07 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2240728403' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:45:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:07 smithi186 ceph-mon[31814]: pgmap v1703: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T15:45:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/37738197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:45:07.363 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:07 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2240728403' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:45:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:07 smithi137 ceph-mon[31694]: pgmap v1703: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T15:45:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/37738197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T15:45:07.418 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:07 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2240728403' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T15:45:07.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.442+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f332002d620 con 0x7f332010d500 2024-04-23T15:45:07.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.443+0000 7f331d600640 1 -- 172.21.15.7:0/1545395519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v182) ==== 103+0+11 (secure 0 0 0) 0x7f331809d320 con 0x7f332010d500 2024-04-23T15:45:07.443 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-23T15:45:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33080a3da0 msgr2=0x7f33080a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33080a3da0 0x7f33080a6260 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3314009900 tx=0x7f3314000bc0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 msgr2=0x7f332019eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332019eae0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f331800e960 tx=0x7f331800ee20 comp rx=0 tx=0).stop 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 shutdown_connections 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f33080a3da0 0x7f33080a6260 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3320108f40 0x7f33201a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f332010d500 0x7f332019eae0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 --2- 172.21.15.7:0/1545395519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3320108580 0x7f33201a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.445+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 >> 172.21.15.7:0/1545395519 conn(0x7f3320077e20 msgr2=0x7f33200783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:07.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.446+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 shutdown_connections 2024-04-23T15:45:07.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.446+0000 7f3326200640 1 -- 172.21.15.7:0/1545395519 wait complete. 2024-04-23T15:45:07.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 -- 172.21.15.7:0/1663518828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 msgr2=0x7f7a60104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 --2- 172.21.15.7:0/1663518828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a60104700 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009900 tx=0x7f7a5402a410 comp rx=0 tx=0).stop 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 -- 172.21.15.7:0/1663518828 shutdown_connections 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 --2- 172.21.15.7:0/1663518828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 0x7f7a60110fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 --2- 172.21.15.7:0/1663518828 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a60104cd0 0x7f7a60108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 --2- 172.21.15.7:0/1663518828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a60104700 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 -- 172.21.15.7:0/1663518828 >> 172.21.15.7:0/1663518828 conn(0x7f7a600ffb40 msgr2=0x7f7a60101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 -- 172.21.15.7:0/1663518828 shutdown_connections 2024-04-23T15:45:07.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.677+0000 7f7a66000640 1 -- 172.21.15.7:0/1663518828 wait complete. 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.678+0000 7f7a66000640 1 Processor -- start 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.678+0000 7f7a66000640 1 -- start start 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a66000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a601a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a66000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 0x7f7a601a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a66000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a6019a730 0x7f7a6019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a66000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60114330 con 0x7f7a60104320 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a66000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a601141b0 con 0x7f7a601093f0 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a66000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a601144b0 con 0x7f7a6019a730 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a64c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a601a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a64c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a601a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44646/0 (socket says 172.21.15.7:44646) 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.679+0000 7f7a64c00640 1 -- 172.21.15.7:0/1544484865 learned_addr learned my addr 172.21.15.7:0/1544484865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a5fe00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 0x7f7a601a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a65600640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a6019a730 0x7f7a6019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a64c00640 1 -- 172.21.15.7:0/1544484865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a6019a730 msgr2=0x7f7a6019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a64c00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a6019a730 0x7f7a6019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a64c00640 1 -- 172.21.15.7:0/1544484865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 msgr2=0x7f7a601a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a64c00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 0x7f7a601a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a64c00640 1 -- 172.21.15.7:0/1544484865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6019b330 con 0x7f7a60104320 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a5fe00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 0x7f7a601a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a64c00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a601a0670 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f7a54005940 tx=0x7f7a54004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5403f030 con 0x7f7a60104320 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a54003aa0 con 0x7f7a60104320 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54035070 con 0x7f7a60104320 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.680+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6019b5c0 con 0x7f7a60104320 2024-04-23T15:45:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.681+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a601a7750 con 0x7f7a60104320 2024-04-23T15:45:07.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.682+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a601057f0 con 0x7f7a60104320 2024-04-23T15:45:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.684+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f7a54042030 con 0x7f7a60104320 2024-04-23T15:45:07.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.685+0000 7f7a5d600640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a480a3da0 0x7f7a480a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:07.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.685+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 9467+0+0 (secure 0 0 0) 0x7f7a540f0fb0 con 0x7f7a60104320 2024-04-23T15:45:07.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.685+0000 7f7a5fe00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a480a3da0 0x7f7a480a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.686+0000 7f7a5fe00640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a480a3da0 0x7f7a480a6260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7a6019bf80 tx=0x7f7a4c005e50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:07.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.690+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7a540bd2a0 con 0x7f7a60104320 2024-04-23T15:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.902+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7a6010c620 con 0x7f7a60104320 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.904+0000 7f7a5d600640 1 -- 172.21.15.7:0/1544484865 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v182) ==== 81+0+926 (secure 0 0 0) 0x7f7a540bcba0 con 0x7f7a60104320 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/53488990 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3733281875 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3240450123 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3440122157 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3573875988 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/890429947 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:07.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2805710934 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/147420039 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3440122157 2024-04-24T14:51:20.179514+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4250737482 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3290686917 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1124398484 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3246781913 2024-04-24T14:38:06.870414+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/2898788410 2024-04-24T14:38:42.138800+0000 2024-04-23T15:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:listed 16 entries 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a480a3da0 msgr2=0x7f7a480a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a480a3da0 0x7f7a480a6260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7a6019bf80 tx=0x7f7a4c005e50 comp rx=0 tx=0).stop 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 msgr2=0x7f7a601a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a601a0670 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f7a54005940 tx=0x7f7a54004270 comp rx=0 tx=0).stop 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 shutdown_connections 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f7a480a3da0 0x7f7a480a6260 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a601093f0 0x7f7a601a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a6019a730 0x7f7a6019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 --2- 172.21.15.7:0/1544484865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a60104320 0x7f7a601a0670 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.906+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 >> 172.21.15.7:0/1544484865 conn(0x7f7a600ffb40 msgr2=0x7f7a60100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.907+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 shutdown_connections 2024-04-23T15:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:07.907+0000 7f7a66000640 1 -- 172.21.15.7:0/1544484865 wait complete. 2024-04-23T15:45:07.925 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2024-04-23T15:45:07.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:45:07.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-23T15:45:08.022 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T15:45:08.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[79935]: fuse finished with error 0 and tester_r 0 2024-04-23T15:45:08.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1545395519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:45:08.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:08 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1544484865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:45:08.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1545395519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:45:08.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:08 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1544484865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:45:08.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1545395519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-23T15:45:08.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:08 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1544484865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:45:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:09 smithi007 ceph-mon[27906]: pgmap v1704: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-23T15:45:09.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:09 smithi007 ceph-mon[27906]: osdmap e183: 12 total, 12 up, 12 in 2024-04-23T15:45:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:09 smithi186 ceph-mon[31814]: pgmap v1704: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-23T15:45:09.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:09 smithi186 ceph-mon[31814]: osdmap e183: 12 total, 12 up, 12 in 2024-04-23T15:45:09.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:09 smithi137 ceph-mon[31694]: pgmap v1704: 129 pgs: 129 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-23T15:45:09.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:09 smithi137 ceph-mon[31694]: osdmap e183: 12 total, 12 up, 12 in 2024-04-23T15:45:11.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:11 smithi007 ceph-mon[27906]: pgmap v1706: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-23T15:45:11.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:11 smithi186 ceph-mon[31814]: pgmap v1706: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-23T15:45:11.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:11 smithi137 ceph-mon[31694]: pgmap v1706: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-23T15:45:13.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:13 smithi007 ceph-mon[27906]: pgmap v1707: 129 pgs: 14 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 76 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 29 KiB/s wr, 15 op/s 2024-04-23T15:45:13.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:13 smithi186 ceph-mon[31814]: pgmap v1707: 129 pgs: 14 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 76 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 29 KiB/s wr, 15 op/s 2024-04-23T15:45:13.667 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:13 smithi137 ceph-mon[31694]: pgmap v1707: 129 pgs: 14 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 76 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 29 KiB/s wr, 15 op/s 2024-04-23T15:45:14.123 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T15:45:14.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:45:14.124 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-23T15:45:14.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:45:14.211 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-23T15:45:14.316 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-23T15:45:14.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:45:14.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T15:45:14.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:45:14.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-04-23T15:45:14.561 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-23T15:45:14.581 INFO:tasks.cephadm:Teardown begin 2024-04-23T15:45:14.582 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-23T15:45:14.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T15:45:14.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.806+0000 7f29f3c00640 1 -- 172.21.15.7:0/1784438403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec104df0 msgr2=0x7f29ec108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.806+0000 7f29f3c00640 1 --2- 172.21.15.7:0/1784438403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec104df0 0x7f29ec108e30 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009860 tx=0x7f29d802a340 comp rx=0 tx=0).stop 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 -- 172.21.15.7:0/1784438403 shutdown_connections 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 --2- 172.21.15.7:0/1784438403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec109510 0x7f29ec1110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 --2- 172.21.15.7:0/1784438403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec104df0 0x7f29ec108e30 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 --2- 172.21.15.7:0/1784438403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ec104440 0x7f29ec104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 -- 172.21.15.7:0/1784438403 >> 172.21.15.7:0/1784438403 conn(0x7f29ec0ffcc0 msgr2=0x7f29ec1020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 -- 172.21.15.7:0/1784438403 shutdown_connections 2024-04-23T15:45:14.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.807+0000 7f29f3c00640 1 -- 172.21.15.7:0/1784438403 wait complete. 2024-04-23T15:45:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 Processor -- start 2024-04-23T15:45:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 -- start start 2024-04-23T15:45:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 0x7f29ec1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec109510 0x7f29ec1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ec19a8b0 0x7f29ec19ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:14.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec114450 con 0x7f29ec109510 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1142d0 con 0x7f29ec104440 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.808+0000 7f29f3c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1145d0 con 0x7f29ec19a8b0 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.809+0000 7f29f1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 0x7f29ec1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.809+0000 7f29f1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 0x7f29ec1a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.7:56132/0 (socket says 172.21.15.7:56132) 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.809+0000 7f29f1200640 1 -- 172.21.15.7:0/4037166889 learned_addr learned my addr 172.21.15.7:0/4037166889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.809+0000 7f29ebe00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec109510 0x7f29ec1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.809+0000 7f29f1c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ec19a8b0 0x7f29ec19ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f1200640 1 -- 172.21.15.7:0/4037166889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ec19a8b0 msgr2=0x7f29ec19ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f1200640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ec19a8b0 0x7f29ec19ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f1200640 1 -- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec109510 msgr2=0x7f29ec1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f1200640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec109510 0x7f29ec1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f1200640 1 -- 172.21.15.7:0/4037166889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec19b3d0 con 0x7f29ec104440 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29ebe00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec109510 0x7f29ec1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T15:45:14.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f1200640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 0x7f29ec1a06b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29e000e9f0 tx=0x7f29e000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:14.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e000cd80 con 0x7f29ec104440 2024-04-23T15:45:14.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29e00054d0 con 0x7f29ec104440 2024-04-23T15:45:14.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.810+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ec19b6c0 con 0x7f29ec104440 2024-04-23T15:45:14.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.811+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0010490 con 0x7f29ec104440 2024-04-23T15:45:14.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.811+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ec1a7870 con 0x7f29ec104440 2024-04-23T15:45:14.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.812+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ec069270 con 0x7f29ec104440 2024-04-23T15:45:14.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.817+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f29e0005020 con 0x7f29ec104440 2024-04-23T15:45:14.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.819+0000 7f29e9600640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f29d40a3d20 0x7f29d40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:14.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.819+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 9555+0+0 (secure 0 0 0) 0x7f29e00d0fd0 con 0x7f29ec104440 2024-04-23T15:45:14.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.820+0000 7f29ebe00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f29d40a3d20 0x7f29d40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:14.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.821+0000 7f29ebe00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f29d40a3d20 0x7f29d40a61e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f29d80303f0 tx=0x7f29d8030340 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:14.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:14.825+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f29e009d200 con 0x7f29ec104440 2024-04-23T15:45:15.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.131+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29ec10c7a0 con 0x7f29ec104440 2024-04-23T15:45:15.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.133+0000 7f29e9600640 1 -- 172.21.15.7:0/4037166889 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11930 (secure 0 0 0) 0x7f29e009cb00 con 0x7f29ec104440 2024-04-23T15:45:15.134 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:45:15.134 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T15:43:53.694475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[24508,34448,34424,34484,34526]},"id":1}]} 2024-04-23T15:45:15.134 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 36 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f29d40a3d20 msgr2=0x7f29d40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f29d40a3d20 0x7f29d40a61e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f29d80303f0 tx=0x7f29d8030340 comp rx=0 tx=0).stop 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 msgr2=0x7f29ec1a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 0x7f29ec1a06b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29e000e9f0 tx=0x7f29e000edf0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 shutdown_connections 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f29d40a3d20 0x7f29d40a61e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ec19a8b0 0x7f29ec19ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29ec109510 0x7f29ec1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 --2- 172.21.15.7:0/4037166889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec104440 0x7f29ec1a06b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 >> 172.21.15.7:0/4037166889 conn(0x7f29ec0ffcc0 msgr2=0x7f29ec1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.136+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 shutdown_connections 2024-04-23T15:45:15.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.137+0000 7f29f3c00640 1 -- 172.21.15.7:0/4037166889 wait complete. 2024-04-23T15:45:15.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T15:45:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.353+0000 7f17c1a00640 1 -- 172.21.15.7:0/72924684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108610 msgr2=0x7f17bc108a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.353+0000 7f17c1a00640 1 --2- 172.21.15.7:0/72924684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108610 0x7f17bc108a90 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009cd0 tx=0x7f17a402a8e0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 -- 172.21.15.7:0/72924684 shutdown_connections 2024-04-23T15:45:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 --2- 172.21.15.7:0/72924684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc108fd0 0x7f17bc1154e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 --2- 172.21.15.7:0/72924684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108610 0x7f17bc108a90 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 --2- 172.21.15.7:0/72924684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17bc10e6b0 0x7f17bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 -- 172.21.15.7:0/72924684 >> 172.21.15.7:0/72924684 conn(0x7f17bc075800 msgr2=0x7f17bc106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 -- 172.21.15.7:0/72924684 shutdown_connections 2024-04-23T15:45:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.354+0000 7f17c1a00640 1 -- 172.21.15.7:0/72924684 wait complete. 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 Processor -- start 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 -- start start 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17bc108610 0x7f17bc19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 0x7f17bc19f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc10e6b0 0x7f17bc1a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1188a0 con 0x7f17bc108fd0 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc118720 con 0x7f17bc10e6b0 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17c1a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc118a20 con 0x7f17bc108610 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.355+0000 7f17b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 0x7f17bc19f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 0x7f17bc19f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43394/0 (socket says 172.21.15.7:43394) 2024-04-23T15:45:15.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 -- 172.21.15.7:0/1704538880 learned_addr learned my addr 172.21.15.7:0/1704538880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17baa00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17bc108610 0x7f17bc19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17bb400640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc10e6b0 0x7f17bc1a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 -- 172.21.15.7:0/1704538880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17bc108610 msgr2=0x7f17bc19ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17bc108610 0x7f17bc19ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 -- 172.21.15.7:0/1704538880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc10e6b0 msgr2=0x7f17bc1a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc10e6b0 0x7f17bc1a36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 -- 172.21.15.7:0/1704538880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc1a3df0 con 0x7f17bc108fd0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17bb400640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc10e6b0 0x7f17bc1a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.356+0000 7f17b2000640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 0x7f17bc19f340 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f17a402ae00 tx=0x7f17a4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.357+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004240 con 0x7f17bc108fd0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.357+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17a40305a0 con 0x7f17bc108fd0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.357+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc1a4080 con 0x7f17bc108fd0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.357+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a403b640 con 0x7f17bc108fd0 2024-04-23T15:45:15.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.357+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1ab970 con 0x7f17bc108fd0 2024-04-23T15:45:15.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.358+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc069270 con 0x7f17bc108fd0 2024-04-23T15:45:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.360+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f17a4030ac0 con 0x7f17bc108fd0 2024-04-23T15:45:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.361+0000 7f17b3e00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f17a00a3d20 0x7f17a00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.362+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 9555+0+0 (secure 0 0 0) 0x7f17a402e030 con 0x7f17bc108fd0 2024-04-23T15:45:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.362+0000 7f17baa00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f17a00a3d20 0x7f17a00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.363+0000 7f17baa00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f17a00a3d20 0x7f17a00a61e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17ac005fd0 tx=0x7f17ac005850 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:15.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.367+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f17a40be100 con 0x7f17bc108fd0 2024-04-23T15:45:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:15 smithi007 ceph-mon[27906]: pgmap v1708: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 28 KiB/s wr, 15 op/s 2024-04-23T15:45:15.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:15 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/4037166889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:45:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:15 smithi186 ceph-mon[31814]: pgmap v1708: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 28 KiB/s wr, 15 op/s 2024-04-23T15:45:15.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:15 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/4037166889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:45:15.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.644+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17bc02d620 con 0x7f17bc108fd0 2024-04-23T15:45:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.645+0000 7f17b3e00640 1 -- 172.21.15.7:0/1704538880 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11930 (secure 0 0 0) 0x7f17a40bda00 con 0x7f17bc108fd0 2024-04-23T15:45:15.646 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:45:15.646 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1858740077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1858740077},{"type":"v1","addr":"172.21.15.7:6835","nonce":1858740077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4118329772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4118329772},{"type":"v1","addr":"172.21.15.7:6837","nonce":4118329772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:48:23.629029+0000","modified":"2024-04-23T15:43:53.694475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34526,"mds_1":34484,"mds_2":34448,"mds_3":34424,"mds_4":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14628":{"gid":14628,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2766173942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2766173942},{"type":"v1","addr":"172.21.15.7:6839","nonce":2766173942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14640":{"gid":14640,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/1212403180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1212403180},{"type":"v1","addr":"172.21.15.7:6841","nonce":1212403180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6833/156003904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":156003904},{"type":"v1","addr":"172.21.15.186:6833","nonce":156003904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/77772242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":77772242},{"type":"v1","addr":"172.21.15.186:6835","nonce":77772242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2659046243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2659046243},{"type":"v1","addr":"172.21.15.186:6837","nonce":2659046243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"i","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.186:6839/4267150138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":4267150138},{"type":"v1","addr":"172.21.15.186:6839","nonce":4267150138}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34424":{"gid":34424,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.137:6833/3754100416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3754100416},{"type":"v1","addr":"172.21.15.137:6833","nonce":3754100416}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.137:6835/2502711779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2502711779},{"type":"v1","addr":"172.21.15.137:6835","nonce":2502711779}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34484":{"gid":34484,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/1247128385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1247128385},{"type":"v1","addr":"172.21.15.137:6837","nonce":1247128385}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34526":{"gid":34526,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6839/174749197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":174749197},{"type":"v1","addr":"172.21.15.137:6839","nonce":174749197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34526,"qdb_cluster":[24508,34448,34424,34484,34526]},"id":1}]} 2024-04-23T15:45:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 36 2024-04-23T15:45:15.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f17a00a3d20 msgr2=0x7f17a00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f17a00a3d20 0x7f17a00a61e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17ac005fd0 tx=0x7f17ac005850 comp rx=0 tx=0).stop 2024-04-23T15:45:15.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 msgr2=0x7f17bc19f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 0x7f17bc19f340 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f17a402ae00 tx=0x7f17a4003ba0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 shutdown_connections 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f17a00a3d20 0x7f17a00a61e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17bc10e6b0 0x7f17bc1a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17bc108fd0 0x7f17bc19f340 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 --2- 172.21.15.7:0/1704538880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17bc108610 0x7f17bc19ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 >> 172.21.15.7:0/1704538880 conn(0x7f17bc075800 msgr2=0x7f17bc076950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 shutdown_connections 2024-04-23T15:45:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.649+0000 7f17c1a00640 1 -- 172.21.15.7:0/1704538880 wait complete. 2024-04-23T15:45:15.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:15 smithi137 ceph-mon[31694]: pgmap v1708: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 28 KiB/s wr, 15 op/s 2024-04-23T15:45:15.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:15 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/4037166889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:45:15.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 -- 172.21.15.7:0/1869202448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 msgr2=0x7f63f8110f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 --2- 172.21.15.7:0/1869202448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f8110f00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009ca0 tx=0x7f63f002a8b0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 -- 172.21.15.7:0/1869202448 shutdown_connections 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 --2- 172.21.15.7:0/1869202448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f8110f00 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 --2- 172.21.15.7:0/1869202448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104c10 0x7f63f8108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 --2- 172.21.15.7:0/1869202448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f8104260 0x7f63f8104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 -- 172.21.15.7:0/1869202448 >> 172.21.15.7:0/1869202448 conn(0x7f63f80ffaa0 msgr2=0x7f63f8101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 -- 172.21.15.7:0/1869202448 shutdown_connections 2024-04-23T15:45:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.874+0000 7f63fe400640 1 -- 172.21.15.7:0/1869202448 wait complete. 2024-04-23T15:45:15.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.875+0000 7f63fe400640 1 Processor -- start 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.875+0000 7f63fe400640 1 -- start start 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fe400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104260 0x7f63f81a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fe400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f81a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fe400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f819a5e0 0x7f63f819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fe400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8114280 con 0x7f63f8109330 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fe400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8114100 con 0x7f63f819a5e0 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fe400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8114400 con 0x7f63f8104260 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f81a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f81a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43420/0 (socket says 172.21.15.7:43420) 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63f7e00640 1 -- 172.21.15.7:0/3081967416 learned_addr learned my addr 172.21.15.7:0/3081967416 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fd000640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104260 0x7f63f81a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.876+0000 7f63fda00640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f819a5e0 0x7f63f819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f7e00640 1 -- 172.21.15.7:0/3081967416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104260 msgr2=0x7f63f81a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f7e00640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104260 0x7f63f81a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f7e00640 1 -- 172.21.15.7:0/3081967416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f819a5e0 msgr2=0x7f63f819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f7e00640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f819a5e0 0x7f63f819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f7e00640 1 -- 172.21.15.7:0/3081967416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f819b100 con 0x7f63f8109330 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63fd000640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104260 0x7f63f81a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f7e00640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f81a0970 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e9c0 tx=0x7f63e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e400cd80 con 0x7f63f8109330 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f819b3f0 con 0x7f63f8109330 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63e40054d0 con 0x7f63f8109330 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4010430 con 0x7f63f8109330 2024-04-23T15:45:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.877+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81a7640 con 0x7f63f8109330 2024-04-23T15:45:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.879+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f8069190 con 0x7f63f8109330 2024-04-23T15:45:15.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.881+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f63e4004fd0 con 0x7f63f8109330 2024-04-23T15:45:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.883+0000 7f63f5600640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63dc0a3d20 0x7f63dc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.883+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 9555+0+0 (secure 0 0 0) 0x7f63e40d1150 con 0x7f63f8109330 2024-04-23T15:45:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.883+0000 7f63fd000640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63dc0a3d20 0x7f63dc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.884+0000 7f63fd000640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63dc0a3d20 0x7f63dc0a61e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009b50 tx=0x7f63e8005f90 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:15.887+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f63e400b2c0 con 0x7f63f8109330 2024-04-23T15:45:16.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.103+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63f8104c10 con 0x7f63f8109330 2024-04-23T15:45:16.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.105+0000 7f63f5600640 1 -- 172.21.15.7:0/3081967416 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) ==== 74+0+25331 (secure 0 0 0) 0x7f63e409d380 con 0x7f63f8109330 2024-04-23T15:45:16.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-23T15:45:16.107 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":183,"fsid":"7b70c844-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:32.261830+0000","modified":"2024-04-23T15:45:08.160131+0000","last_up_change":"2024-04-23T14:47:14.439367+0000","last_in_change":"2024-04-23T14:46:49.846359+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:41:56.325786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T14:48:21.290632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T14:48:22.601707+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":102,"snap_epoch":183,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T14:48:26.649609+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":102,"snap_epoch":183,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bada9023-7750-40ab-88f9-04e037cac5af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6803","nonce":3865208541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6805","nonce":3865208541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6809","nonce":3865208541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3865208541},{"type":"v1","addr":"172.21.15.7:6807","nonce":3865208541}]},"public_addr":"172.21.15.7:6803/3865208541","cluster_addr":"172.21.15.7:6805/3865208541","heartbeat_back_addr":"172.21.15.7:6809/3865208541","heartbeat_front_addr":"172.21.15.7:6807/3865208541","state":["exists","up"]},{"osd":1,"uuid":"bb0cc325-66cb-4ed4-866d-ce8820287b97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6801","nonce":1298672167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6803","nonce":1298672167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6807","nonce":1298672167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1298672167},{"type":"v1","addr":"172.21.15.137:6805","nonce":1298672167}]},"public_addr":"172.21.15.137:6801/1298672167","cluster_addr":"172.21.15.137:6803/1298672167","heartbeat_back_addr":"172.21.15.137:6807/1298672167","heartbeat_front_addr":"172.21.15.137:6805/1298672167","state":["exists","up"]},{"osd":2,"uuid":"d2b7d455-8c45-4b91-8c1d-059d4a0fe3fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6801","nonce":3205554231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6803","nonce":3205554231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6807","nonce":3205554231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3205554231},{"type":"v1","addr":"172.21.15.186:6805","nonce":3205554231}]},"public_addr":"172.21.15.186:6801/3205554231","cluster_addr":"172.21.15.186:6803/3205554231","heartbeat_back_addr":"172.21.15.186:6807/3205554231","heartbeat_front_addr":"172.21.15.186:6805/3205554231","state":["exists","up"]},{"osd":3,"uuid":"546655c4-16cd-4be5-a422-aa644ef9c0e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6811","nonce":2158265578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6813","nonce":2158265578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6817","nonce":2158265578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2158265578},{"type":"v1","addr":"172.21.15.7:6815","nonce":2158265578}]},"public_addr":"172.21.15.7:6811/2158265578","cluster_addr":"172.21.15.7:6813/2158265578","heartbeat_back_addr":"172.21.15.7:6817/2158265578","heartbeat_front_addr":"172.21.15.7:6815/2158265578","state":["exists","up"]},{"osd":4,"uuid":"06dad351-e05a-4c7b-83bc-e1e8757bc711","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6809","nonce":3040772889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6811","nonce":3040772889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6815","nonce":3040772889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3040772889},{"type":"v1","addr":"172.21.15.137:6813","nonce":3040772889}]},"public_addr":"172.21.15.137:6809/3040772889","cluster_addr":"172.21.15.137:6811/3040772889","heartbeat_back_addr":"172.21.15.137:6815/3040772889","heartbeat_front_addr":"172.21.15.137:6813/3040772889","state":["exists","up"]},{"osd":5,"uuid":"097180ed-48e5-4b8a-a06b-3190abf3df8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6809","nonce":2388437494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6811","nonce":2388437494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6815","nonce":2388437494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2388437494},{"type":"v1","addr":"172.21.15.186:6813","nonce":2388437494}]},"public_addr":"172.21.15.186:6809/2388437494","cluster_addr":"172.21.15.186:6811/2388437494","heartbeat_back_addr":"172.21.15.186:6815/2388437494","heartbeat_front_addr":"172.21.15.186:6813/2388437494","state":["exists","up"]},{"osd":6,"uuid":"3b57c273-5d0c-40e5-ba14-8704b6844d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6819","nonce":2119533144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6821","nonce":2119533144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6825","nonce":2119533144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2119533144},{"type":"v1","addr":"172.21.15.7:6823","nonce":2119533144}]},"public_addr":"172.21.15.7:6819/2119533144","cluster_addr":"172.21.15.7:6821/2119533144","heartbeat_back_addr":"172.21.15.7:6825/2119533144","heartbeat_front_addr":"172.21.15.7:6823/2119533144","state":["exists","up"]},{"osd":7,"uuid":"c59e05c5-705e-49d3-92c8-d32881241f96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6817","nonce":342014063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6819","nonce":342014063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6823","nonce":342014063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":342014063},{"type":"v1","addr":"172.21.15.137:6821","nonce":342014063}]},"public_addr":"172.21.15.137:6817/342014063","cluster_addr":"172.21.15.137:6819/342014063","heartbeat_back_addr":"172.21.15.137:6823/342014063","heartbeat_front_addr":"172.21.15.137:6821/342014063","state":["exists","up"]},{"osd":8,"uuid":"0dc3fbc8-a0e3-4031-a338-30881b7db934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6817","nonce":4105017585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6819","nonce":4105017585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6823","nonce":4105017585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":4105017585},{"type":"v1","addr":"172.21.15.186:6821","nonce":4105017585}]},"public_addr":"172.21.15.186:6817/4105017585","cluster_addr":"172.21.15.186:6819/4105017585","heartbeat_back_addr":"172.21.15.186:6823/4105017585","heartbeat_front_addr":"172.21.15.186:6821/4105017585","state":["exists","up"]},{"osd":9,"uuid":"6bc566f6-4686-46dc-b8a2-fffbeadd9025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6827","nonce":938090792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6829","nonce":938090792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6833","nonce":938090792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":938090792},{"type":"v1","addr":"172.21.15.7:6831","nonce":938090792}]},"public_addr":"172.21.15.7:6827/938090792","cluster_addr":"172.21.15.7:6829/938090792","heartbeat_back_addr":"172.21.15.7:6833/938090792","heartbeat_front_addr":"172.21.15.7:6831/938090792","state":["exists","up"]},{"osd":10,"uuid":"f4c5d502-eef1-42eb-88fe-2b9c343deb6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6825","nonce":2931599651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6827","nonce":2931599651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6831","nonce":2931599651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2931599651},{"type":"v1","addr":"172.21.15.137:6829","nonce":2931599651}]},"public_addr":"172.21.15.137:6825/2931599651","cluster_addr":"172.21.15.137:6827/2931599651","heartbeat_back_addr":"172.21.15.137:6831/2931599651","heartbeat_front_addr":"172.21.15.137:6829/2931599651","state":["exists","up"]},{"osd":11,"uuid":"793ab73a-d36f-4b60-9cb3-9a2a14b92148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6825","nonce":25472290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6827","nonce":25472290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6831","nonce":25472290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":25472290},{"type":"v1","addr":"172.21.15.186:6829","nonce":25472290}]},"public_addr":"172.21.15.186:6825/25472290","cluster_addr":"172.21.15.186:6827/25472290","heartbeat_back_addr":"172.21.15.186:6831/25472290","heartbeat_front_addr":"172.21.15.186:6829/25472290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:40:48.665001+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:21.842128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:54.343014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:30.352859+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:04.770419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:38.100138+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:16.081657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:50.572514+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:45:25.313578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:02.531848+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:46:37.712729+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:47:12.798403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/53488990":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3733281875":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3240450123":"2024-04-24T14:51:20.179514+0000","172.21.15.7:6801/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/3573875988":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/890429947":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/2805710934":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/147420039":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3440122157":"2024-04-24T14:51:20.179514+0000","172.21.15.7:0/4250737482":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6801/2898788410":"2024-04-24T14:38:42.138800+0000","172.21.15.7:0/3290686917":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:0/1124398484":"2024-04-24T14:38:42.138800+0000","172.21.15.7:6801/3246781913":"2024-04-24T14:38:06.870414+0000","172.21.15.7:6800/2898788410":"2024-04-24T14:38:42.138800+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":89,"length":1},{"begin":102,"length":1}]},{"pool":4,"snaps":[{"begin":89,"length":1},{"begin":102,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":89,"length":1},{"begin":102,"length":1}]},{"pool":4,"snaps":[{"begin":89,"length":1},{"begin":102,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.108+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63dc0a3d20 msgr2=0x7f63dc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.108+0000 7f63fe400640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63dc0a3d20 0x7f63dc0a61e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009b50 tx=0x7f63e8005f90 comp rx=0 tx=0).stop 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.108+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 msgr2=0x7f63f81a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.108+0000 7f63fe400640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f81a0970 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e9c0 tx=0x7f63e400ee80 comp rx=0 tx=0).stop 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 shutdown_connections 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f63dc0a3d20 0x7f63dc0a61e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63f819a5e0 0x7f63f819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f8109330 0x7f63f81a0970 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 --2- 172.21.15.7:0/3081967416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63f8104260 0x7f63f81a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 >> 172.21.15.7:0/3081967416 conn(0x7f63f80ffaa0 msgr2=0x7f63f8101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 shutdown_connections 2024-04-23T15:45:16.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.109+0000 7f63fe400640 1 -- 172.21.15.7:0/3081967416 wait complete. 2024-04-23T15:45:16.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-23T15:45:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 -- 172.21.15.7:0/1863378741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 msgr2=0x7f43741152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 --2- 172.21.15.7:0/1863378741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741152d0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f436c009900 tx=0x7f436c02a3f0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 -- 172.21.15.7:0/1863378741 shutdown_connections 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 --2- 172.21.15.7:0/1863378741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4374076e50 0x7f43741129a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 --2- 172.21.15.7:0/1863378741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741152d0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 --2- 172.21.15.7:0/1863378741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4374076530 0x7f4374076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 -- 172.21.15.7:0/1863378741 >> 172.21.15.7:0/1863378741 conn(0x7f43740ffd90 msgr2=0x7f43741021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 -- 172.21.15.7:0/1863378741 shutdown_connections 2024-04-23T15:45:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.333+0000 7f4379c00640 1 -- 172.21.15.7:0/1863378741 wait complete. 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.334+0000 7f4379c00640 1 Processor -- start 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.334+0000 7f4379c00640 1 -- start start 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4379c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4374076530 0x7f437419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4379c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4374076e50 0x7f437419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4379c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4379c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43741188f0 con 0x7f4374112ee0 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4379c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4374118770 con 0x7f4374076530 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4379c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4374118a70 con 0x7f4374076e50 2024-04-23T15:45:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741a3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43452/0 (socket says 172.21.15.7:43452) 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 -- 172.21.15.7:0/2651490276 learned_addr learned my addr 172.21.15.7:0/2651490276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4372a00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4374076530 0x7f437419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4372000640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4374076e50 0x7f437419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 -- 172.21.15.7:0/2651490276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4374076e50 msgr2=0x7f437419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4374076e50 0x7f437419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 -- 172.21.15.7:0/2651490276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4374076530 msgr2=0x7f437419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.335+0000 7f4373400640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4374076530 0x7f437419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f4373400640 1 -- 172.21.15.7:0/2651490276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43741a3d90 con 0x7f4374112ee0 2024-04-23T15:45:16.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f4373400640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741a3660 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f436c005ab0 tx=0x7f436c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c03f030 con 0x7f4374112ee0 2024-04-23T15:45:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f436c003cb0 con 0x7f4374112ee0 2024-04-23T15:45:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c035070 con 0x7f4374112ee0 2024-04-23T15:45:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43741a4020 con 0x7f4374112ee0 2024-04-23T15:45:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.336+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43741ab910 con 0x7f4374112ee0 2024-04-23T15:45:16.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.338+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4374077c70 con 0x7f4374112ee0 2024-04-23T15:45:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.340+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f436c042030 con 0x7f4374112ee0 2024-04-23T15:45:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.341+0000 7f436b400640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f43580a3da0 0x7f43580a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.341+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 9555+0+0 (secure 0 0 0) 0x7f436c0f1490 con 0x7f4374112ee0 2024-04-23T15:45:16.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.341+0000 7f4372a00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f43580a3da0 0x7f43580a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:16.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.342+0000 7f4372a00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f43580a3da0 0x7f43580a6260 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4364005e10 tx=0x7f4364005da0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:16.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.346+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f436c0bd720 con 0x7f4374112ee0 2024-04-23T15:45:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:16 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1704538880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:45:16.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:16 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3081967416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:16.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:16.609+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f437410e070 con 0x7f4374112ee0 2024-04-23T15:45:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:16 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1704538880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:45:16.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:16 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3081967416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:16 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1704538880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:45:16.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:16 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3081967416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:45:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.292+0000 7f436b400640 1 -- 172.21.15.7:0/2651490276 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f436c0bd020 con 0x7f4374112ee0 2024-04-23T15:45:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-23T15:45:17.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f43580a3da0 msgr2=0x7f43580a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f43580a3da0 0x7f43580a6260 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4364005e10 tx=0x7f4364005da0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 msgr2=0x7f43741a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741a3660 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f436c005ab0 tx=0x7f436c0042f0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 shutdown_connections 2024-04-23T15:45:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f43580a3da0 0x7f43580a6260 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4374112ee0 0x7f43741a3660 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4374076e50 0x7f437419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 --2- 172.21.15.7:0/2651490276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4374076530 0x7f437419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.298+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 >> 172.21.15.7:0/2651490276 conn(0x7f43740ffd90 msgr2=0x7f4374102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.299+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 shutdown_connections 2024-04-23T15:45:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.299+0000 7f4379c00640 1 -- 172.21.15.7:0/2651490276 wait complete. 2024-04-23T15:45:17.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-23T15:45:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 -- 172.21.15.7:0/4161746502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37281093e0 msgr2=0x7f3728110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 --2- 172.21.15.7:0/4161746502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37281093e0 0x7f3728110fb0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f3720009ca0 tx=0x7f372002a8c0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 -- 172.21.15.7:0/4161746502 shutdown_connections 2024-04-23T15:45:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 --2- 172.21.15.7:0/4161746502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37281093e0 0x7f3728110fb0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 --2- 172.21.15.7:0/4161746502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3728104cc0 0x7f3728108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 --2- 172.21.15.7:0/4161746502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3728104310 0x7f37281046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.528+0000 7f3727e00640 1 -- 172.21.15.7:0/4161746502 >> 172.21.15.7:0/4161746502 conn(0x7f37280ffb70 msgr2=0x7f3728101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.529+0000 7f3727e00640 1 -- 172.21.15.7:0/4161746502 shutdown_connections 2024-04-23T15:45:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.529+0000 7f3727e00640 1 -- 172.21.15.7:0/4161746502 wait complete. 2024-04-23T15:45:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 Processor -- start 2024-04-23T15:45:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 -- start start 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3728104310 0x7f37281a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37281093e0 0x7f37281a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 0x7f372819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37281143a0 con 0x7f372819a600 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3728114220 con 0x7f3728104310 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3728114520 con 0x7f37281093e0 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.530+0000 7f3727400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 0x7f372819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 0x7f372819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43472/0 (socket says 172.21.15.7:43472) 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 -- 172.21.15.7:0/2584888847 learned_addr learned my addr 172.21.15.7:0/2584888847 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3726000640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37281093e0 0x7f37281a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3726a00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3728104310 0x7f37281a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 -- 172.21.15.7:0/2584888847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37281093e0 msgr2=0x7f37281a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37281093e0 0x7f37281a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 -- 172.21.15.7:0/2584888847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3728104310 msgr2=0x7f37281a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3728104310 0x7f37281a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 -- 172.21.15.7:0/2584888847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372819b120 con 0x7f372819a600 2024-04-23T15:45:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3726000640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37281093e0 0x7f37281a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:45:17.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.531+0000 7f3727400640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 0x7f372819aab0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f3720005e30 tx=0x7f37200093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.532+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720003c70 con 0x7f372819a600 2024-04-23T15:45:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.532+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3720003e10 con 0x7f372819a600 2024-04-23T15:45:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.532+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720030c10 con 0x7f372819a600 2024-04-23T15:45:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.532+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372819b3b0 con 0x7f372819a600 2024-04-23T15:45:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.532+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281a75b0 con 0x7f372819a600 2024-04-23T15:45:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.533+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3728069190 con 0x7f372819a600 2024-04-23T15:45:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.535+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f3720004040 con 0x7f372819a600 2024-04-23T15:45:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.537+0000 7f372ca00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f370c0a3da0 0x7f370c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.537+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 9897+0+0 (secure 0 0 0) 0x7f37200f2060 con 0x7f372819a600 2024-04-23T15:45:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.537+0000 7f3726a00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f370c0a3da0 0x7f370c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.538+0000 7f3726a00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f370c0a3da0 0x7f370c0a6260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3718005e10 tx=0x7f3718005da0 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:17.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.541+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f37200be2b0 con 0x7f372819a600 2024-04-23T15:45:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a[27902]: 2024-04-23T15:45:17.287+0000 7f3b8e800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T15:45:17.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-mon[27906]: pgmap v1709: 129 pgs: 12 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 78 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-23T15:45:17.601 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-mon[31694]: pgmap v1709: 129 pgs: 12 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 78 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-23T15:45:17.601 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h[61489]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.602 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h[61489]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.602 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e[61184]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.603 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e[61184]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.603 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-mds[61188]: -- 172.21.15.137:0/536232341 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558bd1acba40 con 0x558bd1a9ec00 2024-04-23T15:45:17.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-mon[31814]: pgmap v1709: 129 pgs: 12 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 78 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-23T15:45:17.614 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c[62866]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.614 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c[62866]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.614 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-mds[62870]: -- 172.21.15.186:0/3717775532 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c1a271a40 con 0x556c1a245000 2024-04-23T15:45:17.614 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c[62866]: starting mds.c at 2024-04-23T15:45:17.614 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l[62236]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l[62236]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-mds[62242]: -- 172.21.15.186:0/2343780101 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e548195a40 con 0x55e548169000 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l[62236]: starting mds.l at 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f[62545]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f[62545]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-mds[62550]: -- 172.21.15.186:0/2326015396 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555666607a40 con 0x5556665da800 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f[62545]: starting mds.f at 2024-04-23T15:45:17.615 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i[63174]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.616 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i[63174]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.616 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-mds[63178]: -- 172.21.15.186:0/1110828684 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619cb709a40 con 0x5619cb6dc800 2024-04-23T15:45:17.616 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:45:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i[63174]: starting mds.i at 2024-04-23T15:45:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:17.825+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3728104cc0 con 0x7f372819a600 2024-04-23T15:45:17.918 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e[61184]: starting mds.e at 2024-04-23T15:45:17.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-mds[61493]: -- 172.21.15.137:0/903883774 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e923c7a40 con 0x556e9239ac00 2024-04-23T15:45:17.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h[61489]: starting mds.h at 2024-04-23T15:45:17.918 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-mds[61805]: -- 172.21.15.137:0/3807555327 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0275e3a40 con 0x55b0275b6800 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: starting mds.b at 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k[60875]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k[60875]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-mds[60881]: -- 172.21.15.137:0/2364893872 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55907127da40 con 0x559071250c00 2024-04-23T15:45:17.919 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:45:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k[60875]: starting mds.k at 2024-04-23T15:45:18.086 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a[66934]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:18.086 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a[66934]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:18.086 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-mds[66938]: -- 172.21.15.7:0/3718312297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c955ec3a40 con 0x55c955e96800 2024-04-23T15:45:18.086 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a[66934]: starting mds.a at 2024-04-23T15:45:18.087 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g[66568]: ignoring --setuser ceph since I am not root 2024-04-23T15:45:18.087 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g[66568]: ignoring --setgroup ceph since I am not root 2024-04-23T15:45:18.087 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-mds[66592]: -- 172.21.15.7:0/763026203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5608c4f5fa40 con 0x5608c4f32c00 2024-04-23T15:45:18.087 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:45:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g[66568]: starting mds.g at 2024-04-23T15:45:18.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.362+0000 7f372ca00640 1 -- 172.21.15.7:0/2584888847 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f37200bdbb0 con 0x7f372819a600 2024-04-23T15:45:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.366+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f370c0a3da0 msgr2=0x7f370c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f370c0a3da0 0x7f370c0a6260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3718005e10 tx=0x7f3718005da0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 msgr2=0x7f372819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:18.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 0x7f372819aab0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f3720005e30 tx=0x7f37200093d0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 shutdown_connections 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f370c0a3da0 0x7f370c0a6260 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f372819a600 0x7f372819aab0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37281093e0 0x7f37281a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 --2- 172.21.15.7:0/2584888847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3728104310 0x7f37281a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 >> 172.21.15.7:0/2584888847 conn(0x7f37280ffb70 msgr2=0x7f3728101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 shutdown_connections 2024-04-23T15:45:18.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.367+0000 7f3727e00640 1 -- 172.21.15.7:0/2584888847 wait complete. 2024-04-23T15:45:18.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 -- 172.21.15.7:0/1155196137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94104e00 msgr2=0x7fde94108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 --2- 172.21.15.7:0/1155196137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94104e00 0x7fde94108e40 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fde80009900 tx=0x7fde8002a410 comp rx=0 tx=0).stop 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 -- 172.21.15.7:0/1155196137 shutdown_connections 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 --2- 172.21.15.7:0/1155196137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde94109520 0x7fde941110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 --2- 172.21.15.7:0/1155196137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94104e00 0x7fde94108e40 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 --2- 172.21.15.7:0/1155196137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde94104450 0x7fde94104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.615+0000 7fde9be00640 1 -- 172.21.15.7:0/1155196137 >> 172.21.15.7:0/1155196137 conn(0x7fde940ffcb0 msgr2=0x7fde941020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.616+0000 7fde9be00640 1 -- 172.21.15.7:0/1155196137 shutdown_connections 2024-04-23T15:45:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.616+0000 7fde9be00640 1 -- 172.21.15.7:0/1155196137 wait complete. 2024-04-23T15:45:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 Processor -- start 2024-04-23T15:45:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 -- start start 2024-04-23T15:45:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde94104450 0x7fde941a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 0x7fde941a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde9419a840 0x7fde9419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fde94114460 con 0x7fde94109520 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde941142e0 con 0x7fde9419a840 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde9be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fde941145e0 con 0x7fde94104450 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde98a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 0x7fde941a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.617+0000 7fde98a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 0x7fde941a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43528/0 (socket says 172.21.15.7:43528) 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 -- 172.21.15.7:0/1541610299 learned_addr learned my addr 172.21.15.7:0/1541610299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde99e00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde9419a840 0x7fde9419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde99400640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde94104450 0x7fde941a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 -- 172.21.15.7:0/1541610299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde94104450 msgr2=0x7fde941a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde94104450 0x7fde941a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 -- 172.21.15.7:0/1541610299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde9419a840 msgr2=0x7fde9419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde9419a840 0x7fde9419acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 -- 172.21.15.7:0/1541610299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9419b3d0 con 0x7fde94109520 2024-04-23T15:45:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.618+0000 7fde98a00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 0x7fde941a0c10 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fde80031a20 tx=0x7fde80004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.619+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8003f030 con 0x7fde94109520 2024-04-23T15:45:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.619+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde80003aa0 con 0x7fde94109520 2024-04-23T15:45:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.619+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80035070 con 0x7fde94109520 2024-04-23T15:45:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.619+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9419b660 con 0x7fde94109520 2024-04-23T15:45:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.619+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941a77c0 con 0x7fde94109520 2024-04-23T15:45:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.620+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde94105920 con 0x7fde94109520 2024-04-23T15:45:18.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.622+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fde80042030 con 0x7fde94109520 2024-04-23T15:45:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.624+0000 7fde92000640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fde7c0a3da0 0x7fde7c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.624+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 9897+0+0 (secure 0 0 0) 0x7fde800f1170 con 0x7fde94109520 2024-04-23T15:45:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.624+0000 7fde99400640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fde7c0a3da0 0x7fde7c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:18.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.625+0000 7fde99400640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fde7c0a3da0 0x7fde7c0a6260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fde88005fd0 tx=0x7fde88009500 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.629+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde800bd250 con 0x7fde94109520 2024-04-23T15:45:18.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2651490276' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-23T15:45:18.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T15:45:18.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T15:45:18.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2651490276' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-23T15:45:18.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: osdmap e184: 12 total, 12 up, 12 in 2024-04-23T15:45:18.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-23T15:45:18.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:18 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2584888847' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T15:45:18.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2651490276' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-23T15:45:18.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T15:45:18.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T15:45:18.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2651490276' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-23T15:45:18.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: osdmap e184: 12 total, 12 up, 12 in 2024-04-23T15:45:18.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-23T15:45:18.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:18 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2584888847' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T15:45:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:18.836+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde94104e00 con 0x7fde94109520 2024-04-23T15:45:18.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2651490276' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-23T15:45:18.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T15:45:18.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T15:45:18.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2651490276' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-23T15:45:18.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: osdmap e184: 12 total, 12 up, 12 in 2024-04-23T15:45:18.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-23T15:45:18.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:18 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2584888847' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T15:45:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.380+0000 7fde92000640 1 -- 172.21.15.7:0/1541610299 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v185) ==== 181+0+0 (secure 0 0 0) 0x7fde800bcb50 con 0x7fde94109520 2024-04-23T15:45:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-23T15:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fde7c0a3da0 msgr2=0x7fde7c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fde7c0a3da0 0x7fde7c0a6260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fde88005fd0 tx=0x7fde88009500 comp rx=0 tx=0).stop 2024-04-23T15:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 msgr2=0x7fde941a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 0x7fde941a0c10 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fde80031a20 tx=0x7fde80004040 comp rx=0 tx=0).stop 2024-04-23T15:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 shutdown_connections 2024-04-23T15:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fde7c0a3da0 0x7fde7c0a6260 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde9419a840 0x7fde9419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde94109520 0x7fde941a0c10 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 --2- 172.21.15.7:0/1541610299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde94104450 0x7fde941a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.386+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 >> 172.21.15.7:0/1541610299 conn(0x7fde940ffcb0 msgr2=0x7fde94101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.388+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 shutdown_connections 2024-04-23T15:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.388+0000 7fde9be00640 1 -- 172.21.15.7:0/1541610299 wait complete. 2024-04-23T15:45:19.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-23T15:45:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 -- 172.21.15.7:0/2869506825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284102f60 msgr2=0x7fb284103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 --2- 172.21.15.7:0/2869506825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284102f60 0x7fb284103340 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fb278009900 tx=0x7fb27802a3f0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 -- 172.21.15.7:0/2869506825 shutdown_connections 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 --2- 172.21.15.7:0/2869506825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb284103880 0x7fb28410bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 --2- 172.21.15.7:0/2869506825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb28410c3d0 0x7fb28410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 --2- 172.21.15.7:0/2869506825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284102f60 0x7fb284103340 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 -- 172.21.15.7:0/2869506825 >> 172.21.15.7:0/2869506825 conn(0x7fb2840fc7c0 msgr2=0x7fb2840febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 -- 172.21.15.7:0/2869506825 shutdown_connections 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.611+0000 7fb28ae00640 1 -- 172.21.15.7:0/2869506825 wait complete. 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.612+0000 7fb28ae00640 1 Processor -- start 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.612+0000 7fb28ae00640 1 -- start start 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.612+0000 7fb28ae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb284102f60 0x7fb2841a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.612+0000 7fb28ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 0x7fb2841a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb28ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28410c3d0 0x7fb28419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb28ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb2841120f0 con 0x7fb284103880 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb28ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb284111f70 con 0x7fb28410c3d0 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb28ae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb284112270 con 0x7fb284102f60 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 0x7fb2841a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 0x7fb2841a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43548/0 (socket says 172.21.15.7:43548) 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 -- 172.21.15.7:0/3293727073 learned_addr learned my addr 172.21.15.7:0/3293727073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289a00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb284102f60 0x7fb2841a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb28a400640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28410c3d0 0x7fb28419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 -- 172.21.15.7:0/3293727073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb284102f60 msgr2=0x7fb2841a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb284102f60 0x7fb2841a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 -- 172.21.15.7:0/3293727073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28410c3d0 msgr2=0x7fb28419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:19.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28410c3d0 0x7fb28419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.613+0000 7fb289000640 1 -- 172.21.15.7:0/3293727073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28419af50 con 0x7fb284103880 2024-04-23T15:45:19.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.614+0000 7fb289000640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 0x7fb2841a0b10 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fb27400b450 tx=0x7fb27400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.614+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274015020 con 0x7fb284103880 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.614+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb274011d40 con 0x7fb284103880 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.614+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28419b240 con 0x7fb284103880 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.614+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27400f340 con 0x7fb284103880 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.614+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2841a7550 con 0x7fb284103880 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.615+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28406ae80 con 0x7fb284103880 2024-04-23T15:45:19.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.617+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7fb274018020 con 0x7fb284103880 2024-04-23T15:45:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.619+0000 7fb282000640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb26c0a3da0 0x7fb26c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.619+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 9401+0+0 (secure 0 0 0) 0x7fb2740d0460 con 0x7fb284103880 2024-04-23T15:45:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.619+0000 7fb289a00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb26c0a3da0 0x7fb26c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:19.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.620+0000 7fb289a00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb26c0a3da0 0x7fb26c0a6260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb278000c00 tx=0x7fb278031400 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.623+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb27401f020 con 0x7fb284103880 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: pgmap v1711: 129 pgs: 129 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: Cluster is now healthy 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2584888847' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6832/1659633499,v1:172.21.15.186:6833/1659633499] up:boot 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6834/2510697397,v1:172.21.15.186:6835/2510697397] up:boot 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6836/2359719987,v1:172.21.15.186:6837/2359719987] up:boot 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.186:6838/3826846568,v1:172.21.15.186:6839/3826846568] up:boot 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6832/981965696,v1:172.21.15.137:6834/981965696] up:boot 2024-04-23T15:45:19.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6833/2655682872,v1:172.21.15.137:6835/2655682872] up:boot 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6836/3432557243,v1:172.21.15.137:6838/3432557243] up:boot 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.137:6837/3314780485,v1:172.21.15.137:6839/3314780485] up:boot 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.7:6838/3017245896,v1:172.21.15.7:6840/3017245896] up:boot 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: mds.? [v2:172.21.15.7:6839/1996350447,v1:172.21.15.7:6841/1996350447] up:boot 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: fsmap 12 up:standby 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T15:45:19.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T15:45:19.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T15:45:19.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T15:45:19.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:19 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1541610299' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:19.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:19.830+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2841a7720 con 0x7fb284103880 2024-04-23T15:45:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: pgmap v1711: 129 pgs: 129 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-04-23T15:45:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T15:45:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T15:45:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: Cluster is now healthy 2024-04-23T15:45:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2584888847' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-23T15:45:19.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6832/1659633499,v1:172.21.15.186:6833/1659633499] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6834/2510697397,v1:172.21.15.186:6835/2510697397] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6836/2359719987,v1:172.21.15.186:6837/2359719987] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.186:6838/3826846568,v1:172.21.15.186:6839/3826846568] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6832/981965696,v1:172.21.15.137:6834/981965696] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6833/2655682872,v1:172.21.15.137:6835/2655682872] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6836/3432557243,v1:172.21.15.137:6838/3432557243] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.137:6837/3314780485,v1:172.21.15.137:6839/3314780485] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.7:6838/3017245896,v1:172.21.15.7:6840/3017245896] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: mds.? [v2:172.21.15.7:6839/1996350447,v1:172.21.15.7:6841/1996350447] up:boot 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: fsmap 12 up:standby 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T15:45:19.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T15:45:19.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T15:45:19.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T15:45:19.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T15:45:19.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T15:45:19.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T15:45:19.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:19 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1541610299' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:19.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: pgmap v1711: 129 pgs: 129 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-04-23T15:45:19.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: Cluster is now healthy 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2584888847' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6832/1659633499,v1:172.21.15.186:6833/1659633499] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6834/2510697397,v1:172.21.15.186:6835/2510697397] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6836/2359719987,v1:172.21.15.186:6837/2359719987] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.186:6838/3826846568,v1:172.21.15.186:6839/3826846568] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6832/981965696,v1:172.21.15.137:6834/981965696] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6833/2655682872,v1:172.21.15.137:6835/2655682872] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6836/3432557243,v1:172.21.15.137:6838/3432557243] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.137:6837/3314780485,v1:172.21.15.137:6839/3314780485] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.7:6838/3017245896,v1:172.21.15.7:6840/3017245896] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: mds.? [v2:172.21.15.7:6839/1996350447,v1:172.21.15.7:6841/1996350447] up:boot 2024-04-23T15:45:19.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: fsmap 12 up:standby 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T15:45:19.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:19 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1541610299' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:20.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.395+0000 7fb282000640 1 -- 172.21.15.7:0/3293727073 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v186) ==== 169+0+0 (secure 0 0 0) 0x7fb27400d040 con 0x7fb284103880 2024-04-23T15:45:20.398 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-23T15:45:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.401+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb26c0a3da0 msgr2=0x7fb26c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.401+0000 7fb28ae00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb26c0a3da0 0x7fb26c0a6260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb278000c00 tx=0x7fb278031400 comp rx=0 tx=0).stop 2024-04-23T15:45:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.401+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 msgr2=0x7fb2841a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.401+0000 7fb28ae00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 0x7fb2841a0b10 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fb27400b450 tx=0x7fb27400b910 comp rx=0 tx=0).stop 2024-04-23T15:45:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.402+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 shutdown_connections 2024-04-23T15:45:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.402+0000 7fb28ae00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7fb26c0a3da0 0x7fb26c0a6260 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.402+0000 7fb28ae00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28410c3d0 0x7fb28419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.402+0000 7fb28ae00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284103880 0x7fb2841a0b10 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.402+0000 7fb28ae00640 1 --2- 172.21.15.7:0/3293727073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb284102f60 0x7fb2841a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.402+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 >> 172.21.15.7:0/3293727073 conn(0x7fb2840fc7c0 msgr2=0x7fb284101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:20.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.403+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 shutdown_connections 2024-04-23T15:45:20.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.404+0000 7fb28ae00640 1 -- 172.21.15.7:0/3293727073 wait complete. 2024-04-23T15:45:20.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-23T15:45:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 -- 172.21.15.7:0/2967738214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2428074430 msgr2=0x7f2428074810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 --2- 172.21.15.7:0/2967738214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2428074430 0x7f2428074810 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2418009900 tx=0x7f241802a480 comp rx=0 tx=0).stop 2024-04-23T15:45:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 -- 172.21.15.7:0/2967738214 shutdown_connections 2024-04-23T15:45:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 --2- 172.21.15.7:0/2967738214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f242810e6e0 0x7f2428110b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 --2- 172.21.15.7:0/2967738214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 0x7f242810e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 --2- 172.21.15.7:0/2967738214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2428074430 0x7f2428074810 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 -- 172.21.15.7:0/2967738214 >> 172.21.15.7:0/2967738214 conn(0x7f24280fd9d0 msgr2=0x7f24280ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 -- 172.21.15.7:0/2967738214 shutdown_connections 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.636+0000 7f2427e00640 1 -- 172.21.15.7:0/2967738214 wait complete. 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.637+0000 7f2427e00640 1 Processor -- start 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 -- start start 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2428074430 0x7f24281a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 0x7f24281a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 0x7f242819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2428114320 con 0x7f242810e6e0 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24281141a0 con 0x7f2428074430 2024-04-23T15:45:20.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f24281144a0 con 0x7f2428074d50 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 0x7f242819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 0x7f242819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43574/0 (socket says 172.21.15.7:43574) 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.638+0000 7f2427400640 1 -- 172.21.15.7:0/2294208171 learned_addr learned my addr 172.21.15.7:0/2294208171 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2426a00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2428074430 0x7f24281a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2426000640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 0x7f24281a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2427400640 1 -- 172.21.15.7:0/2294208171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 msgr2=0x7f24281a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2427400640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 0x7f24281a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2427400640 1 -- 172.21.15.7:0/2294208171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2428074430 msgr2=0x7f24281a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2427400640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2428074430 0x7f24281a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2427400640 1 -- 172.21.15.7:0/2294208171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242819b000 con 0x7f242810e6e0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2426000640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 0x7f24281a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.639+0000 7f2427400640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 0x7f242819a740 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f242000eb10 tx=0x7f242000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.640+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420004b20 con 0x7f242810e6e0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.640+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242819b2f0 con 0x7f242810e6e0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.640+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2420004cc0 con 0x7f242810e6e0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.640+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24281a75b0 con 0x7f242810e6e0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.640+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420018630 con 0x7f242810e6e0 2024-04-23T15:45:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.641+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2428075ae0 con 0x7f242810e6e0 2024-04-23T15:45:20.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.643+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 26) ==== 138776+0+0 (secure 0 0 0) 0x7f2420005000 con 0x7f242810e6e0 2024-04-23T15:45:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.644+0000 7f241f400640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f240c0a3d20 0x7f240c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:45:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.645+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 8842+0+0 (secure 0 0 0) 0x7f24200d1020 con 0x7f242810e6e0 2024-04-23T15:45:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.645+0000 7f2426a00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f240c0a3d20 0x7f240c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:45:20.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.646+0000 7f2426a00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f240c0a3d20 0x7f240c0a61e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2418031440 tx=0x7f2418005b50 comp rx=0 tx=0).ready entity=mgr.15528 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:45:20.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.649+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f242009d580 con 0x7f242810e6e0 2024-04-23T15:45:20.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:20 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/1541610299' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:20.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:20 smithi137 ceph-mon[31694]: osdmap e185: 12 total, 12 up, 12 in 2024-04-23T15:45:20.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:20 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3293727073' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:20.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:20 smithi137 ceph-mon[31694]: pgmap v1713: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T15:45:20.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:20 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/1541610299' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:20.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:20 smithi007 ceph-mon[27906]: osdmap e185: 12 total, 12 up, 12 in 2024-04-23T15:45:20.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:20 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3293727073' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:20.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:20 smithi007 ceph-mon[27906]: pgmap v1713: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T15:45:20.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:20 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/1541610299' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:20 smithi186 ceph-mon[31814]: osdmap e185: 12 total, 12 up, 12 in 2024-04-23T15:45:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:20 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3293727073' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:20.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:20 smithi186 ceph-mon[31814]: pgmap v1713: 97 pgs: 97 active+clean; 14 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T15:45:20.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:20.875+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2428109860 con 0x7f242810e6e0 2024-04-23T15:45:21.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.410+0000 7f241f400640 1 -- 172.21.15.7:0/2294208171 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v187) ==== 178+0+0 (secure 0 0 0) 0x7f242009ce80 con 0x7f242810e6e0 2024-04-23T15:45:21.411 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' removed 2024-04-23T15:45:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.413+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f240c0a3d20 msgr2=0x7f240c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.413+0000 7f2427e00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f240c0a3d20 0x7f240c0a61e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2418031440 tx=0x7f2418005b50 comp rx=0 tx=0).stop 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.413+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 msgr2=0x7f242819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.413+0000 7f2427e00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 0x7f242819a740 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f242000eb10 tx=0x7f242000c2d0 comp rx=0 tx=0).stop 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.414+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 shutdown_connections 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.414+0000 7f2427e00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:6800/4082524202,v1:172.21.15.7:6801/4082524202] conn(0x7f240c0a3d20 0x7f240c0a61e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.414+0000 7f2427e00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f242810e6e0 0x7f242819a740 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.414+0000 7f2427e00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2428074d50 0x7f24281a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:21.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.414+0000 7f2427e00640 1 --2- 172.21.15.7:0/2294208171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2428074430 0x7f24281a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:45:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.414+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 >> 172.21.15.7:0/2294208171 conn(0x7f24280fd9d0 msgr2=0x7f24280fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:45:21.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.415+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 shutdown_connections 2024-04-23T15:45:21.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-23T15:45:21.416+0000 7f2427e00640 1 -- 172.21.15.7:0/2294208171 wait complete. 2024-04-23T15:45:21.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:45:21.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:45:21.618 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:21 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/3293727073' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:21 smithi137 ceph-mon[31694]: osdmap e186: 12 total, 12 up, 12 in 2024-04-23T15:45:21.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:21 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2294208171' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:21.676 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:21 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/3293727073' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:21.676 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:21 smithi186 ceph-mon[31814]: osdmap e186: 12 total, 12 up, 12 in 2024-04-23T15:45:21.676 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:21 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2294208171' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:21.687 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-23T15:45:21.687 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T15:45:21.753 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T15:45:21.832 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T15:45:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:21 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/3293727073' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:21 smithi007 ceph-mon[27906]: osdmap e186: 12 total, 12 up, 12 in 2024-04-23T15:45:21.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:21 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2294208171' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T15:45:21.899 INFO:tasks.cephadm:Stopping all daemons... 2024-04-23T15:45:21.900 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-23T15:45:21.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a 2024-04-23T15:45:22.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 systemd[1]: Stopping Ceph mon.a for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:22.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 ceph-mon[27906]: from='client.? 172.21.15.7:0/2294208171' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:22.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 ceph-mon[27906]: osdmap e187: 12 total, 12 up, 12 in 2024-04-23T15:45:22.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 ceph-mon[27906]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:45:22.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 ceph-mon[27906]: pgmap v1716: 1 pgs: 1 active+clean; 577 KiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T15:45:22.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a[27902]: 2024-04-23T15:45:22.623+0000 7f3b95600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:45:22.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a[27902]: 2024-04-23T15:45:22.624+0000 7f3b95600700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-23T15:45:22.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:22 smithi186 ceph-mon[31814]: from='client.? 172.21.15.7:0/2294208171' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:22.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:22 smithi186 ceph-mon[31814]: osdmap e187: 12 total, 12 up, 12 in 2024-04-23T15:45:22.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:22 smithi186 ceph-mon[31814]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:45:22.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:22 smithi186 ceph-mon[31814]: pgmap v1716: 1 pgs: 1 active+clean; 577 KiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T15:45:22.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:22 smithi137 ceph-mon[31694]: from='client.? 172.21.15.7:0/2294208171' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T15:45:22.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:22 smithi137 ceph-mon[31694]: osdmap e187: 12 total, 12 up, 12 in 2024-04-23T15:45:22.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:22 smithi137 ceph-mon[31694]: from='mgr.15528 172.21.15.7:0/896383043' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:45:22.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:22 smithi137 ceph-mon[31694]: pgmap v1716: 1 pgs: 1 active+clean; 577 KiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T15:45:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:22 smithi007 podman[125999]: 2024-04-23 15:45:22.763998055 +0000 UTC m=+0.331518806 container died b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-23T15:45:23.478 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:23 smithi007 podman[125999]: 2024-04-23 15:45:23.234322305 +0000 UTC m=+0.801843043 container cleanup b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-04-23T15:45:23.478 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:23 smithi007 bash[125999]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a 2024-04-23T15:45:23.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Apr 23 15:45:23 smithi007 podman[126011]: 2024-04-23 15:45:23.477916394 +0000 UTC m=+0.689488538 container remove b6f0e14cdb06e6a30102a48ef128ce3b890695894026a396d131ab10ac68f864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:45:24.077 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.a.service' 2024-04-23T15:45:24.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:24.239 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-23T15:45:24.239 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-23T15:45:24.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.b 2024-04-23T15:45:24.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:24 smithi137 systemd[1]: Stopping Ceph mon.b for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:25.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b[31690]: 2024-04-23T15:45:24.814+0000 7f5764200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:45:25.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b[31690]: 2024-04-23T15:45:24.814+0000 7f5764200700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-23T15:45:25.168 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:24 smithi137 podman[77548]: 2024-04-23 15:45:24.992389389 +0000 UTC m=+0.320958634 container died cd17eb6ef5c7359210f36d5ece1a763504a42c1edffcaf50d645054ddd6d4f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:45:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:25 smithi137 podman[77548]: 2024-04-23 15:45:25.49372901 +0000 UTC m=+0.822298245 container cleanup cd17eb6ef5c7359210f36d5ece1a763504a42c1edffcaf50d645054ddd6d4f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-23T15:45:25.668 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:25 smithi137 bash[77548]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b 2024-04-23T15:45:26.167 INFO:journalctl@ceph.mon.b.smithi137.stdout:Apr 23 15:45:25 smithi137 podman[77562]: 2024-04-23 15:45:25.762195999 +0000 UTC m=+0.750605494 container remove cd17eb6ef5c7359210f36d5ece1a763504a42c1edffcaf50d645054ddd6d4f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-23T15:45:26.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.b.service' 2024-04-23T15:45:26.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:26.405 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-23T15:45:26.405 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-23T15:45:26.405 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.c 2024-04-23T15:45:26.863 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:26 smithi186 systemd[1]: Stopping Ceph mon.c for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:27.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-c[31810]: 2024-04-23T15:45:27.108+0000 7f7af2800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:45:27.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-c[31810]: 2024-04-23T15:45:27.108+0000 7f7af2800700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-23T15:45:27.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:27 smithi186 podman[80318]: 2024-04-23 15:45:27.180715551 +0000 UTC m=+0.271373442 container died 7ee498c8dc6055cd7159b071ee8b0345cc3491db6707530eea4a5c3b5b52af00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-c, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS) 2024-04-23T15:45:27.958 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:27 smithi186 podman[80318]: 2024-04-23 15:45:27.642776588 +0000 UTC m=+0.733434504 container cleanup 7ee498c8dc6055cd7159b071ee8b0345cc3491db6707530eea4a5c3b5b52af00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:45:27.958 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:27 smithi186 bash[80318]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-c 2024-04-23T15:45:28.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:Apr 23 15:45:27 smithi186 podman[80329]: 2024-04-23 15:45:27.95740412 +0000 UTC m=+0.755321284 container remove 7ee498c8dc6055cd7159b071ee8b0345cc3491db6707530eea4a5c3b5b52af00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mon-c, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:45:28.417 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mon.c.service' 2024-04-23T15:45:28.558 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:28.559 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-23T15:45:28.559 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-23T15:45:28.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x 2024-04-23T15:45:29.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 15:45:28 smithi007 systemd[1]: Stopping Ceph mgr.x for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:31.284 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 15:45:30 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x[28134]: 2024-04-23T15:45:30.858+0000 7fea76800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:45:31.284 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 15:45:30 smithi007 podman[126138]: 2024-04-23 15:45:30.969815906 +0000 UTC m=+1.947468203 container died 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:45:31.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 15:45:31 smithi007 podman[126138]: 2024-04-23 15:45:31.466677291 +0000 UTC m=+2.444329637 container cleanup 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:45:31.585 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 15:45:31 smithi007 bash[126138]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x 2024-04-23T15:45:32.085 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Apr 23 15:45:31 smithi007 podman[126152]: 2024-04-23 15:45:31.701656413 +0000 UTC m=+0.715460927 container remove 62426bc78fd5a9bdc6245d91e8b13514722617a6f529be349e8a806358698162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-x, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5) 2024-04-23T15:45:32.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-23T15:45:32.350 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:32.350 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-23T15:45:32.350 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-23T15:45:32.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.y 2024-04-23T15:45:37.419 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 15:45:37 smithi137 systemd[1]: Stopping Ceph mgr.y for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:39.418 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 15:45:39 smithi137 podman[77676]: 2024-04-23 15:45:39.159176256 +0000 UTC m=+0.274638646 container died c5bf3339a27d33dcc5b84aa80a386fc2670205ff6f6f466110bf4f6b9bdbc789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2) 2024-04-23T15:45:39.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 15:45:39 smithi137 podman[77676]: 2024-04-23 15:45:39.683783438 +0000 UTC m=+0.799245843 container cleanup c5bf3339a27d33dcc5b84aa80a386fc2670205ff6f6f466110bf4f6b9bdbc789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:45:39.918 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 15:45:39 smithi137 bash[77676]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y 2024-04-23T15:45:40.329 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 15:45:39 smithi137 podman[77686]: 2024-04-23 15:45:39.941019272 +0000 UTC m=+0.770495908 container remove c5bf3339a27d33dcc5b84aa80a386fc2670205ff6f6f466110bf4f6b9bdbc789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-23T15:45:40.329 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Apr 23 15:45:39 smithi137 systemd[1]: ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-04-23T15:45:40.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-23T15:45:40.545 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:40.545 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-23T15:45:40.545 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-23T15:45:40.545 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.z 2024-04-23T15:45:41.114 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 15:45:40 smithi186 systemd[1]: Stopping Ceph mgr.z for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:41.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 15:45:41 smithi186 podman[80449]: 2024-04-23 15:45:41.445802966 +0000 UTC m=+0.257233871 container died b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-23T15:45:42.363 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 15:45:42 smithi186 podman[80449]: 2024-04-23 15:45:42.177177511 +0000 UTC m=+0.988608446 container cleanup b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-23T15:45:42.364 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 15:45:42 smithi186 bash[80449]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z 2024-04-23T15:45:42.829 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 15:45:42 smithi186 podman[80463]: 2024-04-23 15:45:42.428808574 +0000 UTC m=+0.749768280 container remove b9040c21569788d50e114f39919282a17e6d31bc91bedaa185af51d82745770b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-04-23T15:45:42.829 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Apr 23 15:45:42 smithi186 systemd[1]: ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-04-23T15:45:42.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-23T15:45:42.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:42.972 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-23T15:45:42.972 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-23T15:45:42.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.0 2024-04-23T15:45:43.335 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:43 smithi007 systemd[1]: Stopping Ceph osd.0 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:44.336 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0[39988]: 2024-04-23T15:45:43.994+0000 7fbf83400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:45:44.336 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0[39988]: 2024-04-23T15:45:43.994+0000 7fbf83400700 -1 osd.0 187 *** Got signal Terminated *** 2024-04-23T15:45:44.336 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:43 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0[39988]: 2024-04-23T15:45:43.995+0000 7fbf83400700 -1 osd.0 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:45:50.415 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:50 smithi007 podman[126260]: 2024-04-23 15:45:50.091312728 +0000 UTC m=+6.623820628 container died 517b07ff85c789b8802d6d61d00e33a50721cdcdce3ad0a9f085831faa3db8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-23T15:45:50.775 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:50 smithi007 podman[126260]: 2024-04-23 15:45:50.547428026 +0000 UTC m=+7.079935920 container cleanup 517b07ff85c789b8802d6d61d00e33a50721cdcdce3ad0a9f085831faa3db8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:45:50.775 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:50 smithi007 bash[126260]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0 2024-04-23T15:45:51.085 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:50 smithi007 podman[126290]: 2024-04-23 15:45:50.773890452 +0000 UTC m=+0.649265006 container remove 517b07ff85c789b8802d6d61d00e33a50721cdcdce3ad0a9f085831faa3db8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:45:51.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:51 smithi007 podman[126378]: 2024-04-23 15:45:51.54828437 +0000 UTC m=+0.038921741 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:45:51.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:51 smithi007 podman[126378]: 2024-04-23 15:45:51.66672226 +0000 UTC m=+0.157359668 container create e0e3d69d819a264046afd5832df09017946affe564cb06947830de861f90a52a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD) 2024-04-23T15:45:51.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:51 smithi007 podman[126378]: 2024-04-23 15:45:51.996221851 +0000 UTC m=+0.486859265 container init e0e3d69d819a264046afd5832df09017946affe564cb06947830de861f90a52a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-23T15:45:52.335 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:52 smithi007 podman[126378]: 2024-04-23 15:45:52.008578397 +0000 UTC m=+0.499215785 container start e0e3d69d819a264046afd5832df09017946affe564cb06947830de861f90a52a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-23T15:45:52.335 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:52 smithi007 podman[126378]: 2024-04-23 15:45:52.145001237 +0000 UTC m=+0.635638688 container attach e0e3d69d819a264046afd5832df09017946affe564cb06947830de861f90a52a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD) 2024-04-23T15:45:53.335 INFO:journalctl@ceph.osd.0.smithi007.stdout:Apr 23 15:45:52 smithi007 podman[126378]: 2024-04-23 15:45:52.98519489 +0000 UTC m=+1.475832348 container died e0e3d69d819a264046afd5832df09017946affe564cb06947830de861f90a52a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-23T15:45:53.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.0.service' 2024-04-23T15:45:53.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:45:53.872 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-23T15:45:53.872 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-23T15:45:53.872 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.1 2024-04-23T15:45:54.418 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:45:53 smithi137 systemd[1]: Stopping Ceph osd.1 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:45:54.918 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:45:54 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1[36317]: 2024-04-23T15:45:54.451+0000 7facf8600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:45:54.918 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:45:54 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1[36317]: 2024-04-23T15:45:54.451+0000 7facf8600700 -1 osd.1 187 *** Got signal Terminated *** 2024-04-23T15:45:54.919 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:45:54 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1[36317]: 2024-04-23T15:45:54.451+0000 7facf8600700 -1 osd.1 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:00.799 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:00 smithi137 podman[77796]: 2024-04-23 15:46:00.46194942 +0000 UTC m=+6.123889862 container died be911f1e8da629a02234010cc269265463d2f5292ad9f7bbc65cdae9bf92f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-23T15:46:01.168 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:00 smithi137 podman[77796]: 2024-04-23 15:46:00.911926352 +0000 UTC m=+6.573866788 container cleanup be911f1e8da629a02234010cc269265463d2f5292ad9f7bbc65cdae9bf92f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:46:01.168 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:00 smithi137 bash[77796]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1 2024-04-23T15:46:01.668 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:01 smithi137 podman[77814]: 2024-04-23 15:46:01.230707523 +0000 UTC m=+0.739411464 container remove be911f1e8da629a02234010cc269265463d2f5292ad9f7bbc65cdae9bf92f9e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-23T15:46:02.353 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:02 smithi137 podman[77905]: 2024-04-23 15:46:01.947207473 +0000 UTC m=+0.034694814 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:46:02.354 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:02 smithi137 podman[77905]: 2024-04-23 15:46:02.065192801 +0000 UTC m=+0.152680183 container create 0e613cd18a300803bac2ad77653db560645fc234051b09bbe7efaf193595dcd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416) 2024-04-23T15:46:02.668 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:02 smithi137 podman[77905]: 2024-04-23 15:46:02.352525106 +0000 UTC m=+0.440012491 container init 0e613cd18a300803bac2ad77653db560645fc234051b09bbe7efaf193595dcd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-23T15:46:02.668 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:02 smithi137 podman[77905]: 2024-04-23 15:46:02.364648832 +0000 UTC m=+0.452136184 container start 0e613cd18a300803bac2ad77653db560645fc234051b09bbe7efaf193595dcd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T15:46:02.669 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:02 smithi137 podman[77905]: 2024-04-23 15:46:02.560285013 +0000 UTC m=+0.647772394 container attach 0e613cd18a300803bac2ad77653db560645fc234051b09bbe7efaf193595dcd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:46:03.918 INFO:journalctl@ceph.osd.1.smithi137.stdout:Apr 23 15:46:03 smithi137 podman[77905]: 2024-04-23 15:46:03.598558434 +0000 UTC m=+1.686045781 container died 0e613cd18a300803bac2ad77653db560645fc234051b09bbe7efaf193595dcd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD) 2024-04-23T15:46:04.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.1.service' 2024-04-23T15:46:04.504 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:46:04.505 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-23T15:46:04.505 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-23T15:46:04.505 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.2 2024-04-23T15:46:04.863 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:04 smithi186 systemd[1]: Stopping Ceph osd.2 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:46:05.363 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:05 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2[37035]: 2024-04-23T15:46:05.052+0000 7f73f8e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:46:05.363 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:05 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2[37035]: 2024-04-23T15:46:05.052+0000 7f73f8e00700 -1 osd.2 187 *** Got signal Terminated *** 2024-04-23T15:46:05.364 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:05 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2[37035]: 2024-04-23T15:46:05.052+0000 7f73f8e00700 -1 osd.2 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:11.114 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:10 smithi186 podman[80570]: 2024-04-23 15:46:10.83258962 +0000 UTC m=+5.920848933 container died d585770ee9fb2ea8c364ced19cc35a9907161aa1c95106fe5503c1051b65e575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:46:11.541 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:11 smithi186 podman[80570]: 2024-04-23 15:46:11.305015145 +0000 UTC m=+6.393274484 container cleanup d585770ee9fb2ea8c364ced19cc35a9907161aa1c95106fe5503c1051b65e575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-23T15:46:11.541 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:11 smithi186 bash[80570]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2 2024-04-23T15:46:11.863 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:11 smithi186 podman[80596]: 2024-04-23 15:46:11.539697123 +0000 UTC m=+0.683512858 container remove d585770ee9fb2ea8c364ced19cc35a9907161aa1c95106fe5503c1051b65e575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:46:12.614 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:12 smithi186 podman[80689]: 2024-04-23 15:46:12.215077864 +0000 UTC m=+0.033437199 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:46:12.614 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:12 smithi186 podman[80689]: 2024-04-23 15:46:12.324184372 +0000 UTC m=+0.142543744 container create 6050f0c6abd5233e63280a8d3a5d14841510bc058333eff49daa34588a1e4335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-23T15:46:13.113 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:12 smithi186 podman[80689]: 2024-04-23 15:46:12.636954678 +0000 UTC m=+0.455314060 container init 6050f0c6abd5233e63280a8d3a5d14841510bc058333eff49daa34588a1e4335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:46:13.113 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:12 smithi186 podman[80689]: 2024-04-23 15:46:12.648157526 +0000 UTC m=+0.466516892 container start 6050f0c6abd5233e63280a8d3a5d14841510bc058333eff49daa34588a1e4335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-23T15:46:13.113 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:12 smithi186 podman[80689]: 2024-04-23 15:46:12.785271012 +0000 UTC m=+0.603630431 container attach 6050f0c6abd5233e63280a8d3a5d14841510bc058333eff49daa34588a1e4335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:46:14.074 INFO:journalctl@ceph.osd.2.smithi186.stdout:Apr 23 15:46:13 smithi186 podman[80689]: 2024-04-23 15:46:13.697405183 +0000 UTC m=+1.515764595 container died 6050f0c6abd5233e63280a8d3a5d14841510bc058333eff49daa34588a1e4335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:46:14.536 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.2.service' 2024-04-23T15:46:14.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:46:14.645 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-23T15:46:14.646 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-23T15:46:14.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.3 2024-04-23T15:46:15.049 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:14 smithi007 systemd[1]: Stopping Ceph osd.3 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:46:15.336 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3[46524]: 2024-04-23T15:46:15.250+0000 7fdc24c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:46:15.336 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3[46524]: 2024-04-23T15:46:15.250+0000 7fdc24c00700 -1 osd.3 187 *** Got signal Terminated *** 2024-04-23T15:46:15.336 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3[46524]: 2024-04-23T15:46:15.250+0000 7fdc24c00700 -1 osd.3 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:21.586 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:21 smithi007 podman[126483]: 2024-04-23 15:46:21.311353708 +0000 UTC m=+6.220582842 container died a9d62402d4e169fa66242f4fd2f518c5ca4a27acc3c5229e1e3da936d26e5926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:46:22.028 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:21 smithi007 podman[126483]: 2024-04-23 15:46:21.759844158 +0000 UTC m=+6.669073276 container cleanup a9d62402d4e169fa66242f4fd2f518c5ca4a27acc3c5229e1e3da936d26e5926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416) 2024-04-23T15:46:22.028 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:21 smithi007 bash[126483]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3 2024-04-23T15:46:22.335 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:22 smithi007 podman[126515]: 2024-04-23 15:46:22.027530109 +0000 UTC m=+0.692074059 container remove a9d62402d4e169fa66242f4fd2f518c5ca4a27acc3c5229e1e3da936d26e5926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:46:23.253 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:22 smithi007 podman[126604]: 2024-04-23 15:46:22.797531766 +0000 UTC m=+0.034296927 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:46:23.253 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:22 smithi007 podman[126604]: 2024-04-23 15:46:22.945216171 +0000 UTC m=+0.181981364 container create e741a767fb0c9cc6d1051a4c32231f3ef204a32526d369481d06f490e8296334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-23T15:46:23.253 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:23 smithi007 podman[126604]: 2024-04-23 15:46:23.250948966 +0000 UTC m=+0.487714189 container init e741a767fb0c9cc6d1051a4c32231f3ef204a32526d369481d06f490e8296334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-23T15:46:23.585 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:23 smithi007 podman[126604]: 2024-04-23 15:46:23.263789282 +0000 UTC m=+0.500554485 container start e741a767fb0c9cc6d1051a4c32231f3ef204a32526d369481d06f490e8296334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:46:23.585 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:23 smithi007 podman[126604]: 2024-04-23 15:46:23.365104499 +0000 UTC m=+0.601869728 container attach e741a767fb0c9cc6d1051a4c32231f3ef204a32526d369481d06f490e8296334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:46:24.085 INFO:journalctl@ceph.osd.3.smithi007.stdout:Apr 23 15:46:23 smithi007 podman[126604]: 2024-04-23 15:46:23.733381316 +0000 UTC m=+0.970146516 container died e741a767fb0c9cc6d1051a4c32231f3ef204a32526d369481d06f490e8296334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-23T15:46:24.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.3.service' 2024-04-23T15:46:24.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:46:24.638 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-23T15:46:24.638 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-23T15:46:24.638 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.4 2024-04-23T15:46:25.168 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:24 smithi137 systemd[1]: Stopping Ceph osd.4 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:46:25.622 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4[42789]: 2024-04-23T15:46:25.203+0000 7fd8bbc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:46:25.622 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4[42789]: 2024-04-23T15:46:25.203+0000 7fd8bbc00700 -1 osd.4 187 *** Got signal Terminated *** 2024-04-23T15:46:25.622 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4[42789]: 2024-04-23T15:46:25.203+0000 7fd8bbc00700 -1 osd.4 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:31.418 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:31 smithi137 podman[78035]: 2024-04-23 15:46:31.13953496 +0000 UTC m=+6.082347241 container died c30d4b916047542583c08e34c76c8ca3533f6bbcd849fe069624674fbed63e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True) 2024-04-23T15:46:31.818 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:31 smithi137 podman[78035]: 2024-04-23 15:46:31.583035731 +0000 UTC m=+6.525848006 container cleanup c30d4b916047542583c08e34c76c8ca3533f6bbcd849fe069624674fbed63e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-23T15:46:31.819 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:31 smithi137 bash[78035]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4 2024-04-23T15:46:32.168 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:31 smithi137 podman[78054]: 2024-04-23 15:46:31.817750757 +0000 UTC m=+0.658089432 container remove c30d4b916047542583c08e34c76c8ca3533f6bbcd849fe069624674fbed63e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD) 2024-04-23T15:46:32.918 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:32 smithi137 podman[78142]: 2024-04-23 15:46:32.546578857 +0000 UTC m=+0.036496243 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:46:32.918 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:32 smithi137 podman[78142]: 2024-04-23 15:46:32.677338102 +0000 UTC m=+0.167255519 container create 330a1645593f74a4224020e4294e0fccc9ff272467b7ea6695d550b0f46b30aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-23T15:46:33.418 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:32 smithi137 podman[78142]: 2024-04-23 15:46:32.972586841 +0000 UTC m=+0.462504268 container init 330a1645593f74a4224020e4294e0fccc9ff272467b7ea6695d550b0f46b30aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-23T15:46:33.418 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:32 smithi137 podman[78142]: 2024-04-23 15:46:32.983603816 +0000 UTC m=+0.473521240 container start 330a1645593f74a4224020e4294e0fccc9ff272467b7ea6695d550b0f46b30aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0) 2024-04-23T15:46:33.418 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:33 smithi137 podman[78142]: 2024-04-23 15:46:33.080145206 +0000 UTC m=+0.570062676 container attach 330a1645593f74a4224020e4294e0fccc9ff272467b7ea6695d550b0f46b30aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:46:33.788 INFO:journalctl@ceph.osd.4.smithi137.stdout:Apr 23 15:46:33 smithi137 podman[78142]: 2024-04-23 15:46:33.437735806 +0000 UTC m=+0.927653230 container died 330a1645593f74a4224020e4294e0fccc9ff272467b7ea6695d550b0f46b30aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:46:34.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.4.service' 2024-04-23T15:46:34.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:46:34.297 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-23T15:46:34.297 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-23T15:46:34.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.5 2024-04-23T15:46:34.864 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:34 smithi186 systemd[1]: Stopping Ceph osd.5 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:46:35.250 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5[43783]: 2024-04-23T15:46:34.864+0000 7f865c200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:46:35.250 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5[43783]: 2024-04-23T15:46:34.864+0000 7f865c200700 -1 osd.5 187 *** Got signal Terminated *** 2024-04-23T15:46:35.250 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5[43783]: 2024-04-23T15:46:34.864+0000 7f865c200700 -1 osd.5 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:41.218 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:40 smithi186 podman[80794]: 2024-04-23 15:46:40.887040158 +0000 UTC m=+6.153362541 container died 966745bce94e1b4a49b03eb54c2c84d429fbc4fd092f74457a2cc82cd78b5d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True) 2024-04-23T15:46:41.594 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:41 smithi186 podman[80794]: 2024-04-23 15:46:41.358255224 +0000 UTC m=+6.624577631 container cleanup 966745bce94e1b4a49b03eb54c2c84d429fbc4fd092f74457a2cc82cd78b5d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-23T15:46:41.594 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:41 smithi186 bash[80794]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5 2024-04-23T15:46:41.863 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:41 smithi186 podman[80826]: 2024-04-23 15:46:41.593191503 +0000 UTC m=+0.678994932 container remove 966745bce94e1b4a49b03eb54c2c84d429fbc4fd092f74457a2cc82cd78b5d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:46:42.726 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:42 smithi186 podman[80912]: 2024-04-23 15:46:42.31995664 +0000 UTC m=+0.039620048 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:46:42.726 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:42 smithi186 podman[80912]: 2024-04-23 15:46:42.444172494 +0000 UTC m=+0.163835900 container create 10b47cb42af3f0e834874a62aeac89856c5853eb6062728f0df9e2a459878249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-23T15:46:42.727 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:42 smithi186 podman[80912]: 2024-04-23 15:46:42.725406614 +0000 UTC m=+0.445070073 container init 10b47cb42af3f0e834874a62aeac89856c5853eb6062728f0df9e2a459878249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=) 2024-04-23T15:46:43.113 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:42 smithi186 podman[80912]: 2024-04-23 15:46:42.738685992 +0000 UTC m=+0.458349401 container start 10b47cb42af3f0e834874a62aeac89856c5853eb6062728f0df9e2a459878249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS) 2024-04-23T15:46:43.113 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:42 smithi186 podman[80912]: 2024-04-23 15:46:42.846745687 +0000 UTC m=+0.566409074 container attach 10b47cb42af3f0e834874a62aeac89856c5853eb6062728f0df9e2a459878249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-23T15:46:43.525 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:43 smithi186 podman[80912]: 2024-04-23 15:46:43.189213906 +0000 UTC m=+0.908877302 container died 10b47cb42af3f0e834874a62aeac89856c5853eb6062728f0df9e2a459878249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:46:43.894 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.5.service' 2024-04-23T15:46:44.113 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:43 smithi186 podman[80938]: 2024-04-23 15:46:43.842565646 +0000 UTC m=+0.638345413 container remove 10b47cb42af3f0e834874a62aeac89856c5853eb6062728f0df9e2a459878249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:46:44.113 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:43 smithi186 systemd[1]: ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-23T15:46:44.114 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:43 smithi186 systemd[1]: Stopped Ceph osd.5 for 7b70c844-017e-11ef-bc93-c7b262605968. 2024-04-23T15:46:44.114 INFO:journalctl@ceph.osd.5.smithi186.stdout:Apr 23 15:46:43 smithi186 systemd[1]: ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.5.service: Consumed 12min 23.390s CPU time. 2024-04-23T15:46:44.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:46:44.123 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-23T15:46:44.123 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-23T15:46:44.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.6 2024-04-23T15:46:44.585 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:44 smithi007 systemd[1]: Stopping Ceph osd.6 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:46:45.086 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:44 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6[53325]: 2024-04-23T15:46:44.769+0000 7fcd55200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:46:45.086 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:44 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6[53325]: 2024-04-23T15:46:44.769+0000 7fcd55200700 -1 osd.6 187 *** Got signal Terminated *** 2024-04-23T15:46:45.086 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:44 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6[53325]: 2024-04-23T15:46:44.769+0000 7fcd55200700 -1 osd.6 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:50.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:50.311+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:51.030 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:50 smithi007 podman[126707]: 2024-04-23 15:46:50.6176042 +0000 UTC m=+5.996675699 container died 11a1b7beb4c426622866d0de6e19e46fa62bd20b171c28d5a5f013c92c40c331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:46:51.329 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:51 smithi007 podman[126707]: 2024-04-23 15:46:51.14542624 +0000 UTC m=+6.524497762 container cleanup 11a1b7beb4c426622866d0de6e19e46fa62bd20b171c28d5a5f013c92c40c331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True) 2024-04-23T15:46:51.329 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:51 smithi007 bash[126707]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6 2024-04-23T15:46:51.585 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:51 smithi007 podman[126738]: 2024-04-23 15:46:51.446696208 +0000 UTC m=+0.811394872 container remove 11a1b7beb4c426622866d0de6e19e46fa62bd20b171c28d5a5f013c92c40c331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-23T15:46:51.586 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:51 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:51.326+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:52.114 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:51 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:51.848+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:52.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:52 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:52.292+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:52.586 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:52 smithi007 podman[126831]: 2024-04-23 15:46:52.171016023 +0000 UTC m=+0.038922985 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:46:52.586 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:52 smithi007 podman[126831]: 2024-04-23 15:46:52.289272545 +0000 UTC m=+0.157179514 container create 75c14a847816dce3a3ffec312b5049294151e34435f8969babb411d4cb8f3aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-23T15:46:53.079 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:52 smithi007 podman[126831]: 2024-04-23 15:46:52.593892104 +0000 UTC m=+0.461799108 container init 75c14a847816dce3a3ffec312b5049294151e34435f8969babb411d4cb8f3aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-23T15:46:53.079 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:52 smithi007 podman[126831]: 2024-04-23 15:46:52.605618172 +0000 UTC m=+0.473525190 container start 75c14a847816dce3a3ffec312b5049294151e34435f8969babb411d4cb8f3aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:46:53.079 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:52 smithi007 podman[126831]: 2024-04-23 15:46:52.709462518 +0000 UTC m=+0.577369566 container attach 75c14a847816dce3a3ffec312b5049294151e34435f8969babb411d4cb8f3aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True) 2024-04-23T15:46:53.079 INFO:journalctl@ceph.osd.6.smithi007.stdout:Apr 23 15:46:53 smithi007 podman[126831]: 2024-04-23 15:46:53.077830389 +0000 UTC m=+0.945737351 container died 75c14a847816dce3a3ffec312b5049294151e34435f8969babb411d4cb8f3aeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-23T15:46:53.113 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:52 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:52.852+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:53.335 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:53 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:53.274+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:53.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.6.service' 2024-04-23T15:46:54.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:46:54.109 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-23T15:46:54.109 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-23T15:46:54.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.7 2024-04-23T15:46:54.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:53 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:53.893+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:54.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:54 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:54.320+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:54.661 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:46:54 smithi137 systemd[1]: Stopping Ceph osd.7 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:46:54.918 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:46:54 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7[49599]: 2024-04-23T15:46:54.659+0000 7ff130e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:46:54.918 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:46:54 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7[49599]: 2024-04-23T15:46:54.659+0000 7ff130e00700 -1 osd.7 187 *** Got signal Terminated *** 2024-04-23T15:46:54.918 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:46:54 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7[49599]: 2024-04-23T15:46:54.659+0000 7ff130e00700 -1 osd.7 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:46:55.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:54 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:54.901+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:55.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:55 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:55.310+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:56.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:46:55 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:46:55.795+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:46:56.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:55 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:55.932+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:56.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:56 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:56.313+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:57.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:46:56 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:46:56.835+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:46:57.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:56 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:56.969+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:57.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:57 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:57.272+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:58.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:46:57 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:46:57.791+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:46:58.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:58 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:58.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:58.586 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:58 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:58.292+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:46:59.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:46:58 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:46:58.762+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:46:59.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:59 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:59.000+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:46:59.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:46:59 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:46:59.325+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:00.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:46:59 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:46:59.799+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:00.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:46:59 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:46:59.954+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:00.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:00 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:00.297+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:00.918 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:00 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:00.818+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:00.918 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:00 smithi137 podman[78262]: 2024-04-23 15:47:00.632800801 +0000 UTC m=+6.112606772 container died 83a7b2bf4c1c1d3c9d93101dac1c214a08750f9c35d658cf6eb5790aedacfc41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-23T15:47:01.338 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:01 smithi137 podman[78262]: 2024-04-23 15:47:01.044657245 +0000 UTC m=+6.524463278 container cleanup 83a7b2bf4c1c1d3c9d93101dac1c214a08750f9c35d658cf6eb5790aedacfc41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-23T15:47:01.338 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:01 smithi137 bash[78262]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7 2024-04-23T15:47:01.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:00 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:00.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:01.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:01 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:01.298+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:01.667 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:01 smithi137 podman[78281]: 2024-04-23 15:47:01.337343597 +0000 UTC m=+0.685223370 container remove 83a7b2bf4c1c1d3c9d93101dac1c214a08750f9c35d658cf6eb5790aedacfc41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-23T15:47:01.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:01 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:01.476+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:02.155 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:01 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:01.818+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:02.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:01 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:01.964+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:02.418 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:02 smithi137 podman[78369]: 2024-04-23 15:47:02.060574638 +0000 UTC m=+0.033642266 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:47:02.418 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:02 smithi137 podman[78369]: 2024-04-23 15:47:02.255294587 +0000 UTC m=+0.228362252 container create bd0f4b1e2bb60682a5bf144627d30ce56eaaef2bcd0498380aeb119f8e2e47ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:47:02.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:02 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:02.320+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:02.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:02 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:02.320+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:02.793 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:02 smithi137 podman[78369]: 2024-04-23 15:47:02.508896576 +0000 UTC m=+0.481964261 container init bd0f4b1e2bb60682a5bf144627d30ce56eaaef2bcd0498380aeb119f8e2e47ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:47:02.794 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:02 smithi137 podman[78369]: 2024-04-23 15:47:02.521206669 +0000 UTC m=+0.494274371 container start bd0f4b1e2bb60682a5bf144627d30ce56eaaef2bcd0498380aeb119f8e2e47ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:47:02.794 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:02 smithi137 podman[78369]: 2024-04-23 15:47:02.616007222 +0000 UTC m=+0.589074937 container attach bd0f4b1e2bb60682a5bf144627d30ce56eaaef2bcd0498380aeb119f8e2e47ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux ) 2024-04-23T15:47:02.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:02 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:02.486+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:03.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:02 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:02.791+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:03.168 INFO:journalctl@ceph.osd.7.smithi137.stdout:Apr 23 15:47:02 smithi137 podman[78369]: 2024-04-23 15:47:02.976168272 +0000 UTC m=+0.949235951 container died bd0f4b1e2bb60682a5bf144627d30ce56eaaef2bcd0498380aeb119f8e2e47ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-23T15:47:03.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:02 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:02.990+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:03.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:02 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:02.990+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:03.586 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:03 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:03.327+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:03.586 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:03 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:03.327+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:03.698 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.7.service' 2024-04-23T15:47:03.806 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:03.806 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-23T15:47:03.806 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-23T15:47:03.807 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.8 2024-04-23T15:47:03.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:03 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:03.439+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:03.918 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:03 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:03.758+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:04.326 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:03 smithi186 systemd[1]: Stopping Ceph osd.8 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:04.326 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:03 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:03.986+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:04.326 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:03 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:03.986+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:04.613 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:04.324+0000 7f4a01e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:04.614 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:04.324+0000 7f4a01e00700 -1 osd.8 187 *** Got signal Terminated *** 2024-04-23T15:47:04.614 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:04.324+0000 7f4a01e00700 -1 osd.8 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:47:04.614 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:04.478+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:04.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:04.343+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:04.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:04 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:04.343+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:05.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:04 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:04.725+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:05.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:04 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:04.725+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:05.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:04.959+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:05.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:04 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:04.959+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:05.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:05 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:05.362+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:05.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:05 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:05.362+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:05.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:05 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:05.505+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:06.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:05 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:05.754+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:06.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:05 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:05.754+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:06.366 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:05 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:05.922+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:06.366 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:05 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:05.922+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:06.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:06 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:06.346+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:06.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:06 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:06.346+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:06.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:06 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:06.499+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:07.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:06 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:06.756+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:07.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:06 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:06.756+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:07.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:06 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:06.943+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:07.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:06 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:06.943+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:07.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:07 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:07.308+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:07.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:07 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:07.308+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:07.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:07 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:07.467+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:08.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:07 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:07.714+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:08.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:07 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:07.714+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:08.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:07 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:07.983+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:08.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:07 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:07.983+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:08.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:08 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:08.345+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:08.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:08 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:08.345+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:08.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:08 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8[50739]: 2024-04-23T15:47:08.452+0000 7f49f8600700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:58.192324+0000 front 2024-04-23T15:45:58.191731+0000 (oldest deadline 2024-04-23T15:47:00.491840+0000) 2024-04-23T15:47:09.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:08 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:08.678+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:09.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:08 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:08.678+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:09.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:08 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:08.989+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:09.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:08 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:08.989+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:09.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:09 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:09.394+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:09.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:09 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:09.394+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:10.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:09 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:09.681+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:10.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:09 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:09.681+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:10.360 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:10 smithi186 podman[81017]: 2024-04-23 15:47:10.030543556 +0000 UTC m=+5.853832392 container died 7a2c990f33c3707aee5095dc9bf6af3c672e8370b09cd765978b22919de51a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:47:10.361 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:09 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:09.972+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:10.361 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:09 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:09.972+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:10.613 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:10 smithi186 podman[81017]: 2024-04-23 15:47:10.48597775 +0000 UTC m=+6.309266593 container cleanup 7a2c990f33c3707aee5095dc9bf6af3c672e8370b09cd765978b22919de51a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-23T15:47:10.613 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:10 smithi186 bash[81017]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8 2024-04-23T15:47:10.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:10 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:10.415+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:10.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:10 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:10.415+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:10.993 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:10 smithi186 podman[81048]: 2024-04-23 15:47:10.737067328 +0000 UTC m=+0.669697447 container remove 7a2c990f33c3707aee5095dc9bf6af3c672e8370b09cd765978b22919de51a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-04-23T15:47:11.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:10 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:10.716+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:11.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:10 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:10.716+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:11.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:10 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:10.991+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:11.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:10 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:10.991+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:11.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:11 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:11.410+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:11.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:11 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:11.410+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:11.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:11 smithi186 podman[81130]: 2024-04-23 15:47:11.463947712 +0000 UTC m=+0.033468808 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:47:11.863 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:11 smithi186 podman[81130]: 2024-04-23 15:47:11.579764072 +0000 UTC m=+0.149285202 container create 8343964f07862ea9a7542c683ca2e67bf2deb9c5d96c91b9b4822068f608df62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:47:12.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:11.747+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:12.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:11.747+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:12.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:11.970+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:12.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:11.970+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:12.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:11 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:11.970+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:12.364 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:11 smithi186 podman[81130]: 2024-04-23 15:47:11.894712061 +0000 UTC m=+0.464233197 container init 8343964f07862ea9a7542c683ca2e67bf2deb9c5d96c91b9b4822068f608df62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS) 2024-04-23T15:47:12.364 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:11 smithi186 podman[81130]: 2024-04-23 15:47:11.905651783 +0000 UTC m=+0.475172940 container start 8343964f07862ea9a7542c683ca2e67bf2deb9c5d96c91b9b4822068f608df62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5) 2024-04-23T15:47:12.364 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:12 smithi186 podman[81130]: 2024-04-23 15:47:12.140732946 +0000 UTC m=+0.710254080 container attach 8343964f07862ea9a7542c683ca2e67bf2deb9c5d96c91b9b4822068f608df62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-23T15:47:12.738 INFO:journalctl@ceph.osd.8.smithi186.stdout:Apr 23 15:47:12 smithi186 podman[81130]: 2024-04-23 15:47:12.372478171 +0000 UTC m=+0.941999281 container died 8343964f07862ea9a7542c683ca2e67bf2deb9c5d96c91b9b4822068f608df62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-23T15:47:12.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:12 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:12.391+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:12.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:12 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:12.391+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:13.086 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.8.service' 2024-04-23T15:47:13.167 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:12 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:12.749+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:13.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:12 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:12.749+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:13.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:13.197 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-23T15:47:13.197 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-23T15:47:13.197 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.9 2024-04-23T15:47:13.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:13.011+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:13.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:13.011+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:13.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:13.011+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:13.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:13 smithi007 systemd[1]: Stopping Ceph osd.9 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:13.585 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:13.381+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:13.586 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:13.381+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:14.070 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:13 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:13.769+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:14.070 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:13 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:13.769+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:14.070 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:13 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:13.769+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:14.085 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:13.816+0000 7f8c76e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:14.085 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:13.816+0000 7f8c76e00700 -1 osd.9 187 *** Got signal Terminated *** 2024-04-23T15:47:14.085 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:13 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:13.816+0000 7f8c76e00700 -1 osd.9 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:47:14.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:13.998+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:14.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:13 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:13.998+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:14.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:13.998+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:14.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:14 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:14.341+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:14.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:14 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:14.341+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:14.836 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:14 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:14.341+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.129964+0000 front 2024-04-23T15:46:08.129437+0000 (oldest deadline 2024-04-23T15:47:14.029698+0000) 2024-04-23T15:47:15.108 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:14.727+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:15.108 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:14.727+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:15.108 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:14 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:14.727+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:15.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:14.976+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:15.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:14.976+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:15.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:14 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:14.976+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:15.738 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:15.357+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:15.738 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:15.357+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:15.738 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:15 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:15.357+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.129964+0000 front 2024-04-23T15:46:08.129437+0000 (oldest deadline 2024-04-23T15:47:14.029698+0000) 2024-04-23T15:47:16.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:15 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:15.774+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:16.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:15 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:15.774+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:16.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:15 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:15.774+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:16.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:15 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:15.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:16.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:15 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:15.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:16.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:15 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:15.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:16.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:16 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:16.342+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:16.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:16 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:16.342+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:16.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:16 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:16.342+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.129964+0000 front 2024-04-23T15:46:08.129437+0000 (oldest deadline 2024-04-23T15:47:14.029698+0000) 2024-04-23T15:47:17.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:16 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:16.790+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:17.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:16 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:16.790+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:17.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:16 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:16.790+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:17.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:17.015+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:17.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:17.015+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:17.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:17 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:17.015+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:17.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:17.365+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:17.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:17.365+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:17.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:17 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:17.365+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.129964+0000 front 2024-04-23T15:46:08.129437+0000 (oldest deadline 2024-04-23T15:47:14.029698+0000) 2024-04-23T15:47:18.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:17.762+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:18.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:17.762+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:18.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:17 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:17.762+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:18.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:18.060+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:18.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:18.060+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:18.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:18 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:18.060+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:18.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:18.344+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.622009+0000 front 2024-04-23T15:45:46.622183+0000 (oldest deadline 2024-04-23T15:46:50.122111+0000) 2024-04-23T15:47:18.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:18.344+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.426331+0000 front 2024-04-23T15:45:59.426945+0000 (oldest deadline 2024-04-23T15:47:01.726600+0000) 2024-04-23T15:47:18.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:18 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9[59903]: 2024-04-23T15:47:18.344+0000 7f8c6d600700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.129964+0000 front 2024-04-23T15:46:08.129437+0000 (oldest deadline 2024-04-23T15:47:14.029698+0000) 2024-04-23T15:47:19.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:18 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:18.749+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:19.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:18 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:18.749+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:19.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:18 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:18.749+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:19.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:19.076+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:19.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:19.076+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:19.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:19.076+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:20.150 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:19 smithi007 podman[126936]: 2024-04-23 15:47:19.856480547 +0000 UTC m=+6.176164920 container died 497956a28d7eabd9b37698a9f9909a693c9dda044fbb6c2afaf62c6322f3510c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T15:47:20.167 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:19 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:19.743+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:20.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:19 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:19.743+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:20.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:19 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:19.743+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:20.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:20 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:20.032+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:20.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:20 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:20.032+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:20.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:20 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:20.032+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:20.517 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:20 smithi007 podman[126936]: 2024-04-23 15:47:20.266038751 +0000 UTC m=+6.585723117 container cleanup 497956a28d7eabd9b37698a9f9909a693c9dda044fbb6c2afaf62c6322f3510c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:47:20.517 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:20 smithi007 bash[126936]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9 2024-04-23T15:47:20.835 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:20 smithi007 podman[126954]: 2024-04-23 15:47:20.516975139 +0000 UTC m=+0.650254879 container remove 497956a28d7eabd9b37698a9f9909a693c9dda044fbb6c2afaf62c6322f3510c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-23T15:47:21.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:20.763+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:21.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:20.763+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:21.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:20 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:20.763+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:21.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:21 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:21.028+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:21.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:21 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:21.028+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:21.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:21 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:21.028+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:21.649 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:21 smithi007 podman[127042]: 2024-04-23 15:47:21.290132959 +0000 UTC m=+0.038286826 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:47:21.649 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:21 smithi007 podman[127042]: 2024-04-23 15:47:21.392874214 +0000 UTC m=+0.141028087 container create 610f86b892be9e6fc4b48df5fba8d34dae6ac3e490af60693a901d8e064d69ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:47:21.649 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:21 smithi007 podman[127042]: 2024-04-23 15:47:21.648718333 +0000 UTC m=+0.396872249 container init 610f86b892be9e6fc4b48df5fba8d34dae6ac3e490af60693a901d8e064d69ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416) 2024-04-23T15:47:22.085 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:21 smithi007 podman[127042]: 2024-04-23 15:47:21.66096754 +0000 UTC m=+0.409121407 container start 610f86b892be9e6fc4b48df5fba8d34dae6ac3e490af60693a901d8e064d69ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-23T15:47:22.085 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:21 smithi007 podman[127042]: 2024-04-23 15:47:21.728466985 +0000 UTC m=+0.476620862 container attach 610f86b892be9e6fc4b48df5fba8d34dae6ac3e490af60693a901d8e064d69ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:47:22.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:21 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:21.750+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:22.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:21 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:21.750+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:22.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:21 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:21.750+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:22.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:22 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:22.023+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:22.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:22 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:22.023+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:22.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:22 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:22.023+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:22.477 INFO:journalctl@ceph.osd.9.smithi007.stdout:Apr 23 15:47:22 smithi007 podman[127042]: 2024-04-23 15:47:22.126336813 +0000 UTC m=+0.874490674 container died 610f86b892be9e6fc4b48df5fba8d34dae6ac3e490af60693a901d8e064d69ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-23T15:47:22.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.9.service' 2024-04-23T15:47:22.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:22.955 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-23T15:47:22.955 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-23T15:47:22.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.10 2024-04-23T15:47:23.035 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:22 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:22.737+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:23.035 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:22 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:22.737+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:23.035 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:22 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:22.737+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:23.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:23.019+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:23.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:23.019+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:23.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:23.019+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:23.418 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 systemd[1]: Stopping Ceph osd.10 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:23.918 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:23.538+0000 7f2780600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:23.918 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:23.538+0000 7f2780600700 -1 osd.10 187 *** Got signal Terminated *** 2024-04-23T15:47:23.918 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:23.538+0000 7f2780600700 -1 osd.10 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:47:23.918 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:23.777+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:23.919 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:23.777+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:23.919 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:23 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:23.777+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:24.284 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:23.985+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:24.284 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:23.985+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:24.284 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:23.985+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:25.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:24.821+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:25.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:24.821+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:25.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:24.821+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:25.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:24 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:24.821+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-04-23T15:46:19.112840+0000 front 2024-04-23T15:46:19.113181+0000 (oldest deadline 2024-04-23T15:47:23.812955+0000) 2024-04-23T15:47:25.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:24 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:24.955+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:25.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:24 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:24.955+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:25.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:24 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:24.955+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:26.133 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:25.831+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:26.133 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:25.831+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:26.133 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:25.831+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:26.133 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:25 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:25.831+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-04-23T15:46:19.112840+0000 front 2024-04-23T15:46:19.113181+0000 (oldest deadline 2024-04-23T15:47:23.812955+0000) 2024-04-23T15:47:26.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:25 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:25.963+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:26.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:25 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:25.963+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:26.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:25 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:25.963+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:27.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:26.801+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:27.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:26.801+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:27.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:26.801+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:27.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:26 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:26.801+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-04-23T15:46:19.112840+0000 front 2024-04-23T15:46:19.113181+0000 (oldest deadline 2024-04-23T15:47:23.812955+0000) 2024-04-23T15:47:27.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:27.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:27.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:27.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:27.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:27.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:28.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:27.794+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:48.703640+0000 front 2024-04-23T15:45:48.703780+0000 (oldest deadline 2024-04-23T15:46:55.006157+0000) 2024-04-23T15:47:28.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:27.794+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:55.007176+0000 front 2024-04-23T15:45:55.007416+0000 (oldest deadline 2024-04-23T15:47:04.408839+0000) 2024-04-23T15:47:28.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:27.794+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:08.511221+0000 front 2024-04-23T15:46:08.511587+0000 (oldest deadline 2024-04-23T15:47:13.210915+0000) 2024-04-23T15:47:28.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:27 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10[56157]: 2024-04-23T15:47:27.794+0000 7f2776e00700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-04-23T15:46:19.112840+0000 front 2024-04-23T15:46:19.113181+0000 (oldest deadline 2024-04-23T15:47:23.812955+0000) 2024-04-23T15:47:28.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:28 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:28.024+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:28.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:28 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:28.024+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:28.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:28 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:28.024+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:29.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:28 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:28.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:29.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:28 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:28.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:29.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:28 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:28.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:29.803 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:29 smithi137 podman[78485]: 2024-04-23 15:47:29.51656082 +0000 UTC m=+6.124369807 container died 147a6f1615202365b0498f38a992cf00d38d5eaaf60937ebc99cec0e4e17be04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5) 2024-04-23T15:47:30.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:29 smithi137 podman[78485]: 2024-04-23 15:47:29.948160828 +0000 UTC m=+6.555969859 container cleanup 147a6f1615202365b0498f38a992cf00d38d5eaaf60937ebc99cec0e4e17be04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:47:30.168 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:29 smithi137 bash[78485]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10 2024-04-23T15:47:30.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:30 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:30.008+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:30.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:30 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:30.008+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:30.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:30 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:30.008+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:30.668 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:30 smithi137 podman[78505]: 2024-04-23 15:47:30.207396926 +0000 UTC m=+0.675397518 container remove 147a6f1615202365b0498f38a992cf00d38d5eaaf60937ebc99cec0e4e17be04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-23T15:47:31.330 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:31 smithi137 podman[78593]: 2024-04-23 15:47:30.951690731 +0000 UTC m=+0.033848565 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:47:31.330 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:31 smithi137 podman[78593]: 2024-04-23 15:47:31.074890572 +0000 UTC m=+0.157048443 container create 10139293686fc582fb1bfec4f40eaa20e83ce6843987df980370c1ae78145e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:47:31.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:31.024+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:31.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:31.024+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:31.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:31.024+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:31.668 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:31 smithi137 podman[78593]: 2024-04-23 15:47:31.329385555 +0000 UTC m=+0.411543456 container init 10139293686fc582fb1bfec4f40eaa20e83ce6843987df980370c1ae78145e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-04-23T15:47:31.668 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:31 smithi137 podman[78593]: 2024-04-23 15:47:31.341263067 +0000 UTC m=+0.423420906 container start 10139293686fc582fb1bfec4f40eaa20e83ce6843987df980370c1ae78145e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-23T15:47:31.668 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:31 smithi137 podman[78593]: 2024-04-23 15:47:31.410727119 +0000 UTC m=+0.492885037 container attach 10139293686fc582fb1bfec4f40eaa20e83ce6843987df980370c1ae78145e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-23T15:47:32.137 INFO:journalctl@ceph.osd.10.smithi137.stdout:Apr 23 15:47:31 smithi137 podman[78593]: 2024-04-23 15:47:31.793085997 +0000 UTC m=+0.875243872 container died 10139293686fc582fb1bfec4f40eaa20e83ce6843987df980370c1ae78145e58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:47:32.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:31.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:32.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:31.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:32.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:31.994+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:32.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.10.service' 2024-04-23T15:47:32.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:32.567 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-23T15:47:32.567 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-23T15:47:32.567 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.11 2024-04-23T15:47:33.039 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:32 smithi186 systemd[1]: Stopping Ceph osd.11 for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.039+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.039+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.039+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.039+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-04-23T15:46:29.305785+0000 front 2024-04-23T15:46:29.305626+0000 (oldest deadline 2024-04-23T15:47:32.205132+0000) 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.103+0000 7ff654e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.103+0000 7ff654e00700 -1 osd.11 187 *** Got signal Terminated *** 2024-04-23T15:47:33.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:33 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:33.103+0000 7ff654e00700 -1 osd.11 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:47:34.365 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:34.059+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:34.365 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:34.059+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:34.365 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:34.059+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:34.366 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:34 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:34.059+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-04-23T15:46:29.305785+0000 front 2024-04-23T15:46:29.305626+0000 (oldest deadline 2024-04-23T15:47:32.205132+0000) 2024-04-23T15:47:35.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:35 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:35.037+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:35.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:35 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:35.037+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:35.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:35 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:35.037+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:35.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:35 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:35.037+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-04-23T15:46:29.305785+0000 front 2024-04-23T15:46:29.305626+0000 (oldest deadline 2024-04-23T15:47:32.205132+0000) 2024-04-23T15:47:36.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:36.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:36.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:36.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.009+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-04-23T15:46:29.305785+0000 front 2024-04-23T15:46:29.305626+0000 (oldest deadline 2024-04-23T15:47:32.205132+0000) 2024-04-23T15:47:37.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.991+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:37.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.991+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:37.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.991+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:37.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:36 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:36.991+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-04-23T15:46:29.305785+0000 front 2024-04-23T15:46:29.305626+0000 (oldest deadline 2024-04-23T15:47:32.205132+0000) 2024-04-23T15:47:38.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:37 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:37.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-04-23T15:45:46.691360+0000 front 2024-04-23T15:45:46.691551+0000 (oldest deadline 2024-04-23T15:46:51.292848+0000) 2024-04-23T15:47:38.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:37 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:37.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-04-23T15:45:59.398336+0000 front 2024-04-23T15:45:59.397611+0000 (oldest deadline 2024-04-23T15:47:02.297855+0000) 2024-04-23T15:47:38.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:37 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:37.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-04-23T15:46:07.000481+0000 front 2024-04-23T15:46:07.000409+0000 (oldest deadline 2024-04-23T15:47:11.100436+0000) 2024-04-23T15:47:38.364 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:37 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11[57869]: 2024-04-23T15:47:37.979+0000 7ff650600700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-04-23T15:46:29.305785+0000 front 2024-04-23T15:46:29.305626+0000 (oldest deadline 2024-04-23T15:47:32.205132+0000) 2024-04-23T15:47:39.112 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:38 smithi186 podman[81237]: 2024-04-23 15:47:38.840956407 +0000 UTC m=+5.883817134 container died 9e8e121bff3207532f3a245b323bcb50ad8b5196c19be01eac4fb92545f20771 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-23T15:47:39.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:39 smithi186 podman[81237]: 2024-04-23 15:47:39.229428577 +0000 UTC m=+6.272289298 container cleanup 9e8e121bff3207532f3a245b323bcb50ad8b5196c19be01eac4fb92545f20771 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T15:47:39.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:39 smithi186 bash[81237]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11 2024-04-23T15:47:39.863 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:39 smithi186 podman[81257]: 2024-04-23 15:47:39.40020426 +0000 UTC m=+0.540226607 container remove 9e8e121bff3207532f3a245b323bcb50ad8b5196c19be01eac4fb92545f20771 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:47:40.594 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:40 smithi186 podman[81348]: 2024-04-23 15:47:40.172728129 +0000 UTC m=+0.033275823 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:47:40.594 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:40 smithi186 podman[81348]: 2024-04-23 15:47:40.272836266 +0000 UTC m=+0.133383994 container create 8eff34808e7b3c3b45964a75ae899744ddeae7d946022f61f2e21e5d2a96ee0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:47:40.594 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:40 smithi186 podman[81348]: 2024-04-23 15:47:40.593041704 +0000 UTC m=+0.453589436 container init 8eff34808e7b3c3b45964a75ae899744ddeae7d946022f61f2e21e5d2a96ee0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-23T15:47:40.863 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:40 smithi186 podman[81348]: 2024-04-23 15:47:40.604208433 +0000 UTC m=+0.464756150 container start 8eff34808e7b3c3b45964a75ae899744ddeae7d946022f61f2e21e5d2a96ee0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:47:40.863 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:40 smithi186 podman[81348]: 2024-04-23 15:47:40.72520308 +0000 UTC m=+0.585750812 container attach 8eff34808e7b3c3b45964a75ae899744ddeae7d946022f61f2e21e5d2a96ee0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-23T15:47:41.363 INFO:journalctl@ceph.osd.11.smithi186.stdout:Apr 23 15:47:41 smithi186 podman[81348]: 2024-04-23 15:47:41.064934514 +0000 UTC m=+0.925482226 container died 8eff34808e7b3c3b45964a75ae899744ddeae7d946022f61f2e21e5d2a96ee0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240416) 2024-04-23T15:47:41.770 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@osd.11.service' 2024-04-23T15:47:41.875 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:41.876 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-23T15:47:41.876 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-23T15:47:41.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.a 2024-04-23T15:47:42.335 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:42 smithi007 systemd[1]: Stopping Ceph mds.a for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:42.835 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:42 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a[66934]: 2024-04-23T15:47:42.447+0000 7fe649000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:42.835 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:42 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a[66934]: 2024-04-23T15:47:42.447+0000 7fe649000700 -1 mds.a *** got signal Terminated *** 2024-04-23T15:47:46.007 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:45 smithi007 podman[127147]: 2024-04-23 15:47:45.749955458 +0000 UTC m=+3.416356115 container died 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-23T15:47:46.325 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:46 smithi007 podman[127147]: 2024-04-23 15:47:46.123912558 +0000 UTC m=+3.790313232 container cleanup 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T15:47:46.325 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:46 smithi007 bash[127147]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a 2024-04-23T15:47:46.585 INFO:journalctl@ceph.mds.a.smithi007.stdout:Apr 23 15:47:46 smithi007 podman[127161]: 2024-04-23 15:47:46.324876458 +0000 UTC m=+0.563929773 container remove 82e6793760b9169e1ff2346145a071aa90e74f2177a4dd6f7464c972dafc5f80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-23T15:47:46.807 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.a.service' 2024-04-23T15:47:46.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:46.921 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-23T15:47:46.921 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-23T15:47:46.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.d 2024-04-23T15:47:47.335 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:47 smithi007 systemd[1]: Stopping Ceph mds.d for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:47.796 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:47 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d[65867]: 2024-04-23T15:47:47.490+0000 7fb07f800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:47.796 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:47 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d[65867]: 2024-04-23T15:47:47.490+0000 7fb07f800700 -1 mds.d *** got signal Terminated *** 2024-04-23T15:47:49.011 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:48 smithi007 podman[127264]: 2024-04-23 15:47:48.712585657 +0000 UTC m=+1.358519054 container died 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-23T15:47:49.321 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:49 smithi007 podman[127264]: 2024-04-23 15:47:49.127955326 +0000 UTC m=+1.773888757 container cleanup 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:47:49.321 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:49 smithi007 bash[127264]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d 2024-04-23T15:47:49.585 INFO:journalctl@ceph.mds.d.smithi007.stdout:Apr 23 15:47:49 smithi007 podman[127289]: 2024-04-23 15:47:49.320496732 +0000 UTC m=+0.592994389 container remove 35522f579924450708240c03420611de1a46ac58c07b036b4d5e4c709e4cae42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True) 2024-04-23T15:47:49.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.d.service' 2024-04-23T15:47:50.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:50.002 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-23T15:47:50.002 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-23T15:47:50.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.g 2024-04-23T15:47:50.585 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:50 smithi007 systemd[1]: Stopping Ceph mds.g for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:51.085 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g[66568]: 2024-04-23T15:47:50.621+0000 7f16eb600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:51.086 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:50 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g[66568]: 2024-04-23T15:47:50.621+0000 7f16eb600700 -1 mds.g *** got signal Terminated *** 2024-04-23T15:47:54.070 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:53 smithi007 podman[127393]: 2024-04-23 15:47:53.739344366 +0000 UTC m=+3.228578739 container died 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-23T15:47:54.335 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:54 smithi007 podman[127393]: 2024-04-23 15:47:54.190049746 +0000 UTC m=+3.679284162 container cleanup 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-23T15:47:54.335 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:54 smithi007 bash[127393]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g 2024-04-23T15:47:54.835 INFO:journalctl@ceph.mds.g.smithi007.stdout:Apr 23 15:47:54 smithi007 podman[127407]: 2024-04-23 15:47:54.441297604 +0000 UTC m=+0.678581549 container remove 5620098a976b599886791697aa10e603f1a3f83d28ee8e7c117733479cdba8d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:47:54.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.g.service' 2024-04-23T15:47:55.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:47:55.109 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-23T15:47:55.109 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-23T15:47:55.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.j 2024-04-23T15:47:55.585 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:47:55 smithi007 systemd[1]: Stopping Ceph mds.j for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:47:56.085 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:47:55 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j[65485]: 2024-04-23T15:47:55.707+0000 7f9ecbc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:47:56.085 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:47:55 smithi007 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j[65485]: 2024-04-23T15:47:55.707+0000 7f9ecbc00700 -1 mds.j *** got signal Terminated *** 2024-04-23T15:48:00.013 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:47:59 smithi007 podman[127513]: 2024-04-23 15:47:59.739276293 +0000 UTC m=+4.155101889 container died fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-23T15:48:00.328 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:48:00 smithi007 podman[127513]: 2024-04-23 15:48:00.135306266 +0000 UTC m=+4.551131855 container cleanup fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True) 2024-04-23T15:48:00.328 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:48:00 smithi007 bash[127513]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j 2024-04-23T15:48:00.585 INFO:journalctl@ceph.mds.j.smithi007.stdout:Apr 23 15:48:00 smithi007 podman[127527]: 2024-04-23 15:48:00.327728831 +0000 UTC m=+0.567319255 container remove fe05c0a97db93561830f2c7030c3f86dbdee614905ea52bad432073e114692fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:48:00.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.j.service' 2024-04-23T15:48:00.992 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:00.992 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-23T15:48:00.992 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-23T15:48:00.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.b 2024-04-23T15:48:01.418 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:01 smithi137 systemd[1]: Stopping Ceph mds.b for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:01.918 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:01 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: 2024-04-23T15:48:01.628+0000 7f7480c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:01.918 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:01 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b[61801]: 2024-04-23T15:48:01.628+0000 7f7480c00700 -1 mds.b *** got signal Terminated *** 2024-04-23T15:48:05.918 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:05 smithi137 podman[78712]: 2024-04-23 15:48:05.650731259 +0000 UTC m=+4.191951653 container died 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-23T15:48:06.375 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:06 smithi137 podman[78712]: 2024-04-23 15:48:06.171532354 +0000 UTC m=+4.712752765 container cleanup 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416) 2024-04-23T15:48:06.375 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:06 smithi137 bash[78712]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b 2024-04-23T15:48:06.670 INFO:journalctl@ceph.mds.b.smithi137.stdout:Apr 23 15:48:06 smithi137 podman[78726]: 2024-04-23 15:48:06.374104898 +0000 UTC m=+0.695571170 container remove 4892ba5e8170551b4a7935d7c3539cbe586f56f06b93658ffa3602e5efd16a29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:48:06.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.b.service' 2024-04-23T15:48:06.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:06.962 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-23T15:48:06.962 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-23T15:48:06.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.e 2024-04-23T15:48:07.409 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:07 smithi137 systemd[1]: Stopping Ceph mds.e for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:07.668 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:07 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e[61184]: 2024-04-23T15:48:07.481+0000 7f5904c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:07.668 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:07 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e[61184]: 2024-04-23T15:48:07.481+0000 7f5904c00700 -1 mds.e *** got signal Terminated *** 2024-04-23T15:48:09.918 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:09 smithi137 podman[78834]: 2024-04-23 15:48:09.644257365 +0000 UTC m=+2.287627568 container died 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-23T15:48:10.327 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:10 smithi137 podman[78834]: 2024-04-23 15:48:10.116635139 +0000 UTC m=+2.760005336 container cleanup 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-23T15:48:10.327 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:10 smithi137 bash[78834]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e 2024-04-23T15:48:10.668 INFO:journalctl@ceph.mds.e.smithi137.stdout:Apr 23 15:48:10 smithi137 podman[78859]: 2024-04-23 15:48:10.325940183 +0000 UTC m=+0.661557306 container remove 95d0e96829631a6b9b3155138a0350ee44acf215c6e5e3408f5e8c3a96afd21c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-23T15:48:10.819 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.e.service' 2024-04-23T15:48:10.918 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:10.961 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-23T15:48:10.961 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-23T15:48:10.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.h 2024-04-23T15:48:11.418 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:11 smithi137 systemd[1]: Stopping Ceph mds.h for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:11.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h[61489]: 2024-04-23T15:48:11.550+0000 7f52fb000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:11.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:11 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h[61489]: 2024-04-23T15:48:11.550+0000 7f52fb000700 -1 mds.h *** got signal Terminated *** 2024-04-23T15:48:13.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:13 smithi137 podman[78965]: 2024-04-23 15:48:13.632007354 +0000 UTC m=+2.225170025 container stop 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-04-23T15:48:13.918 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:13 smithi137 podman[78965]: 2024-04-23 15:48:13.660595493 +0000 UTC m=+2.253758140 container died 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-23T15:48:14.397 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:14 smithi137 podman[78965]: 2024-04-23 15:48:14.128769212 +0000 UTC m=+2.721931906 container cleanup 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, ceph=True) 2024-04-23T15:48:14.397 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:14 smithi137 bash[78965]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h 2024-04-23T15:48:14.650 INFO:journalctl@ceph.mds.h.smithi137.stdout:Apr 23 15:48:14 smithi137 podman[78979]: 2024-04-23 15:48:14.396383254 +0000 UTC m=+0.741798948 container remove 58c48ee8b73cc55ac6fa5e9e20e91e5400e03afaf50921505840d73aa016ee76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-04-23T15:48:14.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.h.service' 2024-04-23T15:48:14.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:14.789 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-23T15:48:14.789 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-23T15:48:14.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.k 2024-04-23T15:48:15.364 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:14 smithi137 systemd[1]: Stopping Ceph mds.k for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:15.668 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:15 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k[60875]: 2024-04-23T15:48:15.362+0000 7f51b1c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:15.668 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:15 smithi137 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k[60875]: 2024-04-23T15:48:15.362+0000 7f51b1c00700 -1 mds.k *** got signal Terminated *** 2024-04-23T15:48:17.918 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:17 smithi137 podman[79086]: 2024-04-23 15:48:17.662798016 +0000 UTC m=+2.426116207 container died 40d91a7db09cb2e72c9f760a293a758202da9d2562a36bd140d15baffd138e11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:48:18.266 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:18 smithi137 podman[79086]: 2024-04-23 15:48:18.057438909 +0000 UTC m=+2.820757090 container cleanup 40d91a7db09cb2e72c9f760a293a758202da9d2562a36bd140d15baffd138e11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-23T15:48:18.267 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:18 smithi137 bash[79086]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k 2024-04-23T15:48:18.667 INFO:journalctl@ceph.mds.k.smithi137.stdout:Apr 23 15:48:18 smithi137 podman[79100]: 2024-04-23 15:48:18.266241352 +0000 UTC m=+0.584554148 container remove 40d91a7db09cb2e72c9f760a293a758202da9d2562a36bd140d15baffd138e11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:48:18.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.k.service' 2024-04-23T15:48:18.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:18.899 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-23T15:48:18.899 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-23T15:48:18.899 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.c 2024-04-23T15:48:19.363 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:19 smithi186 systemd[1]: Stopping Ceph mds.c for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:19.744 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c[62866]: 2024-04-23T15:48:19.451+0000 7f24d5a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:19.744 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:19 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c[62866]: 2024-04-23T15:48:19.451+0000 7f24d5a00700 -1 mds.c *** got signal Terminated *** 2024-04-23T15:48:21.809 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:21 smithi186 podman[81453]: 2024-04-23 15:48:21.444348912 +0000 UTC m=+2.130746428 container died 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:48:22.113 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:21 smithi186 podman[81453]: 2024-04-23 15:48:21.92773813 +0000 UTC m=+2.614135656 container cleanup 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-23T15:48:22.113 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:21 smithi186 bash[81453]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c 2024-04-23T15:48:22.613 INFO:journalctl@ceph.mds.c.smithi186.stdout:Apr 23 15:48:22 smithi186 podman[81477]: 2024-04-23 15:48:22.120523281 +0000 UTC m=+0.650855055 container remove 795c1a66aa2128ac9b72f74a7c5f46a0216eee0472e148f20549cf89ebbe8d6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-c, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-23T15:48:22.652 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.c.service' 2024-04-23T15:48:22.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:22.764 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-23T15:48:22.764 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-23T15:48:22.764 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.f 2024-04-23T15:48:23.363 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:22 smithi186 systemd[1]: Stopping Ceph mds.f for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:23.863 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f[62545]: 2024-04-23T15:48:23.397+0000 7f9f30200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:23.863 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:23 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f[62545]: 2024-04-23T15:48:23.397+0000 7f9f30200700 -1 mds.f *** got signal Terminated *** 2024-04-23T15:48:25.775 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:25 smithi186 podman[81584]: 2024-04-23 15:48:25.48002836 +0000 UTC m=+2.248835973 container died ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:48:26.113 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:25 smithi186 podman[81584]: 2024-04-23 15:48:25.898778022 +0000 UTC m=+2.667585651 container cleanup ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD) 2024-04-23T15:48:26.113 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:25 smithi186 bash[81584]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f 2024-04-23T15:48:26.589 INFO:journalctl@ceph.mds.f.smithi186.stdout:Apr 23 15:48:26 smithi186 podman[81597]: 2024-04-23 15:48:26.13617203 +0000 UTC m=+0.647000856 container remove ce9c0f36bf10cec959c2b99f6cd112bff0221f41488c5c376d65f2598a5b87d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-23T15:48:26.617 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.f.service' 2024-04-23T15:48:26.725 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:26.726 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-23T15:48:26.726 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-23T15:48:26.726 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.i 2024-04-23T15:48:27.326 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:26 smithi186 systemd[1]: Stopping Ceph mds.i for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:27.613 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i[63174]: 2024-04-23T15:48:27.325+0000 7fd9bec00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:27.613 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:27 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i[63174]: 2024-04-23T15:48:27.325+0000 7fd9bec00700 -1 mds.i *** got signal Terminated *** 2024-04-23T15:48:29.845 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:29 smithi186 podman[81705]: 2024-04-23 15:48:29.480858778 +0000 UTC m=+2.264783355 container died a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-23T15:48:30.113 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:29 smithi186 podman[81705]: 2024-04-23 15:48:29.960250702 +0000 UTC m=+2.744175282 container cleanup a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:48:30.113 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:29 smithi186 bash[81705]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i 2024-04-23T15:48:30.613 INFO:journalctl@ceph.mds.i.smithi186.stdout:Apr 23 15:48:30 smithi186 podman[81719]: 2024-04-23 15:48:30.153442516 +0000 UTC m=+0.661942354 container remove a2c22858d05418952a50888b460fb83d1fefc3147ab1caa09915a2a4b83b5281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-04-23T15:48:30.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.i.service' 2024-04-23T15:48:30.827 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:30.828 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-23T15:48:30.828 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-23T15:48:30.828 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.l 2024-04-23T15:48:31.363 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:30 smithi186 systemd[1]: Stopping Ceph mds.l for 7b70c844-017e-11ef-bc93-c7b262605968... 2024-04-23T15:48:31.863 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l[62236]: 2024-04-23T15:48:31.453+0000 7f7cc5400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:48:31.863 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:31 smithi186 ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l[62236]: 2024-04-23T15:48:31.453+0000 7f7cc5400700 -1 mds.l *** got signal Terminated *** 2024-04-23T15:48:33.780 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:33 smithi186 podman[81824]: 2024-04-23 15:48:33.491722832 +0000 UTC m=+2.189475286 container died e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-23T15:48:34.113 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:33 smithi186 podman[81824]: 2024-04-23 15:48:33.889176489 +0000 UTC m=+2.586928973 container cleanup e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, ceph=True) 2024-04-23T15:48:34.113 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:33 smithi186 bash[81824]: ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l 2024-04-23T15:48:34.523 INFO:journalctl@ceph.mds.l.smithi186.stdout:Apr 23 15:48:34 smithi186 podman[81838]: 2024-04-23 15:48:34.206856195 +0000 UTC m=+0.699775116 container remove e41884369ddb9f21c65c9b79c1252cbee5519df50190b2935c8f04c5a2592723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7b70c844-017e-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-23T15:48:34.557 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7b70c844-017e-11ef-bc93-c7b262605968@mds.l.service' 2024-04-23T15:48:34.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:48:34.668 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-23T15:48:34.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T15:48:34.997 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T15:48:40.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T15:48:40.458 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T15:48:45.476 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T15:48:45.807 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T15:48:50.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:48:50.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:48:50.952 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:48:51.078 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-23T15:48:51.080 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi007/crash 2024-04-23T15:48:51.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash -- . 2024-04-23T15:48:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T15:48:51.176 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-04-23T15:48:51.179 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi137/crash 2024-04-23T15:48:51.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash -- . 2024-04-23T15:48:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T15:48:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2024-04-23T15:48:51.283 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi186/crash 2024-04-23T15:48:51.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash -- . 2024-04-23T15:48:51.416 INFO:teuthology.orchestra.run.smithi186.stderr:tar: /var/lib/ceph/7b70c844-017e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T15:48:51.416 INFO:teuthology.orchestra.run.smithi186.stderr:tar: Error is not recoverable: exiting now 2024-04-23T15:48:51.421 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-23T15:48:51.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-23T15:48:51.592 INFO:tasks.cephadm:Compressing logs... 2024-04-23T15:48:51.592 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T15:48:51.597 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T15:48:51.605 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T15:48:51.681 INFO:teuthology.orchestra.run.smithi186.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-23T15:48:51.681 INFO:teuthology.orchestra.run.smithi186.stderr:: No such file or directory 2024-04-23T15:48:51.682 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log 2024-04-23T15:48:51.682 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-23T15:48:51.683 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-23T15:48:51.683 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-23T15:48:51.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-23T15:48:51.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T15:48:51.686 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-23T15:48:51.687 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-23T15:48:51.688 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-23T15:48:51.688 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-23T15:48:51.689 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-23T15:48:51.690 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-23T15:48:51.691 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T15:48:51.691 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-04-23T15:48:51.692 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-23T15:48:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log 2024-04-23T15:48:51.693 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-23T15:48:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T15:48:51.694 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T15:48:51.694 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-23T15:48:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-23T15:48:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-23T15:48:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log 2024-04-23T15:48:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-23T15:48:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-23T15:48:51.698 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-23T15:48:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T15:48:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-23T15:48:51.699 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-23T15:48:51.699 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-23T15:48:51.700 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-23T15:48:51.700 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-23T15:48:51.701 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-23T15:48:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-23T15:48:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-23T15:48:51.702 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-23T15:48:51.703 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-23T15:48:51.703 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T15:48:51.703 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T15:48:51.704 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-23T15:48:51.704 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-23T15:48:51.704 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T15:48:51.705 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-23T15:48:51.705 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T15:48:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T15:48:51.706 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-23T15:48:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-23T15:48:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-23T15:48:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-23T15:48:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.d.log: /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.9.log: 94.4% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-23T15:48:51.716 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-04-23T15:48:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.b.log: /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.k.log: 93.3% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-23T15:48:51.718 INFO:teuthology.orchestra.run.smithi007.stderr: 94.4% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-23T15:48:51.746 INFO:teuthology.orchestra.run.smithi007.stderr: 85.3% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T15:48:51.776 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.l.log: 85.2% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T15:48:51.797 INFO:teuthology.orchestra.run.smithi186.stderr: 93.4% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-23T15:48:51.810 INFO:teuthology.orchestra.run.smithi137.stderr: 85.3% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T15:48:51.815 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T15:48:51.819 INFO:teuthology.orchestra.run.smithi186.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T15:48:51.855 INFO:teuthology.orchestra.run.smithi186.stderr: 88.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T15:48:51.869 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T15:48:51.886 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T15:48:51.960 INFO:teuthology.orchestra.run.smithi137.stderr: 90.6% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T15:48:51.986 INFO:teuthology.orchestra.run.smithi186.stderr: 90.6% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T15:48:52.014 INFO:teuthology.orchestra.run.smithi007.stderr: 90.4% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T15:48:52.098 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T15:48:52.164 INFO:teuthology.orchestra.run.smithi186.stderr: 90.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T15:48:52.916 INFO:teuthology.orchestra.run.smithi186.stderr: 94.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-23T15:48:53.081 INFO:teuthology.orchestra.run.smithi186.stderr: 94.6% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-23T15:48:53.336 INFO:teuthology.orchestra.run.smithi007.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T15:48:53.369 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-23T15:48:53.413 INFO:teuthology.orchestra.run.smithi137.stderr: 93.5% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-23T15:48:53.486 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-23T15:48:53.923 INFO:teuthology.orchestra.run.smithi186.stderr: 93.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-23T15:48:55.730 INFO:teuthology.orchestra.run.smithi007.stderr: 94.6% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-23T15:48:56.875 INFO:teuthology.orchestra.run.smithi007.stderr: 94.7% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-23T15:48:57.412 INFO:teuthology.orchestra.run.smithi186.stderr: 91.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-23T15:48:57.642 INFO:teuthology.orchestra.run.smithi186.stderr: 93.4% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-23T15:48:58.070 INFO:teuthology.orchestra.run.smithi137.stderr: 91.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-23T15:49:04.846 INFO:teuthology.orchestra.run.smithi007.stderr: 90.2% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-23T15:49:28.263 INFO:teuthology.orchestra.run.smithi007.stderr: 90.1% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-23T15:49:33.754 INFO:teuthology.orchestra.run.smithi137.stderr: 93.1% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-23T15:54:55.940 INFO:teuthology.orchestra.run.smithi137.stderr: 92.0% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-23T15:55:39.662 INFO:teuthology.orchestra.run.smithi186.stderr: 92.0% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-23T15:56:48.238 INFO:teuthology.orchestra.run.smithi137.stderr: 91.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-23T15:57:27.399 INFO:teuthology.orchestra.run.smithi186.stderr: 91.9% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-23T15:57:29.664 INFO:teuthology.orchestra.run.smithi137.stderr: 91.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-23T15:57:49.954 INFO:teuthology.orchestra.run.smithi137.stderr: 91.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-23T15:57:49.958 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-23T15:57:49.958 INFO:teuthology.orchestra.run.smithi137.stderr:real 8m58.308s 2024-04-23T15:57:49.958 INFO:teuthology.orchestra.run.smithi137.stderr:user 12m48.028s 2024-04-23T15:57:49.958 INFO:teuthology.orchestra.run.smithi137.stderr:sys 1m26.438s 2024-04-23T15:57:57.884 INFO:teuthology.orchestra.run.smithi186.stderr: 91.8% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-23T15:58:46.944 INFO:teuthology.orchestra.run.smithi186.stderr: 91.7% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-23T15:58:46.947 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-04-23T15:58:46.947 INFO:teuthology.orchestra.run.smithi186.stderr:real 9m55.295s 2024-04-23T15:58:46.947 INFO:teuthology.orchestra.run.smithi186.stderr:user 12m10.943s 2024-04-23T15:58:46.947 INFO:teuthology.orchestra.run.smithi186.stderr:sys 1m21.644s 2024-04-23T16:06:21.302 INFO:teuthology.orchestra.run.smithi007.stderr: 91.7% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-23T16:06:44.547 INFO:teuthology.orchestra.run.smithi007.stderr: 91.5% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-23T16:07:35.864 INFO:teuthology.orchestra.run.smithi007.stderr: 91.7% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-23T16:11:09.078 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% -- replaced with /var/log/ceph/7b70c844-017e-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-23T16:11:56.247 INFO:teuthology.orchestra.run.smithi007.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-23T16:11:56.252 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-23T16:11:56.253 INFO:teuthology.orchestra.run.smithi007.stderr:real 23m4.610s 2024-04-23T16:11:56.253 INFO:teuthology.orchestra.run.smithi007.stderr:user 25m48.794s 2024-04-23T16:11:56.253 INFO:teuthology.orchestra.run.smithi007.stderr:sys 3m21.619s 2024-04-23T16:11:56.254 INFO:tasks.cephadm:Archiving logs... 2024-04-23T16:11:56.255 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi007/log 2024-04-23T16:11:56.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T16:13:29.485 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi137/log 2024-04-23T16:13:29.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T16:14:30.269 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi186/log 2024-04-23T16:14:30.270 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T16:15:29.955 INFO:tasks.cephadm:Removing cluster... 2024-04-23T16:15:29.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --force 2024-04-23T16:15:30.656 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T16:15:32.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --force 2024-04-23T16:15:33.545 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T16:15:35.481 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7b70c844-017e-11ef-bc93-c7b262605968 --force 2024-04-23T16:15:36.019 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: 7b70c844-017e-11ef-bc93-c7b262605968 2024-04-23T16:15:37.781 INFO:tasks.cephadm:Removing cephadm ... 2024-04-23T16:15:37.782 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T16:15:37.846 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T16:15:37.904 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T16:15:37.959 INFO:tasks.cephadm:Teardown complete 2024-04-23T16:15:37.960 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T16:15:37.983 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T16:15:37.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T16:15:37.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T16:15:38.002 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T16:15:38.419 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T16:15:38.431 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T16:15:38.432 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T16:15:38.440 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T16:15:38.449 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T16:15:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-04-23T16:15:38.495 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-23T16:15:38.504 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-04-23T16:15:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T16:15:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-23T16:15:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:^- hv01.front.sepia.ceph.com 2 6 377 21 +2091us[+2091us] +/- 575ms 2024-04-23T16:15:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -332us[ -323us] +/- 54ms 2024-04-23T16:15:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +522us[ +531us] +/- 86ms 2024-04-23T16:15:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T16:15:38.599 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T16:15:38.599 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-04-23T16:15:38.599 INFO:teuthology.orchestra.run.smithi007.stdout:^- hv01.front.sepia.ceph.com 2 6 377 20 +2074us[+2074us] +/- 575ms 2024-04-23T16:15:38.599 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv02.front.sepia.ceph.com 3 7 377 86 -292us[ -299us] +/- 54ms 2024-04-23T16:15:38.599 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +518us[ +518us] +/- 86ms 2024-04-23T16:15:38.599 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T16:15:38.616 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T16:15:38.616 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-23T16:15:38.616 INFO:teuthology.orchestra.run.smithi186.stdout:^- hv01.front.sepia.ceph.com 2 6 377 21 +2071us[+2077us] +/- 575ms 2024-04-23T16:15:38.617 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -325us[ -319us] +/- 54ms 2024-04-23T16:15:38.617 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +508us[ +508us] +/- 86ms 2024-04-23T16:15:38.617 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T16:15:38.620 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T16:15:38.638 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T16:15:38.640 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T16:15:38.669 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T16:15:38.999 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T16:15:39.254 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T16:15:39.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T16:15:39.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T16:15:39.620 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T16:15:39.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T16:15:39.712 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T16:15:39.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T16:15:39.805 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T16:15:39.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T16:15:39.850 INFO:teuthology.task.internal:Duration was 6627.674330 seconds 2024-04-23T16:15:39.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T16:15:39.900 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T16:15:39.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T16:15:39.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T16:15:39.917 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T16:15:40.072 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T16:15:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T16:15:40.084 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T16:15:40.528 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T16:15:40.529 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-04-23T16:15:40.529 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T16:15:40.609 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T16:15:40.609 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T16:15:40.693 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-04-23T16:15:40.693 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T16:15:40.767 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T16:15:40.768 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T16:15:40.776 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T16:15:40.783 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T16:15:40.869 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T16:15:40.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T16:15:40.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T16:15:40.881 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T16:15:41.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T16:15:41.460 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T16:15:41.461 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T16:15:41.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T16:15:41.645 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T16:15:41.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T16:15:41.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T16:15:41.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T16:15:41.763 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T16:15:41.863 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-04-23T16:15:41.880 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-04-23T16:15:41.883 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-04-23T16:15:41.937 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T16:15:41.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T16:15:41.992 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T16:15:42.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T16:15:42.048 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T16:15:42.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T16:15:42.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T16:15:42.116 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T16:15:42.118 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi007 2024-04-23T16:15:42.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T16:15:42.228 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi137 2024-04-23T16:15:42.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T16:15:42.328 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669558/remote/smithi186 2024-04-23T16:15:42.328 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T16:15:42.433 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T16:15:42.434 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T16:15:42.442 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T16:15:42.450 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T16:15:42.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T16:15:42.519 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T16:15:42.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T16:15:42.560 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T16:15:42.560 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T16:15:42.568 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T16:15:42.575 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T16:15:42.621 INFO:teuthology.orchestra.run.smithi007.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 16:15 /home/ubuntu/cephtest 2024-04-23T16:15:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 16:15 /home/ubuntu/cephtest 2024-04-23T16:15:42.633 INFO:teuthology.orchestra.run.smithi186.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 16:15 /home/ubuntu/cephtest 2024-04-23T16:15:42.636 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T16:15:42.652 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T16:15:42.740 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} duration: 6627.674329519272 flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.c-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology success: true 2024-04-23T16:15:42.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T16:15:42.827 INFO:teuthology.run:pass